We are seeking a Senior Data Engineer with strong SQL and Java expertise to design and deliver scalable data solutions.
In this role, you will leverage Java's robustness and Scala's functional data-processing power to build scalable pipelines, manage distributed big data frameworks, and optimize our data platform.
Location: 3days/w onsite in Glasgow
Key Responsibilities
- Design, develop, and maintain scalable data pipelines to support data integration, transformation, and analytics requirements.
- Write efficient, high-performance SQL queries, stored procedures, and data transformation logic.
- Build and maintain backend data processing applications using Java.
- Develop scalable APIs and microservices architectures.
- Work with batch and near real-time data processing frameworks to deliver reliable data solutions.
- Optimise data models, database performance, and query execution.
- Collaborate with data architects, analysts, and business stakeholders to translate requirements into scalable data solutions.
- Implement automated testing, monitoring, and data quality controls across the data platform.
Requirements
Essential Skills & Experience
• Java: 5+ years of professional experience with Java (Version 11 or higher preferred).
• Advanced SQL skills with experience in performance tuning, data modelling, and complex query development.
• Strong Java development experience, including object-oriented design and enterprise application development.
• Experience designing and developing ETL/ELT pipelines.
• Experience working with relational databases such as PostgreSQL, SQL Server, Oracle, or MySQL.
• Understanding of data warehousing concepts and dimensional modelling.
• Experience with version control systems such as Git.
• Knowledge of cloud-based data platforms and modern data engineering practices.
Desirable Skills
• Experience with Scala development.
• Experience with Apache Spark or other distributed data processing frameworks.
• Experience with Kafka, Event Hubs, or other streaming technologies.
• Exposure to cloud platforms such as Azure, AWS, or GCP.
• Experience with CI/CD pipelines and DevOps practices.
• Familiarity with data lake and lakehouse architectures.
• Experience in banking or financial services industry
Benefits
Benefits
By joining us you can expect
- Autonomy to develop and grow your skills and experience
- Be part of exciting project work that is making a difference in society
- Strong, inspiring and thought-provoking leadership
- A supportive and collaborative environment
As well as this, we offer:
- Development access to LinkedIn Learning, a management development programme and training
- Wellness 24/7 Confidential employee assistance programme
- Social - Breakfast Tuesdays, Thirsty Thursdays and Pizza on the last Thursday of each month as well as commitment to charitable causes
- Time off 25 days a year; plus the opportunity to purchase extra leave per year
- Pension Salary Exchange Scheme with 4% employer contribution and 5% employee contribution
- Life Assurance of 4 times base salary
- Private Medical Insurance which is non-contributory (spouse and dependants included)
- Worldwide Travel Insurance which is non-contributory (spouse and dependants included)
Skills Required
- Java (version 11+) with 5+ years professional experience
- Advanced SQL skills including performance tuning and complex query development
- Experience designing and developing ETL/ELT pipelines
- Experience with relational databases (PostgreSQL, SQL Server, Oracle, MySQL)
- Understanding of data warehousing concepts and dimensional modelling
- Experience with version control systems such as Git
- Knowledge of cloud-based data platforms and modern data engineering practices
- Strong Java development experience including object-oriented design and enterprise application development
- Experience with Scala development
- Experience with Apache Spark or other distributed data processing frameworks
- Experience with Kafka, Event Hubs, or other streaming technologies
- Exposure to cloud platforms such as Azure, AWS, or GCP
- Experience with CI/CD pipelines and DevOps practices
- Familiarity with data lake and lakehouse architectures
- Experience in banking or financial services industry
What We Do
Methods is the leading digital transformation partner for the UK public sector. We care deeply about making our public services better and have been doing this for 28 years. Methods partners with a range of central government departments and agencies to transform the way public sector operates in the UK. Our mission is to help safeguard public-facing services and apply digital thinking to make sure the future of our public services is centred around citizens. Committed to having social impact, we enjoy an enviable track record of delivering real savings and benefits. We do this by helping you move from vertically integrated legacy infrastructure to a platform business model – allowing you to keep infrastructure costs low and focus on doing what you do best i.e. delivering front-end services. With Methods, you access a range of specialist skills and industry expertise to transform your organisation for the digital age, break free of expensive suppliers, and take control of your customer relationships and operating model. Further information on Methods Group can be found at www.methods.co.uk.
.png)
