Senior Data Engineer

Posted 6 Hours Ago
Be an Early Applicant
Leeds, West Yorkshire, England, GBR
Hybrid
Senior level
Information Technology • Consulting
The Role
Build and operate reliable data pipelines for a large-scale migration. Responsibilities include ingesting and validating data from multiple sources, transforming it into consistent structures, developing SQL, Python, PySpark, and dbt solutions, implementing automated quality checks, monitoring and recovering failed processing, and maintaining auditable transformation and security records. The role requires cloud data engineering experience, distributed processing, orchestration, Delta Lake, and infrastructure-as-code expertise.
Summary Generated by Built In
Company Description

Netcompany is one of Europe’s leading technology partners, with more than 9,500 colleagues delivering digital solutions for governments, critical industries and businesses across Europe. We take responsibility for the full journey, from strategy and development to daily operations. As Europe’s leader in sovereign AI, we build technology on Europe’s own terms.

AI is a natural part of how we build solutions. We use it in business-critical systems through a proven delivery model where human judgement, transparency, security and accountability matter from design to daily operations. AI-related roles include roles clearly involving AI, machine learning, data science, generative AI, LLMs, AI automation, AI governance or AI architecture.

Job Description

Build the data foundations for a large-scale migration. You'll design and operate repeatable pipelines that move varied source data into a single platform, taking ownership of data processing from ingestion to delivery. 

Key responsibilities

  • You'll work as part of a migration team, collaborating with the data lead, analysts, the platform team and source organisations throughout the delivery.
  • Build repeatable processes to receive, unpack, validate and ingest data from multiple sources.
  • Transform source extracts into consistent structures for migration to a single platform.
  • Develop maintainable ingestion and transformation code using SQL, Python, PySpark and dbt.
  • Implement automated checks that establish completeness and accuracy throughout the migration.
  • Monitor, diagnose and recover failed or incomplete data processing.
  • Maintain auditable records of data sources, mappings, transformations and outcomes, and apply agreed controls for secure data handling.

Qualifications

  • You bring hands-on experience building and operating data pipelines, with the technical skills to deliver reliable data processing in a structured migration environment.
  • Hands-on experience building and operating data pipelines on Azure, AWS or Google Cloud.
  • Experience with Spark, PySpark, Databricks or comparable distributed processing technologies.
  • Experience building modular, tested and documented transformations using dbt or an equivalent approach.
  • Strong SQL and Python skills for writing and troubleshooting transformations, validation and reconciliation queries.
  • Experience scheduling, monitoring and recovering pipelines using cloud-native or equivalent orchestration tools.
  • Experience with Delta Lake, including transactional tables, schema changes and repeatable batch loading.
  • Experience using Terraform or equivalent infrastructure as code to provision and maintain consistent cloud environments.

Build on your experience and keep developing

Your development continues through the responsibility you take, the projects you lead and the people you learn from. As part of a structured career model, you’ll build on the experience you already bring, supported by a personal mentor from the leadership group who can help guide your professional development, career direction and personal goals.

Be part of a shared community

Community is built through the way we work together. You’ll join teams where collaboration, trust and support are part of everyday work. We bring together colleagues with different backgrounds, identities, cultures and experiences, ensuring everyone is met with respect and has equal opportunities to develop and thrive.

Driven by responsible digitalisation

We believe digitalisation creates the most value when it is done responsibly. We build solutions that are secure, transparent, and designed to create lasting impact for people, businesses, and society. Responsibility is embedded in how we design, develop, and deliver every solution.

Additional Information

Benefits include

  • Hybrid working model with some flexible working
  • 25 days’ holiday
  • Private Medical Health care via Vitality
  • Pension contribution, Life Assurance
  • Professional certifications supported as part of learning and development.
  • A range of retail discounts to enhance your lifestyle, encompassing restaurants, supermarkets, travel, leisure activities and health and well-being services.
  • Access to our Employee Resource Groups, our groups represent diverse backgrounds and provide a platform for colleagues to connect, learn, and support one another.

Company information

We pride ourselves on our entrepreneurial spirit and our capacity for doing things differently. Our culture is built on fostering low bureaucracy, emphasizing high agility and promoting flexibility, enabling everyone to contribute their best.

Netcompany is committed to providing an inclusive and barrier-free recruitment process for anyone wishing to apply for a job with us. We operate a Disability Confident Interview Scheme which means that we offer guaranteed interviews to all applicants with a disability who meet the minimum criteria for a role. Applicants are asked to opt in, so please let us know if you wish your application to be considered under this scheme.

If you need any reasonable adjustments or extra support during the recruitment process, please contact us at [email protected].

#LI-JD1

Skills Required

  • Hands-on experience building and operating data pipelines in a structured migration environment
  • Hands-on experience building and operating data pipelines on Azure, AWS, or Google Cloud
  • Experience with Spark, PySpark, Databricks, or comparable distributed processing technologies
  • Experience building modular, tested, and documented transformations using dbt or an equivalent approach
  • Strong SQL and Python skills for transformations, validation, and reconciliation queries
  • Experience scheduling, monitoring, and recovering pipelines using cloud-native or equivalent orchestration tools
  • Experience with Delta Lake, including transactional tables, schema changes, and repeatable batch loading
  • Experience using Terraform or equivalent infrastructure-as-code tools to provision and maintain consistent cloud environments
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Copenhagen
6,701 Employees
Year Founded: 2000

What We Do

Netcompany is the fastest growing and most successful IT service company in Northern Europe. Today, we lead the way with digitalisation in Northern Europe, building modern IT solutions and introducing advanced use of technology for large global customer, side by side in agile teams. Netcompany leads the way in the next generation of IT consulting, with keen focus on Customer Value, Speed and Guaranteed delivery. We build IT solutions through agile delivery methods with speed to market. Our solutions are based on modern legacy free technology and industry standards. We build scalable robust solutions that will adapt to changing business needs, fully anchored in the organization. We know what it takes to build, operate and maintain IT solutions across all sectors and industries. We constantly challenge and innovate, and ensure that Development and Operations resources work together to ensure stability with speed. Netcompany’s vision is to be the leading digital Challenger in Northern Europe. We help Northern European businesses become future digital winners. The clients of Netcompany are large companies from a diverse array of industries and the public sector. Current and recent clients include: Danish Customs and Tax Administration (SKAT), ATP, Carlsberg, Royal Danish Ministry of Foreign Affairs, Ørsted, Airbus, Ministry of Justice (UK), Sodexo, Oslo Local Authority and Post Nord to name a few. We are headquartered in Copenhagen and besides the offices in Denmark, we are located in UK, Netherlands, Poland, Norway and Vietnam, with an employee count of more than 6500+. Privacy policy: https://www.netcompany.com/int/Privacy-Policy

Similar Jobs

Wise Logo Wise

Senior Data Engineer

Fintech • Mobile • Payments • Software • Financial Services
Hybrid
London, Greater London, England, GBR
9000 Employees

Wise Logo Wise

Senior Software Engineer

Fintech • Mobile • Payments • Software • Financial Services
Hybrid
London, England, GBR
9000 Employees
111K-145K Annually

Wise Logo Wise

Senior Data Engineer

Fintech • Mobile • Payments • Software • Financial Services
Hybrid
London, Greater London, England, GBR
9000 Employees
111K-145K Annually

Netcompany Logo Netcompany

Senior Data Engineer

Information Technology • Consulting
Hybrid
London, England, GBR
6701 Employees

Similar Companies Hiring

NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Austin, TX
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account