Data Engineer

Posted 2 Days Ago
Be an Early Applicant
Kraków, Małopolskie, POL
In-Office
Mid level
Fintech • Payments • Financial Services
The Role
Build and operate production-grade batch and real-time data pipelines on GCP (BigQuery, Airflow, Kafka), ensure data quality via contracts and observability, develop connectors and integrations, support ML feature pipelines, and mentor junior engineers while contributing to engineering standards and CI/CD practices.
Summary Generated by Built In

Job Title

Data Engineer

Job Description

Compensation details will be shared by the recruiter during the first interview.

So, who are we? 
IG Group is a FTSE 100 fintech operating across five continents, serving over 1.3m customers and handling billions of dollars in transactions – built on scale, trust, and proof.

We didn't pivot to innovation; it's how we've always operated. What that means for the people who work here is real: genuinely complex problems to solve, the technology and resources to tackle them properly, and the kind of scope that's rare in established businesses.

The bar is high – bring a curious and forward-thinking mindset and we'll give you the platform to define what comes next. Join us at IG – the future gets built here. 

 

Your team 

 IG’s Data function is a central capability serving both central and divisional business lines across the entire IG estate. The Data Engineering team is responsible for the platforms that underpin analytics, reporting, compliance, and client-facing data products, and that will increasingly power AI and machine-learning use cases across the firm. 

The current data landscape reflects IG’s growth: a combination of GCP-native capabilities, onpremises systems, and a legacy AWS data platform. The strategic direction — endorsed by the CDO and Executive — is clear: consolidate onto GCP, raise the bar on data quality, and enable self-service access to trusted data for teams across the business.  

 
Your role in the Team’s Success 

As a Data Engineer, build, and operate the data pipelines and platform capabilities that power IG’s analytics, compliance, and AI ambitions. Working within a squad led by the Data Engineering Team Lead, you will be a key technical contributor to IG’s GCP consolidation programme — tackling complex ingestion, transformation, and reliability challenges with a high standard of craft. You will also play a meaningful role in raising the bar for the wider team: mentoring junior engineers, championing data quality, and helping to define how the squad builds and operates at scale. 

  

What you’ll do 

  • Design and build robust batch and real-time data pipelines on GCP, including Kafka-based event streams, BigQuery transformations, and Airflow-orchestrated workflows, as part of the GCP consolidation and Medallion architecture build-out 

  • Own data quality within your delivery area: define and implement data contracts, quality checks, and observability instrumentation so that pipeline health is visible and SLAs are met 

  • Develop and maintain in-house connectors and third-party native integrations that form part of IG’s ingestion estate, ensuring resilience, monitoring, and long-term maintainability 

  • Contribute to engineering standards and best practices across the squad — including code review, dbt modelling patterns, CI/CD pipeline hygiene, and change control for shared datasets 

  • Support feature engineering and model data pipelines for Data Science, and help lay the foundations for AI-ready data — including lineage, reproducibility, and freshness guarantees for ML workloads 

 

What you’ll need for this role 

  • Proven hands-on experience building and operating production-grade data pipelines on GCP — including BigQuery, Cloud Composer/Airflow, GCS, and Cloud Run — with strong SQL and Python skills 

  • Solid experience with Apache Kafka or equivalent streaming technologies, including designing event-driven ingestion patterns and troubleshooting real-time data flows under operational conditions 

  • Familiarity with modern transformation tooling, particularly dbt, and an appreciation of Medallion (Bronze/Silver/Gold) architecture patterns and how they support self-service analytics 

  • A quality-first mindset: experience implementing data contracts, lineage tracking, observability tooling, and pipeline SLO monitoring in a production environment 

  • Comfortable working in a regulated financial services environment, with an understanding of data governance requirements (lineage, access control, audit trails) and the discipline to operate within change control processes 

How we work

We try to take a thoughtful approach to our ways of working as a company. We follow a hybrid working model with 3 days in the office – which we think balances the need to collaborate effectively and connect with each other. When it comes to how we deliver, there are 5 things we want everyone to do to drive high performance, better learning and career satisfaction: 

  • Lead and Inspire: Drives trust, alignment, and enthusiasm 

  • Think Big: Focus on the problems that most impact commercial outcomes 

  • Champion the client: Understand and prioritise client's needs 

  • Deliver at pace: Push for fast, sustainable growth;  

  • Raise the bar: Take ownership, be accountable and share feedback 

 

We believe that diversity is vital to success, it fuels creativity, drives innovation and sets us up for global success. We’re committed to building teams with a variety of perspectives and skills to help us realise our vision and strategy, that’s why we encourage applications from people with diverse backgrounds and experiences to join us on this journey. Learn more about our D&I approach here. 

 

The Perks

Your growth fuels our success! Thrive with tailored development programs, mentoring opportunities with leaders, and clear career progression. Expand your network through committees, sports and social clubs. Enjoy extra time off for volunteering and community work.  

  • Home office equipment reimbursement   

  • Performance relate bonus 

  • Private medical cover for you and your family/partner (Medicover) 

  • Multikafeteria system (you can choose a multisport card, vouchers, etc.)  

  • Life insurance (Generali)  

  • LinkedIn Learning platform free access 

  • Share Plans for Employees 

  • Well-being events as well as Employee Assistance Programme 

  • Summer picnic, New Year party and other social events   

  • Three additional days off a year - one to celebrate your Birthday and two for voluntary work 

  • App-based parking spots booking system 

  • Stretching sessions 

 
Learn more about the Perks here! 
 

Join us for this exciting journey. Apply now!

Number of openings

1

Skills Required

  • Hands-on experience building and operating production-grade data pipelines on GCP (BigQuery, Cloud Composer/Airflow, GCS, Cloud Run)
  • Strong SQL skills
  • Strong Python skills
  • Experience with Apache Kafka or equivalent streaming technologies
  • Familiarity with dbt and Medallion (Bronze/Silver/Gold) architecture patterns
  • Experience implementing data contracts, lineage tracking, observability tooling, and pipeline SLO monitoring
  • Understanding of data governance requirements in regulated financial services (lineage, access control, audit trails) and working within change control processes
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: London
2,748 Employees

What We Do

We’ve been at the forefront of trading innovation since 1974, taking on the challenge to deliver an unmatched experience for our clients and raise the bar for tomorrow’s opportunities. Today, we’re a global fintech company incorporating the IG, tasty, IG Prime, Spectrum and DailyFX brands, with a presence in 18 countries across five continents – Europe, North America, Africa, Asia-Pacific and the Middle East. We’re an organisation of positive problem-solvers, united and inspired by our purpose, which is to power the pursuit of financial freedom for the ambitious. Our award-winning products and platforms empower go-getters the world over to unlock opportunities around the clock, giving them access to over 19,000 financial markets. Today, more than 400,000 clients call IG Group home. IG Group Holdings plc is an established member of the FTSE 250 and holds a long-term investment grade credit rating of BBB- with a stable outlook from Fitch Ratings

Similar Jobs

BlackLine Logo BlackLine

Data Engineer

Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
Hybrid
Kraków, Małopolskie, POL
1810 Employees
336K-420K Annually

HERE Technologies Logo HERE Technologies

Data Engineer

Artificial Intelligence • Automotive • Computer Vision • Information Technology • Internet of Things • Logistics • Software
Hybrid
3 Locations
6000 Employees

BlackLine Logo BlackLine

Senior Data Engineer

Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
Hybrid
Kraków, Małopolskie, POL
1810 Employees

BlackLine Logo BlackLine

Senior Data Engineer

Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
Hybrid
Kraków, Małopolskie, POL
1810 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account