Senior Azure Data Engineer

Posted 4 Days Ago
Be an Early Applicant
3 Locations
Remote
Senior level
Artificial Intelligence • Cloud • Information Technology • Software • Consulting • Data Privacy
The Role
Design, build, and maintain scalable data pipelines on Databricks for analytics and AI/ML. Implement ETL/ELT, medallion-style models, CI/CD and orchestration, ensure data quality, governance, security, performance, and troubleshoot production issues while collaborating with cross-functional teams.
Summary Generated by Built In

Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable products, platforms, and data-driven solutions. 

We specialize in Artificial Intelligence, Data and Cloud, Intelligent Automation, and Digital Products, combining deep technical expertise with a strong focus on engineering excellence and a people-first culture.  

In the CEE region, we’re a team of nearly 1,000 experts delivering modern applications, data platforms, and AI solutions for clients such as McLaren, Aviva, Deloitte, Spotify, Disney, ING, UPS, Tesco, Truecaller, AllSaints, Volotea, Schmitz Cargobull, Allegro, InPost, and many, many more. We work with leading technologies including AWS, Azure, GCP, Databricks, and Snowflake, and combine strong engineering culture with a consulting mindset and a continuous focus on growth and knowledge sharing. 


You will be:
  • designing, building, and maintaining scalable data pipelines supporting analytics, reporting, and AI/ML use cases,
  • developing and optimizing data ingestion and transformation workflows across multiple source systems,
  • implementing data models following best practices (e.g., layered/medallion-style architectures) to support different consumption patterns,
  • developing pipelines using Databricks notebooks and integrating them into production workflows using orchestration and CI/CD tools,
  • ensuring data quality, reliability, and performance through testing, monitoring, and validation practices,
  • contributing to data governance, security, and access controls in line with platform standards,
  • collaborating with analytics, product, and engineering teams to deliver data solutions aligned with business needs,
  • supporting and enhancing CI/CD and SDLC practices for data pipelines, including adoption of automation and AI-assisted development tools,
  • participating in evaluating and piloting new platform capabilities and tools within the data ecosystem,
  • contributing to defining and improving standards for data democratization, discoverability, and reusable data assets,
  • troubleshooting and resolve data pipeline and performance issues in production environments.

Your profile:
  • solid experience in data engineering,
  • strong proficiency in Python and SQL for data processing and transformation,
  • hands-on experience with Spark/PySpark and distributed data processing,
  • hands-on experience developing data pipelines using Databricks notebooks,
  • experience building and maintaining pipelines on Databricks or similar cloud data platforms (Databricks strongly preferred),
  • solid understanding of ETL/ELT design, data modeling, and workflow orchestration,
  • experience with Azure DevOps for code management, CI/CD, and release processes,
  • familiarity with orchestration tools such as Azure Data Factory (ADF),
  • experience working with large-scale datasets and optimizing performance,
  • familiarity with modern data architecture concepts (e.g., layered/medallion approaches, data lake/lakehouse patterns) • Understanding of data governance, data quality, and security fundamentals,
  • experience working in a structured SDLC environment, including version control and deployment practices,
  • ability to work both independently and within a team, with strong problem-solving skills,
  • exposure to AI-assisted development tools and workflows within the data engineering lifecycle,
  • exposure to streaming or near real-time data processing,
  • experience contributing to technical proposals, solution design, or platform improvements.

Work from the European Union region and a work permit are required.

Nice to have:
  • familiarity with Databricks ecosystem features and recent platform capabilities,
  • experience with data platform governance tools (e.g., cataloging, lineage, access control),
  • awareness of emerging data/AI platform capabilities (e.g., feature stores, data apps, conversational analytics, or pipeline automation tools),
  • basic understanding of machine learning workflows and how data pipelines support them
Recruitment Process:

CV review – HR call – InterviewClient Interview – Decision


Skills Required

  • Solid experience in data engineering
  • Proficiency in Python for data processing
  • Proficiency in SQL for data processing and transformation
  • Hands-on experience with Spark / PySpark
  • Hands-on experience developing data pipelines using Databricks notebooks
  • Experience building and maintaining pipelines on Databricks or similar cloud data platforms (Databricks strongly preferred)
  • Understanding of ETL/ELT design and data modeling (layered/medallion architectures)
  • Experience with workflow orchestration and production CI/CD practices
  • Experience with Azure DevOps for code management, CI/CD, and release processes
  • Familiarity with orchestration tools such as Azure Data Factory (ADF)
  • Experience working with large-scale datasets and performance optimization
  • Understanding of data governance, data quality, and security fundamentals
  • Experience working in a structured SDLC environment with version control and deployment practices
  • Ability to work independently and within a team with strong problem-solving skills
  • Work from the European Union region and a valid work permit
  • Exposure to AI-assisted development tools and workflows
  • Exposure to streaming or near real-time data processing
  • Experience contributing to technical proposals, solution design, or platform improvements
  • Familiarity with Databricks ecosystem features and recent platform capabilities
  • Experience with data platform governance tools (cataloging, lineage, access control)
  • Basic understanding of machine learning workflows and how data pipelines support them

Xebia Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Xebia and has not been reviewed or approved by Xebia.

  • Healthcare Strength U.S. offerings include health, dental, and vision insurance alongside an Employee Assistance Program, strengthening total compensation where available.
  • Leave & Time Off Breadth Vacation/PTO and paid holidays, with mentions of parental leave in certain regions, broaden time-off options and support work-life balance.
  • Retirement Support A U.S. 401(k) plan with matching is noted, enhancing long-term financial benefits as part of total rewards.

Xebia Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Atlanta
3,254 Employees
Year Founded: 2001

What We Do

We are a pioneering IT consultancy company, following 1 mission, 4 values, and 4 business principles. WHO WE ARE With over 20 years of experience, our global network of passionate technologists and pioneering craftsmen deliver cutting-edge technology and game-changing consulting to companies on the brink of transformation. Founded in 2001, Xebia was the first Dutch organization to embrace the Agile way of working, with gurus like Jeff Sutherland. Since then, we have grown from a Java company into a full-service digital consulting company with 4500+ professionals working on a worldwide ambition. We are organized in complementary chapters – teams with a tremendous amount of knowledge and experience within a particular field, such as Agile, DevOps, Data and AI, Cloud, Software Technology, Low Code, and Microsoft. We help the world’s top 250 companies and category leaders overcome digital challenges, embrace innovation, adopt new technology, and implement new business models. In addition to high-quality consulting, we also provide offshoring and nearshoring services. WHAT WE DO ★ Digital Strategy ★ DevOps and SRE ★ Agile ★ Data and AI ★ Cloud ★ Microsoft Solutions ★ Software Technology ★ Security ★ Low Code ★ Xebia Academy HOW WE ARE ORGANIZED Xebia has launched specific labels, like GoDataDriven, Binx, Xpirit, Qxperts, Stackstate, Instruqt, Xccelerated, and Xebia Academy Complementing our organic growth, other specialized companies join our successful journey and also operate within the Xebia network under their own brand name, like Appcino, coMakeIt, g-company, Oblivion, PGS Software, and SwissQ. Together we are Xebia. With 17 offices in Atlanta, San Francisco, UK, Vietnam, Canada, Amsterdam, and Hilversum (the Netherlands), Belgium, Germany, Gurgaon, Jaipur, Hyderabad, Pune, Bangalore, Poland, Melbourne, Mexico, and Dubai. ✉️ [email protected]

Similar Jobs

SEON Logo SEON

Security Engineer

Artificial Intelligence • Cybersecurity
Remote
27 Locations
415 Employees

SEON Logo SEON

Infrastructure Engineer

Artificial Intelligence • Cybersecurity
Remote
27 Locations
415 Employees

Zscaler Logo Zscaler

Account Executive

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
Poland
8697 Employees

Drata Logo Drata

Corporate Counsel

Security • Software • Cybersecurity • Automation
Remote
26 Locations
600 Employees
111K-137K Annually

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account