AWS Data Engineer with Databricks

Posted 15 Days Ago
Be an Early Applicant
Hiring Remotely in Bulgaria
Remote
Mid level
Artificial Intelligence • Cloud • Information Technology • Software • Consulting • Data Privacy
The Role
The role involves designing and maintaining data pipelines using Python and PySpark, operating Delta Live Tables, optimizing SQL queries, and implementing data governance on Databricks, while collaborating with cross-functional teams.
Summary Generated by Built In

Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable products, platforms, and data-driven solutions. 

We specialize in Artificial Intelligence, Data and Cloud, Intelligent Automation, and Digital Products, combining deep technical expertise with a strong focus on engineering excellence and a people-first culture.  

In the CEE region, we’re a team of nearly 1,000 experts delivering modern applications, data platforms, and AI solutions for clients such as McLaren, Aviva, Deloitte, Spotify, Disney, ING, UPS, Tesco, Truecaller, AllSaints, Volotea, Schmitz Cargobull, Allegro, InPost, and many, many more. We work with leading technologies including AWS, Azure, GCP, Databricks, and Snowflake, and combine strong engineering culture with a consulting mindset and a continuous focus on growth and knowledge sharing. 

About project:

Our client is a large, technology‑driven logistics and e‑commerce services organization operating at significant scale. The company processes high volumes of operational and analytical data daily and invests heavily in modern cloud‑based data platforms. Data is a critical enabler for business performance, decision‑making, and continuous optimization across the organization.
You will join a Data Services / Data Engineering team responsible for designing, building, and operating scalable data solutions on a modern cloud analytics platform. The team supports multiple business domains by delivering reliable, well‑governed, and high‑performance data pipelines.

You will be:
  • designing, developing, and maintaining scalable data pipelines using Python and PySpark,

  • building and operating Delta Live Tables pipelines in both streaming and triggered modes,

  • selecting and configuring appropriate Databricks compute for different workload types,

  • implementing and maintaining data governance using Unity Catalog across Databricks workspaces,

  • diagnosing, analysing, and optimising slow SQL queries on large Delta tables,

  • defining, packaging, and deploying Databricks resources using Databricks Asset Bundles,

  • collaborating closely with other data engineers, analytics teams, and platform stakeholders,

  • contributing to best practices around performance, reliability, and maintainability of data solutions


Your profile:
  • strong experience with AWS Databricks,

  • proven experience building scalable data pipelines using Python and PySpark,

  • hands‑on experience designing and operating Delta Live Tables pipelines,

  • solid understanding of Databricks compute options and the ability to choose the right configuration for specific workloads,

  • ability to diagnose and optimise slow SQL queries on large Delta tables using a structured approach,


  • experience using Databricks Asset Bundles for infrastructure and deployment as code,

  • experience working with Unity Catalog to centralize data governance,

  • experience working in complex, data‑intensive environments with large datasets,

  • good understanding of data modeling and data quality concepts,

  • practical experience using AI-powered assistants (e.g. Claude Code, GitHub Copilot, Cursor) to improve productivity, quality, or decision-making in software delivery,

  • work from the European Union region and a work permit are required.

Nice to have:
  • familiarity with CI/CD practices for data platforms,
  • experience collaborating in cross‑functional, agile teams,
  • experience with streaming data architectures,
  • exposure to data platform cost optimization,
  • experience mentoring or supporting other data engineers,
  • knowledge of wider AWS data ecosystem services.
  • experience applying GenAI in a more structured way within the SDLC, including defined workflows, prompt patterns, or tool integrations embedded into daily work,

  • interest in and familiarity with emerging AI-driven practices (e.g. agent-based workflows, automation patterns, AI-augmented development), with a willingness to explore and experiment beyond standard approaches.
Recruitment Process:

CV review – HR call – InterviewClient Interview – Decision


Skills Required

  • Strong experience with AWS Databricks
  • Proven experience building scalable data pipelines using Python and PySpark
  • Hands-on experience designing and operating Delta Live Tables pipelines
  • Solid understanding of Databricks compute options
  • Ability to diagnose and optimise slow SQL queries on large Delta tables
  • Experience using Databricks Asset Bundles for infrastructure and deployment as code
  • Experience working with Unity Catalog
  • Experience working in complex, data-intensive environments
  • Good understanding of data modeling and data quality concepts
  • Practical experience using AI-powered assistants

Xebia Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Xebia and has not been reviewed or approved by Xebia.

  • Healthcare Strength U.S. offerings include health, dental, and vision insurance alongside an Employee Assistance Program, strengthening total compensation where available.
  • Leave & Time Off Breadth Vacation/PTO and paid holidays, with mentions of parental leave in certain regions, broaden time-off options and support work-life balance.
  • Retirement Support A U.S. 401(k) plan with matching is noted, enhancing long-term financial benefits as part of total rewards.

Xebia Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Atlanta, GA
3,254 Employees
Year Founded: 2001

What We Do

We are a pioneering IT consultancy company, following 1 mission, 4 values, and 4 business principles. WHO WE ARE With over 20 years of experience, our global network of passionate technologists and pioneering craftsmen deliver cutting-edge technology and game-changing consulting to companies on the brink of transformation. Founded in 2001, Xebia was the first Dutch organization to embrace the Agile way of working, with gurus like Jeff Sutherland. Since then, we have grown from a Java company into a full-service digital consulting company with 4500+ professionals working on a worldwide ambition. We are organized in complementary chapters – teams with a tremendous amount of knowledge and experience within a particular field, such as Agile, DevOps, Data and AI, Cloud, Software Technology, Low Code, and Microsoft. We help the world’s top 250 companies and category leaders overcome digital challenges, embrace innovation, adopt new technology, and implement new business models. In addition to high-quality consulting, we also provide offshoring and nearshoring services. WHAT WE DO ★ Digital Strategy ★ DevOps and SRE ★ Agile ★ Data and AI ★ Cloud ★ Microsoft Solutions ★ Software Technology ★ Security ★ Low Code ★ Xebia Academy HOW WE ARE ORGANIZED Xebia has launched specific labels, like GoDataDriven, Binx, Xpirit, Qxperts, Stackstate, Instruqt, Xccelerated, and Xebia Academy Complementing our organic growth, other specialized companies join our successful journey and also operate within the Xebia network under their own brand name, like Appcino, coMakeIt, g-company, Oblivion, PGS Software, and SwissQ. Together we are Xebia. With 17 offices in Atlanta, San Francisco, UK, Vietnam, Canada, Amsterdam, and Hilversum (the Netherlands), Belgium, Germany, Gurgaon, Jaipur, Hyderabad, Pune, Bangalore, Poland, Melbourne, Mexico, and Dubai. ✉️ [email protected]

Similar Jobs

Mondelēz International Logo Mondelēz International

Internal Controls Coordinator (Audit & Controls background needed, English fluency required)

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
5 Locations
90000 Employees
3K-3K Annually

DraftKings Logo DraftKings

Customer Experience Associate

Digital Media • Gaming • Information Technology • Software • Sports • Esports • Big Data Analytics
Remote or Hybrid
Sofia, Sofia-grad, BGR
6400 Employees

DraftKings Logo DraftKings

Data Engineer

Digital Media • Gaming • Information Technology • Software • Sports • Esports • Big Data Analytics
Remote or Hybrid
Bulgaria
6400 Employees

DraftKings Logo DraftKings

Data Analyst

Digital Media • Gaming • Information Technology • Software • Sports • Esports • Big Data Analytics
Remote or Hybrid
Plovdiv, BGR
6400 Employees

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account