AWS Data Platform Engineer

Posted 5 Days Ago
Be an Early Applicant
3 Locations
Remote
Mid level
Artificial Intelligence • Cloud • Information Technology • Software • Consulting • Data Privacy
The Role
Design and provision AWS lakehouse foundations, implement tenant-isolation security and ingestion pipelines, build Terraform IaC and GitHub Actions CI/CD, orchestrate workflows with Airflow/Astronomer, ensure data lineage/observability and cost governance, and collaborate with architects and engineers while transferring knowledge to client teams.
Summary Generated by Built In

Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable products, platforms, and data-driven solutions. 

We specialize in Artificial Intelligence, Data and Cloud, Intelligent Automation, and Digital Products, combining deep technical expertise with a strong focus on engineering excellence and a people-first culture.  

In the CEE region, we’re a team of nearly 1,000 experts delivering modern applications, data platforms, and AI solutions for clients such as McLaren, Aviva, Deloitte, Spotify, Disney, ING, UPS, Tesco, Truecaller, AllSaints, Volotea, Schmitz Cargobull, Allegro, InPost, and many, many more. We work with leading technologies including AWS, Azure, GCP, Databricks, and Snowflake, and combine strong engineering culture with a consulting mindset and a continuous focus on growth and knowledge sharing. 


You will be:

  • Designing and provisioning the lakehouse foundation on AWS: S3 lake zones (raw, canonical, curated), Apache Iceberg tables, Glue Data Catalog, Athena, and Lake Formation,
  • delivering all infrastructure as code with Terraform, reproducible from the client's GitHub repositories and CI/CD, across isolated environments (ci, dev, staging, prod),
  • building and enforcing the tenant-isolation security gate: Lake Formation row-level security and physical partitioning by CompanyId, separate IAM roles for customer versus internal access, and fail-closed handling that quarantines and alerts on rows with missing or unresolved CompanyId,
  • implementing the upstream entitlement mapping (principal to allowed CompanyIds) that drives access control,
  • seting up ingestion infrastructure: CDC paths from DynamoDB Streams, AWS DMS extracts from Aurora PostgreSQL, and bulk export to Parquet, supporting the near-real-time (5 min) and batch (4 hr) SLAs,
  • standing up workflow orchestration with Apache Airflow and Astronomer Cosmos, including profile-based connections, model-level retries, and lineage emission,
  • building CI/CD pipelines (GitHub Actions): dbt compile and slim builds, SQLFluff linting, DAG validation, branch protection, environment promotion, and Git-revert rollback,
  • configuring end-to-end governance and observability: catalog and data contracts, OpenLineage capture, and org-wide audit through CloudTrail,
  • owning cost governance and monitoring: resource tagging, usage alerting, and right-sizing of compute,
  • collaborating with the Data Platform Architect, Data Engineers, and Analytics Engineer, and support knowledge transfer to the client team.

Your profile:
  • strong experience with AWS data and platform services: S3, Glue (Data Catalog and Jobs), Athena, Lake Formation, IAM, VPC networking, DMS, DynamoDB, Aurora PostgreSQL,
  • experience with infrastructure as Code with Terraform, including modular design and YAML-driven configuration,
  • knowledge about Apache Iceberg and open table formats on S3,
  • experience with security and access control,
  • knowledge about CI/CD engineering with GitHub Actions, trunk-based development, and environment promotion,
  • solid Python and SQL skills,
  • experience with dbt on AWS (dbt-athena, dbt-glue adapters) and analytics-engineering workflows,
  • previous exposure to Airflow orchestration, ideally with Astronomer Cosmos,
  • data lineage and observability (OpenLineage, dbt-elementary) and data quality tooling (dbt tests, dbt-expectations) skills,
  • experience with CDC and streaming ingestion patterns.

Work from the European Union region and a work permit are required.

Nice to have:
  • exposure to BI serving layers such as QuickSight or Sigma,
  • snowflake experience.
Recruitment Process:

CV review – HR call – InterviewClient Interview – Decision


Skills Required

  • Experience with AWS S3
  • Experience with AWS Glue (Data Catalog and Jobs)
  • Experience with AWS Athena
  • Experience with AWS Lake Formation
  • Experience with AWS IAM
  • Experience with VPC networking
  • Experience with AWS DMS
  • Experience with DynamoDB and DynamoDB Streams
  • Experience with Aurora PostgreSQL
  • Infrastructure as Code with Terraform (modular design, YAML-driven config)
  • Knowledge of Apache Iceberg and open table formats on S3
  • Experience with security and access control (tenant isolation, row-level security)
  • CI/CD engineering with GitHub Actions, trunk-based development, environment promotion
  • Solid Python skills
  • Strong SQL skills
  • dbt on AWS (dbt-athena, dbt-glue) and analytics-engineering workflows
  • Previous exposure to Apache Airflow orchestration (ideally Astronomer Cosmos)
  • Data lineage and observability tooling (OpenLineage, dbt-elementary) and data quality tooling (dbt tests, dbt-expectations)
  • Experience with CDC and streaming ingestion patterns and Parquet exports
  • Work from the European Union region and valid work permit

Xebia Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Xebia and has not been reviewed or approved by Xebia.

  • Healthcare Strength U.S. offerings include health, dental, and vision insurance alongside an Employee Assistance Program, strengthening total compensation where available.
  • Leave & Time Off Breadth Vacation/PTO and paid holidays, with mentions of parental leave in certain regions, broaden time-off options and support work-life balance.
  • Retirement Support A U.S. 401(k) plan with matching is noted, enhancing long-term financial benefits as part of total rewards.

Xebia Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Atlanta
3,254 Employees
Year Founded: 2001

What We Do

We are a pioneering IT consultancy company, following 1 mission, 4 values, and 4 business principles. WHO WE ARE With over 20 years of experience, our global network of passionate technologists and pioneering craftsmen deliver cutting-edge technology and game-changing consulting to companies on the brink of transformation. Founded in 2001, Xebia was the first Dutch organization to embrace the Agile way of working, with gurus like Jeff Sutherland. Since then, we have grown from a Java company into a full-service digital consulting company with 4500+ professionals working on a worldwide ambition. We are organized in complementary chapters – teams with a tremendous amount of knowledge and experience within a particular field, such as Agile, DevOps, Data and AI, Cloud, Software Technology, Low Code, and Microsoft. We help the world’s top 250 companies and category leaders overcome digital challenges, embrace innovation, adopt new technology, and implement new business models. In addition to high-quality consulting, we also provide offshoring and nearshoring services. WHAT WE DO ★ Digital Strategy ★ DevOps and SRE ★ Agile ★ Data and AI ★ Cloud ★ Microsoft Solutions ★ Software Technology ★ Security ★ Low Code ★ Xebia Academy HOW WE ARE ORGANIZED Xebia has launched specific labels, like GoDataDriven, Binx, Xpirit, Qxperts, Stackstate, Instruqt, Xccelerated, and Xebia Academy Complementing our organic growth, other specialized companies join our successful journey and also operate within the Xebia network under their own brand name, like Appcino, coMakeIt, g-company, Oblivion, PGS Software, and SwissQ. Together we are Xebia. With 17 offices in Atlanta, San Francisco, UK, Vietnam, Canada, Amsterdam, and Hilversum (the Netherlands), Belgium, Germany, Gurgaon, Jaipur, Hyderabad, Pune, Bangalore, Poland, Melbourne, Mexico, and Dubai. ✉️ [email protected]

Similar Jobs

Circle (circle.so) Logo Circle (circle.so)

Senior Site Reliability Engineer

Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Easy Apply
Remote
31 Locations
250 Employees
130K-140K Annually

HiBob Logo HiBob

Senior Account Executive

HR Tech • Information Technology • Professional Services • Sales • Software
Remote or Hybrid
Poland
1350 Employees
250K-350K Annually

Capco Logo Capco

Program Test Manager - Cards (Polish is Mandatory) (She/He/They)

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
Poland
6000 Employees

Capco Logo Capco

Support Engineer

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
Poland
6000 Employees

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account