Xebia is a trusted advisor in the modern era of digital transformation, serving hundreds of leading brands worldwide with end-to-end IT solutions. The company has experts specializing in technology consulting, software engineering, AI, digital products and platforms, data, cloud, intelligent automation, agile transformation, and industry digitization. In addition to providing high-quality digital consulting and state-of-the-art software development, Xebia has a host of standardized solutions that substantially reduce the time-to-market for businesses.
Xebia also offers a diverse portfolio of training courses to help support forward-thinking organizations as they look to upskill and educate their workforce to capitalize on the latest digital capabilities. The company has a strong presence across 16 countries with development centres across the US, Latin America, Western Europe, Poland, the Nordics, the Middle East, and Asia Pacific.
Job Title: Senior Data Engineer
Department: Data Engineering / Analytics
About the Role
We are seeking a Lead/Senior Data Engineer to join our dynamic data team and play a critical role in building and scaling our modern data platform. This role requires hands-on experience in designing robust data pipelines and transforming data into actionable insights using best-in-class tools and practices.
You will be responsible for architecting, developing, and maintaining data pipelines that support both batch and real-time data ingestion, transformation, and delivery across the organization. You’ll work closely with data analysts, scientists, and business stakeholders to ensure data quality, performance, and availability.
Key Responsibilities
- Design, build, and maintain scalable data pipelines using Fivetran for ingestion, Databricks for transformation & Airflow for Orchestration.
- Develop real-time data ingestion solutions using AWS Kinesis (Optional).
- Implement data transformation workflows with dbt (Data Build Tool), leveraging Iceberg table format for optimized performance and versioned data storage.
- Write efficient and clean code using Python, PySpark, and SQL to support complex data transformations and analysis.
- Work with large-scale datasets and ensure data quality, lineage, and governance across the pipeline.
- Optimize pipeline performance, monitor jobs, and resolve data-related issues proactively.
- Collaborate with cross-functional teams including data scientists, product managers, and engineers to understand data needs and deliver solutions.
- Experience with any DevOps tool like Git
Qualifications
- 5+ years of experience in data engineering or a related field.
- Proven expertise in data pipeline development and orchestration using tools like Fivetran and dbt.
- Strong hands-on experience with Databricks, Spark/PySpark, and Apache Iceberg.
- Experience with real-time data streaming using Kinesis or equivalent (Kafka, etc.) is a plus.
- Experience with Snowflake is a plus.
- Advanced proficiency in SQL and Python.
- Solid understanding of data warehousing concepts, data modeling, and performance tuning.
- Familiarity with versioned data storage and open table formats like Iceberg.
- Experience working in cloud environments, particularly AWS.
- Excellent communication and collaboration skills.
- Experience with CI/CD for data pipeline deployment.
- Familiarity with orchestration tools such as Airflow or Databricks Workflows
- Strong communication and collaboration skills, with a team-first mindset.
Some useful links:
Xebia | Creating Digital Leaders.
https://www.linkedin.com/company/xebia/mycompany/
http://twitter.com/xebiaindia
https://www.instagram.com/life_at_xebia/
http://www.youtube.com/XebiaIndia
Similar Jobs
What We Do
We are a pioneering IT consultancy company, following 1 mission, 4 values, and 4 business principles.
WHO WE ARE
With over 20 years of experience, our global network of passionate technologists and pioneering craftsmen deliver cutting-edge technology and game-changing consulting to companies on the brink of transformation.
Founded in 2001, Xebia was the first Dutch organization to embrace the Agile way of working, with gurus like Jeff Sutherland. Since then, we have grown from a Java company into a full-service digital consulting company with 4500+ professionals working on a worldwide ambition.
We are organized in complementary chapters – teams with a tremendous amount of knowledge and experience within a particular field, such as Agile, DevOps, Data and AI, Cloud, Software Technology, Low Code, and Microsoft.
We help the world’s top 250 companies and category leaders overcome digital challenges, embrace innovation, adopt new technology, and implement new business models. In addition to high-quality consulting, we also provide offshoring and nearshoring services.
WHAT WE DO
★ Digital Strategy
★ DevOps and SRE
★ Agile
★ Data and AI
★ Cloud
★ Microsoft Solutions
★ Software Technology
★ Security
★ Low Code
★ Xebia Academy
HOW WE ARE ORGANIZED
Xebia has launched specific labels, like GoDataDriven, Binx, Xpirit, Qxperts, Stackstate, Instruqt, Xccelerated, and Xebia Academy Complementing our organic growth, other specialized companies join our successful journey and also operate within the Xebia network under their own brand name, like Appcino, coMakeIt, g-company, Oblivion, PGS Software, and SwissQ. Together we are Xebia.
With 17 offices in Atlanta, San Francisco, UK, Vietnam, Canada, Amsterdam, and Hilversum (the Netherlands), Belgium, Germany, Gurgaon, Jaipur, Hyderabad, Pune, Bangalore, Poland, Melbourne, Mexico, and Dubai.
✉️ [email protected]
