IT Engineer - Data Lakehouse

Posted 3 Days Ago
Be an Early Applicant
Bangalore, Bengaluru Urban, Karnataka, IND
Hybrid
Mid level
Automotive • Energy • Industrial • Manufacturing
The Role
Designs, develops, and operates scalable batch and streaming data pipelines in Azure Databricks. Builds lakehouse layers, dimensional and warehouse models, data marts, and semantic models for supply chain analytics. Implements data quality controls, automated testing, CI/CD, version control, governance, lineage, and performance optimization. Collaborates with product owners, architects, business stakeholders, and analytics teams in an agile enterprise environment.
Summary Generated by Built In
Company Description

Continental develops pioneering technologies and services for sustainable and connected mobility of people and their goods. Founded in 1871, the technology company offers safe, efficient, intelligent, and affordable solutions for vehicles, machines, traffic and transportation. In 2023, Continental generated sales of €41.4 billion and currently employs around 200,000 people in 56 countries and markets.

 Guided by the vision of being the customer's first choice for material-driven solutions, the ContiTech group sector focuses on development competence and material expertise for products and systems made of rubber, plastics, metal, and fabrics. These can also be equipped with electronic components in order to optimize them functionally for individual services. ContiTech's industrial growth areas are primarily in the areas of energy, agriculture, construction, and surfaces. In addition, ContiTech serves the automotive and transportation industries as well as rail transport.

The IT Digital Enablement and Data Services Competence Center of ContiTech caters to all the Business Areas in ContiTech and responsible among other on areas of Data & Analytics, Smart Factory, Web and Mobile Software Development and AI.

The team for Data services specializes in all platforms, business applications and products in the domain of data and analytics, covering the entire spectrum including AI, machine learning, data science, data analysis, reporting and dashboarding.

Job Description

Key targets of the job profile

- Design, develop, and operate scalable and maintainable data pipelines in the Azure Databricks environment
- Develop all technical artefacts as code, implemented in professional IDEs, with full version control and CI/CD automation
- Enable data-driven decision-making in Supply Chain Management (SCM) by ensuring high data availability, quality, and reliability
- Implement data products and analytical assets using software engineering principles in close alignment with business domains and functional IT
- Apply rigorous software engineering practices such as modular design, test-driven development, and artifact reuse in all implementations

Dimensions/ Organization/ Magnitude

- Global delivery footprint; cross-functional data engineering support across SCM domains
- Collaboration with business stakeholders, functional IT partners, product owners, architects, ML/AI engineers, and Power BI developers
- Agile, product-team structure embedded in an enterprise-scale Azure & Azure Databricks environment

Main Tasks: 

(1) Data Pipeline Development

• Design scalable batch and streaming pipelines in Azure Databricks using PySpark and/or Scala
• Implement ingestion from structured and semi-structured sources (e.g., SAP, APIs, flat files)
• Build bronze/silver/gold data layers following the defined lakehouse layering architecture & governance

(2) Data & Analytics business applications

• Implement use-case driven dimensional models (star/snowflake schema) tailored to SCM needs
• Ensure compatibility with reporting tools (e.g., Power BI) via curated data marts and semantic models

(3) Data Warehouse Integration

• Implement enterprise-level data warehouse models (domain-driven 3NF models) for SCM data, closely aligned with data engineers for other business domains
• Develop and apply master data management strategies (e.g., Slowly Changing Dimensions)

(4) Data Quality & Testing

• Develop automated data validation tests using frameworks
• Monitor pipeline health, identify anomalies, and implement quality thresholds
• Establish data quality transparency by defining and implementing meaningful data quality rules with source system and business stakeholders and implementing related reports

(5) Data Engineering Excellence

• Develop and structure pipelines using modular, reusable code in a professional IDE
• Apply test-driven development (TDD) principles with automated unit, integration, and validation tests
• Integrate tests into CI/CD pipelines to enable fail-fast deployment strategies
• Commit all artifacts to version control with peer review and CI/CD integration

(6) Collaboration & Requirements Engineering

• Work closely with Product Owners to refine user stories and define acceptance criteria
• Translate business requirements into data contracts and technical specifications
• Participate in agile events such as sprint planning, reviews, and retrospectives

(7) Documentation & Governance

• Document pipeline logic, data contracts, and technical decisions in markdown or auto-generated docs from code
• Align designs with governance and metadata standards (e.g., Unity Catalog)
• Track lineage and audit trails through integrated tooling

(8) Performance Optimization

• Profile and tune data transformation performance
• Reduce job execution times and optimize cluster resource usage
• Refactor legacy pipelines or inefficient transformations to improve scalability

Qualifications

Required knowledge:

  • Strong experience with modern data engineering technologies, including Azure Databricks, PySpark, Scala, Delta Lake, and Azure Data Lake Storage (ADLS Gen2).
  • Solid understanding of data modeling, ETL/ELT architecture, orchestration frameworks, and scalable data platform design.
  • Experience with CI/CD pipelines, DevOps practices, Git-based development workflows, and Infrastructure as Code.
  • Proficiency in agile software delivery methods, including Scrum, SAFe, test-driven development, and collaborative development practices.
  • Good knowledge of data warehouse concepts, including dimensional modeling, normalization, star schemas, and Slowly Changing Dimensions (SCDs).
  • Understanding of data governance, metadata management, and best practices for operating lakehouse environments.
  • Familiarity with business intelligence and reporting solutions, preferably including Power BI and tabular analysis tools.
  • Basic understanding of advanced analytics, data mining, machine learning concepts, and AI-driven use cases.
  • Knowledge of AI services, large language models (LLMs), and API integration concepts.
  • Understanding of supply chain management processes, data structures, and business KPIs is beneficial.

Education / Certification: Degree in Computer Science, Data Engineering, Information Systems, or related discipline.
Certifications in software development and data engineering (e.g., Databricks DE Associate, Azure Data Engineer, or relevant DevOps certifications).

Professional Experience: 3–6 years of hands-on experience in data engineering roles in enterprise environments. Demonstrated experience building production-grade codebases in IDEs, with test coverage and version control.

Project and/or Process Experience: Proven experience in implementing complex data pipelines and contributing to full lifecycle data projects (development to deployment)
Experience in at least one business domain: SCM or a comparable field

Leadership Experience: Not required; however, experience mentoring junior developers or leading implementation workstreams is a plus

Intercultural / International Experience: Experience working in international teams across multiple time zones and cultures, preferably with teams in India, Germany, and the Philippines.

Additional Information

The well-being of our employees is important to us. That's why we offer exciting career prospects and support you in achieving a good work-life balance with additional benefits such as:

  • Training opportunities
  • Mobile and flexible working models
  • Sabbaticals

and much more...

Sounds interesting for you? Click here to find out more.

Diversity, Inclusion & Belonging are important to us and make our company strong and successful. We offer equal opportunities to everyone - regardless of age, gender, nationality, cultural background, disability, religion, ideology or sexual orientation.

Ready to drive with Continental? Take the first step and fill in the online application.

Ready to drive with Continental? Take the first step and fill in the online application.

Skills Required

  • Strong experience with Azure Databricks, PySpark, Scala, Delta Lake, and Azure Data Lake Storage Gen2
  • Experience with data modeling, ETL/ELT architecture, orchestration frameworks, and scalable data platform design
  • Experience with CI/CD pipelines, DevOps practices, Git-based development workflows, and Infrastructure as Code
  • Proficiency in Scrum, SAFe, test-driven development, and collaborative agile software delivery
  • Knowledge of data warehouse concepts, dimensional modeling, normalization, star schemas, and Slowly Changing Dimensions
  • Understanding of data governance, metadata management, and lakehouse operations
  • Familiarity with business intelligence and reporting solutions, preferably Power BI and tabular analysis tools
  • Basic understanding of advanced analytics, data mining, machine learning, and AI-driven use cases
  • Knowledge of AI services, large language models, and API integration concepts
  • Understanding of supply chain management processes, data structures, and business KPIs
  • Degree in Computer Science, Data Engineering, Information Systems, or a related discipline
  • Certifications in software development or data engineering, such as Databricks DE Associate, Azure Data Engineer, or relevant DevOps certifications
  • Three to six years of hands-on experience in enterprise data engineering roles
  • Experience building production-grade codebases with test coverage and version control
  • Experience implementing complex data pipelines and contributing to full-lifecycle data projects from development through deployment
  • Experience in SCM or a comparable business domain
  • Experience mentoring junior developers or leading implementation workstreams
  • Experience working in international teams across multiple time zones and cultures

Continental Industry Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Continental Industry and has not been reviewed or approved by Continental Industry.

  • Retirement Support — Feedback suggests retirement matching and pension contributions are highlighted across several locations, with some roles advertising a 6% 401(k) match and immediate vesting. Such features are portrayed as competitive elements within the overall package.
  • Healthcare Strength — Feedback suggests comprehensive medical, dental, and vision coverage, along with HSA contributions in the U.S., are commonly offered. Wellness initiatives and preventive care are also noted in multiple regions.
  • Strong & Reliable Incentives — Feedback suggests weekly attendance or production bonuses and annual performance bonuses are present in various roles. Profit-sharing and other financial incentives are also described in company materials for certain locations.

Continental Industry Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Hannover
20,000 Employees
Year Founded: 1871

What We Do

ContiTech is a leading industry specialist that develops and produces sustainable, safe, and convenient material-based solutions using rubber, plastics, metal, and fabric. It serves diverse industrial sectors, including off-highway mobility, mining, agriculture, construction, energy management, and the automotive industry, providing system-critical components like hoses, conveyor belts, and air springs for challenging industrial environments globally.

Similar Jobs

Cargill Logo Cargill

Senior Software Engineer

Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
155000 Employees
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
289097 Employees
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
289097 Employees

JumpCloud Logo JumpCloud

Director of Global Account Management - India

Cloud • Information Technology • Security • Software
Easy Apply
In-Office or Remote
Bangalore, Bengaluru, Karnataka, IND
800 Employees

Similar Companies Hiring

Amalgamated Sugar Thumbnail
Food • Greentech • Agriculture • Industrial • Manufacturing
Boise, Idaho
768 Employees
Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
Glendale, Kentucky
55 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account