Principal Data Engineer

Posted Yesterday
Be an Early Applicant
Chennai, Tamil Nadu, IND
Hybrid
Expert/Leader
Logistics • Manufacturing
Konecranes - Moves what matters.™
The Role
Lead the design and delivery of scalable Lakehouse data solutions using Azure Databricks, PySpark, SQL, Spark, and Delta Lake. Own enterprise ETL/ELT pipelines, data modeling, migration, performance optimization, data quality, governance, security, and monitoring. Define engineering standards, review technical designs, collaborate with architects and stakeholders, support planning and risk management, and mentor Data Engineers.
Summary Generated by Built In
Company Description

At Konecranes, we believe that great customer experience is built on the people behind the Konecranes name. Everything we do, we do with passion and drive. We believe diversity drives business success and is the foundation for our growth. We welcome different backgrounds and skills that enrich our community and we promote a place where we can ALL be ourselves. This is what makes Konecranes a unique place to work.

Job Description

We are seeking an experienced Lead Data Engineer to provide technical leadership in designing, developing, and evolving scalable data solutions within a modern Lakehouse architecture. The role will be responsible for leading complex data engineering initiatives, defining technical approaches and development standards, and ensuring the delivery of scalable, reliable, and well-governed data products. The Lead Data Engineer will work closely with Data Architects, Business Analysts, Analytics teams, and business stakeholders to translate strategic and business requirements into robust technical solutions. The role will also provide technical guidance and mentorship to Data Engineers while ensuring alignment with the organization's data architecture and governance standards.

Key Roles & Responsibilities

  • Lead the design, development, and implementation of scalable data engineering solutions within the Lakehouse environment.
  • Define and drive technical approaches for data ingestion, transformation, integration, and consumption.
  • Lead complex ETL/ELT development initiatives involving multiple source systems and business domains.
  • Design and oversee scalable data pipelines using Azure Databricks, PySpark, SQL, and Delta Lake.
  • Lead the migration of existing data assets, SQL views, transformation logic, and data models into the Lakehouse architecture.
  • Define and implement data engineering standards, reusable frameworks, and best practices.
  • Design and evolve layered data architecture to support business intelligence, analytics, and future advanced data use cases.
  • Ensure data models and curated datasets are optimized for scalability, performance, and business consumption.
  • Review and optimize complex SQL queries, data pipelines, and processing workloads.
  • Define strategies for incremental data loading, historical data management, schema evolution, and pipeline recovery.
  • Establish data quality, validation, reconciliation, monitoring, and exception-handling processes.
  • Ensure data solutions comply with defined governance, security, metadata, lineage, and access management requirements.
  • Conduct technical reviews and provide guidance on solution design and development practices.
  • Mentor and support Data Engineers in improving technical capabilities and engineering practices.
  • Collaborate with Data Architects to ensure engineering solutions align with the overall data architecture.
  • Work with Business Analysts and stakeholders to understand complex business requirements and convert them into scalable technical solutions.
  • Support project estimation, technical planning, dependency management, and risk identification.
  • Drive continuous improvement in data engineering processes, automation, performance, and maintainability.
  • Awareness of ISO 14001 & 45001 Standards

Qualifications

Education Required: Graduation/Post Graduation

Professional Experience Required (Max – Min.): 10-15 years

Technical Competence:

  • Strong expertise in Lakehouse architecture and modern data platform concepts.
  • Extensive experience with Azure Databricks.
  • Strong expertise in Apache Spark, PySpark, and Delta Lake.
  • Deep understanding of layered data architecture, including Bronze, Silver, and Gold layers.
  • Ability to design scalable, reusable, and maintainable data engineering solutions.
  • Extensive experience designing and implementing enterprise-scale ETL/ELT pipelines.
  • Expert-level proficiency in SQL, including complex transformations and performance optimization.
  • Strong hands-on experience with Python and PySpark.
  • Ability to establish coding standards and perform technical code reviews.
  • Strong expertise in analytical and dimensional data modelling.
  • Experience designing Fact and Dimension models, Star Schemas, and business-oriented data models.
  • Strong understanding of data governance, metadata management, lineage, and data quality.
  • Strong knowledge of Git, version control, CI/CD, and automated deployment.
  • Understanding of data security, access management, and compliance requirements.

Functional & Behavioral Skills:

  • Strong ability to understand complex business processes and translate them into scalable data solutions.
  • Ability to work with Data Architects to convert enterprise architecture into practical engineering solutions.
  • Strong understanding of how data products support Business Intelligence, analytics, and reporting.
  • Experience engaging with senior business and technical stakeholders.
  • Ability to lead requirement discussions and identify technical dependencies and risks.
  • Experience in planning and managing complex data engineering initiatives.
  • Ability to assess existing data solutions and define approaches for modernization and migration.
  • Strong understanding of end-to-end data flow, from source systems through transformation to reporting and analytics consumption.
  • Ability to balance business requirements, technical feasibility, performance, and long-term maintainability.
  • Experience supporting and guiding multiple projects or workstreams simultaneously.
  • Ability to mentor, coach, and provide technical guidance to Data Engineers.
  • Excellent analytical, problem-solving, and decision-making skills.
  • Ability to influence technical decisions and drive alignment across teams.
  • High level of accountability and commitment to delivery.

Additional Information

Location: India - Chennai

Why join us?

We are a global company with history dating back to 1910 - with future looking attitude that has brought us here today. Now together, we are shaping the next generation of material handling for smarter and safer world.

We believe in creating a workplace that is built on trust, flexibility, friendliness and inclusivity towards each other and culture with open communication and low hierarchy. We are a strong expert organisation where you are able to use modern tools and technologies - while embracing agile methodologies and continuous learning and development.

What we can offer you

  • Work in a global environment
  • Competitive Salary
  • Work-Life balance
  • Innovative and dynamic working environment
  • Support of an excellent Global Team
  • Possibility to work in leading crane building company with leading technology

Interested?
If this role sparked your interest, please submit your application as soonest, on our career site. Please note that position will be filled when we find a suitable person. We will contact you after the application period at latest. For more information, please feel free to write  - [email protected]

Konecranes moves what matters. We are a global leader in material handling solutions, serving a broad range of customers across multiple industries. We consistently set the industry benchmark, from everyday improvements to the breakthroughs at moments that matter most, because we know we can always find a safer, more productive and sustainable way. That's why, with 16 000+ professionals in over 50 countries, we are trusted every day to lift, handle and move what the world needs.

Konecranes is committed to ensuring that all employees and job applicants are treated fairly in an environment which is free from any form of discrimination.

Skills Required

  • Graduation or post-graduation degree
  • 10-15 years of professional experience
  • Strong expertise in Lakehouse architecture and modern data platform concepts
  • Extensive experience with Azure Databricks
  • Strong expertise in Apache Spark, PySpark, and Delta Lake
  • Deep understanding of Bronze, Silver, and Gold layered data architecture
  • Experience designing scalable, reusable, and maintainable data engineering solutions
  • Extensive experience designing and implementing enterprise-scale ETL and ELT pipelines
  • Expert-level SQL proficiency, including complex transformations and performance optimization
  • Strong hands-on experience with Python and PySpark
  • Ability to establish coding standards and conduct technical code reviews
  • Strong expertise in analytical and dimensional data modeling
  • Experience designing fact and dimension models, star schemas, and business-oriented data models
  • Strong understanding of data governance, metadata management, lineage, and data quality
  • Strong knowledge of Git, version control, CI/CD, and automated deployment
  • Understanding of data security, access management, and compliance requirements
  • Ability to translate complex business processes and requirements into scalable data solutions
  • Experience engaging with senior business and technical stakeholders
  • Experience planning and managing complex data engineering initiatives
  • Ability to assess existing data solutions and define modernization and migration approaches
  • Ability to mentor, coach, and provide technical guidance to Data Engineers
  • Awareness of ISO 14001 and ISO 45001 standards
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Hyvinkää
11,183 Employees
Year Founded: 1994

What We Do

Konecranes is a global leader in material handling solutions, serving a broad range of customers across multiple industries. We consistently set the industry benchmark, from everyday improvements to the breakthroughs at moments that matter most, because we know we can always find a safer, more productive and sustainable way. That’s why, with around 16,500 professionals in over 50 countries, Konecranes is trusted every day to lift, handle and move what the world needs. In 2023, Group sales totalled EUR 3.9 billion. Konecranes shares are listed on Nasdaq Helsinki (symbol: KCR).

Similar Jobs

Optum Logo Optum

Data Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Chennai, Tamil Nadu, IND
160000 Employees

Staples India Logo Staples India

Principal Engineer

eCommerce • Retail • Software
In-Office
Chennai, Tamil Nadu, IND
12060 Employees

Excelencia Consulting Logo Excelencia Consulting

Data Engineer

Information Technology • Professional Services • Software • Consulting
In-Office
CORP Colony, Tondiarpet, Chennai, Tamil Nadu, IND
275 Employees

Citi Logo Citi

Platform Engineer

Fintech • Financial Services
In-Office
Chennai, Tamil Nadu, IND
223850 Employees

Similar Companies Hiring

Fortune Brands Innovations Thumbnail
Manufacturing
Deerfield, IL
10000 Employees
Rosendin Thumbnail
Other • Manufacturing
San Jose, CA
6219 Employees
Amalgamated Sugar Thumbnail
Food • Greentech • Agriculture • Industrial • Manufacturing
Boise, Idaho
768 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account