Data Engineer - Enterprise Data Lakehouse & Data Products

Reposted Yesterday
Be an Early Applicant
Bangalore, Bengaluru Urban, Karnataka, IND
In-Office
Senior level
Automotive • Hardware • Other • Energy • Industrial
The Role
Leads the design and delivery of scalable data pipelines and reusable data products on an AWS-based Databricks lakehouse. Develops data processing with Python, PySpark, and SQL; implements quality, validation, monitoring, reconciliation, access controls, and masking. Partners with business and technical stakeholders across multiple functions to create analytics-ready datasets, while supporting AWS data services, Snowflake, Apache Iceberg, CI/CD, Power BI, and semantic models.
Summary Generated by Built In
3M has a long-standing reputation as a company committed to innovation. We provide the freedom to explore and encourage curiosity and creativity. We gain new insight from diverse thinking, and take risks on new ideas. Here, you can apply your talent in bold ways that matter.

Job Description:

Collaborate with Innovative 3Mers Around the World

Choosing where to start and grow your career has a major impact on your professional and personal life, so it’s equally important you know that the company that you choose to work at, and its leaders, will support and guide you. With a wide variety of people, global locations, technologies and products, 3M is a place where you can collaborate with other curious, creative 3Mers.

 

The Impact You’ll Make in this Role

As a Data Engineer, you will have the opportunity to tap into your curiosity and collaborate with some of the most innovative people around the world. Here, you will make an impact by: 

  • Designing, building and maintaining scalable ETL/ELT pipelines and data products on 3M's AWS-based Enterprise Data Lakehouse using SQL, Python, PySpark and Databricks, following the Bronze → Silver → Gold Medallion architecture.
  • Partnering with analysts, product owners and architects across Finance, Supply Chain, R&D, Tax and Commercial to turn business needs into reusable, analytics-ready datasets and semantic models, delivered through the POC → Pilot → Prod pathway.
  • Implementing data quality, validation, reconciliation and monitoring controls, along with RBAC, data masking and SOX-compliant controls for close-critical financial data.
  • Supporting the platform and consumption layers, including AWS services (S3, Glue, Lambda, Athena), Apache Iceberg, Databricks, Snowflake and Power BI.
  • Applying DevOps practices (CI/CD, Git, automated testing, deployment automation), providing production support, troubleshooting complex issues and driving continuous improvement in engineering standards and documentation.

Your Skills and Expertise

To set you up for success in this role from day one, 3M requires (at a minimum) the following qualifications:

  • Bachelor's degree or higher in Computer Science, Information Technology, Engineering or a related discipline (completed and verified prior to start).
  • Four (4) to Five (5) years of experience in data engineering data warehouse development, or analytics platform support.
  • Strong, hands-on SQL expertise, including complex joins, window functions, CTEs, aggregations and query performance tuning across large datasets and relational databases.
  • Working proficiency in Python and PySpark for data processing and transformation, with experience in Lakehouse/Medallion architecture and AWS data services (S3, Glue, Lambda, Athena or equivalent).
  • Experience developing and supporting production data pipelines using Git and CI/CD practices, with an understanding of data modeling, data quality, validation and monitoring.

Additional qualifications that could help you succeed even further in this role include:

  • Databricks, AWS, Snowflake or data build tool certifications.
  • Databricks experience, including notebook development, data engineering workflows and lakehouse architecture, along with Unity Catalog and Apache Iceberg or Delta Lake.
  • Experience with data platforms and tools such as Snowflake, Azure, Power BI or similar technologies, including dbt for SQL-based transformation and testing.
  • Experience supporting data lakes, data products, analytics solutions, APIs or integration development, including SAP source data (S/4HANA, SAP HANA).
  • Clear communication, analytical problem-solving, and the ability to work independently and manage multiple priorities while collaborating with business stakeholders in fast-paced, Agile, data-product-oriented teams.

Location: Bangalore (Hebbal), Hybrid Mode


Supporting Your Well-being

3M offers many programs to help you live your best life – both physically and financially. To ensure competitive pay and benefits, 3M regularly benchmarks with other companies that are comparable in size and scope. 


Chat with Max

For assistance with searching through our current job openings or for more information about all things 3M, visit Max, our virtual recruiting assistant on 3M.com/careers.

Learn more about 3M’s creative solutions to the world’s problems at www.3M.com or on Instagram, Facebook, and LinkedIn @3M.

Safety is a core value at 3M. All employees are expected to contribute to a strong Environmental Health and Safety (EHS) culture by following safety policies, identifying hazards, and engaging in continuous improvement.

Please note: your application may not be considered if you do not provide your education and work history, either by: 1) uploading a resume, or 2) entering the information into the application fields directly.

3M Global Terms of Use and Privacy Statement

Carefully read these Terms of Use before using this website. Your access to and use of this website and application for a job at 3M are conditioned on your acceptance and compliance with these terms.

Please click on the following links and select the country where you are applying for employment to review the applicable Terms of Use (link here) and Privacy Policy (link here). Before submitting your application, you will be asked to confirm your agreement with the terms.

Skills Required

  • Bachelor's degree or higher in Computer Science, Information Technology, Engineering, or a related discipline
  • 5+ years of experience in data engineering or analytics engineering
  • Hands-on experience with SQL and relational databases
  • Experience with Python and PySpark for data processing and transformation
  • Experience with Databricks and Lakehouse or Medallion architecture
  • Experience with AWS data services such as S3, Glue, Lambda, and Athena, or equivalent
  • Experience developing and supporting production data pipelines
  • Experience with Git and CI/CD practices
  • Understanding of data modeling, data quality, validation, and monitoring
  • Experience with dbt for SQL-based transformation and testing
  • Experience with Snowflake as a SQL consumption layer
  • Experience with Apache Iceberg or Delta Lake
  • Experience with Databricks Unity Catalog and orchestration tools such as Step Functions or Airflow
  • Knowledge of data contracts, observability, SOX-compliant controls, and catalog tools such as Collibra, Alation, or Glue Data Catalog
  • Relevant Databricks, AWS, Snowflake, or dbt certifications
  • Clear communication, analytical problem-solving, and collaboration skills in Agile, data-product-oriented teams
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Saint Paul, MN
64,670 Employees
Year Founded: 1902

What We Do

3M operates as a diversified technology company, manufacturing more than 55,000 products, including adhesives, laminates, and many more. 3M touches virtually every part of your life. Our people and technology make the impossible, possible. Every day we apply our science to enhance people’s lives. This is 3M Science. Applied to Life.™

Similar Jobs

Zscaler Logo Zscaler

Development Engineer

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Hybrid
Bangalore, Bengaluru, Karnataka, IND
8697 Employees

CrowdStrike Logo CrowdStrike

Senior Technical Support Engineer

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Hybrid
Bangalore, Bengaluru Urban, Karnataka, IND
11000 Employees

The Aerospace Corporation Logo The Aerospace Corporation

Software Engr II

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
4600 Employees

The Aerospace Corporation Logo The Aerospace Corporation

Intern Bachelors Embedded Eng

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
4600 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Unusual Machines, Inc. Thumbnail
Hardware • Robotics
Orlando, FL
300 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account