Manager, Data Engineering

Posted Yesterday
Be an Early Applicant
2 Locations
In-Office
Senior level
Food
The Role
Lead and develop a data engineering team to design, build, and operate Databricks-based, medallion-architecture data pipelines. Ensure platform reliability, performance, observability, data quality, governance, and support cloud migration efforts while partnering with cloud, architecture, and governance stakeholders.
Summary Generated by Built In

Your Opportunity as the Manager, Data Engineering – Enterprise Data Platform

The Manager, Data Engineering is responsible for leading a team of Data Engineers focused on building and operating high-quality data pipelines within a modern cloud data platform. This role combines people leadership, hands-on technical oversight, and operational excellence to deliver trusted, scalable, and efficient data solutions. As part of the Enterprise Data Platforms & Enablement team, this role partners closely with Cloud Engineering, Governance, Architecture, and business stakeholders to support a large-scale transformation from on-premise systems to cloud-native platforms. The Manager ensures that data engineering practices align with modern best practices, including Databricks-based development, medallion architecture (bronze/silver/gold layers), and automated data ingestion frameworks (e.g., Fivetran).

Location: Orrville, OH (Close proximity to Cleveland/Akron)

Work Arrangements: Hybrid - onsite a minimum of 9 days a month primarily during core weeks as determined by the Company; maybe more as business need requires

In this role you will:

  • Team Leadership & Delivery

    • Lead, coach, and develop a team of Data Engineers, fostering strong technical skills and ownership

    • Set clear priorities, manage workload, and ensure timely delivery of data engineering initiatives

    • Establish engineering standards, code quality expectations, and best practices across the team

    • Partner with stakeholders to translate business needs into scalable data solutions

  • Data Pipeline Engineering

    • Oversee the design, development, and operation of data pipelines built in Databricks

    • Ensure pipelines are scalable, reliable, and aligned to medallion architecture standards (bronze, silver, gold)

    • Guide implementation of ingestion frameworks using tools like Fivetran and custom ingestion patterns

    • Drive consistent development patterns for batch and near real-time data pipelines

  • Platform & Architecture

    • Provide technical leadership for the Databricks platform, including workspace, jobs, clusters, and performance optimization

    • Collaborate with Cloud Engineering to ensure seamless integration with AWS services (e.g., S3)

    • Ensure alignment with enterprise architecture, including data modeling, partitioning strategies, and storage optimization

    • Optimize compute usage for performance and cost efficiency

  • Data Quality, Governance & Reliability

    • Establish and enforce data quality standards, including testing, validation, and monitoring frameworks

    • Ensure robust observability across pipelines (monitoring, alerting, lineage visibility)

    • Partner with Governance teams to support metadata management and lineage through tools like Atlan

    • Enforce security, compliance, and data access standards across all data engineering assets

  • Operations & Continuous Improvement

    • Own production support processes, including incident management, root cause analysis, and prevention

    • Establish proactive monitoring and health checks for pipelines and platform performance

    • Drive continuous improvement in automation, CI/CD, and release management practices

    • Support and lead data migration efforts from legacy on-prem systems to cloud platforms

What we are looking for:

Minimum Requirements:

  • Bachelor’s Degree or equivalent experience

  • 7+ years of experience in data engineering or data platform roles

  • 3+ years of experience leading and developing technical teams

  • Experience operating in modern cloud data environments (Databricks, data lakes, or lakehouse platforms)

  • Proven experience delivering enterprise-scale data pipelines and platforms

  • Experience supporting cloud migration or modernization initiatives

  • Strong expertise in Databricks (notebooks, jobs, cluster management)

  • Proficiency in Python and PySpark for distributed data processing

  • Advanced SQL skills and experience working with large-scale datasets

  • Experience designing and operating cloud-based data platforms (AWS preferred)

  • Experience with data ingestion tools (e.g., Fivetran or similar)

  • Deep understanding of data modeling and medallion architecture patterns

Additional skills and experience that we think would make someone successful in this role (not required):

  • AWS services such as S3, IAM, and data storage architectures

  • Data governance tools such as Atlan or similar

  • Reporting and visualization tools such as Tableau

  • CI/CD tools and automation frameworks

  • Monitoring and observability tools for data platforms

The Right Place for You 

We are bold, kind, strive to do the right thing, we play to win, and we believe in a strong community that thrives together. Our culture is rooted in our Basic Beliefs, and we believe in supporting every employee by meeting their physical, emotional, and financial needs. 

Stay connected with us on LinkedIn® 

We're an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, genetic information, age, national origin, disability status or protected veteran status. 

Skills Required

  • Bachelor's degree or equivalent experience
  • 7+ years of experience in data engineering or data platform roles
  • 3+ years of experience leading and developing technical teams
  • Experience operating in modern cloud data environments (Databricks, data lakes, lakehouse platforms)
  • Proven experience delivering enterprise-scale data pipelines and platforms
  • Experience supporting cloud migration or modernization initiatives
  • Strong expertise in Databricks (notebooks, jobs, cluster management)
  • Proficiency in Python and PySpark for distributed data processing
  • Advanced SQL skills and experience with large-scale datasets
  • Experience designing and operating cloud-based data platforms (AWS preferred)
  • Experience with data ingestion tools (e.g., Fivetran or similar)
  • Deep understanding of data modeling and medallion architecture patterns (bronze/silver/gold)
  • Establishing data quality, testing, validation, and monitoring frameworks

The J.M. Smucker Co. Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about The J.M. Smucker Co. and has not been reviewed or approved by The J.M. Smucker Co..

  • Retirement Support Retirement programs are described as strong, with a company 401(k) match, immediate vesting in some materials, and access to an Employee Stock Purchase Plan. These elements contribute to a favorable view of total compensation value.
  • Parental & Family Support Paid parental leave for all parents and on-site childcare at key locations signal a family-forward approach. Additional supports such as adoption assistance and pet-related leave reinforce this emphasis.
  • Leave & Time Off Breadth Paid time off, seasonal compressed schedules, and flexibility options are highlighted across materials. The ability to start with substantial PTO and buy additional time enhances perceived time-off breadth.

The J.M. Smucker Co. Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Orrville, OH
5,001 Employees

What We Do

Each generation of consumers leaves their mark on culture by establishing new expectations for food and the companies that make it. At The J.M. Smucker Co., it is our privilege to be at the heart of this dynamic with a portfolio that appeals to each generation of people and pets with products found in 90 percent of U.S. homes and countless restaurants. This includes a mix of iconic brands consumers have always loved such as Folgers®, Jif® and Milk-Bone® and new favorites like Café Bustelo®, Smucker’s® Uncrustables® and Rachael Ray® Nutrish®. By continuing to immerse ourselves in consumer and pet parent preferences for food, how it’s purchased and how the companies that make it should operate, we will maintain the important role we play in their lives. This will allow us to continue growing our business and the positive impact we have on all of those who count on us.

Similar Jobs

PNC Bank Logo PNC Bank

Software Engineering Manager

Machine Learning • Payments • Security • Software • Financial Services
Hybrid
Strongsville, OH, USA
55000 Employees
100K-223K Annually

CrowdStrike Logo CrowdStrike

Data Engineering Manager

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
USA
10000 Employees
125K-180K Annually

Citizens Logo Citizens

Engineering Manager

Digital Media • Fintech • Information Technology • Machine Learning • Financial Services • Cybersecurity • Automation
In-Office or Remote
2 Locations
17000 Employees

CVS Health Logo CVS Health

Manager, Data Engineering

Fitness • Healthtech • Retail • Pharmaceutical
In-Office or Remote
47 Locations
119959 Employees
83K-222K Annually

Similar Companies Hiring

McCain Foods Thumbnail
Food • Retail • Agriculture • Manufacturing
Florenceville-Bristol, NB
20000 Employees
Munchkin, Inc. Thumbnail
Consumer Web • eCommerce • Food • Kids + Family • Design • Manufacturing
Milton, Ontario
325 Employees
Amalgamated Sugar Thumbnail
Food • Greentech • Agriculture • Industrial • Manufacturing
Boise, Idaho
768 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account