Senior Cloud Data Engineer

Posted Yesterday
Green Bay, WI, USA
In-Office
Senior level
Food • Logistics • Biotech • Agriculture
The Role
Designs, develops, and optimizes Azure-based data engineering solutions for manufacturing operations, business intelligence, analytics, and digital transformation. Builds ETL/ELT pipelines, lakehouse architectures, data models, governance controls, and integrations across enterprise systems. Monitors and troubleshoots production workflows, improves performance and cost efficiency, and supports data quality, security, and compliance. Collaborates with stakeholders and technical teams, participates in Agile delivery, and mentors junior engineers.
Summary Generated by Built In
Overview

JOB SUMMARY


The Senior Cloud Data Engineer designs, develops, and optimizes scalable data solutions that support manufacturing operations, business intelligence, advanced analytics, and digital transformation. This role builds and maintains cloud-based data pipelines using Azure Databricks and related Azure services to integrate enterprise operational and business data. The ideal candidate combines hands-on cloud data engineering experience with collaboration across business stakeholders, analysts, architects, and data engineers to deliver reliable, secure, and high-performing data products that enable data-driven decisions across the organization.


Essential Functions and Responsibilities

  • Design, develop, and maintain scalable ETL/ELT pipelines using Azure Databricks, PySpark, Python, and SQL.
  • Build and optimize ingestion frameworks for ERP, MES, Industrial IoT, quality, supply chain, inventory, finance, and related operational systems.
  • Develop reusable engineering patterns and standards that improve delivery speed, supportability, and reliability.
  • Implement and support lakehouse solutions using Delta Lake and Medallion Architecture across Bronze, Silver, and Gold layers.
  • Design and optimize data models for reporting, analytics, AI, and machine learning use cases.
  • Maintain data lineage, metadata, technical documentation, and operational runbooks.
  • Integrate Azure Databricks with Azure Data Factory, Azure Data Lake Storage Gen2, Azure Key Vault, Microsoft Fabric, Power BI, and Azure DevOps.
  • Support orchestration and movement of data between enterprise applications and cloud platforms.
  • Monitor and optimize Databricks clusters, jobs, notebooks, and workflows for performance, scalability, and cost efficiency.
  • Troubleshoot production issues, identify root causes, and implement sustainable corrective actions.
  • Contribute to monitoring, alerting, testing, and operational support practices.
  • Apply organizational standards for data quality, governance, privacy, security, and compliance.
  • Implement role-based access controls and governed data access using Unity Catalog and Azure security services.
  • Build automated validation, auditing, and data quality controls into engineering workflows.
  • Partner with business users, analysts, architects, and IT teams to translate requirements into maintainable technical solutions.
  • Participate in Agile ceremonies, sprint planning, code reviews, and technical design reviews.
  • Mentor junior engineers and promote coding, testing, documentation, and deployment best practices.
Qualifications

QUALIFICATIONS, KNOWLEDGE, SKILLS, AND EXPERIENCE

  • Bachelor's degree in computer science, information systems, data engineering, or a related field; an equivalent combination of education and experience may be considered.
  • 3–5 years of experience in data engineering, cloud engineering, or analytics platform development.
  • Minimum 2 years of hands-on experience developing solutions with Azure Databricks.
  • Experience supporting enterprise data solutions in a manufacturing or industrial environment.
  • Strong knowledge of Azure Databricks, Apache Spark, PySpark, Python, SQL, Delta Lake, lakehouse architecture, data modeling, and data warehousing concepts.
  • Experience with Azure Data Lake Storage Gen2, Azure Data Factory, Azure DevOps, Git source control, and CI/CD practices for data platforms.
  • Experience with data quality, security, monitoring, troubleshooting, and performance tuning.
  • Knowledge of manufacturing data domains such as ERP, MES, production planning, inventory, supply chain, quality management, maintenance, or Industrial IoT.
  • Ability to work with operational stakeholders and translate manufacturing processes into reliable data requirements and solutions.

ADDITIONAL SKILLS/EXPERIENCE/REQUIREMENTS

  • Experience with Microsoft Fabric, Power BI, or real-time and streaming data workloads.
  • Hands-on experience with Unity Catalog and governed lakehouse implementations.
  • Exposure to machine learning or AI data preparation and deployment patterns.
  • Experience with Infrastructure as Code using Terraform, Bicep, or ARM templates.
  • Preferred knowledge of Infor M3, including its application design, business data model, and core table structures used across manufacturing, supply chain, inventory, finance, and related functional areas.
  • Preferred understanding of production, planning, inventory, quality, maintenance, and supply chain processes.
  • Microsoft Certified: Azure Data Engineer Associate.
  • Databricks Certified Data Engineer Associate or Professional.
  • Microsoft Certified: Fabric Analytics Engineer Associate.

INTENT AND FUNCTION OF JOB DESCRIPTIONS

Job descriptions assist organizations in ensuring that the hiring process is fairly administered and that qualified employees are selected. All descriptions have been reviewed to ensure that only essential functions and basic duties have been included. Requirements, skills, and abilities included have been determined to be the minimal standards required to successfully perform the positions. In no instance, however, should the duties, responsibilities, and requirements delineated be interpreted as all-inclusive. Additional functions and requirements may be assigned by supervisors as deemed appropriate. Job descriptions are not intended as and do not create employment contracts. The organization maintains its status as an at-will employer. Employees can be terminated for any reason not prohibited by law.

Summary

OUR FAMILY CULTURE


We are a family-owned business established in 1946 with nearly 5,000 employees. Over the years, Rosen’s Diversified, Inc. (“RDI”) has grown into a holding company of vertically integrated business units, including American Foods Group, America’s Service Line, Scientific Life Solutions, and Rosen’s Inc. By understanding our employees, our customers and ourselves, we are preparing RDI for the future generations of success.


Our Company is comprised of innovative entrepreneurs who value our casual and down to earth culture. As a member of the Rosen’s family, you will find yourself challenged and rewarded for your professional contributions as well as the Company’s success.


WHAT WE OFFER

  • Privately held, family-owned (three generations) business which operates with a mentality of what should be done versus share holder requirements.
  • Excellent health and welfare benefits including but not limited to medical, dental, vision, disability, and a variety of voluntary benefit options.
  • 401(k) benefits with annual company match for eligible employees.
  • Professional and personal development programs including Career and Learning Paths providing opportunities for advancement.

Skills Required

  • Bachelor's degree in computer science, information systems, data engineering, or a related field, or equivalent education and experience
  • 3-5 years of experience in data engineering, cloud engineering, or analytics platform development
  • At least 2 years of hands-on experience developing Azure Databricks solutions
  • Experience supporting enterprise data solutions in a manufacturing or industrial environment
  • Knowledge of Azure Databricks, Apache Spark, PySpark, Python, SQL, Delta Lake, lakehouse architecture, data modeling, and data warehousing
  • Experience with Azure Data Lake Storage Gen2, Azure Data Factory, Azure DevOps, Git source control, and CI/CD practices
  • Experience with data quality, security, monitoring, troubleshooting, and performance tuning
  • Knowledge of manufacturing data domains including ERP, MES, production planning, inventory, supply chain, quality management, maintenance, or Industrial IoT
  • Ability to translate manufacturing processes into reliable data requirements and technical solutions
  • Experience with Microsoft Fabric, Power BI, or real-time and streaming data workloads
  • Hands-on experience with Unity Catalog and governed lakehouse implementations
  • Exposure to machine learning or AI data preparation and deployment patterns
  • Experience with Infrastructure as Code using Terraform, Bicep, or ARM templates
  • Knowledge of Infor M3, including application design, business data model, and core table structures
  • Understanding of production, planning, inventory, quality, maintenance, and supply chain processes
  • Microsoft Certified: Azure Data Engineer Associate
  • Databricks Certified Data Engineer Associate or Professional
  • Microsoft Certified: Fabric Analytics Engineer Associate
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
5,000 Employees
Year Founded: 1946

What We Do

Rosen’s Diversified, Inc. (RDI) is a privately held, family-run holding company with vertically integrated businesses spanning agriculture, food production, transportation and life-science materials. Its portfolio includes Rosen’s Inc., which supplies crop-protection and agribusiness products; American Foods Group, a major beef processor; America’s Service Line, a refrigerated transportation fleet; and Scientific Life Solutions, a biomaterials supplier serving biomanufacturing, regenerative medicine and research markets.

Similar Jobs

SoFi Logo SoFi

Senior Manager, Compliance Marketing

Fintech • Mobile • Software • Financial Services
Easy Apply
Remote or Hybrid
United States
4500 Employees
131K-226K Annually

Findhelp Logo Findhelp

Senior Account Executive

Cloud • Edtech • Healthtech • Mobile • Social Impact • Software • Data Privacy
Remote or Hybrid
United States
250 Employees

Hilton Logo Hilton

Senior Revenue Specialist, High Efficiency Support

Events • Food • Travel • Hospitality • Hotels & Resorts
In-Office or Remote
3 Locations
500000 Employees
40K-80K Annually

Hilton Logo Hilton

Senior Manager, Owner Relations

Events • Food • Travel • Hospitality • Hotels & Resorts
In-Office or Remote
2 Locations
500000 Employees
40K-120K Annually

Similar Companies Hiring

HERE Technologies Thumbnail
Artificial Intelligence • Automotive • Computer Vision • Information Technology • Internet of Things • Logistics • Software
Amsterdam, NL
6000 Employees
Axle Health Thumbnail
Artificial Intelligence • Healthtech • Information Technology • Logistics
Santa Monica, CA
25 Employees
Amalgamated Sugar Thumbnail
Food • Greentech • Agriculture • Industrial • Manufacturing
Boise, Idaho
768 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account