Senior Data Engineer

Posted An Hour Ago
Be an Early Applicant
Hiring Remotely in United States
Remote
Senior level
Agriculture
The Role
Designs, develops, and maintains Databricks-based ETL pipelines, data lake architectures, datasets, and data warehouses supporting reporting, analytics, and AI/ML workloads. Troubleshoots and optimizes Databricks and SSIS processes, maintains SSRS reports, implements data quality controls, migrates legacy systems, and collaborates with business and technical teams. The role also promotes AI-assisted development practices and documents technical procedures.
Summary Generated by Built In

This role is responsible for the design, development, and maintenance of data integration and reporting solutions. Working primarily in Databricks, you will build and maintain the pipelines and datasets that feed our reporting, analytics, and AI/ML workloads. The ideal candidate will possess expertise in Databricks and strong skills in SQL Server, SSIS and SSRS, and experience with other modern data engineering tools such as Azure Data Factory. This position requires a proactive and results-oriented individual with a passion for data and a strong understanding of data warehousing principles. A strong grasp of AI-assisted development tools as a regular part of the engineering workflow is expected.

 

Responsibilities

Data Integration

  • Design, develop, and maintain robust and efficient ETL pipelines and processes on Databricks.

  • Troubleshoot and resolve Databricks pipeline errors and performance issues.

  • Troubleshoot and resolve SSIS package errors and performance issues.

  • Optimize data flow performance and minimize data latency.

  • Implement data quality checks and validations within ETL processes.

  • Maintain legacy SSIS packages for ETL processes.

 

Databricks Development

  • Develop and maintain Databricks pipelines and datasets using Python, Spark and SQL.

  • Drive the design and implementation of batch and streaming data lake architectures supporting both analytics and AI/ML workloads.

  • Optimize Databricks jobs for performance and cost-effectiveness.

  • Integrate Databricks with other data sources and systems.

  • Migrate legacy systems (e.g. SSIS packages, SQL Server procs) to Databricks pipelines.

 

Data Warehousing

  • Participate in the design and implementation of data warehousing.

  • Support data quality initiatives and implement data cleansing procedures.

 

Reporting and Analytics

  • Collaborate with business users to understand data requirements for department driven reporting needs.

  • Maintain existing library of complex SSRS reports, dashboards, and visualizations.

  • Troubleshoot and resolve SSRS report issues, including performance bottlenecks and data inconsistencies.

 

Collaboration and Communication

  • Comfortable in entrepreneurial, self-starting, and fast-paced environment, working both independently and with our highly skilled teams.

  • Collaborate effectively with business users, data analysts, and other IT teams.

  • Communicate technical information clearly and concisely, both verbally and in writing.

  • Document all development work and procedures thoroughly.

 

Continuous Growth

  • Keep abreast of the latest advancements in data integration, reporting, data engineering.

  • Actively contribute to company’s AI-assisted tooling, strategies, and best practices.

  • Continuously improve skills and knowledge through training and self-learning.

 

Requirements

  • Bachelor's Degree in Computer Science, Information Systems, or a related field.

  • 7+ years of experience in data integration and reporting.

  • Extensive experience with Databricks, including Python, Spark, and Delta Lake

  • Experience with data warehousing concepts and best practices.

  • Strong proficiency with AI-assisted development tools.

  • Strong proficiency in SQL Server, including T-SQL, stored procedures, and functions.

  • Experience with SSIS (SQL Server Integration Services) development and maintenance.

  • Experience with SSRS (SQL Server Reporting Services) report design and development.

  • Experience with Microsoft Azure cloud platform and Microsoft Fabric desirable.

  • Strong analytical and problem-solving skills.

  • Excellent communication and interpersonal skills.

  • Ability to work independently and as part of a team.

  • Experience with Agile methodologies.

About Us

As a holding company with cooperative and private ownership, URUS is a family of businesses at the heart of the dairy and beef industry – Alta Genetics, GENEX, Genetics Australia, Leachman Cattle, Jetstream, PEAK, SCCL, Trans Ova Genetics and VAS.  Each organization has its unique identity, products, and services. These companies work globally to provide cutting-edge dairy and beef genetics, customized reproductive services to maximize conceptions, dairy management information to take producers to the frontline of progressive dairy farming, and an array of products and services to help bovines reach their full genetic potential. URUS has 9 brands in 17 retail countries and employs nearly 2,800 people globally.


Skills Required

  • Bachelor's degree in Computer Science, Information Systems, or a related field
  • 7+ years of experience in data integration and reporting
  • Extensive experience with Databricks, Python, Spark, and Delta Lake
  • Experience with data warehousing concepts and best practices
  • Strong proficiency with AI-assisted development tools
  • Strong proficiency in SQL Server, including T-SQL, stored procedures, and functions
  • Experience developing and maintaining SSIS packages
  • Experience designing and developing SSRS reports
  • Experience with Microsoft Azure cloud platform
  • Experience with Microsoft Fabric
  • Strong analytical and problem-solving skills
  • Excellent communication and interpersonal skills
  • Ability to work independently and as part of a team
  • Experience with Agile methodologies
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
17 Employees
Year Founded: 2003

What We Do

Leachman Cattle of Colorado develops and markets cattle genetics for the beef industry. The company breeds and sells elite bulls, females, and semen, including Angus, Red Angus, Stabilizer composites, and Charolais, with an emphasis on genetic improvement, feed efficiency, and profitability for cow/calf producers. It also markets bulls through annual, regional, and private-treaty sales and arranges delivery to stockyards nationwide.

Similar Jobs

Optum Logo Optum

Senior Data Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office or Remote
Raleigh, NC, USA
160000 Employees
92K-164K Annually

Jellyfish Logo Jellyfish

Senior Data Engineer

Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
Remote or Hybrid
United States
225 Employees
165K-235K Annually

Centerfield Logo Centerfield

Senior Data Engineer

AdTech • Consumer Web • Digital Media • eCommerce • Marketing Tech • SEO
Remote or Hybrid
United States
890 Employees

NinjaOne Logo NinjaOne

Senior Data Engineer

Information Technology • Productivity • Software • Infrastructure as a Service (IaaS)
Remote or Hybrid
18 Locations
2000 Employees
110K-200K Annually

Similar Companies Hiring

McCain Foods Thumbnail
Food • Retail • Agriculture • Manufacturing
Florenceville-Bristol, NB
20000 Employees
Halter Thumbnail
Software • Machine Learning • Internet of Things • Hardware • Greentech • Business Intelligence • Agriculture
Boulder, Colorado
350 Employees
Amalgamated Sugar Thumbnail
Food • Greentech • Agriculture • Industrial • Manufacturing
Boise, Idaho
768 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account