Sr Data Engineer -

Reposted Yesterday
Hiring Remotely in The Entertainment District, ON, CAN
Remote
Senior level
Cloud • Information Technology • Software
The Role
Design, build, and optimize Databricks-based data and ML platforms. Own ETL pipelines, Delta Lake lakehouse, MLflow model lifecycle, MLOps, cluster optimization, RAG/LLM solutions, BI integration, and data governance with Unity Catalog.
Summary Generated by Built In

Job Summary

We are seeking a highly skilled Databricks Engineer with AI/ML experience to design, build, and optimize scalable data and machine learning platforms on Databricks. The role involves end-to-end ownership of data pipelines, ML workflows, and production AI systems.

Key Responsibilities

  • Design and implement scalable ETL pipelines using Databricks & Spark
  • Build Lakehouse architecture using Delta Lake
  • Develop and deploy ML models using MLflow
  • Implement MLOps pipelines for training, testing, and serving models
  • Optimize cluster performance and reduce compute cost
  • Build RAG and LLM-based solutions using Mosaic AI
  • Integrate analytics with BI tools (Power BI, Tableau)
  • Implement data governance using Unity Catalog
  • Collaborate with Data Scientists and Business teams
  • Ensure data quality, security, and compliance

Required Skills

Mandatory

  • 5+ years of Databricks & Apache Spark
  • Strong Python & PySpark
  • Experience with Delta Lake & Lakehouse
  • MLflow & MLOps experience
  • Cloud platform (AWS/Azure/GCP)
  • Git & CI/CD

Preferred

  • Experience with LLMs & Generative AI
  • RAG pipelines & Vector Databases
  • Deep Learning frameworks
  • Databricks certifications
  • Power BI integration

 



Requirements

Job Summary

We are seeking a highly skilled Databricks Engineer with AI/ML experience to design, build, and optimize scalable data and machine learning platforms on Databricks. The role involves end-to-end ownership of data pipelines, ML workflows, and production AI systems.

Key Responsibilities

  • Design and implement scalable ETL pipelines using Databricks & Spark
  • Build Lakehouse architecture using Delta Lake
  • Develop and deploy ML models using MLflow
  • Implement MLOps pipelines for training, testing, and serving models
  • Optimize cluster performance and reduce compute cost
  • Build RAG and LLM-based solutions using Mosaic AI
  • Integrate analytics with BI tools (Power BI, Tableau)
  • Implement data governance using Unity Catalog
  • Collaborate with Data Scientists and Business teams
  • Ensure data quality, security, and compliance

Required Skills

Mandatory

  • 5+ years of Databricks & Apache Spark
  • Strong Python & PySpark
  • Experience with Delta Lake & Lakehouse
  • MLflow & MLOps experience
  • Cloud platform (AWS/Azure/GCP)
  • Git & CI/CD

Preferred

  • Experience with LLMs & Generative AI
  • RAG pipelines & Vector Databases
  • Deep Learning frameworks
  • Databricks certifications
  • Power BI integration

 



Skills Required

  • 5+ years of Databricks & Apache Spark
  • Strong Python & PySpark
  • Experience with Delta Lake & Lakehouse
  • MLflow & MLOps experience
  • Cloud platform (AWS/Azure/GCP)
  • Git & CI/CD
  • Experience with LLMs & Generative AI
  • RAG pipelines & Vector Databases
  • Deep Learning frameworks
  • Databricks certifications
  • Power BI integration / Tableau
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Seattle, WA
1,233 Employees
Year Founded: 2002

What We Do

iLink Digital, a CMMI Level 3 and ISO 9001:2015 Certified Global Software Solution Provider and Systems Integrator, delivers next-generation technology solutions to help clients solve complex business challenges, improve organizational effectiveness, increase business productivity, realize sustainable enterprise value and transform your business inside-out. iLink integrates software systems and develops custom applications, components, and frameworks on the latest platforms for IT departments, commercial accounts, application services providers (ASP) and independent software vendors (ISV). iLink solutions are used in a broad range of industries and functions, including healthcare, telecom, government, oil and gas, education, and life sciences. iLink’s expertise includes Cloud Computing & Application Modernization, Data Management & Analytics, Enterprise Mobility, Portal, collaboration & Social Employee Engagement, Embedded Systems and User Experience design etc. What makes iLink Digital's offerings unique is the fact that we use pre-created frameworks, designed to accelerate software development and implementation of business processes for our clients. iLink has over 60 frameworks (solution accelerators), both industry-specific and horizontal, that can be easily customized and enhanced to meet your current business challenges.

Similar Jobs

Block Logo Block

Senior Data Engineer

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
In-Office or Remote
8 Locations
12000 Employees
168K-297K Annually

Cash App Logo Cash App

Senior Data Engineer

Blockchain • Fintech • Mobile • Payments • Software • Financial Services
Remote or Hybrid
8 Locations
3500 Employees
168K-297K Annually

Babylist Logo Babylist

Senior Data Engineer

eCommerce • Healthtech • Kids + Family • Retail • Social Media
Easy Apply
Remote or Hybrid
Canada
300 Employees

Samsara Logo Samsara

Sr. Data Ops Engineer

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
Canada
4000 Employees
113K-146K Annually

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account