Mid-Senior Databricks Engineer

Posted 10 Days Ago
Be an Early Applicant
Hiring Remotely in Chandigarh, IND
In-Office or Remote
Senior level
Information Technology • Marketing Tech • Software • Analytics
The Role
Develop and maintain scalable Databricks data pipelines using Python, PySpark, and Delta Lake. Build automated ETL workflows with Delta Live Tables, optimize Spark jobs through partitioning and performance tuning, and manage orchestration with Airflow or Azure Data Factory. Implement data quality and governance practices while collaborating with cross-functional teams to deliver reliable, efficient data engineering solutions.
Summary Generated by Built In

This is a remote position.

Position: Mid-Senior Databricks Engineer
Location: Remote
Experience: 3–6 Years
Employment Type: Full-Time
Required Skills & Qualifications
  • 3–6 years of experience in Data Engineering.

  • Strong knowledge of SQL, Python, and PySpark.

  • Hands-on experience with Databricks and Apache Spark.

  • Understanding of Spark optimization, partitioning, and shuffling.

  • Experience with Delta Lake, Z-Ordering, and VACUUM.

  • Experience building ETL pipelines using Delta Live Tables (DLT).

  • Knowledge of Apache Airflow or Azure Data Factory.

  • Understanding of data governance and data quality.

Key Responsibilities
  • Develop and maintain scalable data pipelines using Databricks, Python, and PySpark.

  • Build and automate ETL workflows using Delta Live Tables (DLT).

  • Optimize Spark jobs through partitioning, shuffling, and performance tuning.

  • Implement Delta Lake optimization techniques, including Z-Ordering and VACUUM.

  • Manage data orchestration using Airflow or Azure Data Factory.

  • Ensure data quality, governance, and pipeline performance.

  • Collaborate with cross-functional teams to deliver efficient data engineering solutions.

  • ​



Skills Required

  • 3-6 years of experience in data engineering
  • Strong knowledge of SQL
  • Strong knowledge of Python
  • Strong knowledge of PySpark
  • Hands-on experience with Databricks and Apache Spark
  • Understanding of Spark optimization, partitioning, and shuffling
  • Experience with Delta Lake, Z-Ordering, and VACUUM
  • Experience building ETL pipelines using Delta Live Tables
  • Knowledge of Apache Airflow or Azure Data Factory
  • Understanding of data governance and data quality
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Chandigarh
143 Employees
Year Founded: 2021

What We Do

Arting Digital is an IT services and digital transformation company serving more than 500 clients worldwide. It provides customized technology solutions spanning software and product engineering, web and mobile application development, cloud computing, data and analytics, DevOps, QA testing, robotic process automation, digital marketing, consulting, and related digital services to help organizations improve operations and achieve growth.

Similar Jobs

Micron Technology Logo Micron Technology

Engineer, STPG PE

Artificial Intelligence • Hardware • Information Technology • Machine Learning
Remote
Gujarat, IND
45000 Employees

Micron Technology Logo Micron Technology

ENGINEER, EQUIPMENT ENGINEER

Artificial Intelligence • Hardware • Information Technology • Machine Learning
Remote
Gujarat, IND
45000 Employees

Circle (circle.so) Logo Circle (circle.so)

Operations Coordinator

Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Remote
32 Locations
250 Employees

Pfizer Logo Pfizer

Platform Engineer

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote
India
121990 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account