Senior Engineer – Data Engineering (Databricks) - India

Posted 6 Hours Ago
Be an Early Applicant
Navi Mumbai, Thane, Maharashtra, IND
In-Office
Senior level
Digital Media
The Role
Lead data engineering delivery on the Databricks Platform, building scalable batch, micro-batch, and streaming pipelines. Design lakehouse solutions using Delta Lake, Iceberg, Delta Live Tables, Unity Catalog, Spark, and cloud data platforms. Develop workflow orchestration, data quality, observability, CI/CD, and infrastructure automation solutions. Collaborate with architects and cross-functional teams, contribute to Databricks Center of Excellence initiatives, and deliver solution accelerators for clients.
Summary Generated by Built In

Senior Engineer – Data Engineering

Who You’ll Work With Slalom is a fiercely human business and technology consulting company that leads with outcomes to bring more value, in all ways, always. From strategy through delivery, our agile teams across 52 offices in 12 countries collaborate with clients to bring powerful customer experiences, innovative ways of working, and new products and services to life. We are trusted by leaders across the Global 1000, many successful enterprise and mid-market companies, and 500+ public sector organizations to improve operations, drive growth, and create value. At Slalom, we believe that together, we can move faster, dream bigger, and build better tomorrows for all.

What You’ll Do

• Be a technical leader in teams with minimal oversight and direction to deliver innovative solutions on the Databricks Platform using core cloud data lakehouse methodologies, tools, distributed processing engines, event streaming platforms, and other modern data related technologies.

• Be part of the Databricks Center of Excellence.

• Build the next generation of data platforms and work with some of the most forward-thinking organizations in data and analytics.

• Work under the direction of a Solution Architect to help design and implement components of our clients’ data platform solution.

• Participate in design sessions and be able to break down complex development tasks, and complete development items on time.

• Contribute to various COE initiatives to develop Databricks solution accelerators and bring an innovative mindset.

What You’ll Bring

As a Senior Engineer in the Databricks practice, you will bring a curious mindset and a passion for exploring innovative solutions to address our clients’ most pressing data challenges. You are a self-starter who excels at breaking down complex problems and eagerly shares insights with your team and the broader Builder community.

Key Responsibilities:

•

Develop and implement data solutions using Databricks, with hands-on experience in specific Databricks platform features such as Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative Pipelines), and Unity Catalog.

•

Collaborate with cross-functional teams to design and optimize data pipelines for both batch and streaming data, ensuring data quality and efficiency.

•

Stay updated with emerging technologies, latest Databricks platform features and continuously improve your skills in Databricks and other relevant tools.

Requirements:

•

5+ years of data engineering experience, with at least 2 years of hands-on data pipeline design and development experience with Databricks, including specific -platform features like Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative pipelines), and Unity Catalog.

•

Proficiency in designing and building robust, scalable, YAML configuration driven data pipelines with batch, micro-batch, and streaming data ingestion and processing patterns

using tools like Auto Loader demonstrating a strong understanding of modern data engineering practices.Experienced in building complex job/workflow orchestration patterns using either Databricks jobs/workflows or with other orchestration tools like Airflow, dbt etc.

•

Exposure in building robust data quality, pipeline audit/observability solutions with Databricks native features and/or other data quality tools/frameworks like Great Expectations, Collibra, dbt etc.

•

Proficiency in Big Data Platforms: Apache Spark, Presto, Amazon EMR.

•

Experience with Cloud Data Warehouses: Amazon Redshift, Snowflake, Google BigQuery.

•

Strongprogramming skills using SQL, Stored Proceduresand Object-Oriented Programming languages (like Java, Python, PySpark etc.).

•

Familiarity with building DevOPs, CI/CD pipelines using Databricks Asset Bundles with automated validation and testing.

•

Exposure with Infrastructure as Code (IaC) tools like Terraform is a big plus.

•

Familiarity with NoSQL Databases and Container Management Systems.

•

Exposure to AI/ML tools (like mlflow), prompt engineering,, and modern data and AI agentic workflows.

•

An ideal candidate will have Databricks Data Engineering Associate and/or Professional ceritification completed with multiple Databricks project delivery experience.

About Us Slalom is a purpose-led, global business and technology consulting company. From strategy to implementation, our approach is fiercely human. In six countries and 43 markets, we deeply understand our customers—and their customers—to deliver practical, end-to-end solutions that drive meaningful impact. Backed by close partnerships with over 400 leading technology providers, our 13,000+ strong team helps people and organizations dream bigger, move faster, and build better tomorrows for all. We’re honored to be consistently recognized as a great place to work,including being one of Fortune’s 100 Best Companies to Work for seven years running. Learn more at slalom.com.

Skills Required

  • 5+ years of data engineering experience
  • At least 2 years of hands-on Databricks data pipeline design and development experience
  • Experience with Delta Lake, Uniform or Iceberg, Delta Live Tables or Lakeflow Declarative Pipelines, and Unity Catalog
  • Experience designing scalable YAML configuration-driven batch, micro-batch, and streaming data pipelines
  • Experience with Auto Loader and modern data ingestion and processing patterns
  • Experience with Databricks Jobs or Workflows, Apache Airflow, dbt, or other orchestration tools
  • Experience building data quality, pipeline audit, and observability solutions
  • Proficiency with Apache Spark, Presto, and Amazon EMR
  • Experience with Amazon Redshift, Snowflake, and Google BigQuery
  • Strong SQL, stored procedure, and object-oriented programming skills using Java, Python, or PySpark
  • Familiarity with DevOps and CI/CD pipelines using Databricks Asset Bundles
  • Exposure to Terraform and infrastructure as code
  • Familiarity with NoSQL databases and container management systems
  • Exposure to MLflow, prompt engineering, and agentic data and AI workflows
  • Databricks Data Engineering Associate or Professional certification
  • Multiple Databricks project delivery experience
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Walnut Creek, CA
168 Employees
Year Founded: 1994

What We Do

Established in 1994, Object Edge is an award-winning digital consultancy working with leading global brands. In a challenging digital landscape, we help businesses differentiate and compete by creating effortless digital experiences. We design, implement, and support commerce, content, subscription, and CPQ with a data-driven, highly collaborative, and best-in-class team. Oracle Gold Partner (Commerce, CPQ, Subscription) | commercetools Select Partner | MACH Alliance Certified

Similar Jobs

Cloudflare Logo Cloudflare

Program Manager

Cloud • Information Technology • Security • Software • Cybersecurity
Remote or Hybrid
India
4400 Employees

Mastercard Logo Mastercard

Senior Software Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Pune, Maharashtra, IND
38800 Employees

Mastercard Logo Mastercard

Vice President, Software Engineering

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Pune, Maharashtra, IND
38800 Employees

ZS Logo ZS

Senior IT Project Associate

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
Pune, Maharashtra, IND
15000 Employees

Similar Companies Hiring

Hedra Thumbnail
Consumer Web • Digital Media • Enterprise Web • Marketing Tech • News + Entertainment • Software • Generative AI
San Francisco, CA
Bankrate Thumbnail
Artificial Intelligence • Consumer Web • Digital Media • Fintech • Marketing Tech • Software • Financial Services
US
160 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account