Senior Data Engineer – AWS & Databricks

Posted 19 Hours Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
In-Office
2M-2M Annually
Senior level
HR Tech • Information Technology • Professional Services
The Role
Design, develop, and optimize scalable ETL pipelines, data models, and analytics solutions using AWS, Databricks, and Apache Spark. Ensure data quality, security, governance, and performance while supporting streaming and real-time processing. Collaborate with data scientists, analysts, and stakeholders on scalable solutions, participate in code reviews, document systems, troubleshoot issues, and mentor junior engineers.
Summary Generated by Built In


Senior Data Engineer – AWS & Databricks
Role Details
  • Experience: 6–10 Years

  • Location: Bengaluru

  • Work Mode: Hybrid (2–3 days/week from office mandatory)

  • Mandatory Skills: AWS + Databricks

  • Budget: 17 LPA

  • Joining: Immediate / Early joiners preferred

  • Contract Duration: 12 months

Role Overview

We are seeking a highly skilled Senior Data Engineer with strong hands-on experience in AWS and Databricks to design, implement, and optimize scalable data pipelines and analytics solutions. The ideal candidate should have deep expertise in Apache Spark, ETL design, cloud-native data engineering, and modern data governance practices.

You will collaborate closely with data scientists, analysts, and business stakeholders to deliver robust, high-performance data solutions that drive strategic insights.


Key Responsibilities
  • Design, develop, and optimize ETL pipelines using Databricks and Apache Spark.

  • Build scalable and efficient data models and schemas.

  • Collaborate with data scientists to support ML model deployment.

  • Ensure data quality, consistency, reliability, and governance.

  • Optimize SQL queries and troubleshoot performance bottlenecks.

  • Implement data security, access controls, and governance policies.

  • Work with Databricks Unity Catalog for centralized governance.

  • Develop and maintain technical documentation.

  • Participate in code reviews and mentor junior engineers.

  • Translate business requirements into scalable technical solutions.

  • Support real-time and streaming data processing use cases.

Required Skills & Qualifications
Technical Skills
  • 6–10 years of experience in Data Engineering.

  • Strong expertise in Databricks Platform and Apache Spark.

  • Hands-on experience with AWS cloud services.

  • Excellent SQL skills.

  • Strong programming skills in Python or Scala.

  • Experience building robust ETL processes and data pipelines.

  • Experience with Databricks Unity Catalog.

  • Understanding of distributed computing and big data architecture.

  • Familiarity with Git and version control practices.

  • Experience with real-time/streaming data processing.

  • Strong understanding of data warehousing and analytics concepts.

Nice to Have
  • Databricks certifications.

  • Experience with data governance and compliance standards.

  • Exposure to Azure or GCP (secondary cloud platforms).

  • Experience in fast-paced enterprise environments.

Soft Skills
  • Strong analytical and problem-solving ability.

  • Excellent communication and stakeholder collaboration skills.

  • Ability to manage multiple priorities in a dynamic environment.

  • Mentoring and team collaboration mindset.



Skills Required

  • 6-10 years of experience in data engineering
  • Strong expertise with the Databricks platform and Apache Spark
  • Hands-on experience with AWS cloud services
  • Excellent SQL skills
  • Strong programming skills in Python or Scala
  • Experience building robust ETL processes and data pipelines
  • Experience with Databricks Unity Catalog
  • Understanding of distributed computing and big data architecture
  • Familiarity with Git and version control practices
  • Experience with real-time or streaming data processing
  • Strong understanding of data warehousing and analytics concepts
  • Databricks certifications
  • Experience with data governance and compliance standards
  • Exposure to Azure or GCP
  • Experience in fast-paced enterprise environments
  • Strong analytical and problem-solving ability
  • Excellent communication and stakeholder collaboration skills
  • Ability to manage multiple priorities in a dynamic environment
  • Mentoring and team collaboration mindset
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
76 Employees
Year Founded: 2010

What We Do

Talpro India Private Limited is a technology-driven recruitment and staffing company serving businesses across industries. It specializes in sourcing, vetting, and hiring top-tier technology talent, while providing innovative, sustainable, and cost-effective recruitment solutions. The company develops comprehensive hiring strategies intended to meet immediate recruitment demands and support longer-term workforce needs, acting as a human-resources services provider in India for employers.

Similar Jobs

Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
2449 Employees

BlackRock Logo BlackRock

Application Engineer

Fintech • Information Technology • Financial Services
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
25000 Employees

Cargill Logo Cargill

Manager, Software Engineering - Food

Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
155000 Employees

Cargill Logo Cargill

Senior Application Engineer

Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
155000 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account