Lead Data Engineer

Posted 3 Days Ago
Be an Early Applicant
4 Locations
In-Office
1M-3M Annually
Senior level
Artificial Intelligence • HR Tech • Professional Services • Software
The Role
Design, develop, and maintain scalable cloud-based data pipelines and ETL/ELT processes. Build and optimize data solutions on GCP (BigQuery, Dataflow), ensure data quality, governance, monitoring, and high availability. Develop backend data processing services in Java, support BI, analytics, and ML teams, troubleshoot pipeline issues, and contribute to data platform architecture and modernization.
Summary Generated by Built In

This role is for one of the Weekday's clients

Salary range: Rs 1200000 - Rs 2500000 (ie INR 12-25 LPA)

Experience: 7+ yrs

Location: Pune, Bangalore, Chennai, Coimbatore

Job Type: full-time

We are looking for a skilled Data Engineer who is passionate about building scalable data platforms and enabling data-driven decision-making. This role involves designing, developing, and maintaining robust data pipelines, processing large-scale datasets, and ensuring the availability, reliability, and performance of data systems.

The ideal candidate will have strong expertise in cloud-based data engineering, backend development, and modern data processing technologies. You will work closely with cross-functional teams to create efficient data solutions that support analytics, reporting, machine learning, and business intelligence initiatives.


RequirementsKey Responsibilities
  • Design, develop, and maintain scalable data pipelines for processing structured and unstructured data.
  • Build and optimize cloud-based data solutions using modern data engineering best practices.
  • Develop and manage data ingestion, transformation, validation, and orchestration workflows.
  • Create reliable ETL/ELT pipelines to support analytics, reporting, and operational use cases.
  • Work with large datasets to ensure data quality, consistency, and accessibility across systems.
  • Develop and optimize backend services and data processing applications using Java.
  • Implement data governance, monitoring, and performance optimization practices.
  • Collaborate with product, analytics, and engineering teams to understand data requirements and deliver scalable solutions.
  • Troubleshoot data pipeline issues and proactively identify opportunities for improvement.
  • Ensure high availability, security, and scalability of data infrastructure.
  • Participate in architecture discussions and contribute to data platform modernization initiatives.
  • Support business intelligence, advanced analytics, and machine learning teams with reliable data assets.
What Makes You a Great Fit
  • Strong experience in Data Engineering and building scalable data processing systems.
  • Proficiency in Java and cloud-native data engineering practices.
  • Hands-on experience with Google Cloud Platform (GCP) and its data ecosystem.
  • Strong understanding of data warehousing, data modeling, and distributed data processing concepts.
  • Experience building and maintaining high-performance ETL/ELT pipelines.
  • Familiarity with BigQuery, Dataflow, and other cloud-based data processing technologies is highly desirable.
  • Strong SQL skills and experience working with large-scale datasets.
  • Understanding of data architecture, data governance, and data quality frameworks.
  • Experience with workflow orchestration, monitoring, and automation tools.
  • Strong analytical thinking and problem-solving abilities.
  • Ability to collaborate effectively with cross-functional stakeholders and communicate technical concepts clearly.
  • Self-driven mindset with a focus on ownership, scalability, and continuous improvement.

Skills Required

  • 7+ years of experience in Data Engineering
  • Strong experience building scalable data processing systems
  • Proficiency in Java
  • Hands-on experience with Google Cloud Platform (GCP) and its data ecosystem
  • Strong SQL skills and experience with large-scale datasets
  • Experience building and maintaining ETL/ELT pipelines
  • Understanding of data warehousing, data modeling, and distributed data processing concepts
  • Experience with workflow orchestration, monitoring, and automation tools
  • Familiarity with BigQuery and Dataflow
  • Knowledge of data governance, data quality, and performance optimization practices
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
0 Employees
Year Founded: 2021

What We Do

Weekday is an AI-powered recruitment platform that helps startups hire top-tier engineering and product talent. By leveraging a massive database of white-collar professionals and advanced outreach tools, the company streamlines the hiring process through automated sourcing, AI-driven resume screening, and white-glove contingency services. Their mission is to modernize recruitment by enabling companies to discover and engage passive candidates efficiently, ensuring high-quality hires for critical roles.

Similar Jobs

Mastercard Logo Mastercard

Lead Data Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Pune, Mahārāshtra, IND
38800 Employees

Mastercard Logo Mastercard

Lead Data Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Pune, Mahārāshtra, IND
38800 Employees

M&G Logo M&G

Lead Data Engineer

Fintech • Financial Services
In-Office
Pune, Mahārāshtra, IND
2729 Employees

Weekday, Inc. Logo Weekday, Inc.

Lead Data Engineer

Artificial Intelligence • HR Tech • Professional Services • Software
In-Office
4 Locations
2M-3M Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account