Lead Data Engineer

Posted 2 Days Ago
Be an Early Applicant
Hiring Remotely in Gurgaon, Haryana, IND
In-Office or Remote
Senior level
Information Technology
The Role
Design and operate scalable multi-cloud data platforms, real-time and batch pipelines, lakehouse architectures, and distributed processing systems. Optimize BigQuery, data models, queries, and warehouse performance while automating infrastructure with Terraform and Kubernetes. Lead architecture reviews, ensure data reliability, security, governance, and compliance, and mentor engineers. The role requires extensive production data-platform experience and expertise in Kafka, Spark, GCP, BigQuery, Airflow, and lakehouse technologies.
Summary Generated by Built In

This is a remote position.

Shuru is an AI-native technology and engineering company that partners with businesses to build and scale high-impact digital products, platforms, and AI-driven solutions. We work with fast-growing organizations across industries, helping them solve complex technology challenges through strong engineering, product, data, and AI capabilities.

We are looking for a Senior Data Engineer to join Shuru and help design and build scalable, reliable, and high-performance data platforms for complex business environments.

Key Responsibilities
  • Design, build, and manage scalable multi-cloud data platforms.
  • Develop and optimize real-time and batch data pipelines using Kafka and Spark.
  • Build Lakehouse architectures using Apache Iceberg or Delta Lake.
  • Optimize BigQuery, data models, queries, and warehouse performance.
  • Design reliable and scalable distributed data processing systems.
  • Automate infrastructure and deployments using Terraform and Kubernetes.
  • Ensure high standards of data reliability, security, governance, and compliance.
  • Drive technical architecture and design reviews.
  • Mentor engineers and contribute to engineering best practices.




Requirements
  • 8+ years of experience in Data Engineering, Data Platforms, or Distributed Systems.
  • 3+ years of experience operating large-scale data platforms in production.
  • Strong hands-on experience with Kafka, Spark, GCP, BigQuery, and Airflow.
  • Experience with Terraform and Kubernetes.
  • Hands-on knowledge of Lakehouse technologies such as Iceberg or Delta Lake.
  • Strong understanding of data modeling, distributed systems, and data warehouse architecture.
  • Experience leading technical initiatives and mentoring engineers.
Nice to Have
  • Experience with Debezium, Redpanda, and dbt.
  • Experience with Prometheus and Grafana for monitoring and observability.
  • Exposure to fintech, financial services, or regulated environments.
  • Understanding of data governance, security, and compliance requirements.


Benefits
  • Work on challenging, large-scale engineering and data problems.
  • Build modern platforms using cutting-edge cloud and data technologies.
  • Work closely with experienced engineering, product, and technology leaders.
  • Opportunity to take ownership of architecture and key technical decisions.
  • Remote-first and collaborative work environment.
  • Strong opportunities for learning, leadership, and career growth.


Skills Required

  • 8+ years of experience in data engineering, data platforms, or distributed systems
  • 3+ years of experience operating large-scale data platforms in production
  • Strong hands-on experience with Kafka, Spark, GCP, BigQuery, and Airflow
  • Experience with Terraform and Kubernetes
  • Hands-on knowledge of lakehouse technologies such as Apache Iceberg or Delta Lake
  • Strong understanding of data modeling, distributed systems, and data warehouse architecture
  • Experience leading technical initiatives and mentoring engineers
  • Experience with Debezium, Redpanda, and dbt
  • Experience with Prometheus and Grafana for monitoring and observability
  • Exposure to fintech, financial services, or regulated environments
  • Understanding of data governance, security, and compliance requirements
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Gurugram, Haryana
50 Employees
Year Founded: 2021

What We Do

Looking for a self-managed professional team to help take your technology and product strategy to the next level? From leadership consulting to hands-on software delivery, we can support you in many ways. 1. Mobile, Web, Backend Software Development 2. Technology Infrastructure Solutions 3. Technology Scaling Solutions 4. Adopting Emerging Tech like Artificial Intelligence 5. Product & Technology Leadership Our custom software development services specialize in end-to-end product development. With a team of experienced professionals, we can help you navigate the complex world of technology and bring your vision to life. We offer on-demand product leadership and strategic guidance to help your business excel without the full-time commitment of a Chief Product Officer. Our team of experienced product experts works closely with you to understand your unique needs and craft tailored product strategies that align with your business objectives. We provide on-demand technical leadership and expertise to help your business scale and innovate without the full-time commitment of a Chief Technology Officer. As your tech leader, we focus on driving your technology strategy, optimizing your software architecture, and fostering a culture of innovation to propel your business forward. Let us be your go-to resource for all things product and technology. Contact us to learn more about how we can help your business succeed.

Similar Jobs

Remote
India
450 Employees

Opus Technologies Logo Opus Technologies

Data Engineer

Fintech • Financial Services
Remote
India
1000 Employees

hud Logo hud

Lead Research Engineer, Data Quality

Artificial Intelligence • Information Technology • Software
In-Office or Remote
18 Locations
10 Employees
120K-295K Annually

Photon Logo Photon

Lead Data Engineer

Agency • Information Technology
Remote
India
5017 Employees

Similar Companies Hiring

NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Austin, TX
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account