Lead Data Engineer

Reposted 18 Days Ago
Be an Early Applicant
2 Locations
In-Office
Senior level
eCommerce • Other • Retail
The Role
Lead the design and development of scalable data solutions, optimizing data architecture and pipelines while collaborating with teams to support enterprise-level data initiatives.
Summary Generated by Built In

About us:

As a Fortune 50 company with more than 400,000 team members worldwide, Target is an iconic brand and one of America's leading retailers.

Joining Target means promoting a culture of mutual care and respect and striving to make the most meaningful and positive impact. Becoming a Target team member means joining a community that values different voices and lifts each other up. Here, we believe your unique perspective is important, and you'll build relationships by being authentic and respectful.

Overview about TII:
At Target, we have a timeless purpose and a proven strategy. And that hasn’t happened by accident. Some of the best minds from different backgrounds come together at Target to redefine retail in an inclusive learning environment that values people and delivers world-class outcomes. That winning formula is especially apparent in Bengaluru, where Target in India operates as a fully integrated part of Target’s global team and has more than 4,000 team members supporting the company’s global strategy and operations.

Team Overview:

Every time a guest enters a Target store or browses Target.com nor the app, they experience the impact of Target’s investments in technology and innovation. We’re the technologists behind one of the most loved retail brands, delivering joy to millions of our guests, team members, and communities.

Join our global in-house technology team of more than 5,000 of engineers, data scientists, architects and product managers striving to make Target the most convenient, safe and joyful place to shop. We use agile practices and leverage open-source software to adapt and build best-in-class technology for our team members and guests—and we do so with a focus on diversity and inclusion, experimentation and continuous learning.

Position Overview:

As a Lead Data Engineer, you will serve as the technical anchor for the engineering team, responsible for designing and developing scalable, high-performance data solutions. You will own and drive data architecture that supports both functional and non-functional business needs, ensuring reliability, efficiency, and scalability.
Your expertise in big data technologies, distributed systems, and cloud platforms will help shape the engineering roadmap and best practices for data processing, analytics, and real-time data serving. You will play a key role in architecting and optimizing data pipelines using Hadoop, Spark, Scala/Java, and cloud technologies to support enterprise-wide data initiatives.
Additionally, experience with API development for serving low-latency data and Customer Data Platforms (CDP) will be a strong plus.

Key Responsibilities:

  • Architect and build scalable, high-performance data pipelines and distributed data processing solutions using Hadoop, Spark, Scala/Java, and cloud platforms (AWS/GCP/Azure).

  • Design and implement real-time and batch data processing solutions, ensuring data is efficiently processed and made available for analytical and operational use.

  • Develop APIs and data services to expose low-latency, high-throughput data for downstream applications, enabling real-time decision-making.

  • Optimize and enhance data models, workflows, and processing frameworks to improve performance, scalability, and cost-efficiency.

  • Drive data governance, security, and compliance best practices.

  • Collaborate with data scientists, product teams, and business stakeholders to understand requirements and deliver data-driven solutions.

  • Lead the design, implementation, and lifecycle management of data services and solutions.

  • Stay up to date with emerging technologies and drive adoption of best practices in big data engineering, cloud computing, and API development.

  • Provide technical leadership and mentorship to engineering teams, promoting best practices in data engineering and API design.

About You:

  • 7+ years of experience in data engineering, software development, or distributed systems.

  • Expertise in big data technologies such as Hadoop, Spark, and distributed processing frameworks.

  • Strong programming skills in Scala and/or Java (Python is a plus).

  • Experience with cloud platforms (AWS, GCP, or Azure) and their data ecosystem (e.g., S3, BigQuery, Databricks, EMR, Snowflake, etc.).

  • Proficiency in API development using REST, GraphQL, or gRPC to serve real-time and batch data.

  • Experience with real-time and streaming data architectures (Kafka, Flink, Kinesis, etc.).

  • Strong knowledge of data modeling, ETL pipeline design, and performance optimization.

  • Understanding of data governance, security, and compliance in large-scale data environments.

  • Experience with Customer Data Platforms (CDP) or customer-centric data processing is a strong plus.

  • Strong problem-solving skills and ability to work in complex, unstructured environments.

  • Excellent communication and collaboration skills, with experience working in cross-functional teams.

Why Join Us?

  • Work with cutting-edge big data, API, and cloud technologies in a fast-paced, collaborative environment.

  • Influence and shape the future of data architecture and real-time data services at Target.

  • Solve high-impact business problems using scalable, low-latency data solutions.

  • Be part of a culture that values innovation, learning, and growth.

Life at Target- https://india.target.com/

Benefits- https://india.target.com/life-at-target/workplace/benefits

Culture- https://india.target.com/life-at-target/belonging

Top Skills

AWS
Azure
Databricks
Emr
Flink
GCP
GraphQL
Grpc
Hadoop
Java
Kafka
Kinesis
Rest
Scala
Snowflake
Spark
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Minneapolis, MN
172,344 Employees

What We Do

Target is an American retailing company providing access to a wide selection of products such as furniture, electronics, toys, and more.

Target is one of the world’s most recognized brands and one of America’s leading retailers. We make Target our guests’ preferred shopping destination by offering outstanding value, inspiration, innovation and an exceptional guest experience that no other retailer can deliver. Target is committed to responsible corporate citizenship, ethical business practices, environmental stewardship and generous community support. Since 1946, we have given 5 percent of our profits back to our communities. Our goal is to work as one team to fulfill our unique brand promise to our guests, wherever and whenever they choose to shop.

Similar Jobs

Hybrid
Bengaluru, Karnataka, IND
289097 Employees
Remote or Hybrid
Bangalore, Bengaluru Urban, Karnataka, IND
1100 Employees

A.P. Moller - Maersk Logo A.P. Moller - Maersk

Lead Data Engineer

Logistics • Transportation
In-Office
Bangalore, Bengaluru Urban, Karnataka, IND
58338 Employees

Rearc Logo Rearc

Lead Data Engineer

Information Technology • Consulting
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
51 Employees

Similar Companies Hiring

ClickMint Thumbnail
Marketing Tech • Generative AI • eCommerce • AdTech
Malibu, CA
9 Employees
PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account