Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)

Posted 5 Hours Ago
Be an Early Applicant
55445, Minneapolis, MN, USA
In-Office
132K-238K Annually
Senior level
eCommerce • Other • Retail
The Role
Technical lead for Finance Technology data engineering: design and build scalable batch and real-time data pipelines (Hadoop/Spark/PySpark/Scala/Java), optimize data models and APIs, drive cloud-based data architecture (AWS/GCP/Azure), enforce governance/security, and mentor engineers to deliver enterprise financial data services.
Summary Generated by Built In
The pay range is $132,000.00 - $238,000.00

Pay is based on several factors which vary based on position. These include labor markets and in some instances may include education, work experience and certifications. In addition to your pay, Target cares about and invests in you as a team member, so that you can take care of yourself and your family. Target offers eligible team members and their dependents comprehensive health benefits and programs, which may include medical, vision, dental, life insurance and more, to help you and your family take care of your whole selves. Other benefits for eligible team members include 401(k), employee discount, short term disability, long term disability, paid sick leave, paid national holidays, and paid vacation. Find competitive benefits from financial and education to well-being and beyond at https://corporate.target.com/careers/benefits.

JOIN TARGET AS A LEAD DATA ENGINEER – FINANCE TECHNOLOGY SOLUTIONS

About Us:

Working at Target means helping all families discover the joy of everyday life. We bring that vision to life through our values and culture. Learn more about Target here. 

About the Team:
Finance Technology within Core Retail Services powers the financial backbone of Target's enterprise operations. We build and support platforms that enable critical business capabilities across Accounts Payable, Accounts Receivable, Vendor Income, Treasury, Financial Planning, Core Accounting, Revenue & Receivables, and Enterprise Financial Controls. Our financial reporting platform brings these data domains together to deliver near real-time insights, enabling accurate financial reporting and faster, data-driven decision-making. Join our global in-house technology team of more than 5,000 engineers, data scientists, architects, and product managers who are striving to make Target the most convenient, safe, and joyful place to shop. We use agile practices and leverage open-source technologies to build best-in-class solutions for our team members and guests.

About the Role:
As a Lead Data Engineer, you will serve as the technical lead for the engineering team, designing and developing scalable, high-performance data solutions. You will drive the evolution of our data architecture, ensuring it meets both functional and non-functional business requirements while delivering reliability, efficiency, and scalability. Your expertise in big data technologies, distributed systems, and cloud platforms will help shape the engineering roadmap and establish best practices for data processing, analytics, and real-time data services. You will play a key role in architecting and optimizing data pipelines using Hadoop, Spark, Scala/Java, and cloud technologies to support enterprise-wide data initiatives.

Key Responsibilities

  • Architect and build scalable, high-performance data pipelines and distributed data processing solutions using Spark, Scala/Java and cloud platforms (AWS, GCP, or Azure)
  • Design and implement real-time and batch data processing solutions, ensuring data is efficiently processed and readily available for analytical and operational use
  • Develop APIs and data services that provide low-latency, high-throughput access to data for downstream applications, enabling real-time decision-making
  • Optimize and enhance data models, workflows, and processing frameworks to improve performance, scalability, and cost efficiency
  • Drive data governance, security, and compliance best practices
  • Collaborate with product teams and business stakeholders to understand requirements and deliver data-driven solutions
  • Lead the design, implementation, and lifecycle management of data services and platforms
  • Stay current with emerging technologies and promote the adoption of best practices in big data engineering, cloud computing, and API development
  • Provide technical leadership and mentor engineers to foster engineering excellence and best practices

Core responsibilities of this job are articulated within this job description. Job duties may change at any time due to business needs. 

About You

  • BS or MS in Computer Science, Machine Learning, Artificial Intelligence, Applied Mathematics or a related technical field preferred
  • 7plus years of experience in data engineering, software development, or distributed systems
  • Expertise in Big Data technologies such as Hadoop, Spark, and distributed processing frameworks
  • Strong programming skills in PySpark, Scala, and/or Java
  • Experience with cloud platforms (AWS, GCP, or Azure) and associated data services (e.g. S3, BigQuery, Databricks, EMR, Snowflake)
  • Proficiency in API development using REST, GraphQL, or gRPC to support real-time and batch data access
  • Experience with real-time and streaming data architectures like Kafka, Flink or Kinesis
  • Strong knowledge of data modeling, ETL pipeline design and performance optimization
  • Understanding of data governance, security, and compliance in large-scale data environments
  • Strong problem-solving skills and the ability to thrive in complex, evolving environments
  • Excellent communication and collaboration skills, with experience working across cross-functional teams

This position will operate as a Hybrid/Flex for Your Day work arrangement based on Target’s needs. A Hybrid/Flex for Your Day work arrangement means the team member’s core role will need to be performed both onsite at the Target HQ MN location the role is assigned to and virtually, depending upon what your role, team and tasks require for that day. Work duties cannot be performed outside of the country of the primary work location, unless otherwise prescribed by Target. Click here if you are curious to learn more about Minnesota.

Benefits Eligibility

Please paste this url into your preferred browser to learn about benefits eligibility for this role: https://tgt.biz/BenefitsForYou_E

Americans with Disabilities Act (ADA)

In compliance with state and federal laws, Target will make reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please reach out to [email protected]. Non-accommodation-related requests, such as application follow-ups or technical issues, will not be addressed through this channel.  

Application deadline is : 08/20/2026

Skills Required

  • 7+ years of experience in data engineering, software development, or distributed systems
  • Expertise in Big Data technologies such as Hadoop and Spark
  • Strong programming skills in PySpark, Scala, and/or Java
  • Experience with cloud platforms (AWS, GCP, or Azure) and associated data services (S3, BigQuery, Databricks, EMR, Snowflake)
  • Proficiency in API development using REST, GraphQL, or gRPC
  • Experience with real-time and streaming architectures like Kafka, Flink, or Kinesis
  • Strong knowledge of data modeling, ETL pipeline design, and performance optimization
  • Understanding of data governance, security, and compliance in large-scale data environments
  • BS or MS in Computer Science, Machine Learning, AI, Applied Mathematics or related technical field
  • Excellent communication and collaboration skills; ability to mentor and provide technical leadership

Target Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Target and has not been reviewed or approved by Target.

  • Healthcare Strength Health benefits are accessible to hourly team members at relatively low hour thresholds and include no‑cost, 24/7 virtual medical care and expanded mental‑health support. This breadth is positioned as a relative strength compared to typical retail offerings.
  • Retirement Support Retirement programs include a dollar‑for‑dollar 401(k) match with immediate vesting and options like Roth 401(k) and stock purchase. These features strengthen long‑term savings for a wide range of roles.
  • Parental & Family Support Family support includes paid family leave, backup care, and reimbursements for adoption and surrogacy. These resources complement paid time off and holidays for eligible team members.

Target Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Minneapolis, MN
172,344 Employees

What We Do

Target is an American retailing company providing access to a wide selection of products such as furniture, electronics, toys, and more. Target is one of the world’s most recognized brands and one of America’s leading retailers. We make Target our guests’ preferred shopping destination by offering outstanding value, inspiration, innovation and an exceptional guest experience that no other retailer can deliver. Target is committed to responsible corporate citizenship, ethical business practices, environmental stewardship and generous community support. Since 1946, we have given 5 percent of our profits back to our communities. Our goal is to work as one team to fulfill our unique brand promise to our guests, wherever and whenever they choose to shop.

Similar Jobs

Adyen Logo Adyen

Senior Account Executive

Fintech • Payments • Financial Services
Easy Apply
Remote or Hybrid
3 Locations
4771 Employees
330K-480K Annually

Wipfli Logo Wipfli

Audit Manager, Real Estate

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
3000 Employees
110K-166K Annually

Wipfli Logo Wipfli

Senior Auditor - Tribal Industry

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
3000 Employees
73K-98K Annually

Wipfli Logo Wipfli

Senior Consultant

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
3000 Employees
88K-118K Annually

Similar Companies Hiring

PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Scotch Thumbnail
Artificial Intelligence • eCommerce • Fintech • Payments • Retail • Software • Analytics
US
35 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account