Lead Data Engineer

Posted 3 Days Ago
Be an Early Applicant
O'Fallon, MO, USA
Hybrid
140K-231K Annually
Expert/Leader
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
We are a global technology company in the payments industry.
The Role
Leads the architecture, development, modernization, and operation of enterprise data platforms and pipelines supporting credit risk, analytics, regulatory reporting, and AI initiatives. Builds scalable cloud lakehouse solutions using Databricks, Spark, Delta Lake, Python, and SQL; establishes governance, quality, lineage, observability, and compliance controls; optimizes performance and costs; leads technical initiatives; influences architecture; mentors engineers; and partners with product, analytics, science, engineering, and business stakeholders.
Summary Generated by Built In
Our Purpose
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title and Summary
Lead Data Engineer
Overview:
Mastercard's Enterprise Credit Risk (ECR) team is seeking a Lead Data Engineer to design and scale the next generation of data platforms that power credit decisioning, portfolio risk management, regulatory reporting, analytics, and AI-driven insights across Mastercard's lending and risk ecosystems.
In this role, you will combine deep hands-on data engineering expertise with technical leadership to build reliable, scalable, governed, and high-quality data products. You will lead the architecture and implementation of modern data engineering solutions across cloud platforms, large-scale data processing, data governance, and operational excellence.
You will partner closely with Product Management, Risk Analytics, Data Science, Architecture, Engineering, and Business stakeholders to transform complex business needs into scalable technical solutions, simplify access to trusted data, and accelerate innovation across the ECR portfolio.
This is a hybrid role based in O'Fallon, MO, requiring three days per week onsite.
Role:• Lead the design, development, and evolution of enterprise-grade data platforms and pipelines supporting credit risk products, decisioning capabilities, analytics, and regulatory reporting.• Architect and implement scalable ETL/ELT frameworks using Databricks, Apache Spark, Delta Lake, and cloud-native technologies to support high-volume data workloads.• Drive data platform modernization and cloud transformation, including the migration of legacy data assets to modern cloud-based and Data Lakehouse architectures.• Establish and advance data quality, lineage, metadata, governance, observability, and monitoring capabilities to deliver trusted, compliant, and reliable data products.• Partner across Risk, Product, Data Science, Architecture, Engineering, and Business teams to translate complex requirements into scalable, sustainable technical solutions.• Define and promote engineering standards and best practices across coding, testing, data quality, deployment automation, documentation, and operational excellence.• Lead technical design reviews and influence architectural decisions for data-intensive applications, platforms, and services.• Optimize large-scale data workloads and platforms for performance, reliability, scalability, resiliency, and cost efficiency.• Build reusable, governed data products and capabilities that enable AI, machine learning, advanced analytics, and emerging risk use cases.• Drive technical initiatives from strategy through execution, identifying dependencies, managing technical risks, and ensuring solutions align with business priorities and long-term platform strategy.• Mentor and coach engineers across the organization, providing technical guidance, design expertise, knowledge sharing, and feedback to strengthen engineering capabilities.• Shape technology roadmaps and delivery priorities across the ECR portfolio, balancing business value, engineering feasibility, risk, compliance, and long-term platform sustainability.• Ensure engineering solutions meet security, privacy, regulatory, compliance, and audit requirements through appropriate controls, documentation, and engineering practices.• Create clarity in complex and ambiguous environments, communicate technical trade-offs to senior stakeholders, and foster a culture of ownership, accountability, and continuous improvement.
All About You:• Deep expertise in designing and implementing large-scale data engineering solutions and distributed data processing systems.• Advanced proficiency with Databricks, Apache Spark/PySpark, Delta Lake, SQL, and Python.• Experience building and operating cloud-based data platforms using Azure, AWS, or GCP.• Strong experience developing enterprise-grade ETL/ELT pipelines, data integration frameworks, and streaming architectures.• Strong understanding of data modeling and data architecture for analytical and operational workloads.• Experience implementing data quality, lineage, metadata management, observability, and data governance frameworks in enterprise environments.• Experience working with modern data formats and storage technologies, including Parquet, Avro, and ORC.• Working knowledge of CI/CD, infrastructure-as-code, automated testing, Git/GitHub, and DevOps practices for data engineering environments.• Experience with workflow orchestration tools, such as Apache Airflow.• Strong understanding of security, privacy, regulatory, and compliance requirements associated with sensitive financial and customer data.• Proven ability to lead complex technical initiatives across multiple teams and influence engineering direction without direct authority.• Demonstrated ability to mentor engineers and elevate technical capability, including providing design guidance, knowledge sharing, and constructive feedback.• Excellent communication and stakeholder management skills, with the ability to clearly articulate technical concepts, trade-offs, risks, dependencies, and recommendations to both technical and business audiences.• Experience with Java-based application development is a strong plus, particularly in environments where data platforms integrate with enterprise applications and services.
Preferred Qualifications:• Bachelor's degree in Computer Science, Engineering, Information Systems, or a related STEM discipline. Equivalent practical experience will also be considered.• Preferred experience with:
o Databricks
o Apache Spark / PySpark
o Hadoop
o Delta Lake
o SQL and Python
o Apache Airflow
o Azure Data Services
o Kafka / event streaming
o GitHub and CI/CD tooling
o Cloud-based Data Lakehouse architectures
Mastercard is a merit-based, inclusive, equal opportunity employer that considers applicants without regard to gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law. We hire the most qualified candidate for the role. In the US or Canada, if you require accommodations or assistance to complete the online application process or during the recruitment process, please contact [email protected] and identify the type of accommodation or assistance you are requesting. Do not include any medical or health information in this email. The Reasonable Accommodations team will respond to your email promptly.
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
  • Abide by Mastercard's security policies and practices;
  • Ensure the confidentiality and integrity of the information being accessed;
  • Report any suspected information security violation or breach, and
  • Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.

In line with Mastercard's total compensation philosophy and assuming that the job will be performed in the US, the successful candidate will be offered a competitive base salary and may be eligible for an annual bonus or commissions depending on the role. The base salary offered may vary depending on multiple factors, including but not limited to location, job-related knowledge, skills, and experience. Mastercard benefits for full time (and certain part time) employees generally include: insurance (including medical, prescription drug, dental, vision, disability, life insurance); flexible spending account and health savings account; paid leaves (including 16 weeks of new parent leave and up to 20 days of bereavement leave); 80 hours of Paid Sick and Safe Time, 25 days of vacation time and 5 personal days, pro-rated based on date of hire; 10 annual paid U.S. observed holidays; 401k with a best-in-class company match; deferred compensation for eligible roles; fitness reimbursement or on-site fitness facilities; eligibility for tuition reimbursement; and many more. Mastercard benefits for interns generally include: 56 hours of Paid Sick and Safe Time; jury duty leave; and on-site fitness facilities in some locations.
Pay Ranges
O'Fallon, Missouri: $140,000 - $231,000 USD

Skills Required

  • Deep expertise designing and implementing large-scale data engineering solutions and distributed data processing systems
  • Advanced proficiency with Databricks, Apache Spark or PySpark, Delta Lake, SQL, and Python
  • Experience building and operating cloud-based data platforms using Azure, AWS, or GCP
  • Strong experience developing enterprise-grade ETL or ELT pipelines, data integration frameworks, and streaming architectures
  • Strong understanding of data modeling and data architecture for analytical and operational workloads
  • Experience implementing data quality, lineage, metadata management, observability, and data governance frameworks
  • Experience with Parquet, Avro, and ORC data formats and storage technologies
  • Working knowledge of CI/CD, infrastructure as code, automated testing, Git or GitHub, and DevOps practices
  • Experience with workflow orchestration tools such as Apache Airflow
  • Understanding of security, privacy, regulatory, and compliance requirements for sensitive financial and customer data
  • Ability to lead complex technical initiatives across multiple teams and influence engineering direction without direct authority
  • Ability to mentor engineers and provide design guidance, knowledge sharing, and constructive feedback
  • Excellent communication and stakeholder management skills
  • Bachelor's degree in Computer Science, Engineering, Information Systems, or a related STEM discipline, or equivalent practical experience
  • Experience with Java-based application development
  • Experience with Hadoop, Azure Data Services, Kafka or event streaming, GitHub, CI/CD tooling, and cloud-based data lakehouse architectures

What the Team is Saying

Jenny
Mastercard

Mastercard Compensation & Benefits Highlights

  • Retirement Support Retirement plans are presented as best-in-class with a high company match on 401(k) or local equivalents. Career materials and U.S. postings consistently highlight retirement matching as a standout feature.
  • Leave & Time Off Breadth U.S. postings describe generous paid time off including vacation, personal days, holidays, sick/safe time, and additional bereavement leave. A hybrid policy and a limited “work from elsewhere” option further support time away.
  • Parental & Family Support Company pages state a global minimum of 16 weeks of paid new-parent leave across birth, adoption, and foster, plus family-building assistance where permitted. Mental-health resources and caregiving supports are also emphasized.

Mastercard Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Purchase, NY
38,800 Employees
Year Founded: 1966

What We Do

Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re building a resilient economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.

Why Work With Us

We live the Mastercard Way: creating value in the communities we touch, growing together through the opportunities we see, and moving fast to innovate and scale. Our collaborative culture and our passionate people are the key to what we do, driving meaningful change as one team and connecting everyone to priceless possibilities.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Mastercard Teams

Team
Technology
Team
Cybersecurity and Threat Intelligence
Team
Consulting
Team
AI and Data
About our Teams

Mastercard Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

In our ongoing workplace evolution, we’ve introduced hybrid work, Work-From-Elsewhere Weeks and Meeting-Free Days.

Typical time on-site: 3 days a week
Company Office Image
HQPurchase, NY
Arlington, VA
Company Office Image
Atlanta, GA
Bogotá, CO
Boston, MA
Chicago, IL
Company Office Image
Dublin, Dublin
Gurugram, Gurugram
Company Office Image
London, GB
Company Office Image
Miami, FL
Mumbai, Maharashtra
Company Office Image
New York, NY
Company Office Image
O'Fallon, MO
Company Office Image
Pune, Maharashtra
Ramat Gan, IL
Company Office Image
Saint Leonards, St Leonards
San Francisco, CA
São Paulo, SP
Seattle, WA
Singapore, SG
Company Office Image
Toronto, Ontario
Vancouver, BC
Learn more

Similar Jobs

Mastercard Logo Mastercard

Data Scientist

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
O'Fallon, MO, USA
38800 Employees
27-34 Hourly

Mastercard Logo Mastercard

Principal, Product Management GBSC AI Delivery

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
O'Fallon, MO, USA
38800 Employees
156K-265K Annually

Mastercard Logo Mastercard

Software Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
O'Fallon, MO, USA
38800 Employees
115K-184K Annually

Mastercard Logo Mastercard

Product Management - Technical Intern, Summer 2027 - St. Louis, MO, US

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
O'Fallon, MO, USA
38800 Employees
25-30 Hourly

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account