Sr Data Engineer

Reposted 3 Days Ago
Be an Early Applicant
Pune, Maharashtra, IND
Hybrid
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
We are a global technology company in the payments industry.
The Role
Join the AI Innovation at Scale team to design and execute test strategies, perform white-box and black-box testing, validate data using Impala and Spark, monitor Spark job execution, collect logs, analyze quality data, and work with stakeholders to resolve issues and improve QA processes.
Summary Generated by Built In
Our Purpose
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title and Summary
Sr Data Engineer
Overview
The AI Innovation at Scale team is seeking a highly motivated and detail-oriented Quality Assurance Engineer to join our team. This role is critical in ensuring the delivery of high-quality products by assessing requirements, identifying issues, and implementing effective testing strategies. The ideal candidate is curious, detail-oriented, technically skilled, and thrives in a collaborative environment. You will play a key role in improving quality management and continuous improvement.
Role
As a Senior AI Engineer, you will:• Be an integral part of a creative and innovative team, contributing to collaborative projects and sharing insights to drive engineering and data science excellence• Work with cutting-edge big data platforms (e.g., Databricks, Apache Spark) at petabyte scale, pushing the boundaries of data processing and model enablement• Partner closely with Data Science teams to enable seamless R&D, scale models, features, and experimentations into reliable systems• Support the deployment of model features and model artifacts, ensuring seamless integration into production environments and downstream decisioning systems• Write clean, testable, and maintainable code, ensuring solutions are robust, efficient, and production-grade• Design, build, and maintain data pipelines that integrate multiple data sources to support a unified merchant registry and trust profile, enabling richer datasets and unlocking new opportunities for innovation• Collaborate with data operations and governance teams to move and manage data in compliance with security standards, policies, and regulatory requirements• Contribute to the design and evolution of scalable, entity-centric data models that support merchant identity resolution and longitudinal profiling• Automate and maintain data workflows in distributed environments, improving reliability and operational efficiency• Analyze and optimize ETL/ELT processes to support high-performance data access and model execution• Implement testing frameworks and monitoring capabilities to ensure production solutions are reliable, observable, and continuously improving• Support incident response, debugging, and performance tuning of production AI/ML systems
About You
Essential Skills to be successful:• Proven track record of self-directed learning, demonstrating the ability to acquire new skills and knowledge independently• Strong independent research skills and resourcefulness, enabling you to find solutions and innovate in data engineering• Strong understanding of data pipelines and end-to-end ML model development workflows, with exposure to entity-centric data systems• Experience with Python and SQL, showcasing the ability to write clean, readable, and maintainable code• Experience with big data technologies (e.g., Spark, distributed compute frameworks)• Hands-on experience with cloud platforms such as Databricks, AWS, or GCP• Critical thinking and a drive to produce high-quality work, ensuring all solutions meet rigorous standards• Strong communication skills, enabling effective collaboration with team members and stakeholders• Experience collaborating across data science, engineering, and governance teams• Ability and interest in problem-solving, with a proactive approach to tackling challenges• Openness to learn and apply new technologies, staying current with industry trends and advancements• Familiarity with Agile methodologies, with the ability to drive iterative delivery and cross-team collaboration• Bachelor's degree in Computer Science, Data Analytics, Mathematics, Software Engineering, or a related field or equivalent practical experience• Contributions to platform standardization, reusability, and shared tooling across teams
Nice to Have• Experience working in hybrid environments (cloud and on-premises)• Familiarity with ML lifecycle and CI/CD practices for data and ML workflows• Experience with data governance, lineage, and metadata management• Exposure to batch, streaming, or real-time data pipelines and production ML monitoring/observability• Experience supporting high-scale production systems in merchant, fraud, or payment domains• Understanding of security, compliance, and handling sensitive data• Experience designing scalable databases and data models such as business registries• Experience with database updates and maintenance
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
  • Abide by Mastercard's security policies and practices;
  • Ensure the confidentiality and integrity of the information being accessed;
  • Report any suspected information security violation or breach, and
  • Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.

Skills Required

  • Curious, meticulous and eager to learn new technologies and methodologies
  • Strong technical skills relevant to QA work
  • Critical and creative thinking in problem-solving
  • Excellent time management and organizational skills
  • Communicate effectively with stakeholders
  • Experience in software development and software QA
  • Proficiency in QA methodologies, processes, and tools
  • Ability to write clear, concise, and comprehensive test plans and cases
  • Familiarity with appropriate testing tools and frameworks
  • Familiarity with Hadoop, CDP, PCF, and Databricks
  • Basic knowledge of data science and Generative AI concepts
  • Proficient with Unix/Linux commands
  • Working knowledge of Python and Java applications
  • Use Impala and Spark for data queries and validation
  • Monitor Spark job execution, perform initial analysis, and collect logs

What the Team is Saying

Jenny
Mastercard

Mastercard Compensation & Benefits Highlights

  • Retirement Support Careers materials and job postings advertise a “best‑in‑class” 10% retirement match (401k or equivalent). Public-facing benefits pages consistently position this as a standout element of the U.S. package.
  • Leave & Time Off Breadth Recent U.S. postings list 25 vacation days, 5 personal days, 10 paid holidays, up to 20 days of bereavement, and 80 hours of sick/safe time. The combined time‑off framework is described as well above typical U.S. baselines.
  • Parental & Family Support Company materials specify a minimum of 16 weeks paid new‑parent leave and inclusive family‑building support, with financial assistance for adoption, fertility, and surrogacy where allowed. Impact/ESG reporting also notes coverage enhancements for gender‑affirming care in North America.

Mastercard Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Purchase, NY
38,800 Employees
Year Founded: 1966

What We Do

Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re building a resilient economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.

Why Work With Us

We live the Mastercard Way: creating value in the communities we touch, growing together through the opportunities we see, and moving fast to innovate and scale. Our collaborative culture and our passionate people are the key to what we do, driving meaningful change as one team and connecting everyone to priceless possibilities.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Mastercard Teams

Team
Technology
Team
Cybersecurity and Threat Intelligence
Team
Consulting
Team
AI and Data
About our Teams

Mastercard Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

In our ongoing workplace evolution, we’ve introduced hybrid work, Work-From-Elsewhere Weeks and Meeting-Free Days.

Typical time on-site: 3 days a week
Company Office Image
HQPurchase, NY
Arlington, VA
Company Office Image
Atlanta, GA
Bogotá, CO
Boston, MA
Chicago, IL
Company Office Image
Dublin, Dublin
Gurugram, Gurugram
Company Office Image
London, GB
Company Office Image
Miami, FL
Mumbai, Maharashtra
Company Office Image
New York, NY
Company Office Image
O'Fallon, MO
Company Office Image
Pune, Maharashtra
Ramat Gan, IL
Company Office Image
Saint Leonards, St Leonards
San Francisco, CA
São Paulo, SP
Seattle, WA
Singapore, SG
Company Office Image
Toronto, Ontario
Vancouver, BC
Learn more

Similar Jobs

Mastercard Logo Mastercard

Senior Data Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Pune, Maharashtra, IND
38800 Employees

Mastercard Logo Mastercard

Senior Data Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Navi Mumbai, Thane, Maharashtra, IND
38800 Employees

Mastercard Logo Mastercard

Senior Data Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Pune, Maharashtra, IND
38800 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account