Senior Data Engineer

Posted 8 Days Ago
O'Fallon, MO
Senior level
Payments
We are a global technology company in the payments industry.
The Role
As a Senior Data Engineer, you will develop and manage data pipelines, perform ETL processes using Apache Spark and Kafka, build big data technologies, and collaborate across teams for data analyses. You'll utilize tools like Hadoop, AWS, and SQL to enhance efficiency and performance in data handling.
Summary Generated by Built In

Our Purpose

We work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. We cultivate a culture of inclusion for all employees that respects their individual strengths, views, and experiences. We believe that our differences enable us to be a better team – one that makes better decisions, drives innovation and delivers better business results.

Title and Summary


Senior Data Engineer

Who is Mastercard?
Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential.
Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. With connections across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all.
Data Engineer
Overview
We are looking for an enthusiastic and adaptable Data Engineer to join our Data Engineering Team. You will be responsible for developing and managing Data Pipelines and assisting various data-driven requests across the company. The position involves a wide variety of technical skills, from developing high throughput Spark jobs to tuning performance of Big Data solutions. The ideal candidate will have experience working with large-scale data and building automated data ETL processes. Data warehousing experience would be ideal.
Key responsibilities include:
• Build and maintain big data technologies, environments, and applications, seeking opportunities for improvements and efficiencies
• Performing ETL (Extract, Transform, Load) processes based on business requirements using Apache Spark and data ingestion from Apache Kafka
• Work with various data platforms including Apache Hadoop, Apache Ozone, AWS S3, Delta Lake, Apache Iceberg
• Utilizing orchestration tools like Apache NiFi for managing and scheduling data flows efficiently
• Writes performant SQL statement to analyze data with Hive/Impala/Oracle
• Full application development lifecycle (SDLC) from design to deployment
• Working with multiple stakeholders across teams to fulfill ad-hoc investigations, including large-scale data extraction, transformation, and analyses
About You
• Excellent problem-solving skills with good understanding of data engineering concepts
• Proficient in Apache Spark with Python and related technologies
• Strong knowledge of SQL and performance tuning
• Experience in Big Data technologies like Hadoop and Oracle Exadata
• Solid knowledge of Linux environments and proficiency with bash scripting
• Effective verbal and written communication skills
Nice to have knowledge or prior experience with any of the following
• Apache Kafka, Apache Spark with Scala
• Orchestration with Apache Nifi, Apache Airflow
• Java development and microservices architecture
• Build tools like Jenkins
• Log analysis and monitoring using Splunk
• Databricks, AWS
• Working with large data sets with terabytes of data
Corporate Security Responsibility
Every person working for, or on behalf of, Mastercard is responsible for information security. All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and therefore, it is expected that the successful candidate for this position must:
• Abide by Mastercard’s security policies and practices;
• Ensure the confidentiality and integrity of the information being accessed;
• Report any suspected information security violation or breach, and
• Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.
NOTE: Candidates go through a thorough screening and interview process. There is no need to include all preferred skills in the job description.

Mastercard is an inclusive equal opportunity employer that considers applicants without regard to gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law. In the US or Canada, if you require accommodations or assistance to complete the online application process or during the recruitment process, please contact [email protected] and identify the type of accommodation or assistance you are requesting. Do not include any medical or health information in this email. The Reasonable Accommodations team will respond to your email promptly.

Corporate Security Responsibility


All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

  • Abide by Mastercard’s security policies and practices;

  • Ensure the confidentiality and integrity of the information being accessed;

  • Report any suspected information security violation or breach, and

  • Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.

In line with Mastercard’s total compensation philosophy and assuming that the job will be performed in the US, the successful candidate will be offered a competitive base salary based on location, experience and other qualifications for the role and may be eligible for an annual bonus or commissions depending on the role. Mastercard benefits for full time (and certain part time) employees generally include: insurance (including medical, prescription drug, dental, vision, disability, life insurance), flexible spending account and health savings account, paid leaves (including 16 weeks new parent leave, up to 20 paid days bereavement leave), 10 annual paid sick days, 10 or more annual paid vacation days based on level, 5 personal days, 10 annual paid U.S. observed holidays, 401k with a best-in-class company match, deferred compensation for eligible roles, fitness reimbursement or on-site fitness facilities, eligibility for tuition reimbursement, gender-inclusive benefits and many more.







Top Skills

Java
Python
SQL
The Company
HQ: Purchase, NY
0 Employees
Hybrid Workplace
Year Founded: 1966

What We Do

Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re building a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.

Why Work With Us

We live the Mastercard Way: creating value in the communities we touch, growing together through the opportunities we see, and moving fast to innovate and scale. Our collaborative culture and our passionate people are the key to what we do, driving meaningful change as one team and connecting everyone to priceless possibilities.

Gallery

Gallery

Similar Jobs

PwC Logo PwC

Managed Services - Informatica Data Engineer - Senior Associate

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
St Louis, MO, USA
364000 Employees
58K-161K Annually

PwC Logo PwC

Managed Services - Informatica Data Engineer - Senior Associate

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
Kansas City, MO, USA
364000 Employees
58K-161K Annually

PwC Logo PwC

Google Cloud Data Engineer [No-Code/Low-Code]-Senior Manager

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
Kansas City, MO, USA
364000 Employees
130K-256K Annually

PwC Logo PwC

Google Cloud Data Engineer [No-Code/Low-Code]-Senior Manager

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
St Louis, MO, USA
364000 Employees
130K-256K Annually

Similar Companies Hiring

Block Thumbnail
Software • Payments • Fintech • Financial Services • eCommerce • Cryptocurrency • Blockchain
Oakland, CA
12000 Employees
Gynger Thumbnail
Software • Payments • Fintech • Financial Services • Automation • Artificial Intelligence
New York, NY
32 Employees
Tarro Thumbnail
Software • Payments • Information Technology • Hospitality • Food
Long Island City, NY
1300 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account