Senior Big Data Engineer

Our Purpose

Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.

Title and Summary

Senior Big Data Engineer

SpendingPulse is a data product that provides economic insights to our customers. We analyze billions of transactions across the globe to power our platform and create reports on historical consumer spending, predictions of future spending, and commentary on the current economic climate for our customers across financial, retail, and government sectors across the globe. We are looking for an innovative engineer who will design data pipelines on our in-house, 800+ node Hadoop cluster and expand our footprint to cloud infrastructure. We work closely with Data Science, Product Management, and Data Warehouse teams to create reliable, scalable, and flexible data pipelines. The team is located in Prague, the United States, and India. This position requires a strong foundation in programming and SQL. Experience with Spark is preferred, but not required. Every team member contributes to designing, building, and testing new features.
The SpendingPulse team is currently scaling the product globally, adding new countries, new sectors, and expanding with new features. As the product continues to grow, we must design our infrastructure and codebase to facilitate quality control and reliability for our customers. In addition to our ongoing efforts on-prem, we are currently exploring moving our pipelines to cloud technologies like Databricks.
The SpendingPulse team is part of Mastercard's Services organization. Services are a key differentiator for Mastercard, helping our clients make better decisions around the world.
Position Responsibilities
As a Senior Data Engineer on the data pipeline team, you will:
Build scalable and maintainable data pipelines to expand SpendingPulse with new features and deliver insights from economic trends.
Drive performance, reliability, and readability in our code base, allowing us to troubleshoot quickly and publish data consistently.
Test your code and review code from other team members.
Continuously innovate and determine new approaches, tools, techniques, and technologies to solve business problems.
Partner with roles across the organization including data scientists, product managers, and system administrators to determine the highest priority problems to solve.
Ideal Candidate Qualifications
Strong foundation in programming. Python is preferred, but experience in other high-level languages is ok.
Strong SQL, writing readable and well-tuned queries.
Familiarity with objected-oriented software design.
Familiarity Linux command line.
Experience with big data technologies like PySpark is a bonus.
Clear communicator; Strong written and verbal English skills
Motivation, creativity, self-direction, and desire to thrive on small project teams.
Ability to collaborate within the team across roles and communicate with teammates who have varying levels of technical understanding.
Strong technologist eager to learn new tools and frameworks.
Passion for analytical / quantitative problem solving.
Eager to experiment with new team processes and innovate on development approaches.

Corporate Security Responsibility

All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

• Abide by Mastercard’s security policies and practices;

• Ensure the confidentiality and integrity of the information being accessed;

• Report any suspected information security violation or breach, and

• Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.