Staff Data Platform Engineer - GCP

Reposted 3 Days Ago
Wacker, IL, USA
In-Office
132K-220K Annually
Mid level
Financial Services
The Role
As a Data Platform Engineer, you will build and maintain self-service platforms for data processing and analytics using cloud technologies and automation tools.
Summary Generated by Built In

The Data Platform Engineering team is a collection of highly skilled individuals dedicated to building and scaling the infrastructure that powers our organization's data-driven initiatives. We are building a cutting-edge platform on Google Cloud to handle petabyte-scale data processing, real-time analytics, and machine learning workloads. We champion a DevSecOps culture, and our core principles are centered around automation, quality, and Infrastructure as Code (IaC) to raise the bar on how we manage and deploy data infrastructure.

About the Role:

As a Data Platform Engineer, you will be responsible for building and maintaining the self-service platforms and frameworks used by our Data Scientists and Engineers. Your work will directly accelerate the development and deployment of batch and streaming data pipelines built with Spark and Flink, and enable seamless, governed access to data in BigQuery. You will be a key contributor to our automation strategy, utilizing tools like Terraform for infrastructure provisioning and Argo Workflows for orchestrating complex data jobs on Google Kubernetes Engine (GKE).If you are passionate about building robust infrastructure for large-scale data processing, cloud-native data architectures, and empowering data practitioners, this job is for you!

Principal Accountabilities:

  • Design, build, and operate the core infrastructure for our data platform on Google Cloud.

  • Develop self-service tools and automation to improve the productivity of Data Engineering and Data Science teams.

  • Partner with application teams to ensure data services are well-architected, secure, and optimized for performance and cost.

  • Serve as a Subject Matter Expert (SME) for core platform components, including our Kubernetes environment (GKE), data processing engines (Spark, Flink), and data warehousing (BigQuery).

  • Mentor junior team members and lead technical initiatives to define the future of our data infrastructure toolset.

Core Skills and Qualifications:

1. Cloud Architecture & Orchestration

  • GCP Mastery: Expert-level experience architecting and operating resilient infrastructure on Google Cloud Platform (GCP), specifically leveraging GKE, BigQuery, and Cloud Storage.

  • Kubernetes as a Platform: Deep hands-on expertise with Google Kubernetes Engine (GKE), including designing for multi-tenancy, custom resource definitions (CRDs), and automated scaling for high-throughput data workloads.

  • Infrastructure as Code (IaC): Advanced proficiency with Terraform is required

2. Data Engineering at Scale

  • Distributed Processing: Proven track record of tuning and scaling Apache Spark and Apache Flink within containerized environments. 

  • Modern Data Stack: Strong hands-on experience with Google BigQuery, focusing on performance tuning, partitioning strategies, and governing secure access for hundreds of users.

  • Workflow Orchestration: Expert proficiency in Argo Workflows and/or Airflow to automate complex, dependent data lifecycles.

3. Software Engineering & Security

  • Advanced Programming: Strong proficiency in Python, Go, or Java.

  • DevSecOps Mindset: Experience integrating security into the platform "by design"—specifically managing IAM roles, secrets management (e.g., HashiCorp Vault), and CI/CD security scanning.

#LI-RP1

#LI-hybrid

CME Group is committed to offering a competitive total rewards package for our employees that recognizes their contributions to the business and reflects our long-term investment in their future. The pay range for this role is $132,100-$220,100. Actual salary offered will be dependent on a wide array of factors including but not limited to: relevant experience, skills, education and comparison to internal employees (where relevant). Our compensation program also includes an annual target bonus opportunity for all employees, as well as the opportunity to become an owner in the company through our broad-based equity program. Through our benefits program, we strive to offer flexibility, value and choice. From comprehensive health coverage, to a retirement package that includes both a 401(k) and an active pension plan, to highly competitive education reimbursement provisions, paid time off and a mental health benefit, CME Group offers a holistic benefits package for our team and their dependents.

CME Group: Where Futures are Made

CME Group is the world’s leading derivatives marketplace. But who we are goes deeper than that. Here, you can impact markets worldwide. Transform industries. And build a career by shaping tomorrow. We invest in your success and you own it – all while working alongside a team of leading experts who inspire you in ways big and small. Problem solvers, difference makers, trailblazers. Those are our people. And we’re looking for more.

At CME Group, we embrace our employees' unique experiences and skills to ensure that everyone’s perspectives are acknowledged and valued. As an equal-opportunity employer, we consider all potential employees without regard to any protected characteristic.

Important Notice: Recruitment fraud is on the rise, with scammers using misleading promises of job offers and interviews to solicit money and personal information from job seekers. CME Group adheres to established procedures designed to maintain trust, confidence and security throughout our recruitment process. Learn more here.

Skills Required

  • Strong proficiency in a high-level programming language such as Python, Java, or Golang
  • Deep experience with cloud platforms, specifically Google Cloud (GCP)
  • Hands-on experience with large-scale data processing frameworks like Apache Spark or Apache Flink
  • Proven hands-on experience with containerization (Docker) and orchestration, preferably Kubernetes
  • Excellent proficiency with version control systems, particularly Git
  • Strong understanding of Infrastructure as Code (IaC) and GitOps principles
  • Strong understanding of data warehousing solutions, with hands-on experience in Google BigQuery being a significant advantage
  • Experience building and managing complex data pipelines using orchestration tools like Argo Workflows or Airflow
  • Familiarity with building CI/CD pipelines (e.g., Jenkins, GitLab CI, Argo Workflows) for data applications
  • Proficiency with Infrastructure as Code (IaC) tools, particularly Terraform is a plus

CME Group Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about CME Group and has not been reviewed or approved by CME Group.

  • Retirement Support U.S. offerings include both a 401(k) and a company-funded cash-balance pension, strengthening long-term financial security. This dual-track structure is highlighted as a notable differentiator among private employers.
  • Leave & Time Off Breadth PTO and holiday schedules are described as generous, with ample time off and carryover commonly highlighted. This breadth of leave meaningfully enhances perceived total rewards.
  • Flexible Benefits A flexible, hybrid work model applies to many roles, increasing day-to-day usability of the package. Flexibility is framed as a standard feature rather than an exception.

CME Group Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Chicago, IL
3,291 Employees

What We Do

As the world's leading derivatives marketplace, CME Group (www.cmegroup.com) is where the world comes to manage risk. CME Group exchanges offer the widest range of global benchmark products across all major asset classes, including futures and options based on interest rates, equity indexes, foreign exchange, energy, agricultural commodities, metals, weather and real estate. CME Group brings buyers and sellers together through its CME Globex® electronic trading platform and its trading facilities in New York and Chicago. CME Group also operates CME Clearing, one of the world’s leading central counterparty clearing provider in the world, which offers clearing and settlement services for exchange-traded contracts, as well as for over-the-counter derivatives transactions through CME ClearPort®. These products and services ensure that businesses everywhere can substantially mitigate counterparty credit risk in both listed and over-the-counter derivatives markets.

Similar Jobs

Capital One Logo Capital One

Product Manager

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
4 Locations
55000 Employees
101K-127K Annually

Capital One Logo Capital One

Administrative Assistant

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
3 Locations
55000 Employees
74K-101K Annually

Capital One Logo Capital One

Risk Manager, Business Continuity and Resilience Risk Management

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
4 Locations
55000 Employees
138K-189K Annually

Capital One Logo Capital One

Platform Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
3 Locations
55000 Employees
150K-188K Annually

Similar Companies Hiring

Granted Thumbnail
Mobile • Insurance • Healthtech • Financial Services • Artificial Intelligence
New York, New York
23 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account