Data Platform Engineer II (GCP & Data Platforms)
Summary
The Platform Engineering team is a collective of highly skilled individuals bridging the gap between development and operations with a security-first mindset. We are looking for a Platform Engineer II to help us build the next generation of self-service capabilities that drive developer productivity and data transparency.
In this role, you will focus on the intersection of Cloud Infrastructure and Data Governance. You will be responsible for engineering automated pipelines that facilitate metadata discovery, data lineage, and integration across our hybrid-cloud ecosystem (On-prem to GCP). Your mission is to treat the "Platform as a Product," ensuring our data analytics and application teams can discover, trust, and deploy data assets with speed and security.
Principal Accountabilities
- Data Platform Engineering: Design and implement self-service tools and "Golden Paths" that reduce time-to-market for application and data teams.
- Metadata & Discovery: Build and maintain automated pipelines to crawl metadata and establish lineage from diverse sources (Oracle, SQL Server, Cloud SQL, AlloyDB) into our centralized discovery and governance platforms.
- Automated Workflows: Engineer scalable CI/CD and data orchestration workflows using Argo Workflows and shell scripting to automate complex infrastructure and data tasks.
- Hybrid Cloud Integration: Collaborate on the architecture and migration of data assets from on-premises environments to GCP (BigQuery), ensuring data remains well-architected and secure.
- Collaboration & Mentorship: Work closely with senior engineers to identify bottlenecks in the delivery process and contribute to the evolution of our global tech stack.
Skills and Experience Requirements
Experience Levels:
- Total Experience: 3 to 5 years in a professional technical role (Software Engineering, Platform, or DevOps).
- Relevant Cloud Experience: At least 2+ years of hands-on experience specifically within Google Cloud Platform (GCP) and Kubernetes.
- Data Experience: At least 1 year of experience working with data-centric tools (SQL, BigQuery, or ETL/ELT pipelines).
Required (Must Have):
- Cloud Expertise: Proven experience with GCP core services, specifically BigQuery, Cloud SQL, AlloyDB, and IAM.
- Database Proficiency: Strong command of SQL for querying complex schemas and managing data across RDBMS and Cloud Data Warehouses.
- Orchestration & Automation: Hands-on experience with Kubernetes and Argo Workflows.
- Scripting & Development: Strong proficiency in Shell Scripting and at least one high-level language such as Python or Java.
- Infrastructure as Code: Experience with Git-based workflows and automation tools (e.g., Ansible, Terraform, or Jenkins).
- Containerization: Deep understanding of Docker and Kubernetes-native deployment strategies.
- Communication: Excellent oral and written communication skills, with the ability to work effectively in a global team environment.
Preferred (Good to Have):
- Data Governance: Experience with data cataloging, metadata management, and lineage tools (e.g., Atlan, Collibra, or DataPlex).
- Data Engineering Fundamentals: Familiarity with ETL/ELT patterns and movement of data from RDBMS (Oracle/SQL Server) to Cloud Data Warehouses.
- Data Visualization: Exposure to Looker or Tableau, specifically regarding how these tools consume data and represent metadata.
- Security Mindset: Understanding of DevSecOps principles, including secret management and least-privilege access in a data context.
What We Offer
- A supportive environment fostering career progression and continuous learning.
- Exposure to diverse products, asset classes, and high-scale data environments.
- A competitive salary and comprehensive benefits package consistent with our global standards.
CME Group: Where Futures are Made
CME Group is the world’s leading derivatives marketplace. But who we are goes deeper than that. Here, you can impact markets worldwide. Transform industries. And build a career by shaping tomorrow. We invest in your success and you own it – all while working alongside a team of leading experts who inspire you in ways big and small. Problem solvers, difference makers, trailblazers. Those are our people. And we’re looking for more.
At CME Group, we embrace our employees' unique experiences and skills to ensure that everyone’s perspectives are acknowledged and valued. As an equal-opportunity employer, we consider all potential employees without regard to any protected characteristic.
Important Notice: Recruitment fraud is on the rise, with scammers using misleading promises of job offers and interviews to solicit money and personal information from job seekers. CME Group adheres to established procedures designed to maintain trust, confidence and security throughout our recruitment process. Learn more here.
Top Skills
What We Do
As the world's leading derivatives marketplace, CME Group (www.cmegroup.com) is where the world comes to manage risk. CME Group exchanges offer the widest range of global benchmark products across all major asset classes, including futures and options based on interest rates, equity indexes, foreign exchange, energy, agricultural commodities, metals, weather and real estate. CME Group brings buyers and sellers together through its CME Globex® electronic trading platform and its trading facilities in New York and Chicago. CME Group also operates CME Clearing, one of the world’s leading central counterparty clearing provider in the world, which offers clearing and settlement services for exchange-traded contracts, as well as for over-the-counter derivatives transactions through CME ClearPort®. These products and services ensure that businesses everywhere can substantially mitigate counterparty credit risk in both listed and over-the-counter derivatives markets.
