Sr Engineer, Data Engineering

Posted 2 Hours Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
Hybrid
Senior level
Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
The Role
Designs and optimizes enterprise-scale data platforms and batch or streaming pipelines on GCP. Responsibilities include BigQuery, Spark, Dataproc, Dataflow, storage, and workload performance optimization; cloud cost analysis and FinOps; resource tagging, governance, and lifecycle controls; monitoring and reliability; and presenting architecture and cost-saving recommendations to technical and business stakeholders.
Summary Generated by Built In

TransUnion's Job Applicant Privacy Notice

Team Overview

• We are seeking a highly skilled Cloud Data Engineer with strong expertise in Google Cloud Platform (GCP) to join our Cloud Strategy team. The ideal candidate will have 5-8 years of experience designing, implementing, optimizing, and governing cloud-based data platforms and analytics workloads.
This role requires deep technical expertise in GCP Data Engineering services, cloud cost optimization, workload right-sizing, architecture design, resource tagging/governance, and FinOps practices. The candidate should be comfortable partnering with engineering, architecture, platform, and business teams to improve performance, scalability, reliability, and cloud cost efficiency. This is a hybrid position and involves regular performance of job responsibilities virtually as well as in-person at an assigned TU office location for a minimum of two days a week.

Role Overview And Core Responsibilities

  • ata Platform Architecture & Engineering
  • Design, implement, and optimize enterprise-scale data platforms on GCP.
  • Build scalable batch and streaming data pipelines.
  • Architect data ingestion, transformation, storage, and consumption solutions.
  • Evaluate and recommend the most appropriate GCP services for specific use cases.
  • Define standards and best practices for cloud-native data engineering.
  • GCP Workload Optimization
  • Analyze existing cloud workloads and identify optimization opportunities.
  • Recommend right-sizing strategies for compute, storage, and networking resources.
  • Improve resource utilization across data engineering platforms.
  • Optimize cluster sizing, auto-scaling policies, job scheduling, and resource allocation.
  • Reduce operational costs without impacting performance or reliability.
  • FinOps & Cloud Cost Management
  • Perform detailed cloud cost analysis and chargeback/showback reporting.
  • Establish cloud cost governance frameworks and optimization programs.
  • Identify idle, underutilized, and overprovisioned resources.
  • Develop cloud cost dashboards and KPIs.
  • Track budget consumption and provide cost-saving recommendations.
  • Build forecasting models for cloud spending.
  • Governance & Resource Management
  • Define and enforce metadata, labeling, and tagging standards.
  • Ensure cloud resources are properly categorized for cost allocation and accountability.
  • Implement governance controls for cloud resource lifecycle management.
  • Collaborate with platform and security teams to ensure compliance with organizational policies.
  • Performance Optimization
  • Tune data pipelines for throughput, latency, and cost efficiency.
  • Optimize BigQuery queries and storage patterns.
  • Improve Spark workload performance through cluster tuning.
  • Optimize data partitioning, clustering, indexing, and caching strategies.
  • Establish SLIs/SLOs for data platforms and monitor operational efficiency.
  • Stakeholder Collaboration
  • Work closely with architects, engineering teams, finance teams, and business stakeholders.
  • Provide consulting and technical guidance on cloud adoption and optimization.
  • Present cost-benefit analysis and architecture recommendations to leadership teams.

Required Knowledge And Experiences

  • 5-8 years of experience in Data Engineering, Cloud Engineering, or Cloud Architecture.
  • Minimum 3+ years of hands-on experience with Google Cloud Platform.
  • Strong experience designing cloud-native data platforms.
  • Experience implementing cloud cost optimization initiatives.
  • Experience with enterprise-scale data processing environments.
Required Technical SkillsGoogle Cloud Platform (GCP)

Strong knowledge and hands-on experience with:

Data Engineering Services
  • BigQuery
  • Dataproc
  • Dataflow
  • Pub/Sub
  • Cloud Composer (Airflow)
  • Cloud Storage
  • BigLake
  • Data Fusion
  • Datastream
  • Cloud SQL
  • AlloyDB
  • Spanner
  • Looker / Looker Studio
Compute & Infrastructure
  • GKE (Google Kubernetes Engine)
  • Compute Engine
  • Cloud Run
  • Serverless technologies
  • Instance Groups
  • Managed Services
Monitoring & Operations
  • Cloud Monitoring
  • Cloud Logging
  • Cloud Trace
  • Cloud Profiler
  • Cloud Asset Inventory
Cost Optimization & FinOps Skills

Strong understanding of:

  • GCP pricing and billing models
  • Compute cost optimization
  • BigQuery cost controls and query optimization
  • Dataproc cluster sizing and lifecycle optimization
  • Storage class optimization
  • Committed Use Discounts (CUDs)
  • Sustained Use Discounts
  • Reservation planning
  • Cost allocation models
  • Chargeback and Showback mechanisms
  • Budgeting and forecasting
  • Cloud ROI analysis
  • Unit economics
  • Capacity planning
  • FinOps best practices
Governance & Tagging
  • Resource Labels and Tags
  • Cost Center Mapping
  • Environment Classification (Prod, Non-Prod, Dev, Test)
  • Data Classification
  • Ownership Attribution
  • Resource Lifecycle Governance
  • Automated policy enforcement
Data Engineering Skills
  • Apache Spark
  • PySpark
  • SQL
  • Advanced BigQuery optimization
  • Data Modeling
  • ETL/ELT design
  • Streaming architectures
  • Data Warehousing
  • Lakehouse architectures
  • Data Quality frameworks
  • Data Lineage
  • Metadata management
DevOps & Automation Skills
  • Terraform
  • Infrastructure as Code (IaC)
  • GitHub Actions / Azure DevOps / Jenkins
  • CI/CD pipelines
  • Python
  • Shell scripting
  • Kubernetes
  • Docker
Security & Compliance
  • IAM design and governance
  • Service Accounts
  • VPC and networking fundamentals
  • Data protection and encryption
  • Secrets management
  • Audit logging
  • Compliance and governance frameworks
Preferred Certifications

One or more of the following:

  • Google Professional Data Engineer
  • Google Professional Cloud Architect
  • Google Professional Cloud DevOps Engineer
  • FinOps Certified Practitioner
  • FinOps Certified Professional
  • Terraform Associate
Success Metrics

The successful candidate should be able to:

  • Reduce cloud spend through optimization initiatives.
  • Improve utilization of GCP data platform resources.
  • Establish tagging and governance standards.
  • Optimize BigQuery, Dataproc, Dataflow, and storage costs.
  • Improve performance of enterprise data pipelines.
  • Provide measurable savings through architecture and workload optimization.
  • Drive cloud adoption while maintaining cost efficiency and operational excellence.

TransUnion Overview:

At TransUnion, we encourage and are committed to creating a real, positive impact and shared sense of purpose within our Workforce for Good, which empowers our people to grow, innovate and contribute to a better future for our communities and customers. We strive to build an environment where our associates are in the driver’s seat of their professional development— while having access to help along the way. We recognize that success comes when our associates thrive both professionally and personally; that’s why we prioritize work/life flexibility and offer resources for our teams across the globe to collaborate and drive excellence.


Be a part of our Workforce for Good – you’ll work with great people, pioneering products and cutting-edge technology.


TransUnion Job Title


Sr Developer, Applications Development

Skills Required

  • 5-8 years of experience in Data Engineering, Cloud Engineering, or Cloud Architecture
  • At least 3 years of hands-on Google Cloud Platform experience
  • Experience designing cloud-native data platforms
  • Experience implementing cloud cost optimization initiatives
  • Experience with enterprise-scale data processing environments
  • Strong knowledge and hands-on experience with GCP data engineering, compute, infrastructure, monitoring, and operations services
  • Experience with Apache Spark, PySpark, SQL, data modeling, ETL/ELT, streaming architectures, data warehousing, and lakehouse architectures
  • Experience with Terraform, infrastructure as code, CI/CD pipelines, Python, shell scripting, Kubernetes, and Docker
  • Understanding of GCP pricing, billing, FinOps, cost allocation, chargeback/showback, budgeting, forecasting, and cloud ROI analysis
  • Knowledge of IAM, service accounts, VPC networking, data protection, encryption, secrets management, audit logging, and compliance frameworks
  • Google Professional Data Engineer certification
  • Google Professional Cloud Architect certification
  • Google Professional Cloud DevOps Engineer certification
  • FinOps Certified Practitioner certification
  • FinOps Certified Professional certification
  • Terraform Associate certification

What the Team is Saying

Patrick
Tiana
Jason
Lauren
TC
Jay
Aayushi
Paul
Alex Barnett
Sheetal Wathare
TransUnion
TransUnion
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Chicago, IL
13,000 Employees
Year Founded: 1968

What We Do

TransUnion is a global information and insights company that makes trust possible by ensuring that each consumer is reliably and safely represented in the marketplace. We do this by having an accurate and comprehensive picture of each person. This picture is grounded in our legacy as a credit reporting agency which enables us to tap into both credit and public record data; our data fusion methodology that helps us link, match and tap into the awesome combined power of that data; and our knowledgeable and passionate team, who stewards the information with expertise, and in accordance with local legislation around the world. Because of our work, organizations can better understand consumers in order to make more informed decisions, and earn their trust through great, personalized experiences, and the proactive extension of the right opportunities, tools and offers. In turn, consumers can be confident that their data identities will result in the opportunities they deserve. We make trust possible, so businesses and consumers can transact with confidence and achieve great things. We call this Information for Good®—it’s our purpose, and what drives us every day.

Why Work With Us

Our culture is welcoming, energetic and innovative. There’s an overall synergy that flows throughout TransUnion, creating a sense of unity in knowing that we’re all working to achieve the same overall goal. We’re dedicated to providing opportunities for our people to get involved and stay connected with their colleagues across the globe.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

TransUnion Teams

Team
Invested in Tech Teams
About our Teams

TransUnion Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Typical time on-site: Flexible
HQChicago, IL
MX
Amsterdam, NL
Bengaluru, IN
Boca Raton, FL
Bogotá, Colombia
Burlington, ON
South Africa
Cerqueira César, Sao Paulo
Chennai, IN
Cherry Hill, NJ
Cork, County Cork
Crum Lynne, PA
Denver, CO
Greenwood Village, CO
Guaynabo, PR
Gurugram, IN
Hamburg, DE
Hyderabad, IN
Johannesburg, ZA
TransUnion UK Head Office
London, GB
Louisville, KY
Madrid, ES
Makati, PH
Mumbai, IN
New York, NY
Pune, IN
Reston, VA
San Luis Obispo, CA
Santiago, CL
Sydney, NSW
Toronto, ON
Ulloa, La Aurora
Washington, US
White Plains, NY
Learn more

Similar Jobs

TransUnion Logo TransUnion

Manager - Data Science & Analytics

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
World Trade Center, Yeshwanthpur, Bengaluru Urban, Karnataka, IND
13000 Employees

TransUnion Logo TransUnion

Java Engineer

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
13000 Employees

TransUnion Logo TransUnion

Cyber security Advisor

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
2 Locations
13000 Employees

TransUnion Logo TransUnion

Principal Advisor, GenAI Technical Product Management

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
13000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account