Senior Data Engineer - GCP

Reposted 8 Days Ago
Be an Early Applicant
Bengaluru North, Yelahanka, Bengaluru Urban, Karnataka, IND
In-Office
Senior level
Artificial Intelligence • Software • Consulting • Generative AI
The Role
The Senior Data Engineer will design and optimize data platforms on Google Cloud Platform, focusing on batch and streaming pipelines, mentorship, and ensuring data quality and performance.
Summary Generated by Built In

Auxo is looking for a Senior Data Engineer – GCP Native Platform to design, build, and operate scalable, production-grade data platforms for our enterprise clients.

This is a hands-on delivery role, not a support function. You will own end-to-end data pipeline engineering on Google Cloud Platform, embedding best-in-class data engineering practices across batch and streaming workloads, while working closely with architects, analysts, and data scientists.

Location : Bangalore, Hyderabad, Mumbai, and Gurgaon

Responsibilities
  • Design, build, and optimize scalable batch and streaming data pipelines using Dataflow (Apache Beam)
  • Develop and manage workflow orchestration using Airflow on Cloud Composer
  • Implement ELT transformations using Dataform for SQL-based data modeling and transformations
  • Design and maintain BigQuery datasets following layered / medallion architecture patterns
  • Implement event-driven ingestion and CDC patterns using Pub/Sub
  • Partner with architects to implement technical designs, standards, and platform best practices
  • Ensure performance optimization, reliability, monitoring, and cost efficiency of data pipelines
  • Implement data quality checks, validations, and monitoring within pipelines
  • Support production deployments, incident resolution, and operational stability
  • Mentor junior engineers and contribute to engineering excellence across the team


RequirementsRequired Skills & Experience
Data Engineering (Strong Hands-on Experience)
  • Design and development of production-grade data pipelines
  • Batch and streaming data processing architectures
  • Workflow orchestration and dependency management
  • Data modeling, schema design, and performance optimization
  • Pipeline monitoring, troubleshooting, and cost optimization
GCP Data Platform
  • Hands-on experience with BigQuery (advanced SQL, partitioning, clustering, optimization)
  • Strong experience with Dataflow / Apache Beam (Python or Java)
  • Experience with Cloud Composer / Airflow
  • Experience with Pub/Sub and Cloud Storage
Technical Foundation
  • Strong proficiency in SQL and Python (Java is a plus)
  • Solid understanding of ETL/ELT patterns and modern data stack concepts
  • Experience with Git-based version control and CI/CD pipelines
  • Working knowledge of cloud monitoring and logging

Preferred Qualifications
  • Experience with GCP Professional Data Engineer certification
  • Exposure to Dataform or dbt for transformation workflows
  • Experience with real-time streaming architectures
  • Familiarity with Vertex AI, Cloud Functions, or Dataproc
  • Understanding of data governance concepts and platforms (Dataplex, Atlan, Collibra)
  • Experience with legacy-to-cloud data migrations
  • Familiarity with Looker or Power BI


Skills Required

  • Strong hands-on experience in data engineering
  • Experience with GCP data platform tools
  • Proficiency in SQL and Python
  • Solid understanding of ETL/ELT patterns
  • Experience with BigQuery and Dataflow
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
Year Founded: 2022

What We Do

AuxoAI partners with enterprise leaders to build AI systems, enabling the creation of AI-first enterprises by moving from AI strategy to production-grade deployed systems in weeks.

Similar Jobs

ZS Logo ZS

Administrative Coordinator

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
15000 Employees

ZS Logo ZS

Consultant

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
4 Locations
15000 Employees

TransUnion Logo TransUnion

Senior Engineer

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
13000 Employees

Zscaler Logo Zscaler

Development Engineer

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Hybrid
Bangalore, Bengaluru, Karnataka, IND
8697 Employees

Similar Companies Hiring

Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
LTX Thumbnail
Conversational AI • Generative AI
Jerusalem, Israel
360 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account