Senior Data Engineer - GCP

Posted 23 Days Ago
Be an Early Applicant
Bengaluru North, Yelahanka, Bengaluru Urban, Karnataka, IND
In-Office
Senior level
Artificial Intelligence • Software • Consulting • Generative AI
The Role
The Senior Data Engineer will design and optimize data platforms on Google Cloud Platform, focusing on batch and streaming pipelines, mentorship, and ensuring data quality and performance.
Summary Generated by Built In

Auxo is looking for a Senior Data Engineer – GCP Native Platform to design, build, and operate scalable, production-grade data platforms for our enterprise clients.

This is a hands-on delivery role, not a support function. You will own end-to-end data pipeline engineering on Google Cloud Platform, embedding best-in-class data engineering practices across batch and streaming workloads, while working closely with architects, analysts, and data scientists.

Location : Bangalore, Hyderabad, Mumbai, and Gurgaon

Responsibilities
  • Design, build, and optimize scalable batch and streaming data pipelines using Dataflow (Apache Beam)
  • Develop and manage workflow orchestration using Airflow on Cloud Composer
  • Implement ELT transformations using Dataform for SQL-based data modeling and transformations
  • Design and maintain BigQuery datasets following layered / medallion architecture patterns
  • Implement event-driven ingestion and CDC patterns using Pub/Sub
  • Partner with architects to implement technical designs, standards, and platform best practices
  • Ensure performance optimization, reliability, monitoring, and cost efficiency of data pipelines
  • Implement data quality checks, validations, and monitoring within pipelines
  • Support production deployments, incident resolution, and operational stability
  • Mentor junior engineers and contribute to engineering excellence across the team


RequirementsRequired Skills & Experience
Data Engineering (Strong Hands-on Experience)
  • Design and development of production-grade data pipelines
  • Batch and streaming data processing architectures
  • Workflow orchestration and dependency management
  • Data modeling, schema design, and performance optimization
  • Pipeline monitoring, troubleshooting, and cost optimization
GCP Data Platform
  • Hands-on experience with BigQuery (advanced SQL, partitioning, clustering, optimization)
  • Strong experience with Dataflow / Apache Beam (Python or Java)
  • Experience with Cloud Composer / Airflow
  • Experience with Pub/Sub and Cloud Storage
Technical Foundation
  • Strong proficiency in SQL and Python (Java is a plus)
  • Solid understanding of ETL/ELT patterns and modern data stack concepts
  • Experience with Git-based version control and CI/CD pipelines
  • Working knowledge of cloud monitoring and logging

Preferred Qualifications
  • Experience with GCP Professional Data Engineer certification
  • Exposure to Dataform or dbt for transformation workflows
  • Experience with real-time streaming architectures
  • Familiarity with Vertex AI, Cloud Functions, or Dataproc
  • Understanding of data governance concepts and platforms (Dataplex, Atlan, Collibra)
  • Experience with legacy-to-cloud data migrations
  • Familiarity with Looker or Power BI


Skills Required

  • Strong hands-on experience in data engineering
  • Experience with GCP data platform tools
  • Proficiency in SQL and Python
  • Solid understanding of ETL/ELT patterns
  • Experience with BigQuery and Dataflow
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
0 Employees
Year Founded: 2022

What We Do

AuxoAI partners with enterprise leaders to build AI systems, enabling the creation of AI-first enterprises by moving from AI strategy to production-grade deployed systems in weeks.

Similar Jobs

Augury Logo Augury

Principal Product Manager

Artificial Intelligence • Hardware • Internet of Things • Machine Learning • Software • Manufacturing
Easy Apply
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
203 Employees

Capital One Logo Capital One

Principal Associate - Software Engineering

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
55000 Employees

Definitive Healthcare Logo Definitive Healthcare

Senior Data Scientist

Big Data • Healthtech • Software
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
800 Employees

MongoDB Logo MongoDB

Senior Engineer

Big Data • Cloud • Software • Database
Easy Apply
Remote or Hybrid
India
5550 Employees

Similar Companies Hiring

Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
LTX Thumbnail
Conversational AI • Generative AI
Jerusalem, Israel
360 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account