Senior Data Engineer - GCP

Posted 3 Days Ago
Be an Early Applicant
Bengaluru North, Yelahanka, Bengaluru Urban, Karnataka, IND
In-Office
Senior level
Artificial Intelligence • Software • Consulting • Generative AI
The Role
The Senior Data Engineer will design and optimize data platforms on Google Cloud Platform, focusing on batch and streaming pipelines, mentorship, and ensuring data quality and performance.
Summary Generated by Built In

Auxo is looking for a Senior Data Engineer – GCP Native Platform to design, build, and operate scalable, production-grade data platforms for our enterprise clients.

This is a hands-on delivery role, not a support function. You will own end-to-end data pipeline engineering on Google Cloud Platform, embedding best-in-class data engineering practices across batch and streaming workloads, while working closely with architects, analysts, and data scientists.

Location : Bangalore, Hyderabad, Mumbai, and Gurgaon

Responsibilities
  • Design, build, and optimize scalable batch and streaming data pipelines using Dataflow (Apache Beam)
  • Develop and manage workflow orchestration using Airflow on Cloud Composer
  • Implement ELT transformations using Dataform for SQL-based data modeling and transformations
  • Design and maintain BigQuery datasets following layered / medallion architecture patterns
  • Implement event-driven ingestion and CDC patterns using Pub/Sub
  • Partner with architects to implement technical designs, standards, and platform best practices
  • Ensure performance optimization, reliability, monitoring, and cost efficiency of data pipelines
  • Implement data quality checks, validations, and monitoring within pipelines
  • Support production deployments, incident resolution, and operational stability
  • Mentor junior engineers and contribute to engineering excellence across the team


RequirementsRequired Skills & Experience
Data Engineering (Strong Hands-on Experience)
  • Design and development of production-grade data pipelines
  • Batch and streaming data processing architectures
  • Workflow orchestration and dependency management
  • Data modeling, schema design, and performance optimization
  • Pipeline monitoring, troubleshooting, and cost optimization
GCP Data Platform
  • Hands-on experience with BigQuery (advanced SQL, partitioning, clustering, optimization)
  • Strong experience with Dataflow / Apache Beam (Python or Java)
  • Experience with Cloud Composer / Airflow
  • Experience with Pub/Sub and Cloud Storage
Technical Foundation
  • Strong proficiency in SQL and Python (Java is a plus)
  • Solid understanding of ETL/ELT patterns and modern data stack concepts
  • Experience with Git-based version control and CI/CD pipelines
  • Working knowledge of cloud monitoring and logging

Preferred Qualifications
  • Experience with GCP Professional Data Engineer certification
  • Exposure to Dataform or dbt for transformation workflows
  • Experience with real-time streaming architectures
  • Familiarity with Vertex AI, Cloud Functions, or Dataproc
  • Understanding of data governance concepts and platforms (Dataplex, Atlan, Collibra)
  • Experience with legacy-to-cloud data migrations
  • Familiarity with Looker or Power BI


Skills Required

  • Strong hands-on experience in data engineering
  • Experience with GCP data platform tools
  • Proficiency in SQL and Python
  • Solid understanding of ETL/ELT patterns
  • Experience with BigQuery and Dataflow
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
0 Employees
Year Founded: 2022

What We Do

AuxoAI partners with enterprise leaders to build AI systems, enabling the creation of AI-first enterprises by moving from AI strategy to production-grade deployed systems in weeks.

Similar Jobs

Graphcore Logo Graphcore

Staff Embedded SW/FW Engineer (Bringup) - Bengaluru

Artificial Intelligence • Semiconductor
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
762 Employees
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
762 Employees

Navan Logo Navan

Staff Software Engineer

Fintech • Information Technology • Payments • Productivity • Software • Travel • Automation
Easy Apply
Hybrid
Bengaluru, Karnataka, IND
3300 Employees

Datadog Logo Datadog

Manager, Commercial Sales

Artificial Intelligence • Cloud • Security • Software • Cybersecurity
Easy Apply
Hybrid
Bangalore, Bengaluru Urban, Karnataka, IND
6500 Employees

Similar Companies Hiring

Bellagent Thumbnail
Artificial Intelligence • Machine Learning • Business Intelligence • Generative AI
Chicago, IL
20 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York City, NY
100 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account