GCP(Big query + SQL) Data Engineer

Posted 2 Days Ago
Be an Early Applicant
4 Locations
In-Office
1M-2M Annually
Senior level
Artificial Intelligence • HR Tech • Professional Services • Software
The Role
Develop and maintain scalable GCP data pipelines using BigQuery, Dataflow, Pub/Sub, Cloud Storage, Airflow, Python, and SQL. Automate infrastructure with Terraform and build enterprise-scale data lakes, warehouses, and analytics platforms. Monitor end-to-end pipelines, troubleshoot production issues, resolve data duplication and quality problems, and collaborate cross-functionally to deliver reliable data solutions.
Summary Generated by Built In

This role is for one of Weekday’s clients
Salary range: Rs 1400000 - Rs 2000000 (ie INR 14 - 20 LPA)

Min Experience: 5+ years
Location: Bengaluru, Pune, Maharashtra, India, Hyderabad, Telangana, India, Chennai, Tamil Nadu, India
JobType: full-time


Requirements

Roles & Responsibilities:

• Develop and maintain scalable, cloud-native data processing pipelines on GCP

• Work extensively on BigQuery, DataFlow, Pub/Sub, Cloud Storage, and Airflow for orchestration

• Automate infrastructure using Terraform and follow agile development practices

• Implement data solutions for enterprise-scale data lakes and data warehouses

• Write clean, efficient, and production-ready code using Python and SQL

• Handle data quality issues including data duplication and debugging code failures

• Collaborate with cross-functional teams to build resilient and reliable data platforms

Additional Screening Points:

• Hands-on experience with debugging/analyzing production issues

• Exposure to identifying and resolving data duplication or consistency issues

• Should have worked on end-to-end data pipeline creation and monitoring

• Experience in the data engineering field is preferred
• Hands-on experience in GCP cloud data implementation suite such as Bl Query, Pub Sub, Data Flow/Apache Beam Airflow/Composer, Cloud Storage
• Strong experience and understanding of very large-scale data architecture, solutioning, and operationalization of data warehouses, data lakes, and analytics platforms.

Hands on Strong Experience in the below technology
1. GBQ Query

2.Python

3. Apache Airflow

4..SQL (BigQuery preferred)

5. Extensive hands-on experience working with data using SQL and Python

Skills Required

  • 5+ years of experience
  • Hands-on experience developing and maintaining GCP cloud-native data pipelines
  • Strong experience with BigQuery
  • Strong experience with Python and SQL
  • Experience with Apache Airflow or Cloud Composer
  • Experience with Dataflow or Apache Beam
  • Experience with Pub/Sub and Cloud Storage
  • Experience automating infrastructure with Terraform
  • Experience building enterprise-scale data lakes and data warehouses
  • Experience debugging and analyzing production issues
  • Experience identifying and resolving data duplication or consistency issues
  • Experience creating and monitoring end-to-end data pipelines
  • Experience in the data engineering field
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Stockholm
Year Founded: 2021

What We Do

Weekday is an AI-powered recruitment platform that helps startups hire top-tier engineering and product talent. By leveraging a massive database of white-collar professionals and advanced outreach tools, the company streamlines the hiring process through automated sourcing, AI-driven resume screening, and white-glove contingency services. Their mission is to modernize recruitment by enabling companies to discover and engage passive candidates efficiently, ensuring high-quality hires for critical roles.

Similar Jobs

Ericsson Logo Ericsson

Supply Chain Planner

Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Hybrid
2 Locations
88000 Employees

TransUnion Logo TransUnion

Devops Engineer

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
4 Locations
13000 Employees

Mondelēz International Logo Mondelēz International

Platform Engineer

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
India
90000 Employees

FloQast Logo FloQast

Senior ABAP Engineer

Artificial Intelligence • Fintech • Software
Hybrid
Pune, Mahārāshtra, IND
800 Employees

Similar Companies Hiring

Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees
VCA Animal Hospitals Thumbnail
Pet • Professional Services
Los Angeles, CA
35000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account