Data Engineer Lead-GCP & BigQuery Specialist

Posted 7 Days Ago
Be an Early Applicant
Hyderabad, Telangana, IND
In-Office
Expert/Leader
Information Technology • Professional Services • Software • Consulting
The Role
Lead the design, development, and optimization of scalable GCP data pipelines, ETL/ELT workflows, BigQuery warehouses, and streaming solutions. Migrate on-premise systems to GCP, ensure data quality, security, governance, and reliability, and troubleshoot large-scale data platforms. Collaborate with technical and business stakeholders, establish data engineering best practices, and mentor junior engineers while guiding complex projects and recommending platform improvements.
Summary Generated by Built In

Role Overview: We are seeking a highly experienced Senior Data Engineer with over 15 years of expertise in designing, building, and managing scalable data solutions. The ideal candidate will have extensive hands-on experience with Google Cloud Platform (GCP) services, particularly BigQuery, and a strong background in data pipelines, ETL/ELT processes, and data architecture.This role requires a strategic thinker who can lead complex data engineering projects, mentor junior team members, and collaborate with cross-functional teams to deliver high-quality data solutions.

Key Responsibilities:

  • Design, develop, and maintain scalable and efficient data pipelines and ETL/ELT workflows using GCP services.
  • Architect and implement data warehouse solutions using BigQuery, ensuring optimal performance and cost efficiency.
  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver actionable insights.
  • Optimize and manage large-scale datasets, ensuring data quality, integrity, and security.
  • Develop and enforce best practices for data governance, data modeling, and data lifecycle management.
  • Implement streaming data solutions using tools like Dataflow, Pub/Sub, and Apache Beam.
  • Monitor and troubleshoot data pipelines, ensuring high availability and reliability.
  • Lead the migration of on-premise data systems to GCP, ensuring seamless integration and minimal downtime.
  • Mentor and guide junior engineers, fostering a culture of continuous learning and innovation.
  • Stay updated with the latest advancements in GCP and data engineering technologies, and recommend improvements to existing systems.

Requirements

What we are looking for:

  • 15+ years of experience in data engineering, with a focus on cloud-based solutions.
  • Expertise in GCP services, including but not limited to:BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud Composer (Airflow), Cloud Functions.
  • Strong proficiency in SQL and experience with BigQuery SQL for complex queries and performance optimization.\
  • Hands-on experience with Python or Java for building data pipelines and automation.
  • Deep understanding of data modeling, data warehousing, and schema design.
  • Experience with streaming data processing and tools like Apache Beam or Kafka.
  • Familiarity with CI/CD pipelines and version control systems like Git.
  • Strong knowledge of data security and compliance standards (e.g., GDPR, HIPAA).
  • Proven experience in migrating on-premise data systems to GCP.
  • Excellent problem-solving skills and the ability to work in a fast-paced, dynamic environment.
  • Strong communication and collaboration skills, with the ability to work effectively with both technical and non-technical stakeholders.

Skills Required

  • 15+ years of experience in data engineering focused on cloud-based solutions
  • Expertise with GCP services including BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud Composer, and Cloud Functions
  • Strong SQL proficiency, including complex BigQuery SQL queries and performance optimization
  • Hands-on experience with Python or Java for data pipelines and automation
  • Deep understanding of data modeling, data warehousing, and schema design
  • Experience with streaming data processing using Apache Beam or Kafka
  • Familiarity with CI/CD pipelines and Git
  • Knowledge of data security and compliance standards such as GDPR and HIPAA
  • Proven experience migrating on-premise data systems to GCP
  • Excellent problem-solving skills in a fast-paced, dynamic environment
  • Strong communication and collaboration skills with technical and non-technical stakeholders
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
17 Employees
Year Founded: 2015

What We Do

NexusCorp LLC (operating as Nexus Corporation) helps businesses achieve their goals through custom software development, IT consulting, statement-of-work delivery, contingent workforce and direct-hire solutions, and payroll services. It designs, builds, tests, and maintains scalable digital applications; analyzes systems to improve technology use; and supplies specialized professionals and structured project delivery. Its client-first approach emphasizes compliance, integrity, innovation, and tailored business outcomes.

Similar Jobs

Wise Logo Wise

India and South Asia Government Relations Manager

Fintech • Mobile • Payments • Software • Financial Services
Hybrid
Hyderabad, Telangana, IND
9000 Employees

Wise Logo Wise

Engineering Lead

Fintech • Mobile • Payments • Software • Financial Services
Hybrid
Hyderabad, Telangana, IND
9000 Employees

Zeta Global Logo Zeta Global

Associate Analyst

AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
Easy Apply
Hybrid
Hyderabad, Telangana, IND
2429 Employees

JPMorganChase Logo JPMorganChase

Data Analyst

Financial Services
Hybrid
Hyderabad, Telangana, IND
289097 Employees

Similar Companies Hiring

Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account