GCP Big Data Engineer

Posted 4 Days Ago
Be an Early Applicant
Karachi, Sindh
In-Office
Senior level
Artificial Intelligence • Information Technology • Software • Analytics
The Role
Design and implement scalable data pipelines on GCP, optimize data solutions for analytics, manage data quality, and collaborate with stakeholders.
Summary Generated by Built In
Job Title: GCP Big Data Engineer

Experience: 7–8 Years
Employment Type: Full-Time

Job Summary

We are seeking a highly skilled GCP Big Data Engineer with 7–8 years of experience in designing, developing, and optimizing large-scale data solutions on Google Cloud Platform (GCP). The ideal candidate will have strong expertise in data engineering, cloud-native architectures, and building scalable batch and real-time data pipelines.

You will be responsible for designing and implementing robust data platforms that support analytics, reporting, and machine learning use cases.

Key Responsibilities
  • Design, develop, and maintain scalable data pipelines using GCP services.

  • Build and optimize batch and real-time processing frameworks.

  • Develop ETL/ELT workflows using Dataflow, Dataproc, Composer (Airflow), and Cloud Functions.

  • Implement data ingestion solutions using Pub/Sub, Cloud Storage, and BigQuery.

  • Design and manage data warehousing solutions in BigQuery.

  • Ensure data quality, governance, security, and compliance standards.

  • Optimize performance and cost of cloud data workloads.

  • Collaborate with Data Scientists, Analysts, and Business stakeholders to deliver data solutions.

  • Implement CI/CD pipelines for data engineering workflows.

  • Monitor and troubleshoot data platform issues.

Required Skills & Technical ExpertiseGoogle Cloud Platform (Must Have)
  • BigQuery (advanced SQL, optimization, partitioning, clustering)

  • Dataflow (Apache Beam)

  • Dataproc (Spark, Hadoop)

  • Cloud Composer (Airflow)

  • Pub/Sub

  • Cloud Storage

  • Cloud Functions / Cloud Run

  • IAM & Security Best Practices

Big Data Technologies
  • Apache Spark

  • Hadoop Ecosystem

  • Kafka (preferred)

  • Hive

Programming
  • Python (mandatory)

  • SQL (advanced level)

  • Scala or Java (preferred)

Other Skills
  • Strong understanding of Data Modeling (Star/Snowflake schemas)

  • Experience with CI/CD tools (Jenkins, GitLab CI, etc.)

  • Infrastructure as Code (Terraform preferred)

  • Experience with DevOps practices

  • Strong analytical and problem-solving skills

Qualifications
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.

  • 7–8 years of experience in Data Engineering.

  • Minimum 3+ years of hands-on experience on Google Cloud Platform.

  • GCP Certifications (Professional Data Engineer) – Preferred.

Good to Have
  • Experience with Real-time Streaming Architectures.

  • Exposure to Data Governance tools.

  • Experience in multi-cloud environments.

  • Knowledge of ML pipelines on GCP.

Top Skills

Spark
BigQuery
Cloud Composer
Cloud Functions
Cloud Storage
Dataflow
Dataproc
Google Cloud Platform
Hadoop
Hive
Kafka
Pub/Sub
Python
SQL
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Dubai
65 Employees
Year Founded: 2016

What We Do

Datamatics Technologies (DMT) was established in Dubai. We specialize in providing onsite and offshore professional services, covering the full spectrum of Data Analytics and Data Science domains.

Our experience of working with diverse industry sectors such as Telecoms, Finance, Government and Manufacturing, across multiple regions enables us to engage and deliver for our clients with confidence.

We can offer our full portfolio of services through resource augmentation, managed services, both on T&M or fixed price financial arrangements. Through our end-to-end managed services offering we enable our clients to cut down costs, increase profitability and focus on value addition to their core business activities.
Our project and delivery management team are certified in Agile, PMI and ITIL to ensure the planning and execution are carried out using industry best practices.
We are working with our clients across Middle East and Africa Region.

Similar Jobs

DigitalOcean Logo DigitalOcean

Senior Engineer

Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
In-Office
Karachi, Sindh, PAK
1400 Employees

Mondelēz International Logo Mondelēz International

PCM Chocolate GDM & KSA

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
2 Locations
90000 Employees

DigitalOcean Logo DigitalOcean

Executive Assistant

Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
In-Office
Karachi, Sindh, PAK
1400 Employees

Motive Logo Motive

Senior Software Engineer

Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Easy Apply
In-Office
3 Locations
4000 Employees

Similar Companies Hiring

Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY
Bellagent Thumbnail
Artificial Intelligence • Machine Learning • Business Intelligence • Generative AI
Chicago, IL
20 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account