GCP Data Engineer

Reposted 4 Days Ago
Houston, TX, USA
In-Office
Mid level
Information Technology • Software
The Role
Design, build, and maintain scalable GCP data pipelines using Airflow, Dataflow (Apache Beam), and BigQuery. Ingest and transform massive datasets, optimize pipeline performance, ensure data quality/security, and collaborate with data teams to troubleshoot and deliver reliable analytics solutions.
Summary Generated by Built In

GCP Data Engineer
Houston, TX
Long Term Contract
Key Responsibilities:
  • Design, develop, and manage robust, scalable, and efficient data pipelines on GCP.
  • Build and maintain data workflows using Apache Airflow for orchestration.
  • Work with Google BigQuery for large-scale analytics and data storage.
  • Leverage Google Cloud Dataflow (Apache Beam) for real-time and batch data processing.
  • Ingest, transform, and analyze massive datasets (millions+ of records).
  • Collaborate with data scientists, analysts, and other engineering teams to deliver reliable data solutions.
  • Optimize data performance and troubleshoot data pipeline issues in production.
  • Ensure data quality, integrity, and security across all data platforms.
Required Skills & Qualifications:
  • 4+ years of hands-on experience with Google Cloud Platform (GCP) services.
  • Strong experience with BigQuery, Dataflow, and Airflow.
  • Proficiency in Python or Java for data processing and pipeline development.
  • Deep understanding of big data processing principles and distributed systems.
  • Hands-on experience working with millions of rows/records in large-scale environments.
  • Experience with data lake and data warehouse architectures.
  • Strong problem-solving skills and ability to debug complex systems.
  • Automating specific system operations to enhance efficiency and speed 
  • Testing designs to find and fix mistakes and make system improvements 
  • Evaluating and identifying the best cloud solutions in collaboration with engineering and development teams 
  • Developing, establishing and implementing modular cloud-based applications 
  • Locating, evaluating and fixing infrastructure risks and deployment problems 
  • Periodically evaluating computer systems and offering suggestions for performance enhancements 
  • Offering support and guidance to meet customer requirements 

Top Skills

Apache Airflow
Apache Beam
Big Data
Data Lake
Data Warehouse
Distributed Systems
Google Bigquery
Google Cloud Dataflow
Google Cloud Platform (Gcp)
Java
Python
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Portland, OR
20 Employees
Year Founded: 2016

What We Do

CrackaJack Digital Solutions is an IT company in business since 2016 with offices in Portland, Oregon and Pune, India. We primarily serve small to mid-sized businesses across the United States to unleash the power of digital transformation. We specialize in several areas of technology with a particular focus on managed IT services, remote infrastructure, recruiting & staffing technical talent, and website development & maintenance. We pride ourselves on providing practical and effective technology solutions ranging in scope and size. Our MISSION Inspire and transform businesses through digital innovations to accelerate long-term sustainable revenue growth. Our VISION The Pacific Northwest’s most successful and impactful digital IT transformation service provider. Our PURPOSE Listen & seek to understand Lead with data & insights Leverage expertise

Similar Jobs

CVS Health Logo CVS Health

Development Engineer

Fitness • Healthtech • Retail • Pharmaceutical
In-Office or Remote
2 Locations
119959 Employees
107K-237K Annually

Optimum Logo Optimum

Sales Representative

AdTech • Digital Media • Internet of Things • Marketing Tech • Mobile • Retail • Software
Hybrid
Plano, TX, USA
9000 Employees
40K-120K Annually

Wipfli Logo Wipfli

Transaction Advisory Services Manager

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
3000 Employees
117K-158K Annually

Wipfli Logo Wipfli

Director - Transaction Advisory Services

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
3000 Employees
142K-191K Annually

Similar Companies Hiring

Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account