GCP Data Engineer

Posted 9 Days Ago
Houston, TX
In-Office
Mid level
Information Technology • Software
The Role
Design, build, and maintain scalable GCP data pipelines using Airflow, Dataflow (Apache Beam), and BigQuery. Ingest and transform massive datasets, optimize pipeline performance, ensure data quality/security, and collaborate with data teams to troubleshoot and deliver reliable analytics solutions.
Summary Generated by Built In

GCP Data Engineer
Houston, TX
Long Term Contract
Key Responsibilities:
  • Design, develop, and manage robust, scalable, and efficient data pipelines on GCP.
  • Build and maintain data workflows using Apache Airflow for orchestration.
  • Work with Google BigQuery for large-scale analytics and data storage.
  • Leverage Google Cloud Dataflow (Apache Beam) for real-time and batch data processing.
  • Ingest, transform, and analyze massive datasets (millions+ of records).
  • Collaborate with data scientists, analysts, and other engineering teams to deliver reliable data solutions.
  • Optimize data performance and troubleshoot data pipeline issues in production.
  • Ensure data quality, integrity, and security across all data platforms.
Required Skills & Qualifications:
  • 4+ years of hands-on experience with Google Cloud Platform (GCP) services.
  • Strong experience with BigQuery, Dataflow, and Airflow.
  • Proficiency in Python or Java for data processing and pipeline development.
  • Deep understanding of big data processing principles and distributed systems.
  • Hands-on experience working with millions of rows/records in large-scale environments.
  • Experience with data lake and data warehouse architectures.
  • Strong problem-solving skills and ability to debug complex systems.
  • Automating specific system operations to enhance efficiency and speed 
  • Testing designs to find and fix mistakes and make system improvements 
  • Evaluating and identifying the best cloud solutions in collaboration with engineering and development teams 
  • Developing, establishing and implementing modular cloud-based applications 
  • Locating, evaluating and fixing infrastructure risks and deployment problems 
  • Periodically evaluating computer systems and offering suggestions for performance enhancements 
  • Offering support and guidance to meet customer requirements 

Top Skills

Google Cloud Platform (Gcp),Google Bigquery,Google Cloud Dataflow,Apache Beam,Apache Airflow,Python,Java,Data Lake,Data Warehouse,Big Data,Distributed Systems
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Portland, OR
20 Employees
Year Founded: 2016

What We Do

CrackaJack Digital Solutions is an IT company in business since 2016 with offices in Portland, Oregon and Pune, India.

We primarily serve small to mid-sized businesses across the United States to unleash the power of digital transformation. We specialize in several areas of technology with a particular focus on managed IT services, remote infrastructure, recruiting & staffing technical talent, and website development & maintenance.

We pride ourselves on providing practical and effective technology solutions ranging in scope and size.

Our MISSION
Inspire and transform businesses through digital innovations to accelerate long-term sustainable revenue growth.

Our VISION
The Pacific Northwest’s most successful and impactful digital IT transformation service provider.

Our PURPOSE
Listen & seek to understand
Lead with data & insights
Leverage expertise

Similar Jobs

CVS Health Logo CVS Health

Development Engineer

Fitness • Healthtech • Retail • Pharmaceutical
In-Office or Remote
2 Locations
119959 Employees
107K-237K Annually

ServiceNow Logo ServiceNow

Architect

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Austin, TX, USA
28000 Employees
152K-251K Annually

Boeing Logo Boeing

Systems Engineer

Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
In-Office
Plano, TX, USA
170000 Employees
146K-239K Annually

Boeing Logo Boeing

Associate Industrial Engineer

Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
In-Office
San Antonio, TX, USA
170000 Employees
83K-113K Annually

Similar Companies Hiring

Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account