The Role
Lead a team of Data Engineers to modernize cloud infrastructure, migrate data to Google BigQuery, and develop scalable ETL pipelines.
Summary Generated by Built In
Lead Data Engineer
Primary Skills
- GCP, Big Query, Python, Airflow, SQL, DBT
Job requirements
- About the Role
- We are seeking a Senior Data Engineer with deep expertise in Google Cloud Platform (GCP) and BigQuery to lead cloud modernization initiatives, develop scalable data pipelines, and enable real-time data processing for enterprise-level systems. This is a high-impact role focused on driving the transformation of legacy infrastructure into a robust, cloud-native data ecosystem.
- Key Responsibilities
- 1. Data Migration & Cloud Modernization
- Analyze legacy on-premises and hybrid cloud data warehouse environments (e.g., SQL Server).
- Lead the migration of large-scale datasets to Google BigQuery.
- Design and implement data migration strategies ensuring data quality, integrity, and performance.
- 2. Data Integration & Streaming
- Integrate data from various structured and unstructured sources, including APIs, relational databases, and IoT devices.
- Build real-time streaming pipelines for large-scale ingestion and processing of IoT and telemetry data.
- 3. ETL / Data Pipeline Development
- Modernize and refactor legacy SSIS packages into cloud-native ETL pipelines.
- Develop scalable, reliable workflows using Apache Airflow, Python, Spark, and GCP-native tools.
- Ensure high-performance data transformation and loading into BigQuery for analytical use cases.
- 4. Programming & Query Optimization
- Write and optimize complex SQL queries, stored procedures, and scheduled jobs within BigQuery.
- Develop modular, reusable transformation scripts using Python, Java, Spark, and SQL.
- Continuously monitor and optimize query performance and cost efficiency in the cloud data environment.
- Required Skills & Experience
- 5+ years in Data Engineering with a strong focus on cloud and big data technologies.
- Minimum 2+ years of hands-on experience with GCP, specifically BigQuery.
- Proven experience migrating on-premise data systems to the cloud.
- Strong development experience with Apache Airflow, Python, and Apache Spark.
- Expertise in streaming data ingestion, particularly in IoT or sensor data environments.
- Strong SQL development skills; experience with BigQuery performance tuning.
- Solid understanding of cloud architecture, data modeling, and data warehouse design.
- Familiarity with Git and CI/CD practices for managing data pipelines.
- Preferred Qualifications
- GCP Professional Data Engineer certification.
- Experience with modern data stack tools like dbt, Kafka, or Terraform.
- Exposure to ML pipelines, analytics engineering, or DataOps/DevOps methodologies.
- Why Join Us?
- Work with cutting-edge technologies in a fast-paced, collaborative environment.
- Lead cloud transformation initiatives at scale.
- Competitive compensation and benefits.
- Remote flexibility and growth opportunities.
Skills Required
- 5+ years in Data Engineering
- 2+ years of hands-on experience with GCP
- Experience migrating on-premise data systems to the cloud
- Development experience with Apache Airflow, Python, and Apache Spark
- SQL development skills and BigQuery performance tuning
Brillio Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Brillio and has not been reviewed or approved by Brillio.
-
Healthcare Strength — Healthcare is considered comprehensive, including medical coverage for employees and dependents alongside life, disability, and accidental death protections. Feedback suggests these protections are a core strength of the package.
-
Leave & Time Off Breadth — Time-off options include paid leave and parental leave, with flexible or ‘flexible PTO’ approaches cited in some contexts. Feedback suggests this breadth helps support work-life balance when team norms permit usage.
-
Wellbeing & Lifestyle Benefits — Wellbeing offerings span counseling, financial-management sessions, fitness programs, and travel insurance, plus region-specific extras like discounted IT hardware and work-from-home essentials. Feedback suggests these add-ons enhance perceived value beyond core insurance.
Brillio Insights
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Brillio is the leader in global digital business transformation, applying technology with a human touch. We help businesses define internal and external transformation objectives, and translate those objectives into actionable market strategies using proprietary technologies. With 2600+ experts and 13 offices worldwide, Brillio is the ideal partner for enterprises that want to quickly increase their core business productivity, and achieve a competitive edge, with the latest digital solutions.
