The Role
Design and own a multi-petabyte GCP lakehouse and medallion data platform architecture. Define ingestion, transformation, governance, cataloging, security, and analytics-serving layers; guide legacy ETL migration; evaluate data tooling; review engineering work; and present architecture decisions to technical, executive, and security stakeholders.
Summary Generated by Built In
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!
ABOUT THE ROLE
We are looking for a Solution Architect to lead the technical design of a large-scale GCP data platform for an enterprise telecommunications client. You will define a lakehouse and medallion architecture using BigQuery, Dataflow, and Pub/Sub, working as an independent technical voice alongside senior client architects. The role starts part-time and scales to full-time.
WHAT YOU WILL DO
- Design and own the target-state lakehouse/medallion architecture for a multi-petabyte GCP data platform (BigQuery, GCS, Dataflow, Pub/Sub) supporting thousands of pipelines and hundreds of thousands of tables.
- Translate transformation goals into scalable, secure architecture decisions and delivery roadmaps, working directly with architects and engineering leadership.
- Define architecture for ingestion, transformation, curation, dataset registration/cataloging, governance, and analytics-serving layers (BigQuery as serving layer, dbt/Looker for transformation and reporting).
- Advise on migration strategy for legacy ETL pipelines — including undocumented, proprietary legacy tooling — into modern GCP-native or open lakehouse patterns.
- Evaluate and help select ingestion/transformation tooling (e.g. Fivetran, dbt, Airflow/Composer, NiFi) as part of ongoing technology proofs of concept.
- Define data governance and cataloging strategy aligned with GCP's native catalog capabilities (e.g. Dataplex, BigQuery universal catalog), including metadata, lineage, and access-control design.
- Act as senior technical reviewer for the squad's engineers, ensuring architectural consistency, security compliance, and long-term maintainability.
- Present and validate architecture decisions to executives, enterprise architecture teams, and security stakeholders.
- Operate within a controlled toolchain and security constraints, including approved AI-assisted development environments.
MUST HAVES
- 10+ years of experience in data architecture, solution architecture, or enterprise systems architecture.
- Strong, hands-on experience architecting data platforms on Google Cloud Platform (BigQuery, Dataflow, Pub/Sub, GCS) at enterprise / multi-petabyte scale.
- Proven experience designing lakehouse or medallion architectures (bronze/silver/gold layering or equivalent).
- Experience defining enterprise data governance frameworks — data quality, lineage, metadata management, access controls, cataloging.
- Experience advising on or leading migration of legacy ETL/data platforms to modern cloud-native architectures.
- Strong understanding of data ingestion and transformation tooling such as Fivetran, dbt, Apache Airflow/Composer.
- Experience working directly with enterprise clients as a trusted technical advisor, able to challenge and be challenged by client architects rather than simply execute a defined scope.
- Comfortable operating inside a large, security-conscious enterprise with a controlled toolchain, including adapting to approved rather than personally preferred AI-assisted development tools.
- Excellent communication and presentation skills — able to explain complex architecture to technical, business, and executive audiences.
- Fluent English, comfortable in a client-facing role daily.
- Willingness to travel occasionally (a few days at a time) to the UK office.
NICE TO HAVES
- Experience with BigLake / Iceberg-based lakehouse patterns.
- Experience with Google Dataplex or BigQuery's universal data catalog.
- Familiarity with legacy ETL platforms such as Ab Initio, Informatica, or similar proprietary tools, particularly reverse-engineering pipelines built on them.
- Experience with AI-assisted, spec-driven development tools such as Amazon Kiro or comparable environments.
- Telecommunications sector experience (not required, but relevant given the scale).
- Google Cloud certification (Professional Data Engineer / Professional Cloud Architect).
- Experience working within Scrum/SAFe delivery frameworks.
PERKS AND BENEFITS
- Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
- Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.
- A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.
- Flextime: Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.
Meet Our Recruitment Process
Application → Coding Challenge → Video Interview → Technical Interview or Hiring Manager Interview
Each step helps us understand your skills and overall fit.
If it’s a match, you’ll receive an offer.
Skills Required
- 10+ years of experience in data architecture, solution architecture, or enterprise systems architecture
- Hands-on experience architecting enterprise-scale GCP data platforms using BigQuery, Dataflow, Pub/Sub, and Google Cloud Storage
- Experience designing lakehouse or medallion architectures
- Experience defining enterprise data governance frameworks covering data quality, lineage, metadata, access controls, and cataloging
- Experience advising on or leading migrations from legacy ETL or data platforms to modern cloud-native architectures
- Strong understanding of Fivetran, dbt, and Apache Airflow or Cloud Composer
- Experience working directly with enterprise clients as a trusted technical advisor
- Ability to work within security-conscious enterprise environments and controlled toolchains
- Excellent communication and presentation skills for technical, business, and executive audiences
- Fluent English and ability to work in a daily client-facing role
- Willingness to travel occasionally to the UK office
- Experience with BigLake or Iceberg-based lakehouse patterns
- Experience with Google Dataplex or BigQuery universal data catalog
- Familiarity with Ab Initio, Informatica, or similar proprietary legacy ETL platforms
- Experience with AI-assisted, spec-driven development tools such as Amazon Kiro
- Telecommunications sector experience
- Google Cloud Professional Data Engineer or Professional Cloud Architect certification
- Experience with Scrum or SAFe delivery frameworks
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
AgileEngine is a privately held company established in 2010 that builds dedicated teams of designers and developers. We turn good ideas into awesome software that people actually want to use. Some of the biggest names and the hottest startups around the world chose us to build their tech.
