Sr Data Engineer

Posted 21 Days Ago
Hiring Remotely in USA
Remote
Senior level
Artificial Intelligence • Big Data • Machine Learning
The Role
As a Senior Data Engineer, you will design and maintain scalable data pipelines, focusing on architecture, ingestion, storage, and analytics on GCP. You'll collaborate with stakeholders and optimize data structures for performance while ensuring adherence to data governance and compliance standards.
Summary Generated by Built In

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed.

Company Highlights:

Quantiphi has seen 2.5x growth YoY since its inception in 2013, we don’t just innovate—we lead. Headquartered in Boston, with 4000+ Quantiphi professionals across the globe. As an Elite/Premier Partner for Google Cloud, AWS, NVIDIA, Snowflake, and others, we’ve been recognized with:

  • 17x Google Cloud Partner of the Year awards in the last 8 years

  • 3x AWS AI/ML award wins

  • 3x NVIDIA Partner of the Year titles

  • 2x Snowflake Partner of the Year awards

  • We have also garnered Top analyst recognitions from Gartner, ISG, and Everest Group.

  • We offer first-in-class industry solutions across Healthcare, Financial Services, Consumer Goods, Manufacturing, and more, powered by cutting-edge Generative AI and Agentic AI accelerators.

  • We have been certified as a Great Place to Work for the third year in a row- 2021, 2022, 2023.

Be part of a trailblazing team that’s shaping the future of AI, ML, and cloud innovation. Your next big opportunity starts here.

About The Role
As a Senior Data Engineer, you will play a key role in designing, building, and maintaining scalable data pipelines that power analytics, insights, and business decision-making. You will work across both batch and streaming architectures, leveraging PySpark, SQL, and modern data engineering frameworks to deliver reliable, high-performance data solutions.
Key Responsibilities

  • Define and own the overall data architecture for ingestion, storage, transformation, and analytics on GCP (focused on BigQuery and Cloud Composer).
  • Design data modeling frameworks and best practices for structured and semi-structured insurance data (Policy, Claims, Billing).
  • Collaborate with Business Analysts to translate functional Guidewire requirements into conceptual and logical data models.
  • Work with Data Modelers and Data Engineers to define physical schemas, transformation strategies, and data lineage standards.
  • Design and oversee data ingestion architecture from Guidewire (staging, raw, curated layers) using SQL-based ELT pipelines.
  • Establish data governance, metadata management, and data quality frameworks for transparency and compliance.
  • Review and optimize BigQuery data structures (partitioning, clustering, query tuning, storage tiering).
  • Define naming conventions, security models (IAM/RLS), and access control standards for the data warehouse.
  • Ensure architecture alignment with cloud best practices for scalability, cost optimization, and maintainability.
  • Provide architectural direction and mentorship to the Data Engineering Lead, Data Modeler, and Data Engineers.
  • Partner with enterprise security and infrastructure teams to maintain compliance with data privacy regulations.

Required Skills and Experience

  • 10+ years of experience in data architecture/design with at least 6+ years on GCP.
  • Deep expertise in Google BigQuery data warehouse design and performance tuning.
  • Strong working knowledge of Cloud Composer (Airflow) and orchestration pipelines.
  • Solid understanding of insurance data structures, preferably from Guidewire systems (PolicyCenter, BillingCenter, ClaimsCenter).
  • Experience architecting enterprise-grade ELT frameworks and multi-layered data architectures (staging → raw → curated → analytics).
  • Hands-on proficiency in SQL and schema design for analytical environments (star/snowflake models).
  • Familiarity with data governance, cataloging, and metadata management.
  • Ability to lead technical teams and guide design decisions with both functional and technical stakeholders.

What is in it for you:

  • Be part of the fastest-growing AI-first digital transformation and engineering company in the world

  • Be a leader of an energetic team of highly dynamic and talented individuals

  • Exposure to working with fortune 500 companies and innovative market disruptors

  • Exposure to the latest technologies related to artificial intelligence and machine learning, data and cloud

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Top Skills

BigQuery
Cloud Composer
GCP
Pyspark
SQL
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Marlborough, MA
3,494 Employees
Year Founded: 2013

What We Do

Quantiphi is an award-winning AI-first digital engineering company driven by the desire to solve transformational problems at the heart of business. Quantiphi solves the toughest and complex business problems by combining deep industry experience, disciplined cloud, and data-engineering practices, and cutting-edge artificial intelligence research to achieve quantifiable business impact at unprecedented speed.

Similar Jobs

CertifID Logo CertifID

Senior Data Engineer

Legal Tech • Real Estate • Security • Software • Cybersecurity • PropTech
Easy Apply
Remote or Hybrid
2 Locations
130 Employees

LeafLink Logo LeafLink

Senior Data Engineer

Cannabis • eCommerce • Enterprise Web • Logistics • Payments • Software • Database
Easy Apply
Remote
United States
190 Employees
125K-155K Annually
Easy Apply
Remote
United States
350 Employees
141K-158K Annually

Inspiren Logo Inspiren

Senior Data Engineer

Artificial Intelligence • Hardware • Healthtech • Software
Easy Apply
In-Office or Remote
3 Locations
160 Employees
180K-200K Annually

Similar Companies Hiring

GC AI Thumbnail
Legal Tech • Artificial Intelligence
San Francisco, California
46 Employees
Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees
Bellagent Thumbnail
Artificial Intelligence • Machine Learning • Business Intelligence • Generative AI
Chicago, IL
20 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account