AI Data Engineer, Data Platform

Posted 6 Days Ago
San Francisco, CA, USA
Hybrid
180K-230K Annually
Senior level
Fintech • Software
The Role
Own and scale Collective’s data platform by building reliable batch and event-driven pipelines into BigQuery, modeling data with dbt, and enforcing quality, observability, security, and cost standards. Partner with engineers, analysts, and business stakeholders to deliver trustworthy datasets, metrics, reporting, and AI-enabled warehouse access. The role includes production ownership, incident response, governance, infrastructure practices, and support for analytics and LLM-based tools.
Summary Generated by Built In

About Collective:

Collective is on a mission to redefine the way businesses-of-one work. Our technology and team of trusted advisors help members achieve financial independence by taking care of everything from business incorporation to accounting, bookkeeping, tax services, and access to a thriving community, all in one integrated platform. We believe in empowering self-employed people to enjoy the same tax savings that big companies get, so they can focus on their passion, not paperwork.

Featured in Forbes, Business Insider, Yahoo, Bloomberg, Financial Times, TechCrunch, and more. We are backed by General Catalyst, Sound Ventures, QED Investors, Google’s Gradient Ventures, Expa, and other investors who have financed iconic companies like YouTube, Substack, Twitch, Box, Hims, Instacart, and Lyft.

About the role:

We are looking for a Data Engineer to own and scale the data platform that powers analytics, reporting, and AI across Collective. You will design, build, and maintain the pipelines that move data from our product, financial, and third-party systems into our BigQuery warehouse; model that data into clean, well-documented, reliable tables; and set the engineering standards that keep the platform trustworthy as the company grows.

You will join the Data Engineering team within Engineering and work closely with product engineers, analysts, and business stakeholders across Operations, Finance, and Go-to-Market. This is a hands-on role for someone who cares about data quality, takes ownership of production systems end-to-end, and wants their work to be the foundation the rest of the company builds on.

What you'll do: 

  • Design and build data pipelines. Develop, deploy, and maintain scalable batch and event-driven pipelines that ingest data from application databases, SaaS tools, and external APIs into BigQuery using managed connectors (Fivetran), custom Python loaders, and orchestration tooling.

  • Model the data. Design and implement dimensional and analytical data models in dbt, following a layered architecture (raw, staging, marts) with clear grain, naming conventions, and documentation that analysts and downstream tools can rely on.

  • Own data quality and reliability. Implement testing, monitoring, alerting, and data contracts across the pipeline; define and meet freshness and accuracy SLAs; triage and resolve pipeline failures and data incidents to root cause.

  • Optimize performance and cost. Tune warehouse queries, partitioning, and clustering; manage BigQuery spend; and keep pipelines efficient as data volume grows.

  • Establish engineering standards. Drive best practices for version control, code review, CI/CD, and infrastructure-as-code across the data stack; document systems and runbooks so the platform is maintainable by the team.

  • Govern and secure data. Implement access controls, PII handling, and data retention practices appropriate for a financial services company; partner with Security and Legal on compliance requirements.

  • Enable the business. Partner with product engineers on source schema design and change management, and with analysts and stakeholders to translate business questions into reliable datasets, metric definitions, and self-serve reporting in Metabase.

  • Support AI and analytics use cases. Maintain the semantic layer, metric definitions, and documentation that allow LLM-based tools and internal agents to query the warehouse accurately and consistently.

What you'll bring:

  • Experience: 5+ years of professional experience in data engineering, analytics engineering, or a closely related role, ideally at a B2B SaaS or fintech company.

  • SQL and Python: Expert-level SQL and strong Python skills for building pipelines, transformations, and tooling; comfortable writing tested, production-grade code.

  • Modern data stack: Hands-on production experience with a cloud data warehouse (BigQuery strongly preferred), dbt or equivalent transformation framework, managed ingestion tools (Fivetran or similar), and an orchestrator (Airflow, Dagster, Cloud Composer, or similar).

  • Data modeling: Deep understanding of dimensional modeling, layered warehouse architecture, and schema design, with strong opinions on grain, naming, and consistency.

  • Data quality and observability: Experience implementing testing frameworks, lineage, monitoring, and alerting for data pipelines, and operating them in production including on-call.

  • Engineering fundamentals: Fluency with git-based workflows, code review, CI/CD, and infrastructure-as-code; you treat data infrastructure as software.

  • Ownership: A track record of taking ambiguous, high-impact problems and delivering reliable systems end-to-end, with a focus on outcomes rather than just implementation.

  • Communication: Ability to explain technical trade-offs to non-technical stakeholders and drive alignment on data definitions across teams.

Nice to have:

  • Experience with streaming or event data (Pub/Sub, Kafka, or similar) and product analytics tooling (Amplitude or similar).

  • Experience with Terraform and Google Cloud Platform infrastructure.

  • Experience with observability platforms such as Datadog.

  • Exposure to financial, accounting, tax, or payroll data and the correctness requirements that come with it.

  • Experience building semantic layers or metric stores consumed by LLM-based tools, or supporting LLM evaluation programs.

  • AI-assisted development experience (Claude Code or similar).

What we offer:

  • Hybrid Work Model: Based in San Francisco with a balance of in-office and remote flexibility.

  • Fresh Lunch: Provided on in-office days.

  • Commuter Support: $150 monthly reimbursement for transit expenses.

  • Health & Wellness: $200 quarterly reimbursement to support your well-being.

  • Time Off: Flexible PTO plus 14 company holidays.

  • Comprehensive Coverage: 100% medical, dental, and vision for employees; 75% coverage for dependents.

  • Parental Leave: 16 weeks fully paid.

  • Retirement & Ownership: 401k plan plus an equity package.

  • Team Connection: Quarterly virtual events and an annual in-person summit.

Skills Required

  • 5+ years of professional experience in data engineering, analytics engineering, or a closely related role
  • Expert-level SQL skills
  • Strong Python skills for production pipelines, transformations, and tooling
  • Production experience with a cloud data warehouse; BigQuery strongly preferred
  • Experience with dbt or an equivalent transformation framework
  • Experience with managed ingestion tools such as Fivetran or similar
  • Experience with an orchestration tool such as Airflow, Dagster, Cloud Composer, or similar
  • Deep understanding of dimensional modeling, layered warehouse architecture, and schema design
  • Experience implementing data testing, lineage, monitoring, and alerting
  • Experience operating data pipelines in production, including on-call support
  • Fluency with Git-based workflows, code review, CI/CD, and infrastructure as code
  • Track record of owning ambiguous, high-impact problems and delivering reliable systems end to end
  • Ability to explain technical trade-offs to nontechnical stakeholders and align teams on data definitions
  • Experience with streaming or event data, such as Pub/Sub or Kafka
  • Experience with product analytics tooling such as Amplitude
  • Experience with Terraform and Google Cloud Platform infrastructure
  • Experience with observability platforms such as Datadog
  • Exposure to financial, accounting, tax, or payroll data
  • Experience building semantic layers or metric stores for LLM-based tools
  • Experience supporting LLM evaluation programs
  • AI-assisted development experience, such as Claude Code
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
229 Employees
Year Founded: 2020

What We Do

Collective is on a mission to redefine the way Businesses-of-One work. Collective is the first online concierge financial platform designed to give self-employed people the technology and team they need so they can focus on their passion, not their paperwork. Collective handles company formation, taxes, accounting, bookkeeping, and more.

Similar Jobs

Riot Games Logo Riot Games

Application Engineer

eCommerce • Gaming
In-Office
Los Angeles, CA, USA
4500 Employees

CrowdStrike Logo CrowdStrike

Staff Engineer

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
USA
11000 Employees
195K-290K Annually

Zoox Logo Zoox

Platform Engineer

Artificial Intelligence • Machine Learning • Robotics • Software • Transportation • Design • Manufacturing
Hybrid
Foster City, CA, USA
2900 Employees
230K-277K Annually

Axiamatic, Inc. Logo Axiamatic, Inc.

Software Engineer

Artificial Intelligence • Software • Generative AI
In-Office
Menlo Park, CA, USA
89 Employees

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account