Databricks QA Engineer

Posted Yesterday
Hiring Remotely in United States
Remote
70-80 Hourly
Senior level
Artificial Intelligence • Information Technology • Machine Learning • Generative AI • Big Data Analytics
We Unify. We Elevate. We Foresee
The Role
Own quality strategy and release sign-off for enterprise Databricks data platforms. Build Python and PySpark test suites with pytest, validate ingestion and Medallion transformations, implement data quality rules, test Delta Lake and ELT workflows, and maintain CI quality gates that block failed releases. Partner with data engineers and customers to improve automation coverage and prevent production data errors.
Summary Generated by Built In
About V4C

V4C is a pure-play Databricks partner, and in under two years we have earned 850+ Databricks certifications across 325+ customers and been named Databricks' 2026 Partner of the Year (C&SI Emerging).

As a Databricks QA Engineer on our data engineering team you will own the quality gate for enterprise data platforms, working directly with customers. You will work on live enterprise data platforms alongside one of the most heavily Databricks-certified delivery teams in the market.

The Role

This is a QA role for people who understand data engineering, not general software QA pointed at a data project. You will validate Lakehouse pipelines, which means reasoning about row counts, schema drift, late-arriving data, and silent transformation errors no UI will ever surface. Our approach is automation-first: suites in Python and PySpark, running in CI, blocking promotion when they fail. You own release sign-off, which makes you the last person between a customer and bad data in production. 

Responsibilities

  • Own test strategy and release sign-off on engagements, including documented test plans covering scope, risk, and coverage
  • Build and maintain automated test suites in Python and PySpark (pytest), integrated into CI pipelines
  • Validate data pipelines end to end: ingestion, Medallion layer transformations, Delta Lake tables, and ELT workflows
  • Implement data quality rules as code, including Lakeflow expectations and reusable validation frameworks
  • Run regression validation after code changes and maintain CI quality gates that block merge or promotion on failure
  • Partner with engineers to identify automation candidates and raise the coverage bar across the practice

Requirements
  • 5+ years in QA automation or test engineering, including meaningful time testing data pipelines rather than applications alone
  • A data engineering background: you can read a pipeline, reason about a transformation, and write the SQL to verify it
  • Expert-level SQL
  • Experience with Medallion architecture, Delta Lake, and ELT-based data platforms
  • Experience building automated suites that run in CI and gate deployment
  • Demonstrable hands-on experience working on Databricks or similar platforms

Preferences

  • Healthcare or life sciences experience preferred but not required
  • Existing Databricks certification(s)
  • Hands-on experience with Unity Catalog, Lakeflow pipelines, or Databricks Asset Bundles
  • Experience with Azure DevOps pipelines, or equivalent CI tooling (GitHub Actions, GitLab CI)
  • Familiarity with contract-based data validation standards such as ODCS
  • Experience using LLM agents or MCP-connected tooling to run validations, triage failures, or draft defect reports
  • Consulting or client-facing background

Benefits

Pay Rate: $70 – $80 per hour (1099 independent contractor).

This is a contract engagement rather than a salaried employee role. Where a rate lands within the range depends on depth of data-pipeline testing experience and automation capability. Open to contractors anywhere in the United States.

Skills Required

  • 5+ years of experience in QA automation or test engineering, including meaningful experience testing data pipelines
  • Data engineering background, including the ability to read pipelines, reason about transformations, and write SQL for verification
  • Expert-level SQL
  • Experience with Medallion architecture, Delta Lake, and ELT-based data platforms
  • Experience building automated test suites that run in CI and gate deployment
  • Hands-on experience with Databricks or similar platforms
  • Healthcare or life sciences experience
  • Existing Databricks certifications
  • Hands-on experience with Unity Catalog, Lakeflow pipelines, or Databricks Asset Bundles
  • Experience with Azure DevOps pipelines or equivalent CI tooling such as GitHub Actions or GitLab CI
  • Familiarity with contract-based data validation standards such as ODCS
  • Experience using LLM agents or MCP-connected tooling for validations, failure triage, or defect reports
  • Consulting or client-facing background

v4c.ai Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about v4c.ai and has not been reviewed or approved by v4c.ai.

  • Flexible Benefits — Flexible work arrangements, including remote-first and hybrid options, are highlighted across roles and company materials. Flexibility is positioned as part of the benefits package supporting work–life balance.
  • Wellbeing & Lifestyle Benefits — Wellbeing offerings such as wellness programs and regular social events are explicitly called out. These lifestyle benefits are framed as supporting employee happiness.
  • Healthcare Strength — Comprehensive health insurance plans are stated as part of the package. Health coverage is presented as a core benefit alongside wellness support.

v4c.ai Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Scottsdale, AZ
142 Employees

What We Do

v4c.ai is a premier IT services consultancy specializing in Databricks to help organizations unlock the full potential of their data. We partner with enterprises to accelerate their journey to becoming data-driven by delivering end-to-end Databricks services across Lakehouse implementation, data engineering, AI/ML, and governance. Our expertise in integration, optimization, and enablement empowers clients to unify disparate data sources, modernize analytics, and build AI-ready platforms. By aligning Databricks capabilities with strategic business goals, we help organizations achieve faster insights, stronger competitive advantage, and scalable innovation.

Similar Jobs

Motive Logo Motive

Sales Leadership Trainer

Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Easy Apply
Remote
United States
4000 Employees
161K-201K Annually

Samsara Logo Samsara

AVP, Federal Sales

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
United States
4000 Employees
440K-550K Annually

Toast Logo Toast

Consultant

Cloud • Fintech • Food • Information Technology • Software • Hospitality
Remote
US
5000 Employees
93K-149K Annually

GitLab Logo GitLab

Senior Candidate Experience Specialist, AMER

Cloud • Security • Software • Cybersecurity • Automation
Easy Apply
Remote
2 Locations
2500 Employees
54K-91K Annually

Similar Companies Hiring

Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account