Software Quality Engineer

Posted 2 Days Ago
Be an Early Applicant
Franklin, TN, USA
In-Office
77K-104K Annually
Mid level
Information Technology • Legal Tech • Professional Services
The Role
Own quality for a product area through risk-based test strategy, exploratory testing, automation, CI integration, defect management, and release sign-off. Evaluate LLM-based features using golden datasets, precision and recall thresholds, human-label comparisons, adversarial cases, and prompt-injection tests. Collaborate with engineers and product teams to improve acceptance criteria and testability. The role requires coding, strong SQL, automated testing, and familiarity with Python/Django, React, PostgreSQL, and modern cloud environments.
Summary Generated by Built In

Zipliens is a leading lien resolution company that specializes in streamlining the lien process for personal injury law firms. Our work helps law firms operate more efficiently and helps the injured people they serve access settlement funds more quickly and accurately. We are looking for a quality engineer who is passionate about building the testing and evaluation that keeps complex, data-heavy products working correctly at scale.

Zipliens is looking for a Quality Engineer to join our team and own quality for a product area within the applications we build for the legal industry. After several years of high growth, Zipliens has become a leader in lien resolution, a process required in most personal injury settlements. The software we build supports that work, so the quality of what we ship has a clear, real-world impact on law firms and the people they represent.

We're scaling engineering significantly this year, and quality engineering is growing along with it. QA at Zipliens is embedded in the engineering teams and combines exploratory testing with automation. You'd own quality for a feature or product area, including the test strategy, the automation behind it, and the release sign-off for that area. You'll have established patterns and existing test suites to work from, and you'll help improve them as the team grows.

We also build with AI as a first-class part of the workflow, and that applies to testing as much as to development. Our product uses LLMs to extract structure from medical records and lien correspondence, so evaluating non-deterministic output is a regular part of the job. We also use agentic coding tools and internal skills and harnesses we've written ourselves to build and maintain automation, and you'd be expected to use those tools well, review what they produce, and help improve them.


RequirementsResponsibilities:
  • Own quality for a feature or product area, including the risk-based test strategy, the regression scope, and the release sign-off for that area.
  • Build and maintain the automated test suites for your area and keep them integrated with CI. When tests fail or become flaky, you'll troubleshoot them and fix the underlying cause.
  • Run exploratory testing against the lien workflow and develop a detailed understanding of the applications your team owns, including their risk areas and failure modes.
  • Test our LLM-based features. This includes building the evaluation suite for a feature, setting acceptance thresholds with product (for example, precision and recall targets for extraction), checking LLM-judge agreement against human labels, and adding adversarial and prompt-injection cases.
  • Use agentic coding tools to build and maintain automation, and review AI-generated tests before they merge.
  • Join refinement early enough to shape Acceptance Criteria with the Product Owner, flag testability gaps before development starts, and recommend coverage and risk priorities for your area.
  • Shepherd defects for your area from triage through resolution, writing clear, reproducible reports that engineers can act on.
  • Work directly with the engineers on your team day to day. QA at Zipliens is embedded in the engineering teams rather than run as a separate function.
Qualifications:
  • 3+ years on a QA or software development team, including experience owning test coverage for a feature or product area.
  • Strong skills in at least one of exploratory testing and test design, test automation and infrastructure, or AI/LLM evaluation, with working proficiency in a second. We don't expect the same depth in all three.
  • Hands-on experience building and maintaining automated test suites in a modern framework (Playwright, Cypress, pytest, or similar), including diagnosing flaky tests and fixing their root causes.
  • Comfortable reading and writing code. Our backend is Python/Django and our frontend is React, and you should be able to read a change in either and understand what it affects and what it puts at risk.
  • Experience integrating tests into CI pipelines and deciding which checks should gate a merge or a deploy.
  • Strong SQL. Much of what we test lives in PostgreSQL, and verifying a workflow often means verifying the data it produced as well as what the UI shows.
  • Hands-on experience testing LLM or ML features, whether in production or through prototypes and experimentation: building golden datasets, measuring output quality, and understanding how these systems fail.
  • Experience using or experimenting with agentic coding tools, and good judgment about when their output needs a closer look.
  • Clear written communication. You'll be writing defect reports, test plans, and release sign-offs for engineers and product, and explaining risk to non-technical stakeholders.
Nice to Have:
  • Experience testing document processing or extraction from unstructured data.
  • Experience testing third-party integrations, especially where the counterparty's documentation isn't solid and you need contract tests, sandboxes, or recorded fixtures to work around it.
  • Familiarity with AWS and Kubernetes. We have an SRE who owns the cluster - you won't be running it, but you'll be reading logs and working out where a failure happened in it.
  • Experience handling sensitive data such as PHI, or working under HIPAA-style requirements.

Benefits
  • Private Health Care Plan (Medical, Dental & Vision)
  • Company HSA contributions for HDHP participants
  • Flexible Spending Accounts (Health & Dependent Care)
  • Company-Paid Short-Term Disability Coverage
  • Voluntary Long-Term Disability, Life, AD&D, and Supplemental Coverage Options
  • 401(k) Plan with Company Match
  • Paid Time Off (Vacation, Sick Time & 10 paid Holidays)
  • Parental Leave

Pay Disclosure: The total base salary range for this role is $77,000 - $104,000 annually with an opportunity to earn a discretionary quarterly bonus. Final compensation will be determined based on skills and experience.

Work Authorization: Applicants must be authorized to work in the United States without the need for employer-sponsored visa support now or in the future.

Skills Required

  • 3+ years on a QA or software development team, including experience owning test coverage for a feature or product area
  • Strong skills in at least one of exploratory testing and test design, test automation and infrastructure, or AI/LLM evaluation, with working proficiency in a second
  • Hands-on experience building and maintaining automated test suites using Playwright, Cypress, pytest, or a similar modern framework
  • Experience diagnosing flaky tests and fixing their root causes
  • Ability to read and write code and understand risks in Python/Django or React changes
  • Experience integrating tests into CI pipelines and determining merge or deployment gating checks
  • Strong SQL skills and experience testing data in PostgreSQL
  • Hands-on experience testing LLM or ML features, including building golden datasets and measuring output quality
  • Experience using or experimenting with agentic coding tools and reviewing their output
  • Clear written communication for defect reports, test plans, release sign-offs, and risk explanations
  • Experience testing document processing or extraction from unstructured data
  • Experience testing third-party integrations using contract tests, sandboxes, or recorded fixtures
  • Familiarity with AWS and Kubernetes
  • Experience handling sensitive data such as PHI or working under HIPAA-style requirements
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Louisville, KY
51 Employees
Year Founded: 2018

What We Do

Zipliens is a leader in lien resolution, specializing in streamlining the lien process for personal injury law firms by providing efficient and compliant services that optimize firm productivity and benefit clients.

Similar Jobs

Fortive Logo Fortive

Quality Assurance Engineer

Hardware • Other • Software • Appliances • Industrial • Manufacturing
In-Office or Remote
2 Locations
13486 Employees

Alpaca Logo Alpaca

Senior Software Engineer

Fintech • Information Technology
In-Office or Remote
7 Locations
132 Employees

Findhelp Logo Findhelp

Implementation Manager

Cloud • Edtech • Healthtech • Mobile • Social Impact • Software • Data Privacy
Hybrid
Nashville, TN, USA
250 Employees

Findhelp Logo Findhelp

Senior Customer Success Manager

Cloud • Edtech • Healthtech • Mobile • Social Impact • Software • Data Privacy
Hybrid
Nashville, TN, USA
250 Employees

Similar Companies Hiring

Cravath, Swaine & Moore LLP Thumbnail
Legal Tech • Other • Professional Services
New York, NY
1200 Employees
VCA Animal Hospitals Thumbnail
Pet • Professional Services
Los Angeles, CA
35000 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account