Software QA Analyst

Posted Yesterday
Be an Early Applicant
Zionsville, IN, USA
In-Office
Junior
Insurance
The Role
Test and validate an LLM agent runtime and its supporting services by writing and maintaining API and integration test cases, reviewing agent outputs for accuracy, identifying failure patterns, owning tickets end-to-end, and driving fixes and guardrail improvements with the platform team.
Summary Generated by Built In

Group 1001 is a consumer-centric, technology-driven family of insurance companies on a mission to deliver outstanding value and operational performance by combining financial strength and stability with deep insurance expertise and a can-do culture. Group1001’s culture emphasizes the importance of collaboration, communication, core business focus, risk management, and striving for outcomes. This goal extends to how we hire and onboard our most valuable assets – our employees.

Why This Role Matters: 

 

We're building an agentic platform — an LLM agent runtime that reviews code, writes tests, and builds from tickets on real development repos — alongside the services that power it: a control plane that orchestrates agent runs, an intake registry that routes work requests through to automated fulfilment, and the integrations that tie them together. Someone has to make sure all of it actually works. This role owns that question across the stack — from "did the agent's code review make sense?" to "did the API return the right thing?" to "did the end-to-end flow complete without dropping state." You're the signal between what we ship and what's actually good. 

 

How You'll Contribute: 

 

  • Test the services we build — control plane APIs, intake registry, agent dispatch flows, webhook integrations — at the API and integration level. 
  • Review agent output — code review comments, generated tests, draft MRs — and assess accuracy, relevance, and quality against the codebase and context. 
  • Write and maintain test cases and evaluation criteria: API contracts, end-to-end flows, agent output quality for each agent type (reviewer, tester, builder). 
  • Identify failure patterns across the stack: broken API responses, dropped state, hallucinations, missed issues, bad diffs. Log them clearly. 
  • Work with the platform team to translate findings into fixes, guideline improvements, and guardrail changes. 
  • Own tickets end-to-end: test plan → findings → documented change → verified improvement. 
  • Sit in on design reviews; help define what "done well" looks like before work ships. 

 

What We're Looking For: 

 

  • 1-3 years of professional experience with software testing, QA tooling, or API test automation (Postman, pytest, httpx, or similar).
  • Attention to detail and the ability to read code across at least one language (Python or TypeScript preferred). 
  • Comfortable with Git, HTTP/REST APIs, basic SQL, and Linux shell. 
  • Writes things down clearly — test cases, failure patterns, improvement proposals. 
  • Asks questions and communicates what's wrong without waiting to be asked. 

Nice-to-haves (all optional):

  • Familiarity with LLMs or AI agents
  • Python or TypeScript · any CI/CD exposure
  • AWS basics (ECS, CloudWatch, Secrets Manager)

 

What you'll gain:

Ground-floor experience on a production agentic platform and the services behind it, a direct line between your findings and what ships, a senior mentor, growth path to a QA or product engineering role, paid AWS cert if wanted. 

 

Benefits Highlights:  

Employees who meet benefit eligibility guidelines and work 30 hours or more weekly, have the ability to enroll in Group 1001’s benefits package. Employees (and their families) are eligible to participate in the Company’s comprehensive health, dental, and vision insurance plan options.  Employees are also eligible for Basic and Supplemental Life Insurance, Short and Long-Term Disability. All employees (regardless of hours worked) have immediate access to the Company’s Employee Assistance Program and wellness programs—no enrollment is required.  Employees may also participate in the Company’s 401K plan, with matching contributions by the Company.

 

Group 1001, and its affiliated companies, is strongly committed to providing a supportive work environment where employee differences are valued. Diversity is an essential ingredient in making Group 1001 a welcoming place to work and is fundamental in building a high-performance team. Diversity embodies all the differences that make us unique individuals.  All employees share the responsibility for maintaining a workplace culture of dignity, respect, understanding and appreciation of individual and group differences.

Skills Required

  • 1-3 years professional experience with software testing, QA tooling, or API test automation (Postman, pytest, httpx, or similar)
  • Ability to read code in at least one language (Python or TypeScript preferred)
  • Familiarity with Git
  • Experience testing HTTP/REST APIs
  • Basic SQL knowledge
  • Comfortable with Linux shell
  • Clear written communication of test cases, failure patterns, and improvement proposals
  • Proactive communication and asking questions; ownership of test plans and verification
  • Familiarity with LLMs or AI agents
  • CI/CD exposure
  • AWS basics (ECS, CloudWatch, Secrets Manager)

Group 1001 Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Group 1001 and has not been reviewed or approved by Group 1001.

  • Fair & Transparent Compensation Pay is considered competitive for many specialized and senior roles, with employer-posted salary ranges providing clarity for candidates. Job postings indicate market-aligned compensation in several corporate, tech, and sales functions.
  • Leave & Time Off Breadth Time off is portrayed as generous, including paid holidays and multiple leave types alongside hybrid work options for eligible roles. Some positions also offer remote flexibility that supports overall work–life balance.
  • Retirement Support Retirement offerings include a 401(k) with company matching and are emphasized as a core part of total rewards. Certain postings reference immediate vesting, reinforcing attention to long-term savings.

Group 1001 Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Indianapolis, IN
184 Employees
Year Founded: 2013

What We Do

Group 1001 Insurance Holdings, LLC (“Group 1001”) is an insurance holding company in the United States, with current combined assets under management of approximately $57.5 billion as of June 30, 2022, and a mission for setting a new standard in the insurance industry by making insurance more useful and intuitive for everyone. Group 1001 is a long-standing, nimble, and tech-driven financial services enterprise established on deep industry expertise and reliable delivery of long-term value through empowering its customers, employees, and communities. Leveraging upon its record of building successful businesses and strong operating fundamentals, Group 1001 powers the next generation of insurance businesses with useful and intuitive solutions and products accessible to everyone. Group 1001 invests in strategic partnerships as part of our mission to transform communities through sports and education. Group 1001 and our subsidiaries have a strong commitment to service and community transformation. Education and sports initiatives, coupled with impactful partnerships, allow Group 1001 to improve lives through positive change in our communities. Learn more at Group1001.com.

Similar Jobs

Zscaler Logo Zscaler

Senior Director, Public Sector Sales Operations

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
USA
8697 Employees
232K-290K Annually

Pluralsight Logo Pluralsight

Director Analytics Engineering

Edtech • Information Technology • Software
Remote or Hybrid
USA
1000 Employees
167K-220K Annually

CSC Logo CSC

Associate Tax Research Specialist

Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Remote or Hybrid
2 Locations
8500 Employees
58K-73K Annually

Domino Data Lab Logo Domino Data Lab

Architect

Artificial Intelligence • Machine Learning
Easy Apply
Remote or Hybrid
US
200 Employees
180K-220K Annually

Similar Companies Hiring

Globe Life Thumbnail
Insurance • Financial Services
McKinney, TX
3000 Employees
MassMutual India Thumbnail
Big Data • Fintech • Information Technology • Insurance • Financial Services
Hyderabad, Telangana
Granted Thumbnail
Mobile • Insurance • Healthtech • Financial Services • Artificial Intelligence
New York, New York
23 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account