AI Product Testing Engineer

Posted 2 Days Ago
San Francisco, CA, USA
In-Office
120K-200K Annually
Mid level
Artificial Intelligence • Software • Cybersecurity • Generative AI
The Role
Design, execute, and automate test plans for product features and backend systems. Perform model evaluations and red-teaming for AI security, build system-level tests for APIs and data pipelines, optimize CI/CD and testing infrastructure, and collaborate with backend, ML, infra teams and customers to align testing with product needs.
Summary Generated by Built In

Testing Engineer (Product & Back-End Focus)

Location: San Francisco, CA (Onsite | Hybrid)

About Virtue AI

Virtue AI sets the standard for advanced AI security platforms. Built on decades of foundational and award-winning research in AI security, its AI-native architecture unifies automated red-teaming, real-time multimodal guardrails, and systematic governance for enterprise apps and agents. We are a well-funded, early-stage startup founded by industry veterans, and we're looking for passionate builders to join our core team.

What You’ll Do

As a Testing Engineer, you will be responsible for ensuring the functionality, reliability, and quality of our proprietary AI platform, focusing on both product features and backend systems. Your work will involve traditional QA/system testing combined with cutting-edge AI security validation.

You will:

  • Design and execute comprehensive test plans for new product features, focusing on end-to-end functionality and user experience.

  • Develop and automate system-level test cases for backend APIs, data pipelines, and platform reliability.

  • Contribute to the optimization of the overall testing platform and CI/CD pipelines.

  • Perform comprehensive model evaluations and analyze the results to ensure robust product behavior.

  • Apply and develop core techniques for agent and model red-teaming, including designing new red-teaming methods to discover security vulnerabilities.

  • Collaborate closely with backend, ML, and infra teams to align testing strategy with product requirements and deployment realities.

  • Communicate with customers to understand customer requirements and be involved in product planning and management.

What Makes You a Great Fit

You’ll thrive in this role if you’re excited by new technology, love solving customer problems, and can comfortably bridge the business and technical worlds.

Required Qualifications

  • Bachelor’s degree in CS, CE, EE, or a related field.

  • Proficiency in programming languages such as Python.

  • Strong experience in software testing (especially AI-related software) methodologies, including test case design, automation, and defect tracking.

  • Deep experience with backend testing, including API testing (e.g., REST/gRPC) and performance testing.

  • Experience with containerization and deployment tools like Docker and Kubernetes.

  • Strong problem-solving skills and effective communication abilities.

Preferred Qualifications

  • Experience developing LLM-related and AI agent-related products.

  • Hands-on experience in back-end (Go, C/C++) or front-end development (Node.js, Typescript).

  • Familiarity with LLM libraries like PyTorch, HuggingFace, or agent development kits.

  • Enthusiasm for thriving in a fast-paced startup environment.

Why Join Virtue AI

  • Competitive base salary compensation + equity commensurate with skills and experience.

  • Impact at scale – Help define the category of AI security and partner with Fortune 500 enterprises on their most strategic AI initiatives.

  • Work on the frontier – Engage with bleeding-edge AI/ML and deploy AI security solutions for use cases that don't yet exist anywhere else.

  • Collaborative culture – Join a team of builders, problem-solvers, and innovators who are mission-driven and collaborative.

  • Opportunity for growth – Shape not only our customer engagements, but also the processes and culture of an early lean team with plans for scale.

Equal Opportunity Employment

Virtue AI is an Equal Opportunity Employer. We welcome and celebrate diversity and are committed to creating an inclusive workplace for all employees. Employment decisions are made without regard to race, color, religion, sex, gender identity or expression, sexual orientation, marital status, national origin, ancestry, age, disability, medical condition, veteran status, or any other status protected by law.

We also provide reasonable accommodations for applicants and employees with disabilities or sincerely held religious beliefs, consistent with legal requirements.

Skills Required

  • Bachelor's degree in Computer Science, Computer Engineering, Electrical Engineering, or related field
  • Proficiency in Python
  • Strong experience in software testing methodologies including test case design, automation, and defect tracking
  • Deep experience with backend testing including API testing (REST/gRPC) and performance testing
  • Experience with containerization and deployment tools such as Docker and Kubernetes
  • Experience developing and automating system-level test cases for backend APIs, data pipelines, and CI/CD pipelines
  • Strong problem-solving skills
  • Effective communication abilities
  • Experience developing LLM-related and AI agent-related products
  • Hands-on experience in back-end (Go, C/C++) or front-end development (Node.js, TypeScript)
  • Familiarity with LLM libraries like PyTorch, HuggingFace, or agent development kits
  • Enthusiasm for working in a fast-paced startup environment
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
44 Employees

What We Do

Virtue AI is an AI-native security, compliance, and governance platform dedicated to building scalable, trustworthy, and responsible AI systems. Its architecture unifies automated red-teaming, real-time multimodal guardrails, and policy-driven governance to safeguard enterprise agents, models, and apps across text, code, image, video, and audio in over 100 languages, detecting risks in sub-10 ms.

Similar Jobs

MetLife Logo MetLife

Customer Care Advocate AMS Service - Omaha, NE 9.21.26 - 18275

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote or Hybrid
United States
43000 Employees
42K-42K Annually

MetLife Logo MetLife

Customer Care Advocate Disability Intake - Cary, NC 9.14.26 - 18272

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote or Hybrid
United States
43000 Employees
42K-42K Annually

MetLife Logo MetLife

Customer Care Advocate Disability Intake - Cary, NC 9.21.26 - 18274

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote or Hybrid
United States
43000 Employees
42K-42K Annually
Remote or Hybrid
United States
240 Employees
210K-275K Annually

Similar Companies Hiring

Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
LTX Thumbnail
Conversational AI • Generative AI
Jerusalem, Israel
360 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account