Responsibilities
- Lead quality efforts for complex features including AI powered call routing, inbound and outbound calling, and third party telephony integrations
- Design and execute comprehensive test strategies covering end-to-end workflows, integrations, and event driven systems
- Validate inbound call capture, recording, transcription, summarization, and downstream event notifications
- Test phone registration workflows, including business registration, A2P compliance, and SHAKEN/STIR related processesEnsure accuracy and reliability of AI generated conversations, call summaries, and data capture across varied scenarios
- Validate management applications used to configure call flows, routing logic, permissions, and reporting
- Identify edge cases related to dropped calls, transcription errors, AI confidence thresholds, and third party provider failures
- Contribute to and maintain QA documentation, standards, and the organizational knowledge base
- Partner with Product and Engineering to influence requirements, design decisions, and release readiness
- Drive continuous improvement by identifying gaps in processes, tooling, and test coverage
Qualifications
- Advanced expertise in manual testing methodologies and test case design for complex systems
- Strong experience testing APIs, webhooks, and third party integrations
- Solid understanding of telephony concepts such as call flows, call routing, IVR behavior, and voicemail
- Experience validating AI or ML assisted features, including non deterministic outputs and regression risks
- Ability to assess transcription accuracy, conversational intent recognition, and AI response quality
- Experience testing event driven architectures and downstream data delivery
- Familiarity with compliance driven workflows, auditability, and data traceability
- Strong analytical and problem solving skills with attention to detail
- Excellent written and verbal communication skills, including clear defect documentation
- Ability to influence development teams and advocate effectively for quality initiatives
Similar Jobs
What We Do
Filevine is case management software built for and inspired by real attorneys. As a fully-featured suite of tools, it comes ready to manage every part of a moving case. Assign tasks, upload files or images, monitor staff productivity, and communicate with your client directly from within their case file. Our software is built on the truth that every law firm functions differently. That’s why Filevine is so customizable. Build new case-type templates, design automatic workflows, and receive customized reports on a schedule that fits your needs. Accessing your information is never a problem, because Filevine is hosted on The Cloud. To ensure security, your law firm’s data is protected through state-of-the-art encryption on redundant servers. All you need to get started is an internet connection and your favorite web browser. Learn more at filevine.com.
Gallery








