About Sutherland
Artificial Intelligence. Automation.Cloud engineering. Advanced analytics.For business leaders, these are key factors of success. For us, they’re our core expertise.
We work with iconic brands worldwide. We bring them a unique value proposition through market-leading technology and business process excellence.
We’ve created over 200 unique inventions under several patents across AI and other critical technologies. Leveraging our advanced products and platforms, we drive digital transformation, optimize critical business operations, reinvent experiences, and pioneer new solutions, all provided through a seamless “as a service” model.
For each company, we provide new keys for their businesses, the people they work with, and the customers they serve. We tailor proven and rapid formulas, to fit their unique DNA.We bring together human expertise and artificial intelligence to develop digital chemistry. This unlocks new possibilities, transformative outcomes and enduring relationships.
Sutherland
Unlocking digital performance. Delivering measurable results.
Job DescriptionRole Summary
Owns technical testing of agent outputs — accuracy, turnaround-time impact, and regression testing as agents are iterated — feeding the accuracy and completion-time KPIs tracked at the programme level.
Key Responsibilities
- Build test suites validating agent outputs against golden-record datasets across covered processes.
- Track and report accuracy/turnaround-time metrics to support baselining exercises agreed with the business.
- Run regression testing whenever agent/prompt configurations change, to prevent silent accuracy drift in regulated processes.
- Feed findings into the human QA function for final sign-off — this role supports human QA authority on regulated activity with technical evidence, not replaces it.
Required Experience
- 5+ years QA/test engineering experience, ideally including ML/LLM output validation (not just deterministic software testing).
- Experience defining test datasets and accuracy benchmarks for document/text-processing systems.
- Domain process familiarity a plus for building realistic test scenarios.
Skills Required
- 5+ years of QA or test engineering experience
- Experience with ML or LLM output validation
- Experience defining test datasets and accuracy benchmarks for document or text-processing systems
- Domain process familiarity for building realistic test scenarios
Sutherland Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Sutherland and has not been reviewed or approved by Sutherland.
-
Flexible Benefits — Flexible scheduling and work-from-home arrangements are offered on certain programs, supported by remote-work infrastructure and virtual IT support. Program-specific flexibility is emphasized for “Sutherland Anywhere” roles.
-
Leave & Time Off Breadth — Paid time off and paid training are positioned as standard elements, with some materials also highlighting flexible vacation days. Core leave features are presented as part of the baseline package.
-
Strong & Reliable Incentives — Performance incentives, bonuses, and commissions are available on selected programs to supplement base pay. Goal-linked earnings opportunities are described for certain functions.
Sutherland Insights
What We Do
We make digital ?????™ by combining human-centered design with real-time Analytics, AI, Cognitive Technology & Automation to create exceptionally engineered Brand Experiences! Sutherland is an experience-led digital transformation company. Our mission is to deliver exceptionally engineered experiences for customers and employees today, that continue to delight tomorrow. For over 35 years, we have cared for our customers’ customers, delivering measurable results and accelerating growth. Our proprietary, AI-based products and platforms are built using robust IP and automation. We are a team of global professionals, operationally effective, culturally meshed, and committed to our clients and to one another. We call it One Sutherland. #MakeDigitalHuman
