Build your future with Sovos.
At Sovos, we're transforming tax compliance through innovative technology and AI-powered solutions used by customers worldwide. We're looking for an LLM Ops Lead with 2-3 years of experience to help scale, govern, and operationalize Generative AI across the business while ensuring quality, safety, observability, and continuous improvement.
What You'll Do- Own AI quality standards, evaluation frameworks, and release gates across Ask Sovi products
- Lead prompt and model versioning, regression detection, and AI governance initiatives
- Coordinate Safety, Guardrails, and Red Team testing programs
- Build observability practices across latency, cost, quality, and safety metrics using tools such as Langfuse
- Manage Jira epics, ticket triage, and cross-functional coordination across Product and Engineering teams
- Develop LLMOps playbooks, best practices, and operational standards
- Lead AI incident response, troubleshooting, and root-cause analysis
- 2-3 years of experience in Applied AI, LLMOps, AI Quality Engineering, AI Operations, Test Automation, or related fields
- Hands-on experience with Langfuse, LangSmith, or similar AI observability and evaluation tools
- Strong understanding of AI quality, evaluation pipelines, prompt versioning, and AI governance
- Experience with AI safety, guardrails, content moderation, audit logging, and release management
- Strong stakeholder management and communication skills
- Ability to support teams operating across UK business hours
- Applied AI Engineers from AI-native or AI-first organizations with hands-on Langfuse/LangSmith experience
- Product-minded Engineers who combine strong technical skills with customer and business impact awareness
- QA/Test Automation Engineers who have transitioned into AI evaluation, quality, or LLM testing
- AI Quality Analysts with expertise in hallucination detection, model drift monitoring, LLM-as-a-Judge methodologies, and AI quality governance
- Work on cutting-edge Generative AI products and platforms
- Collaborate with global AI, Product, and Engineering leaders
- Bi-Weekly Meeting Free Days
- Mentoring and career development programs
- Globally recognized training opportunities
- Comprehensive health and wellness benefits
- Flexible and collaborative work environment
CCAT & EPP Assessment → Automated Video Interview → Hiring Manager Interview → Final Interview
#Hiring #LLMOps #AIOps #GenerativeAI #AIEngineering #LangSmith #Langfuse #SovosCareers
Skills Required
- 2-3 years of experience in Applied AI, LLMOps, AI Quality Engineering, AI Operations, Test Automation, or related fields
- Hands-on experience with Langfuse, LangSmith, or similar AI observability and evaluation tools
- Strong understanding of AI quality, evaluation pipelines, prompt versioning, and AI governance
- Experience with AI safety, guardrails, content moderation, audit logging, and release management
- Strong stakeholder management and communication skills
- Ability to support teams operating across UK business hours
- Background as Applied AI Engineer, Product-minded Engineer, QA/Test Automation Engineer, or AI Quality Analyst
Sovos Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Sovos and has not been reviewed or approved by Sovos.
-
Leave & Time Off Breadth — Flexible or unlimited time off is broadly offered and stands out as a strong aspect of the package. While usage may depend on workload and manager norms, the breadth of the policy is clear.
-
Parental & Family Support — Parental leave is included, with examples of extended maternity and multi‑week leave for other parents. This support complements wider family‑oriented resources.
-
Wellbeing & Lifestyle Benefits — Wellness resources, donation matching, volunteer time off, recognition programs, and structured development/mentorship are part of a broad offering. Remote/flexible work options and community perks further bolster everyday wellbeing.
Sovos Insights
What We Do
Sovos provides businesses with the confidence needed to navigate an increasingly regulated world. Offering a modern, IT driven response to compliance, Sovos’ solutions are scalable, reliable and secure and provide a great user experience. Sovos has more than 100,000 customers, including half the Fortune 500, as well as businesses of every size operating in more than 70 countries. The company’s cloud-based solutions integrate with a wide variety of business applications and government compliance processes. Sovos has employees throughout the Americas and Europe and is owned by Hg and TA Associates.
Why Work With Us
We are dedicated to being a place where people truly enjoy being. We promote internally and offer a variety of development programs internally. Tax and the regulatory compliance space is also an incredibly stable industry! It changes a lot (because, tax!) but it is never going away. It is always something businesses will have to do!
Gallery
