What You’ll Do
- Build and maintain automated evaluation pipelines for AI model quality.
- Implement task-specific benchmarks and test suites.
- Design quality dashboards tracking accuracy, regression, and safety metrics.
- Implement automated regression testing for every model iteration.
- Build comparison frameworks for side-by-side evaluation of model variants.
- Analyze evaluation results to identify failure modes and report to the ML team.
- Maintain evaluation datasets: versioning, quality validation, coverage analysis.
- Support A/B testing infrastructure for production model validation.
What You Will Bring to Coupa
- 3+ years of software engineering
- Proficiency in Python .
- Experience with statistical analysis and data visualization.
- Understanding of ML model evaluation concepts (precision, recall, F1, human eval).
- Experience building automated test frameworks and CI/CD pipelines.
- Familiarity with dashboarding tools.
- Strong analytical and problem-solving skills.
- BS in Computer Science, Statistics, or equivalent experience.
Skills Required
- 3+ years of software engineering
- Proficiency in Python
- Experience with statistical analysis and data visualization
- Understanding of ML model evaluation concepts (precision, recall, F1, human eval)
- Experience building automated test frameworks and CI/CD pipelines
- Familiarity with dashboarding tools
- Strong analytical and problem-solving skills
- BS in Computer Science, Statistics, or equivalent experience
What the Team is Saying
Coupa Compensation & Benefits Highlights
-
Healthcare Strength — Company materials describe comprehensive healthcare and mental wellness programs for employees and their families, positioning well‑being as a core pillar of the package.
-
Leave & Time Off Breadth — Generous paid time off, parental leave, and company Wellness Days are highlighted, with remote‑work flexibility available for many roles.
-
Parental & Family Support — Family‑focused offerings include parental leave, fertility benefits, family medical leave, and on‑site mother’s rooms to support caregivers.
Coupa Insights
What We Do
Coupa is a global technology company that helps businesses run smarter by connecting all the ways they spend money — from procurement and expenses to payments and supply chain decisions — in one intelligent platform. In simple terms, Coupa gives organizations the visibility and control they need to make better financial choices, reduce waste, and drive real impact. It’s where technology meets purpose: helping companies manage their resources more responsibly while creating a positive ripple across their people, partners, and the planet.
Why Work With Us
At Coupa, we prioritize an inclusive and empathetic workplace where every voice is valued. Our teams are proactive and accountable, ensuring we collaborate effectively to achieve our goals. The foundation of our culture rests on our people; we believe in fostering an environment that encourages innovation and curiosity.
Gallery
Coupa Offices
Remote Workspace
Employees work remotely.
Our virtual-first approach is intentional. It gives you the freedom to do your best work in a space that supports focus, balance, and creativity, while staying connected to a global team of changemakers who are redefining the future of business spend
