The Role
Build and maintain automated evaluation pipelines and labeling automation for ML models. Implement labeling functions, train lightweight models to accelerate labeling, ensure labeled data quality, create benchmarks, dashboards, regression tests, and comparison frameworks, analyze failures, and support A/B testing for production validation.
Summary Generated by Built In
Coupa makes margins multiply through its community-generated AI and industry-leading total spend management platform for businesses large and small. Coupa AI is informed by trillions of dollars of direct and indirect spend data across a global network of 10M+ buyers and suppliers. We empower you with the ability to predict, prescribe, and automate smarter, more profitable business decisions to improve operating margins.
Why join Coupa?
🔹 Pioneering Technology: At Coupa, we're at the forefront of innovation, leveraging the latest technology to empower our customers with greater efficiency and visibility in their spend.
🔹 Collaborative Culture: We value collaboration and teamwork, and our culture is driven by transparency, openness, and a shared commitment to excellence.
🔹 Global Impact: Join a company where your work has a global, measurable impact on our clients, the business, and each other.
Learn more on Life at Coupa blog and hear from our employees about their experiences working at Coupa.
What You’ll Do
- Build and maintain automated evaluation pipelines for AI model quality.
- Develop and implement labeling functions (LFs) to automate and scale data labeling using AI tools.
- Train and deploy lightweight ML models to suggest or auto-generate labels, improving labeling throughput and efficiency.
- Perform quality assurance on labeled data and refine guidelines as needed to ensure precision and consistency.
- Work cross-functionally to evolve data labeling strategies and coverage.
- Maintain documentation for labeling strategies, logic, edge cases, and automation scripts.
- Monitor labeling performance metrics and drive continuous improvement in data quality.
- Implement task-specific benchmarks and test suites.
- Design quality dashboards tracking accuracy, regression, and safety metrics.
- Implement automated regression testing for every model iteration.
- Build comparison frameworks for side-by-side evaluation of model variants.
- Analyze evaluation results to identify failure modes and report to the ML team.
- Maintain evaluation datasets: versioning, quality validation, coverage analysis.
- Support A/B testing infrastructure for production model validation.
What You Will Bring to Coupa
- 2+ years of software engineering / data engineering / data science /quality engineering experience.
- Experience in dealing with large sets of Production Data.
- Knowledge of SQL and experience querying large datasets.
- Proficiency in Python.
- Excellent attention to detail, problem-solving skills, and ability to work independently.
- BS in Computer Science, Statistics, or equivalent experience.
- Direct experience working with P2P products or similar procurement/SaaS platforms.
- Understanding of weak supervision, active learning, and data-centric AI methodologies.
- Exposure to enterprise data governance and data quality principles.
- Familiarity with data labeling platforms/tools such as Snorkel, Label Studio, Prodigy, or custom-built tools.
- Ability to build simple ML models (e.g., for text classification or entity recognition) to accelerate labeling efforts.
Coupa complies with relevant laws and regulations regarding equal opportunity and offers a welcoming and inclusive work environment. Decisions related to hiring, compensation, training, or evaluating performance are made fairly, and we provide equal employment opportunities to all qualified candidates and employees.
Please be advised that inquiries or resumes from recruiters will not be accepted.
By submitting your application, you acknowledge that you have read Coupa’s Privacy Policy and understand that Coupa receives/collects your application, including your personal data, for the purposes of managing Coupa's ongoing recruitment and placement activities, including for employment purposes in the event of a successful application and for notification of future job opportunities if you did not succeed the first time. You will find more details about how your application is processed, the purposes of processing, and how long we retain your application in our Privacy Policy.
Skills Required
- 2+ years of software engineering / data engineering / data science / quality engineering experience
- Experience dealing with large sets of production data
- Knowledge of SQL and experience querying large datasets
- Proficiency in Python
- Excellent attention to detail, problem-solving skills, and ability to work independently
- BS in Computer Science, Statistics, or equivalent experience
- Direct experience working with P2P products or similar procurement/SaaS platforms
- Understanding of weak supervision, active learning, and data-centric AI methodologies
- Exposure to enterprise data governance and data quality principles
- Familiarity with data labeling platforms/tools such as Snorkel, Label Studio, Prodigy, or custom-built tools
- Ability to build simple ML models (e.g., text classification or entity recognition) to accelerate labeling
What the Team is Saying
Aditya Maheshwari
Sr. Software Engineer, Cloud
Alex Moon
Operations Analyst, Order Management
Jose Miguel Jimenez
Procurement
Jessica Fonseca
Technical Support Specialist
Daniela Aristizábal
Associate Planning & Operations Analyst
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Coupa is a global technology company that helps businesses run smarter by connecting all the ways they spend money — from procurement and expenses to payments and supply chain decisions — in one intelligent platform. In simple terms, Coupa gives organizations the visibility and control they need to make better financial choices, reduce waste, and drive real impact. It’s where technology meets purpose: helping companies manage their resources more responsibly while creating a positive ripple across their people, partners, and the planet.
Why Work With Us
At Coupa, we prioritize an inclusive and empathetic workplace where every voice is valued. Our teams are proactive and accountable, ensuring we collaborate effectively to achieve our goals. The foundation of our culture rests on our people; we believe in fostering an environment that encourages innovation and curiosity.
Gallery
Coupa Offices
Hybrid Workspace
Employees engage in a combination of remote and on-site work.
Our virtual-first approach is intentional. It gives you the freedom to do your best work in a space that supports focus, balance, and creativity, while staying connected to a global team of changemakers who are redefining the future of business spend
Typical time on-site:
Flexible
Foster City
HR
Ann Arbor
Bangalore office
Bogotá, CO
Boston, MA
Chicago, IL
Dubai, Dubai 48800
Hyderabad office
São Paulo, BR
Pune office
Shivaji Nagar, IN
Singapore, SG
Tokyo Office
Uppsala, SE
Learn more
