Dropbox is seeking a Staff Product Manager to lead AI Evaluations (Evals) — the systems, metrics, and processes that measure the quality and reliability of AI-powered features across Dropbox. In this role, you’ll define how we evaluate model performance, accuracy, and user satisfaction across diverse AI surfaces like Dash, search, summarization, and intelligent organization.
You’ll collaborate closely with Applied AI, Data Science, and Research to design frameworks that ensure our AI features are helpful, safe, and high-quality. This includes everything from defining success metrics for model improvements, to building scalable pipelines that assess qualitative and quantitative signals at scale.
This role sits at the intersection of AI systems, data rigor, and product judgment — ideal for a PM who loves turning ambiguity into measurable progress and ensuring that every AI interaction meets a bar of excellence.
Responsibilities- Define and drive the roadmap for Dropbox’s AI Evaluation Framework, covering both quantitative metrics and human-in-the-loop systems.
- Partner with ML, data, and research teams to build evaluation pipelines that measure model accuracy, helpfulness, bias, latency, and hallucination rates.
- Translate business and product goals into measurable AI performance objectives.
- Develop taxonomies and methodologies for evaluating large language model (LLM) behaviors in production.
- Work closely with PMs across Dash to integrate eval signals into product development loops.
- Partner with infra and AI platform teams to operationalize eval tooling and dashboards.
- Ensure evaluations are ethical, transparent, and aligned with Dropbox’s privacy and trust standards.
- Communicate findings and drive accountability across teams for improving AI quality.
- 10+ years of product management experience, ideally in AI/ML systems, data platforms, or experimentation.
- Proven experience defining and shipping metrics-driven AI products or frameworks.
- Strong understanding of model evaluation concepts such as precision/recall, win-rate testing, and user feedback loops.
- Excellent analytical, problem-solving, and communication skills.
- Strong cross-functional collaboration across ML, data, design, and research teams.
- Comfort balancing experimentation speed with rigor and reproducibility.
- Background in AI systems, API design, or developer platforms.
- Experience working on extensibility or plugin ecosystems.
- Understanding of AI evaluation and safety frameworks.
- Ability to influence across multiple product teams and technical domains.
Top Skills
What the Team is Saying
What We Do
We're a global community of bold visionaries and resourceful doers who are shaping the future of Dropbox—and with it the future of work. Our Virtual First model combines the flexibility of a distributed workplace with the power of human connection, making space for both meaningful work and meaningful relationships. With our start-up mindset and enterprise-level opportunities, you can be who you are and grow into who you’re meant to be. Here, you can own your impact to make work more intuitive, joyful, and human—for you as a Dropboxer and for hundreds of millions of people worldwide. If you're ready to push boundaries—and yourself—Dropbox is ready for you.
Why Work With Us
We believe people do their best work when empowered with autonomy and harmony, and we understand there’s no substitute for human connection. Our Virtual First model combines the flexibility of remote work with the power of in-person collaboration to create the best of both worlds: a distributed workplace, anchored in community.
Gallery
Dropbox Offices
Remote Workspace
Employees work remotely.
While remote work is the primary experience for our employees, we also prioritize opportunities for quarterly in-person collaboration knowing that connection is vital to a thriving workforce. We focus on how we work, not where we work.
