Director of Data Quality, Gen AI

Posted 10 Days Ago
Be an Early Applicant
Metropolitan Area Apt, ON
195K-230K Annually
Senior level
Artificial Intelligence • Information Technology • Machine Learning
Our mission is to build the best products to align with artificial intelligence.
The Role
As Director of Data Quality at Labelbox, you will lead a high-performing QA team, implementing and optimizing QA policies to ensure high data quality standards. You will analyze quality metrics, drive process improvements and automation, and align QA objectives with the overall business strategy. Additionally, you will foster a culture of excellence and compliance with industry standards while mentoring team members.
Summary Generated by Built In

Labelbox is the data factory for generative AI, providing the highest quality training data for frontier and task-specific models. Labelbox’s comprehensive platform combines on-demand labeling services with the industry-leading data labeling platform. The Boost labeling service is powered by the Alignerr community of highly-educated experts, who span all major languages and a diverse range of advanced subjects. They are available on-demand to rapidly generate new data for supervised fine-tuning, RLHF, and more. Labelbox’s software-first approach delivers unmatched control and transparency into the labeling process, leading to the generation of high-quality, consistent data at scale.

Labelbox is backed by leading investors including SoftBank, Andreessen Horowitz, B Capital, Gradient Ventures, Databricks Ventures, and Kleiner Perkins. Our customers include Fortune 500 enterprises and leading AI labs.


Your Day to Day

  • Recruit, train, and mentor a high-performing QA team.

  • Foster a culture of excellence, accountability, and continuous learning.

  • Design, implement, and optimize QA policies and procedures.

  • Apply advanced QC/QA methods, such as consensus scoring and statistical process control, to ensure quality standards. Identify workflow inefficiencies and implement best practices to enhance efficiency and reduce errors.

  • Drive initiatives for process improvements and automation in QA.

  • Develop long-term quality strategies aligned with company goals and industry trends.

  • Align QA objectives with overall business strategy.

  • Work with operations, product, engineering, and client teams to optimize annotation guidelines and processes.

  • Represent the QA function in client meetings and strategy sessions. Analyze quality metrics and KPIs to drive decision-making.

  • Prepare and present detailed reports to senior management.

  • Maintain compliance with industry standards and regulatory requirements. Stay updated on advancements in QA technologies and methodologies.

About You

  • Bachelor’s or Master’s degree in Data Science, Computer Science, Quality Management, or a related field.

  • Minimum of 5 years in quality management, particularly in data annotation or related industries.

  • Proven track record of leading QA teams and scaling processes in fast-paced environments.

  • Expert knowledge of QC/QA methods, including consensus scoring, Inter-Rater Reliability (IRR), and statistical process control.

  • Familiarity with data annotation tools, machine learning workflows, and statistical analysis software.

  • Experience with automation and AI-driven quality assurance tools is a plus.

  • Certifications such as Six Sigma Black Belt or ISO Quality Management are highly desirable.

  • Exceptional leadership, team-building, and communication skills.

  • Strong problem-solving and analytical abilities, with an innovative and data-driven mindset.

  • High adaptability and effectiveness in a fast-paced, client-centric environment.

Labelbox strives to ensure pay parity across the organization and discuss compensation transparently.  The expected annual base salary range for United States-based candidates is below. This range is not inclusive of any potential equity packages or additional benefits. Exact compensation varies based on a variety of factors, including skills and competencies, experience, and geographical location.

Annual base salary range

$195,000$230,000 USD

Excel in a remote-friendly hybrid model.

We are dedicated to achieving excellence and recognize the importance of bringing our talented team together. While we continue to embrace remote work, we have transitioned to a hybrid model with a focus on nurturing collaboration and connection within our dedicated tech hubs in the San Francisco Bay Area, New York City Metro Area, and Wrocław, Poland. We encourage asynchronous communication, autonomy, and ownership of tasks, with the added convenience of hub-based gatherings.

Your Personal Data Privacy: Any personal information you provide Labelbox as a part of your application will be processed in accordance with Labelbox’s Job Applicant Privacy notice.

Any emails from Labelbox team members will originate from a @labelbox.com email address. If you encounter anything that raises suspicions during your interactions, we encourage you to exercise caution and suspend or discontinue communications.

Top Skills

Computer Science
Data Science
The Company
HQ: San Francisco, CA
115 Employees
Hybrid Workplace
Year Founded: 2017

What We Do

Labelbox is the data factory for generative AI, providing the highest quality training data for frontier and task-specific models. Labelbox’s comprehensive platform combines on-demand labeling services with the industry-leading data labeling platform. The Boost labeling service is powered by the Alignerr community of highly-educated experts, who span all major languages and a diverse range of advanced subjects. They are available on-demand to rapidly generate new data for supervised fine-tuning, RLHF, and more. Labelbox’s software-first approach delivers unmatched control and transparency into the labeling process, leading to the generation of high-quality, consistent data at scale. Customers include Fortune 500 enterprises and leading AI labs, and Labelbox is backed by leading investors including SoftBank, Andreessen Horowitz, B Capital, Gradient Ventures, Databricks Ventures, and Kleiner Perkins.

Why Work With Us

Labelboxers are driven to master their craft and build the best products for AI, which is quickly becoming one of the most significant technologies of our time. Join us in supporting our customers as they create AI breakthroughs.

Gallery

Gallery

Similar Jobs

Magna International Logo Magna International

Customer Portal Analyst, B2B/EDI

Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
Hybrid
Aurora, ON, CAN
171000 Employees

Magna International Logo Magna International

Manager, Data Management Operations

Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
Hybrid
Aurora, ON, CAN
171000 Employees

Magna International Logo Magna International

Senior Manager BI, CoE and Data Marketplace

Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
Hybrid
Aurora, ON, CAN
171000 Employees

Magna International Logo Magna International

Sr. Workday Functional Analyst, HR Systems

Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
Hybrid
Aurora, ON, CAN
171000 Employees

Similar Companies Hiring

Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees
InCommodities Thumbnail
Renewable Energy • Machine Learning • Information Technology • Energy • Automation • Analytics
Austin, TX
234 Employees
RunPod Thumbnail
Software • Infrastructure as a Service (IaaS) • Cloud • Artificial Intelligence
Charlotte, North Carolina
53 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account