Training Lead, Product Operations - AI Classification

About DoubleVerify

DoubleVerify is a recognized market innovator with technology & tools that accurately authenticate the quality of digital media and drive ad performance for the world's largest brands. DV provides media transparency and accountability to deliver the highest level of impression quality for maximum advertising performance. Since 2008, DV has helped hundreds of Fortune 500 companies gain the most from their media spend by delivering best-in-class solutions across the digital ecosystem that help build a better industry.

Position Overview

The Classification Operations team plays a critical role in product development by providing data + insights that help drive ontology-based and AI/ML initiatives. As a Training Lead on the team, you’ll ensure the quality of DV classifications by executing labeling/QA processes, project organization, and sprint-planning.

You’ll work both independently and collaboratively within the AI Classification department and also partner with Policy, Product, Data Science, Ontology, and other global teams (ex: Costa Rica, Tel Aviv, Helsinki, London) to evolve DV’s classification technologies and ensure a high quality of training across all global teams.

This is a great mid-level opportunity for someone interested in online media and content management. You’ll build on your knowledge of the ad tech industry, the growing field of data labeling, and the online space across international markets. You’ll also learn popular tools and technologies, as well as valuable skills, that will help meet the needs of top advertising clients across industries, and you’ll contribute towards the mission of making the digital ecosystem safer, more transparent, and sustainable.

In order to be successful in this role, the candidate must:

• Be a critical thinker who can identify and describe themes and tone of content
• Consistently demonstrate/achieve strong understanding of category definition; Autonomous completion of tasks per established SLAs; Positive feedback from other teams regarding communications, such as ontology feedback and AM/client communications.
• Be comfortable seeing and talking about sometimes sensitive or explicit textual and visual content
• Be an independent worker, but can collaborate with a team when needed (please note: this role is not customer facing)
• Possess strong attention to detail and QA/troubleshooting mindset
• Be a naturally curious learner with an interest in news, pop culture, and online trends
• Be a strong communicator, both verbal and written, with a good understanding of stakeholder motivations and needs
  

Primary Job Responsibilities

• Ownership of key components within the team, with a focus on providing training guidelines, organization, and process improvement
• Support proprietary workforce management process on daily basis
• Understand products and associated roadmaps that deliver customer success
• Provide judgements for data labeling/annotating or classification based on independent interpretation of guidelines and policies, providing summaries and recaps once projects are complete
• Provides training and other support-related to processes to other classifiers, including training of new team members.
• Ownership and follow-through of discrete projects (ex: creation + maintenance of JIRA tickets)
• Technical expertise in related classification tasks, management of feedback to Semantic Science, and delegation of tasks, tickets, and projects to specialists.
• Deliver internal training, ensures quality of classifications, and creates and sends communications for internal teams.
• Provide feedback & proactively identify issues to cross-functional teams
• Grow strong working relationships with key internal partners (ex: Account Managers, Product Managers, Policy Managers, Data Scientists)
  

Skills & Background

• Bachelor’s degree
• Knowledge of Google Workspace (Gmail, Google Docs, Google Sheets) and/or Microsoft Office products
• Functional fluency with JIRA, Confluence, Monday.com, and/or other project-tracking tools
• Language skills are a plus

The successful candidate’s starting salary will be determined based on a number of non-discriminating factors, including qualifications for the role, level, skills, experience, location, and balancing internal equity relative to peers at DV.
The estimated salary range for this role based on the qualifications set forth in the job description is between [$75,000- $95,000]. This role will also be eligible for bonus/commission (as applicable), equity, and benefits.
The range above is for the expectations as laid out in the job description; however, we are often open to a wide variety of profiles, and recognize that the person we hire may be more or less experienced than this job description as posted.

Not-so-fun fact: Research shows that while men apply to jobs when they meet an average of 60% of job criteria, women and other marginalized groups tend to only apply when they check every box. So if you think you have what it takes but you’re not sure that you check every box, apply anyway!