Lead Generative AI Analyst

Posted One Month Ago
8 Locations
In-Office or Remote
Junior
Machine Learning • Natural Language Processing
The Role
Leads technical and writing teams delivering generative AI products, coordinating customers, data, product, and research teams. Tracks annotator metrics, manages labeling initiatives, creates prompts and responses, develops stakeholder guidelines, and trains teams on LLM and dataset best practices. The role includes customer interaction, quality assurance, and exposure to potentially toxic or sensitive content.
Summary Generated by Built In

If you have a Candidate Login already, but have forgotten your password please use the steps to reset your password. If you have forgotten your email login, please contact [email protected] subject Workday Candidate Login

When creating your Workday account and entering personal information like name, address, please do not use ALL CAPS.

Thank you!

NOTICE:  For Privacy Policy please review here

Job Responsibilities:

The Lead Generative AI Analyst plays a pivotal role in leading technical and writing teams to deliver NEMO products. This position also involves customer-facing responsibilities, ensuring world-class quality through tracking metrics, labeling initiatives, and training stakeholders. Exposure to potentially sensitive content may be required.

Responsibilities:

  • Lead technical and writing teams to deliver NEMO products.
  • Act as the liaison between customers, DataFactory teams, product teams, and research teams.
  • Track annotator metrics to ensure top-quality deliverables.
  • Write creative prompts and responses across diverse topics.
  • Manage labeling initiatives with third-party firms and internal customers.
  • Develop and update detailed guidelines and specifications for stakeholders.
  • Train teams on best practices for creating large language models and datasets.
  • Handle potentially toxic or offensive content as required (e.g., sexually explicit, graphic, or disturbing material).

Additional Job Details:

Requirements:

  • Proven track record of delivering quality products on time.
  • Native-level English proficiency with excellent written and verbal communication skills.
  • Self-driven, motivated, and enthusiastic about working on state-of-the-art machine learning tools.
  • Domain knowledge in specialized fields (e.g., Law, Gardening, Biology, US History, Academic Engineering).
  • 4-year accredited college degree or equivalent experience.

Ways to Stand Out:

  • Over 1 year of experience delivering products in the LLM space.
  • College degree or experience in Linguistics, English Literature, Creative Writing, Journalism, STEM, or relevant domain knowledge.
  • Deep understanding of large language models and RLHF.
  • Experience in labeling and tagging frames/tasks/prompts for DNN preparation.
  • QA/testing experience.
  • Python scripting skills are a plus.

Skills Required

  • Proven track record of delivering quality products on time
  • Native-level English proficiency with excellent written and verbal communication skills
  • Self-driven, motivated, and enthusiastic about working on state-of-the-art machine learning tools
  • Domain knowledge in a specialized field such as Law, Gardening, Biology, US History, or Academic Engineering
  • Four-year accredited college degree or equivalent experience
  • More than one year of experience delivering products in the LLM space
  • Degree or experience in Linguistics, English Literature, Creative Writing, Journalism, STEM, or a relevant domain
  • Deep understanding of large language models and RLHF
  • Experience labeling and tagging frames, tasks, or prompts for DNN preparation
  • QA or testing experience
  • Python scripting skills
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
2,331 Employees
Year Founded: 1997

What We Do

Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 250,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our people work across offices in North America, Europe, and Asia serving our global clients in the markets that matter to them. • Global team of 2,100+ • Offices in North America, Europe and Asia • Quality Certifications: ISO 9001:2015, ISO/IEC 27001:2013, ISO 17100:2015, ISO 13485:2016, ISO 18587:2017 • Accredited professional translators and interpreters for 250+ languages www.welocalize.com

Similar Jobs

Applied Systems Logo Applied Systems

User Experience Designer

Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Remote or Hybrid
4 Locations
3116 Employees
100K-140K Annually

NBCUniversal Logo NBCUniversal

Lead Character Artist | Chef.fe d'équipe Artiste Personnage

AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Remote or Hybrid
Montréal, QC, CAN

Mosaic Logo Mosaic

Account Director

Software • Conversational AI
Remote or Hybrid
5 Locations
65 Employees
150K-300K Annually

Boomi Logo Boomi

Human Resources Business Partner

Cloud • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Canada
2200 Employees
110K-137K Annually

Similar Companies Hiring

Learneo Thumbnail
Software • Machine Learning • Edtech • Artificial Intelligence
NL
397 Employees
Allen Control Systems Thumbnail
Artificial Intelligence • Computer Vision • Machine Learning • Robotics • Defense • Manufacturing
Austin , TX
350 Employees
Blissway Thumbnail
Computer Vision • Fintech • Hardware • Internet of Things • Machine Learning • Software • Transportation
Denver, CO
24 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account