Lead Generative AI Analyst

Posted 4 Days Ago
8 Locations
In-Office or Remote
Junior
Machine Learning • Natural Language Processing
The Role
Leads technical and writing teams delivering generative AI products, coordinating customers, data, product, and research teams. Tracks annotator metrics, manages labeling initiatives, creates prompts and responses, develops stakeholder guidelines, and trains teams on LLM and dataset best practices. The role includes customer interaction, quality assurance, and exposure to potentially toxic or sensitive content.
Summary Generated by Built In

If you have a Candidate Login already, but have forgotten your password please use the steps to reset your password. If you have forgotten your email login, please contact [email protected] subject Workday Candidate Login

When creating your Workday account and entering personal information like name, address, please do not use ALL CAPS.

Thank you!

NOTICE:  For Privacy Policy please review here

Job Responsibilities:

The Lead Generative AI Analyst plays a pivotal role in leading technical and writing teams to deliver NEMO products. This position also involves customer-facing responsibilities, ensuring world-class quality through tracking metrics, labeling initiatives, and training stakeholders. Exposure to potentially sensitive content may be required.

Responsibilities:

  • Lead technical and writing teams to deliver NEMO products.
  • Act as the liaison between customers, DataFactory teams, product teams, and research teams.
  • Track annotator metrics to ensure top-quality deliverables.
  • Write creative prompts and responses across diverse topics.
  • Manage labeling initiatives with third-party firms and internal customers.
  • Develop and update detailed guidelines and specifications for stakeholders.
  • Train teams on best practices for creating large language models and datasets.
  • Handle potentially toxic or offensive content as required (e.g., sexually explicit, graphic, or disturbing material).

Additional Job Details:

Requirements:

  • Proven track record of delivering quality products on time.
  • Native-level English proficiency with excellent written and verbal communication skills.
  • Self-driven, motivated, and enthusiastic about working on state-of-the-art machine learning tools.
  • Domain knowledge in specialized fields (e.g., Law, Gardening, Biology, US History, Academic Engineering).
  • 4-year accredited college degree or equivalent experience.

Ways to Stand Out:

  • Over 1 year of experience delivering products in the LLM space.
  • College degree or experience in Linguistics, English Literature, Creative Writing, Journalism, STEM, or relevant domain knowledge.
  • Deep understanding of large language models and RLHF.
  • Experience in labeling and tagging frames/tasks/prompts for DNN preparation.
  • QA/testing experience.
  • Python scripting skills are a plus.

Skills Required

  • Proven track record of delivering quality products on time
  • Native-level English proficiency with excellent written and verbal communication skills
  • Self-driven, motivated, and enthusiastic about working on state-of-the-art machine learning tools
  • Domain knowledge in a specialized field such as Law, Gardening, Biology, US History, or Academic Engineering
  • Four-year accredited college degree or equivalent experience
  • More than one year of experience delivering products in the LLM space
  • Degree or experience in Linguistics, English Literature, Creative Writing, Journalism, STEM, or a relevant domain
  • Deep understanding of large language models and RLHF
  • Experience labeling and tagging frames, tasks, or prompts for DNN preparation
  • QA or testing experience
  • Python scripting skills
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
2,331 Employees
Year Founded: 1997

What We Do

Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 250,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our people work across offices in North America, Europe, and Asia serving our global clients in the markets that matter to them. • Global team of 2,100+ • Offices in North America, Europe and Asia • Quality Certifications: ISO 9001:2015, ISO/IEC 27001:2013, ISO 17100:2015, ISO 13485:2016, ISO 18587:2017 • Accredited professional translators and interpreters for 250+ languages www.welocalize.com

Similar Jobs

Block Logo Block

Software Engineer

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
In-Office or Remote
8 Locations
12000 Employees
153K-270K Annually

Affirm Logo Affirm

Software Engineer

Big Data • Fintech • Mobile • Payments • Financial Services
Easy Apply
Remote
Canada
2200 Employees
128K-188K Annually

360Learning Logo 360Learning

Enterprise Account Executive

Artificial Intelligence • Cloud • Edtech • HR Tech • Sales • Software • Generative AI
Easy Apply
Remote
Canada
400 Employees

Fluent, Inc. Logo Fluent, Inc.

Junior NetSuite Administrator

AdTech • Digital Media • eCommerce • Marketing Tech
In-Office or Remote
Toronto, ON, CAN
200 Employees
65K-85K Annually

Similar Companies Hiring

Allen Control Systems Thumbnail
Artificial Intelligence • Computer Vision • Machine Learning • Robotics • Defense • Manufacturing
Austin , TX
350 Employees
Blissway Thumbnail
Computer Vision • Fintech • Hardware • Internet of Things • Machine Learning • Software • Transportation
Denver, CO
24 Employees
Credal.ai Thumbnail
Software • Security • Productivity • Machine Learning • Artificial Intelligence
Brooklyn, NY

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account