Lead Generative AI Analyst

Posted 2 Days Ago
8 Locations
In-Office or Remote
Junior
Machine Learning • Natural Language Processing
The Role
Leads technical and writing teams delivering generative AI products. Coordinates customers, data, product, and research teams; tracks annotator metrics; creates prompts and responses; manages labeling initiatives; develops guidelines; trains stakeholders on LLM and dataset best practices; and supports quality assurance while handling potentially sensitive content.
Summary Generated by Built In

If you have a Candidate Login already, but have forgotten your password please use the steps to reset your password. If you have forgotten your email login, please contact [email protected] subject Workday Candidate Login

When creating your Workday account and entering personal information like name, address, please do not use ALL CAPS.

Thank you!

NOTICE:  For Privacy Policy please review here

Job Responsibilities:

The Lead Generative AI Analyst plays a pivotal role in leading technical and writing teams to deliver NEMO products. This position also involves customer-facing responsibilities, ensuring world-class quality through tracking metrics, labeling initiatives, and training stakeholders. Exposure to potentially sensitive content may be required.

Responsibilities:

  • Lead technical and writing teams to deliver NEMO products.
  • Act as the liaison between customers, DataFactory teams, product teams, and research teams.
  • Track annotator metrics to ensure top-quality deliverables.
  • Write creative prompts and responses across diverse topics.
  • Manage labeling initiatives with third-party firms and internal customers.
  • Develop and update detailed guidelines and specifications for stakeholders.
  • Train teams on best practices for creating large language models and datasets.
  • Handle potentially toxic or offensive content as required (e.g., sexually explicit, graphic, or disturbing material).

Additional Job Details:

Requirements:

  • Proven track record of delivering quality products on time.
  • Native-level English proficiency with excellent written and verbal communication skills.
  • Self-driven, motivated, and enthusiastic about working on state-of-the-art machine learning tools.
  • Domain knowledge in specialized fields (e.g., Law, Gardening, Biology, US History, Academic Engineering).
  • 4-year accredited college degree or equivalent experience.

Ways to Stand Out:

  • Over 1 year of experience delivering products in the LLM space.
  • College degree or experience in Linguistics, English Literature, Creative Writing, Journalism, STEM, or relevant domain knowledge.
  • Deep understanding of large language models and RLHF.
  • Experience in labeling and tagging frames/tasks/prompts for DNN preparation.
  • QA/testing experience.
  • Python scripting skills are a plus.

Skills Required

  • Proven track record of delivering quality products on time
  • Native-level English proficiency with excellent written and verbal communication skills
  • Self-driven, motivated, and enthusiastic about state-of-the-art machine learning tools
  • Domain knowledge in a specialized field such as law, gardening, biology, U.S. history, or academic engineering
  • Four-year accredited college degree or equivalent experience
  • More than one year of experience delivering products in the LLM space
  • Degree or experience in linguistics, English literature, creative writing, journalism, STEM, or a relevant domain
  • Deep understanding of large language models and RLHF
  • Experience labeling and tagging frames, tasks, or prompts for deep neural network preparation
  • Quality assurance or testing experience
  • Python scripting skills
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
2,331 Employees
Year Founded: 1997

What We Do

Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 250,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our people work across offices in North America, Europe, and Asia serving our global clients in the markets that matter to them. • Global team of 2,100+ • Offices in North America, Europe and Asia • Quality Certifications: ISO 9001:2015, ISO/IEC 27001:2013, ISO 17100:2015, ISO 13485:2016, ISO 18587:2017 • Accredited professional translators and interpreters for 250+ languages www.welocalize.com

Similar Jobs

WeLocalize Logo WeLocalize

Lead Generative AI Analyst

Machine Learning • Natural Language Processing
In-Office or Remote
8 Locations
2331 Employees

Dynatrace Logo Dynatrace

Senior Data Analyst

Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Remote or Hybrid
Ontario, ON, CAN
5600 Employees
86K-107K Annually

Dynatrace Logo Dynatrace

Account Executive

Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Remote or Hybrid
Calgary, AB, CAN
5600 Employees

Zapier Logo Zapier

Legal Counsel

Artificial Intelligence • Productivity • Software • Automation
Remote
2 Locations
800 Employees
158K-238K Annually

Similar Companies Hiring

Allen Control Systems Thumbnail
Artificial Intelligence • Computer Vision • Machine Learning • Robotics • Defense • Manufacturing
Austin , TX
350 Employees
Blissway Thumbnail
Computer Vision • Fintech • Hardware • Internet of Things • Machine Learning • Software • Transportation
Denver, CO
24 Employees
Credal.ai Thumbnail
Software • Security • Productivity • Machine Learning • Artificial Intelligence
Brooklyn, NY

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account