Lead Generative AI Analyst

Posted One Month Ago
8 Locations
In-Office or Remote
Junior
Machine Learning • Natural Language Processing
The Role
Leads technical and writing teams delivering generative AI products, coordinating customers, data, product, and research teams. Tracks annotator metrics, manages labeling initiatives, creates prompts and responses, develops stakeholder guidelines, and trains teams on LLM and dataset best practices. The role includes customer interaction, quality assurance, and exposure to potentially toxic or sensitive content.
Summary Generated by Built In

If you have a Candidate Login already, but have forgotten your password please use the steps to reset your password. If you have forgotten your email login, please contact [email protected] subject Workday Candidate Login

When creating your Workday account and entering personal information like name, address, please do not use ALL CAPS.

Thank you!

NOTICE:  For Privacy Policy please review here

Job Responsibilities:

The Lead Generative AI Analyst plays a pivotal role in leading technical and writing teams to deliver NEMO products. This position also involves customer-facing responsibilities, ensuring world-class quality through tracking metrics, labeling initiatives, and training stakeholders. Exposure to potentially sensitive content may be required.

Responsibilities:

  • Lead technical and writing teams to deliver NEMO products.
  • Act as the liaison between customers, DataFactory teams, product teams, and research teams.
  • Track annotator metrics to ensure top-quality deliverables.
  • Write creative prompts and responses across diverse topics.
  • Manage labeling initiatives with third-party firms and internal customers.
  • Develop and update detailed guidelines and specifications for stakeholders.
  • Train teams on best practices for creating large language models and datasets.
  • Handle potentially toxic or offensive content as required (e.g., sexually explicit, graphic, or disturbing material).

Additional Job Details:

Requirements:

  • Proven track record of delivering quality products on time.
  • Native-level English proficiency with excellent written and verbal communication skills.
  • Self-driven, motivated, and enthusiastic about working on state-of-the-art machine learning tools.
  • Domain knowledge in specialized fields (e.g., Law, Gardening, Biology, US History, Academic Engineering).
  • 4-year accredited college degree or equivalent experience.

Ways to Stand Out:

  • Over 1 year of experience delivering products in the LLM space.
  • College degree or experience in Linguistics, English Literature, Creative Writing, Journalism, STEM, or relevant domain knowledge.
  • Deep understanding of large language models and RLHF.
  • Experience in labeling and tagging frames/tasks/prompts for DNN preparation.
  • QA/testing experience.
  • Python scripting skills are a plus.

Skills Required

  • Proven track record of delivering quality products on time
  • Native-level English proficiency with excellent written and verbal communication skills
  • Self-driven, motivated, and enthusiastic about working on state-of-the-art machine learning tools
  • Domain knowledge in a specialized field such as Law, Gardening, Biology, US History, or Academic Engineering
  • Four-year accredited college degree or equivalent experience
  • More than one year of experience delivering products in the LLM space
  • Degree or experience in Linguistics, English Literature, Creative Writing, Journalism, STEM, or a relevant domain
  • Deep understanding of large language models and RLHF
  • Experience labeling and tagging frames, tasks, or prompts for DNN preparation
  • QA or testing experience
  • Python scripting skills

WeLocalize Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about WeLocalize and has not been reviewed or approved by WeLocalize.

  • Wellbeing & Lifestyle Benefits — Flexible, fully remote scheduling is often highlighted as making earnings more workable for supplemental income. Feedback suggests that the ability to choose hours and work from home offsets some concerns about lower or variable pay.

WeLocalize Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
2,331 Employees
Year Founded: 1997

What We Do

Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 250,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our people work across offices in North America, Europe, and Asia serving our global clients in the markets that matter to them. • Global team of 2,100+ • Offices in North America, Europe and Asia • Quality Certifications: ISO 9001:2015, ISO/IEC 27001:2013, ISO 17100:2015, ISO 13485:2016, ISO 18587:2017 • Accredited professional translators and interpreters for 250+ languages www.welocalize.com

Similar Jobs

Affirm Logo Affirm

Group Product Management Manager

Big Data • Fintech • Mobile • Payments • Financial Services
Easy Apply
Remote
Canada
2200 Employees
209K-269K Annually

Circle (circle.so) Logo Circle (circle.so)

Lead Engineer, AI Platform

Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Remote
60 Locations
250 Employees

Movable Ink Logo Movable Ink

Senior Back-end Engineer

Artificial Intelligence • Marketing Tech • Software
Easy Apply
Remote or Hybrid
Toronto, ON, CAN
600 Employees
140K-180K Annually

CDW Logo CDW

Field CISO, Cyber Risk

Information Technology
Remote or Hybrid
Thornhill, ON, CAN
15100 Employees

Similar Companies Hiring

Learneo Thumbnail
Software • Machine Learning • Edtech • Artificial Intelligence
NL
397 Employees
Allen Control Systems Thumbnail
Artificial Intelligence • Computer Vision • Machine Learning • Robotics • Defense • Manufacturing
Austin , TX
450 Employees
Blissway Thumbnail
Computer Vision • Fintech • Hardware • Internet of Things • Machine Learning • Software • Transportation
Denver, CO
24 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account