Research Scientist / Engineer - Controllability, Personalization & Productization

Reposted 23 Days Ago
Be an Early Applicant
10 Locations
Remote or Hybrid
188K-395K Annually
Expert/Leader
Artificial Intelligence • Software
Luma AI’s mission is to build Multimodal AGI
The Role
The role focuses on refining Luma's foundation models for better controllability and personalization while collaborating across research, product, and design teams.
Summary Generated by Built In
About the Role
This is a foundational opportunity to refine, personalize, and build the final capabilities and control interface of Luma’s foundation models and drive real-world value.
You’ll sit at the intersection of research, product, and partnerships, helping close the gap between generalist capability and production needs. Your mission is to make our video foundation models more expressive, controllable, and personalized – solving the “last mile” challenges demanded by top-tier creative workflows.

What You’ll Do
You will work as a fullstack researcher across modeling, data, systems, and evaluation to translate foundational capabilities into the personalized and high-fidelity tools required by top-tier creative production.
  • Controllability and Features: You will use SFT, RL, distillation, and adapter-based methods to give Luma’s models precise control and creative capabilities for high-fidelity, partner-grade workflows.
  • Personalization: You will use context management, PEFT, and preference learning to embed domain expertise and long-horizon memory into our models. You’ll ground our data engine in real-world workflows, translating usage into training and data insights that shape future models.
  • End-User Quality: You will define and drive end-user quality – setting success metrics, building user-aligned evaluations, and iterating on the model/data/evals loop to meet  strict fidelity and reliability targets in specific verticals.
  • Cross-functional Collaboration: You will partner with Product and Design to turn creative intent and user feedback into clear specs and shippable model behaviors, delivering intuitive control and dependable capabilities for users and partners.


Who You Are
  • Strong foundation in machine learning with deep experience in visual generative models (diffusion/transformers or related architectures). Ideal candidates also have a deep understanding of at least one: fine-tuning, personalization, domain adaptation, data curation, targeted distillation, interpretability, or human-feedback-driven refinement.
  • You are a product-obsessed researcher/engineer. You treat end users and partners as collaborators and enjoy solving specific “last mile” problems – not just optimizing public metrics.
  • Hands-on experience with PyTorch and large model training.

Bonus Points
  • Contributions to state-of-the-art models in image/video generation.
  • Experience collaborating with creative partners (VFX, animation, film, design tools).
  • Track record building workflows/tools that materially improve iteration speed and evaluation rigor.
  • Familiarity with large-scale training infrastructure and distributed systems (Ray, Slurm, Kubernetes).
Compensation
The base pay range for this role is $187,500 – $395,000 per year.
About Luma

Luma’s mission is to build unified general intelligence that can generate, understand, and operate in the physical world.

We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.

Skills Required

  • Strong foundation in machine learning with deep experience in visual generative models
  • Hands-on experience with PyTorch and large model training
  • Deep understanding of fine-tuning, personalization, domain adaptation, data curation, targeted distillation, or interpretability

Luma AI Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Luma AI and has not been reviewed or approved by Luma AI.

  • Fair & Transparent Compensation Pay is considered competitive for senior technical and some non-technical roles, with posted bands indicating strong market alignment in key locations. Publicly listed ranges provide directional clarity for certain roles and markets.
  • Equity Value & Accessibility Equity is positioned as a meaningful component of total compensation, and language in postings emphasizes ownership alongside cash pay. Signals indicate equity can be significant in senior roles where competition for talent is intense.
  • Healthcare Strength Core medical, dental, and vision coverage are referenced in multiple postings, aligning with standard expectations for venture-backed tech companies. These inclusions suggest baseline health benefits are part of the package.

Luma AI Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco Bay Area, CA
246 Employees
Year Founded: 2021

What We Do

Luma AI’s mission is to build Multimodal AGI: AI that can generate, understand, and operate in the physical world. We develop multimodal models across video, 3D, and generative media, and ship them in products like Dream Machine to help creators and teams turn ideas into compelling visuals—fast.

Similar Jobs

ServiceNow Logo ServiceNow

Technical Support

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Toronto, ON, CAN
29000 Employees

ServiceNow Logo ServiceNow

Technical Support

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Toronto, ON, CAN
29000 Employees

Block Logo Block

Head Of Product

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
In-Office or Remote
8 Locations
12000 Employees
305K-457K Annually

Block Logo Block

Senior Manager, Strategic Account Management- Services

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
In-Office or Remote
8 Locations
12000 Employees
185K-327K Annually

Similar Companies Hiring

Bellagent Thumbnail
Artificial Intelligence • Machine Learning • Business Intelligence • Generative AI
Chicago, IL
20 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York City, NY
100 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account