Be an Early Applicant
Luma AI’s mission is to build Multimodal AGI
The Role
The Research Engineer will design scalable evaluation systems for multimodal generative AI models, integrating metrics and automated pipelines for model assessment and improvement.
Summary Generated by Built In
About Luma AI
Luma's mission is to build multimodal AI to expand human imagination and capabilities. We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable, and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.
About the Role
Luma is pushing the boundaries of generative AI, building tools that redefine how visual content is created. We're seeking a Research Engineer to design and scale the infrastructure that powers our model evaluation efforts. This role is about building the pipelines, metrics, and automated systems that close the loop between model output, evaluation, and improvement. You'll work across research, engineering, and product teams to ensure our models are measured rigorously, consistently, and in ways that directly inform development.
Responsibilities
- Design and implement scalable pipelines for automated evaluation of generative models, with a focus on visual and multimodal outputs (image, video, text, audio).
- Develop novel metrics and evaluation models that capture qualities like fidelity, coherence, temporal consistency, and alignment with human intent.
- Integrate evaluation signals into training loops (including reinforcement learning and reward modeling) to continuously improve model performance.
- Build infrastructure for large-scale regression testing, benchmarking, and monitoring of multimodal generative models.
- Collaborate with researchers running human studies to translate human evaluation frameworks into automated or semi-automated systems.
- Partner with model researchers to identify failure cases and build targeted evaluation harnesses.
- Maintain dashboards, reporting tools, and alerting systems to surface evaluation results to stakeholders.
- Stay current with emerging evaluation techniques in generative AI, multimodal LLMs, and perceptual quality assessment.
Qualifications
- Master's or PhD in Computer Science, Machine Learning, or a related technical field (or equivalent industry experience).
- 5+ years of experience building ML evaluation systems, model pipelines, or large-scale infrastructure.
- Hands-on experience working with visual data (images and/or video), including evaluation, modeling, or data preparation.
- Proficiency in Python and ML frameworks (PyTorch, JAX, or TensorFlow).
- Familiarity with human-in-the-loop evaluation workflows and how to scale them with automation.
- Strong background in machine learning, with experience in generative models (diffusion, LLMs, multimodal architectures).
- Strong software engineering skills (CI/CD, testing, data pipelines, distributed systems).
Nice to Have
- Experience with reinforcement learning or reward modeling.
- Prior work on perceptual metrics, multimodal evaluation benchmarks, or retrieval-based evaluation.
- Background in large-scale model training or evaluation infrastructure.
- Experience designing metrics for perceptual quality
- Familiarity with creative media workflows (film, VFX, animation, digital art).
- Contributions to open-source evaluation libraries or benchmarks.
Luma’s mission is to build unified general intelligence that can generate, understand, and operate in the physical world.
We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.
Skills Required
- Master's or PhD in Computer Science, Machine Learning, or a related technical field
- 3+ years of experience building ML evaluation systems, model pipelines, or large-scale infrastructure
- Hands-on experience working with visual data (images or video)
- Proficiency in Python and ML frameworks (PyTorch, JAX, or TensorFlow)
- Strong background in machine learning, with experience in generative models
- Strong software engineering skills (CI/CD, testing, data pipelines, distributed systems)
Luma AI Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Luma AI and has not been reviewed or approved by Luma AI.
-
Fair & Transparent Compensation — Pay is considered competitive for senior technical and some non-technical roles, with posted bands indicating strong market alignment in key locations. Publicly listed ranges provide directional clarity for certain roles and markets.
-
Equity Value & Accessibility — Equity is positioned as a meaningful component of total compensation, and language in postings emphasizes ownership alongside cash pay. Signals indicate equity can be significant in senior roles where competition for talent is intense.
-
Healthcare Strength — Core medical, dental, and vision coverage are referenced in multiple postings, aligning with standard expectations for venture-backed tech companies. These inclusions suggest baseline health benefits are part of the package.
Luma AI Insights
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Luma AI’s mission is to build Multimodal AGI: AI that can generate, understand, and operate in the physical world. We develop multimodal models across video, 3D, and generative media, and ship them in products like Dream Machine to help creators and teams turn ideas into compelling visuals—fast.
