Mirage is the leading AI short-form video company. We’re building full-stack foundation models and products that redefine video creation, production and editing. Over 20 million creators and businesses use Mirage’s products to reach their full creative and commercial potential.
We are a rapidly growing team of ambitious, experienced, and devoted engineers, researchers, designers, marketers, and operators based in NYC. As an early member of our team, you’ll have an opportunity to have an outsized impact on our products and our company's culture.
Our Products
Captions
Mirage Studio
Our Technology
AI Research @ Mirage
Mirage Model Announcement
Seeing Voices (white-paper)
Press Coverage
TechCrunch
Lenny’s Podcast
Forbes AI 50
Fast Company
Our Investors
We’re very fortunate to have some the best investors and entrepreneurs backing us, including Index Ventures, Kleiner Perkins, Sequoia Capital, Andreessen Horowitz, Uncommon Projects, Kevin Systrom, Mike Krieger, Lenny Rachitsky, Antoine Martin, Julie Zhuo, Ben Rubin, Jaren Glover, SVAngel, 20VC, Ludlow Ventures, Chapter One, and more.
** Please note that all of our roles will require you to be in-person at our NYC HQ (located in Union Square)
We do not work with third-party recruiting agencies, please do not contact us**
About the role:
Captions is seeking an exceptional Research Engineer (MOTS) to advance the state-of-the-art in large-scale multimodal video diffusion models. You'll conduct novel research on generative modeling architectures, develop new training techniques, and scale models to billions of parameters. As a key member of our ML Research team, you'll work at the cutting edge of multimodal generation while building systems that enable natural, controllable video creation. We're already training large-scale models with demonstrated product impact, and we're excited to continue expanding the scope and capabilities of our research.
We're especially excited about pushing the boundaries of audio-video generation, with a focus on realistic and charismatic human behavior that enables natural storytelling and creative iteration. Our models power creative tools used by millions of creators, and we're tackling fundamental challenges in how to generate compelling human motion, expression, and speech.
Key Responsibilities:
Research & Architecture Development:
Design and implement novel architectures for large-scale video and multimodal diffusion models
Develop new approaches to multimodal fusion, temporal modeling, and video control
Research temporal video editing techniques and controllable generation
Research and validate scaling laws for video generation models
Create new loss functions and training objectives for improved generation quality
Drive rapid experimentation with model architectures and training strategies
Validate research directly through product deployment and user feedback
Model Training & Optimization:
Train and optimize models at massive scale (10s-100s of billions of parameters)
Develop sophisticated distributed training approaches using FSDP, DeepSpeed, Megatron-LM
Design and implement model surgery techniques (pruning, distillation, quantization)
Create new approaches to memory optimization and training efficiency
Research techniques for improving training stability at scale
Conduct systematic empirical studies of architecture and optimization choices
Technical Innovation:
Advance state-of-the-art in video model architecture design and optimization
Develop new approaches to temporal modeling for video generation
Create novel solutions for multimodal learning and cross-modal alignment
Research and implement new optimization techniques for generative modeling and sampling
Design and validate new evaluation metrics for generation quality
Systematically analyze and improve model behavior across different regimes
Requirements:
Research Experience:
Master's or PhD in Computer Science, Machine Learning, or related field
Track record of research contributions at top ML conferences (NeurIPS, ICML, ICLR)
Demonstrated experience implementing and improving upon state-of-the-art architectures
Deep expertise in generative modeling approaches (diffusion, autoregressive, VAEs, etc.)
Strong background in optimization techniques and loss function design
Experience with empirical scaling studies and systematic architecture research
Technical Expertise:
Strong proficiency in modern deep learning tooling (PyTorch, CUDA, Triton, FSDP, etc.)
Experience training diffusion models with 10B+ parameters
Experience with very large language models (200B+ parameters) is a plus
Deep understanding of attention, transformers, and modern multimodal architectures
Expertise in distributed training systems and model parallelism
Proven ability to implement and improve complex model architectures
Track record of systematic empirical research and rigorous evaluation
Engineering Capabilities:
Ability to write clean, modular research code that scales
Strong software engineering practices including testing and code review
Experience with rapid prototyping and experimental design
Strong analytical skills for debugging model behavior and training dynamics
Facility with profiling and optimization tools
Track record of bringing research ideas to production
Experience maintaining high code quality in a research environment
About the Team:
You'll work directly alongside our research and engineering teams in our NYC office. We've intentionally built a culture where technical innovation and research excellence are highly valued - your success will be measured by your contributions to improving our models and advancing the field, not by your ability to navigate politics. We're a team that loves diving deep into complex technical problems and emerging with practical breakthroughs.
Our team values:
Open technical discussions and collaboration
Rapid iteration and practical solutions
Deep technical expertise and continuous learning
Direct impact on research and product outcomes
What sets us apart:
Opportunity to advance the state-of-the-art in video generation
Direct impact on products used by millions of creators
Access to massive compute resources and diverse, large-scale datasets
Environment that values both research excellence and practical impact
Ability to validate research through direct product feedback
Comprehensive medical, dental, and vision plans
401K with employer match
Commuter Benefits
Catered lunch multiple days per week
Dinner stipend every night if you're working late and want a bite!
Grubhub subscription
Health & Wellness Perks (Talkspace, Kindbody, One Medical subscription, HealthAdvocate, Teladoc)
Multiple team offsites per year with team events every month
Generous PTO policy
Captions provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
Please note benefits apply to full time employees only.
Top Skills
What We Do
We’re building full-stack foundation models and products that are changing video creation, production and editing more broadly. Over 20 million creators and businesses use Mirage’s products to reach their full creative and commercial potential.
We are a rapidly growing team of ambitious, experienced, and devoted engineers, researchers, designers, marketers, and operators based in NYC. As an early member of our team, you’ll have an opportunity to have an outsized impact on our products and our company's culture.
Gallery
