Research Scientist - Audiovisual Understanding, Model Foundations

AI is moving fast. Most people are watching it happen. We’re building what comes next.
At LTX, we’re creating cutting-edge open-world models that help AI understand, simulate, and generate the world around us. We’re laying the groundwork for AI systems that can model how reality looks, moves, and behaves.

These world models will power the next generation of creative tools, physical AI, product simulation, and entirely new ways to build and interact with technology.

We’re not just training models. We’re helping define a new category.

Some opportunities let you work on AI. This one lets you shape its future.

We’re a team of builders, researchers, and creatives who thrive on solving hard problems and pushing beyond what’s considered possible. Curiosity is encouraged. Experimentation is expected. Today we know that great ideas can come from anywhere.

Every breakthrough we make reaches millions of creators and developers worldwide. This can only happen in an environment where you are encouraged to think, push boundaries, create, and explore. Real impact happens when we, as a team, are empowered to experiment, evolve, and elevate together.

The Core Generative AI team at Lightricks Research is a unified group of researchers and engineers dedicated to developing our generative foundational models that serve LTX Studio, our AI-based video creation platform. Our focus is on creating a controllable, cutting-edge video generative model by merging cutting-edge algorithms with exceptional engineering. This involves enhancing machine learning components within our sophisticated internal training framework, crucial for developing advanced models. We specialize in both research and engineering that enable efficient and scalable training and inference, allowing us to deliver state-of-the-art AI-generated video models.

As a Large Scale Video Understanding Research Scientist, you will play a key role in improving video generation quality and efficiency by improving video and audio understanding pipelines used for both training data construction and model evaluation.. This role demands hands-on work with large-scale Video Language Models (VLLMs), including fine-tuning, post-training, and control, alongside implementing classic computer vision and signal processing algorithms and applying strong research skills. Your expertise in post-training and controlling large scale foundational models, understanding statistics, implementing complex systems and eliminating bugs will be crucial, as our video training sets consist of petabytes of data processed across hundreds to thousands of virtual machines.

• Fine-tune and control VLLMs for video and audio understanding.
• Design algorithms for balancing, filtering, and curating training and evaluation datasets, informed by model behavior and failure modes.
• Implement classic and modern algorithms for processing, clustering, evaluation and filtering of large scale datasets.
• Work within high-performance, scalable distributed systems capable of handling petabytes of data, with attention to throughput, correctness, and reproducibility..
• Collaborate with other researchers and product stakeholders to iteratively improve training sets and evaluation protocols through tight feedback loops driven by model performance. 

• Experience training, fine-tuning, or post-training large-scale VLLMs or multimodal foundation models.
• Strong software engineering skills, proficient in Jax or PyTorch.
• Ability to develop and implement computer vision models for data filtering and evaluation.
• Understanding of relevant topics in statistics, clustering.
• Enjoys delving into system implementations to enhance performance and maintainability.

This role is designed for individuals who are not only technically proficient but also deeply passionate about pushing the boundaries of AI and machine learning through innovative engineering and collaborative research.

• We run daily door-to-door shuttles, offering Car-to-go subscriptions from several locations for several locations in central Israel, plus free parking and train-station pickups.
• We’re proud to have 2 chef-led restaurants on site by the legendary Machneyuda Group (yes, that Machneyuda!), plus a bakery nestled in the heart of our office, filled daily with the scent of fresh pastries.
• We empower employees with cutting-edge tools and learning opportunities to grow and succeed through workshops, access and training on platforms, subscriptions, and clear guidelines for responsible AI use.