Research Intern

Our mission is to build the next generation of AI: ubiquitous, interactive intelligence that runs wherever you are. Today, not even the best models can continuously process and reason over a year-long stream of audio, video and text—1B text tokens, 10B audio tokens and 1T video tokens—let alone do this on-device.

We're pioneering the model architectures that will make this possible. Our founding team met as PhDs at the Stanford AI Lab, where we invented State Space Models or SSMs, a new primitive for training efficient, large-scale foundation models. Our team combines deep expertise in model innovation and systems engineering paired with a design-minded product engineering team to build and ship cutting edge models and experiences.

We're funded by leading investors at Index Ventures and Lightspeed Venture Partners, along with Factory, Conviction, A Star, General Catalyst, SV Angel, Databricks and others. We're fortunate to have the support of many amazing advisors, and 90+ angels across many industries, including the world's foremost experts in AI.

The role

As a research intern, you'll have the opportunity to work inside our research team in pioneering multimodal models built on new model architectures.

Your main responsibility will be to push the quality, efficiency and capabilities of our pretrained models, in collaboration with a variety of machine learning, data and systems engineering stakeholders.

• implement new model backbones, architectures and training algorithms,

• rapidly run and iterate on experiments and ablations,

• build training infrastructure that scales to massive multimodal datasets,

• stay up-to-date on new research ideas.

Note: we don't offer part-time or remote internships.

What we’re looking for

• Comfortable navigating complex machine learning codebases.

• Deep machine learning background, including a strong grasp of fundamentals in sequence modeling, generative models and common model architecture families (RNNs, CNNs, Transformers).

• Experienced model trainer, ideally previously wrote and pretrained large-scale models.

• Proficient in Python and Pytorch (or similar framework) and tensor programming more broadly.

• Familiarity with efficiency tradeoffs in designing model architectures for accelerators such as GPUs.

• Pursuing advanced degrees in machine learning (MS/PhD). Regardless of background, consider applying if you have strongly relevant experience.

• [bonus] Prior research experience in advancing state space models or implementing them in practice.

• [bonus] Experience in optimizing model inference with CUDA, Triton or other frameworks.

We'd encourage you to apply even if you feel that you don't meet every criteria listed here.

Our perks

🍽 Lunch, dinner and snacks at the office.

✈️ Relocation assistance.

🦖 Your own personal Yoshi.

🏢 We’re an in-person team based out of San Francisco. We love being in the office, hanging out together and learning from each other everyday.

🚢 We ship fast. All of our work is novel and cutting edge, and execution speed is paramount. We have a high bar, and we don’t sacrifice quality and design along the way.

🤝 We support each other. We have an open and inclusive culture that’s focused on giving everyone the resources they need to succeed.