Launched in November 2023, the Nebius platform provides high-end infrastructure and tools for training, fine-tuning and inference. Based in Europe with a global footprint we aspire to become the leading AI cloud for AI practitioners around the world.
Nebius is built around the talents of around 400 highly skilled engineers with a proven track record in developing sophisticated cloud and ML solutions and designing cutting-edge hardware. This allows all the layers of the Nebius cloud – from hardware to UI – to be built in-house, differentiating Nebius from the majority of specialized clouds. As a result, Nebius customers get a true hyperscaler-cloud experience tailored for AI practitioners.
As an NVIDIA preferred cloud service provider, Nebius offers the latest NVIDIA GPUs including H100, L40S, with H200 and Blackwell chips coming soon.
Nebius owns a data center in Finland, built from the ground up by the company’s R&D team. We are expanding our infrastructure and plan to add new colocation data centers in Europe and North America already this year, and to build several greenfield DCs in the near future.
Our Finnish data center is home to ISEG, the most powerful commercially available supercomputer in Europe and the 19th most powerful globally (Top 500 list, June 2024). It also epitomizes our commitment to sustainability, with energy efficiency levels significantly above the global average and an innovative system that recovers waste heat to warm 2,000 residential buildings in the nearby town of Mäntsälä.
Nebius is headquartered in Amsterdam, Netherlands, with R&D and commercial hubs across North America, Europe and Israel.
The role
LLM team is currently in search of senior and staff-level ML engineers to work on the agentic models for software engineering tasks.
Learn more about what our team is working on by visiting this link.
Your responsibilities will include:
- Conducting experiments to figure out efficient ways to train a large language model on traces of interactions with various environments
- Exploring methods of guided generation and search in the trajectory space
- Coming up with ways to mine web-scale data for examples relevant to the tasks of interest and figuring out efficient ways to do post-pretraining on that data
- Ensuring that infrastructure for running models on agentic tasks is robust and performant
We expect you to have:
- A profound understanding of theoretical foundations of machine learning
- Deep expertise in modern deep learning for language processing and generation
- Substantial experience with training large models on multiple nodes
- Reasonable understanding of performance aspects of large neural network training (sharding strategies, custom kernels, hardware features etc.)
- Strong software engineering skills (we mostly use python)
- Deep experience with modern deep learning frameworks (we use jax)
- Proficiency in contemporary software engineering approaches, including CI/CD, version control and unit testing
- Strong communication and leadership abilities
Nice to have:
- Experience with deep reinforcement learning for LLMs, including techniques such as reward modeling, DPO, PPO etc.
- Familiarity with important ideas in LLM space, such as MHA, RoPE, ZeRO/FSDP, Flash Attention, quantization
- Bachelor’s degree in Computer Science, Artificial Intelligence, Data Science, or a related field Master’s or PhD preferred
- Track record of building and delivering products (not necessarily ML-related) in a dynamic startup-like environment
- Experience in engineering complex systems, such as large distributed data processing systems or high-load web services
- Open-source projects that showcase your engineering prowess
- Excellent command of the English language, alongside superior writing, articulation, and communication skills
We’re growing and expanding our products every day. If you’re up to the challenge and are excited about AI and ML as much as we are, join us!
What We Do
Cloud platform specifically designed to train AI models
