Software Engineer (Ray Core)

Reposted Yesterday
2 Locations
Hybrid
Junior
Artificial Intelligence • Software
The Role
The role involves developing open source software for distributed programming, optimizing performance, improving testing processes, and communicating findings publicly.
Summary Generated by Built In

About Anyscale:

At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.

Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.

About the role

Ray aims to provide a universal API for building distributed applications. To achieve this goal requires a distributed system with high levels of performance and reliability. We're looking for engineers with systems software experience that are interested in contributing to the Ray backend.


About the Ray Core Team

The Ray Core team develops and maintains the Ray C++ backend (e.g., distributed scheduler, language runtime integration, I/O and memory subsystems). We are responsible for the reliability, scalability, and performance of Ray as well as ensuring that Ray provides the right feature set to support higher level libraries and use cases. The team works on a balance of new features / distributed libraries, test infra improvements, debugging, and longer-term architectural improvements to Ray.

A snapshot of projects you can work on:

  • Optimizing performance of large-scale workloads on Ray

  • Stability and stress testing infrastructure

  • Improving fault tolerance (HA)

As part of this role, you will:

  • Leading cross-team projects while mentoring junior team members

  • Develop high quality open source software to simplify distributed programming (Ray)

  • Identify, implement, and evaluate architectural improvements to Ray core

  • Improve the testing process for Ray to make releases as smooth as possible

  • Communicate your work to a broader audience through talks, tutorials, and blog posts

We'd love to hear from you if you have:

  • At least 5 year of relevant work experience

  • Experience in building scalable and fault-tolerant distributed systems

  • Extensive experience working in C/C++ and on low level operating systems

  • Solid background in algorithms, data structures, system design

  • Knowledge of distributed model training and inference (e.g. tensor parallel, pipeline parallel) is preferred

  • Knowledge of GPU programming is preferred

Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. 


Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish

Skills Required

  • At least 2 years of relevant work experience
  • Solid background in algorithms, data structures, system design
  • Experience in building scalable and fault-tolerant distributed systems
  • Knowledge of distributed model training and inference preferred
  • Knowledge of GPU programming preferred

Anyscale Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Anyscale and has not been reviewed or approved by Anyscale.

  • Fair & Transparent Compensation Pay is considered market-based with target ranges shown in postings and a stated market-based philosophy. Feedback suggests this clarity and consistency aid confidence in pay fairness.
  • Equity Value & Accessibility Equity is commonly included in offers and is positioned as a meaningful part of total compensation for many roles. Feedback suggests this equity participation enhances perceived overall pay competitiveness.
  • Healthcare Strength Health, dental, and vision coverage are described as robust with many plan options, alongside mental-health support and fertility benefits. Feedback suggests this strong core healthcare offering increases perceived benefits quality.

Anyscale Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
115 Employees
Year Founded: 2019

What We Do

Distributed computing made simple Anyscale enables developers of all skill levels to easily build applications that run at any scale, from a laptop to a data center.

Similar Jobs

Leader Bank Logo Leader Bank

Business Development Manager

Fintech • Insurance • Payments • Social Impact • Financial Services
Remote or Hybrid
United States
420 Employees
72K-108K Annually

ServiceNow Logo ServiceNow

Sr Director, Product Pricing

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Santa Clara, CA, USA
29000 Employees
220K-397K Annually

ServiceNow Logo ServiceNow

Software Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Santa Clara, CA, USA
29000 Employees
201K-352K Annually

ServiceNow Logo ServiceNow

Tech Lead, Agentic AI Product - Moveworks

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Mountain View, CA, USA
29000 Employees
400K-600K Annually

Similar Companies Hiring

Bellagent Thumbnail
Artificial Intelligence • Machine Learning • Business Intelligence • Generative AI
Chicago, IL
20 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York City, NY
100 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account