Software Engineer (Ray Data)

Posted 5 Days Ago
2 Locations
In-Office
3-4 Annually
Mid level
Artificial Intelligence • Software
The Role
The role focuses on improving Ray Data's performance, ensuring scaling of data pipelines, building data solutions for AI workloads, and enhancing fault tolerance.
Summary Generated by Built In

About Anyscale:

At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.

Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.

About Ray Data Team:

Ray Data is Python-native data processing engine that is a one stop shop for all AI data processing needs. Ray Data provides performant, first-class integration with cutting edge AI frameworks using both multi-modal and structured data.

The Ray Data team currently develops and maintains Ray Data. We are a team of engineers passionate about building a Data processing engine which is a one-stop shop for all of your ML/AI needs. We are looking for exceptional engineers to build, optimize, and scale Ray for modern and increasingly complex AI workloads.

As part of this role, you will:

  • Improve the performance of Ray Data and multi-modal batch inference use cases.

  • Ensure efficient scaling across different stages of the Data pipeline in a heterogeneous environment.

  • Building data loading solutions for production training workloads.

  • Focus on stability and fault tolerance at high scale

  • Working with customers and new age AI native companies in scaling their AI workloads.

We'd love to hear from you if have:

  • At least 3-4 years of relevant work experience

  • Solid background in building scalable and fault-tolerant distributed systems

  • Experience with data processing, database internals.

  • Passionate about large scale systems and performance for AI.

Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. 

Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish

Top Skills

Data Processing
Database Internals
Distributed Systems
Machine Learning
Python
Ray
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
115 Employees
Year Founded: 2019

What We Do

Distributed computing made simple

Anyscale enables developers of all skill levels to easily build applications that run at any scale, from a laptop to a data center.

Similar Jobs

HoneyBook Logo HoneyBook

Senior Customer Success Manager

Fintech • Payments • Productivity • Software • Automation
Hybrid
San Francisco, CA, USA
300 Employees
120K-145K Annually

Tempus AI Logo Tempus AI

Technical Project Manager

Artificial Intelligence • Big Data • Healthtech • Machine Learning • Analytics • Biotech • Generative AI
Hybrid
6 Locations
3775 Employees
100K-140K Annually

Verkada Inc Logo Verkada Inc

Software Engineering Manager

Cloud • Hardware • Security • Software
In-Office
San Mateo, CA, USA
2000 Employees
200K-315K Annually

Samsara Logo Samsara

Software Engineer

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
6 Locations
2800 Employees
180K-253K Annually

Similar Companies Hiring

Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account