Jobs at Anyscale

Own Anyscale’s compliance function, including SOC 2 and ISO 27001 audits, evidence collection, risk management, customer security diligence, contractual compliance obligations, and future certifications. Partner with security, engineering, IT, legal, sales, and external auditors to maintain audit-ready controls, improve evidence automation, and establish an enterprise-aligned compliance program.

Own Anyscale’s IT engineering function across identity and access, endpoint management, hardware logistics, SaaS vendors, audit controls, and office technology. Build and operate internal automation and notification services, manage Okta and Google Workspace, administer the macOS fleet, automate HRIS-driven provisioning, coordinate hardware procurement and shipping, manage vendor renewals, and support audit evidence collection. This hybrid San Francisco Bay Area role emphasizes secure automation, code ownership, and end-to-end accountability.

Build developer tooling, MLOps capabilities, CLIs, SDKs, APIs, observability features, and highly available services for distributed AI workloads on Ray. Own projects end to end across data preparation, model fine-tuning, evaluation, serving, deployment, debugging, and optimization. Collaborate with users, field teams, and machine learning and distributed-systems experts to deliver intuitive, scalable developer experiences.

Own detection engineering and incident response across corporate and production environments. Build cloud, endpoint, container, runtime, correlation, and alerting capabilities; lead live incidents; develop and exercise response runbooks; tune detections; measure detection and response performance; conduct retrospectives; and partner with infrastructure security and IT to address identified gaps.

Design, build, and scale control- and data-plane infrastructure for distributed AI workloads. Improve reliability, performance, scheduling, and observability for Ray clusters across cloud and on-prem environments. Support accelerator integration, container image management, and provide on-call troubleshooting and cross-team collaboration.

Lead and scale a Customer Engineering team supporting production AI workloads. Own operational health, customer escalations, and technical issue resolution. Partner with Product and Engineering to translate customer feedback into product improvements. Drive automation, diagnostics, documentation, and tooling to reduce recurring issues and improve customer outcomes.

Lead Infrastructure, SRE, and Enterprise Governance Engineering teams to design and operate Anyscale's platform. Own strategy and delivery for cluster launcher, cloud providers (AWS/GCP/Azure), Kubernetes support, autoscaling, control and data planes, reliability, billing, and production databases. Recruit, mentor, and manage a high-performing team while partnering with customers and field engineering to solve distributed systems challenges.

Develop and optimize Ray Data, a Python-native distributed data processing engine for AI workloads. Improve performance, scalability, data loading, stability, and fault tolerance across heterogeneous environments. Build production training data solutions and collaborate with customers and AI-native companies to scale large machine learning workloads.

The Customer Engineer manages post-sale customer journeys, resolves issues, advises customers on Anyscale platform, and collaborates with engineering teams.

Develop high-quality open-source software to simplify distributed programming while working on architectural improvements and enhancing testing processes for the Ray core.

Develop high-quality software for distributed programming, optimize Ray's Datasets library, and improve testing processes. Communicate work through tutorials and talks.

The role focuses on optimizing ML inference at scale, collaborating with product teams, integrating Ray Data, and enhancing open-source contributions.

Design and implement scalable cloud infrastructure for distributed AI applications, focusing on control and data planes, optimizing performance and reliability of services, and integrating with existing tools.

Build and scale control and data plane infrastructure for Ray-based distributed AI workloads. Design orchestration, scheduling, resource management, observability, and accelerator integration for VM and Kubernetes deployments. Support on-call operations, performance and reliability improvements, and collaborate on open-source and proprietary integrations.

Bay Area-based hunter Enterprise Account Executive responsible for prospecting, developing, and closing new enterprise business for Anyscale. Manage complex sales cycles, achieve quotas, lead CxO engagements, qualify opportunities, collaborate with marketing, and drive ongoing account growth while advising customers on ML, compute, and cloud solutions.

The role involves developing open source software for distributed programming, optimizing performance, improving testing processes, and communicating findings publicly.

Lead Ray Data, a scalable data processing library, by managing the product roadmap, encouraging open source adoption, and engaging with customers.