Senior Software Engineer, Infrastructure

Posted 10 Days Ago
Be an Early Applicant
New York, NY, USA
In-Office
200K-280K Annually
Senior level
Professional Services • Consulting
The Role
Own and scale infrastructure for concurrent, stateful AI workloads. Responsibilities include dispatch-layer reliability, queueing, concurrency control, failure handling, realistic system testing, evaluation development, platform integrations, and support for external orchestration frameworks. The role requires production backend and distributed infrastructure experience, cluster management expertise, and experience supporting large language model workloads.
Summary Generated by Built In

About the company

Our client is a data infrastructure company.

The role

Raydar is recruiting for this role on behalf of our client. Own the platform that runs many concurrent, stateful workloads for AI systems. The work covers job dispatch and reliability, designing realistic test scenarios, and extending the platform with new integrations as the field evolves.

What you'll do

- Run and scale the dispatch layer for many parallel, stateful workloads, including queueing, concurrency control and failure handling.

- Design realistic environments and test scenarios that probe system limits and measure what matters, not only what is easy to measure.

- Build new evaluation approaches and extend the platform to support additional environment types.

- Ship integrations with external orchestration frameworks.

- Keep pace with a fast-moving area and bring new ideas into the platform.


Requirements

What we're looking for

- A track record of designing, launching and growing production backend systems that handle heavy traffic and large volumes of data.

- Background at a startup that grew quickly or at a fast-paced large technology company.

- Comfort with cluster management tooling and event-driven system design.

- Experience maintaining distributed services and infrastructure for large language model workloads.

Bonus points

- Experience running AI or machine learning workloads at scale.

- Experience at both an early-stage startup and a large technology company.

- Extensive hands-on experience with Kubernetes.


Benefits

Compensation and benefits

- Base salary: USD 200,000 to 280,000 per year

- Equity

Location and work model

- New York, NY, United States

- Hybrid, 2-3 days per week in the office

- Remote option may be available for strong candidates

- Full-time

Skills Required

  • Track record designing, launching, and scaling production backend systems handling heavy traffic and large data volumes
  • Background at a rapidly growing startup or fast-paced large technology company
  • Experience with cluster management tooling and event-driven system design
  • Experience maintaining distributed services and infrastructure for large language model workloads
  • Experience running AI or machine learning workloads at scale
  • Experience at both an early-stage startup and a large technology company
  • Extensive hands-on experience with Kubernetes
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
28 Employees
Year Founded: 2021

What We Do

Raydar is a talent acquisition and business consulting firm that connects world-class and emerging talent with growing organizations. It supports companies through team development, strategic hiring, and customized growth solutions, helping clients recruit roles such as engineers, product managers, executives, legal counsel, and quantitative traders. Raydar focuses on understanding each organization’s needs, culture, and long-term goals to build high-impact teams.

Similar Jobs

MongoDB Logo MongoDB

Senior Software Engineer

Big Data • Cloud • Software • Database
Easy Apply
Remote or Hybrid
3 Locations
5550 Employees
126K-248K Annually

CoreWeave Logo CoreWeave

Senior Software Engineer

Cloud • Information Technology • Machine Learning
In-Office
2 Locations
1450 Employees
153K-204K Annually

General Intuition & Medal Logo General Intuition & Medal

Staff Software Engineer

Artificial Intelligence • Machine Learning • Robotics • Generative AI
In-Office
New York City, NY, USA
41 Employees
180K-275K Annually

Schrödinger, Inc. Logo Schrödinger, Inc.

Senior Software Engineer

Healthtech • Machine Learning • Software • Biotech • Pharmaceutical
Hybrid
New York, NY, USA
885 Employees
155K-270K Annually

Similar Companies Hiring

Fora Thumbnail
Agency • On-Demand • Professional Services • Sales • Software • Travel • Hospitality
New York, NY
250 Employees
Energy CX Thumbnail
Greentech • Professional Services • Business Intelligence • Consulting • Energy • Financial Services • Utilities
Chicago, IL
150 Employees
Cravath, Swaine & Moore LLP Thumbnail
Legal Tech • Other • Professional Services
New York, NY
1200 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account