(Senior) Software Engineer - Compute Platform

Sorry, this job was removed at 08:37 p.m. (CST) on Saturday, May 31, 2025
2 Locations
In-Office or Remote
Artificial Intelligence • Software
The Role
Building the Future of Decentralized AI Development

At Prime Intellect, we're building the foundation for decentralized AI development at scale. Our platform combines powerful distributed training infrastructure with an intuitive developer experience, enabling researchers and engineers to train state-of-the-art models collaboratively.

We recently raised $15mm in funding (total of $20mm raised) led by Founders Fund, with participation from Menlo Ventures and prominent angels including Andrej Karpathy (Eureka AI, Tesla, OpenAI), Tri Dao (Chief Scientific Officer of Together AI), Dylan Patel (SemiAnalysis), Clem Delangue (Huggingface), Emad Mostaque (Stability AI) and many others.

Role Impact

This is a hybrid role spanning both our developer platform and infrastructure layers. You'll work on two key areas:

1. Our developer-facing platform for AI workload management

2. The underlying distributed infrastructure that powers our training systems

Core Technical Responsibilities

Platform Development

- Build intuitive web interfaces for AI workload management and monitoring

- Develop REST APIs and backend services in Python

- Create real-time monitoring and debugging tools

- Implement user-facing features for resource management and job control

Infrastructure Development

- Design and implement distributed training infrastructure in Rust

- Build high-performance networking and coordination components

- Create infrastructure automation pipelines with Ansible

- Manage cloud resources and container orchestration

- Implement scheduling systems for heterogeneous hardware (CPU, GPU, TPU)

Technical Requirements

Platform Skills

- Strong Python backend development (FastAPI, async)

- Modern frontend development (TypeScript, React/Next.js, Tailwind)

- Experience building developer tools and dashboards

- RESTful API design and implementation

Infrastructure Skills

- Systems programming experience with Rust

- Infrastructure automation (Ansible, Terraform)

- Container orchestration (Kubernetes)

- Cloud platform expertise (GCP preferred)

- Observability tools (Prometheus, Grafana)

Nice to Have

- Experience with GPU computing and ML infrastructure

- Knowledge of AI/ML model architecture and training

- High-performance networking implementation

- Open-source infrastructure contributions

- WebSocket/real-time systems experience

What We Offer

- Competitive compensation with significant equity and token incentives

- Flexible work arrangement (remote or San Francisco office)

- Full visa sponsorship and relocation support

- Professional development budget for courses and conferences

- Regular team off-sites and conference attendance

- Opportunity to shape the future of decentralized AI development

Growth Opportunity

You'll join a team of experienced engineers and researchers working on cutting-edge problems in AI infrastructure. We believe in open development and encourage team members to contribute to the broader AI community through research and open-source contributions.

We value potential over perfection - if you're passionate about democratizing AI development and have experience in either platform or infrastructure development (ideally both), we want to talk to you.

Ready to help shape the future of AI? Apply now and join us in our mission to make powerful AI models accessible to everyone.

Similar Jobs

Collectors Logo Collectors

Senior Manager, CRM (Marketplace)

Consumer Web • eCommerce • Machine Learning • Professional Services • Software • Sports • Analytics
Remote or Hybrid
US
2246 Employees
133K-177K Annually

Boeing Logo Boeing

Security Engineer

Aerospace • Information Technology • Cybersecurity • Defense • Manufacturing
Remote
United States
141000 Employees
146K-178K Annually

Cox Enterprises Logo Cox Enterprises

Technical Customer Care Specialist II (Dealer.com)

Automotive • Cloud • Greentech • Information Technology • Other • Software • Cybersecurity
Remote or Hybrid
United States
50000 Employees
20-29 Hourly

Toast Logo Toast

Staff Software Engineer

Cloud • Fintech • Food • Information Technology • Software • Hospitality
Remote
US
5000 Employees
155K-248K Annually
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
16 Employees

What We Do

Prime Intellect democratizes AI development at scale. Our platform makes it easy to find global compute resources and train state-of-the-art models through distributed training across clusters. Collectively own the resulting open AI innovations, from language models to scientific breakthroughs.

Similar Companies Hiring

Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account