Senior Software Engineer, Distributed Systems

Reposted 18 Days Ago
7 Locations
In-Office or Remote
Senior level
Artificial Intelligence • Cloud • Hardware • Information Technology • Software
The Role
Design, build, and secure scalable distributed backend systems for AI workloads. Implement microservice-based architectures, manage Kubernetes-based deployments, apply IaC and DevOps practices, and collaborate with performance and solutions engineering to optimize model deployment and infrastructure cost, security, and scalability.
Summary Generated by Built In

Parasail is redefining AI infrastructure by enabling seamless deployment across a distributed network of GPUs, optimizing for cost, performance, and flexibility. Our mission is to empower AI developers with a fast, cost-efficient, and scalable cloud experience—free from vendor lock-in and designed for the next generation of AI workloads.

Job Description

The Senior Software Engineer, Distributed Systems role at Parasail is crucial for ensuring the seamless deployment, scalability, and security of our AI platform. This position is tailored for individuals passionate about creating robust infrastructures that support complex AI workloads, with a strong emphasis on cloud compatibility, security, ease of use, and cost savings. You will work closely with AI-focused performance and solutions engineering teams, facilitating the orchestration of resources needed for high-performing AI applications, all while ensuring our infrastructure adheres to the highest standards of security and data privacy.

Technical Abilities
  • Microservice Architecture: Deep understanding of distributed application design patterns, service decomposition, and inter-service communication. Experience in building scalable and maintainable microservice-based systems.

  • Backend Development: Strong foundation in storage solutions and networking protocols. Ability to design and implement robust backend systems with optimized data management and network communication.

  • Programming Languages & Frameworks: Extensive experience with Java, Spring Boot, and Golang. Proficiency in developing enterprise-grade applications using modern development frameworks and tools.

  • Distributed Systems: Deep knowledge of distributed computing principles, including consistency models, fault tolerance, and scalability patterns. Experience in designing and maintaining large-scale distributed applications.

  • Cloud-Native Technologies: Proficiency in cloud platforms and Infrastructure as Code (IaC). Experience with containerization, orchestration, and automated infrastructure deployment using modern DevOps practices.

  • Large Language Models: Understanding of LLM technologies and their applications. Experience in integrating and working with AI language models in production environments, including model deployment and optimization.

Qualifications
  • 5+ years of experience in backend or infrastructure, with exposure in Kubernetes and distributed computing environments.

  • Demonstrated ability to build and secure scalable, high-performance backend.

  • Hands-on to build brand new system and make end to end work

  • Excellent problem-solving skills, with a track record of designing solutions that address the complex needs of AI workloads.

  • While AI experience is not required, a demonstrated capacity to learn new technologies and stay up-to-date on the cutting edge is essential.

What You Bring to the Table

This role is pivotal in building a new breed of cloud architecture that enables enterprises to build powerful AI in their preferred environment with the same performance and economics as uncontrolled external services. This role ensures our AI solutions are not just innovative but also secure and sustainable. If you're passionate about learning the cutting edge of AI, building the future of infrastructure, and making a tangible impact to the early days of a company, we're excited to welcome you aboard.

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Mateo, California
23 Employees
Year Founded: 2023

What We Do

Parasail is the first AI Deployment Network built for the new era of open and scalable AI. We connect teams to the world’s largest pool of on-demand GPU compute—giving AI builders fast, flexible, and cost-efficient infrastructure to deploy and scale models without contracts, quotas, or cloud complexity. From real-time inference to massive batch jobs, Parasail intelligently matches workloads across a global GPU network, optimizing for performance, price, and geography. No DevOps burden, no vendor lock-in—just plug-and-play access to high-performance infrastructure that works with the latest open-source models and evolving AI stacks. Companies like Weights & Biases, Elicit, Rasa, Everpilot, and Oumi are already building faster and saving up to 30x on costs with Parasail. The future of AI deployment isn’t a single cloud. It’s a global compute network. Parasail is making that future a reality. 🔗 www.parasail.io

Similar Jobs

Webflow Logo Webflow

Staff Software Engineer

Artificial Intelligence • Enterprise Web • Software • Design • Generative AI
Easy Apply
Remote
3 Locations
800 Employees
205K-290K Annually
Remote
Canada
275 Employees
180K-230K Annually

Block Logo Block

Policy + External Affairs Communications Lead

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
In-Office or Remote
8 Locations
12000 Employees
136K-245K Annually

Airwallex Logo Airwallex

People Operations & Workplace Experience Specialist

Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Remote or Hybrid
Toronto, ON, CAN
2000 Employees

Similar Companies Hiring

Bellagent Thumbnail
Artificial Intelligence • Machine Learning • Business Intelligence • Generative AI
Chicago, IL
20 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account