Open Source Infrastructure Engineer

The Opportunity

AI is rapidly transforming the world. Whether it’s developing the next generation of human-level intelligence, enhancing voice assistants, or enabling researchers to analyze genetic markers at scale, AI is increasingly integrated into various aspects of our daily lives.

Arize AI is the leading AI observability and evaluation platform, empowering AI engineers to build and deploy high-performing, reliable models. As the AI landscape shifts from traditional ML to generative AI and agentic systems, Arize ensures teams have the tools to monitor, troubleshoot, and improve AI in production.

The Role

As an OSS Infrastructure Engineer, you will focus on designing, building, and scaling the open-source infrastructure that powers Arize Phoenix and its associated tools. You’ll work directly with the CTO and open-source team to ensure the platform’s robustness, scalability, and accessibility for developers worldwide. This is a unique opportunity to contribute to foundational infrastructure that will shape the way organizations observe and evaluate AI systems.

You’ll play a pivotal role in helping build a SaaS platform built on top of Phoenix. We’re looking for an exceptional engineer with a passion for open source, a knack for scalable system design, and a commitment to delivering impactful solutions. You’ll play a pivotal role in our engineering organization and within the broader community of Arize Phoenix users and contributors.

We are a fully remote company with offices in the Bay Area and NYC.

What You'll Work On

• Collaborate with internal teams and the open-source community to architect and scale infrastructure that supports Arize Phoenix’s growth.
• Enable and enhance Phoenix’s SaaS capabilities by building out features such as central authentication, data retention, and capacity scaling.
• Build out a robust set of infrastructure tools and services that alleviates the operations of Arize's product offering.

What Will Set You Apart

• 3+ years of experience building scalable infrastructure and developer tools, ideally in an open-source context.   
• Strong understanding of the open-source development lifecycle and community dynamics. 
• Expertise in Kubernetes, Terraform, and other modern infrastructure tools.
• Familiarity with build tools like Bazel and CI/CD systems.
• A pragmatic approach to solving problems and prioritizing impactful solutions over trends.
• Experience working with AI frameworks, LLM integrations, or observability platforms is a plus.
• Familiarity with Go, Python, and some TypeScript is a Plus.

The estimated annual salary and variable compensation for this role is between $125,000 - $225,000, plus a competitive equity package. Actual compensation is determined based upon a variety of job related factors that may include: transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefit package, including: medical, dental, vision, 401(k) plan, unlimited paid time off, generous parental leave plan, and others for mental and wellness support.

While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.