Infrastructure Engineer

AI is rapidly transforming the world. Whether it’s developing the next generation of human-level intelligence, enhancing voice assistants, or enabling researchers to analyze genetic markers at scale, AI is increasingly integrated into various aspects of our daily lives.

Arize AI is the leading AI observability and evaluation platform, helping AI teams discover issues, diagnose problems, and improve the results of their AI applications. We are here to build world-class software that helps make AI applications work better — and we’re inviting you to join us on this mission.

About Arize Phoenix

Large Language Models (LLMs) like GPT4 are capable of human and super-human reasoning, but they don’t understand your personal data, are unable to perform complex tasks, remember the actions they performed yesterday, and so on. The core mission of the Arize OSS team is to enable developers to build LLM-powered applications with safety and observability in mind.

We are at the forefront of a new way to build software. Doing this successfully will usher in a new age of knowledge automation and completely redefine the modern tech stack.

Our product offerings consist of an open-source Typescript libraries as well as an enterprise platform. Arize Phoenix has hundreds of thousands monthly downloads and is used from large enterprises to early-stage startups - it is both easy to get started but robust for production use. We’re backed by TCV, Foundation Capital, Swift Ventures, and Battery Ventures.

You will focus on designing, building, and scaling the infrastructure that powers Arize’s platform services. You will work directly with our open-source team to ensure the Arize Phoenix’s  robustness, scalability, and accessibility for developers worldwide. This is a unique opportunity to contribute to foundational infrastructure that will shape the way organizations observe and evaluate AI systems.

• Collaborate with internal teams and the open-source community to architect and scale infrastructure that supports Arize Phoenix’s growth.
• Enable and enhance Phoenix’s SaaS capabilities by building out features such as central authentication, data retention, and capacity scaling.
• Build out a robust set of infrastructure tools and services that alleviates the operations across the suite of Arize's product offering.

• 3+ years of experience building scalable infrastructure and developer tools, ideally in an open-source context.
• Strong understanding of the open-source development lifecycle and community dynamics.
• Expertise in Kubernetes, Terraform, and other modern infrastructure tools.
• Familiarity with build tools like Bazel and CI/CD systems.
• A pragmatic approach to solving problems and prioritizing impactful solutions over trends.
• Experience working with AI frameworks, LLM integrations, or observability platforms is a plus.
• Familiarity with Go, Python, and some TypeScript is a plus.

Location:

The estimated annual salary and variable compensation for this role is between $125,000 - $225,000, plus a competitive equity package. Actual compensation is determined based upon a variety of job related factors that may include: transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefit package, including: medical, dental, vision, 401(k) plan, unlimited paid time off, generous parental leave plan, and others for mental and wellness support.

While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.