Software Engineer - Back End

About Distyl AI

Distyl AI develops AI native technologies for humans & AI to collaborate to power the operations of the Global Fortune 1000.

In just 24 months, we’ve rapidly grown to partner with some of the world’s largest enterprises—including F100 telecom, healthcare, manufacturing, insurance, and retail companies—delivering multiple AI deployments with $100M+ impact. Our platform, Distillery, along with our team of AI Engineers, Researchers, and Strategists, is pioneering AI-native systems of work, solving the most complex, high-stakes challenges at scale.

Distyl is founded and led by proven leaders from companies like Palantir, Apple, and top national laboratories. We work in deep partnership with OpenAI, jointly going-to-market at the largest enterprises and collaborating evaluating and testing the latest models. Backed by Lightspeed, Khosla, Coatue, industry leaders like Nat Friedman (former GitHub CEO), as well as board members of over 20+ F500s, Distyl is building the future of AI-powered enterprise operations.

What You'll Do

As a Software Engineer Back End you will help design, build, and optimize Distillery—our AI-native platform that powers real-world enterprise AI systems for diverse F500 workflows.

Your role will involve developing scalable AI infrastructure, ensuring system reliability, and collaborating with engineers and business leaders to solve some of the most complex AI deployment challenges.

Key Responsibilities

Build & Scale AI-Native Infrastructure: Develop and refine a platform where AI builds, optimizes, and operates AI-powered workflows. Define how AI automation integrates into traditional enterprise infrastructure.

Develop Cloud-Native Microservices & Scalable AI Systems: Design and build secure, high-performance backend services deployed across AWS/GCP/Azure or on-prem Kubernetes environments. Build using Python, FastAPI, SQLAlchemy, Alembic, and modern DevOps tools to develop scalable, reliable AI infrastructure.

Optimize System Performance & Reliability: Ensure high-availability, security, and observability of AI-native workflows. Implement best practices for ML/AI Ops, distributed computing, and scalable service orchestration.

Collaborate with Cross-Functional Teams: Partner with Forward-Deployed Engineers (FDEs), AI Researchers, and business SMEs to translate real-world operational needs into platform capabilities. Advocate for strong software engineering and DevOps practices, driving high coding standards and scalable architectures.

Who We’re Looking For

We are hiring multiple roles across different levels of seniority (3-10+ years of software engineering experience).

Proficiency in Backend & Systems Engineering. Expertise in Python, Java, Golang, or C++ for building scalable, high-performance systems.

Hands-on experience with Kubernetes, CI/CD, cloud platforms (AWS, GCP, or Azure), and infrastructure as code.

Strong interest in AI-native development, leveraging tools like ChatGPT, Claude, Perplexity, and Cursor in engineering workflows.

Experience with security, distributed systems, storage, ML/AI Ops, and large-scale observability is a plus.

What We Offer

The opportunity to build enterprise-scale AI infrastructure used by Fortune 500 companies.

Work alongside top engineers, AI researchers, and enterprise experts in an AI-native company.

Competitive salary, benefits, and equity in a fast-growing startup.

Hybrid work environment – 3 days a week in our NYC or San Francisco office.

If you’re a strong backend software engineer with a passion for building AI infrastructure, we’d love to hear from you. Apply now and help shape the future of AI-powered enterprise systems!