Software Engineer - AI Infrastructure

Posted 13 Days Ago
New York, NY
In-Office
135K-280K Annually
Senior level
Artificial Intelligence • Software • Automation
The support operations platform. Enabling great support, from workforce planning to AI automation
The Role
The software engineer will build and operate infrastructure for AI agents, ensuring reliability, scalability, and security. Responsibilities include managing LLM services, developing storage systems, and enhancing observability while collaborating cross-functionally.
Summary Generated by Built In
About Assembled

Assembled builds the infrastructure that underpins exceptional customer support, empowering companies like CashApp, Etsy, and Robinhood to deliver faster, better service at scale. With solutions for workforce management, BPO collaboration, and AI-powered issue resolution, Assembled simplifies the complexities of modern support operations by uniting in-house, outsourced, and AI-powered agents in a single operating system. Backed by $70M in funding from NEA, Emergence Capital, and Stripe, and driven by a team of experts passionate about problem-solving, we’re at the forefront of support operations technology.

The Role

We’re looking for a software engineer to join our Infrastructure team—building and operating the core systems that power our rapidly growing AI agent platform for customer support. Our AI Agents automates support workflows across email, chat, and voice, and has grown from $0 to $1M in ARR in just 3 months. As adoption accelerates, we’re investing deeply in scaling its infrastructure to meet increasing demand and security expectations from enterprise customers.

As part of the AI Infrastructure team, you’ll be responsible for the systems that enable Assist to be fast, reliable, and secure. You’ll work on foundational platform components that power real-time LLM usage at scale, while also exploring how AI can be leveraged internally to make our engineering team more productive. This team is highly cross-functional, working closely with the AI, security, and product engineering teams.

This is a high-ownership role for someone who’s excited by 0-to-1 building and shaping the infrastructure backbone of our AI products.

Some projects owned by the Infrastructure team
  • Agent service reliability and scaling: We manage and scale the infrastructure that serves LLM-powered agents across chat, email, and voice. This includes selecting inference strategies, integrating with model providers (e.g. OpenAI, Anthropic), and dynamically routing traffic for performance and cost efficiency.

  • Prompt and embedding storage systems: Assist relies heavily on dynamically generated prompts and semantic search across support content. The team owns highly-available, fast-access storage and indexing layers optimized for real-time AI interactions.

  • Privacy and security: Enterprises expect strict guardrails around AI use. We’re building systems like network-level intrusion detection (IDS/IPS), audit logging, and LLM usage policy enforcement to meet these expectations and unlock new sales channels.

  • Observability and usage analytics: We operate systems that surface key metrics—token usage, latency, cost per response, and quality signals—so the Assist team can continuously improve Assist’s performance and accuracy.

  • AI-powered developer tools: We are beginning to explore and evangelize the use of AI to accelerate internal engineering workflows—through internal chat agents, pair programming tools, and intelligent automation for deployment, debugging, and on-call. Our goal is to empower engineers across the company to build faster and more confidently with AI.

You may be a good fit if you:
  • Have 6+ years of engineering experience, with past ownership of high-scale, production-critical infrastructure

  • Have experience with distributed systems and container orchestration (especially Kubernetes)

  • Have worked with AI/ML platforms or are excited to build foundational infrastructure for LLM-based applications

  • Thrive in fast-paced environments with shifting requirements and ambiguous problem spaces

  • Are motivated by impact, enjoy deep technical challenges, and want to work cross-functionally across security, AI, and product

  • Have strong familiarity with one or more parts of our tech stack:

    • Cloud provider: AWS

    • Orchestration: Kubernetes + Karpenter

    • LLM integration: Experience with OpenAI, Anthropic, or open-source model serving (e.g., vLLM, HuggingFace TGI, Ray Serve)

    • Prompt & embedding infrastructure: Vector databases (e.g., Pinecone, Weaviate, PGVector), semantic search, prompt templating systems

    • Datastores: Postgres + PgBouncer, Snowflake, Redis

    • Languages: Go and Python

    • Monitoring & CI/CD: Datadog, Mezmo, CloudWatch, Buildkite, CircleCI

Our U.S. benefits
  • Generous medical, dental, and vision benefits

  • Paid company holidays, sick time, and unlimited time off

  • Monthly credits to spend on each: professional development, general wellness, Assembled customers, and commuting

  • Paid parental leave

  • Hybrid work model with catered lunches everyday (M-F), snacks, and beverages in our SF & NY offices

  • 401(k) plan enrollment

Top Skills

Anthropic
AWS
Buildkite
CircleCI
Cloudwatch
Datadog
Go
Karpenter
Kubernetes
Mezmo
Openai
Pgbouncer
Pgvector
Pinecone
Postgres
Python
Redis
Snowflake
Weaviate

What the Team is Saying

Joe
Talal
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, California
130 Employees
Year Founded: 2018

What We Do

Industry leaders like Etsy, Robinhood, and Stripe trust Assembled to provide customer-facing AI agents and workforce planning at scale. We automatically resolve millions of interactions through chat, email, and phone while optimizing staffing for hundreds of thousands of support professionals. Our mission is to elevate customer support through AI-powered software that makes life easier for customers and employees.

Why Work With Us

Assembled is built on the belief that great teams, like great support agents, lead with empathy, ownership, and action. We work transparently, give and receive feedback as a gift, and show up for each other across roles. It's a culture where titles take a back seat to impact, and everyone’s invested in building something that truly supports people.

Gallery

Gallery
Gallery
Gallery

Assembled Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

For the majority of our roles we're hybrid, Monday & Thursday in-office

Typical time on-site: 2 days a week
HQSan Francisco, California
New York City, NY
Learn more

Similar Jobs

Assembled Logo Assembled

Growth Marketing Lead

Artificial Intelligence • Software • Automation
In-Office or Remote
3 Locations
120K-160K Annually

Assembled Logo Assembled

Customer Success Manager

Artificial Intelligence • Software • Automation
In-Office
2 Locations
105K-130K Annually

Assembled Logo Assembled

Sales Development Representative

Artificial Intelligence • Software • Automation
In-Office
2 Locations
70K-95K Annually

Assembled Logo Assembled

AI Deployment Strategist

Artificial Intelligence • Software • Automation
In-Office
2 Locations
120K-180K Annually

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account