Solutions Architect (NYC)

Reposted 10 Days Ago
Be an Early Applicant
New York, NY, USA
In-Office
170K-190K Annually
Senior level
Information Technology • Software • Database
The Role
The Solutions Architect will design and optimize AI infrastructure, engage with enterprise customers, and ensure scalable deployments using various cloud platforms and agent engineering techniques.
Summary Generated by Built In
About Us

At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale.

With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world.

Today, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater.

About the Role

We're looking for a Solutions Architect to join our Professional Services team. You'll work directly with enterprise customers to design, deploy, and optimize production-grade AI infrastructure and agent systems. You'll be responsible for architecting scalable, secure infrastructure deployments and building reliable, well-evaluated agent applications that solve real business problems.

This role combines software development, infrastructure/platform engineering, and customer-facing skills. You'll work on everything from Kubernetes cluster design to multi-agent system architecture, requiring deep technical expertise across both infrastructure and agent engineering domains.

This role offers direct impact on customer success, the opportunity to shape best practices, and work with cutting-edge AI technology. You'll join a collaborative team environment with a strong engineering culture.

Key Responsibilities
  • Infrastructure & Platform Engineering: Design scalable, highly-available infrastructure for AI platform deployments (compute, storage, networking, security), enterprise integration patterns, Infrastructure as Code (Terraform, Helm), multi-region HA/DR strategies, and CI/CD pipelines

  • Agent Engineering & Development: Design multi-agent systems using different patterns, implement agent logic using modern frameworks (langchain/langgraph), design comprehensive evaluation frameworks, optimize prompts with A/B testing, and guide deployment/operations

  • Customer Engagement & Assessment: Lead technical maturity assessments, work directly with enterprise customers to understand requirements and present recommendations, and partner with Engagement Managers and Product/Engineering teams

What We're Looking For
Required Experience

7+ years of experience in a technical, hands-on customer-facing roles such as Solutions Architect or Forward Deployed Engineer. We also like former founders, so if you have an unusual background, but all the right skillsets, you are welcome to apply

Infrastructure & Platform:

  • 3+ years of experience designing and deploying production infrastructure on cloud platforms (GCP, AWS, or Azure)

  • Strong Kubernetes experience (GKE, EKS, or AKS) including cluster design, autoscaling, and multi-zone deployments

  • Experience with Infrastructure as Code (Terraform, Helm) and GitOps practices

  • Knowledge of database systems (relational databases, in-memory data stores) including HA, replication, backup strategies, and sizing

  • Experience designing high-availability and disaster recovery solutions

  • Strong understanding of networking, security (SSO/RBAC, TLS, secrets management), and observability (Prometheus, Grafana, Datadog)

  • Experience with CI/CD pipelines for infrastructure and applications

Agent Engineering & Development:

  • 1+ years of experience building production AI/ML applications or agents

  • Strong experience with LLM frameworks (LangChain, LangGraph, or similar) for building agent-based applications

  • Experience with state management patterns (short-term and long-term memory)

  • Experience designing and implementing evaluation frameworks for AI applications

  • Strong prompt engineering skills with experience in optimization and A/B testing

  • Experience with vector stores, RAG patterns, and knowledge organization

  • Experience with tool integration, API design, and error handling patterns

  • Strong Python and/or TypeScript development skills

Customer-Facing:

  • Customer-facing experience with enterprise customers

  • Experience conducting technical assessments or infrastructure audits

  • Strong communication skills with ability to explain technical concepts to diverse audiences

Key Attributes
  • Strong problem-solving skills with ability to analyze complex requirements and design elegant solutions

  • Excellent customer-facing communication skills, able to explain technical concepts to diverse audiences

  • Experience working cross-functionally with engineering teams, product teams, and customers

  • Consultative approach with ability to understand customer needs, provide recommendations, and guide implementation

  • Ability to balance infrastructure architecture with agent development work

  • Strong engineering background with hands-on development experience

Location: New York City

Compensation

$170K to $190K

Compensation Philosophy:

We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks. Actual compensation and offerings will vary based on role, level, and location. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations.

Benefits

Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.

Skills Required

  • 7+ years of experience in technical customer-facing roles
  • 3+ years designing and deploying production infrastructure on cloud platforms
  • Strong Kubernetes experience including cluster design
  • Experience with Infrastructure as Code tools (Terraform, Helm)
  • 1+ years building production AI/ML applications
  • Strong Python and/or TypeScript development skills
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
123 Employees

What We Do

LangChain is the platform for building reliable agents. Our products power top engineering teams — from fast-growing startups like Lovable, Mercor, and Clay to global brands including AT&T, Home Depot, and Klarna. LangGraph is a low-level orchestration framework for building controllable agents and long-running workflows. It’s used in production by teams at Replit, Uber, LinkedIn, GitLab, and more. LangSmith offers unified evaluation and monitoring to help developers debug, evaluate, and improve their agents at scale. LangChain provides hundreds of integrations and composable components, making it easy to connect with the latest models, tools, and databases — with minimal engineering overhead. Together, these tools help teams build, deploy, and manage enterprise-grade agents, faster.

Similar Jobs

Hyro Logo Hyro

Solutions Architect

Artificial Intelligence • Healthtech • Telehealth
Hybrid
New York City, NY, USA
120 Employees
140K-175K Annually

Cox Enterprises Logo Cox Enterprises

Human Resources Business Partner

Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Remote or Hybrid
United States
50000 Employees
67K-101K Annually

Cox Enterprises Logo Cox Enterprises

Customer Success Manager

Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Remote or Hybrid
United States
50000 Employees
92K-154K Annually

Capital One Logo Capital One

Machine Learning Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
2 Locations
55000 Employees
136K-169K Annually

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account