Architect MLE

Posted Yesterday
Hiring Remotely in USA
Remote
Expert/Leader
Artificial Intelligence • Big Data • Machine Learning
The Role
Architect and build production-grade multi-agent AI systems, agentic workflows, RAG solutions, tool libraries, memory systems, and evaluation frameworks. Deploy scalable, low-latency solutions across AWS, GCP, or Azure using MLOps, CI/CD, observability, and infrastructure automation. Integrate and optimize LLMs, implement monitoring and safety controls, establish performance metrics, and lead technical delivery while mentoring team members and communicating complex AI concepts to stakeholders.
Summary Generated by Built In

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

About Quantiphi:

Quantiphi is an award-winning, AI-First digital engineering and consulting company focused on delivering high-impact Services and Solutions that help organizations solve what truly matters. We partner with enterprises to reimagine their businesses through intelligent, scalable, and transformative AI driving measurable outcomes at the very core of their operations.

Since our founding in 2013, Quantiphi has tackled some of the world’s most complex business challenges by combining deep industry expertise, disciplined cloud and data engineering practices, and cutting-edge applied AI research. Our work is rooted in delivering accelerated, quantifiable business value, not just technology for technology’s sake.

Headquartered in Boston, Quantiphi is a global organization with 4,000+ professionals serving clients across key industry verticals, including BFSI, Healthcare & Life Sciences, CPG, MFG, TME etc. As an Elite and Premier partner to leading cloud and AI platforms such as NVIDIA, Google Cloud, AWS, and Snowflake, we build and deliver enterprise-grade AI services and solutions that create real-world impact. 

We’ve been recognized with:

  • 17x Google Cloud Partner of the Year awards in the last 8 years.

  • 3x AWS AI/ML award wins.

  • 3x NVIDIA Partner of the Year titles.

  • 2x Snowflake Partner of the Year awards.

  • We have also garnered top analyst recognitions from Gartner, ISG, and Everest Group.

  • We offer first-in-class industry solutions across Healthcare, Financial Services, Consumer Goods, Manufacturing, and more, powered by cutting-edge Generative AI and Agentic AI accelerators.

  • We have been certified as a Great Place to Work for the third year in a row- 2021, 2022, 2023.

Be part of a trailblazing team that’s shaping the future of AI, ML, and cloud innovation. 

Your next big opportunity starts here!

For more details, visit: Website or LinkedIn Page.

Role: Architect Machine Learning Engineer
Experience Level: 8-12 years
Location: US / Canada [ET&CT]

Job Summary:

We are seeking an experienced Architect Machine Learning Engineer to architect, build, and deploy production-grade agentic AI systems and multi-agent workflows from the ground up. The ideal candidate will have deep expertise in designing autonomous AI systems that can collaborate, reason, and execute complex tasks with minimal human intervention. You will be responsible for creating scalable, robust agentic workflows using cutting-edge frameworks like CrewAI/Langraph, while ensuring enterprise-grade deployment on major cloud platforms.

Roles & Responsibilities:
  • Architect & Build Agentic Systems: Design and develop end-to-end multi-agent systems from scratch. You will create the foundational agent harnesses, define communication protocols, and build orchestration layers using frameworks like CrewAI, Langgraph, and AutoGen. Architectural decisions to ensure: 

    • Hierarchical and collaborative multi-agent structures with well-defined agent roles, responsibilities, and communication protocols

    • Dynamic task decomposition, sophisticated tool integration, planning mechanisms (ReAct), and self-correction loops

    • Develop state management systems and memory mechanisms for persistent agent interactions

  • Engineer Advanced Agent Capabilities: Develop custom agent-tools and define specialized agent-skills that empower agents to perform complex, domain-specific tasks.

  • Pioneer Context Engineering: Implement advanced context engineering and memory systems to ensure agents maintain state, learn from interactions, and make informed decisions in dynamic environments.

  • Deploy Production-Grade Solutions: Own the deployment, scaling, and maintenance of robust, low-latency agentic systems on major cloud platforms (GCP, AWS, or Azure). You will implement best-in-class MLOps practices for monitoring, continuous integration/continuous deployment (CI/CD), and system reliability.

  • Integrate and Optimize LLMs: Integrate LLMs to serve as the core reasoning engines for autonomous agents. You will apply advanced techniques like RAG and PEFT to optimize performance.

  • Create and maintain comprehensive tool libraries for agents including API integrations, database queries, and external service connections

  • Design and implement RAG systems using vector databases (Pinecone, Weaviate, ChromaDB)

  • Develop custom tools and plugins that enable agents to interact with various enterprise systems and APIs

  • Ensure tool reliability, error handling, and seamless integration within agentic workflows

  • Implement comprehensive monitoring and tracing systems for agent behavior, performance, cost optimization, and latency analysis

  • Design novel evaluation frameworks to assess multi-step agentic task success, reliability, and accuracy

  • Utilize advanced observability tools (LangSmith, Arize AI, or custom solutions) to trace agent decision making processes

  • Establish metrics and KPIs for measuring agentic system performance in production environments

Required Skills & Qualifications:

Experience:

  • 6-8 years of hands on experience in machine learning and AI engineering with proven track record of taking ML systems to production

  • Demonstrated expertise in building multi-agent systems and agentic workflows, preferably with Langraph/CrewAI

Technical Skills - Must Have:

  • Programming & ML: Expert-level Python proficiency with ML frameworks (TensorFlow, PyTorch, Transformers). Experience with FastAPI, async programming, and microservices architecture

  • Data & Vector Systems: Hands-on experience with vector databases (Pinecone, Weaviate, ChromaDB) and building scalable RAG systems

  • Monitoring & Observability: Experience with LLM application monitoring tools (LangSmith, Weights & Biases, custom telemetry solutions)

  • Proven ability to architect and implement complex AI systems from scratch in production environments

  • Cloud Platform Expertise: Production-level experience with at least one major cloud platform (AWS, GCP, or Azure), including:

    • Compute services (EC2, GCE, Azure VMs)

    • Serverless functions (Lambda, Cloud Functions, Azure Functions)

    • Container orchestration (EKS, GKE, AKS)

    • Managed AI/ML services (SageMaker, Vertex AI, Azure ML)

  • Production & DevOps: Strong skills in Infrastructure as Code (Terraform, CloudFormation), CI/CD pipelines (GitHub Actions, Jenkins), and containerization (Docker, Kubernetes)

Technical Skills - Good to have:

  • Experience with prompt engineering techniques, fine-tuning SLMs (PEFT, SFT, RLHF), and model optimization

  • Knowledge of distributed systems, message queues, and event-driven architectures for agent coordination

  • Familiarity with SDLC best practices, version control (Git), and agile development methodologies

  • Experience with tool-calling agents, multi-step workflows, and stateful orchestration (e.g. graphs, planners, routers).

  • Hands-on evals for agents: trajectory / tool-use checks, golden traces, LLM-as-judge with fixed rubrics, regression suites.

  • Online evals, drift thinking, and clear quality gates before or after deploy (thresholds, alerts, rollback criteria).

  • Safety and abuse: prompt injection via tools, untrusted retrieval, PII handling in prompts and logs, allowlists and guardrails.

  • Cost and latency discipline: budgets per run, timeouts, caps on turns and tool calls.

  • Model lifecycle: routing / gateway patterns, version pinning, fallbacks, and which model for which step.

  • Memory and state: what is persisted, retention, redaction, and what must never be stored

Soft Skills:

  • Exceptional problem-solving and analytical thinking with ability to tackle complex, ambiguous challenges

  • Strong communication skills to explain complex agentic concepts to both technical and non-technical stakeholders

  • Proven ability to work independently and drive large-scale projects to completion with minimal supervision

  • Leadership mindset with experience mentoring team members and driving technical excellence

What’s in it for YOU at Quantiphi:

  • Make an impact at one of the world’s fastest-growing AI-first digital engineering companies.

  • Upskill and discover your potential as you solve complex challenges in cutting-edge areas of technology alongside passionate, talented colleagues.

  • Work where innovation happens - work with disruptive innovators in a research-focused organization with 60+ patents filed across various disciplines.

  • Stay ahead of the curve, immerse yourself in breakthrough AI, ML, data, and cloud technologies and gain exposure working with Fortune 500 companies.


If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Skills Required

  • 6-8 years of hands-on experience in machine learning and AI engineering, with a proven record of taking ML systems to production.
  • Demonstrated expertise building multi-agent systems and agentic workflows, preferably with LangGraph or CrewAI.
  • Expert-level Python proficiency.
  • Experience with TensorFlow, PyTorch, and Transformers.
  • Experience with FastAPI, asynchronous programming, and microservices architecture.
  • Hands-on experience with Pinecone, Weaviate, or ChromaDB and scalable RAG systems.
  • Experience with LLM application monitoring and observability tools such as LangSmith or Weights & Biases.
  • Ability to architect and implement complex AI systems from scratch in production environments.
  • Production-level experience with at least one major cloud platform: AWS, GCP, or Azure.
  • Experience with cloud compute, serverless functions, container orchestration, and managed AI/ML services.
  • Strong skills in Terraform or CloudFormation, CI/CD pipelines, Docker, and Kubernetes.
  • Prompt engineering, SLM fine-tuning, PEFT, SFT, RLHF, or model optimization experience.
  • Knowledge of distributed systems, message queues, and event-driven architectures.
  • Familiarity with SDLC practices, Git, and agile development methodologies.
  • Experience with tool-calling agents, multi-step workflows, and stateful orchestration.
  • Experience designing agent evaluations, regression suites, online evaluations, quality gates, and drift monitoring.
  • Knowledge of AI safety, prompt injection, PII handling, allowlists, guardrails, cost controls, and latency optimization.
  • Experience with model routing, version pinning, fallbacks, memory persistence, retention, and redaction.
  • Exceptional problem-solving, analytical thinking, communication, independent execution, mentoring, and technical leadership.

Quantiphi Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Quantiphi and has not been reviewed or approved by Quantiphi.

  • Wellbeing & Lifestyle Benefits — Wellbeing initiatives such as monthly meeting-free AMA-Zen Days, health check-ups, and wellness counseling are designed to reduce burnout and support day-to-day balance. Broader wellness programs reinforce both physical and mental health.
  • Flexible Benefits — Remote/hybrid options with flexible working hours provide meaningful autonomy over where and when work gets done. Flexible leave constructs, including sabbaticals and special day leaves, add practical adaptability to the package.
  • Parental & Family Support — Paid parental leave in the U.S., alongside maternity and childcare support, signals solid backing for families. These family-oriented policies integrate with a wider health and wellness focus.

Quantiphi Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Marlborough, MA
3,494 Employees
Year Founded: 2013

What We Do

Quantiphi is an award-winning AI-first digital engineering company driven by the desire to solve transformational problems at the heart of business. Quantiphi solves the toughest and complex business problems by combining deep industry experience, disciplined cloud, and data-engineering practices, and cutting-edge artificial intelligence research to achieve quantifiable business impact at unprecedented speed.

Similar Jobs

Superhuman Logo Superhuman

Growth Design Manager, Web & Acquisition

Artificial Intelligence • Information Technology • Machine Learning • Natural Language Processing • Productivity • Software • Generative AI
Remote or Hybrid
United States
1500 Employees

Hewlett Packard Enterprise Logo Hewlett Packard Enterprise

Distinguished Technologist -WLAN TME

Artificial Intelligence • Cloud • Information Technology • Consulting
Remote
Texas, USA
85422 Employees
173K-420K Annually

Hewlett Packard Enterprise Logo Hewlett Packard Enterprise

Systems Engineer

Artificial Intelligence • Cloud • Information Technology • Consulting
In-Office or Remote
2 Locations
85422 Employees
172K-355K Annually

Hewlett Packard Enterprise Logo Hewlett Packard Enterprise

Sr. Federal Certification Engineer

Artificial Intelligence • Cloud • Information Technology • Consulting
In-Office or Remote
2 Locations
85422 Employees
109K-251K Annually

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account