Applied AI Engineer - USA

Posted Yesterday
Hiring Remotely in United States
Remote
Entry level
Cloud • Information Technology • Business Intelligence • Consulting
The Role
Build and operate production AI capabilities across enterprise platforms, including agent runtimes, model routing, RAG, tool calling, guardrails, evaluation, monitoring, and cost and latency optimization. Develop reliable, measurable, safe, and cost-conscious AI systems; create evaluation frameworks and quality controls; monitor production behavior; and collaborate with backend, platform, product, security, and client teams to deliver practical AI solutions.
Summary Generated by Built In

Applied AI Engineer

Inviso is partnering with one of our clients to find an experienced Backend / Platform Engineer to join their team working remotely. Inviso is managing the recruitment and placement process for this opportunity. This is a remote, direct-hire permanent employee position for our client that is a global multi-billion dollar software conglomerate.

The Applied AI Engineer is responsible for building and operating AI capabilities across an enterprise platform, including agent runtimes, model routing, RAG, tool/function calling, guardrails, evaluation, monitoring, cost management, latency optimization, and production quality controls.

This role is focused on shipping AI that works in production, not demos. The ideal candidate understands how to move from prototype to monitored production systems, can evaluate AI behavior rigorously, and can partner with product and engineering teams to decide when AI is the right solution and when it is not.

Experience & Skills Required

  • Experience shipping software backed by LLMs, ML models, RAG systems, or agentic workflows to real production users.
  • Experience designing or implementing agent runtime, orchestration, model routing, tool/function calling, or AI workflow patterns.
  • Strong understanding of RAG, grounding, retrieval quality, prompt design, context management, and evaluation approaches.
  • Experience building evaluation harnesses, golden sets, regression checks, quality gates, or measurable AI performance frameworks.
  • Ability to treat cost, latency, reliability, and safety as first-class engineering constraints.
  • Experience building guardrails and controls for AI systems, including untrusted retrieved content, tool output risk, and failure modes.
  • Experience monitoring production AI behavior and improving systems based on evidence, not opinion.
  • Strong software engineering skills and ability to collaborate with backend, platform, product, and security teams.
  • Strong communication and collaboration skills for client-facing consulting environments.
  • Pragmatic mindset with the ability to prioritize business value and ship useful AI capabilities quickly and responsibly.

Desired Qualifications

  • Experience with Claude, GPT, Azure OpenAI, open-source models, model routing, fine-tuning, distillation, or small/edge models.
  • Experience with MCP, A2A, multi-agent orchestration, AI tool calling, or agent evaluation.
  • Experience with LLM-as-judge approaches calibrated against human evaluation.
  • Experience with semantic knowledge management, ontologies, knowledge graphs, or semantic layers.
  • Experience with AI development lifecycle practices across data, build, evaluation, deployment, monitoring, and continuous improvement.
  • Experience using AI-assisted development tools while maintaining strong review, testing, and safety discipline.

Success Criteria

Success in this role is measured by the ability to deliver AI capabilities that are useful, reliable, measurable, safe, and cost aware. Applied AI Engineers are expected to turn experiments into production features, build evaluation discipline into the delivery process, and help client teams make informed decisions about where AI creates real value.

Skills Required

  • Experience shipping software backed by LLMs, ML models, RAG systems, or agentic workflows to production users
  • Experience designing or implementing agent runtimes, orchestration, model routing, tool/function calling, or AI workflow patterns
  • Strong understanding of RAG, grounding, retrieval quality, prompt design, context management, and evaluation approaches
  • Experience building evaluation harnesses, golden sets, regression checks, quality gates, or measurable AI performance frameworks
  • Ability to manage cost, latency, reliability, and safety as engineering constraints
  • Experience building AI guardrails and controls for untrusted retrieved content, tool output risks, and system failure modes
  • Experience monitoring production AI behavior and improving systems based on evidence
  • Strong software engineering skills and ability to collaborate with backend, platform, product, and security teams
  • Strong communication and collaboration skills in client-facing consulting environments
  • Pragmatic mindset focused on business value and responsible delivery
  • Experience with Claude, GPT, Azure OpenAI, open-source models, model routing, fine-tuning, distillation, or small and edge models
  • Experience with MCP, A2A, multi-agent orchestration, AI tool calling, or agent evaluation
  • Experience with LLM-as-judge approaches calibrated against human evaluation
  • Experience with semantic knowledge management, ontologies, knowledge graphs, or semantic layers
  • Experience with AI development lifecycle practices across data, build, evaluation, deployment, monitoring, and continuous improvement
  • Experience using AI-assisted development tools with strong review, testing, and safety discipline
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Bellevue, WA
265 Employees
Year Founded: 2004

What We Do

Inviso Corporation is a global technology consulting firm based in Bellevue, Washington. The company specializes in helping organizations optimize security, performance, and digital decision-making by combining expertise in AI, data, marketing, and sales enablement. Their services include application development, business intelligence, and software asset management, catering to a diverse range of clients from small businesses to large enterprises.

Similar Jobs

GitLab Logo GitLab

Incident & Escalation Lead- Enterprise Customers

Cloud • Security • Software • Cybersecurity • Automation
Easy Apply
Remote
2 Locations
2500 Employees

GoodRx Logo GoodRx

Counsel

Consumer Web • Coupons • Healthtech • Social Impact • Pharmaceutical
Remote or Hybrid
USA
800 Employees
142K-305K Annually

Applied Systems Logo Applied Systems

Data Engineer

Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Remote or Hybrid
United States
3116 Employees
160K-260K Annually

Coursera + Udemy  Logo Coursera + Udemy

Category Manager

Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
Remote or Hybrid
United States
1500 Employees
137K-174K Annually

Similar Companies Hiring

Quanta Thumbnail
Artificial Intelligence • Fintech • Software • Business Intelligence • Big Data Analytics
San Francisco, California
21 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account