L2 Support (AI Experience)

Posted 9 Minutes Ago
Be an Early Applicant
Hiring Remotely in Columbus, OH, USA
In-Office or Remote
Entry level
Artificial Intelligence • Cloud • Information Technology • Consulting
The Role
Provides L2 production support for AI applications and pipelines built with Azure AI Foundry. Develops Python applications, APIs, integrations, and AI workflows; supports Generative AI, LLM, RAG, and agent solutions; monitors deployments and endpoints; troubleshoots prompt, retrieval, integration, and pipeline failures; performs root-cause analysis; and maintains documentation while collaborating with technical and business teams.
Summary Generated by Built In

This is a remote position.

Job Description

We are looking for an L2 AI Application Support Engineer with strong Python development skills and hands-on experience building, deploying, and supporting AI pipelines using Azure AI Foundry (Microsoft Foundry).

The ideal candidate should have experience working with Generative AI, Large Language Models (LLMs), RAG pipelines, and AI-powered applications. This role involves supporting existing AI solutions, troubleshooting production issues, enhancing AI workflows, and developing or maintaining AI pipelines to support business automation and enterprise applications.

Key Responsibilities
  • Build, maintain, and enhance AI pipelines and workflows using Azure AI Foundry.

  • Develop and maintain Python-based applications, scripts, APIs, and AI integrations.

  • Support Generative AI applications, LLM workflows, AI agents, and RAG-based solutions.

  • Handle L2 production support, investigate incidents, troubleshoot failures, and perform root-cause analysis.

  • Monitor AI pipelines, model endpoints, API integrations, and application performance.

  • Troubleshoot prompt-related issues, model responses, retrieval failures, and pipeline execution errors.

  • Work with Azure OpenAI, Azure AI Search, embeddings, vector databases, and document processing workflows.

  • Support application deployments, configuration changes, enhancements, and production releases.

  • Maintain technical documentation, support procedures, and incident resolution records.

  • Collaborate with development, cloud, and business teams to ensure reliability and continuous improvement of AI solutions.

Required Technical Skills
  • Strong hands-on programming experience in Python.

  • Practical experience with Azure AI Foundry / Microsoft Foundry.

  • Experience building and maintaining AI pipelines, workflows, and AI-powered applications.

  • Good understanding of Generative AI, LLMs, prompt engineering, and RAG architecture.

  • Experience with Azure OpenAI, model deployments, embeddings, and AI service integrations.

  • Knowledge of REST APIs, JSON, application integrations, and backend development.

  • Experience troubleshooting production applications, monitoring workflows, and resolving technical incidents.

  • Understanding of Git, CI/CD, and application deployment processes.

Good to Have
  • Experience with LangChain, LangGraph, Semantic Kernel, or similar AI frameworks.

  • Knowledge of Azure AI Search and vector databases.

  • Exposure to Anthropic Claude or other LLM platforms.

  • Familiarity with Azure Monitor, Application Insights, logging, and observability.

  • Experience with AI agents, workflow automation, and enterprise application integrations.



Skills Required

  • Strong hands-on Python programming experience
  • Practical experience with Azure AI Foundry or Microsoft Foundry
  • Experience building and maintaining AI pipelines, workflows, and AI-powered applications
  • Understanding of Generative AI, LLMs, prompt engineering, and RAG architecture
  • Experience with Azure OpenAI, model deployments, embeddings, and AI service integrations
  • Knowledge of REST APIs, JSON, application integrations, and backend development
  • Experience troubleshooting production applications, monitoring workflows, and resolving technical incidents
  • Understanding of Git, CI/CD, and application deployment processes
  • Experience with LangChain, LangGraph, Semantic Kernel, or similar AI frameworks
  • Knowledge of Azure AI Search and vector databases
  • Exposure to Anthropic Claude or other LLM platforms
  • Familiarity with Azure Monitor, Application Insights, logging, and observability
  • Experience with AI agents, workflow automation, and enterprise application integrations
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Columbus, OH
885 Employees
Year Founded: 1997

What We Do

Everest Technologies is an enterprise IT services firm that helps organizations solve business problems and scale through technology. Its offerings include managed services, project solutions, staff augmentation, DevOps and automation, quality engineering, cloud enablement, application services, retail and supply-chain technology, and decision intelligence. The company combines domain expertise with software engineering and AI capabilities, serving enterprise clients globally from U.S. and Indian delivery centers.

Similar Jobs

Wipfli Logo Wipfli

Audit Manager, Tribal Industry

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
2900 Employees
97K-131K Annually

Wipfli Logo Wipfli

Architect

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
2900 Employees
129K-174K Annually

Wipfli Logo Wipfli

Manager, Financial Reporting - Physician Practice Clients

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
2900 Employees
97K-145K Annually

Wipfli Logo Wipfli

Consultant

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
2900 Employees
88K-118K Annually

Similar Companies Hiring

Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account