The Role
Build the CI/CD, IaC, release, config, and observability framework for agentic workflows and AI integrations. Implement Git-driven pipelines, Terraform/Helm GitOps provisioning, secrets/SSO controls, LLMOps practices (prompt/versioning, A/B testing, cost dashboards), and compliance/audit trails. Create reusable automation modules, ensure SLO-driven monitoring, and produce runbooks and documentation to scale client deployments.
Summary Generated by Built In
Join Expedient's AI CTRL product team as our AI DevOps Engineer — a senior, hands-on engineer who will build the framework that manages, configures and ships agentic workflows, tooling applications, and AI integrations to clients quickly, safely, and repeatably. You'll own the path from commit to production: Git-driven CI/CD, infrastructure as code, release and config management, observability, and the LLMOps practices that keep model-powered systems reliable and cost-efficient. This is a build role — you won't be maintaining someone else's pipelines, you'll be creating the framework the AI Dev team builds on.
Because AI CTRL runs on enterprise model APIs (Anthropic Claude, OpenAI, Google Gemini) with RAG and MCP integrations rather than training custom models, this role is LLMOps-focused: prompts, configs, and integrations are the primary code surface, and the operational challenges are deployment velocity, traceability, cost, and risk at scale.
What You'll Do:
Because AI CTRL runs on enterprise model APIs (Anthropic Claude, OpenAI, Google Gemini) with RAG and MCP integrations rather than training custom models, this role is LLMOps-focused: prompts, configs, and integrations are the primary code surface, and the operational challenges are deployment velocity, traceability, cost, and risk at scale.
What You'll Do:
- CI/CD Pipelines: Design and build Git-based pipelines that automate build → test → deploy for Retool apps, agentic workflows, MCP servers, and data connectors — turning manual client deployments into repeatable, gated releases.
- Infrastructure as Code: Make the platform reproducible. Use Terraform, Helm, and GitOps (ArgoCD/Flux) to provision and manage Kubernetes (Nutanix NKP) clusters and per-client environments as code.
- Configuration Management: Manage environment and deployment configuration as code across a growing fleet of client deployments — eliminate config drift and one-off manual changes.
- Release Management: Own versioning, environment promotion, release gates, and clean rollback. Maintain versioned, deployable artifacts so any release can be reproduced or reverted.
- Observability & Tracing: Build the monitoring backbone — Elastic/ECK, APM, and telemetry distributed tracing — with deployment health, SLOs/SLIs, and usage/cost instrumentation across all client deployments. Strengthen alerting so issues surface before clients feel them.
- LLMOps Practices: Stand up prompt and configuration versioning, model/prompt evaluation pipelines, A/B testing of prompts and models, multi-provider traffic routing and failover, and token/cost dashboards — the AI-specific discipline that keeps model-powered systems accurate, available, and affordable.
- Change & Risk Management (incl. Compliance): Implement controlled-change processes — approvals, audit trails, and guardrails — with compliance-as-code for SOC 2 audit logging, secrets management (e.g., vaults/sealed-secrets), and SSO/OIDC configuration.
- Automation Marketplace: Build an internal library of vetted, reusable workflows, connectors, and IaC modules that accelerate client delivery — and graduate proven items into a client-facing catalog aligned to the Agentic Workflow Engine (AWE).
- Collaborate & Document: Partner with the AI Dev engineering team on platform standards; write the runbooks, release guides, and architecture docs that let the framework scale beyond
- Experience: 3–5 years in DevOps, platform engineering, site reliability, or MLOps/LLMOps. Prior experience at a managed service provider, SaaS company, or enterprise technology team is a strong plus.
- Git-based CI/CD: designing automated build/test/deploy pipelines from scratc
- Infrastructure as Code: Terraform and Helm; GitOps with ArgoCD or Flu
- Kubernetes: operating and automating clusters (Nutanix NKP or equivalent); namespaces, workloads, container lifecycle
- Observability: Elastic/ECK, APM, OpenTelemetry tracing; defining alerts, SLOs/SLIs (Prometheus/Grafana experience transfers)
- Scripting & data: strong Python and Bash; SQL fundamentals
- Secrets & identity: secrets management (Vault or equivalent), SSO/OIDC configuration (Entra ID, Okta, OneLogin)
- Workflow orchestration: Argo Workflows, Airflow, or similar (a plus)
- LLM APIs: working familiarity with Anthropic Claude, OpenAI, and/or Google Gemini — prompt construction, tool use/function calling, token management
- RAG & MCP awareness: chunking, embedding, vector search, context-window management; Model Context Protocol integrations (a plus)
- Compliance exposure: SOC 2 audit logging and controls-as-code (a plus)
- Builder mindset: sees a manual process and automates it; ships the framework, not just the fix
- Automation-first & reliability-minded: treats infrastructure, config, and compliance as code; thinks in SLOs, blast radius, and rollback
- Documentation instinct: writes the runbook before calling something done; updates the guide when the process changes
- Risk-aware: balances deployment velocity with controlled change and auditability
- Self-directed, strong ownership mentality, excellent communicator, thrives in a fast-paced environment
- Education: Bachelor's in Computer Science, Engineering, Information Systems, or related field (or equivalent practical experience).
Location & Compensation:
Indianapolis, Cleveland, or Pittsburgh. Hybrid work model. Regional travel may be required.
Salary for this position is directly related to your own experience, knowledge, and skills. Estimated range for this role is $120,000 to $150,000
#LI-hybrid
Indianapolis, Cleveland, or Pittsburgh. Hybrid work model. Regional travel may be required.
Salary for this position is directly related to your own experience, knowledge, and skills. Estimated range for this role is $120,000 to $150,000
#LI-hybrid
Skills Required
- 3-5 years in DevOps, platform engineering, site reliability, or MLOps/LLMOps
- Designing Git-based CI/CD pipelines (build -> test -> deploy)
- Terraform and Helm; GitOps with ArgoCD or Flux
- Operating and automating Kubernetes clusters (Nutanix NKP or equivalent)
- Observability: Elastic/ECK, APM, OpenTelemetry tracing; define alerts, SLOs/SLIs
- Strong Python and Bash scripting; SQL fundamentals
- Secrets management (Vault or equivalent) and SSO/OIDC configuration (Entra ID, Okta, OneLogin)
- Working familiarity with LLM APIs (Anthropic Claude, OpenAI, Google Gemini) and prompt/tooling practices
- Bachelor's in Computer Science, Engineering, Information Systems, or equivalent practical experience
- Workflow orchestration experience (Argo Workflows, Airflow, or similar)
- RAG & MCP awareness: chunking, embeddings, vector search, context-window management
- SOC 2 audit logging and controls-as-code exposure
- Prior experience at an MSP, SaaS company, or enterprise technology team
- Experience with Prometheus/Grafana (transferable to SLO/SLI work)
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Expedient is a network of data centers offering cloud computing, a wide range of managed services, and network connectivity.
