Senior AI/MLOps Engineer

Reposted 11 Days Ago
Be an Early Applicant
Gurugram, Haryana
Hybrid
Senior level
HR Tech • Software
Simpplr is the leading AI-powered employee experience platform.
The Role
The role involves designing, implementing, and maintaining AI systems for enterprise applications, integrating LLM workflows, ensuring observability, and collaborating with ML and DevOps teams.
Summary Generated by Built In
Who We Are

Simpplr is the AI-powered platform that unifies the digital workplace – bringing together engagement, enablement, and services to transform the employee experience. It streamlines communication, simplifies interactions, automates workflows, and elevates the everyday experience of work. The platform is intuitive, highly extensible, and built to integrate seamlessly with your existing technology.

More than 1,000 leading organizations – including AAA, the NHS, Penske, and Moderna – trust Simpplr to foster a more aligned and productive workforce. Headquartered in Silicon Valley with global offices, Simpplr is backed by Norwest Ventures, Sapphire Ventures, Salesforce Ventures, and Tola Capital. Learn more at simpplr.com.

JOB DESCRIPTION


AI/LLM Ops Specialist 

 (Agentic AI & AI‑Native Infrastructure)

Role Summary

We are seeking an experienced AI/LLM Ops Specialist to own the deployment and operations of agentic AI systems at enterprise scale. You will accelerate our shift from AI‑enabled workflows to AI‑native infrastructure, implementing and running autonomous multi‑agent LLM solutions that drive mission‑critical processes.

Key Responsibilities
  • Architect & Deploy Agentic AI Systems: Design, implement, and maintain multi‑agent orchestration frameworks (e.g., FastAgent, FastMCP, LangGraph, AutoGen, CrewAI) to coordinate autonomous LLM workflows.
  • LLMOps & RAG Integration: Develop and operationalize RAG workflows, vector stores, and knowledge‑graph connectors.
  • Monitoring, Observability & Reliability: Implement end‑to‑end observability using Prometheus/Grafana, OpenTelemetry, and incident playbooks.
  • Governance, Security & Compliance: Enforce data governance, PII handling, and prompt‑audit trails across agent interactions.
  • Collaboration & Enablement: Partner with data engineers, MLOps, and DevOps to align CI/CD for AI workloads and mentor teams.
  • Continuous Improvement: Benchmark agent performance, optimize token usage, and research emerging agentic AI frameworks.
Core Qualifications
  1. 5+ years in production ML/LLM operations, with 2+ years in autonomous agent systems.
  2. Hands‑on experience with FastAgent, FastMCP, LangGraph, AutoGen, CrewAI, or similar.
  3. Expertise in Kubernetes, Docker, Terraform (or Pulumi), and GitOps workflows.
  4. Proven track record implementing RAG pipelines with Pinecone, Elasticsearch, or similar.
  5. Proficient in observability tools (Prometheus, Grafana, Jaeger/OpenTelemetry).
Bonus Qualifications
  • Open‑source contributions or conference talks on agentic AI or LLMOps.
  • Experience optimizing inference with vLLM, TensorRT‑LLM, or similar libraries.
  • Certifications in cloud architecture or AI security.
  • Familiarity with multi‑modal agent workflows or edge‑deployed agents. Experience leading AI‑first governance and decision‑loop monitoring.
Technologies & Frameworks
  • Agentic AI Frameworks: FastMCP, FastAgent, Agent Builder, LangGraph, AutoGen, CrewAI
  • Protocols & Standards: Model Context Protocol (MCP), A2A
  • LLM Providers: OpenAI, Anthropic, Google Gemini
  • Vector Stores & Indexing: Pinecone, Redis Vector DB, Weaviate, PGVector, LlamaIndex
  • Monitoring & Observability: LangSmith, LangFuse, Arize, Coralogix
  • Cloud & Orchestration: Kubernetes, Docker, AWS Bedrock/SageMaker, GCP Vertex AI, Azure ML
  • Inference Optimization: vLLM, TensorRT‑LLM, Ollama
  • IaC & CI/CD Tools: Terraform, Helm, GitHub Actions

 

Join us and be the driving force behind our evolution into an AI‑native, agentic future, crafting the autonomous systems that will power tomorrow’s innovation.

Simpplr’s Hub-Hybrid-Remote Model:

At Simpplr we believe that when work is good, life is better and that belief guides all we do. Including how we approach our flexible work model. Simpplr operates with a Hub-Hybrid-Remote model. This model is role-based with exceptions and provides employees with the flexibility that many have told us they want.

  • Hub - 100% work from Simpplr office. Role requires Simpplifier to be in the office full-time.
  • Hybrid - Hybrid work from home and office. Role dictates the ability to work from home, plus benefit from in-person collaboration on a regular basis. 
  • Remote - 100% remote. Role can be done anywhere within your country of hire, as long as the requirements of the role are met. 

Top Skills

Autogen
Aws Bedrock
Azure Ml
Crewai
Docker
Elasticsearch
Fastagent
Fastmcp
Gcp Vertex Ai
Github Actions
Gitops
Grafana
Helm
Jaeger
Kubernetes
Langgraph
Ollama
Opentelemetry
Pinecone
Prometheus
Sagemaker
Tensorrt
Terraform
Terraform
Vllm
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Redwood City, CA
400 Employees
Year Founded: 2014

What We Do

Simpplr is the leading AI-powered employee experience platform. Organizations use our forward-looking, adaptable products to deliver personalized experiences that inspire and engage their employees. Wherever people work, Simpplr enables them to flourish.

Trusted by more than 700+ leading brands, including Penske, Snowflake, Moderna, Eurostar, and AAA, our customers are achieving measurable improvements in employee engagement, productivity, and accelerated business performance.

Simpplr is headquartered in Silicon Valley, CA with offices in the UK, Canada, and India, and is backed by Sapphire Ventures, Norwest Venture Partners, Salesforce Ventures, and Tola Capital. Learn more at simpplr.com.

Why Work With Us

- Simpplr named a leader in the Forrester Wave for intranet platforms
- Amazing growth! We've almost doubled in the last year, meaning great opportunity for career growth
- We're trusted by brands such as Eurostar, Splunk, Docusign, and Coursera

Gallery

Gallery

Similar Jobs

ZS Logo ZS

Consultant

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
4 Locations
13000 Employees

ZS Logo ZS

Project Manager

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
2 Locations
13000 Employees

ZS Logo ZS

Architect

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
2 Locations
13000 Employees

ZS Logo ZS

Knowledge Services Associate

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
Gurugram, Haryana, IND
13000 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account