Applied AI Engineer

Reposted 3 Hours Ago
Hiring Remotely in US
Remote
150K-160K Annually
Mid level
Artificial Intelligence • Healthtech • Mobile • Software • Telehealth • Generative AI
Come work for Pager Health!
The Role
Design, build, and deploy LLM-powered applications, collaborating with Data Science teams to ensure agent systems operate reliably in production. Handle full lifecycle from prototype to production, integrating APIs and managing workflows.
Summary Generated by Built In
 

Pager Health℠ is a leading AI-powered care navigation platform empowering health plans to deliver high-engagement and simplified, intelligent health experiences for their members and teams.
Our solutions help people get the right care at the right time in the right place and stay healthy, while simultaneously reducing system friction and fragmentation, powering engagement, and orchestrating the enterprise. Pager Health partners with leading payers, providers and employers representing more than 26 million individuals across the United States and Latin America.


We're looking for an Applied AI/LLM Engineer to design, build, and ship LLM-powered agents and applications. You'll work closely with our Data Science team, who defines the LLM strategy, guardrails, evaluation criteria, and model selection. Your job is to take that foundation and turn it into reliable, production-grade agent systems that solve real business problems. This is a builder role, not a research role. You'll spend most of your time writing code — wiring up tools, orchestrating multi-step workflows, integrating APIs, and making sure agents behave predictably in the wild. You should be deeply comfortable working with large language models in production and operating at the intersection of software engineering and applied AI. 
Responsibilities:

  •  Build agentic applications and workflows using the LLM frameworks, models, and guardrails provided by the Data Science team Design and implement tool integrations, function-calling patterns, and orchestration logic that allow agents to take actions across internal systems and external APIs
  • Translate agent specifications and prompt strategies (authored by Data Science) into robust, deployable services Implement RAG pipelines, including vector store integration, chunking strategies, and retrieval optimization
  • Own the full lifecycle of agent systems from prototype through production, including testing, monitoring, logging, and iteration
  • Build evaluation and observability infrastructure so the team can measure agent quality, latency, cost, and safety in production
  • Collaborate with Data Science on prompt engineering, model behavior tuning, and guardrail enforcement. Implementing their specifications into the runtime layer Work with platform and infrastructure teams to deploy, scale, and maintain agent services in cloud environments (GCP/Vertex AI, AWS Bedrock, Azure OpenAI)
  • Contribute to internal tooling, SDKs, and shared libraries that accelerate agent development across the organization

Qualifications: 

  • 3+ years of software engineering experience with strong proficiency in Python Hands-on experience building applications powered by large language models (Claude, GPT, Gemini)
  • Familiarity with agent frameworks and orchestration patterns (LangChain, LangGraph, CrewAI, Vertex AI Agent Builder, or custom orchestration)
  • Experience implementing function calling, tool use, and multi-step agent workflows Solid understanding of RAG architectures, embedding models, and vector databases (Pinecone, Weaviate, pgvector, Vertex AI Vector Search)
  • Comfort working within defined guardrails and model configurations - you don't need to pick the model, but you need to know how to get the most out of it
  • Experience with API design, microservices, and deploying services in cloud environments Strong debugging and problem-solving instincts. Agent systems fail in non-obvious ways and you enjoy chasing down why
  • Strong communication skills; ability to work across Data Science, Product, and Engineering teams
  • Experience with evaluation frameworks for LLM-based systems (custom evals, RAGAS, LangSmith, Braintrust), is nice to have
  • Familiarity with MLOps tooling and CI/CD for ML systems and experience with streaming responses, async architectures, and real-time agent interactions, are nice to have
  • Background in building multi-agent systems with routing, delegation, and coordination patterns, is preferred 
  • Exposure to Google Cloud Platform/Vertex AI ecosystem Contributions to open-source AI/ML projects, is preferred

For Colorado, Nevada, New York, and Washington DC-based employment: In accordance with the Pay Transparency laws the pay range for this position is $150,000 - $160,000. The compensation package may include stock options, plus a range of medical, dental, vision, financial, generous PTO, stipends for professional development, and wellness benefits.  Final compensation for this role will be determined by various factors such as a candidate's relevant work experience, skills, certifications, and geographic location. The range listed only applies to Colorado, Nevada, New York, and Washington DC.

At Pager Health, you will work alongside passionate, talented and mission-driven professionals – people who are building scalable platforms, solving critical enterprise-level challenges in health tech and providing concierge services to help individuals access the medical care and wellbeing programs they need.  

You will be encouraged to shape your job, stretch your skills and drive the company’s future. You will be part of a remote-first, dynamic and tight-knit team that embraces the challenges and opportunities that come with being part of a growth company. Most importantly, you will be an industry innovator who is making a positive impact on people’s lives.    

At Pager Health, we value diversity and always treat all employees and job applicants based on merit, qualifications, competence, and talent. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
Please be aware that all official communication from Pager Health regarding employment opportunities will originate from email addresses ending in @pager.com. We will never request personal or financial information via email. If you receive an email purporting to be from Pager Health that does not adhere to this format, please do not respond and report it to [email protected].
Pager Health is committed to protecting the privacy and security of your personal information


Skills Required

  • 3+ years of software engineering experience
  • Strong proficiency in Python
  • Hands-on experience building applications powered by large language models
  • Familiarity with agent frameworks and orchestration patterns
  • Experience with API design, microservices, and deploying services in cloud environments

What the Team is Saying

Peter
Seb
Latoya Brown
Heidi S.

Pager Health Compensation & Benefits Highlights

  • Healthcare Strength Feedback suggests employees can access a free employee‑only Cigna high‑deductible plan with employer HSA contributions, alongside dental, vision, company‑paid life/AD&D, short‑ and long‑term disability, and an EAP. Optional accident, critical illness, and hospital indemnity expand protection where needed.
  • Leave & Time Off Breadth Feedback suggests salaried staff receive unlimited PTO plus six dedicated Wellness Days, supporting meaningful rest and flexibility. Remote work is described as the norm, making time away easier to take across locations.
  • Retirement Support Feedback suggests a 401(k) with company match is available, complemented by equity opportunities for eligible roles. This adds long‑term savings and ownership to the total rewards mix.

Pager Health Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
366 Employees
Year Founded: 2014

What We Do

Pager’s virtual care platform enables healthcare organizations to help their members and patients navigate the entire healthcare journey with a personalized, connected care experience. By bringing together clinical and service teams onto a unified, collaborative communication platform, Pager enables delivery of a complete set of virtual care services including triage, telemedicine, appointment scheduling, prescriptions, labs and care advocacy to help your members make better health and benefits decisions. Pager was founded in 2014 in New York City, and its platform supports over 15 million people across the United States and Latin America. For more information, visit pager.com.

Why Work With Us

Our teams are made up up passionate individuals who care about our mission and enjoy working together! At Pager, you'll have the opportunity to shape and stretch your own career, while making a real impact in today's healthcare landscape!

Gallery

Gallery
Gallery
Gallery
Gallery

Pager Health Offices

Remote Workspace

Employees work remotely.

Pager Health employees work remotely throughout the US.

Typical time on-site:
United States

Similar Jobs

Pager Health Logo Pager Health

Staff Engineer

Artificial Intelligence • Healthtech • Mobile • Software • Telehealth • Generative AI
Remote
US
366 Employees
170K-180K Annually

Pager Health Logo Pager Health

Engineering Manager

Artificial Intelligence • Healthtech • Mobile • Software • Telehealth • Generative AI
Remote
US
366 Employees
180K-200K Annually

Pager Health Logo Pager Health

Bilingual Care Coordinator (Per Diem) - U.S. Remote

Artificial Intelligence • Healthtech • Mobile • Software • Telehealth • Generative AI
Remote
United States
366 Employees
20-21 Hourly

Pager Health Logo Pager Health

VP: Data, Analytics and Insights

Artificial Intelligence • Healthtech • Mobile • Software • Telehealth • Generative AI
Remote
US
366 Employees
250K-275K Annually

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account