Senior Software Engineer (Applied AI)

Posted Yesterday
Hiring Remotely in New York, NY, USA
In-Office or Remote
160K-200K Annually
Senior level
Healthtech • Software • Analytics
Pearl Health is democratizing access to value in healthcare, providing physicians with the tools to provide great care.
The Role
Design and build production-grade Applied AI features (RAG, vector DBs, agentic workflows, LLM integrations). Develop scalable data pipelines, APIs, and microservices, ensure observability, security, and regulatory compliance, deliver POCs, mentor engineers, drive architecture and cross-team delivery, and build user-facing intelligence features.
Summary Generated by Built In
The Opportunity

As a Senior Software Engineer (Applied AI), you will play a critical hands-on role in building the AI-powered intelligence layer of the Pearl platform. You will design and implement Applied AI features, including RAG pipelines, Agentic workflows, and LLM integrations, while ensuring these capabilities are delivered through scalable, production-grade services. If you are passionate about turning cutting-edge AI into real products that drive better health outcomes for thousands of providers and their patients, this role could be a great fit.

Who We Are

Pearl Health is dedicated to empowering primary care providers, health systems, and physician-led networks to succeed in the shift to value-based care. Our platform delivers the technology, financial tools, and expert services that enable practices to provide more proactive, effective care to their Medicare patients, ultimately lowering costs and improving health outcomes.

Founded in 2020, we are a team of healthcare and technology innovators backed by premier investors like Andreessen Horowitz, Viking Global Investors, and AlleyCorp. We partner with thousands of providers across 44 states to build a more sustainable future for American healthcare.

What You'll Do

Applied AI & Full-Stack Engineering

  • Design, build, and own production AI features powered by LLMs, including RAG architectures (chunking strategies, semantic search, vector databases) and Agentic workflows.

  • Develop high-performance data pipelines, APIs, and microservices that process healthcare data at scale and securely integrate LLM outputs into user-facing experiences.

  • Execute Proof-of-Concepts (POCs) and technical evaluations of new AI technologies to validate product viability and scalability.

  • Build responsive web applications using modern frontend frameworks to deliver intuitive, user-facing intelligence and analytic features.

  • Ensure observability, monitoring, and operational excellence for AI-powered services, championing security and regulatory compliance (HIPAA, SOC2).

Technical Leadership & Collaboration

  • Drive architectural decisions and system optimizations for AI features in close collaboration with product and engineering leadership.

  • Own technical projects from discovery to delivery with autonomy, ensuring solutions align with business needs and long-term scalability.

  • Mentor and upskill fellow engineers on Applied AI best practices, fostering a strong culture of technical excellence and collaborative growth.

  • Contribute to the team's understanding of LLM capabilities, limitations, and best practices within the healthcare domain.

  • Participate in thorough design and code reviews, raising the bar for technical quality across the team.

Delivery & Impact

  • Own and deliver complex technical projects with autonomy and accountability, ensuring successful delivery aligned with business timelines.

  • Identify and help resolve technical bottlenecks and cross-team dependencies that impact delivery velocity or system reliability.

  • Balance speed and quality, making pragmatic decisions that enable rapid iteration while maintaining engineering excellence.

What You'll Bring

You are an experienced engineer who combines strong full-stack fundamentals with hands-on Applied AI experience. You're excited to build production AI systems in a fast-moving healthcare environment and to elevate the capabilities of the team around you.

Must-Haves

  • 7+ years of professional experience in software engineering, with a strong foundation in service-oriented architectures and distributed systems.

  • Hands-on experience working with RAG architectures, vector databases, embedding models, and/or Agentic workflows in personal or production environments.

  • Experience with observability and evaluation practices for LLM systems (prompt tracking, quality metrics, cost monitoring)

  • Strong proficiency in Python, relational databases, and a major cloud platform (AWS preferred).

  • A deep understanding of modern service design principles, including RESTful and event-driven architectures.

  • Proven experience designing, building, and optimizing data-intensive applications.

  • A demonstrated history of mentoring engineers and driving technical best practices within a team.

  • A strong background in performance optimization, reliability engineering, and security best practices.

Nice-to-Haves

  • Experience building and deploying user-facing client applications using modern frameworks (e.g., React, Angular, Vue.js, TypeScript).

  • A background working in healthcare technology, fintech, or another highly regulated industry.

  • Familiarity with compliance and security frameworks such as HIPAA or SOC2.

This role might not be for you if:

  • You are primarily interested in academic AI research or fundamental model training, rather than the hands-on productization and deployment of AI features.

  • Your career preference is to specialize deeply in only one area of the stack (pure frontend or pure backend) and not apply expertise across a full-stack context.

  • You thrive most in a highly structured corporate environment with top-down decision-making and minimal ambiguity.

Our Values

Collaborate to Innovate: We believe the best solutions arise from intelligent teamwork. We trust the expertise of our teammates and pursue opportunities to learn and grow from each other. By embracing diverse perspectives and encouraging authenticity, we create and evangelize groundbreaking health solutions.

Trust Through Transparency: We prioritize transparency in all our interactions, ensuring that employees, patients, clinicians and partners have access to the information they need to make informed decisions. Integrity is at the core of how we operate, from building products to fostering relationships, and is crucial to our ability to communicate openly and gain trust.

Serious Impact, Big Heart: We go above and beyond with our efforts to empower proactive, patient-centered care — and we celebrate every step forward. Humor and positivity fuel our creativity, strengthen relationships, and remind us to acknowledge the journey as much as the destination.

We are an Equal Opportunity Employer on a mission to improve lives. Our strength comes from the diverse backgrounds, experiences, and perspectives of our team. We welcome all candidates and are committed to a fair, inclusive hiring process free from discrimination.

What We Offer

The expected offer for this role includes the following components:

Base Salary Range: $160,000 - $200,000 per year.

Additional Compensation: This role is eligible for a discretionary performance bonus and equity options.

Benefits: We offer a competitive benefits package. More on our careers page.

Final compensation for this role will be determined by a variety of factors, including a candidate's relevant skills, experience, labor market conditions, and location.

The Interview Process

While steps may vary by role, you can typically expect:

  1. Recruiter Screen: An intro call to discuss your background and motivations.

  2. Technical Exercise: An online assessment meant to evaluate relevant technical skills.

  3. Engineering Manager Interview: A deeper-dive conversation with an EM.

  4. Panel Interview: A round of technical and behavioral meetings with teammates, a cross-functional partner, and a leader.

  5. Executive Interview: Final conversation(s) with 1-2 of our leaders.

Skills Required

  • 7+ years professional software engineering experience with service-oriented architectures and distributed systems.
  • Hands-on experience with RAG architectures, vector databases, embedding models, and/or Agentic workflows.
  • Experience with observability and evaluation practices for LLM systems (prompt tracking, quality metrics, cost monitoring).
  • Strong proficiency in Python.
  • Experience with relational databases (SQL).
  • Proficiency with a major cloud platform.
  • Experience designing, building, and optimizing data-intensive applications.
  • Deep understanding of modern service design principles, including RESTful and event-driven architectures.
  • Proven background in performance optimization, reliability engineering, and security best practices.
  • Demonstrated history of mentoring engineers and driving technical best practices.
  • Experience building and deploying user-facing client applications using modern frameworks (React, Angular, Vue.js) and TypeScript.
  • Familiarity with HIPAA or SOC2 compliance and security frameworks.
  • Background working in healthcare technology, fintech, or other highly regulated industry.
  • AWS experience (preferred).

Pearl Health Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Pearl Health and has not been reviewed or approved by Pearl Health.

  • Healthcare Strength Health coverage includes a national PPO base plan fully paid for employees, plus dental, vision, FSA, commuter, disability, life, and wellbeing programs. Feedback suggests the employer-paid base plan and breadth of offerings create strong value.
  • Retirement Support A 401(k) with a dollar-for-dollar match up to a defined portion of pay and immediate eligibility is highlighted, funded each pay period. Feedback suggests the predictable, ongoing match supports long-term financial security.
  • Parental & Family Support Paid parental leave is offered for both primary and non-primary caregivers at meaningful durations. Feedback suggests this support enhances work-life balance for growing families.

Pearl Health Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
110 Employees
Year Founded: 2020

What We Do

Pearl Health is fixing the health care system by partnering with Primary Care practices around the country, providing the data-driven software and consultative services they need to optimize the quality of care for their patients.

Gallery

Gallery

Similar Jobs

Circle (circle.so) Logo Circle (circle.so)

Software Engineer

Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Easy Apply
Remote
31 Locations
250 Employees
130K-140K Annually

GitLab Logo GitLab

Commercial Account Executive

Cloud • Security • Software • Cybersecurity • Automation
Easy Apply
Remote
United States
2500 Employees

Dynatrace Logo Dynatrace

Lead Internal Communications Advisor

Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Remote or Hybrid
United States
5600 Employees
116K-145K Annually

Garner Health Logo Garner Health

Field Marketing Manager

Big Data • Healthtech • HR Tech • Machine Learning • Software • Telehealth • Big Data Analytics
Easy Apply
Remote
USA
350 Employees
127K-140K Annually

Similar Companies Hiring

Legora Thumbnail
Artificial Intelligence • Legal Tech • Software
Chicago, Illinois
700 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account