Principal Software Engineer, AI-Native

Posted Yesterday
Hiring Remotely in US
Remote
210K-275K Annually
Senior level
Healthtech
The Role
Architect and build AI-native production systems across a multi-language stack, design offline and online evaluation frameworks for LLMs, monitor live model behavior and drift, lead architecture reviews, mentor senior engineers, and prototype and ship AI capabilities while ensuring reliability and correctness in a regulated domain.
Summary Generated by Built In

We are a healthcare technology company that provides platforms and solutions to improve the management and access of cost-effective pharmacy benefits. Our technology helps enterprise and partnership clients simplify their businesses and helps consumers save on prescriptions.

As a leader in SaaS technology for healthcare, we offer innovative solutions with integrated intelligence on a single enterprise platform that connects the pharmacy ecosystem.  With our expertise and modern, modular platform, our partners use real-time data to transform their business performance and optimize their innovative models in the marketplace.

Position summary

RxSense is becoming an AI native company, and AI is the primary lever behind our next phase of growth.

This is a deeply technical, architect level role. You will sit on the AI Engineering team and set the technical standard the broader engineering organization looks to, leading through example and craft rather than mandate. You will architect and build systems across our stack (C#/.NET, Python, and the occasional TypeScript front end), and you will lead development of our AI evaluation infrastructure, both offline (test suites, golden datasets, and regression harnesses wired into CI/CD) and online (continuous monitoring of live model and system behavior).

Working in this domain is compelling because two things must hold true at once. Our systems need to be correct, since we operate in a regulated, high stakes domain where evaluation and trustworthy behavior matter as much as the features themselves. Our systems also need to be fast, since they run at high volume and low latency, where performance compounds at scale. Much of this role is about helping projects move quickly while staying confident in the products we ship.

You will do this work in an AI forward environment. Our engineers build with modern agentic tooling standardized on Anthropic's Claude, so you will have first class tools for the work ahead.

Responsibilities

  • Architect and build production systems across a multi language stack: C#/.NET services, Python AI and data pipelines, and occasional TypeScript
  • Set the example for an AI forward, high technical standard across the broader engineering organization, leading through craft rather than organization wide authority
  • Design and drive adoption of offline evaluation frameworks (test suites, golden datasets, regression harnesses wired into CI/CD) for LLM based and other non deterministic components
  • Build online evaluation and monitoring that continuously assesses live model and system behavior in production, including drift and regression detection
  • Partner with engineering leadership to surface systemic risks in AI features, such as reliability, correctness, and drift, and drive the fixes
  • Lead architecture reviews for major initiatives and mentor senior and staff engineers on system design, evaluation methodology, and AI forward practices
  • Prototype and ship new AI capabilities

What success looks like

Day to day, you move between writing production code, shaping architecture across teams, and building the evaluation tooling that gives RxSense confidence in its AI systems before and after they ship. 

Qualifications

  • 8+ years of professional software engineering experience, with demonstrated Staff, Principal, or Architect-level scope — e.g., owning system architecture end-to-end, driving technical strategy across multiple teams, or being accountable for critical production systems. We evaluate candidates on the scope and impact of their work rather than years of experience alone; strong candidates with less tenure but clear evidence of this level of ownership are encouraged to apply. 
  • Depth across backend and AI/ML systems, working in some combination of C#/.NET, Python, and TypeScript.
  • Experience with LLM observability, prompt and response evaluation, or agentic system testing
  • A track record of setting technical standards that other engineers and teams adopt.
  • Strong communication skills, with the ability to align engineers and leadership around a shared technical direction.
  • Comfort working in an AI forward engineering environment, for example with agentic coding tools such as Claude Code.
  • Bachelor's degree in Computer Science, Engineering, or a related field preferred. Equivalent practical experience will be considered in lieu of a formal degree. 

Preferred

  • Experience in pharmacy benefits, healthcare, fintech, or another regulated, high stakes domain.
  • Familiarity with distributed systems tooling such as Kafka, gRPC, Grafana, and Dragonfly / Redis.
  • A good eye for clean, usable interfaces for the occasional front end work.

Salary Range- $210,000- $275,000

RxSense believes that a diverse workforce is a more talented and productive workforce. As such, we are an Equal Opportunity and Affirmative Action employer. Our recruitment process is free from discriminatory hiring practices and all qualified applicants are considered for employment without regard to race, color, religion, sex, gender, sexual orientation, gender identity, ancestry, age, or national origin.  Neither will qualified applicants be discriminated against on the basis of disability or protected veteran status.  We believe in the strength of the collaboration, creativity and sense of community a diverse workforce brings. 

Skills Required

  • 8+ years of professional software engineering experience with Staff, Principal, or Architect-level scope (owning system architecture end-to-end, driving technical strategy, accountable for critical production systems).
  • Depth across backend and AI/ML systems, working in some combination of C#/.NET, Python, and TypeScript.
  • Experience with LLM observability, prompt and response evaluation, or agentic system testing.
  • A track record of setting technical standards that other engineers and teams adopt.
  • Strong communication skills, ability to align engineers and leadership around a shared technical direction.
  • Comfort working in an AI forward engineering environment, e.g., with agentic coding tools such as Claude Code.
  • Bachelor's degree in Computer Science, Engineering, or related field (preferred; equivalent practical experience accepted).
  • Experience in pharmacy benefits, healthcare, fintech, or another regulated, high stakes domain.
  • Familiarity with distributed systems tooling such as Kafka, gRPC, Grafana, and Dragonfly / Redis.
  • A good eye for clean, usable interfaces for occasional front end work.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Boston, Massachusetts
280 Employees
Year Founded: 2015

What We Do

RxSense (www.rxsense.com) is a high growth and mission-driven healthcare technology company that provides sophisticated cloud-based enterprise solutions for flexible, efficient, and transparent pharmacy benefits administration, claims processing and advanced analytics serving pharmacy benefit managers, health plans, health systems, as well as new and non-traditional industry entrants. RxSense also utilizes its advanced platform and direct contracts with the nation's largest pharmacies (including CVS, Walmart and Walgreens) to deliver consistently low prices direct to consumers on prescription drugs through its SingleCare (www.singlecare.com)prescription savings services. RxSense's mission is to deliver industry leading technology solutions that improve healthcare transparency and access to more affordable medications for millions across America.

Similar Jobs

Cox Enterprises Logo Cox Enterprises

Sales Representative

Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Remote or Hybrid
South Carolina, USA
50000 Employees
45K-88K Annually

Cox Enterprises Logo Cox Enterprises

Fixed Operations Performance Manager

Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Remote or Hybrid
PA, USA
50000 Employees
42K-124K Annually

Cox Enterprises Logo Cox Enterprises

Senior Director, Equipment Sales & Leasing

Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Remote or Hybrid
New Jersey, USA
50000 Employees
182K-304K Annually

Cox Enterprises Logo Cox Enterprises

Human Resources Business Partner

Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Remote or Hybrid
United States
50000 Employees
67K-101K Annually

Similar Companies Hiring

Sailor Health Thumbnail
Healthtech • Social Impact • Telehealth
New York City, NY
20 Employees
Granted Thumbnail
Mobile • Insurance • Healthtech • Financial Services • Artificial Intelligence
New York, New York
23 Employees
OneImaging Thumbnail
Healthtech
Miami, FL
62 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account