Principal II AI Platform Engineer, GenAI

Posted Yesterday
Hiring Remotely in Location, WV, USA
In-Office or Remote
250K-300K Annually
Expert/Leader
Healthtech • Telehealth
The Role
Architects and develops production generative AI applications, agentic systems, conversational experiences, and reusable AI infrastructure. Integrates AI solutions with Databricks, including model serving, retrieval, governance, and vector search. Establishes engineering practices for evaluation, testing, CI/CD, observability, security, and cost monitoring. Leads technical decisions across teams, mentors engineers, partners with product, security, data, and compliance stakeholders, and provides senior escalation support for production AI incidents.
Summary Generated by Built In

Join the team leading the next evolution of virtual care. 


At Teladoc Health, you are empowered to bring your true self to work while helping millions of people live their healthiest lives.


Here you will be part of a high-performance culture where colleagues embrace challenges, drive transformative solutions, and create opportunities for growth. Together, we’re transforming how better health happens.

Summary of Position

We are seeking a Principal II Data & AI Platform Engineer to serve as one of the most senior hands-on technical leaders on our Data & AI Platform team. This role will architect, build, and scale production generative AI applications and agentic systems, including member-facing experiences. You will drive technical decisions for AI architecture, agent infrastructure, and integration with our Databricks ecosystem while directly contributing to design and implementation.


The ideal candidate brings a strong foundation in traditional machine learning and deep learning, followed by substantial recent experience engineering production GenAI solutions. This is a highly influential individual contributor role with technical decision-making authority, cross-team leadership, and an opportunity to shape how Teladoc delivers reliable, secure AI at scale.


Essential Duties and Responsibilities

  • Lead the architecture and hands-on development of production GenAI applications, including member-facing AI agents, conversational experiences, and API-based workflows.
  • Design and build reusable agent infrastructure, including orchestration, tool/function calling (such as MCP), RAG, vector search, context management, and model integrations.
  • Architect AI solutions on Databricks, including platform integration, model serving, retrieval, and governance, with secure and reusable patterns for enterprise applications.
  • Make cross-team technical decisions on AI architecture, scalability, platform integrations, and build-versus-buy tradeoffs, while remaining accountable for implementation.
  • Establish production AI engineering practices for evaluation, automated testing, CI/CD, model/prompt versioning, observability, and troubleshooting.
  • Build safe, reliable AI systems with PHI/PII protections, guardrails, access controls, and performance and cost monitoring.
  • Partner with product, engineering, data, security, and compliance teams to deliver member-facing AI capabilities and integrate AI into enterprise applications.
  • Mentor engineers, set AI engineering standards, and communicate technical decisions to engineering leaders and executives while remaining deeply hands-on.
  • Participate in on-call support as a senior escalation resource for production AI incidents.

The time spent on each responsibility reflects an estimate and is subject to change dependent on business needs.                                                 


Supervisory Responsibilities

No


Qualifications Expected for Position

  • Bachelor’s degree in Computer Science, Engineering, Machine Learning, or a related field, or equivalent practical experience.
  • 12+ years of experience building and running production systems (software, platform, or ML engineering). A proven record of setting technical direction for large, multi-team initiatives and defining architectures and standards used across the company.
  • 5+ years of hands-on Databricks experience at production scale:
    • Lakehouse architecture, Unity Catalog, Delta Lake
    • Spark/PySpark performance tuning
    • Workflows and Databricks SQL
    • Cost management (cluster policies, serverless compute)
  • Strong hands-on foundation in traditional machine learning or deep learning, predating widespread GenAI adoption, followed by recent, substantial agentic GenAI engineering experience.
  • Proven experience personally building, deploying, and operating production GenAI/LLM applications (ideally 3+ years), such as agentic APIs, workflows, or conversational products.
  • Strong knowledge of agent architecture, including orchestration, tool calling, RAG, vector retrieval, context management, evaluation, and observability.
  • Strong Python skills and experience delivering production AI services or APIs, with CI/CD, testing, monitoring, and operational troubleshooting.
  • Ability to lead through technical authority, mentor engineers, collaborate across teams, and design secure, reliable systems while remaining a hands-on individual contributor.

Bonus Qualifications

  • Hands-on experience with Databricks Mosaic AI, Unity Catalog, Delta Lake, MLflow, Vector Search, or Databricks Asset Bundles.
  • Experience with Snowflake, dbt, Terraform, Spark/PySpark, or broader data lakehouse infrastructure.
  • Experience with AI applications in healthcare or other regulated environments, including HIPAA or responsible AI frameworks.
  • Familiarity with complementary AI/cloud frameworks and tools such as LangGraph, Semantic Kernel, Azure AI Foundry, Docker, or Kubernetes.
  • Relevant Databricks or cloud AI certifications, open-source contributions, publications, or conference presentations.

The base salary range for this position is $250,000 - $300,000. In addition to a base salary, this position is eligible for performance bonus, RSU’s, and benefits (subject to eligibility requirements) listed here: Teladoc Health Benefits 2026 Total compensation is based on several factors including, but not limited to, type of position, location, education level, work experience, and certifications. This information is applicable for all full-time positions.


#LI-SS2 #LI-Remote


We follow a Flexible Vacation Policy, intended for rest, relaxation, and personal time. All time off must be approved by your manager prior to use. You will also receive 80 hours of Paid Sick, Safe, and Caregiver Leave annually. This applies to full-time positions only. If you are applying for a part-time role, your recruiter can provide additional details.


As part of our hiring process, we verify identity and credentials, conduct interviews (live or video), and screen for fraud or misrepresentation. Applicants who falsify information will be disqualified.


We’ve been alerted that scammers will sometimes impersonate our employees and make fictitious job offers. The only official email address domain used by Teladoc Health is “@teladochealth.com,” and we are only recruiting for the positions listed below. Additionally, we will never ask you to send any payment to our company or employees, and all Teladoc Health equipment is provided at no charge to our employees. If you have been contacted by any other email domain, offered a position that’s not on our website, or received any other suspicious communication, please do not engage, mark the email as phishing and file a report at https://reportfraud.ftc.gov/.


Teladoc Health will not sponsor or transfer employment work visas for this position. Applicants must be currently authorized to work in the United States without the need for visa sponsorship now or in the future.


Why join Teladoc Health?


  • Teladoc Health is transforming how better health happens. Learn how when you join us in pursuit of our impactful mission. 
  • Chart your career path with meaningful opportunities that empower you to grow, lead, and make a difference.
  • Join a multi-faceted community that celebrates each colleague’s unique perspective and is focused on continually improving, each and every day.  
  • Contribute to an innovative culture where fresh ideas are valued as we increase access to care in new ways.   
  • Enjoy an inclusive benefits program centered around you and your family, with tailored programs that address your unique needs.
  • Explore candidate resources with tips and tricks from Teladoc Health recruiters and learn more about our company culture by exploring #TeamTeladocHealth on LinkedIn.

As an Equal Opportunity Employer, we never have and never will discriminate against any job candidate or employee due to age, race, religion, color, ethnicity, national origin, gender, gender identity/expression, sexual orientation, membership in an employee organization, medical condition, family history, genetic information, veteran status, marital status, parental status, or pregnancy). In our innovative and inclusive workplace, we prohibit discrimination and harassment of any kind.


Teladoc Health respects your privacy and is committed to maintaining the confidentiality and security of your personal information. In furtherance of your employment relationship with Teladoc Health, we collect personal information responsibly and in accordance with applicable data privacy laws, including but not limited to, the California Consumer Privacy Act (CCPA).  Personal information is defined as: Any information or set of information relating to you, including (a) all information that identifies you or could reasonably be used to identify you, and (b) all information that any applicable law treats as personal information. Teladoc Health’s Notice of Privacy Practices for U.S. Employees’ Personal information is available at this link.


Skills Required

  • Bachelor's degree in Computer Science, Engineering, Machine Learning, or a related field, or equivalent practical experience.
  • 12+ years of experience building and running production software, platform, or machine learning systems.
  • Experience setting technical direction for large, multi-team initiatives and defining company-wide architectures and standards.
  • 5+ years of hands-on Databricks experience at production scale.
  • Experience with Lakehouse architecture, Unity Catalog, Delta Lake, Spark or PySpark performance tuning, Workflows, Databricks SQL, and cost management.
  • Strong foundation in traditional machine learning or deep learning.
  • Recent, substantial experience engineering production agentic GenAI solutions.
  • Experience personally building, deploying, and operating production GenAI or LLM applications, ideally 3+ years.
  • Knowledge of agent orchestration, tool calling, RAG, vector retrieval, context management, evaluation, and observability.
  • Strong Python skills and experience delivering production AI services or APIs with CI/CD, testing, monitoring, and operational troubleshooting.
  • Ability to lead through technical authority, mentor engineers, collaborate across teams, and design secure, reliable systems as a hands-on individual contributor.
  • Experience with Databricks Mosaic AI, MLflow, Vector Search, or Databricks Asset Bundles.
  • Experience with Snowflake, dbt, Terraform, Spark/PySpark, or broader data lakehouse infrastructure.
  • Experience with AI applications in healthcare or regulated environments, including HIPAA or responsible AI frameworks.
  • Familiarity with LangGraph, Semantic Kernel, Azure AI Foundry, Docker, or Kubernetes.
  • Relevant Databricks or cloud AI certifications, open-source contributions, publications, or conference presentations.

Teladoc Health Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Teladoc Health and has not been reviewed or approved by Teladoc Health.

  • Healthcare Strength — Comprehensive medical, dental, and vision options combine with free access to the company’s virtual-care services, mental health support, and programs like Hinge Health and Maven. These features materially expand the value of core coverage.
  • Parental & Family Support — Paid parental leave provides 12 weeks of bonding for all parents plus 6–8 weeks of recovery for birthing parents, with eligibility after six months. Family-building resources and teen counseling access further reinforce this focus.
  • Wellbeing & Lifestyle Benefits — Resources such as BetterHelp access, BetterSleep, an EAP, and a monthly TelaFit reimbursement strengthen everyday wellbeing. Remote and flexible work arrangements can enhance the perceived total package.

Teladoc Health Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Purchase, NY
4,002 Employees

What We Do

Teladoc Health is on a mission to empower all people everywhere to live healthier lives by transforming the healthcare experience. Recognized as the world leader in whole-person virtual care, Teladoc Health addresses the full spectrum of health and well-being — powered by human expertise, advanced technology and insights—to deliver improved clinical outcomes at scale. Serving more than 175 countries and ranked Best in KLAS for Virtual Care Platforms in 2020, Teladoc Health leverages extensive expertise and data-driven insights to meet the growing healthcare needs of consumers and healthcare professionals.

Similar Jobs

Qualtrics Logo Qualtrics

Senior Consultant

Artificial Intelligence • HR Tech • Information Technology • Software • Business Intelligence
Remote
United States
7500 Employees
126K-153K Annually

MetLife Logo MetLife

RIS Operations and Service Portfolio Coordinator - 21456

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote or Hybrid
United States
43000 Employees
93K-124K Annually

Dynatrace Logo Dynatrace

Project Manager

Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Remote or Hybrid
United States
5600 Employees
116K-145K Annually

Enverus Logo Enverus

Territory Manager, Business Relations - 26390

Big Data • Information Technology • Software • Analytics • Energy
In-Office or Remote
5 Locations
1800 Employees
80K-175K Annually

Similar Companies Hiring

Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
OneImaging Thumbnail
Healthtech
Miami, FL
62 Employees
Vitalize Thumbnail
Artificial Intelligence • Healthtech • Software
San Francisco, California
50 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account