Principal Applied Scientist – Responsible AI

JOB SUMMARY:

The Principal Applied Scientist — Responsible AI is responsible for the design, development, and technical evaluation of AI/ML systems, with a focus on production readiness, model reliability, and technical risk validation. This role serves as the technical authority within the Responsible AI program, ensuring that all AI systems meet defined standards for performance, observability, and risk mitigation prior to production deployment.

Your work directly impacts audit readiness, risk mitigation, and the trustworthiness of AI systems used across the business. This role does not own governance frameworks, policy, or enterprise AI architecture, but ensures that AI systems are technically compliant, measurable, and defensible within those frameworks.

JOB ROLES AND RESPONSIBILITIES:

1. Model Evaluation & Technical Risk Assessment

• Develop and implement evaluation frameworks for model performance, reliability, and robustness
• Assess risks including bias, hallucination, data leakage, and system failure modes
• Provide technical validation for AI systems prior to governance approval

 2. Production Readiness & Deployment Standards

• Define and validate technical criteria for “production-ready AI”
• Ensure systems meet required thresholds for deployment (performance, monitoring, controls)
• Support go/no-go decisions with objective, evidence-based analysis

3. Observability & Monitoring

• Design and implement model monitoring and evaluation pipelines
• Define metrics for performance tracking, drift detection, and system health
• Ensure systems produce traceable, audit-ready outputs

4. Cross-Functional Technical Leadership

• Partner across Core AI, Engineering, Product, Legal, and Compliance teams
• Serve as the technical reviewer in governance and production approval workflows
• Provide guidance to engineering teams on aligning with governance requirements

5. Innovation & Applied Research

• Research and evaluate emerging AI technologies, including generative AI and agentic systems
• Prototype and test new approaches aligned with production and governance constraints
• Contribute to continuous improvement of AI capabilities and standards

6. Mentorship & Technical Standards

• Mentor applied scientists and data scientists
• Promote best practices in experimentation, validation, and reproducibility
• Elevate technical rigor across AI development teams

7. Governance Alignment (Non-Ownership)

• Ensure AI systems comply with defined Responsible AI and governance standards
• Partner with the AI Governance Architect to operationalize technical requirements
• Support audit readiness through well-documented technical evidence

8. Technical Planning, Prioritization & Pipeline Management

• Manage a portfolio of AI initiatives aligned to Responsible AI and business objectives
• Provide transparency into pipeline status, technical dependencies, and risks
• Balance research, development, and production support across multiple concurrent efforts
• Ensure disciplined execution aligned with governance and production milestones

JOB REQUIREMENTS (Education, Experience, and Training):

• 5 to 8 years of hands‑on experience developing, evaluating, or deploying ML or AI systems in production environments; with strong interest/experience in Responble AI and AI governance.

• Expertise in modern ML/AI techniques, including:

  • Large Language Models (LLMs)

  • Generative AI (text, vision, multimodal)

  • Classical ML (supervised, unsupervised, reinforcement learning)

  • Model evaluation and validation methodologies

• Deep understanding of AI system risks, including bias, hallucination, robustness, drift, data leakage, and safety failure modes.

• Proficiency in Python and ML frameworks (PyTorch, TensorFlow, JAX, HuggingFace, Ray, MLflow, or equivalent).

• Must have strong organizational capabilities to manage and prioritize multiple complex AI initiatives simultaneously.
• Must have strong project management skills to partner through production deployment.
• Strong problem-solving, communication, and cross-functional collaboration skills will be key to success in this role that requires collaborating with Core AI Science/Engineering teams, and business stakeholders. 
• Experience in healthcare or regulated environments strongly preferred!
• MS with significant applied experience acceptable. Advanced degree in a quantitative field (Computer Science, Machine Learning, Statistics, Applied Mathematics, Engineering, or related discipline) preferred.

COMPENSATION The salary range for this position is $180K to $200K. Specific compensation offers are determined based on a variety of factors including the candidate’s education, experience, skills, work location, and internal equity considerations In addition to base salary, this position is eligible for an annual performance bonus and a comprehensive benefits package, including health insurance and a 401(k) retirement plan.

BENEFITS  

We realize that our employees are instrumental in our success, and we reward them accordingly with very competitive compensation and benefits packages, an incentive bonus program, as well as recognition and awards programs.  Our work environment is friendly and supportive, and we offer flexible schedules whenever possible, as well as a wide range of live and web-based professional development and educational programs to prepare you for advancement opportunities. 

Your benefits will include: 

• Medical, dental and vision coverage with low deductible & copay 

• Life insurance 

• Short and long-term disability 

• Paid Parental Leave 

• 401(k) + match 

• Employee Stock Purchase Plan 

• Generous Paid Time Off – accrued based on years of service  

• WA Candidates: the accrual rate is 4.61 hours every other week for the first two years of tenure before increasing with additional years of service 

• 10 paid company holidays 

• Tuition reimbursement 

• Flexible Spending Account 

• Employee Assistance Program 

• Sick time benefits – for eligible employees, one hour of sick time for every 30 hours worked, up to a maximum accrual of 40 hours per calendar year, unless the laws of the state in which the employee is located provide for more generous sick time benefits. 

EEO STATEMENT 

Claritev is an Equal Opportunity Employer and complies with all applicable laws and regulations.  Qualified applicants will receive consideration for employment without regard to age, race, color, religion, gender, sexual orientation, gender identity, national origin, disability or protected veteran status.  If you would like more information on your EEO rights under the law, please click here. 

APPLICATION DEADLINE 

We will generally accept applications for at least 5 calendar days from the posting date or as long as the job remains posted. 

#LI – VG1