The AI Analyst II is responsible for developing, configuring, and optimizing AI solutions and agents that support business processes and operational objectives. This role serves as a trusted partner to stakeholders by identifying opportunities for AI enablement, recommending improvements, and ensuring solutions deliver measurable business value while aligning with governance requirements.
Essential Functions:
- Designs, builds, and administers moderately complex AI solutions and agents using Copilot, Copilot Studio, Power Automate, and other approved tools.
- Provides ongoing oversight of AI solutions at the business level.
- Evaluates and optimizes AI solution behavior and identifies opportunities for configuration improvements.
- Monitors metrics and business outcomes.
- Performs testing, validation, and quality review of AI solution outputs to ensure accuracy, usability, and alignment with expected business outcomes.
- Maintains documentation related to AI solution configuration, workflows, prompts, user guidance, and performance observations.
- Collaborates with technical, governance, compliance, and business partners to support responsible use, adoption, and ongoing enhancement of AI solutions.
- Perform any other job related duties as requested.
Education and Experience:
- Bachelor's degree in a related field required
- Equivalent years of relevant work experience may be accepted in lieu of required education
- Three (3) years of experience in healthcare operations, business analysis, automation, digital transformation, technology solutions, or a related field required
- Experience to include a background in AI-enabled tools, digital engagement, automation, or conversational technologies required
- Experience setting up or improving service journeys, knowledge resources, workflows, or AI-enabled experiences in a cross-functional environment preferred
- Experience in healthcare, health insurance, or another regulated industry is preferred
- Understanding of generative AI tools, AI agents, large language model behavior, prompt patterns, agent instructions, model limitations, knowledge retrieval, and evaluation methods
- Aptitude for designing AI-enabled healthcare service experiences, customer or employee journeys, conversational flows, and operational workflows
- Ability to translate complex healthcare operation’s needs into clear AI experience designs, prompts, agent instructions, business requirements, acceptance criteria, and quality standards
- Ability to support testing, validation, and quality review of AI solution outputs to ensure accuracy, usability, and alignment with expected business outcomes
- Analytical, critical thinking, problem-solving, facilitation, communication, and documentation skills
- Knowledge of responsible AI principles, privacy considerations, accessibility, security, risk controls, and human-in-the-loop review practices
- Ability to establish and maintain effective working relationships with cross-functional stakeholders
- Ability to manage multiple assignments, prioritize work, meet deadlines, and adapt in a fast-paced environment
- Proficiency with Microsoft Office tools, including Word, Excel, PowerPoint, Outlook, Teams, and related collaboration tools
- None
- General office environment; may be required to sit or stand for extended periods of time
- Travel is not typically required
Compensation Range:
$72,200.00 - $115,500.00CareSource takes into consideration a combination of a candidate’s education, training, and experience as well as the position’s scope and complexity, the discretion and latitude required for the role, and other external and internal data when establishing a salary level. In addition to base compensation, you may qualify for a bonus tied to company and individual performance. We are highly invested in every employee’s total well-being and offer a substantial and comprehensive total rewards package.
Compensation Type (hourly/salary):
SalaryOrganization Level Competencies
Fostering a Collaborative Workplace Culture
Cultivate Partnerships
Develop Self and Others
Drive Execution
Influence Others
Pursue Personal Excellence
Understand the Business
Skills Required
- Bachelor's degree in a related field
- Three years of experience in healthcare operations, business analysis, automation, digital transformation, technology solutions, or a related field
- Experience with AI-enabled tools, digital engagement, automation, or conversational technologies
- Experience setting up or improving service journeys, knowledge resources, workflows, or AI-enabled experiences in a cross-functional environment
- Experience in healthcare, health insurance, or another regulated industry
- Understanding of generative AI tools, AI agents, large language model behavior, prompt patterns, agent instructions, model limitations, knowledge retrieval, and evaluation methods
- Ability to design AI-enabled healthcare service experiences, customer or employee journeys, conversational flows, and operational workflows
- Ability to translate healthcare operations needs into AI experience designs, prompts, agent instructions, business requirements, acceptance criteria, and quality standards
- Ability to support testing, validation, and quality review of AI solution outputs
- Knowledge of responsible AI principles, privacy, accessibility, security, risk controls, and human-in-the-loop review practices
- Proficiency with Microsoft Office tools, including Word, Excel, PowerPoint, Outlook, and Teams
CareSource Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about CareSource and has not been reviewed or approved by CareSource.
-
Strong & Reliable Incentives — Bonuses are regularly available and serve as a meaningful part of total compensation. Annual performance-based awards are considered a strong component.
-
Leave & Time Off Breadth — PTO starts around four weeks and increases with tenure, complemented by paid holidays and a floating day. Volunteer time expands the available leave options.
-
Affordable Benefits — Health plan options are considered affordable, supported by wellness incentives that can reduce premiums. Coverage breadth includes medical, dental, vision, and cost‑lowering programs.
CareSource Insights
What We Do
Health Care with Heart. It is more than a tagline; it’s how we do business. CareSource has been providing life-changing health care to people and communities for nearly 30 years and we will continue to be a transformative force in the industry by placing people over profits. CareSource is and will always be members first. Even as we grow, we remember the reason we are here – to make a difference in our members’ lives by improving their health and well-being. Today, CareSource offers a lifetime of health coverage to nearly 2 million members through plan offerings including Marketplace, Medicare Advantage and Medicaid. With our team of 4,000 employees located across the country, we continue to clear a path to better life for our members. Visit the "Life" section to see how we are living our mission in the states we serve. CareSource is an equal opportunity employer and gives consideration for employment to qualified applicants without regard to race, color, religion, sex, age, national origin, disability, sexual orientation, gender identity, genetic information, protected veteran status or any other characteristic protected by applicable federal, state or local law. If you’d like more information about your EEO rights as an applicant under the law, please click here: https://www.eeoc.gov/employers/upload/poster_screen_reader_optimized.pdf and here: https://www.dol.gov/ofccp/regs/compliance/posters/pdf/OFCCP_EEO_Supplement_Final_JRF_QA_508c.pdf Si usted o alguien a quien ayuda tienen preguntas sobre CareSource, tiene derecho a recibir esta información y ayuda en su propio idioma sin costo. Para hablar con un intérprete, Por favor, llame al número de Servicios para Afiliados que figura en su tarjeta de identificación. 如果您或者您在帮助的人对 CareSource 存有疑问，您有权 免费获得以您的语言提供的帮助和信息。 如果您需要与一 位翻译交谈，请拨打您的会员 ID 卡上的会员服务电话号码
