Sr Software Engineer - AI Platform

Posted 5 Hours Ago
3 Locations
In-Office or Remote
Senior level
Healthtech • Insurance
The Role
Operate and scale production LLM and AI agent platforms across the enterprise. Build evaluation frameworks, observability, deployment safeguards, cost optimization, and governance capabilities. Partner with business and technology leaders to identify high-value AI opportunities, design future-state workflows, define requirements and success metrics, guide implementation, and drive adoption. Ensure AI solutions are reliable, measurable, compliant, and integrated into everyday operations.
Summary Generated by Built In

At Blue Cross and Blue Shield of Nebraska, we are a mission-driven organization dedicated to championing the health and well-being of our members and the communities we serve.

Our team is the power behind that promise. And, as the industry rapidly evolves and we seek ways to optimize business processes and customer experiences, there’s no greater time for forward-thinking professionals like you to join us in delivering on it! As a member of Team Blue, you’ll find purpose, opportunities and the support you need to build a meaningful career and make a powerful impact in our community.

We have a live AI platform designed to transform how work gets done across Blue Cross and Blue Shield of Nebraska. AI Agents are helping teams move faster, reduce manual effort, surface insights, and reimagine business processes through AI-driven experiences. The platform is working. Now we need to scale it across the enterprise in a way that is measurable, governed, secure, and capable of delivering real business outcomes.
This role is the connective tissue between the agents technical capabilities and the business value it creates. You'll work across business and technology teams to identify the right opportunities, shape AI-enabled solutions, and ensure every use case delivers measurable impact. You help bridge strategy, operations, and technology, turning AI experimentation into sustainable business transformation.
You'll work shoulder-to-shoulder with business leaders, subject matter experts, engineers, and solution teams. They bring the business challenges and technical capabilities, while you help connect the dots, define the future state, and drive adoption at scale. Together, you will take the agent from a promising platform to a core capability that reshapes how BCBSNE operates.

The ideal candidate will live within driving distance of the Omaha, Nebraska office. This position allows remote flexibility but will have 1 day per week in the office.

If living in one of our approved states (Florida, Iowa, Kansas, Minnesota, Missouri, Nebraska, North Dakota, and Texas) – this person may travel to our headquarters based on business needs.

What You’ll Do:

Your primary focus is platform reliability, evaluation, and AI operations.

  • Business opportunity identification and prioritization. Partner with leaders across Medical Management, Claims, Customer Service, Provider Services, Finance, and Corporate Operations to identify the work best suited for AI agents. Evaluate opportunities based on strategic alignment, operational impact, complexity, and expected business value. Build and maintain a roadmap of agent initiatives that deliver measurable outcomes.
  • Future-state workflow design. Work with business teams to rethink how work gets done in an AI-enabled environment. Facilitate process discovery sessions, identify manual steps that can be automated or augmented by agents, and help teams move beyond current-state thinking. Define future-state workflows that improve efficiency, quality, and employee experience.
  • Agent solution shaping and implementation. Serve as the bridge between business stakeholders and technical teams. Translate business challenges into agent-enabled solutions, help define requirements, establish success criteria, and ensure agent capabilities are aligned to real operational needs. Guide initiatives from concept through deployment and adoption.
  • Change management and adoption. Drive organizational readiness for AI-powered ways of working. Build stakeholder support, identify champions within business areas, facilitate training and communication plans, and help teams integrate agents into day-to-day operations. Ensure solutions are embraced and sustained long after initial deployment.
  • Business value measurement and optimization. Establish key performance indicators and outcome measures for each agent initiative. Track productivity gains, turnaround-time improvements, quality enhancements, cost savings, and experience improvements. Continuously evaluate results and identify opportunities to expand or improve deployed solutions.
  • Enterprise AI governance and scaling. Help establish repeatable frameworks for identifying, evaluating, prioritizing, and delivering agent opportunities across the enterprise. Ensure solutions align with business priorities, risk management standards, compliance requirements, and enterprise architecture principles. Create the operating model that allows agents to scale from individual use cases to enterprise-wide capabilities.
  • Strategic partnership and leadership engagement. Build strong relationships with business and technology leaders to drive AI strategy execution. Facilitate discussions around organizational priorities, emerging opportunities, and investment decisions. Act as a trusted advisor who helps leaders understand not just what agents can do, but how they can fundamentally transform the way work gets done.
  • Success looks like: Agents delivering measurable business outcomes, AI becoming part of everyday operations, reduced manual effort, faster decision-making, improved employee, member, and provider experiences, and a growing portfolio of agent-enabled solutions that create sustainable value across the enterprise.

To be qualified for this position, you must have:

  • Bachelor’s degree and 4-7 years of experience in software engineering. An equivalent combination of education and experience may be substituted to meet this requirement.

Experience operating LLM-based systems in production—not building demos, not writing blog posts about evaluation. You’ve been the person who gets paged when the AI stops working correctly, and you’ve built the systems that prevent that page from happening.

  • 2–3 years in ML/LLM operations, MLOps, or AI platform engineering with production systems serving real users
  • Built evaluation frameworks from scratch: you’ve defined what “correct” means for an LLM system, created the golden datasets and metrics to measure it, and wired it into CI/CD so regressions block deployment
  • Deep observability experience: distributed tracing, custom metrics, alerting on AI-specific signals (drift, latency spikes, retrieval quality drops). You’ve diagnosed a subtle AI failure using your own instrumentation
  • Production ML pipeline experience: model versioning, prompt management, A/B testing, canary rollouts, automated rollback. You understand that deploying an AI change is not the same as deploying code
  • Cost optimization at scale: you’ve tracked token usage, implemented caching strategies, or built model routing that saved meaningful infrastructure spend
  • Experience in regulated industries (healthcare, insurance, fintech, legal)—environments where audit trails, compliance logging, and explainability are requirements, not nice-to-haves
  • Strong Python skills. Comfortable working in a shared codebase alongside agent engineers, contributing to shared tooling and infrastructure
  • Familiarity with Azure ecosystem (Azure OpenAI, Azure Monitor, App Insights, Container Apps) or equivalent cloud-native AI infrastructure
  • Strong knowledge of Python. Work in an existing codebase and extend it with the AI layer
  • Azure OpenAI, Azure AI Search, Azure Container Apps are the target stack 

The strongest candidates will also have:

  • Experience working in an Agile/Scrum environment.
  • Desire to think in a creative, lateral way both conceptually and in practical application.
  • You must be obsessed with addressing customer needs.
  • Strong communication and interpersonal skills.
  • Experience with Azure AD AuthN/AuthZ strategies.
  • Experience creating Single Sign On (SSO) experiences.
  • Possess emotional intelligence.
The StackPython / FastAPI · LangSmith · Azure App Insights / Azure Monitor · Azure OpenAI · Azure Container Apps · PostgreSQL · Redis · Delta Lake · GitHub Actions · Prometheus / Grafana

" We are unable to sponsor or take over sponsorship of an employment visa at this time.” 

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed are representative of the knowledge, skill, and or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. Other duties may be assigned.

Ready to make an impact? Join a team where your skills, attitude, and ideas are valued—and where you’ll help shape the future of healthcare technology.Learn more about what makes BCBSNE such an exceptional place to work by visiting NebraskaBlue.com/Careers.We strongly believe that diversity of experience, perspective and background will lead to a better workplace for our employees and a better product for our customers and members.

Learn more about what makes BCBSNE such an exceptional place to work by visiting NebraskaBlue.com/Careers.

We strongly believe that diversity of experience, perspective and background will lead to a better workplace for our employees and a better product for our customers and members.

Skills Required

  • Bachelor’s degree and 4–7 years of software engineering experience, or equivalent education and experience
  • 2–3 years of experience in ML operations, LLM operations, MLOps, or AI platform engineering with production systems serving real users
  • Experience operating LLM-based systems in production
  • Experience building LLM evaluation frameworks, golden datasets, evaluation metrics, and CI/CD regression gates
  • Deep observability experience, including distributed tracing, custom metrics, alerting, AI-specific signals, and failure diagnosis
  • Production ML pipeline experience with model versioning, prompt management, A/B testing, canary rollouts, and automated rollback
  • Experience optimizing AI infrastructure costs through token tracking, caching, or model routing
  • Experience working in regulated industries such as healthcare, insurance, fintech, or legal
  • Strong Python skills and experience contributing to shared codebases and infrastructure
  • Familiarity with Azure or equivalent cloud-native AI infrastructure
  • Experience with Azure OpenAI, Azure AI Search, and Azure Container Apps
  • Experience in an Agile or Scrum environment
  • Experience with Azure AD authentication and authorization strategies
  • Experience creating single sign-on experiences
  • Strong communication and interpersonal skills
  • Creative and lateral problem-solving ability
  • Customer-focused mindset and emotional intelligence
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Omaha, NE
1,098 Employees
Year Founded: 1939

What We Do

To millions of Americans, Blue Cross and Blue Shield symbolizes peace of mind when it's needed most. That’s because, collectively, the Blue Cross and Blue Shield brands represent the largest and most experienced health care benefit companies in the country. At Blue Cross and Blue Shield of Nebraska, our story is all about you – the people we’ve been serving since 1939. As a company born and raised in Nebraska, we believe it’s our responsibility to be an active member of the communities where we live and work alongside our customers. We envision a health care world without confusion that adds more good years to peoples' lives, and we consider it an honor to be there for you when you need us. Thank you for letting us be part of your story. 1939 was the beginning of a long tradition of health care coverage in Nebraska. Blue Cross and Blue Shield of Nebraska is a mid-size Nebraska business whose mission is to lead the way in supporting patient-focused care. We see the future of healthcare as one without confusion that adds more good years to peoples'​ lives. As a Nebraska-based company, we believe it’s our responsibility to be an active member of the communities in which our customers live and work.

Similar Jobs

Coinbase Logo Coinbase

Senior Software Engineer

Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Easy Apply
Remote
USA
4700 Employees
186K-219K Annually
Remote
US
1470 Employees
195K-260K Annually

ZenBusiness Logo ZenBusiness

Senior Software Engineer

Artificial Intelligence • Machine Learning • Payments • Professional Services • Social Impact • Conversational AI • Generative AI
Remote
USA
357 Employees
125K-150K Annually
Remote
USA
142 Employees
146K-250K Annually

Similar Companies Hiring

Sailor Health Thumbnail
Healthtech • Social Impact • Telehealth
New York City, NY
20 Employees
Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
OneImaging Thumbnail
Healthtech
Miami, FL
62 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account