Job Description:
This role shapes how generative and agentic AI shows up across our data and digital banking products — building AI experiences that are genuinely useful, and the evaluation backbone that makes them reliable and safe in a regulated industry. The hard part of this work isn't access to models; it's the product discipline to turn powerful but probabilistic capabilities into experiences people trust. You will partner with AI architecture, data science, and engineering to bring AI from promising prototype to dependable production feature.
Responsibilities:
AI Product Strategy & Roadmap
- Own the vision, strategy, and roadmap for LLM-powered and agentic AI experiences across multiple products.
- Identify the highest-value applications of AI for our users and translate them into a prioritized roadmap.
- Balance ambitious experimentation with a clear-eyed view of what can be delivered reliably.
Building Reliable AI Experiences
- Turn probabilistic model capabilities into reliable, valuable, and trustworthy user experiences.
- Define how AI features behave, where humans stay in the loop, and how the product degrades gracefully when models are uncertain.
- Work across emerging agentic patterns and tool/interface standards to expand what AI can do for users.
Evaluation, Quality & LLMOps
- Define the evaluation frameworks, quality bars, and guardrails for AI features, balancing reliability, cost, latency, and safety.
- Partner with AI architecture and data science on the tooling and operating practices — evaluation, observability, and LLMOps — that let AI scale across the portfolio.
- Use quantitative and qualitative signals to continuously improve AI feature performance.
Responsible AI & Compliance
- Champion responsible AI — fairness, privacy, transparency, and accountability — throughout the product lifecycle.
- Partner with risk and compliance stakeholders to ensure AI practices meet the expectations of a regulated, financial-services environment.
Cross-Functional Partnership
- Collaborate closely with AI architecture, data science, engineering, and design to ship AI features from concept to production.
- Communicate AI capabilities, limitations, and trade-offs clearly to both technical and non-technical audiences.
Requirements
- 6+ years of product management experience, with proven experience shipping LLM/GenAI or ML-powered products to production.
- Working knowledge of model evaluation, LLMOps and observability, prompt and agent design, and retrieval-augmented generation (RAG).
- Hands-on familiarity with the modern AI product stack — e.g., LLM evaluation and observability platforms (Langfuse, LangSmith, Helicone), orchestration and agent frameworks (such as LangChain), vector databases and retrieval tooling, and experiment-tracking tools (such as MLflow) — along with comfort using Python and SQL.
- Strong cross-functional leadership and sound judgment on AI risk and safety.
- A Bachelor's degree in a technical or quantitative discipline, with a Master's degree a plus.
Preferred Qualifications
- Financial services or banking industry experience (preferred).
- Experience with agentic systems and tool protocols (e.g., Model Context Protocol).
- A conversational UX background, or experience delivering AI in a regulated industry.
As a forward-thinking software provider, Computer Services, Inc. (CSI) helps community and regional financial institutions solve their customers’ needs through open and flexible technologies. In addition to its award-winning core banking platform, these include the latest in lending, digital banking, payments, financial crime prevention and cybersecurity. Building on its 60-year track record of personalized service, CSI is shaping the future of banking and empowering its customers to rival their competition. For more information about CSI, visit www.csiweb.com
CSI provides rewarding and challenging career opportunities for our employees. When determining your pay, we consider various factors such as your skills, qualifications, experience and location. Along with a competitive salary, this position includes eligibility for incentive awards based on both individual and business performance. We also offer a comprehensive range of benefits. To learn more about our benefits, visit: Benefits Summary
CSI is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, physical and mental disability, marital status, veteran status, or any other characteristic protected by applicable law. If you need an accommodation during the recruitment process, please email us at [email protected] and we will work with you to meet your accessibility needs.
For applicants residing in California, please read Privacy Notice for California Residents | CSI (csiweb.com)
Visa Sponsorship: We are unable to offer visa sponsorship for this position. Applicants must be authorized to work in the United States without the need for sponsorship now or in the future.
Skills Required
- 6+ years of product management experience
- Proven experience shipping LLM, generative AI, or machine learning products to production
- Working knowledge of model evaluation, LLMOps, observability, prompt design, agent design, and retrieval-augmented generation
- Hands-on familiarity with LLM evaluation and observability platforms such as Langfuse, LangSmith, or Helicone
- Hands-on familiarity with orchestration and agent frameworks such as LangChain
- Hands-on familiarity with vector databases and retrieval tooling
- Hands-on familiarity with experiment-tracking tools such as MLflow
- Comfort using Python and SQL
- Strong cross-functional leadership and sound judgment on AI risk and safety
- Bachelor's degree in a technical or quantitative discipline
- Financial services or banking industry experience
- Experience with agentic systems and tool protocols such as Model Context Protocol
- Conversational UX background or experience delivering AI in a regulated industry
- Master's degree
What We Do
As a forward-thinking technology partner, we accelerate our delivery of cutting-edge solutions to empower our customers’ growth. CSI heavily invests in research and development, product partnerships and strategic acquisitions to provide the most innovative technologies—all while maintaining our service-first mentality. We drive financial institutions and other businesses forward with a variety of services, including: Core Banking With more than 57 years as a leader in core bank processing, CSI’s enterprise banking solutions empower institutions to compete in an open banking environment while growing assets, developing additional revenue streams and reaching new customers by integrating the latest digital technologies. Regulatory Compliance As an established leader in compliance, top global brands trust CSI as their regtech partner and rely on us for our advanced compliance software—including industry-leading fraud and anti-money laundering solutions. Managed Cybersecurity CSI offers cloud-based cybersecurity services, with 24/7 monitoring, real-time incident remediation, seamless compliance integration and industry-leading support for enhanced threat mitigation. IT Management As one of the largest, most trusted managed services partners in the country, we take a consultative approach to IT management to provide a scalable, efficient IT enterprise that supports institutions’ growth and regulatory needs. Document Distribution From digital document delivery to cost-efficient print and mail services, CSI provides a full range of document distribution solutions to help financial institutions stay connected with their customers. Advisory Services CSI’s Advisory Services—which include IT governance, compliance and risk management services—deliver cost-effective solutions that reduce the time and expense of managing security and compliance while ensuring technology is aligned to business objectives.









