At the heart of JP Morgan’s AI transformation is the Chief Analytics Office (CAO) — the team responsible for driving the firmwide adoption of artificial intelligence and advanced analytics. The CAO leads the strategy, governance, and delivery of AI/ML products across the company, ensuring that innovation is balanced with responsibility, security, and ethical best practices. By overseeing the build, adoption, and maintenance of AI solutions, the CAO empowers every line of business to leverage AI/ML at scale and unlock new value for clients and stakeholders.
As a Generative AI Executive Director within our CAO organization, you’ll be at the forefront of building and optimizing production-grade LLM systems (LLM Suite) that serve hundreds of thousands of professionals every day. You’ll architect and scale robust, reusable APIs and agentic workflows that process millions of documents and automate complex financial tasks. Collaboration is key: you’ll work closely with teams across ML Engineering, Product Management, and Cloud Engineering to deliver solutions that are measured, budgeted, and built for real business impact.
Your technical decisions will directly shape how JP Morgan leverages AI at enterprise scale. You’ll ensure LLM Suite is designed for reliability, scalability, and performance — enabling other teams to build on top of our infrastructure and accelerate innovation firmwide. This is not a research sandbox; it’s production infrastructure with executive visibility and measurable ROI.
If you’re ready to lead engineering teams, ship production AI, and make decisions that influence the future of financial technology, we invite you to join us and help define the next era of enterprise AI at JP Morgan.
Job Responsibilities
Architect and deliver production LLM based systems (text, image, speech, video) powering mission-critical LLM Suite products.
Own end-to-end delivery, performance, and continuous improvement of individual LLM Suite products.
Bridge advanced AI research with robust engineering to build innovative, production-ready solutions.
Drive results with an entrepreneurial mindset in a fast-paced, high-impact environment.
Required qualifications, capabilities, and skills
PhD or equivalent experience in Computer Science, Mathematics, Statistics, or a related quantitative discipline.
Extensive hands-on experience as an individual contributor in ML engineering, with a proven track record of shipping production AI systems.
Deep expertise in NLP, Computer Vision, and/or Multimodal LLM algorithms, with a strong foundation in statistics, optimization, and ML theory.
Practical experience implementing distributed, multi-threaded, and scalable applications using frameworks such as Ray, Horovod, DeepSpeed, etc.
Exceptional communication skills, able to convey complex technical concepts and build trust with stakeholders at all levels.
Preferred qualifications, capabilities, and skills
Advanced proficiency in designing and deploying production ML pipelines using DAG frameworks, including custom operator development and pipeline optimization.
Expertise in architecting and implementing high-throughput, low-latency microservices with gRPC, REST, and GraphQL, including protocol buffer schema design, streaming endpoints, and load balancing.
Hands-on experience with parameter-efficient fine-tuning (LoRA, QLoRA, IA3), model quantization (INT8, FP16, GPTQ), and quantization-aware training for LLMs at scale.
Deep knowledge of distributed training strategies (data/model/pipe parallelism), memory optimization, and inference acceleration for large-scale multimodal models.
Experience with advanced agentic workflow orchestration, including multi-agent coordination, stateful task management, and integration with enterprise event-driven architectures.
FEDERAL DEPOSIT INSURANCE ACT: This position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorganChase’s review of criminal conviction history, including pretrial diversions or program entries.
#LI-RB3
About UsWe offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.
JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans
Skills Required
- PhD or equivalent experience in Computer Science, Mathematics, Statistics, or related quantitative discipline
- Extensive hands-on experience as an individual contributor in ML engineering with a proven track record of shipping production AI systems
- Deep expertise in NLP, Computer Vision, and/or multimodal LLM algorithms with strong foundation in statistics, optimization, and ML theory
- Practical experience implementing distributed, multi-threaded, scalable applications using frameworks such as Ray, Horovod, DeepSpeed
- Exceptional communication skills and ability to convey complex technical concepts to stakeholders at all levels
- Designing and deploying production ML pipelines using DAG frameworks, including custom operator development and pipeline optimization
- Architecting and implementing high-throughput, low-latency microservices with gRPC, REST, GraphQL, including protocol buffer schema design, streaming endpoints, and load balancing
- Hands-on experience with parameter-efficient fine-tuning (LoRA, QLoRA, IA3), model quantization (INT8, FP16, GPTQ), and quantization-aware training for LLMs at scale
- Deep knowledge of distributed training strategies (data/model/pipe parallelism), memory optimization, and inference acceleration for large-scale multimodal models
- Experience with advanced agentic workflow orchestration, multi-agent coordination, stateful task management, and integration with enterprise event-driven architectures
JPMorganChase Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about JPMorganChase and has not been reviewed or approved by JPMorganChase.
-
Healthcare Strength — Medical, dental, vision, and mental health coverage are comprehensive, with on-site clinics, preventive care, and specialized supports such as maternity nurse guidance and fertility treatments. Wellness activities can help offset copays and out-of-pocket costs, reinforcing the perceived strength of health benefits.
-
Retirement Support — A 401(k) with dollar-for-dollar matching and additional automatic pay credits reflect strong employer-backed retirement savings. An employee stock purchase plan and related financial programs further bolster long-term financial support.
-
Leave & Time Off Breadth — Paid time off, sick time, holidays, and generous parental leave are provided alongside family medical leave and adoption/fertility assistance. Additional programs like caregiver support and volunteer time off expand the breadth of time-away options.
JPMorganChase Insights
What We Do
JPMorgan Chase & Co. (NYSE: JPM) is a leading global financial services firm with assets of $3.7 trillion and operations worldwide. The firm is a leader in investment banking, financial services for consumers and small businesses, commercial banking, financial transaction processing, and asset management. A component of the Dow Jones Industrial Average, JPMorgan Chase & Co. serves millions of consumers in the United States and many of the world’s most prominent corporate, institutional and government clients under its J.P. Morgan and Chase brands. Technology fuels every aspect of our company and is at the heart of everything we do. With over 50,000 technologists globally and an annual tech spend of $12 billion, we are dedicated to improving the design, analytics, development, coding, testing and application programming that goes into creating high quality software and new products. Learn more about technology at our firm, explore resources from our Distinguished Engineers, AI & ML researchers, and other experts; access the latest episode of our TechTrends podcast, and more at www.jpmorgan.com/technology. Information about JPMorgan Chase & Co. is available at www.jpmorganchase.com. ©2023 JPMorgan Chase & Co. All rights reserved. JPMorgan Chase is an Equal Opportunity Employer, including Disability/Veterans.
Why Work With Us
Our technologists work on a diverse range of solutions that include strategic technology initiatives, big data, mobile, electronic payments, machine learning, cybersecurity, enterprise cloud development, and other state-of-the-art technologies.
Gallery
