Lead Software Engineer - Java/Python with AI

Posted Yesterday
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
Hybrid
Senior level
Financial Services
We’re one of the world’s biggest technology-driven companies
The Role
Leads development and production operations for LLM-powered software, including RAG applications, agent workflows, microservices, inference pipelines, guardrails, evaluations, and observability. Establishes responsible AI engineering practices, CI/CD integration, model and prompt governance, reliability controls, and secure coding standards. Provides L3 and BAU support for Markets use cases, manages incidents and rollouts, and coaches teams on compliant AI-assisted software development.
Summary Generated by Built In
We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. 
As a Lead Software Engineer at JPMorganChase within the Commercial & Investment Bank, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm’s business objectives. 
Job responsibilities
  • Execute creative LLM assisted software solutions, design, develop, and troubleshoot LLM powered applications and services (e.g., retrieval augmented generation, agent workflows, structured extraction, classification) with a willingness to think beyond routine approaches to break down technical problems and deliver measurable outcomes and think in the novel Agentic AI way.
  • Drives team adoption of enterprise-authorized AI-assisted engineering practices within the work environment to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test strategy acceleration, incident/root-cause analysis support), while establishing consistent validation standards (secure coding, peer review, automated testing) and promoting reuse of effective patterns across the team.
  • Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.
  • Develop data quality rules and controls using LLM, define and enforce guardrails for prompts, retrieved context, model inputs/outputs, and post processing, including PII redaction, toxicity/safety filters, hallucination mitigation, output schema validation, and policy compliance.
  • Provide Level 3 (L3) support for LLM assisted production systems, own complex incidents, model and prompt rollouts/rollbacks, dependency issues (vector stores, embeddings, feature stores), and ensure high availability, reliability, and adherence to SLAs including latency and cost budgets.
  •  Support BAU operations for Markets businesses: maintain and evolve LLM use cases supporting markets workflows with disciplined change management, canary releases, A/B tests, and close partnership with product, controls, and operations.Create secure, high quality production code: implement LLM assisted micro services, synchronous and asynchronous inference pipelines (streaming where appropriate), deterministic fallbacks, circuit breakers, and observability for reliability in production.
  •  Produce architecture and design artifacts, deliver model cards, system/data lineage, RAG/agent reference architectures, prompt libraries and versioning strategies, evaluation plans, and control evidence ensuring design constraints and regulatory expectations are met during development.
  •  Identify hidden problems and patterns, use telemetry, error analysis, prompt and context analytics, and drift detection to improve model selection, prompt strategies, retrieval quality, chunking/embedding strategies, and system architecture.Drive LLM Ops best practices, integrate models, prompts, and evaluation into CI/CD, enforce approvals, segregation of duties, and reproducibility, automate regression and guardrail tests and manage lifecycle across environments.
  • Ensure that model strengths, limitations, and risk profiles are understood, documented, and appropriately applied across different classes of software work, and maintain deep understanding of the strengths, limitations, and risk characteristics of approved LLMs (e.g., Claude, ChatGPT, and successor models), including safety profiles, context limits, determinism strategies, and fine tuning vs. prompt only tradeoffs, design multi agent workflows that incorporate LLM driven analysis, code generation, testing, and review with explicit human approval gates and segregation of duties.
  • Ensure LLM driven systems meet enterprise reliability and resilience expectations, including disaster recovery, fallback behaviors, regional resiliency, and performance SLOs.
Required qualifications, capabilities, and skills
  • Formal training or certification on software engineering concepts and 5+ years applied experience 
  • Strong coding skills in Java/Python and SQL, applied to building LLM enabled micro services, retrieval pipelines, evaluators, and data tooling; solid understanding of data structures, algorithms, and object oriented programming as applied to LLM latency, caching, and throughput.
  • Hands on experience with AWS and cloud data management (e.g., Redshift, Dynamo DB, Aurora, Data bricks), plus experience integrating managed model endpoints and embedding/vector services; familiarity with secure secret management, networking, and least privilege access.
  • Proficiency in automation, CI/CD, and agile methodologies with LLM Ops extensions: prompt and config versioning, automated evaluations, canary releases, and rollback strategies.
  • Experience in system design, application development, and operational stability for LLM architectures, including retrieval layers, vector stores, caching, observability, rate limiting, and backpressure strategies.
  • Strong analytical, problem solving, and communication skills, including the ability to explain model behaviors, tradeoffs, and control decisions to both technical and non technical stakeholders.
  • Provide L3 and BAU support for Markets by leveraging LLMs for incident triage, run book retrieval, and pre approved auto remediation, with on call coverage for LLM services and dependencies.
  • Expert-level knowledge of how large language models work and hands-on experience training and fine-tuning approved models (e.g., Claude, Chat GPT and successors), with a proven track record integrating LLMs as controlled, reliable components of the software engineering lifecycle in regulated environments, ensuring determinism, reproducibility, safety, and traceability
  •  Strong understanding of data modeling challenges in big data and LLM contexts, embeddings, chunking strategies, vector similarity nuances, retrieval quality measures, and document lineage.
  • Demonstrated experience leading effective use of approved AI-assisted software development tools (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security.
  • Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching engineers on safe, compliant adoption within delivery practices


Preferred qualifications, capabilities, and skills
  •  Define model usage guidelines outlining which models are appropriate for requirements analysis, code generation and refactoring, test generation, documentation and explanation, and lead the use of LLMs for structured requirements analysis, translating business and regulatory requirements into clear technical specifications and control implementations.
  • Establish best practices for prompt driven design and development, treating prompts and system instructions as versioned, reviewable engineering artifacts and ensuring change control and traceability, ensure prompt strategies support determinism, reproducibility, and traceability in regulated environments (e.g., seeded examples, constrained decoding, output schemas, and canonical evaluation sets), and oversee prompt libraries and reusable patterns aligned with enterprise coding and architectural standards, including shared retrieval components and guardrail policies.
  • Ability to continuously learn the new developments happening in Agentic AI and LLM driven software coding. An engineer who is self-motivated, take full ownership of every task given, and act without waiting to be asked. Accountability is key for this role: one'll be expected to spot problems early, see each one through to the fix. 

Skills Required

  • Formal training or certification in software engineering concepts
  • 5+ years of applied software engineering experience
  • Strong coding skills in Java, Python, and SQL
  • Experience building LLM-enabled microservices, retrieval pipelines, evaluators, and data tooling
  • Hands-on AWS and cloud data management experience, including services such as Redshift, DynamoDB, Aurora, or Databricks
  • Experience integrating managed model endpoints and embedding or vector services
  • Familiarity with secure secret management, networking, and least-privilege access
  • Proficiency in automation, CI/CD, and agile methodologies
  • Experience with LLMOps, prompt and configuration versioning, automated evaluations, canary releases, and rollback strategies
  • Experience designing and operating LLM architectures with retrieval layers, vector stores, caching, observability, rate limiting, and backpressure
  • Strong analytical, problem-solving, and communication skills
  • Experience providing L3 and BAU support for Markets and LLM services, including on-call coverage
  • Expert-level knowledge of large language models and hands-on experience training and fine-tuning approved models
  • Experience integrating LLMs into controlled, reliable software engineering lifecycles in regulated environments
  • Understanding of embeddings, chunking strategies, vector similarity, retrieval quality, data modeling, and document lineage
  • Experience leading adoption of approved AI-assisted software development tools
  • Understanding of responsible AI, data sensitivity, secure input/output handling, resiliency, and security expectations
  • Experience coaching engineers on safe and compliant AI adoption
  • Ability to define model usage guidelines and use LLMs for requirements analysis and technical specifications
  • Experience treating prompts and system instructions as versioned, reviewable engineering artifacts
  • Knowledge of prompt strategies for determinism, reproducibility, traceability, constrained decoding, output schemas, and evaluation sets
  • Ability to establish prompt libraries and reusable retrieval and guardrail patterns
  • Continuous learning in Agentic AI and LLM-driven software development

JPMorganChase Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about JPMorganChase and has not been reviewed or approved by JPMorganChase.

  • Healthcare Strength — Medical coverage and wellness resources, including mental-health support and wellness incentives, are described as comprehensive and accessible; feedback suggests income-based contributions help keep care affordable.
  • Retirement Support — A dollar-for-dollar 401(k) match up to 5% of eligible pay, plus additional employer contributions in some cases, is highlighted as a strong pillar of financial security. Feedback suggests this structure is a notable advantage of the total rewards package.
  • Parental & Family Support — Up to 16 weeks of paid parental leave for all parents, along with fertility, adoption, surrogacy, childcare, and family-support resources, signals a family-forward approach. Feedback suggests these programs are a standout feature of the package.

JPMorganChase Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
289,097 Employees
Year Founded: 1799

What We Do

JPMorgan Chase & Co. (NYSE: JPM) is a leading global financial services firm with assets of $3.7 trillion and operations worldwide. The firm is a leader in investment banking, financial services for consumers and small businesses, commercial banking, financial transaction processing, and asset management. A component of the Dow Jones Industrial Average, JPMorgan Chase & Co. serves millions of consumers in the United States and many of the world’s most prominent corporate, institutional and government clients under its J.P. Morgan and Chase brands. Technology fuels every aspect of our company and is at the heart of everything we do. With over 50,000 technologists globally and an annual tech spend of $12 billion, we are dedicated to improving the design, analytics, development, coding, testing and application programming that goes into creating high quality software and new products. Learn more about technology at our firm, explore resources from our Distinguished Engineers, AI & ML researchers, and other experts; access the latest episode of our TechTrends podcast, and more at www.jpmorgan.com/technology. Information about JPMorgan Chase & Co. is available at www.jpmorganchase.com. ©2023 JPMorgan Chase & Co. All rights reserved. JPMorgan Chase is an Equal Opportunity Employer, including Disability/Veterans.

Why Work With Us

Our technologists work on a diverse range of solutions that include strategic technology initiatives, big data, mobile, electronic payments, machine learning, cybersecurity, enterprise cloud development, and other state-of-the-art technologies.

Gallery

Gallery

Similar Jobs

The Aerospace Corporation Logo The Aerospace Corporation

Advanced Embedded Engr

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Remote or Hybrid
2 Locations
4600 Employees

The Aerospace Corporation Logo The Aerospace Corporation

Advanced Software Engr

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Remote or Hybrid
2 Locations
4600 Employees

The Aerospace Corporation Logo The Aerospace Corporation

Sr Advanced AI Engr

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Hybrid
2 Locations
4600 Employees

The Aerospace Corporation Logo The Aerospace Corporation

Embedded Engr I

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Remote or Hybrid
2 Locations
4600 Employees

Similar Companies Hiring

Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
85 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account