We have an opportunity to impact your career and provide an adventure where you can push the limits of what’s possible.
As a Software Engineer III at JPMorganChase within Corporate AIML Data Platforms-Chief Data and Analytics Office, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for contributing to critical technology solutions across multiple technical areas within various business functions in support of the firm’s business objectives—with a focus on Go/Python based backend services, to support LLM-enabled experiences.
Job responsibilities
- Execute creative software solutions, design, development, and technical troubleshooting for LLM-enabled applications and platforms.
- Design, build, and maintain backend services in Go, delivering secure, high-quality production code with strong testing discipline.
- Build gRPC services defined with Protobuf, including API design, schema evolution, and compatibility/versioning practices.
- Implement bidirectional streaming gRPC endpoints for LLM workloads (e.g., interactive sessions, token/partial-response streaming, incremental results, cancellations, backpressure/flow control).
- Integrate LLM services with supporting systems (authn/z, rate limits/quotas, caching, queues/streams, persistence) and partner with platform/SRE teams as needed.
- Review and debug SDK and service integrations; participate in code reviews and contribute to shared engineering standards.
- Instrument services with strong observability (metrics/logging/tracing), and contribute to runbooks and operational readiness (alerts, dashboards, on-call support as applicable).
- Identify recurring issues and contribute fixes and automation to improve reliability, latency, and operational stability.
- Leverages enterprise-authorized AI coding assist tools within the work environment to improve code quality, delivery speed, and productivity across complex deliverables (e.g., code generation/refactoring, unit test creation, documentation), while validating outputs through peer review, automated testing, and secure coding standards; contributes learnings and reusable patterns to improve broader team effectiveness.
- Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.
Required qualifications, capabilities, and skills
- Formal training or certification on software engineering concepts and 3+ years applied experience
- Proficiency in Go for backend/service development, including concurrency patterns (goroutines/channels), context usage, and performance troubleshooting.
- Working knowledge of Python for supporting services, internal tooling, automation, evaluation harnesses, or data/ETL tasks.
- Hands-on experience with gRPC and Protobuf in production, including API design and backward/forward compatibility considerations.
- Experience building and operating microservices/APIs with a production mindset (monitoring, debugging, incident support, and continuous improvement).
- Proficiency in automation and continuous delivery methods; strong unit/integration testing discipline.
- Proficient in secure coding practices and core SDLC activities (design, build, test, deploy, operate).
- Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting, or documentation) with demonstrated ability to critically evaluate, validate, and refine AI-generated outputs for correctness, performance, and security.
- Understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; ability to guide peers on safe and effective usage within team practices.
Preferred qualifications, capabilities, and skills
- Experience building LLM streaming experiences end-to-end (token/partial-response streaming, tool/function calling orchestration, session state management, safety/guardrail hooks).
- Familiarity with OpenTelemetry and tracing/metrics patterns for streaming RPCs (correlation IDs, span links, per-message metrics).
- Experience with Kubernetes/Docker and operating services in containerized environments.
- Messaging/streaming systems (Kafka/RabbitMQ/SQS), caching (Redis), and patterns for async orchestration alongside streaming.
- Security best practices for RPC systems: mTLS, authn/z, secrets management, secure-by-default API design, abuse prevention (rate limiting, payload limits).
- Understanding of cost management and spend alerting for AI/LLM workloads.
About Us
We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.
JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans
Skills Required
- Formal training or certification in software engineering concepts and 3+ years of applied experience
- Proficiency in Go for backend and service development, including concurrency patterns, context usage, and performance troubleshooting
- Working knowledge of Python for supporting services, tooling, automation, evaluation harnesses, or data/ETL tasks
- Production experience with gRPC and Protobuf, including API design and compatibility considerations
- Experience building and operating production microservices and APIs, including monitoring, debugging, incident support, and continuous improvement
- Proficiency in automation, continuous delivery, and unit/integration testing
- Proficiency in secure coding practices and core software development lifecycle activities
- Hands-on experience using enterprise-authorized AI-assisted software development tools and validating their outputs
- Understanding of responsible AI use in engineering workflows, data sensitivity, secure input/output handling, resiliency, and security expectations
- Experience building end-to-end LLM streaming experiences, including token streaming, tool calling, session state, and safety hooks
- Familiarity with OpenTelemetry and tracing and metrics patterns for streaming RPCs
- Experience with Kubernetes, Docker, and containerized service operations
- Experience with messaging or streaming systems such as Kafka, RabbitMQ, or SQS
- Experience with caching systems such as Redis
- Knowledge of RPC security practices including mTLS, authentication, authorization, secrets management, rate limiting, and payload limits
- Understanding of cost management and spend alerting for AI and LLM workloads
JPMorganChase Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about JPMorganChase and has not been reviewed or approved by JPMorganChase.
-
Healthcare Strength — Health coverage is considered comprehensive, including medical, dental, and vision, alongside wellness and mental health resources. Some locations add onsite health centers and related wellbeing support.
-
Retirement Support — Retirement offerings include a 401(k)-type savings plan and related financial benefits, with options such as employee stock purchase participation. Financial planning resources are also highlighted to support long-term savings.
-
Parental & Family Support — Paid parental leave of 16 weeks for birth or adoption is available for all parents. Child care and back-up child care resources further reinforce family support.
JPMorganChase Insights
What We Do
JPMorgan Chase & Co. (NYSE: JPM) is a leading global financial services firm with assets of $3.7 trillion and operations worldwide. The firm is a leader in investment banking, financial services for consumers and small businesses, commercial banking, financial transaction processing, and asset management. A component of the Dow Jones Industrial Average, JPMorgan Chase & Co. serves millions of consumers in the United States and many of the world’s most prominent corporate, institutional and government clients under its J.P. Morgan and Chase brands. Technology fuels every aspect of our company and is at the heart of everything we do. With over 50,000 technologists globally and an annual tech spend of $12 billion, we are dedicated to improving the design, analytics, development, coding, testing and application programming that goes into creating high quality software and new products. Learn more about technology at our firm, explore resources from our Distinguished Engineers, AI & ML researchers, and other experts; access the latest episode of our TechTrends podcast, and more at www.jpmorgan.com/technology. Information about JPMorgan Chase & Co. is available at www.jpmorganchase.com. ©2023 JPMorgan Chase & Co. All rights reserved. JPMorgan Chase is an Equal Opportunity Employer, including Disability/Veterans.
Why Work With Us
Our technologists work on a diverse range of solutions that include strategic technology initiatives, big data, mobile, electronic payments, machine learning, cybersecurity, enterprise cloud development, and other state-of-the-art technologies.
Gallery
.png)
