Software Engineer III - AIML Technology

Job Description
As a Software Engineer, in this role you will be able to achieve state-of-the-art throughput for critical models using advanced techniques such as model parallelism and distributed training. You will be working to reduce inference time for new model architectures using optimizations such as quantization and pruning. You will collaborate closely with Applied AI engineering to optimize the internal inference stack. Collaborate with top-tier AI systems engineers, fostering a culture of continuous learning and innovation, while coordinating the inference needs of JPMC's research teams, ensuring alignment with business goals.
As a Software Engineer III at JPMorgan Chase within the Corporate Sector AI/ML Technologies Team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a Software Engineer in this role, you will get to drive significant business impact using your technical capabilities and contributions and apply deep technical prowess and problem-solving skills to tackle a diverse array of challenges that span multiple technologies and applications in the AI/ML space.
Job responsibilities

• Implements distributed ML infrastructure, including inference, training, scheduling, orchestration, and storage.
• Develops advanced monitoring and management tools for high reliability and scalability.
• Optimizes system performance by identifying and resolving inefficiencies and bottlenecks.
• Collaborates with product teams to deliver tailored, technology-driven solutions.
• Helps with the adoption and execution of ML Platform tools across various teams.
• Integrates Generative AI within the ML Platform using state-of-the-art techniques.
• Develops secure and high-quality production code, and reviews and debugs code written by others.
• Drives decisions that influence the product design, application functionality, and technical operations and processes.
• Serves as a function-wide subject matter expert in one or more areas of focus.
• Actively contributes to the engineering community as an advocate of firm wide frameworks, tools, and practices SDLC.
• Analyzes, writes, develops, tests, and releases the products using Python on AWS

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 3+ years applied experience.
• Hands-on experience with ML frameworks (TensorFlow, PyTorch, JAX, RAY).
• Experience in AWS / GCP and Kubernetes ecosystem, including EKS, Helm, and custom operators.
• Strong coding skills and experience in developing large-scale ML systems.
• Background in High Performance Computing, ML Hardware Acceleration (e.g., GPU, TPU, RDMA), or ML for Systems. Proven track record in contributing to and optimizing open-source ML frameworks.
• Advanced in one or more programming language(s) - Python or Java, Intermediate Python is a must.
• Proven ability to identify trade-offs, clarify project ambiguities, and drive decision-making.

Preferred qualifications, capabilities, and skills

• Undergraduate degree in Computer Science or Data Science
• Experience in building Generative AI based system
• Experience in continuous integration and continuous deployment platform

About Us
JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world's most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.
We offer a competitive total rewards package including base salary determined based on the role, experience, skill set, and location. For those in eligible roles, we offer discretionary incentive compensation which may be awarded in recognition of firm performance and individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.
JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans
About the Team
Our professionals in our Corporate Functions cover a diverse range of areas from finance and risk to human resources and marketing. Our corporate teams are an essential part of our company, ensuring that we're setting our businesses, clients, customers and employees up for success.