Senior Software Engineer - Python APIs

The Role 

As a Senior Software Engineer on the Enterprise AI/ML Platform team, you will design, build, and operate production-grade software systems that enable machine learning at scale across the organization. You will focus on developing robust web services, libraries, and automation that support model training, evaluation, deployment, and lifecycle management in highly regulated, high-availability environments. This role is ideal for engineers who enjoy working on distributed systems, developer platforms, and infrastructure-heavy codebases, and who have applied software engineering best practices to systems that support AI/ML workloads.

The Expertise and Skills You Bring

• Bachelor’s or Master’s degree in a technology-focused discipline such as Computer Science, Software Engineering, or a closely related field.
• Strong software engineering experience in Python, with a proven ability to design, implement, test, and maintain production-quality libraries, services, and internal platforms. Comfortable applying object-oriented and functional programming principles in Linux-based environments; scripting and automation experience required.
• Possess 5 years of professional experience developing Python-based cloud applications or internal platforms, with demonstrated ownership of non-trivial systems in production.
• Familiarity with Java or Groovy is a plus.
• Familiarity with LiteLLM or GenAI Gateways is a plus.
• Experience building and operating cloud-native systems on AWS, including services such as S3, Lambda, Batch, Step Functions, EventBridge, CloudWatch, and SNS/SQS. Experience supporting managed ML services (e.g., SageMaker or equivalent) as part of a broader platform. Exposure to Azure or GCP is beneficial but not required.
• Strong DevOps and CI/CD experience, including automated build, test, and deployment pipelines using tools such as Jenkins and Git-based workflows. Hands-on experience with containerization (Docker) and deploying containerized workloads in scalable environments.
• Infrastructure-as-Code expertise is a plus, using tools such as AWS CloudFormation and Terraform/OpenTofu to provision, manage, and evolve cloud infrastructure in a repeatable and auditable manner.
• Hands-on experience supporting ML-enabled systems in production, including model packaging, deployment, inference workflows, monitoring, and operational measurement. Emphasis on system reliability, observability, and maintainability, rather than model experimentation or research.
• Familiarity with applied machine learning concepts and data workflows, including feature pipelines and working with structured, semi-structured, and unstructured data, sufficient to design and support scalable ML platforms and integrations.
• Strong understanding of scalable and distributed system design, with experience building or operating systems that handle high-throughput workloads, asynchronous processing, and fault tolerance using open-source technologies.
• Proven experience supporting business-critical applications, including troubleshooting production issues, performing root cause analysis, and driving improvements to system stability and performance.
• Excellent communication and collaboration skills, with the ability to clearly document systems, communicate technical tradeoffs, and work effectively across engineering, data, and business teams.
• Ability to operate effectively in ambiguous, fast-paced environments, adapting to evolving business priorities and technology changes within a broader AI and data ecosystem.
•  Partner with Data Scientists to package, scale, and operationalize models, providing the platforms and tooling required to move from experimentation to reliable production use.
• Collaborate with application and platform engineers to integrate ML capabilities with enterprise gateways and services, enabling secure and scalable access to both traditional and generative models.
• Operationalize ML-enabled systems at enterprise scale, designing and supporting services capable of serving predictions to tens of millions of customers with high reliability and performance.
• Build platform tooling for model and data observability, including detection of data and feature drift, monitoring prediction quality and uncertainty, and automating diagnostics and explainability workflows.
• Continuously evaluate and adopt emerging technologies, applying sound engineering judgment to simplify the data and ML ecosystem while improving developer experience and operational stability.
• Drive innovation through pragmatic, forward-looking solutions, balancing future capabilities with production readiness and long-term maintainability.
• Improve team agility and productivity by introducing reusable frameworks, automation, and clear abstractions that reduce friction for downstream consumers.
• Resolve technical roadblocks and mitigate platform risks, proactively addressing scalability, reliability, and integration challenges.
• Increase delivery velocity and system reliability through automation, including the design and maintenance of robust CI/CD pipelines and operational workflows.

The Team

The Enterprise Data Science Platform, part of the Fidelity Data Architecture team within the Enterprise Technology business unit, is responsible for delivering scalable AI/ML capabilities across the organization. The team designs and builds advanced cloud-based, open-source, software platforms in close collaboration with Data Scientists, enabling the efficient packaging, deployment, and operation of AI/ML models at production scale.

In addition, the platform develops and maintains enterprise-grade gateways that allow teams across the company to securely discover, access, and consume AI/ML models. These gateways provide critical visibility into model usage and costs, while generating insights into model effectiveness, adoption patterns, and opportunities for continuous improvement.

Placement in the range will vary based on job responsibilities and scope, geographic location, candidate’s relevant experience, and other factors.

Base salary is only part of the total compensation package. Depending on the position and eligibility requirements, the offer package may also include bonus or other variable compensation.   

We offer a wide range of benefits to meet your evolving needs and help you live your best life at work and at home.  These benefits include comprehensive health care coverage and emotional well-being support, market-leading retirement, generous paid time off and parental leave, charitable giving employee match program, and educational assistance including student loan repayment, tuition reimbursement, and learning resources to develop your career.  Note, the application window closes when the position is filled or unposted.

Please be advised that Fidelity’s business is governed by the provisions of the Securities Exchange Act of 1934, the Investment Advisers Act of 1940, the Investment Company Act of 1940, ERISA, numerous state laws governing securities, investment and retirement-related financial activities and the rules and regulations of numerous self-regulatory organizations, including FINRA, among others. Those laws and regulations may restrict Fidelity from hiring and/or associating with individuals with certain Criminal Histories.