Machine Learning Engineer

As a Senior Machine Learning Engineer on the AI Engineering team, you will be a key technical leader responsible for designing and scaling the systems that bring our models from research into reliable, production-grade deployments.

You will work at the intersection of large-scale ML systems, low-latency inference, distributed infrastructure, and product integration. Your work will directly impact how intelligence is delivered to millions of users—ensuring performance, reliability, safety, and continuous improvement of our AI systems.

• Design and implement scalable, low-latency model-serving infrastructure for large language models and multimodal systems.
• Build and maintain robust APIs and services to support real-time conversational workloads.
• Optimize inference systems for throughput, latency, cost-efficiency, and reliability.
  

• Architect and improve end-to-end ML pipelines spanning training, evaluation, deployment, monitoring, and rollback.
• Develop model lifecycle management systems with strong observability and performance tracking.
• Partner with infrastructure teams to scale compute resources efficiently across distributed environments.
• Improve CI/CD workflows and automation for model releases and infrastructure updates.
  

• Collaborate with ML researchers to productionize new model architectures and capabilities.
• Design abstractions that enable rapid experimentation while preserving safety, quality, and reliability.
• Implement evaluation frameworks and guardrails to ensure models meet performance and safety standards before deployment.
  

• Define data requirements and feedback loops to enable continuous model improvement.
• Partner with product and safety teams to integrate telemetry, evaluation signals, and user feedback into training pipelines.
• Ensure high-quality data ingestion and metadata tracking for ML readiness.
  

• Lead architectural decisions that balance performance, scalability, safety, and maintainability.
• Contribute to code reviews and engineering best practices across the team.
• Mentor engineers and raise the bar for production ML excellence.
• Help shape long-term technical strategy for deploying AI systems at global scale.
  

• 1-4 years of experience in machine learning engineering, backend systems, or distributed infrastructure.
• Proven experience deploying and operating ML models in production environments.
• Strong programming skills in Python and/or C++ (or equivalent systems language).
• Experience with large-scale model serving (LLMs, transformers, or similar architectures).
• Deep understanding of distributed systems, API design, and cloud infrastructure.
• Experience with MLOps tools and workflows (CI/CD, model monitoring, experiment tracking).
  

• Experience scaling high-throughput, low-latency inference systems.
• Familiarity with GPU acceleration, model optimization (quantization, batching, caching), and performance tuning.
• Experience working with conversational AI systems or real-time user-facing AI products.
• Knowledge of ML evaluation methodologies, safety systems, and guardrail design.
• Background collaborating closely with research teams in fast-paced AI environments.
  

At Inflection AI, we aim to attract and retain the best employees and compensate them in a way that appropriately and fairly values their individual contributions to the company. For this role, Inflection AI estimates a starting annual base salary to fall within the range of $172,000.00 to $250,000.00, depending on a candidate’s qualifications and level of experience. This role also includes a meaningful equity component, allowing employees to share in the long-term success of the company.

Inflection AI values and supports our team’s mental and physical health. We are focused on building a positive, safe, inclusive and inspiring place to work. Our benefits include: 

• Diverse medical, dental and vision options 
• 401k matching program 
• Unlimited paid time off 
• Parental leave and flexibility for all parents and caregivers
• Support of country-specific visa needs for international employees living in the Bay Area