Machine Learning Platform Engineer

Posted 5 Hours Ago
Be an Early Applicant
Hiring Remotely in China
Remote
Mid level
Artificial Intelligence • Fintech • Software • Financial Services
The Role
Build and operate ML infrastructure for training, evaluation, deployment, inference, observability, and continuous improvement. Design scalable, low-latency model serving and inference systems, reproducible data and training pipelines, benchmarking and monitoring, and platform tooling to enable fast experimentation and reliable production AI workloads.
Summary Generated by Built In

About A1

There are over 5 billion users using basic applications today such email, notes, tasks that are not AI-native. Our mission is to build a proactive smart assistant for everyday users to bring intelligence to conversations, errands, organising and workflows, with minimal prompting.

Our product focuses on achieving high reliability for long-running workflows, persistent context, and real-world task completion. The system must handle multi-step reasoning, interact with external tools, and remain reliable despite non-deterministic model behavior. Our objective is to help users complete tasks daily enjoyable with over ~90%* reduced time.

About the Role

As an ML Platform Engineer, you will build the infrastructure and systems that power A1's AI capabilities.

You will design and operate the systems behind the AI stack, from model training and evaluation to deployment, inference, observability, and continuous improvement.

You will work closely with AI engineers, researchers, and product engineers to turn models into reliable, scalable, and cost-efficient production systems. You will build the platforms, tooling, and infrastructure that enable the team to experiment quickly and bring AI capabilities to production with confidence.

Focus

  • Build and operate the ML infrastructure and platforms powering A1’s AI products

  • Design systems for model training, evaluation, deployment, inference, and experimentation

  • Build and optimise model serving and inference infrastructure for high-throughput and low-latency workloads

  • Improve reliability, scalability, latency, and cost efficiency of AI systems

  • Develop reliable pipelines for data preparation, training, evaluation, model release, and continuous improvement

  • Build platforms and tooling that enable AI engineers and researchers to experiment, evaluate, and ship models faster

  • Develop evaluation and benchmarking infrastructure to measure model quality, performance, and regressions

  • Build production observability, monitoring, tracing, and alerting for AI/ML workloads

  • Improve AI systems across reliability, scalability, latency, throughput, and cost

  • Identify bottlenecks across the ML stack and continuously improve system performance

  • Work closely with AI engineers, researchers, and product teams to turn evolving model requirements into production-ready infrastructure

Tech Stack

  • Python

  • PyTorch / JAX

  • LLM and ML serving infrastructure such as vLLM, SGLang, or TensorRT-LLM

  • Cloud infrastructure

  • Distributed systems

  • ML/data pipelines and workflow orchestration

  • GPU infrastructure and performance tooling

  • Vector databases and retrieval infrastructure

Ideal Experience

  • Strong software engineering fundamentals and experience building production systems

  • Experience building ML infrastructure, platforms, or production machine learning systems

  • Experience with model deployment, inference, evaluation, or data pipelines

  • Strong understanding of distributed systems and system reliability

  • Ability to write clean, maintainable, production-quality code

  • Comfortable working in ambiguous, fast-moving environments

  • Bias toward ownership, experimentation, and continuous improvement

Outcomes

  • AI infrastructure reliably supports production workloads at scale

  • Models can be trained, evaluated, deployed, and improved efficiently

  • Inference systems deliver strong latency, throughput, reliability, and cost efficiency

  • ML pipelines are reproducible, observable, maintainable, and robust

  • Model and infrastructure regressions are detected quickly and diagnosed efficiently

  • Common ML infrastructure capabilities become reusable platform primitives rather than being rebuilt for every AI product

  • The AI stack can evolve rapidly as new models, architectures, and inference techniques emerge

Skills Required

  • Strong software engineering fundamentals and experience building production systems
  • Experience building ML infrastructure, platforms, or production machine learning systems
  • Experience with model deployment, inference, evaluation, or data pipelines
  • Strong understanding of distributed systems and system reliability
  • Ability to write clean, maintainable, production-quality code
  • Experience with Python
  • Experience with PyTorch or JAX
  • Familiarity with LLM and ML serving infrastructure (vLLM, SGLang, or TensorRT-LLM)
  • Experience with cloud infrastructure and GPU infrastructure/performance tooling
  • Experience with vector databases and retrieval infrastructure
  • Experience building ML/data pipelines and workflow orchestration
  • Comfortable working in ambiguous, fast-moving environments with ownership and experimentation mindset
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Petaling Jaya
253 Employees
Year Founded: 2019

What We Do

Our mission is to develop technology based solutions to improve financial inclusion. We develop new & innovative platforms & services globally. For example, we are the first platform to simplify and digitise comprehensive life and medical insurance, supported by AI agent. BJAK is the largest insurance platform in Southeast Asia. If you enjoy building cutting edge platform-ecosystems that gives equal access to financial services to everyone at scale, join us

Similar Jobs

Citadel Securities Logo Citadel Securities

Cplusplus Software Engineer

Information Technology • Software • Financial Services • Quantitative Trading
In-Office or Remote
8 Locations
1900 Employees

Halter Logo Halter

Lead Supplier Quality Engineer

Greentech • Hardware • Internet of Things • Machine Learning • Software • Business Intelligence • Agriculture
Remote
Guangdong, Chongqing, CHN
350 Employees

UL Solutions Logo UL Solutions

Support Services Specialist I A&I

Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
Remote or Hybrid
China
15000 Employees

Magna International Logo Magna International

Customer Service 1

Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
Remote or Hybrid
Hongxing, Beijing, CHN
171000 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account