Principal Machine Learning Engineer

Posted 5 Days Ago
Hiring Remotely in United States
Remote
Expert/Leader
Artificial Intelligence • Fintech • Software • Financial Services
The Role
The Principal Machine Learning Engineer will build and maintain end-to-end ML systems, fine-tune models, and manage production deployments, ensuring robustness and efficiency.
Summary Generated by Built In
About the Role

A1 is building a proactive AI system that understands context across conversations, plans actions, and carries work forward over time.

You will be responsible for turning research direction into working, production-grade ML systems. This role owns the execution layer of A1’s intelligence – training pipelines, inference systems, evaluation tooling, and deployment.


Focus
  • Build and own end-to-end ML pipelines spanning data, training, evaluation, inference, and deployment.

  • Fine-tune and adapt models using state-of-the-art methods such as LoRA, QLoRA, SFT, DPO, and distillation.

  • Architect and operate scalable inference systems, balancing latency, cost, and reliability.

  • Design and maintain data systems for high-quality synthetic and real-world training data.

  • Implement evaluation pipelines covering performance, robustness, safety, and bias, in partnership with research leadership.

  • Own production deployment, including GPU optimization, memory efficiency, latency reduction, and scaling policies.

  • Collaborate closely with application engineering to integrate ML systems cleanly into backend, mobile, and desktop products.

  • Make pragmatic trade-offs and ship improvements quickly, learning from real usage.

  • Work under real production constraints: latency, cost, reliability, and safety


Requirements
  • Strong background in deep learning and transformer-based architectures.

  • Hands-on experience training, fine-tuning, or deploying large-scale ML models in production.

  • Proficiency with at least one modern ML framework (e.g. PyTorch, JAX), and ability to learn others quickly.

  • Experience with distributed training and inference frameworks (e.g. DeepSpeed, FSDP, Megatron, ZeRO, Ray).

  • Strong software engineering fundamentals – you write robust, maintainable, production-grade systems.

  • Experience with GPU optimization, including memory efficiency, quantization, and mixed precision.

  • Comfort owning ambiguous, zero-to-one ML systems end-to-end.

  • A bias toward shipping, learning fast, and improving systems through iteration.


Ideal Experience
  • Experience with LLM inference frameworks such as vLLM, TensorRT-LLM, or FasterTransformer.

  • Contributions to open-source ML or systems libraries.

  • Background in scientific computing, compilers, or GPU kernels.

  • Experience with RLHF pipelines (PPO, DPO, ORPO).

  • Experience training or deploying multimodal or diffusion models.

  • Experience with large-scale data processing (Apache Arrow, Spark, Ray).


How We Work

Our organization is very flat and our team is small, highly motivated, and focused on engineering and product excellence. All members are expected to be hands-on and to contribute directly to the company’s mission.


Interview process

If there appears to be a fit, we'll reach to schedule 3, but no more than 4 interviews.

Applications are evaluated by our technical team members. Interviews will be conducted via virtual meetings and/or onsite.

We value transparency and efficiency, so expect a prompt decision. If you've demonstrated the exceptional skills and mindset we're looking for, we'll extend an offer to join us. This isn't just a job offer; it's an invitation to be part of a team that's bringing AI to have practical benefits to billions globally.

Top Skills

Apache Arrow
Deepspeed
Fsdp
Jax
Megatron
PyTorch
Ray
Spark
Zero
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Selangor, Selangor
253 Employees
Year Founded: 2019

What We Do

Our mission is to develop technology based solutions to improve financial inclusion.

We develop new & innovative platforms & services globally. For example, we are the first platform to simplify and digitise comprehensive life and medical insurance, supported by AI agent. BJAK is the largest insurance platform in Southeast Asia.

If you enjoy building cutting edge platform-ecosystems that gives equal access to financial services to everyone at scale, join us

Similar Jobs

Optum Logo Optum

Machine Learning Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office or Remote
5 Locations
160000 Employees
135K-231K Annually

Atlassian Logo Atlassian

Principal Machine Learning System Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
San Francisco, CA, USA
11000 Employees
194K-303K Annually

Atlassian Logo Atlassian

Machine Learning Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
San Francisco, CA, USA
11000 Employees
194K-303K Annually

ServiceNow Logo ServiceNow

Principal Software Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Santa Clara, CA, USA
28000 Employees
218K-381K Annually

Similar Companies Hiring

Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account