Backend Engineer, AI Systems

Posted 4 Hours Ago
Hiring Remotely in United States
Remote
Entry level
Artificial Intelligence • Fintech • Software • Financial Services
The Role
Build and operate the inference and orchestration backend powering AI interactions across mobile and desktop applications. Responsibilities include designing production AI services, optimizing latency and throughput, managing caching, batching and streaming, and maintaining monitoring, logging, alerting, and incident response systems. The role requires reliable APIs, distributed-systems debugging, and scalable integration with LLMs, embeddings, and multimodal models.
Summary Generated by Built In
About ActAI

There are over 5 billion users using basic applications today such email, notes, tasks, calendar and they're not AI-native. Our mission is to build proactive applications for anyone in the world, who are not used to complex prompting. We aim to bring intelligence to conversations, errands, organising and workflows, with minimal to no prompting.

Our first application is an agent-first mobile communication app. We believe building applications that users use daily for communication, coordination and collaboration needs will help integrate AI into their lives. The net effect is to eliminate misinformation, achieve low coordination costs, enable high quality tasks and collaboration at scale with minimal or little prompting.

 
Role

As a Backend Engineer, AI, you own the inference and orchestration layer that powers every AI interaction in the product. Your work sits between models and users, where latency, correctness, reliability, and cost directly impact real-world experience.

You will build and operate production systems that turn model capability into fast, stable, observable APIs used across mobile and desktop clients.

 
Focus
  • Build and operate backend systems that serve AI-powered features in production.

  • Design inference pipelines, orchestration layers, and service boundaries around models.

  • Own production concerns: monitoring, logging, alerting, and incident response.

  • Optimize latency and throughput across inference, caching, batching, and streaming.

 
Ideal Experiences
  • Strong backend engineering fundamentals in production environments.

  • Experience running high-throughput, low-latency services.

  • Familiarity with AI inference patterns (LLMs, embeddings, multimodal).

  • Comfortable debugging distributed systems under load.

  • Bias toward shipping and learning from production behavior.

 
Outcomes
  • Backend systems run reliably at scale, handling production AI traffic with low latency and high throughput.

  • APIs are stable, clear, and support seamless integration with frontend and ML systems.

  • Production incidents are quickly detected, diagnosed, and resolved, minimizing user impact.

  • Iterative improvements based on real usage continuously increase system performance and reliability.

 
Tech Stack
  • Python

  • NodeJs

  • Pytorch

  • OpenAI / Anthropic / open-source LLMs

  • SQl & noSQL

  • Kubernetes

  • Docker

 
How We Work

The best products today in the world were built by small, world class teams. We are a high talent density and hands-on team. We make decisions collectively, move at rapid speed, striking a balance between shipping high quality work and learning. Joining our team requires the ability to bring structure, exercise judgment, and execute independently. Our goal is to put in hands of our users a truly magical product

 
Interview process

If there appears to be a fit, we'll reach to schedule 3, but no more than 4 interviews.

Applications are evaluated by our technical team members. Interviews will be conducted via virtual meetings and/or onsite.

We value transparency and efficiency, so expect a prompt decision. If you've demonstrated the exceptional skills and mindset we're looking for, we'll extend an offer to join us. This isn't just a job offer; it's an invitation to be part of a team that's bringing AI to have practical benefits to billions globally.

Skills Required

  • Strong backend engineering fundamentals in production environments
  • Experience running high-throughput, low-latency services
  • Familiarity with AI inference patterns, including LLMs, embeddings, and multimodal models
  • Ability to debug distributed systems under load
  • Python experience
  • Node.js experience
  • PyTorch experience
  • Experience with SQL and NoSQL databases
  • Experience with Kubernetes and Docker
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Petaling Jaya
253 Employees
Year Founded: 2019

What We Do

Our mission is to develop technology based solutions to improve financial inclusion. We develop new & innovative platforms & services globally. For example, we are the first platform to simplify and digitise comprehensive life and medical insurance, supported by AI agent. BJAK is the largest insurance platform in Southeast Asia. If you enjoy building cutting edge platform-ecosystems that gives equal access to financial services to everyone at scale, join us

Similar Jobs

Square Logo Square

Account Executive

eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Remote or Hybrid
Indianapolis, IN, USA
12000 Employees
129K-233K Annually

Takeda Logo Takeda

MCR, OBU, ST, Jinzhou

Healthtech • Software • Analytics • Biotech • Pharmaceutical • Manufacturing
Remote or Hybrid
Cambridge, MA, USA
50000 Employees

Nexthink Logo Nexthink

VP Federal Sales

Artificial Intelligence • Big Data • Cloud • Information Technology • Machine Learning • Software
Remote or Hybrid
McLean, VA, USA
1200 Employees

Nexthink Logo Nexthink

VP Federal Sales

Artificial Intelligence • Big Data • Cloud • Information Technology • Machine Learning • Software
Remote or Hybrid
Washington, DC, USA
1200 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account