Backend Engineer, AI
Role
As a Backend Engineer, AI, you own the inference and orchestration layer that powers every AI interaction in the product. Your work sits between models and users, where latency, correctness, reliability, and cost directly impact real-world experience.
You will build and operate production systems that turn model capability into fast, stable, observable APIs used across mobile and desktop clients.
Focus
Build and operate backend systems that serve AI-powered features in production.
Design inference pipelines, orchestration layers, and service boundaries around models.
Own production concerns: monitoring, logging, alerting, and incident response.
Optimize latency and throughput across inference, caching, batching, and streaming.
Ideal Experiences
Strong backend engineering fundamentals in production environments.
Experience running high-throughput, low-latency services.
Familiarity with AI inference patterns (LLMs, embeddings, multimodal).
Comfortable debugging distributed systems under load.
Bias toward shipping and learning from production behavior.
Outcomes
Backend systems run reliably at scale, handling production AI traffic with low latency and high throughput.
APIs are stable, clear, and support seamless integration with frontend and ML systems.
Production incidents are quickly detected, diagnosed, and resolved, minimizing user impact.
Iterative improvements based on real usage continuously increase system performance and reliability.
Tech Stack
Python
NodeJs
Pytorch
OpenAI / Anthropic / open-source LLMs
SQl & noSQL
Kubernetes
Docker
Skills Required
- Strong backend engineering fundamentals in production environments
- Experience running high-throughput, low-latency services
- Familiarity with AI inference patterns, including LLMs, embeddings, and multimodal systems
- Ability to debug distributed systems under load
- Python experience
- Node.js experience
- PyTorch experience
- Experience with OpenAI, Anthropic, or open-source LLMs
- SQL and NoSQL experience
- Kubernetes experience
- Docker experience
What We Do
Cygnify offers Talent Acquisition as a Service (TAaaS), providing a fully-managed team of experts, AI tools, and a candidate database on a flexible, month-to-month subscription model.
