Staff MaaS Backend Engineer

Posted 5 Days Ago
Be an Early Applicant
San Jose, CA, USA
In-Office
180K-260K Annually
Senior level
Software
The Role
Re-architect and operate a globally distributed, multi-tenant Model-as-a-Service platform. Own Go backend services, API compatibility, inference routing, Kubernetes-based model serving, performance optimization, multi-region reliability, tenant isolation, observability, metering, and invoice-grade billing. Lead migrations, define SLOs, support on-call operations, mentor engineers, and ensure scalable, secure, reversible delivery for a revenue-bearing platform.
Summary Generated by Built In

Bitdeer is a world-leading technology company for AI and Bitcoin mining infrastructure.

Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers and building AI computational infrastructure to support the AI revolution. Bitdeer handles complex processes involved in computing such as equipment procurement, transport logistics, data center design and construction, equipment management, and daily operations. Bitdeer also offers advanced cloud capabilities to customers with high demand for artificial intelligence.

Headquartered in Singapore, Bitdeer has deployed data centers across multiple countries, including the United States, Norway, Bhutan, and Ethiopia.

To learn more, visit https://ir.bitdeer.com/

Position Overview

We are seeking a Staff Backend Engineer to take our Model-as-a-Service (MaaS) working system and re-architect it into a commercial, globally distributed, multi-tenant token service — one that sustains at least millions of monthly active users, high sustained token throughput per GPU, and invoice-grade accounting, with scalability, reliability, and observability engineered in deliberately rather than absorbed under load. This role works directly with the principal architect: co-owning the MaaS system design as the deepest backend voice in that conversation, and owning the implementation end to end — the code that ships, the migrations that land, and the service that stays up. Design authority is shared; delivery accountability is not. The mandate is explicit: measure what exists, find where it breaks before it breaks in front of a paying customer, and carry the platform there incrementally — with each step independently shippable, reversible, and non-disruptive to the tenants already on it. The role is deeply hands-on: it reads and rewrites the existing Go services, owns SLOs and on-call for a revenue-bearing service, and sets the backend engineering standard for the MaaS team.

Key Responsibilities

  • Architecture, Strategy, and Leadership: Co-own the end-to-end MaaS system design with the Principal Architect, authoring decision records and defending technical trade-offs. Drive the platform through its maturity roadmap by delivering operable, measurable capabilities rather than mere demos. Lead technical execution by setting stringent Go and API standards, mentoring engineers, and aligning cross-functional teams.
  • Inference Gateway and API Surface: Own the wire compatibility contract for major formats (OpenAI, Anthropic), supporting advanced features like streaming, tool calling, and structured output. Evolve the routing tier to handle load-aware, model-aware, and prefix-cache-aware endpoint selection with robust circuit breaking and fallback mechanisms. Run versioning and deprecation as a published contract to guarantee external customer code stability across underlying changes.
  • Performance Optimization and Model Lifecycle: Maximize platform economics and performance by optimizing token throughput, KV cache tiering, and time-to-first-token (TTFT) latency at the p95/p99 levels. Mature the model serving control plane by integrating deployment tooling, LoRA multiplexing, and cold-start-aware autoscaling directly with the Kubernetes fleet. Treat regressions in cost-per-million-tokens or latency metrics as critical system incidents.
  • Global Topology and Reliability (SLOs): Scale the platform to a globally distributed architecture featuring regional inference pools, capacity-aware failovers, and an active-active control plane. Define, publish, and rigorously defend strict Service Level Objectives (SLOs) baselined against actual system performance rather than aspirations. Ensure operational resilience through peak-concurrency load testing, robust on-call runbooks, and predictable load-shedding during overloads.
  • Security, Identity, and Multi-Tenant Isolation: Enforce fail-closed authorization, robust multi-tenant isolation, and zero-retention data paths across the network, cache, and storage layers. Manage the complete lifecycle of API keys and OAuth credentials while distributedly enforcing rate limits and quotas without relying on client-supplied identifiers. Design strict abuse, rate, and prompt-injection controls, treating all user and model-generated content as untrusted data.
  • Token Metering and Billing Cor
  • rectness: Build an idempotent, exactly-once metering system to capture uncached, cached, output, and reasoning tokens accurately across all requests. Maintain a high-volume usage ledger that enforces prepaid spend caps asynchronously and reconciles perfectly with the invoicing system. Safeguard business integrity by treating any metering or billing defect as a critical revenue and trust incident.
  • Safe Migrations and Observability: Execute zero-regression, incremental platform upgrades using strangler-style replacements, shadow traffic, and stateful dual-writes. Deliver end-to-end request tracing and cost telemetry, defining internal schemas for token and quality attributes. Enforce absolute log hygiene by ensuring prompts, completions, and PII are never retained outside of explicit, consented policies.

Qualifications

  • Bring 8+ years of backend engineering experience, including 3+ years owning a high-traffic, multi-tenant API platform for paying customers. Act as a senior technical voice who can collaborate closely with architects, write rigorous design documents, and commit to executing architectural decisions effectively.
  • Demonstrate expertise in scaling distributed systems through multi-region active-active deployments, caching, backpressure, and targeted performance engineering that measurably lowers unit costs. You must have a proven track record of safely executing zero-downtime brownfield migrations for stateful subsystems—like metering or ledgers—without regressions or accounting gaps.
  • Possess deep hands-on proficiency with Go-based services, production Kubernetes (including Envoy and GPU-aware scheduling), and the architectural trade-offs of datastores like PostgreSQL, Redis, and Kafka. Additionally, you will drive operational visibility by owning end-to-end observability strategies using OpenTelemetry and high-cardinality analytics stores.
  • Apply a systems-level understanding of LLM serving to manage complexities like server-sent-event streaming, KV/prefix caching, and the trade-offs between time-to-first-token (TTFT) and throughput. Leverage this foundation to build highly reliable, exactly-once metering and billing systems that accurately reconcile billions of events under partial failure conditions.
  • Enforce strict multi-tenant security disciplines by designing fail-closed authorization, mandating verified identities, and guaranteeing absolute cross-tenant isolation. Bring operational maturity to a revenue-bearing platform by carrying on-call responsibilities, running blameless incident reviews, and translating outages into structural improvements.

--------------------------------------------------------------------

Bitdeer is committed to providing equal employment opportunities in accordance with country, state, and local laws. Bitdeer does not discriminate against employees or applicants based on conditions such as race, color, gender identity and/or expression, sexual orientation, marital and/or parental status, religion, political opinion, nationality, ethnic background or social origin, social status, disability, age, indigenous status, and union.

Skills Required

  • 8+ years of backend engineering experience
  • 3+ years owning a high-traffic, multi-tenant API platform serving paying customers
  • Experience collaborating with architects, authoring rigorous design documents, and executing architectural decisions
  • Proven experience scaling distributed systems through multi-region active-active deployments, caching, backpressure, and performance engineering
  • Proven experience executing zero-downtime brownfield migrations for stateful systems such as metering or ledgers
  • Deep hands-on proficiency with Go-based services, production Kubernetes, Envoy, and GPU-aware scheduling
  • Experience with PostgreSQL, Redis, and Kafka
  • Experience owning end-to-end observability strategies using OpenTelemetry and high-cardinality analytics stores
  • Systems-level understanding of LLM serving, server-sent-event streaming, KV or prefix caching, time-to-first-token, and throughput trade-offs
  • Experience building exactly-once metering and billing systems that reconcile high-volume events under partial failure conditions
  • Experience designing fail-closed authorization, verified identities, strict multi-tenant isolation, and secure data handling
  • Operational experience with on-call responsibilities, load testing, incident reviews, and reliability improvement
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Singapore
214 Employees

What We Do

Bitdeer Technologies Group (Nasdaq: BTDR) is a leader in the blockchain and high-performance computing industry. It is one of the world’s largest holders of proprietary hash rate and suppliers of hash rate. Bitdeer is committed to providing comprehensive computing solutions for its customers. The company was founded by Jihan Wu, an early advocate and pioneer in cryptocurrency who cofounded multiple leading companies serving the blockchain economy. Mr. Wu leads the company as Founder, Chairman, and CEO. Linghui Kong serves as Bitdeer’s CBO and provides leadership through deep industry knowledge and technology expertise. Headquartered in Singapore, Bitdeer has deployed mining datacenters in the United States, Norway, and Bhutan. It offers specialized mining infrastructure, high-quality hash rate sharing products, and reliable hosting services to global users. The company also offers advanced cloud capabilities for customers with high demands for artificial intelligence. Dedication, authenticity, and trustworthiness are foundational to our mission of becoming the world’s most reliable provider of full-spectrum blockchain and high-performance computing solutions. We welcome global talent to join us in shaping the future

Similar Jobs

Pfizer Logo Pfizer

Director, QSEO AI Transformation Lead

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
8 Locations
121990 Employees
177K-294K Annually

Pfizer Logo Pfizer

Senior Oncology Account Specialist Prostate Cancer Santa Monica, CA

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
In-Office or Remote
5 Locations
121990 Employees
109K-251K Annually

Pfizer Logo Pfizer

Vice President, Integrated Medicines Business - East

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
In-Office or Remote
2 Locations
121990 Employees
300K-500K Annually

DraftKings Logo DraftKings

Lifecycle Associate

Digital Media • Gaming • Information Technology • Software • Sports • Esports • Big Data Analytics
Remote or Hybrid
United States
6400 Employees
54K-68K Annually

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
Glendale, Kentucky
55 Employees
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account