Founding Engineer - Platform

Posted Yesterday
Hiring Remotely in San Francisco, CA, USA
In-Office or Remote
250K-350K Annually
Senior level
Big Data • Blockchain • Internet of Things • Software
The Role
Design and own a cloud-native, low-latency platform for real-time, stateful AI inference and live video generation: manage GPU-heavy Kubernetes clusters, observability, autoscaling, security, and platform primitives while collaborating with ML teams and mentoring engineers.
Summary Generated by Built In
The problem we saw

AI inference today is slow, expensive, and stateless. Send a query, wait, get a response, reset. That's fine for batch — but AI is becoming interactive, and interactive means inference has to respond instantly, hold context across a session, and be steerable in real time.

Nobody had built an infrastructure that does all three at once. The bottleneck isn't the models. It's the runtime underneath them.

 
What we're building to fix it

uRun — Universal Runtime is the layer that makes real-time, stateful inference possible. Our platform lets AI respond instantly, hold context across a session, and be directed as it runs.

We prove it through the hardest problem in the stack: real-time AI video generation. Not pre-rendered clips. Not queued jobs. Live, steerable, continuous video that responds as you speak. Solve that, and the rest of the inference stack follows, and that's what we've done. We're an infrastructure company; we build the layer model labs, builders, and research teams ship on top of.

 
Where you come in

You'll design and own the scalable, low-latency infrastructure that powers uRun's real-time inference runtime, the platform that makes live, interactive, multi-user AI workloads possible.

This is not classic ops or cloud management. You'll be deep in the AI runtime itself, not just keeping VMs up. Latency, frame rate, and interactive quality of service are first-class platform properties, and they're yours to own. The workloads are GPU-constrained, memory-bound, and bursty, not stateless web backends, so you'll often write platform features, custom controllers, and scaling logic rather than only operating commercial tooling.

You'll report directly to our founder, Keegan McCallum, and set the technical direction the engineering organisation grows around.

 
What you'll actually be doing day-to-day
  • Design, operate, and evolve the cloud-native platform that runs uRun's real-time inference and video runtime, Kubernetes, GPU-heavy workloads, and streaming pipelines

  • Own observability, reliability, and performance at scale: SLO-driven capacity, autoscaling, failover, and cost-efficient GPU provisioning

  • Build and maintain the platform primitives that product and ML teams depend on, service meshes, deployment pipelines, secrets and credential management, and configuration-as-code

  • Partner closely with ML and video-workload engineers to optimise for low-latency inference, memory-bound workloads, and streaming data flows

  • Define and champion platform standards for security, observability, and incident response, drawing on SRE-style practices

  • Mentor and unblock other engineers, and act as a technical leader on architecture, trade-offs, and long-term platform evolution

 
What skills you need for the journey
  • 7+ years as an engineer, with a proven track record architecting and owning large-scale production systems

  • Deep Kubernetes expertise, including GPU-heavy clusters (NVIDIA tooling, autoscaling on GPU nodes) and service-mesh patterns

  • Strong cloud and infrastructure-as-code: AWS, GCP, or Azure; Terraform, Pulumi, or equivalent; networking and security (VPC, IAM, API-gateway-style routing)

  • SRE-style thinking and observability depth: Prometheus/Grafana, OpenTelemetry, distributed tracing, SLOs, incident response, and post-mortems

  • Proficiency in at least one of Python, Go, or TypeScript/Node.js for platform tooling, automation, and glue code

  • Experience with streaming or real-time systems: WebRTC, low-latency video pipelines, or comparable latency-sensitive workloads. This is central to the role, not a bonus

  • A track record of mentoring engineers and influencing cross-functional teams

 
Things that will give you an edge
  • Hands-on experience with GPU-constrained, memory-bound, or bursty workloads

  • Experience writing custom Kubernetes controllers, scaling logic, or other platform features in-house

  • Early-stage startup experience: owning ambiguous problems end-to-end and setting technical direction with limited scaffolding

 
What you'll get in return
  • Competitive salary and meaningful equity in an early-stage AI infrastructure company. The band above is our target; for an exceptional candidate we'll go higher. Equity is real, you're early, and the grant reflects that.

  • Health, dental, and vision — full coverage

  • 401(k) — company-supported retirement savings

  • FSA/HSA — flexible spending accounts for healthcare costs

  • Paid time off — we trust you to manage your time

  • Top-tier tooling — access to the best AI tools available: Claude, Codex, Kimi, and whatever else helps you move faster

  • MacBook Pro and AirPods — the hardware you need, on us

How we work (and what that feels like day-to-day)

We build the stage, not the show. We're an infrastructure company, a developer-tools company, and a production partner for model labs, and focus is a deliberate choice we've made and hold to.

Day-to-day, that means a small team, a high bar, and real ownership. You won't wait for permission or inherit a backlog of someone else's decisions, in a founding security role, the function is what you make it.

It also means ambiguity: priorities shift, not everything is documented, and you'll often be the person who decides what "secure enough, for now" means. That suits some people and not others, and we'd rather you know that before you apply.

  • Watch our launch party video

  • Read the manifesto

  • Follow us on LinkedIn

  • Follow us on X

Skills Required

  • 7+ years as an engineer with experience architecting and owning large-scale production systems
  • Deep Kubernetes expertise including GPU-heavy clusters, NVIDIA tooling, and autoscaling on GPU nodes
  • Experience with service-mesh patterns
  • Cloud and infrastructure-as-code experience (AWS, GCP, or Azure; Terraform, Pulumi, or equivalent)
  • Networking and security: VPC, IAM, API-gateway-style routing
  • SRE-style observability and reliability: Prometheus/Grafana, OpenTelemetry, distributed tracing, SLOs, incident response
  • Proficiency in at least one of: Python, Go, or TypeScript/Node.js
  • Experience with streaming or real-time systems (WebRTC, low-latency video pipelines, or comparable latency-sensitive workloads)
  • Track record mentoring engineers and influencing cross-functional teams
  • Hands-on experience with GPU-constrained, memory-bound, or bursty workloads
  • Experience writing custom Kubernetes controllers, scaling logic, or in-house platform features
  • Early-stage startup experience owning ambiguous problems end-to-end
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company

What We Do

HowURun is a global team of experienced technologists and business strategists dedicated to enabling value exchange between people, organizations, and partners. They specialize in creating decentralized, secure, and transparent systems, leveraging deep technical expertise in IoT, Telemetry, Big Data Storage and Analysis, and Blockchain to help businesses and governments break down data silos, improve collaboration, and achieve high-value business results.

Similar Jobs

GC AI Logo GC AI

Data Engineer

Artificial Intelligence • Legal Tech
In-Office or Remote
San Mateo, CA, USA
100 Employees
165K-350K Annually

Embedding VC Logo Embedding VC

Reliability Engineer

Artificial Intelligence • Software • Generative AI
In-Office or Remote
7 Locations
17 Employees

ChowNow Logo ChowNow

Sales Manager

Food • Software
Easy Apply
Remote or Hybrid
USA
208 Employees
130K-165K Annually

Globe Life Logo Globe Life

Senior Director, Onboarding (Remote)

Insurance • Financial Services
Remote
USA
3000 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account