Software Engineer, Full-Stack ML Infrastructure

Posted 3 Hours Ago
Be an Early Applicant
2 Locations
In-Office
Mid level
Artificial Intelligence • Security • Software
The Role
Build full-stack infrastructure, DevOps, and MLOps tools for AI development teams. Responsibilities include CI/CD, reproducible environments, experiment and evaluation workflows, self-service applications, observability, cost tracking, deployment automation, identity and access services, LLM gateways, and usage metering. Collaborate directly with engineers and researchers to improve internal workflows, reliability, and operational efficiency.
Summary Generated by Built In
Company

Pramaana Labs is a frontier AI lab building the verification layer for AI. Founded in 2025 and headquartered in Palo Alto, we turn complex human knowledge, including tax codes, legal rules, clinical guidelines and security protocols, into a formal representation, so every AI answer can be traced, challenged, and proved. Pramaana's architecture pairs foundation models trained to formalize and reason with a symbolic world model encoded in Lean 4. Pramaana was founded by a team out of Google, DeepMind, and Glean, combining frontier AI researchers and formal methods experts.

The Role

We’re looking for a full-stack engineer with focus on infrastructure to build the tools and systems that help Pramaana’s engineers and researchers develop, test, deploy, and operate their work more effectively.

Your initial focus will be DevOps and MLOps: improving development environments and deployment workflows, making experiments and evaluations reproducible, and helping teams understand the behavior, performance, and cost of AI systems. You’ll build across interfaces, backend services, and infrastructure automation—not just maintain scripts or configure dashboards.

This is an early-stage role with scope across the company. As needs evolve, your work will extend into shared capabilities such as identity and access, LLM gateways, API-key management, training and inference platform maintenance, usage metering, and internal applications. You’ll work directly with the people using these systems, turning recurring friction into reliable, self-serve tools.

We’re looking for someone who treats internal tools as products: useful, understandable, well-maintained, and built around the workflows of the people who depend on them.

What You'll Do
  • Improve how software gets built and deployed. Develop repeatable local environments, automated tests, CI/CD pipelines, and deployment workflows. Help make configuration, secrets, releases, and rollbacks easier to manage safely.

  • Build tools for the AI development lifecycle. Create workflows for running experiments and evaluations, versioning datasets and configurations, tracking results and artifacts, and deploying or integrating model services. Make runs easier to reproduce, compare, and investigate. Help researchers get from a recipe to a running job, and from a failed job to the cause..

  • Create full-stack, self-serve applications. Build interfaces and APIs that let teams launch jobs, manage configurations, inspect results, and troubleshoot failures without relying on repeated manual assistance.

  • Make systems observable and costs understandable. Connect logs, metrics, traces, and usage data so teams can diagnose issues, identify bottlenecks, and understand where time and compute are being spent.

  • Contribute to shared platform services. Help build and integrate identity, access controls, LLM routing, API keys, budgets, and usage metering across Pramaana’s products and internal workflows.

  • Use existing tools thoughtfully. Evaluate and extend open-source or managed solutions where they fit. Build custom software where it solves a real gap, rather than recreating infrastructure unnecessarily.

  • Improve tools through direct feedback. Work alongside engineers and researchers to identify recurring problems, prioritize improvements, and measure whether tools reduce setup time, manual work, and failed runs. Maintain tests, documentation, and operational guidance for what you ship.

You Will Thrive in This Role If You Have
  • Minimum 2-3 years of software engineering experience, including hands-on work with backend services, full-stack applications, internal tools, or deployment automation.

  • A solid foundation in building software across the stack. You can develop services and automation in Python or TypeScript, work with APIs and databases, and build usable interfaces with React or a similar framework.

  • Practical cloud and deployment experience. You’ve deployed applications using containers and a cloud platform such as AWS, worked with CI/CD, and used logs or metrics to investigate problems.

  • Some hands-on exposure to AI or ML workflows. This could include integrating model APIs, running evaluations, tracking experiments, or operating model-backed applications through work or substantial projects. You don’t need to be an ML researcher.

  • A product mindset for internal users. You care about clear interfaces, sensible defaults, useful documentation, and reducing the number of steps it takes someone to get their work done.

  • Good engineering judgment and a collaborative approach. You write maintainable code, test important behavior, ask for review, and communicate trade-offs. You can take ownership of a scoped problem while recognizing when to seek help.

Especially Strong Candidates May Also Have
  • Experience with experiment tracking, evaluation pipelines, workflow orchestration, or model observability using tools such as MLflow, Langfuse, or Temporal.

  • Experience with infrastructure as code, container orchestration, or telemetry tooling, such as Terraform, Kubernetes, or OpenTelemetry.

  • Experience running GPU workloads on Kubernetes: job queueing and preemption multi-node training with NCCL over EFA or InfiniBand, GPU node health and driver management, or serving models with vLLM or SGLang.

  • Experience implementing authentication, role-based access, API-key management, image provenance, LLM gateways, usage and cost tracking or hardening public endpoints.

  • Experience adapting open-source software or building developer tools that other engineers or researchers use regularly.

You don’t need experience with every system listed above. Strong software engineering fundamentals, practical problem-solving, and an interest in DevOps and MLOps matter more than matching every tool.

Skills Required

  • 2–3 years of software engineering experience, including backend services, full-stack applications, internal tools, or deployment automation
  • Ability to develop services and automation in Python or TypeScript
  • Experience working with APIs and databases
  • Experience building usable interfaces with React or a similar framework
  • Experience deploying applications using containers and a cloud platform such as AWS
  • Experience working with CI/CD
  • Experience using logs or metrics to investigate problems
  • Hands-on exposure to AI or ML workflows, such as model APIs, evaluations, experiment tracking, or model-backed applications
  • Experience with experiment tracking, evaluation pipelines, workflow orchestration, or model observability
  • Experience with MLflow, Langfuse, or Temporal
  • Experience with infrastructure as code, container orchestration, or telemetry tooling
  • Experience with Terraform, Kubernetes, or OpenTelemetry
  • Experience running GPU workloads on Kubernetes
  • Experience with NCCL over EFA or InfiniBand, GPU node health, driver management, vLLM, or SGLang
  • Experience implementing authentication, role-based access, API-key management, image provenance, LLM gateways, usage tracking, cost tracking, or endpoint hardening
  • Experience adapting open-source software or building developer tools used by engineers or researchers
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
33 Employees
Year Founded: 2025

What We Do

Pramaana Labs builds the verification layer for AI, translating complex human knowledge—including tax codes, clinical guidelines, legal rules, and safety constraints—into machine-checkable logic. Its domain-specific systems use provers and solvers to search solution spaces and return proof artifacts, counterexamples, and traceable explanations for expert review. The aim is to make AI answers verifiable, challengeable, and defensible, supporting more accountable AI deployment across high-stakes applications.

Similar Jobs

Tapestry - Coach and Kate Spade Logo Tapestry - Coach and Kate Spade

Sales Associate III

eCommerce • Fashion • Retail • Sales • Wearables • Design
Hybrid
Cabazon, CA, USA
16000 Employees
15-24 Hourly

Wipfli Logo Wipfli

Quality Assurance Lead

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
2900 Employees
107K-144K Annually

CrowdStrike Logo CrowdStrike

Sr. Competitive Intelligence Analyst III (Remote)

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
USA
11000 Employees
145K-220K Annually

CrowdStrike Logo CrowdStrike

Senior Engineering Manager

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Hybrid
4 Locations
11000 Employees
160K-250K Annually

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account