LLM Inference Platform Architect

Posted 4 Days Ago
Be an Early Applicant
Helsinki, FIN
Hybrid
Entry level
Artificial Intelligence • Machine Learning • Software • Quantum Computing
The Role
Designs and leads a secure internal LLM serving platform on controlled GPU infrastructure. Responsibilities include managing GPU clusters, inference engines, access control, capacity planning, platform standards, regulatory compliance, and optimized model deployment. The role collaborates with security, operations, enterprise architecture, and LLM science teams to deliver reliable, private AI services.
Summary Generated by Built In

Join QuTwo - Europe's private Quantum AI Lab, on our quest to bridge the gap between the classical and the quantum world. We partner with the most advanced and forward-thinking customers, solving fundamental real-world problems, side by side.

We are a European AI lab for the quantum era, co-founded by pioneers behind IQM and Silo AI, with a team spanning MIT, UC Berkeley, Cambridge, and Carnegie Mellon, and backed by the founders of Skype, Hugging Face, Quantinuum, Supercell and many more. We work at the intersection of quantum computing, AI, optimization, and simulation — where the answers do not yet exist and the work genuinely matters.

We are seeking LLM Inference Platform Architect. If you are a humble learner, not afraid of the unknown, we encourage you to apply.

Role Description

The Infrastructure Architect designs and leads a secure, internal LLM serving platform on fully controlled GPU hardware, ensuring complete data privacy and independence from external model providers.

Managing the full serving stack—including GPU clusters, inference engines, access control, and capacity planning—this role delivers a reliable AI service for the entire organization. The architect sets platform standards, ensures strict regulatory compliance (such as DORA), and partners closely with security, operations, and LLM scientists to deploy optimized models.

Qualifications
  • Experience designing and running large-scale infrastructure on Kubernetes, including GPU workloads

  • Hands-on experience with LLM inference engines (vLLM, SGLang, TensorRT-LLM or similar)

  • Infrastructure as code (Terraform or similar), CI/CD and observability tooling

  • Understanding of security, identity and network design in enterprise environments

  • Experience writing architecture guidelines and working with enterprise architecture teams

Experience in one or more of the following areas is a plus but not a requirement:
  • Hands-on experience configuring and managing enterprise-grade GPUs (NVIDIA or AMD Instinct) and their respective acceleration stacks (CUDA or ROCm).

  • Background in banking or other highly regulated industries, with familiarity with DORA or equivalent compliance frameworks.

Skills Required

  • Experience designing and operating large-scale Kubernetes infrastructure, including GPU workloads
  • Hands-on experience with LLM inference engines such as vLLM, SGLang, or TensorRT-LLM
  • Experience with infrastructure as code, such as Terraform, plus CI/CD and observability tooling
  • Understanding of enterprise security, identity, and network design
  • Experience writing architecture guidelines and collaborating with enterprise architecture teams
  • Experience configuring and managing enterprise-grade NVIDIA or AMD Instinct GPUs and CUDA or ROCm acceleration stacks
  • Background in banking or other highly regulated industries, with familiarity with DORA or equivalent compliance frameworks
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Year Founded: 2026

What We Do

Qutwo is a European AI lab focused on creating next-generation AI for a quantum world. The company develops enterprise software and the Qutwo OS, an orchestration layer that bridges classical and quantum computing. By simulating quantum workloads and offering hybrid solutions, Qutwo helps enterprises solve complex optimization and simulation problems and prepare for the transition to full quantum advantage.

Similar Jobs

Tulip Logo Tulip

Senior Customer Success Manager

Enterprise Web • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
27 Locations
310 Employees
Hybrid
Helsinki, FIN
2449 Employees

Pfizer Logo Pfizer

Product Engineer

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
28 Locations
121990 Employees
Hybrid
5 Locations
2449 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account