The Role
Design, build, and operate backend services and LLM orchestration pipelines. Implement RAG/agent flows, CI/CD, schema migrations, observability, secure multi-tenant access, and participate in on-call incident response to ensure reliable production systems.
Summary Generated by Built In
At Routine Labs, we are building Europe's first secure, auditable, and EU-compliant automation infrastructure for legacy systems. We're taking a practical approach to improving how engineers work with AI systems. Combining LLMs with familiar software engineering methods to make it easier for people to build, modify and maintain software automations. Our platform lowers the effort required to turn natural-language instructions into deterministic, testable code that can interface with and automate legacy systems.
We’re hiring a Senior Software Engineer (Backend/LLM Infrastructure) to build and operate the backend services and LLM pipelines that make this automation fast, reliable, and production-ready.
Tasks
* Build and maintain Python/FastAPI services, SQLAlchemy/Alembic models, Redis caching, and background jobs (Celery/RQ).
* Implement and optimize LLM orchestration pipelines: RAG flows, agent workflows, evaluation, tracing, retries, and feature flags.
* Own CI/CD pipelines, environment promotion, schema migrations, canary/blue-green deployments, and operational reliability.
* Add observability: structured logs, OpenTelemetry tracing, and RAG quality dashboards.
* Integrate secure multi-tenant access with SSO (OIDC/SAML) and RBAC.
* Participate in on-call rotations, incident response, and continuous improvement of production systems.
Requirements
* 4–6+ years of backend or full-stack engineering experience with Python/FastAPI/LangGraph in production.
* Hands-on experience with LLM systems, embeddings, vector stores, and performance/cost optimization.
* Strong CI/CD and operations mindset: SLOs, monitoring, incidents, and rollbacks.
Solid SQL, Redis, and background job experience.
* Experience integrating SSO (OIDC/SAML) and multi-tenant RBAC.
* Nice addition: Playwright/Stagehands/pywinauto, Temporal/Kafka, feature flags (langfuse/Unleash), HIPAA/SOC2 exposure.
Benefits
* Direct collaboration with the CTO, CPO and founding team
* Competitive compensation package including Virtual Share Options (VSOPs)
* True ownership and a green field to shape the technical foundation of the product
* Perks such as Urban Sports Club, Workations, Offsites, Deutschland Ticket
Join the team shaping the technical foundation of a company redefining how legacy software gets automated.
_We value diverse perspectives and welcome candidates of all genders, identities and backgrounds._
We’re hiring a Senior Software Engineer (Backend/LLM Infrastructure) to build and operate the backend services and LLM pipelines that make this automation fast, reliable, and production-ready.
Tasks
* Build and maintain Python/FastAPI services, SQLAlchemy/Alembic models, Redis caching, and background jobs (Celery/RQ).
* Implement and optimize LLM orchestration pipelines: RAG flows, agent workflows, evaluation, tracing, retries, and feature flags.
* Own CI/CD pipelines, environment promotion, schema migrations, canary/blue-green deployments, and operational reliability.
* Add observability: structured logs, OpenTelemetry tracing, and RAG quality dashboards.
* Integrate secure multi-tenant access with SSO (OIDC/SAML) and RBAC.
* Participate in on-call rotations, incident response, and continuous improvement of production systems.
Requirements
* 4–6+ years of backend or full-stack engineering experience with Python/FastAPI/LangGraph in production.
* Hands-on experience with LLM systems, embeddings, vector stores, and performance/cost optimization.
* Strong CI/CD and operations mindset: SLOs, monitoring, incidents, and rollbacks.
Solid SQL, Redis, and background job experience.
* Experience integrating SSO (OIDC/SAML) and multi-tenant RBAC.
* Nice addition: Playwright/Stagehands/pywinauto, Temporal/Kafka, feature flags (langfuse/Unleash), HIPAA/SOC2 exposure.
Benefits
* Direct collaboration with the CTO, CPO and founding team
* Competitive compensation package including Virtual Share Options (VSOPs)
* True ownership and a green field to shape the technical foundation of the product
* Perks such as Urban Sports Club, Workations, Offsites, Deutschland Ticket
Join the team shaping the technical foundation of a company redefining how legacy software gets automated.
_We value diverse perspectives and welcome candidates of all genders, identities and backgrounds._
Skills Required
- 4-6+ years backend or full-stack engineering experience with Python, FastAPI, and LangGraph in production
- Hands-on experience with LLM systems, embeddings, and vector stores, including performance and cost optimization
- Strong CI/CD and operations mindset (SLOs, monitoring, incident response, rollbacks)
- Solid SQL knowledge and experience with Redis and background job systems (Celery or RQ)
- Experience integrating SSO (OIDC/SAML) and implementing multi-tenant RBAC
- Participate in on-call rotations and incident response for production systems
- Playwright, Stagehands, or pywinauto experience
- Experience with Temporal or Kafka
- Experience with feature flag systems (langfuse, Unleash)
- HIPAA or SOC2 exposure
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Routine Labs is building Europe's first secure, auditable, and EU-compliant automation infrastructure for legacy systems. Their mission is to improve how engineers work with AI systems by combining Large Language Models (LLMs) with familiar software engineering methods. This approach allows them to turn natural-language instructions into deterministic, testable code that can interface with and automate legacy systems safely and precisely.
