Engineering Manager - AI Product(100% Remote EMEA)

Posted 2 Days Ago
Be an Early Applicant
Hiring Remotely in Türkiye
Remote
Senior level
Information Technology • Software
The Role
Lead a small engineering team building and operating the end-to-end AI product platform: model serving, GPU scheduling, inference pipelines, retrieval/embedding systems, monitoring, and CI/CD. Balance hands-on coding (~50%) with technical leadership, architecture, cross-functional collaboration, hiring and coaching, and driving reliability, cost-efficiency, and AI product quality.
Summary Generated by Built In
 
 

Location: Remote (Europe Time Zone)
Start date: ASAP
Language: English
Team: AI

About the Role

Our client is a European technology company operating a cloud and infrastructure platform, and we are looking for an AI Engineering Manager to lead the small, high-leverage team behind their AI product.

This team owns the full stack that makes the product work from model serving and inference infrastructure to the AI platform and application layer that users interact with.

You will combine leadership and technical depth, leading a team of 3 engineers, setting direction, and staying hands-on with production-grade code (~50%). With a team this size, your own output matters as much as your judgment: this is a player-coach role for a technical leader who can make strategic decisions, guide architecture, and ship reliable, cost-efficient AI systems at scale.

What You'll Do
  • Lead, mentor, and grow a small, high-performing team of engineers focused on AI platform and product engineering

  • Drive architectural direction for the AI product with an emphasis on inference performance, reliability, cost efficiency, and developer experience

  • Contribute hands-on to design, implementation, and optimization of core AI systems (model serving, inference pipelines, retrieval, orchestration, evaluation)

  • Own the AI/ML platform end to end: GPU capacity and scheduling, model deployment and versioning, data and embedding pipelines, monitoring and quality evaluation

  • Collaborate closely with Product, Infrastructure, Security, and Backend teams to define priorities and ensure smooth integrations

  • Conduct regular 1:1s, performance reviews, and technical coaching

  • Foster a culture of ownership, engineering excellence, and continuous improvement

  • Translate strategic objectives into actionable execution plans and ensure timely delivery

  • Influence the evolution of the AI platform with pragmatic, forward-looking technical decisions

  • Champion best practices across software development, automation, evaluation, and operational excellence

What We're Looking For
  • 7+ years of experience in software engineering, including 2+ years in a technical leadership or engineering management role

  • Proven experience building and operating AI/ML platform or inference infrastructure in production (model serving, GPU workloads, latency and cost optimization)

  • Solid experience building distributed backend systems, strong Python, plus a systems language (Go, Rust, or similar) is a plus

  • Hands-on familiarity with the modern LLM stack: model APIs and open-weight models, serving frameworks (vLLM, TGI, Triton or similar), retrieval/vector databases, and prompt or context engineering

  • Strong grasp of AI product quality: evaluation frameworks, benchmarking, regression testing, and observability for non-deterministic systems

  • Strong expertise in cloud platforms (AWS preferred: EC2, ECS, Lambda, IAM, CloudWatch) and GPU compute

  • Familiarity with Kubernetes, containerization, and Infrastructure-as-Code (Terraform, Pulumi, AWS CDK)

  • Understanding of CI/CD automation (GitHub Actions, CircleCI, or similar)

  • Strong knowledge of Linux systems, networking fundamentals, and monitoring/alerting best practices

  • Excellent communication and leadership skills, able to guide performance, set expectations, and motivate engineers

  • Strong technical judgment and the ability to balance hands-on coding with people and strategic responsibilities

Why This Role Matters for You
  • Own a product, not a component: Lead the team behind the company's AI product and shape the capabilities the wider business builds on

  • High leverage, small team: With three engineers, your technical and strategic decisions translate directly into what ships

  • Grow as a leader: Manage, mentor, and inspire a talented team while influencing strategic technical decisions

  • Stay hands-on: Balance leadership with coding in a modern, high-scale AI platform environment

  • Work with cutting-edge technology: Deepen your expertise in LLMs, inference infrastructure, GPU compute, and distributed systems at scale

  • Drive platform evolution: Directly impact architecture, reliability, and AI quality across the organization

  • Collaborate across teams: Work closely with Product, Infrastructure, Security, and Backend teams, expanding your cross-functional expertise

  • Remote-first flexibility: Enjoy a fully remote role while aligning with the European time zone

Pragmatike is an Equal Opportunity Employer and is committed to providing equal employment opportunities to all applicants without discrimination. We recruit on behalf of our clients and prohibit discrimination and harassment based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training. We are committed to a fair and inclusive hiring process. We process your personal data solely for recruitment purposes, in accordance with applicable privacy laws, and maintain reasonable safeguards to protect your information. Your data may be shared with our client(s) for hiring consideration, but will not be disclosed to third parties outside of the recruitment process.

Skills Required

  • 7+ years software engineering experience including 2+ years in technical leadership or engineering management
  • Proven experience building and operating AI/ML platform or inference infrastructure in production (model serving, GPU workloads, latency and cost optimization)
  • Experience designing and optimizing model serving, inference pipelines, retrieval, orchestration, and evaluation systems
  • Strong Python programming skills
  • Experience with a systems language (Go, Rust, or similar)
  • Hands-on familiarity with modern LLM stack: model APIs, open-weight models, and serving frameworks (vLLM, TGI, Triton)
  • Experience with retrieval/vector databases and embedding pipelines
  • Expertise in AI product quality: evaluation frameworks, benchmarking, regression testing, and observability for non-deterministic systems
  • Strong expertise in cloud platforms (AWS preferred) and GPU compute (EC2, ECS, Lambda, IAM, CloudWatch)
  • Familiarity with Kubernetes, containerization, and Infrastructure-as-Code (Terraform, Pulumi, AWS CDK)
  • Understanding of CI/CD automation (GitHub Actions, CircleCI or similar)
  • Strong knowledge of Linux systems, networking fundamentals, and monitoring/alerting best practices
  • Excellent communication, leadership, people management (1:1s, performance reviews, coaching) and ability to translate strategy into execution
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Marseille
11 Employees
Year Founded: 2022

What We Do

Trusted by remote-first companies worldwide. Completing tech projects for startups and scaleups.

Similar Jobs

Mondelēz International Logo Mondelēz International

o9 Change Readiness Lead

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
11 Locations
90000 Employees
Remote or Hybrid
2 Locations
289097 Employees

Milestone Systems Logo Milestone Systems

Inside Channel Manager

Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Remote or Hybrid
2 Locations
1500 Employees

Capco Logo Capco

Business Analyst

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
10 Locations
6000 Employees

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account