Software Engineer AI Inference

Posted Yesterday
Be an Early Applicant
Paris, Île-de-France, FRA
Hybrid
Entry level
Cloud • Software
The Role
Build and operate high-performance AI inference infrastructure for LLMs and generative AI workloads. Develop Golang backend services, deploy Kubernetes-based systems, optimize serving stacks with vLLM, Triton, and CUDA, and integrate AI tooling such as Hugging Face and KServe. The role includes architecture decisions, troubleshooting, scaling ML models, collaborating across teams, and contributing to code reviews and knowledge sharing.
Summary Generated by Built In
OUR STORY:
 
🇪🇺 Join Scaleway and shape the sovereign cloud of tomorrow !
Since 1999, we have been designing secure, sustainable infrastructures aimed at supporting the most ambitious companies.
 
Historically known for our dedicated servers (Dedibox), we made a strategic shift to cloud computing in 2015. Staying true to our principles of simplicity, flexibility, and technical excellence, we have become one of the leading players in Europe in the sector.
 
With the rise of artificial intelligence, we have strengthened our commitment, supported by the Iliad Group, which is investing €3 billion to develop a serious, sovereign AI alternative to American and Asian giants.
 
Every day, thanks to our fast-growing portfolio of cloud and AI products (bare metal, containerization, serverless, AI, etc.), Scaleway proudly serves thousands of customer across the private and public sector, from corporations like France Télévisions or Hachette Livre, to fast-growing startups like Photoroom and Biolevate, to institutions like the City of Copenhagen.
 
📍 Our offices are located in Paris, Lille, Toulouse, Rennes, Rouen, Bordeaux and Lyon.

WHY WE NEED YOU?

As Scaleway expands its AI capabilities, we are strengthening our AI Inference team to build and scale our next-generation inference platform.

Your mission will be to design, build, and operate high-performance AI inference infrastructure, enabling the deployment of LLMs and generative AI workloads at scale.

You will tackle challenges in distributed systems, GPU infrastructure, and performance optimization, helping shape the future of sovereign AI cloud infrastructure in Europe.

YOUR FUTURE TEAM

We work in a collaborative and international environment where the diversity of Scalers, combined with a spirit of sharing, helps bring new projects to life every day, advancing our ambitions together.

You will be part of a team of 4 DevOps engineers, working closely on backend and infrastructure topics related to AI inference. The squad  is part of a broader AI tribe focused on four strategic products:

  • Managed Inference, a platform to deploy, scale, and monitor AI models in production
  • Generative APIs, a unified API layer to access cutting-edge generative models (LLMs, Diffusion, etc.)
  • AI HPC, serving massive clusters, with thousands of GPU, to high end customers with strong model training needs
  • AI Tooling, developing in house technologies to boost Scaleway and the Iliad Group in their daily tasks

🗓️ YOUR DAILY ROUTINE INCLUDES:

  • Build and operate infrastructure for serving LLMs and other generative models at scale
  • Design, deploy, and maintain Kubernetes-based services optimized for AI inference
  • Develop in Golang to build robust and efficient backend services
  • Optimize serving stacks using tools like vLLM, Triton, and CUDA
  • Integrate open-source AI tooling such as Hugging Face, KServe, or custom components
  • Participate in architecture discussions and make high-impact technical decisions
  • Keep up with the fast-paced evolution of AI serving ecosystems
  • Troubleshoot and resolve complex infrastructure and deployment issues
  • Collaborate with internal teams to integrate new AI features
  • Contribute to code reviews and knowledge sharing within the team
 

🔍 ABOUT YOU:

HARDSKILLS

  • Strong experience with Golang in production environments
  • Proficiency with Kubernetes and container orchestration tools
  • Knowledge about AI models (LLMs, Diffusion models, …)
  • Hands-on experience with deploying and scaling ML models is appreciated
  • Solid understanding of backend architectures and DevOps practices


SOFTSKILLS

  • Fast learner with high adaptability to new technologies
  • Strong curiosity and willingness to dive deep into emerging AI tools
  • Proactive mindset and readiness to take initiative
  • Technical autonomy and ownership of your scope
  • Clear communicator, capable of explaining complex systems simply
 

 WHAT YOU WILL FIND AT SCALEWAY ?

  • Hybrid work: Up to 3 days remote per week

  • Modern offices: Creative, ergonomic workspaces in prime locations with terraces and bike facilities

  • Healthy dining: Chef-prepared meals at HQ; Swile card for regional sites

  • Well-being: Support for gym memberships, childcare, and caregiver services

  • Diverse culture: English is as common as French; teams span many nationalities

  • Growth mindset: Strong internal mobility and opportunities across the Iliad Group

 

🚀 Why join the Scaleway adventure ?  

✔ A rich and diverse product offering: Scaleway offers over 100 public cloud products in IaaS, PaaS, AI.

✔ A cutting-edge technical environment: Scaleway provides modern infrastructures, including high-performance bare metal servers, to tackle exciting technical challenges.

✔ Commitment to responsible cloud: Scaleway is dedicated to a more responsible cloud, with data centers powered solely by renewable energy since 2017, minimizing our ecological footprint and holding top-level certification.

🔜 The next steps ?

- Discovery call with a recruiter (30 min)

- Technical interview to validate your expertise (1h)
- Hiring Manager Interview (45 min): In-depth discussion about your experience, expectations, and alignment with the role.
- Head of Tribe Interview (45 min): Final discussion to assess your fit with the team, the organization, and the broader technical challenges.

At Scaleway, we are committed to building an inclusive and respectful workplace where everyone has a fair opportunity to thrive.
All applications are considered with care, regardless of age, gender, sexual orientation, ethnic or social background, religion, disability, or any other characteristic.
We believe great ideas come from everywhere, and everyone which is why you should definitely apply. 

Skills Required

  • Strong experience with Golang in production environments
  • Proficiency with Kubernetes and container orchestration tools
  • Knowledge of AI models, including LLMs and diffusion models
  • Hands-on experience deploying and scaling machine learning models
  • Solid understanding of backend architectures and DevOps practices
  • Fast learner with high adaptability to new technologies
  • Curiosity and willingness to learn emerging AI tools
  • Proactive mindset and readiness to take initiative
  • Technical autonomy and ownership
  • Clear communication skills and ability to explain complex systems simply
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Paris, Paris
555 Employees
Year Founded: 1999

What We Do

Welcome to Scaleway: Europe's empowering cloud provider We are the preferred cloud solution, empowering developers and businesses to seamlessly build, deploy, and scale applications across diverse infrastructures. Our global presence spans Paris, Amsterdam, and Warsaw, serving a thriving community of over 25,000 businesses, including pioneering European startups. Why Choose Us? Our comprehensive cloud ecosystem is distinguished by multi-AZ redundancy, delivering a robust foundation for uninterrupted operations. What sets us apart is not just our state-of-the-art data centers, powered entirely by renewable energy, but also our commitment to providing a smooth developer experience. Scaleway is the choice for those seeking native tools to navigate and manage multi-cloud architectures effortlessly. What We Offer: We offer fully managed solutions for bare metal, containerization, and serverless architectures. We believe in empowering our customers with choices: the choice to determine the location of their data, the choice to select the architecture that best suits their business needs, and the choice to scale responsibly. Our Advantages: Multi-AZ Redundancy: Ensure business continuity with our robust multi-AZ redundancy. Smooth Developer Experience: Streamline your development process with a user-friendly environment. Renewable Energy Data Centers: Contribute to a sustainable future by hosting your applications in data centers powered solely by renewable energy. Native Tools for Multi-Cloud: Seamlessly manage and optimize your multi-cloud architectures with our native tools. Choose us, Choose Innovation: We're not just a cloud provider; we are your partner in innovation. Choose us for the freedom to decide where your data resides, the flexibility to tailor your architecture to your business, and the responsibility to scale in an environmentally conscious manner.

Similar Jobs

Pfizer Logo Pfizer

Director, AI Product Lead

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
28 Locations
121990 Employees

Pfizer Logo Pfizer

Associate, AI Engineering

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
28 Locations
121990 Employees

Pfizer Logo Pfizer

Staff Software Engineer

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
In-Office
2 Locations
121990 Employees

Pfizer Logo Pfizer

Global Head, Site Contracting

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
In-Office or Remote
30 Locations
121990 Employees
215K-358K Annually

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account