Senior Forward Deployed Engineer, ML Infrastructure & Inference

Posted 8 Hours Ago
Be an Early Applicant
San Francisco, CA, USA
In-Office
273K-395K Annually
Senior level
Artificial Intelligence • Machine Learning • Generative AI
The Role
Build and deploy FLUX-based ML pipelines and inference systems for enterprise customers. Own production deployments, GPU sizing, scaling, optimization, evaluation, safety layers, and fine-tuning workflows across hosted, on-premise, regulated, and air-gapped environments. Partner with customer engineering teams, advise on architecture and cost-latency tradeoffs, create reusable tooling, and mentor engineers while serving as a technical deployment lead for strategic accounts.
Summary Generated by Built In
About Black Forest Labs

We’re the team building the foundational layer for visual intelligence: multimodal models trained jointly on images, video, audio, and action to see, generate, and understand the world.

Our founding team pioneered latent diffusion and Stable Diffusion, the breakthroughs that made generative AI accessible to millions. With FLUX, we're pushing into generative media at scale, machines that act in the physical world, and emerging applications in computer use.

Our FLUX models top public benchmarks and run in production in some of the world's biggest platforms. We're a small, fast growing research lab competing with the largest companies in the world. From our labs in Freiburg to San Francisco, we're building what comes next.

What You’ll Work On

As a Forward Deployed Engineer, ML Infrastructure & Inference at BFL, you will:

  • Build custom endpoints and pipelines on top of FLUX for our customers: multi-step workflows, prompt harnesses and upsampling, pre- and post-processing, moderation and safety layers, and combinations of FLUX with VLMs and other models

  • Take customer use cases from scoping to proof of concept to a production endpoint, running on BFL's or the customer's infrastructure

  • Own the deployment of FLUX models and custom pipelines into customers' production environments, from on premise to BFL-hosted integrations, including serving setup, GPU sizing and scaling

  • Profile customer workloads, apply existing inference optimizations to hit cost and latency targets, and partner with BFL's inference team on deeper optimization work

  • Build evaluation sets and harnesses against customer requirements, and catch quality regressions across model versions

  • Help customers adapt models to their use case through finetuning and LoRA training pipelines on their own or BFL's infrastructure

  • Advise customers on deployment architecture and on the trade-offs between BFL-hosted and self-hosted setups (cost, latency, security, compliance)

  • Feed field learnings back to BFL's research and platform teams, and turn repeated customer work into reusable tooling, reference architectures and documentation

  • Act as a technical thought leader within the FDE team, setting standards for applied and deployment work and mentoring other engineers

What We’re Looking For
  • 6+ years of engineering experience, with significant time building and running ML systems in production

  • Hands-on experience building and serving ML models in production, from model code to API (e.g. PyTorch, model serving frameworks, GPU workloads)

  • Experience building applied ML systems end to end: pipelines combining multiple models, evaluation, and safety or moderation components

  • Solid infrastructure skills: Kubernetes, containerization, observability, and at least one major cloud platform (AWS, GCP, Azure)

  • Experience working directly with customer engineering teams in complex enterprise environments, including security reviews and regulated or air-gapped setups

  • Strong Python skills and comfort reading and modifying model code

  • Ability to explain complex technical trade-offs clearly to both engineers and non-technical stakeholders, internally and externally

  • Willingness to take on Technical Deployment Lead (TDL) responsibility for strategic accounts, owning the technical relationship and delivery end to end

  • Willingness to travel occasionally, nationally and internationally, for team offsites and customer engagements

Nice to have
  • Prior knowledge of diffusion models and/or flow matching, and relevant finetuning and distillation techniques

  • Inference optimization experience and a track record of improving latency, throughput or cost per generation

  • Experience with LLMs or VLMs for prompt harnesses, captioning or evaluation

  • Experience with open source tooling from the FLUX ecosystem such as ComfyUI, diffusers and common trainer frameworks

  • Experience serving video generation models

  • Open-source contributions to inference, serving or diffusion model projects

  • Previous experience as a forward deployed engineer, solutions architect or ML platform engineer at an AI lab or cloud provider

How We Work Together

We’re a distributed team with real offices that people actually use. This role is based in San Francisco, and you’ll join us in the office at least 2 days a week, or one full week every other week.

Everything we do is grounded in four values:

  • Obsessed. We are a frontier research lab. The science has to be right, the understanding deep, the product beautiful.

  • Low Ego. The work speaks. The best idea wins, no matter who said it. Credit is shared. Nobody is above any task.

  • Bold. We take the ambitious bet. We ship, we do not wait for conditions to be perfect.

  • Kind. People over politics. We treat each other with genuine warmth. Agency without empathy creates chaos.

Closing

If this sounds like work you'd enjoy, we'd love to hear from you.

Compensation

USD 273-395K + equity, depending on profile

 

Skills Required

  • 6+ years of engineering experience, including significant experience building and operating production ML systems
  • Hands-on experience building and serving ML models in production, from model code through APIs
  • Experience with applied ML systems, multi-model pipelines, evaluation, and safety or moderation components
  • Infrastructure experience with Kubernetes, containerization, observability, and at least one major cloud platform
  • Experience working with customer engineering teams in complex enterprise environments, including security reviews and regulated or air-gapped deployments
  • Strong Python skills and ability to read and modify model code
  • Ability to communicate complex technical trade-offs to technical and non-technical stakeholders
  • Willingness to take on Technical Deployment Lead responsibility for strategic accounts
  • Willingness to travel occasionally nationally and internationally
  • Knowledge of diffusion models or flow matching, including fine-tuning and distillation techniques
  • Inference optimization experience improving latency, throughput, or cost per generation
  • Experience with LLMs or VLMs for prompt harnesses, captioning, or evaluation
  • Experience with FLUX ecosystem tools such as ComfyUI, diffusers, and trainer frameworks
  • Experience serving video generation models
  • Open-source contributions to inference, serving, or diffusion model projects
  • Previous experience as a forward deployed engineer, solutions architect, or ML platform engineer at an AI lab or cloud provider
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company

What We Do

Black Forest Labs is a frontier AI research laboratory focused on building state-of-the-art generative deep-learning models for media, including images and videos. Its mission is to advance creativity, efficiency, and diversity in generative media while developing visual intelligence—systems that understand, reason, and act in the world. The company created FLUX, its image-generation model suite, and aims to establish an industry standard for generative media.

Similar Jobs

CNA Logo CNA

Flight Test Intern (Summer 2027)

Cloud • Insurance • Professional Services • Analytics • Cybersecurity
Hybrid
2 Locations
7000 Employees

Lowe’s Logo Lowe’s

Cashier Part Time

Consumer Web • eCommerce • Information Technology • Retail • Software • Analytics • App development
Hybrid
Folsom, CA, USA
300000 Employees

Lowe’s Logo Lowe’s

Warehouse Part Time Days

Consumer Web • eCommerce • Information Technology • Retail • Software • Analytics • App development
Hybrid
Apple Valley, CA, USA
300000 Employees

Lowe’s Logo Lowe’s

Warehouse Part Time Days

Consumer Web • eCommerce • Information Technology • Retail • Software • Analytics • App development
Hybrid
Pico Rivera, CA, USA
300000 Employees

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
85 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account