As a Forward Deployed Engineer at deepset, you work embedded inside our most strategic Enterprise and Public Sector customers, as part of their team. You will transform their problems and challenges into production grade solutions and you stay with the customer until those solutions are adopted at scale and delivering measurable value. You are the technical partner the customer relies on day to day, and the bridge between their teams and deepset’s Customer Engineering, Product and Engineering teams.
Why deepsetAt deepset, we're on a mission to make custom AI solutions accessible to every organization. With Haystack, thousands of developers build advanced LLM applications every day, while our enterprise-ready AI Platform helps companies turn large language models into business value. We're remote-first, flexible, and built on a culture of trust and ownership. You'll collaborate with top-tier tech talent, tackle meaningful challenges, and help transform complex AI into solutions that are simple, powerful, and ready for the real world.
What you will doEmbed and partner
Work inside the customer’s team, aligned with their delivery and governance models, ways of working and environments.
Act as the customer’s trusted AI advisor on use case prioritization, architecture and roadmap, connecting their goals with the Haystack Enterprise Platform (HEP).
Translate business problems into well-scoped solutions with clear success metrics and a baseline, together with the Value Engineer.
Anticipate upcoming needs and maintain a customer-specific AI roadmap.
Build and run in production
Own technical outcomes from PoC to production: agents and orchestration, workflows, RAG pipelines, indexing and embeddings, model optimization, evaluations, cost management, and API and system integrations.
Bring state-of-the-art approaches to the customer’s hardest problems and turn them into reliable, secure, production-grade systems inside the customer’s environment.
Monitor solution performance with the customer and resolve issues in the AI layer quickly.
Reuse and contribute reference architectures and reusable components that make every new engagement faster.
Drive adoption and impact
Make sure what you build is actually used, with measurable quality and business impact.
Run structured evaluations and continuously improve retrieval quality, prompts and model behavior based on real usage and feedback.
Enable the customer team to operate and extend solutions independently: documentation, runbooks, knowledge transfer and training.
Grow the account and the product
Surface new use cases, teams and stakeholders, and bring them to the account team.
Prepare the evidence for the contract renewal: value delivered against the baseline agreed at kick-off.
Share field insights with Product and Engineering to shape HEP.
Native German language skills
Hands-on experience shipping AI applications to production: RAG, agents, data preprocessing, retrieval and embeddings.
A track record of building trusted, long-term relationships with technical and business stakeholders, communicating clearly at every level.
Experience designing and running agent evaluations and improving quality from real usage data.
Familiarity with agent frameworks and vector databases.
Strong Python and production engineering practices: testing, CI/CD, code review and observability.
Experience operating AI solutions in production in enterprise environments: monitoring, troubleshooting and incident handling.
Solid understanding of enterprise integration: APIs, authentication (OIDC/SAML), security and compliance.
Close awareness of the state of the art in LLMs and agentic systems, and the judgment to know when it is ready for production.
Experience scoping and estimating work within long-running engagements: effort, assumptions, risks and deliverables.
Haystack experience is a big plus
Forward-deployed or consulting experience on long, embedded engagements
Basic frontend skills (React, TypeScript) for user-facing workflows
Fine-tuning experience (PEFT, LoRA)
Remote-first setup with flexible hours & tech of your choice
30 days vacation + extra days for family sick leave
Competitive salary & stock options for every team member
Monthly sports & mental health support allowance with Oliva
Annual learning & development budget
Monthly team socials & in-person meetups
Dog-friendly Berlin HQ
About us
Founded in 2018, deepset builds open and enterprise-grade tools that help teams build AI with purpose. From Haystack, our open-source framework, to the Haystack Enterprise Platform, we give developers and organizations the building blocks to solve complex, high impact challenges with AI with full control, transparency, and sovereignty. Backed by GV and Balderton, we’re growing the world’s production AI community and customer base solving challenges too critical to get wrong.
Visit us to learn more: deepset Website | Haystack Website | GitHub | Linkedin | X deepset (Twitter) | X haystack (Twitter)
Skills Required
- Native German language skills
- Hands-on experience shipping AI applications to production, including RAG, agents, data preprocessing, retrieval, and embeddings
- Experience building trusted relationships with technical and business stakeholders
- Experience designing and running agent evaluations and improving quality using real usage data
- Familiarity with agent frameworks and vector databases
- Strong Python and production engineering practices, including testing, CI/CD, code review, and observability
- Experience operating AI solutions in enterprise production environments, including monitoring, troubleshooting, and incident handling
- Understanding of enterprise integrations, APIs, authentication, security, and compliance
- Awareness of current LLM and agentic-system capabilities and production readiness
- Experience scoping and estimating work for long-running engagements
- Haystack experience
- Forward-deployed or consulting experience on long, embedded engagements
- Basic React and TypeScript frontend skills
- Fine-tuning experience with PEFT or LoRA
What We Do
deepset is an enterprise software vendor that provides developers with the tools to build production-ready Artificial Intelligence (AI) and natural language processing (NLP) systems. As the creator of the open-source Haystack framework and the deepset AI Platform, the company enables organizations to deploy custom AI agents and applications using advanced architectures such as retrieval augmented generation (RAG) and multimodal AI to solve mission-critical challenges.









