The Role
Design, develop, and optimize LLM-powered features and agentic systems, ensuring reliability, performance, and scalability. Collaborate with cross-functional teams and contribute to overall technical strategy.
Summary Generated by Built In
About Modjo
At Modjo, we’re on a mission to free salespeople to rediscover the art of selling.
The sales world is broken: even top performers spend more time documenting than selling.
We exist to change that.
By removing admin noise and empowering teams with AI agents, Modjo helps sellers focus on what truly matters: building trust, driving strategy, and closing deals.
Our AI doesn’t replace the human touch; it amplifies it. We build for people who want to perform, progress, and win.
With 70+ people and strong ambitions for our next stage of growth, we’re scaling fast across Europe and strengthening our AI team to move even faster in building our AI product capabilities.
About the role
Play a central role in building, maintaining, and scaling the LLM-powered and agentic features that drive Modjo’s product.
Your primary mission will be to design, develop, and evolve our agentic system, which is becoming the backbone of the entire product. You will work across model orchestration, tool execution, evaluation, reliability, and performance—ensuring these systems operate at production scale and deliver consistently high-quality results.
Experience with speech technologies and our self-hosted transcription pipeline is a plus but not a core requirement.
Responsibilities
Design, build, and optimize the agentic stack that powers both conversational and autonomous multi-step agents, ensuring reliability, scalability, and low-latency performance in production.
Architect, productionize, and maintain LLM-powered features end-to-end, including model orchestration, routing, monitoring, logging, and evaluation.
Develop and improve ML infrastructure, including observability, load balancing, scaling patterns, and deployment workflows for agentic and LLM-based systems.
Construct robust datasets and evaluation pipelines for both deterministic systems (ASR) and non-deterministic systems (LLMs and agents), enabling continuous quality improvements.
Collaborate with Software Engineers to build scalable, observable, and automated infrastructure supporting ML services across the platform.
Work closely with Product Managers to assess feasibility, shape feature specs, and ensure timely and reliable delivery of ML- and agent-driven capabilities.
Contribute to technical strategy, model/tool selection, architectural decisions, and long-term roadmap for Modjo’s agentic platform.
Stay ahead of the curve on new research, frameworks, and open-source developments in LLMs, agentic systems, and evaluation methodologies.
Desired Profile
3+ years of experience in ML Engineering, with a strong track record of deploying and maintaining ML or LLM systems in production—including monitoring, scaling, and performance optimization.
Deep familiarity with LLM integration, including model orchestration, prompt/graph design, evaluation methods, reliability patterns, and cost/performance tradeoffs.
Strong experience with production-grade ML infrastructure, including CI/CD, observability, monitoring, containerization, load balancing, and cloud deployment.
Direct experience with agentic systems—such as planning, tool execution, workflows, memory architectures, LangChain/LangGraph, or equivalent frameworks.
Experience with Vector and Graph Databases is a plus.
Experience with MCP (Model Context Protocol), DeepEval, FastAPI, Uvicorn, or production API development is a plus.
Experience with NLP technologies (ASR, diarization, embeddings, audio ML) is a plus.
Comfortable owning projects end-to-end in a fast-paced, highly collaborative engineering environment.
Our Stack
Cloud & Infra: AWS, Langfuse, Datadog
Agentic & LLM Tools: LangChain, LangGraph
LLMs: OpenAI GPT, Anthropic Claude, Google Gemini
Speech & Audio: OpenAI Whisper, NVIDIA NeMo, pyannote.audio
Data & Storage: Postgres, MongoDB, Weaviate, Neo4j
Top Skills
Anthropic Claude
AWS
Ci/Cd
Containerization
Google Gemini
Langchain
Langgraph
MongoDB
Neo4J
Nvidia Nemo
Openai Gpt
Openai Whisper
Postgres
Pyannote.Audio
Weaviate
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Modjo's mission is to revolutionize the way sales organizations work and become the leader in Conversation Intelligence in Europe. Modjo's platform helps companies improve business strategy and execution by detecting key information in all customer/prospect interactions.
This allows companies to gain insights into what is happening on the field, make the right decisions and achieve better results.
Modjo is trusted by +400 Europeans companies, among them Bouygues Telecom, Doctolib, WorkMotion, PayFit.
