LLM Application Engineer

Posted 6 Days Ago
Be an Early Applicant
Hiring Remotely in Germany
Remote
Mid level
Artificial Intelligence • Fintech • Software • Financial Services
The Role
Build and ship LLM-powered applications and agent workflows. Design reasoning, memory, tool use, and orchestration systems; integrate models with services; develop prompting and evaluation frameworks; debug and optimize AI behavior for reliability, latency, cost, and user-facing product quality.
Summary Generated by Built In

About A1

There are over 5 billion users using basic applications today such email, notes, tasks that are not AI-native. Our mission is to build a proactive smart assistant for everyday users to bring intelligence to conversations, errands, organising and workflows, with minimal prompting.

Our product focuses on achieving high reliability for long-running workflows, persistent context, and real-world task completion. The system must handle multi-step reasoning, interact with external tools, and remain reliable despite non-deterministic model behavior. Our objective is to help users complete tasks daily enjoyable with over ~90%* reduced time.

About the Role

As an LLM Application Engineer, you will build the intelligence layer that powers A1's AI experiences.

You will work at the intersection of LLMs, software engineering, and product - designing agent workflows, improving model behaviour, and turning AI capabilities into reliable user experiences.

You will own problems end-to-end, from understanding user needs, designing Agentic workflows, integrating models and tools, building evaluation system and continuously improving AI behaviour in production.

Focus

  • Build and ship LLM-powered applications and AI agent workflows

  • Design systems for reasoning, planning, memory, tool uuse and multi-step execution

  • Build reliable orchestration pipelines that turn probabilistic model outputs into predictable, observable, and safe actions

  • Integrate LLMs with APIs, databases, search, internal services, and external tools.

  • Develop prompting, context engineering, structured outputs, tool-calling, and other techniques to improve model behaviour

  • Build evaluation frameworks and datasets to measure AI quality, reliability, and regressions

  • Debug AI systems across the entire stack—from model behaviour and prompts to orchestration, backend services, and product UX

  • Optimise AI systems for quality, latency, and cost

  • Work closely with product and engineering teams to turn ambiguous product problems into working AI solutions

  • Establish production practices for observability, tracing, experimentation, evaluation, and continuous improvement

Tech Stack

  • Python

  • LLM APIs and model providers, including OpenAI-compatible APIs and open-weight models

  • Agent frameworks and orchestration systems

  • Vector databases and retrieval systems

  • Backend services, APIs, and distributed systems

  • PyTorch / JAX

Ideal Experience

  • Strong software engineering fundamentals with experience building AI-powered applications

  • Hands-on experience with LLMs, generative AI, or agent-based systems

  • Experience designing prompts, workflows, evaluations, or AI behaviour

  • Ability to write clean, production-quality code

  • Comfortable working across abstraction layers (model → system → product)

  • Strong problem-solving skills in ambiguous, fast-moving environments

  • Bias toward shipping, iteration, and continuous improvement

Outcomes

  • AI features reach production quickly and deliver measurable user impact

  • LLM-powered workflows are reliable, scalable, observable, and maintainable

  • AI quality improves through systematic evaluation, experimentation, and iteration

  • AI workflows become increasingly predictable, efficient, and cost-effective

  • Complex AI capabilities are translated into simple, intuitive user experiences

Skills Required

  • Strong software engineering fundamentals and ability to write production-quality code
  • Hands-on experience with LLMs, generative AI, or agent-based systems
  • Experience designing prompts, agent workflows, evaluations, or AI behavior
  • Experience integrating LLMs with APIs, databases, search, and external tools
  • Familiarity with vector databases and retrieval systems
  • Experience with PyTorch or JAX
  • Experience building orchestration pipelines and agent frameworks for multi-step execution
  • Ability to debug AI systems across model, orchestration, backend services, and product UX
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Petaling Jaya
253 Employees
Year Founded: 2019

What We Do

Our mission is to develop technology based solutions to improve financial inclusion. We develop new & innovative platforms & services globally. For example, we are the first platform to simplify and digitise comprehensive life and medical insurance, supported by AI agent. BJAK is the largest insurance platform in Southeast Asia. If you enjoy building cutting edge platform-ecosystems that gives equal access to financial services to everyone at scale, join us

Similar Jobs

Atlassian Logo Atlassian

Regional Sales Director, DACH (German speaking)

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
Munich, Bayern, DEU
11000 Employees

Zscaler Logo Zscaler

Senior Sales Engineer

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
Germany
8697 Employees
87K-124K Annually

Collectors Logo Collectors

Project Manager

Consumer Web • eCommerce • Machine Learning • Software • Sports • Analytics
Remote or Hybrid
Frankfurt am Main, Hessen, DEU
2246 Employees
107K-141K Annually

Atlassian Logo Atlassian

Customer Success Manager

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Remote
Germany
11000 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account