AI Product Engineer (Backend/LLM)

Posted Yesterday
Be an Early Applicant
Prague, CZE
Hybrid
Senior level
Legal Tech • Software
Filevine is a top-rated cloud-based case management solution for small and midsize legal firms and legal professionals.
The Role
Own AI-powered product features from technical design through production rollout, monitoring, and maintenance. Design APIs, services, data pipelines, and workflows integrating LLMs and machine-learning capabilities. Build reliable, secure, scalable systems using retrieval, structured generation, tool use, human review, and fallback patterns. Establish quality metrics and feedback loops while collaborating with ML engineers, software engineers, product teams, and legal domain experts.
Summary Generated by Built In
Filevine is a Legal AI company delivering Legal Operating Intelligence for the future of legal work. Grounded in a singular system of truth, Filevine brings together data, documents, workflows, and teams into one unified platform—where modern legal work happens with clarity and consistency.

Powered by LOIS, the Legal Operating Intelligence System, Filevine connects context across every matter to transform legal operations from reactive to proactive. LOIS reads, understands, and reasons across your data to surface insight, automate complexity, and give professionals the clarity and confidence to see more, know more, and do more. Fueled by a team of exceptional collaborators and innovators, Filevine’s rapid growth has earned AI awards and recognition from Deloitte and Inc. as one of the most innovative and fastest-growing technology companies in the country.

We're a team of driven, enthusiastic problem solvers with strong backgrounds in machine learning, engineering, product management, legal and operations, on a mission to help attorneys resolve cases faster, for better outcomes. We're combining cutting edge models, approaches, and technologies with precise human in loop and data annotation processes. After achieving state-of-the-art results in automatic transcription, we're now pushing the boundaries in advanced NLP problems such as summarization of medical records and legal depositions, or automations of other legal workflows. We have many challenges to solve, which is exactly where you'll start if you join us.

As an AI Product Engineer, you will work closely with Machine learning Engineers, turning AI capabilities into dependable product features. You will own the systems and workflows that make AI-powered customer experiences reliable, secure, measurable, and maintainable.

 

Key responsibilities

  • Own AI-powered features from technical design and implementation through rollout, monitoring, and maintenance

  • Design services, APIs, data pipelines, and workflows that integrate LLMs and other machine-learning capabilities into Filevine products

  • Turn prototypes into production systems weith appropriate reliability, scalability, security, latency, and cost

  • Implement patterns such as retrieval and grounding, structured generation, tool use, human review, and graceful fallbacks

  • Establish quality metrics, tracing, monitoring, and feedback loops for AI-powered features

  • Collaborate with ML Engineers, Software Engineers, Product, and domain experts to turn customer problems into practical solutions

  • Make pragmatic technical decisions and communicate their context and tradeoffs clearly

Who are we looking for

  • At least 5 years of professional software-engineering experience, including end-to-end ownership of production systems

  • Experience designing, delivering, and operating AI-powered product functionality in production

  • Strong software-engineering foundations, including API design, data modeling, distributed systems, testing, and failure handling

  • Strong experience with Python or a comparable language and the ability to work in a Python-first environment

  • Practical understanding of production LLM systems, including retrieval, context management, structured outputs, tool calling, evaluations, guardrails, and common failure modes

  • Experience with asynchronous workflows, data-processing pipelines, background jobs, or event-driven systems

  • Experience deploying and operating cloud services; our stack includes Python, TypeScript, Temporal, Kubernetes, and AWS

  • Ability to evaluate tradeoffs among quality, reliability, latency, user experience, complexity, and cost

  • Good communication and writing skills in English, team spirit, and an independent problem-solving mindset

  • Ability to meet periodically in our Prague or Bratislava office, as we value in-person collaboration

This opportunity is for independent contractors and is not intended to establish an employment relationship. Contractors are responsible for their own taxes and compliance with applicable laws in their jurisdiction.

This role is open exclusively to candidates currently residing in, or willing to relocate to, Czechia or Slovakia with the legal right to work in these countries. Unfortunately, we are unable to consider applications from candidates based outside of these locations due to operational and regulatory requirements

Privacy Policy Notice
Filevine will handle your personal information according to what’s outlined in our Privacy Policy.

Skills Required

  • At least 5 years of professional software engineering experience
  • End-to-end ownership of production systems
  • Experience designing, delivering, and operating AI-powered product functionality in production
  • Strong foundations in API design, data modeling, distributed systems, testing, and failure handling
  • Strong experience with Python or a comparable programming language
  • Practical understanding of production LLM systems, including retrieval, context management, structured outputs, tool calling, evaluations, guardrails, and failure modes
  • Experience with asynchronous workflows, data-processing pipelines, background jobs, or event-driven systems
  • Experience deploying and operating cloud services
  • Ability to work with Python, TypeScript, Temporal, Kubernetes, and AWS
  • Ability to evaluate tradeoffs among quality, reliability, latency, user experience, complexity, and cost
  • Good English communication and writing skills
  • Ability to work independently and collaborate effectively in a team
  • Ability to meet periodically in the Prague or Bratislava office
  • Currently reside in, or be willing to relocate to, Czechia or Slovakia with legal right to work there

Filevine Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Filevine and has not been reviewed or approved by Filevine.

  • Healthcare Strength Health coverage is described as covering the major bases (medical, dental, vision) and is often framed as decent quality. In some cases, premiums and copays are portrayed as relatively favorable, suggesting tangible value from the plans.
  • Parental & Family Support Paid parental leave is positioned as a standard, clearly offered benefit. The presence of parental leave alongside disability coverage signals baseline family-support provisions typical of growth-stage tech employers.
  • Fair & Transparent Compensation Compensation is sometimes framed as fair or reasonable relative to role expectations, with technical roles in particular appearing closer to market-aligned ranges. This creates pockets where pay is perceived as competitive even if not consistently top-of-market across the company.

Filevine Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Sugar House, UT
450 Employees
Year Founded: 2015

What We Do

Filevine is case management software built for and inspired by real attorneys. As a fully-featured suite of tools, it comes ready to manage every part of a moving case. Assign tasks, upload files or images, monitor staff productivity, and communicate with your client directly from within their case file. Our software is built on the truth that every law firm functions differently. That’s why Filevine is so customizable. Build new case-type templates, design automatic workflows, and receive customized reports on a schedule that fits your needs. Accessing your information is never a problem, because Filevine is hosted on The Cloud. To ensure security, your law firm’s data is protected through state-of-the-art encryption on redundant servers. All you need to get started is an internet connection and your favorite web browser. Learn more at filevine.com.

Gallery

Gallery

Similar Jobs

Mondelēz International Logo Mondelēz International

Program Manager

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
9 Locations
90000 Employees
4K-4K Annually

Pfizer Logo Pfizer

Quality Assurance Manager

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
28 Locations
121990 Employees

Mondelēz International Logo Mondelēz International

Change Manager o9 MEU, Demand Planning

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
9 Locations
90000 Employees

Pricefx Logo Pricefx

Support Engineer

Artificial Intelligence • Cloud • Enterprise Web • Information Technology • Software • Analytics • Business Intelligence
Remote or Hybrid
Czech Republic
400 Employees
810K-1M Annually

Similar Companies Hiring

Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account