Role Summary:
As a Senior MLOps Engineer at Filevine, you'll sit at the intersection of machine learning, platform infrastructure, and product velocity. You'll build and own the systems that make Filevine's AI capabilities faster to develop, safer to ship, and easier to trust, at scale.
You will be responsible for the full stack of ML infrastructure: evals, observability, model serving, annotation tooling, and the prompt platform that lets every team move with confidence.
Responsibilities
Setup and maintain LLM observability frameworks/tools
Help improve data annotation tooling
Ensure stability of LLM calls (rate limits, provisioned throughput, backups, …)
Help to drive security review processes for AI vendors and providers
LLM cost optimization recommendations (caching, batching, identification of workflow parts causing high costs, etc.)
Hosting finetuned/open weight machine learning models
Helping with LLM evaluations (tooling/framework) with the current main focus on agentic evals
Platform tooling for enabling non-technical people (e.g. PMs) to iterate on prompts
Qualifications
5+ years building and operating software systems end-to-end
Hands-on experience with ML infrastructure: model serving, training pipelines, or LLM integrations in production
Strong understanding of cloud infrastructure and distributed systems (primarily AWS)
Familiarity with observability tooling and cost management for LLM workloads
Experience with or openness to: Python, Kubernetes, Terraform
Thrives in a remote-first, async environment: clear communicator, high ownership, low ego
Bonus: experience with eval frameworks, annotation tooling, or prompt management platforms
Skills Required
- 5+ years building and operating software systems end-to-end
- Hands-on experience with ML infrastructure: model serving, training pipelines, or LLM integrations in production
- Strong understanding of cloud infrastructure and distributed systems (primarily AWS)
- Familiarity with observability tooling and cost management for LLM workloads
- Experience with or openness to Python, Kubernetes, Terraform
- Ability to communicate clearly and work with high ownership in a remote-first, asynchronous environment
- Experience hosting fine-tuned or open-weight machine learning models
- Open to working as an independent contractor and responsible for own taxes and compliance
- Must reside in or be willing to relocate to Czechia or Slovakia and have legal right to work there
- Experience with eval frameworks, annotation tooling, or prompt management platforms
Filevine Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Filevine and has not been reviewed or approved by Filevine.
-
Healthcare Strength — Health coverage is described as covering the major bases (medical, dental, vision) and is often framed as decent quality. In some cases, premiums and copays are portrayed as relatively favorable, suggesting tangible value from the plans.
-
Parental & Family Support — Paid parental leave is positioned as a standard, clearly offered benefit. The presence of parental leave alongside disability coverage signals baseline family-support provisions typical of growth-stage tech employers.
-
Fair & Transparent Compensation — Compensation is sometimes framed as fair or reasonable relative to role expectations, with technical roles in particular appearing closer to market-aligned ranges. This creates pockets where pay is perceived as competitive even if not consistently top-of-market across the company.
Filevine Insights
What We Do
Filevine is case management software built for and inspired by real attorneys. As a fully-featured suite of tools, it comes ready to manage every part of a moving case. Assign tasks, upload files or images, monitor staff productivity, and communicate with your client directly from within their case file. Our software is built on the truth that every law firm functions differently. That’s why Filevine is so customizable. Build new case-type templates, design automatic workflows, and receive customized reports on a schedule that fits your needs. Accessing your information is never a problem, because Filevine is hosted on The Cloud. To ensure security, your law firm’s data is protected through state-of-the-art encryption on redundant servers. All you need to get started is an internet connection and your favorite web browser. Learn more at filevine.com.
Gallery
