The Role
Build and improve AI systems for complex legal workflows. Design evaluations, feedback loops, prompts, tools, and agent infrastructure; investigate failures; and optimize quality, latency, cost, and reliability. Work closely with lawyers and engineers to translate legal judgment into measurable system behavior. Own projects from experimentation and prototyping through production deployment, monitoring, and iteration.
Summary Generated by Built In
About Us
The Role
What You Will Do
Who We Are Looking For
Compensation and Structure
Why Blackletter
Blackletter is reinventing legal services from first principles. We pair frontier automation with top-tier lawyers to deliver elite legal services with fast turnaround, predictable pricing, and a better experience for clients and the lawyers doing the work.
We’re serving a growing roster of clients across venture financing, commercial, corporate, and employment, and we’re backed by leading venture investors. Our founding team brings experience from frontier AI labs, leading law firms, and top law schools in North America.
We’re a small team making our earliest hires. You’ll have the opportunity to shape not only our company, but how legal work gets done.
We’re looking for a Machine Learning Engineer to own and improve the intelligence behind our legal AI platform. You’ll build systems that help lawyers handle complex, real-world legal work, and develop the evaluations and feedback loops that make those systems better over time.
This is an applied, product-focused role. You’ll work across models, prompts, tools, agent infrastructure, and context to improve the quality and reliability of legal work. You’ll work directly with lawyers to understand what good looks like, identify where the system falls short, and turn those insights into measurable improvements.
The role has a high degree of ownership. You’ll help define the problems worth solving, make thoughtful decisions with incomplete information, and take work from experimentation through production and iteration.
• Design, build, and improve AI systems that support complex legal workflows, from understanding a matter through producing and reviewing legal work.
• Develop evaluations that measure real-world outcomes, including the quality, precision, and usefulness of the system’s work, not just performance on isolated benchmarks.
• Improve agent behavior through model selection, prompting, context engineering, tool design, and changes to the surrounding harness.
• Build feedback loops that use lawyer review and final work product to identify failures, prioritize improvements, and measure progress.
• Work directly with lawyers and engineers to translate nuanced legal judgment into testable system behavior.
• Investigate failure modes, design experiments, and make pragmatic tradeoffs between quality, latency, cost, and reliability.
• Own work end to end, from defining an approach and building prototypes to shipping, monitoring, and improving production systems.
• Stay current with advances in models and AI systems, and apply them where they meaningfully improve outcomes.
• Experience building and improving machine learning or AI systems used in real-world products.
• Strong understanding of modern language models and the factors that affect their behavior, quality, and reliability.
• Experience designing evaluations, analyzing failures, and using results to improve an AI system.
• Strong programming skills and the ability to build, test, and ship production-quality software.
• Comfort working through ambiguous problems, designing experiments, and reasoning from evidence.
• High agency and ownership: a track record of identifying problems, driving solutions, and delivering useful outcomes.
• Clear communication and the ability to work closely with people outside engineering.
• Product judgment and curiosity about how users actually experience your work.
Competitive salary plus equity. Compensation is commensurate with experience. This role is remote within the United States or Canada; Toronto is preferred.
Your users are your colleagues. You’ll see how your work is used, hear where it falls short, and have the opportunity to improve it directly. As part of a small team, you’ll help shape the product and the systems behind it, with ownership over work that changes how we deliver legal services.
We encourage you to apply even if your experience doesn’t match every item above. Blackletter welcomes applicants from all backgrounds. For recruitment accommodations, contact [email protected].
Skills Required
- Experience building and improving machine learning or AI systems used in real-world products.
- Strong understanding of modern language models and factors affecting their behavior, quality, and reliability.
- Experience designing evaluations, analyzing failures, and using results to improve AI systems.
- Strong programming skills and ability to build, test, and ship production-quality software.
- Ability to work through ambiguous problems, design experiments, and reason from evidence.
- High agency and ownership, with a track record of identifying problems, driving solutions, and delivering useful outcomes.
- Clear communication and ability to work closely with people outside engineering.
- Product judgment and curiosity about how users experience the work.
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Blackletter is a technology-enabled law firm that rethinks legal services around client needs, combining automation with human judgment. It aims to make legal work efficient, intuitive, transparent, and outcome-focused rather than driven by billable hours or manufactured complexity. The firm supports clients with venture financing, employment, commercial contract, and corporate legal matters, delivering tailored advice on clients’ timelines and priorities.




.jpg)




