ML Engineer

Posted 3 Days Ago
New York City, NY, USA
In-Office
150K-300K Annually
Senior level
Software • Design
The Role
Build and own an end-to-end drawing-parsing pipeline: ingest PDFs/CAD, perform layout analysis, detection, OCR, segmentation, extract metadata and schedules, design embedding strategies, integrate into a knowledge store, and build evaluation/ground-truth systems while partnering with engineering staff and the CTO to productize models for production use.
Summary Generated by Built In

About Eagle

We’re on a mission to radically transform the way we design and construct our built environment.

Backed by Lightspeed Venture Partners, Eagle acquires and transforms civil, structural, and MEP engineering firms with applied AI. We’re an AI laboratory dedicated to providing engineers with the tools they need to solve the world’s hardest infrastructure, energy, and climate problems.

By arming designers with frontier technology, our ambition is to build the most valuable, talent-dense engineering firm in the United States.

The opportunity

Our core thesis: 85% of what engineers do today is theoretically automatable, yet less than 5% has actually been touched by AI. That gap is the largest of any profession. Our plan is to close it by acquiring engineering firms, building purpose-built tools for their staff, and compounding that proprietary intelligence across acquisitions.

The richest, most defensible data in this industry lives in 2D drawings—drawings sets, details, sections, schedules—and only a small fraction of it is machine-readable today. As a Machine Learning Engineer, you'll own the problem of turning that visual information into structured, embedded, queryable intelligence. You'll work directly with the CTO, and the work you do becomes the foundation the rest of the platform compounds on top of. You get a front-row seat to building a company from zero—engaging with architecture decisions, firm acquisitions, and product strategy—on a problem domain that's barely been touched by AI.

What you'll do

  • Embed with staff at engineering firms alongside the founders; get your hands on real drawing sets and learn how engineers actually read, mark up, and reuse them

  • Own the drawing-parsing pipeline end-to-end—ingestion of PDF and CAD exports, layout analysis, symbol and entity detection, OCR on dimensions and notes, and extraction of schedules and title-block metadata from noisy, inconsistent real-world sheets

  • Design the embedding strategy for drawings: how to represent a sheet, a detail, or a region as a vector so it can be searched, compared, and reasoned over—adapting or fine-tuning vision and multimodal encoders as needed

  • Integrate extracted structure and embeddings into our knowledge store so it gets richer and more valuable with every drawing and every acquisition

  • Build the evaluation harness this all depends on—ground-truth sets, accuracy metrics, and a tight loop for measuring whether the models actually work on messy production data

  • Collaborate directly with the CTO on technical direction and what we'll build next

What we look for

  • Deep computer vision and VLM experience, ideally on documents, diagrams, or drawings rather than only natural images—detection, segmentation, layout analysis, OCR

  • Wants to obsess over this high-leverage data problem: pulling signal out of drawings that were never designed to be parsed by a machine

  • Understands embeddings and representation learning—how to build, fine-tune, and evaluate an embedding space, not just call an API

  • Ships to production and owns the result; this is an engineering role, not a research-only one

  • Has the rigor to be honest about model quality on real data, and to build the evals that keep everyone honest

  • Has a deep curiosity for how things work (an organization, a workflow, a market)

  • Isn't afraid to expose their ignorance and is constantly asking why

  • Has the poise and communication skills to earn trust with people who've never worked with a tech company before

  • Is willing to get on a plane with us

  • Is not above any task: up to label the data yourself, write the annotation tooling, or hand-tune a heuristic when the model isn't ready yet

Compensation

  • Competitive cash compensation ($150K–$300K depending on experience)

  • Founding equity, scaled to scope

  • Full healthcare benefits

  • In-person office in NYC

Skills Required

  • Deep computer vision and vision-language model experience on documents, diagrams, or drawings (detection, segmentation, layout analysis, OCR)
  • Experience ingesting and parsing PDFs and CAD exports and extracting noisy real-world sheet data (title blocks, schedules, dimensions, notes)
  • Knowledge of embeddings and representation learning; ability to build, fine-tune, and evaluate embedding spaces
  • Experience shipping ML systems to production and owning results (engineering, not research-only)
  • Ability to build evaluation harnesses: ground-truth sets, accuracy metrics, and production measurement loops
  • Willingness to embed with engineering firm staff and travel (in-person work and occasional flights)
  • Strong communication and interpersonal skills to earn trust with non-technical stakeholders
  • Willingness to perform hands-on tasks including labeling data, writing annotation tooling, or hand-tuning heuristics
  • Curiosity about workflows, systems, and product direction; collaborate on technical decisions with the CTO
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
5 Employees

What We Do

Revitalizing American Engineering. Eagle is partnering with AEC owners to create the next-gen design firm.

Similar Jobs

Snap Inc. Logo Snap Inc.

Machine Learning Engineer

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
2 Locations
5000 Employees
178K-313K Annually

Chime Logo Chime

Machine Learning Engineer

Fintech • Machine Learning • Mobile • Security • Software
Easy Apply
Hybrid
4 Locations
1500 Employees
172K-238K Annually

Capital One Logo Capital One

Machine Learning Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
2 Locations
55000 Employees
136K-169K Annually

Snap Inc. Logo Snap Inc.

Machine Learning Engineer

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
6 Locations
5000 Employees
235K-414K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account