Applied AI Engineer

Posted One Month Ago
San Francisco, CA, USA
In-Office
230K-350K Annually
Senior level
Cloud • Software
We're on a mission to help project teams break ground faster.
The Role
Build and own production AI features for permitting workflows, including document extraction, retrieval, agentic systems, evaluation, observability, deployment, and iteration. Define quality standards, improve LLM reliability, make product and architecture decisions, mentor engineers, and work directly with users. The role requires substantial production LLM experience and in-person work four days weekly in the San Francisco Bay Area.
Summary Generated by Built In

About Pulley

Pulley helps the country’s top architects, builders, and retailers speed up every project in their portfolio. With AI-powered permitting intelligence and expert guidance, we eliminate costly delays and bring predictability across the full lifecycle of commercial projects.

Today, permitting is the slowest, most uncertain part of building, spread across 19,000+ jurisdictions with different rules, timelines, and surprises. Pulley gives project teams the clarity and predictability they need to move from planning to opening without delays.

We support rollout programs for brands like J.Crew, Solidcore, and Hibbett Sports, as well as major data center buildouts, EV charging networks, and other commercial projects. Our platform dramatically reduces approval timelines, improves forecasting accuracy, and removes thousands of hours of manual work from design and construction teams.

Founded in 2021, Pulley combines deep permitting expertise with purpose-built AI from people who have created products used by millions. We’re backed by CRV, Susa Ventures, Fifth Wall, and leaders from Plaid, Segment, ServiceTitan, and Procore.

WHAT YOU’LL DO

In this role, you will build the intelligence behind the product that gets stuff built. Permitting runs on messy inputs—scanned plan sets, jurisdiction code, reviewer comments, application forms that differ in every city—and turning that into something fast, structured, and trustworthy is the core technical problem at Pulley. As a senior-level AI engineer, you will:

  • Own AI-powered features end-to-end—from talking to users and defining what “correct” means for a permitting workflow, through prompt and pipeline design, evals, deployment, and iteration in production

  • Turn unstructured permitting documents, city regulations, and jurisdiction workflows into structured, reliable outputs—extraction, classification, retrieval, and agentic workflows over documents that were never designed to be machine-readable

  • Build the evaluation and observability foundation that lets us ship LLM-powered features with confidence: define ground truth, measure quality and regressions, and know when a model change is actually an improvement

  • Build with AI agents as a daily practice—directing, reviewing, and shipping agent-driven work at high velocity while owning the quality bar

  • Make technical and product decisions that have direct impact on our customers and their projects

  • Raise the bar for the engineers around you in how they build with LLMs, through design review, mentorship, and the standards you set in your own work

WHO YOU ARE
  • You thrive in ambiguity—you’d rather define the right problem than execute a spec, and you’re energized rather than paralyzed when the path isn’t laid out

  • You’re product-minded: you care whether the thing you built actually solved the customer’s problem, and you’ll talk to users to find out

  • You’re rigorous about what “working” means—you don’t trust a demo, you trust an eval, and you build the measurement before you build the feature

  • You have strong opinions about quality and velocity and don’t treat them as a tradeoff—you look for the tools, abstractions, and processes that buy both

  • You default to ownership: when something is broken or missing, your instinct is to fix it, not to file it as someone else’s problem

NEED TO HAVE
  • 4+ years of software engineering experience, with a substantial portion building production LLM or ML systems

  • Track record of owning an LLM-powered product surface end-to-end: requirements through production, including the unglamorous parts—data quality, eval design, cost and latency, failure handling

  • Deep hands-on experience with large language models in production—prompting, retrieval-augmented generation, structured extraction, tool use and agentic workflows, and knowing when each is the wrong tool

  • Experience designing evals and otherwise making LLM-powered features reliable in production

  • Real experience building with AI coding agents—not just autocomplete; you’ve shipped work where agents did substantial implementation under your direction

  • Ability to architect durable systems while making pragmatic tradeoffs

  • Based in the San Francisco Bay Area and willing to work in person 4 days a week

NICE TO HAVES
  • Experience with document understanding at scale—OCR, layout-aware parsing, or vision-language models over scanned PDFs, drawings, or forms

  • Experience fine-tuning models or building data pipelines to produce training and eval sets from real-world usage

  • Experience in construction tech, govtech, proptech, or another domain where the hard part is messy real-world documents and processes

  • Experience with modern full-stack development—we use TypeScript, React, and Google Cloud—and an appetite for working in the application code that puts AI features in front of users

  • Startup experience at the stage where you helped build the team, not just the product

  • Experience mentoring engineers or leading technical direction across teams

Skills Required

  • 4+ years of software engineering experience, including substantial experience building production LLM or machine learning systems
  • End-to-end ownership of an LLM-powered product surface from requirements through production
  • Experience with data quality, evaluation design, cost and latency optimization, and failure handling for LLM systems
  • Hands-on production experience with prompting, retrieval-augmented generation, structured extraction, tool use, and agentic workflows
  • Experience designing evaluations and improving the reliability of LLM-powered features in production
  • Experience building and shipping work with AI coding agents beyond autocomplete
  • Ability to architect durable systems while making pragmatic tradeoffs
  • Based in the San Francisco Bay Area and willing to work in person four days per week
  • Experience with document understanding at scale, including OCR, layout-aware parsing, or vision-language models
  • Experience fine-tuning models or building training and evaluation data pipelines from real-world usage
  • Experience in construction technology, government technology, proptech, or similar domains involving complex documents and processes
  • Experience with TypeScript, React, Google Cloud, and modern full-stack development
  • Startup experience helping build a team
  • Experience mentoring engineers or leading technical direction across teams
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
42 Employees

What We Do

Pulley is the leading platform for permitting. Trusted by project teams to deliver the best possible permit outcomes, faster. Submit, track, and respond to comments, verify requirements, and submit with ease, with your whole project team in one place. We’re on a mission to help project teams break ground sooner. Our permitting platform unites project stakeholders in one platform with unlimited users in a model designed for people and teams that build.

Why Work With Us

We are a passionate team building software for the built environment around us. We have an ambitious roadmap to make permitting even faster. And permits are just the start. If that sounds exciting, come build with us!

Gallery

Gallery

Similar Jobs

Drata Logo Drata

Artificial Intelligence Engineer

Security • Software • Cybersecurity • Automation
Hybrid
San Francisco, CA, USA
600 Employees
157K-252K Annually

PwC Logo PwC

Applied AI Health Data System Engineer-Senior Manager

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
65 Locations
370000 Employees
124K-280K Annually

Raydar Logo Raydar

Artificial Intelligence Engineer

Professional Services • Consulting
In-Office
San Francisco, CA, USA
28 Employees
150K-220K Annually

StudyFetch Logo StudyFetch

Staff Engineer

Artificial Intelligence • Edtech • Software
In-Office
Beverly Hills, CA, USA
66 Employees
170K-270K Annually

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
Glendale, Kentucky
55 Employees
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account