Software Engineer, Applied AI

Posted 5 Days Ago
New York, NY, USA
In-Office
175K-290K Annually
Mid level
Information Technology • Professional Services • Software
The Role
As a Software Engineer, Applied AI, you'll design and improve systems for agents, conduct evaluations, and influence product decisions based on real usage data.
Summary Generated by Built In
Why Auctor

Auctor is building the AI layer for professional services and software implementation. Think of us as the brain behind the best solution engineers, forward-deployed engineers, and onboarding teams—automating the documentation, the discovery, and the decision-making that powers $400B+ in services work. We're going after one of the biggest software categories of the decade.

Role Overview

As a Software Engineer, Applied AI at Auctor, you will design, build, and improve the core systems behind our agents in production.

This role sits at the boundary of engineering and empirical research. You will work across retrieval, document understanding, tool use, context management, prompting, and orchestration. Some weeks you will be shipping new capabilities. Some weeks you will be mining production traces, designing evals, and figuring out which part of the system is actually failing.

We are not looking for someone to glue an API onto a product and call it AI. We are looking for someone who wants to build real agent systems, understand how they behave in the wild, and use that understanding to make bold product and architecture decisions.

This role is based in New York, NY, in person 5 days per week.

What You'll Do
  • Build and improve the core systems behind our agents across retrieval, tool use, document understanding, memory, and orchestration

  • Design evals and experiments that help us understand agent quality in production

  • Turn traces, failures, and user behavior into concrete product and architecture decisions

  • Work closely with operations, GTM, and deployed teams to understand real workflows and where agents break down

  • Evaluate models, prompts, and system designs across real enterprise tasks

  • Own the loop from idea -> implementation -> measurement -> iteration

What We're Looking For
  • Strong engineering fundamentals and the ability to ship production systems

  • Fluency in Python

  • Experience building or working on LLM-powered products, agent systems, or adjacent applied AI systems

  • An empirical mindset — you reach for logs, traces, experiments, and real usage before guessing

  • Strong systems taste — you understand that retrieval, prompting, memory, tools, and UX interact

  • High ownership and comfort working in ambiguity

  • Strong opinions about what makes agent systems actually work

Strong Candidates May Also Have
  • Experience with retrieval, search, or ranking systems

  • Experience designing evals, benchmarks, or feedback loops for LLM systems

  • Experience building internal tools, workflow products, or operator-facing systems

  • Experience in startups or other high-ownership environments

Example Projects

This is a new field. We care much more about what you have built than whether your background fits a standard template.

Projects that would make us excited include:

  • Designing and shipping an agent harness that materially improved performance on a real task

  • Building an eval or benchmark that changed what your team decided to build next

  • Designing tool interfaces, memory systems, or retrieval systems for an LLM-powered product

  • Building a production workflow around language models that users actually depended on

  • Running a careful experiment on prompting, model routing, or orchestration and using it to drive a product decision

If you apply, we would love to see one thing you built with LLMs or agents. It does not need to be perfect or flashy. We mostly want to understand how you think, what you owned, what you learned, and what tradeoffs you made.

Compensation

$175,000-$290,000 base salary, plus equity.

Benefits
  • Early-stage equity

  • Competitive, top-of-market salary

  • Catered lunch and dinners

Top Skills

Agent Systems
AI
Llms
Python
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, New York
21 Employees
Year Founded: 2025

What We Do

Auctor brings alignment and intelligence to software implementation, enabling every project to deliver its intended value with clarity and precision.

Similar Jobs

Invisible Technologies Logo Invisible Technologies

Staff Software Engineer

Artificial Intelligence • Information Technology • Machine Learning • Professional Services • Software • Analytics • Consulting
Easy Apply
Hybrid
New York, NY, USA
370 Employees
209K-307K Annually

Ascertain Logo Ascertain

Software Engineer

Angel or VC Firm • Financial Services
In-Office
New York City, NY, USA
28 Employees
140K-175K Annually

Ironclad Logo Ironclad

Staff Software Engineer

Information Technology • Consulting
Remote or Hybrid
4 Locations
543 Employees
240K-295K Annually
Hybrid
2 Locations
48 Employees
175K-275K Annually

Similar Companies Hiring

Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account