LLM Application Engineer

Posted 4 Days Ago
5 Locations
Remote
Senior level
Artificial Intelligence • Digital Media • Information Technology • Software
The Role
Design, ship, and maintain production LLM pipelines for extracting and classifying data from emails, HTML, PDFs, and images. Build multimodal prompts, structured outputs, evaluation harnesses, quality gates, retries, and reliable asynchronous processing. Optimize model costs and latency, collaborate with product, mobile, and QA teams, and document architectures and runbooks. The role requires strong Gemini expertise, Python serverless cloud experience, production LLM delivery, and familiarity with classification, taxonomy, and document-processing systems.
Summary Generated by Built In

We're hiring a mid-senior LLM Application Engineer on a remote monthly retainer to design, ship, and harden production AI pipelines for client products at Bolder Apps. You'll own structured extraction and classification systems that turn messy real-world inputs (email, HTML, PDFs, images) into reliable product data, with measurable quality gates, evals, and cost control. You'll work on Firebase / GCP-style backends with product, mobile, and QA. We want someone who has shipped LLM apps for real users, not demos. You should be strong across modern LLMs and especially fluent with Google Gemini (multimodal prompts, structured outputs, failure modes, and cost/latency tradeoffs), with solid experience on other major providers too. If you can hit hard quality targets, keep dollars-per-run honest, and leave runbooks another engineer can pick up, we want to talk.

About Us

Bolder Apps is a product development studio that partners with US-based startups and established companies to build and scale innovative digital products. We specialize in AI-powered development, full-cycle product creation, and engineering team augmentation. Our mission is simple: build bolder, faster, and smarter.

Our Culture & Values (read before applying)

We move fast. We take ownership. We work with AI, not against it. And we expect everyone to bring ideas, not wait for instructions.
There are no daily checklists, no micromanagement, and no corporate politics. Instead, you'll have autonomy, trust, and a team that's always ready to help you grow. At Bolder Apps, impact matters more than titles, and curiosity matters more than seniority.
If you want a place where you can level up fast and actually see your work making a difference - welcome aboard.


Requirements

Responsibilities

  • Own production LLM pipelines end to end: ingestion, multimodal model calls, structured records, and storage, including confidence flags, retries, and idempotent rescans
  • Design prompt and schema strategies (including schema-aligned or constrained outputs) so results are consistent and product-ready
  • Build classification and filtering layers on top of extraction (taxonomy mapping, demographic or audience filters, deduplication, and related cleanup logic)
  • Define and run evaluation harnesses (golden sets, regression suites, online metrics) so quality does not regress when prompts, models, or parsers change
  • Hit and report against hard quality targets (precision-style gates for completeness, duplicates, incorrect inclusions, image presence, and similar product SLAs)
  • Optimize token usage, model tiering, caching, and batching to keep dollars-per-run and latency under control
  • Harden reliability for long-running async jobs (timeouts, partial recovery, memory limits, safe production deploys)
  • Partner with Flutter / mobile and QA on field contracts, review queues, and incident debugging
  • Document architecture and runbooks so ownership is shared, not a single point of failure
  • Stay current on Gemini and peer LLM APIs; recommend when to swap models, add fallbacks (e.g. document AI), or tighten schemas
  • Shipped LLM applications in production (not demos only): prompts, structured outputs, retries, observability, and real failure handling
  • Strong hands-on experience with Google Gemini, including multimodal (text + image / document-style) workflows and structured extraction
  • Practical experience with at least one other major LLM stack (OpenAI, Anthropic, or similar) and good judgment on when to use which
  • Structured extraction from messy inputs: HTML, PDFs, images, and mixed email-like content
  • Classification / taxonomy systems on top of LLM outputs
  • Evaluation discipline: offline evals, regression suites, and production quality metrics tied to clear acceptance criteria
  • Cost and latency awareness: token budgeting, cheaper tiers, caching, batching; can explain dollars-per-run tradeoffs to a PM
  • Python backend experience on serverless cloud (Cloud Functions or equivalent) and document stores (e.g. Firestore) or similar GCP patterns
  • English at C1 or above for client-adjacent debugging with a PM
  • US hours overlap through roughly 5 PM EST when live coordination is needed
  • Ownership habits: honest estimates, early blockers, finished releases

Nice to have

  • Schema-aligned LLM frameworks (BAML, Instructor, Outlines, or similar)
  • Google Document AI or other OCR / document intelligence as a fallback path
  • Gmail API / OAuth products and restricted-scope compliance familiarity
  • Computer vision for product-image quality checks
  • Firebase + GCP ops (secrets, regions, schedulers, cost monitoring)
  • Building eval corpora from real production data and iterating until contractual SLAs pass
  • Agency or multi-client studio experience

Benefits
  • Fully remote and async-friendly, with required overlap through ~5 PM EST when client or release coordination needs it
  • Monthly retainer structure with recurring AI pipeline work for engineers who keep production quality and cost honest
  • Real autonomy over how you structure prompts, schemas, evals, and deploys. We do not hand you a rigid playbook
  • Direct line to PMs, mobile engineers, and decision-makers
  • Tooling budget for the LLM and cloud tools you need to move fast
  • A peer network of product-minded builders across overlapping client projects

Skills Required

  • Production experience shipping LLM applications, including prompts, structured outputs, retries, observability, and failure handling
  • Strong hands-on Google Gemini experience, including multimodal text, image, document workflows, and structured extraction
  • Experience with at least one other major LLM stack, such as OpenAI or Anthropic
  • Experience extracting structured data from HTML, PDFs, images, and mixed email content
  • Experience building classification and taxonomy systems on top of LLM outputs
  • Experience with offline evaluations, regression suites, and production quality metrics tied to acceptance criteria
  • Understanding of token budgeting, model tiering, caching, batching, cost, and latency optimization
  • Python backend experience on serverless cloud platforms such as Cloud Functions, plus document stores such as Firestore or similar GCP patterns
  • English proficiency at C1 level or above
  • Availability for US-hours overlap through approximately 5 PM EST when coordination is needed
  • Ownership habits including honest estimates, early blocker communication, and completing releases
  • Experience with schema-aligned LLM frameworks such as BAML, Instructor, or Outlines
  • Experience with Google Document AI or other OCR and document-intelligence tools
  • Familiarity with Gmail API, OAuth products, and restricted-scope compliance
  • Computer vision experience for product-image quality checks
  • Firebase and GCP operations experience, including secrets, regions, schedulers, and cost monitoring
  • Experience building evaluation corpora from production data and iterating against contractual SLAs
  • Agency or multi-client product studio experience
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, New York
27 Employees

What We Do

At BolderApps, we believe in the power of creativity and strategy to transform brands. our vision is to push boundaries, challenge norms, and craft digital experiences that leave a lasting impact. Our mission is to create meaningful connections between brands and their audiences, ensuring every project inspires, engages, and fuels long-term growth. with a commitment to excellence and a passion for innovation.

Similar Jobs

Hilton Logo Hilton

Fitness Instructor

Software • Hospitality
Remote
MEX
121228 Employees

Crunchyroll Logo Crunchyroll

Software Engineer

Digital Media • eCommerce • Gaming • Mobile • News + Entertainment
Remote or Hybrid
Mexico City, Ciudad De México, MEX
1300 Employees

Magna International Logo Magna International

Superintendente de Facilidades

Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
Remote or Hybrid
COA, Coahuila De Zaragoza, MEX
171000 Employees

Arrive Logistics Logo Arrive Logistics

Risk Coordinator

Logistics • Sales • Software • 3PL: Third Party Logistics
Remote
Guadalajara, Jalisco, MEX
1700 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
43 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account