Software Engineer, Inference

Reposted 3 Months Ago
San Francisco, CA, USA
In-Office
150K-230K Annually
Mid level
Software
Production-Grade Unstructured Document Extraction
The Role
Develop and optimize low-latency inference services for OCR and multimodal models, focusing on performance engineering and model serving. Implement autoscaling and capacity planning while building performance dashboards.
Summary Generated by Built In

Overview


Pulse is tackling one of the most persistent challenges in data infrastructure: extracting accurate, structured information from complex documents at scale. We have a breakthrough approach to document understanding that combines intelligent schema mapping with fine-tuned extraction models where legacy OCR and other parsing tools consistently fail.

We are a small, fast-growing team of engineers in San Francisco powering Fortune 100 enterprises, YC startups, public investment firms, and growth-stage companies. We are backed by tier 1 investors and growing quickly.

What makes our tech special is our multi-stage architecture:

  • Layout understanding with specialized component detection models

  • Low-latency OCR models for targeted extraction

  • Advanced reading-order algorithms for complex structures

  • Proprietary table structure recognition and parsing

  • Fine-tuned vision-language models for charts, tables, and figures

If you are passionate about the intersection of computer vision, NLP, and data infrastructure, your work at Pulse will directly impact customers and shape the future of document intelligence.

What we are looking for

  • 5 days in-office at our San Francisco office

  • Eager to learn and adapt quickly

  • Prior startup or founding experience is a plus

What we are looking for

  • 5 days in-office at our San Francisco office

  • Eager to learn and adapt quickly

  • Prior startup or founding experience is a plus

About the Role
Specialize in low-latency, high-throughput inference for OCR and multimodal models. Own profiling, batching, and autoscaling across single-tenant and multi-tenant environments.

Responsibilities

  • Build inference services with smart batching and caching

  • Optimize kernels, tokenization, and model graphs

  • Evaluate vLLM, TensorRT LLM, and Triton tradeoffs

  • Implement autoscaling and admission control with clear SLOs

  • Own performance dashboards and capacity planning

Requirements

  • 3+ years in performance engineering or ML systems

  • Strong Python, plus C++ or CUDA exposure

  • Experience with GPU profiling and model serving

Nice to have

  • Experience reducing p95 and cost in production ML systems

Sponsorship
Sponsorship available.

Compensation and benefits
Competitive base salary plus equity, performance-based bonus, relocation assistance for Bay Area moves, daily meal stipend, medical, vision, and dental coverage.

Skills Required

  • 3+ years in performance engineering or ML systems
  • Strong Python, plus C++ or CUDA exposure
  • Experience with GPU profiling and model serving
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: London
26 Employees
Year Founded: 2024

What We Do

Production-Grade Unstructured Document Extraction

Similar Jobs

ServiceNow Logo ServiceNow

Staff Software Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
San Diego, CA, USA
29000 Employees
181K-317K Annually

ServiceNow Logo ServiceNow

Staff Software Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Santa Clara, CA, USA
29000 Employees
201K-352K Annually

Snap Inc. Logo Snap Inc.

Software Engineer

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
2 Locations
5000 Employees
133K-235K Annually

Snap Inc. Logo Snap Inc.

Software Engineer

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
3 Locations
5000 Employees
133K-235K Annually

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
Glendale, Kentucky
55 Employees
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account