Software Engineer, ML Infrastructure (Senior Level)

Sorry, this job was removed at 10:07 p.m. (CST) on Wednesday, Sep 03, 2025
Easy Apply
San Francisco, CA
In-Office
Software
The Role

At Instabase, we're passionate about democratizing access to cutting-edge AI innovation to enable any organization to solve previously unsolvable unstructured data problems in their industry.  With customers representing some of the largest and most complex organizations in the world, and investors like Greylock, Andreessen Horowitz, and Index Ventures, our market opportunity is near infinite.

Instabase offers a consumption-based pricing model where customers can pay only for what they use, aligning directly with the value our products deliver. It empowers our clients to explore our AI Hub platform features extensively, enabling them to uncover crucial business insights. This customer-centric model allows Instabase to glean insights from diverse use cases and behaviors, ensuring we deliver top-tier solutions that provide unmatched advantages for everyday business operations.

With offices in San Francisco, New York, London and Bengaluru, Instabase is a truly global company. We are people-first, and we've built a fearlessly experimental, endlessly curious, customer obsessed team who work together and help organizations around the world turn their unstructured data into insights instantly.

As part of our ML Infrastructure Team, you’ll design and develop the next generation of machine learning products at Instabase. You’ll build intuitive applications that empower our customers to leverage the latest technologies in AI/ML to tackle their hardest document understanding problems. We are bridging the human-machine gap in ML, enabling humans to understand, debug, and fine-tune models, all the while deploying and managing these models at large scales (millions of requests per month).

What you'll do

  • Design and implement architectures for using, testing, and training models at scale, both in the cloud using Kubernetes.
  • Design and develop and contribute to scalable distributed systems infrastructure that power the ML/AI infrastructure.
  • Dive into the complexities of real-time data processing and develop strategies to ensure that our systems can efficiently handle the dynamic outputs of generative AI models.
  • Design and implement best practices for model management and deployment.
  • Create products around models that make it easy for the customer to use and understand machine learning models and approaches.
  • Work with both internal and external developers / data scientists to bring models into Instabase that are then used by customers to solve use cases.
  • Troubleshoot production issues and contribute to improving our platform stability.

About you

  • BS, MS, or PhD in Computer Science, or equivalent experience in a technical field
  • You have 5+ years of software engineering experience.
  • You have highly relevant experience in infrastructure engineering with demonstrated expertise in large-scale distributed systems
  • You enjoy thinking about how the end user / customer interacts with and understands models.
  • You like getting to the bottom of deep, complex problems. You aren’t satisfied with “it works” until you understand why.
  • You are familiar with both distributed systems and data science, and enjoy thinking about how the two are built together. 
  • You have experience with proper software engineering best practices.
  • Experience with Kubernetes, existing ML scaling techniques and model training/serving technologies like AnyScale Ray, vLLM, AWS Sagemaker preferred
  • Experience with machine ]learning (ML) and artificial intelligence (AI) in the space of document understanding preferred

Compensation: The base salary range for this role is $190,000 to $205,000 + bonus, equity and US benefits. The actual pay may vary based on factors such as location, experience and skills.

US Benefits:
  • Flexible PTO: Because life is better when you actually live it!
  • Instabreak Fridays: Enjoy 6 company-wide Friday breaks scheduled throughout the year, giving you long weekends to relax and recharge!
  • Comprehensive Coverage: Top-notch medical, dental, and vision insurance.
  • 401(k) with Matching: We’ve got your back for a secure future.
  • Parental Leave & Fertility Benefits: Supporting you in growing your family, your way.
  • Therapy Sessions Covered: Mental health matters— 10 free sessions through Samata Health.
  • Wellness Stipend: For gym memberships, fitness tech, or whatever keeps you thriving.
  • Lunch on Us: Enjoy a lunch credit when you're in the office.

#LI-Hybrid


Instabase is an Equal Opportunity Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status. Research shows that in order to apply for a job, women feel they need to meet 100% of the criteria while men usually apply after meeting about 60%. Regardless of how you identify, if you believe you can do the job and are a good match, we encourage you to apply.

Similar Jobs

MongoDB Logo MongoDB

Software Engineer

Big Data • Cloud • Software • Database
Easy Apply
Remote or Hybrid
8 Locations
5550 Employees
135K-203K Annually

Motorola Solutions Logo Motorola Solutions

Director Of Sales

Artificial Intelligence • Hardware • Information Technology • Security • Software • Cybersecurity • Big Data Analytics
Remote or Hybrid
California, USA
23000 Employees
115K-300K Annually

Motorola Solutions Logo Motorola Solutions

Director Of Sales

Artificial Intelligence • Hardware • Information Technology • Security • Software • Cybersecurity • Big Data Analytics
Remote or Hybrid
California, USA
23000 Employees
115K-300K Annually

Motorola Solutions Logo Motorola Solutions

Director of Business Development, Electronic Warfare

Artificial Intelligence • Hardware • Information Technology • Security • Software • Cybersecurity • Big Data Analytics
Remote or Hybrid
California, USA
23000 Employees
180K-280K Annually
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
300 Employees
Year Founded: 2015

What We Do

The Automation Platform for Unstructured Data

Instabase is democratizing access to deep learning to empower any organization to solve unstructured data problems with unprecedented accuracy. From understanding complex financial data for the world’s largest banks to transforming manual processes for insurers and federal agencies alike, automating unstructured data represents the largest opportunity for digital transformation in the enterprise.

With Instabase, our customers can automatically understand unstructured data with the latest deep learning technologies, rapidly build end-to-end workflows with pre-packaged solution blocks, and innovate at scale across their organization.

Why Work With Us

We are a remote first company where our people are at the core of our success. Our key priorities are employee wellbeing through comprehensive benefits, competitive compensation, and a commitment to diversity, equity and inclusion. We are constantly working to make sure that employees feel supported and empowered.

Gallery

Gallery

Similar Companies Hiring

PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account