Software Engineer, Distributed Systems & AI Agents (Senior Level)

Reposted 3 Days Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
In-Office
Senior level
Software
The Role
Build and operate scalable distributed backend and execution infrastructure for AI agents and large unstructured-data workloads. Design scheduling, retries, timeouts, cancellation, rate limiting, and failure recovery. Develop agent runtimes coordinating model calls, tool execution, durable state, multi-step workflows, and human approvals. Evaluate models, run benchmarks, and own systems from design through production including testing, observability, and incident response.
Summary Generated by Built In

At Instabase, we're passionate about democratizing access to cutting-edge AI innovation to enable any organization to solve previously unsolvable unstructured data problems in their industry.  With customers representing some of the largest and most complex organizations in the world, and investors like Greylock, Andreessen Horowitz, and Index Ventures, our market opportunity is near infinite.

Instabase offers a consumption-based pricing model where customers can pay only for what they use, aligning directly with the value our products deliver. It empowers our clients to explore our AI Hub platform features extensively, enabling them to uncover crucial business insights. This customer-centric model allows Instabase to glean insights from diverse use cases and behaviors, ensuring we deliver top-tier solutions that provide unmatched advantages for everyday business operations.

With offices in San Francisco and Bengaluru, Instabase is a truly global company. We are people-first, and we've built a fearlessly experimental, endlessly curious, customer obsessed team who work together and help organizations around the world turn their unstructured data into insights instantly.

The Role

We are looking for a systems-minded engineer to build the distributed backend and execution infrastructure that powers AI agents. You will help build scalable, reliable, and secure systems at the intersection of distributed systems, agentic execution, and applied AI.

About the Team
The team tackles some of the most challenging technical problems in scaling the capabilities and utility of agents and agentic models. Our work enables best-in-class platforms that leverage the world’s most capable models and maximize the value of agentic products for users across enterprises, small and medium-sized businesses, and individuals. We work across several interconnected areas:

  • Distributed systems for processing large-scale unstructured-data extraction workloads.
  • Reliable backend infrastructure for agentic execution and long-running AI workflows.
  • R&D into advances in LLMs and AI, including benchmarks and new approaches to solving complex platform and customer problems.

What You Will Do

  • Take new ideas from 0-to-1 quickly, then evolve their architecture to scale by orders of magnitude—from early prototypes to production systems handling workloads that are 10×, 1,000×, or even 1,000,000× larger.
  • Build scalable distributed systems for large-scale unstructured-data extraction and agentic workloads.
  • Develop reliable execution infrastructure for scheduling, retries, timeouts, cancellation, rate limits, and failure recovery.
  • Build agent runtimes that coordinate model calls, tool execution, durable state, multi-step loops, and human approvals.
  • Evaluate emerging models and AI techniques through benchmarks and experiments, and apply them to new platform and customer problems.
  • Own systems from design through production, including testing, observability, and pragmatic trade-offs across reliability, performance, security, and cost.

About You

  • 5+ years of software engineering experience building and operating production backend systems, with the ability and experience toserve as a technical lead—setting direction, leading teams through complex projects, and mentoring and coaching engineers while remaining hands-on.
  • Strong fundamentals in distributed systems, concurrency, APIs, data modeling, and failure handling.
  • Experience with agentic execution systems, workflow orchestration, event processing, scheduling, or high-volume services.
  • Proficiency in a backend language such as Python, Go, Java, Kotlin, Rust, or C++.
  • Experience with queues, databases, caching, containers, cloud infrastructure, and production observability.
  • Experience building or integrating ML, generative-AI, or LLM-based systems, including tool calling and agent workflows.
  • A strong ownership mindset across design, deployment, monitoring, incident response, and continuous improvement.

Helpful experience: workflow engines or task executors; Kafka, Temporal, Celery, Ray, or similar systems; Kubernetes; agent runtimes, RAG, evaluations, model gateways, MCP, or AI observability.

Instabase is an Equal Opportunity Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status. Research shows that in order to apply for a job, women feel they need to meet 100% of the criteria while men usually apply after meeting about 60%. Regardless of how you identify, if you believe you can do the job and are a good match, we encourage you to apply.

Skills Required

  • 5+ years software engineering experience building and operating production backend systems and ability to serve as a technical lead
  • Strong fundamentals in distributed systems, concurrency, APIs, data modeling, and failure handling
  • Experience with agentic execution systems, workflow orchestration, event processing, scheduling, or high-volume services
  • Proficiency in a backend language such as Python, Go, Java, Kotlin, Rust, or C++
  • Experience with queues, databases, caching, containers, cloud infrastructure, and production observability
  • Experience building or integrating ML, generative-AI, or LLM-based systems, including tool calling and agent workflows
  • Ownership mindset across design, deployment, monitoring, incident response, and continuous improvement
  • Experience with workflow engines or task executors; Kafka, Temporal, Celery, Ray; Kubernetes
  • Experience with agent runtimes, RAG, evaluations, model gateways, MCP, or AI observability
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
300 Employees
Year Founded: 2015

What We Do

The Automation Platform for Unstructured Data Instabase is democratizing access to deep learning to empower any organization to solve unstructured data problems with unprecedented accuracy. From understanding complex financial data for the world’s largest banks to transforming manual processes for insurers and federal agencies alike, automating unstructured data represents the largest opportunity for digital transformation in the enterprise. With Instabase, our customers can automatically understand unstructured data with the latest deep learning technologies, rapidly build end-to-end workflows with pre-packaged solution blocks, and innovate at scale across their organization.

Why Work With Us

We are a remote first company where our people are at the core of our success. Our key priorities are employee wellbeing through comprehensive benefits, competitive compensation, and a commitment to diversity, equity and inclusion. We are constantly working to make sure that employees feel supported and empowered.

Gallery

Gallery

Similar Jobs

Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
289097 Employees

CSC Logo CSC

Service Desk Analyst

Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Remote or Hybrid
2 Locations
8500 Employees

MongoDB Logo MongoDB

Recruiter

Big Data • Cloud • Software • Database
Easy Apply
Remote or Hybrid
India
5550 Employees

Flywire Logo Flywire

Operations Associate

Fintech • Payments • Software
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
1200 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account