Senior Software Engineer, Vector Indexing

Posted 5 Days Ago
Be an Early Applicant
Headquarters, AZ
In-Office
180K-235K Annually
Senior level
Artificial Intelligence • Information Technology • Software
The Role
The role involves designing and maintaining vector indexing systems, implementing GPU-accelerated algorithms, optimizing performance, and engaging with the open-source community.
Summary Generated by Built In
About LanceDB

LanceDB is a developer-friendly, open-source data lake for multimodal AI. From hyper-scalable vector search to advanced retrieval for RAG, from streaming training data to interactive exploration of large-scale AI datasets, LanceDB is the best foundation for your AI application, and powers some of the most groundbreaking applications and challenging requirements today.

About the Role

We’re looking for a Software Engineer focused on Vector Indexing to help build the next generation of vector-native data infrastructure. You’ll work on high-performance indexing and search systems at the core of LanceDB, enabling scalable similarity search, full-text search, and flexible indexing for the open-source and enterprise communities alike.

You’ll be responsible for:
  • Designing, building, and maintaining core vector indexing and search components

  • Implementing GPU-accelerated indexing algorithms and performance optimizations

  • Maintaining and evolving vector index algorithms, including pruning, quantization, and graph-based methods

  • Developing and optimizing full-text search capabilities and integrations

  • Benchmarking, profiling, and tuning performance across varied workloads

  • Writing and maintaining documentation, benchmarks, tutorials, and blog posts to support and grow adoption

  • Engaging with the open-source community: reviewing contributions, triaging issues, and joining design discussions

Requirements
  • Strong proficiency in Rust

  • Experience designing or implementing vector search or indexing algorithms (e.g., HNSW, IVF, PQ, quantization, clustering)

  • Proficiency in C for GPU-related development

  • Familiarity with GPU acceleration frameworks (CUDA, ROCm, etc.)

  • Demonstrated ability to benchmark, profile, and optimize system performance

  • Excellent written communication and documentation skills

  • Comfortable collaborating in open-source environments

Nice to Have
  • Understanding of full-text search systems (Lucene, Elasticsearch, Tantivy, etc.)

  • Experience building or maintaining data systems, databases, or search engines

  • Familiarity with distributed systems and scale-out architecture

  • Background in web APIs, embedding serving, or real-time systems

  • Contributions to or maintenance of open-source projects

What We Offer
  • A key role shaping an open-source project with real production usage

  • Remote-first team with flexible hours

  • Competitive compensation, equity, and benefits

  • Generous learning budget and support for open-source contributions

About the LanceDB Team


LanceDB was created by experts with decades of experience building tools for data science and machine learning. From co-authors of pandas to Apache PMC members of HDFS, Arrow, and Delta, the LanceDB team has created open-source tools used by millions worldwide.

Top Skills

C
Cuda
Rocm
Rust
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, California
29 Employees
Year Founded: 2022

What We Do

LanceDB is a developer-friendly, open source database for multimodal AI. From hyper scalable vector search to advanced retrieval for RAG, from streaming training data to interactive exploration of large scale AI datasets, LanceDB is the best foundation for your AI application.

Similar Jobs

DailyPay Logo DailyPay

Client Engagement Specialist

Fintech • HR Tech • Payments • Social Impact • Financial Services
In-Office
Headquarters, AZ, USA
850 Employees
83K-125K Annually

DailyPay Logo DailyPay

Enterprise Sales Director

Fintech • HR Tech • Payments • Social Impact • Financial Services
In-Office
Headquarters, AZ, USA
850 Employees

Capital One Logo Capital One

Relationship Manager

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
Phoenix, AZ, USA
55000 Employees
73K-83K Annually
Hybrid
10 Locations
213000 Employees
77K-145K Annually

Similar Companies Hiring

Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account