Staff Software Engineer (Backend) - AI Infra

Posted Yesterday
Be an Early Applicant
San Jose, CA
152K-215K Annually
Senior level
Fintech • Software
The Role
The Staff Software Engineer will design and implement scalable machine learning models in the backend focused on AI infrastructure for financial automation. Responsibilities include leading initiatives, developing frameworks for prompt engineering, integrating AI models, and collaborating cross-functionally to enhance operational efficiency.
Summary Generated by Built In

Innovate with purpose


At BILL, we believe in empowering the businesses that drive our economy. By replacing outdated financial processes with innovative tools, we help businesses—from startups to established brands—make smarter decisions and gain control of their operations. And we don’t stop there: we’re creating the future of financial automation so businesses can spend more time on what matters.


Working here means you become part of a vision-driven team that’s ready to tackle challenges and build cutting-edge solutions. We value purpose, drive, and curiosity—and we thrive in a fast-paced, ever-changing environment. Whether in one of our offices in San Jose, CA, Draper, UT, or working remotely, BILLders collaborate to deliver real impact for businesses that need more time in their busy weeks.


At BILL, we listen, learn, and lead—fostering collaboration and a drive for continuous growth. We’re committed to building a diverse and inclusive workplace that values each person’s unique skills and experiences. Even if you don’t meet every requirement, we’d love to hear from you—you might be just what we’re looking for, whether in this role or another.


✨ Let’s give businesses more time for what matters.

Make your impact within a rapidly growing Fintech Company

Join our AI Infrastructure team at the forefront of transforming financial operations for small and mid-sized businesses, which form the backbone of the U.S. economy, contributing to about 1% of the U.S. GDP. Our team is the powerhouse behind a diverse range of AI models — from sophisticated credit models and advanced document understanding to intelligent virtual assistants and groundbreaking new projects on the horizon. 

As a Staff Software Engineer, you'll play a pivotal role in shaping the future of fintech by developing cutting-edge solutions that streamline and enhance financial operations. This role offers a substantial scope for impact, allowing you to contribute directly to the success of millions of businesses while working at the intersection of AI, finance, and technology. You will define and execute architectural strategies that address long-term business and technical challenges. You'll have the opportunity to lead initiatives, drive innovations, and deploy models that save our customers time and effort, all within a dynamic, fast-paced environment that values high energy, cross-functional partnership, business acumen, and a strong sense of ownership.

We’d love to chat if you have:

  • Advanced Degree in Computer Science, Engineering, Mathematics, or a related field, ideally, with a focus on Machine Learning/AI
  • Demonstrated expertise in designing, implementing, and deploying scalable machine learning models, especially in the backend
  • Experience with low latency systems, document understanding/generation, and virtual assistants is highly valued
  • Skilled in integrations to ingest data sets from various data sources
  • Experience in model evaluation frameworks to track and improve product/system performance, quality, data management and accuracy
  • Develop, test, and refine prompts for a variety of use cases, ensuring high accuracy and relevance in generated outputs
  • Experienced in integrating various SOTA LLM solutions (GPT, Claude, Gemini, etc)  into existing or new applications
  • Contribute to the development of a scalable framework for prompt engineering, promoting reuse and knowledge sharing across different business units
  • Stay up-to-date with advancements in Generative AI technology and contribute to strategic decisions on tool and platform selection
  • Document prompt engineering processes, best practices, and use case outcomes to build a comprehensive prompt optimization solution
  • Demonstrated expertise in fine tuning Large Language Models (LLMs) to drive model quality further
  • Strong coding skills in Python, Java, or similar, along with experience in ML frameworks (e.g., PyTorch) and cloud services (e.g., AWS, GCP)
  • Knowledge of CI/CD pipelines and MLOps principles
  • A track record of successful cross-functional partnerships, with the ability to lead and inspire teams towards achieving shared goals
  • Innovative Mindset: A passion for staying on the cutting edge of ML/AI technology, with a drive to explore and implement novel solutions
  • Ownership and Drive: Exceptional problem-solving skills and a proactive approach to tackling challenges, taking ownership from concept through to deployment

The estimated salary  range for this role is noted below for our San Jose based role.  Our ranges for each role and job level are based on a variety of factors including candidate experience, expertise, and geographic location and may vary from the amounts listed above. The role is also eligible for a competitive benefits package that includes: medical, dental, vision, life and disability insurance, 401(k) retirement plan, flexible spending & health savings account, paid holidays, paid time off, and other company benefits.

San Jose pay range

$179,300$215,000 USD

What’s in it for you? 

Redefining how businesses automate their work is a fast-paced, exciting, and fun environment. But we also have benefits and perks to ensure the magic isn’t only experienced by our customers, but by our employees as well. 

Here is a preview of some of the amazing benefits here at BILL:

  • 100% paid employee health, dental, and vision plans (choose HMO, PPO, or HDHP)
  • HSA & FSA accounts 
  • Life Insurance, Long & Short-term disability coverage
  • Employee Assistance Program (EAP)
  • 11+ Observed holidays and wellness days and flexible time off 
  • Employee Stock Purchase Program with employee discounts
  • Wellness & Fitness initiatives
  • Employee recognition and referral programs
  • And much more

Don’t believe us? Check out our culture, benefits, and teams on our career site, LinkedIn Life, or YouTube pages.

BILL is an Equal Opportunity Employer that values diversity and inclusion. We believe our best ideas come from the unique stories, perspectives, and experiences of our team members. We welcome people of all backgrounds, abilities, and identities to bring their authentic selves and contribute to our culture.

We are committed to a transparent, inclusive hiring process that reflects our values. If you need accommodations at any stage, please contact [email protected].

Our Applicant Privacy Notice describes how BILL treats the personal information it receives from applicants.

Top Skills

Java
Python
The Company
HQ: San Jose, CA
2,753 Employees
On-site Workplace

What We Do

BILL (NYSE: BILL) is a leader in financial automation software for small and midsize businesses (SMBs). As a champion of SMBs, we are dedicated to automating the future of finance so businesses can thrive. Hundreds of thousands of businesses trust BILL solutions to manage financial workflows, including payables, receivables, and spend and expense management. With BILL, businesses are connected to a network of millions of members, so they can pay or get paid faster. Through our automated solutions, we help SMBs simplify and control their finances, so they can confidently manage their businesses, and succeed on their terms. BILL is a trusted partner of leading U.S. financial institutions, accounting firms, and accounting software providers. BILL is headquartered in San Jose, California. For more information, visit bill.com.

Similar Jobs

Remote
Hybrid
4 Locations
2674 Employees

Verkada Inc Logo Verkada Inc

Senior Backend Engineer - Search

Cloud • Hardware • Security • Software
San Mateo, CA, USA
2000 Employees
130K-280K Annually

Roblox Logo Roblox

Senior Software Engineer, Design Systems & Accessibility

Computer Vision • Gaming • Software • Virtual Reality • Web3 • Metaverse
Hybrid
San Mateo, CA, USA
2500 Employees
219K-284K Annually

Roblox Logo Roblox

Senior Content Platform Software Engineer

Computer Vision • Gaming • Software • Virtual Reality • Web3 • Metaverse
San Mateo, CA, USA
2500 Employees
189K-234K Annually

Similar Companies Hiring

Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees
RunPod Thumbnail
Software • Infrastructure as a Service (IaaS) • Cloud • Artificial Intelligence
Charlotte, North Carolina
53 Employees
Hedra Thumbnail
Software • News + Entertainment • Marketing Tech • Generative AI • Enterprise Web • Digital Media • Consumer Web
San Francisco, CA
14 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account