Staff Product Engineer (Hybrid)

Posted 23 Days Ago
Be an Early Applicant
Palo Alto, CA, USA
Hybrid
175K-300K Annually
Senior level
Artificial Intelligence • Analytics
The Role
The Staff Product Engineer will design and build core services for AI applications, lead implementation of distributed systems, and enhance observability metrics while collaborating with product and engineering teams.
Summary Generated by Built In

Our Purpose

At Fiddler, we understand the implications of AI and the impact that it has on human lives. Our company was born with the mission of building trust into AI. The rise of Generative AI and Agents has unlocked generalized intelligence but also widened the risk aperture and made it harder to ensure that AI applications are working well. Fiddler enables organizations to get ahead of these issues by helping deploy trustworthy, and transparent AI solutions. 

Fiddler partners with AI-first organizations to help build a long-term framework for responsible AI practices, which, in turn, builds trust with their user base. AI Engineers, Data Science, and business teams use Fiddler AI to monitor, evaluate, secure, analyze, and improve their AI solutions to drive better outcomes. Our platform enables engineering teams and business stakeholders alike to understand the "what", “why”, and "how" behind AI outcomes.  

Our Founders

Fiddler AI is founded by Krishna Gade (engineering leader at Facebook, Pinterest, Twitter, and Microsoft) and Amit Paka (product leader at Microsoft, Samsung, Paypal and two-time founder). We are backed by Insight Partners, Lightspeed Venture Partners, and Lux Capital. 

Why Join Us

Our team is motivated to help build trust into AI to enable society harness the power of AI. Joining us means you get to make an impact by ensuring that AI applications at production scale across industries have operational transparency and security.  We are an early-stage startup and have a rapidly growing team of intelligent and empathetic doers, thinkers, creators, builders, and everyone in between. The AI and ML industry has a rapid pace of innovation and the learning opportunities here are monumental. This is your chance to be a trailblazer.  

Fiddler is recognized as a pioneer in the field of AI Observability and has received numerous accolades, including:  2022 a16z Data50 list, 2021 CB Insights AI 100 most promising startups, 2020 WEF Technology Pioneer, 2020 Forbes AI 50 most promising startups of 2020, and a 2019 Gartner Cool Vendor in Enterprise AI Governance and Ethical Response. By joining our brilliant (at least we think so) team, you will help pave the way in the AI Observability space.

👩🏽‍🚀 The Mission:

Our AI engineers make a real impact on the safety and ROI of large language models and agentic applications across different verticals and domains. You will work on the cutting edge of envisioning and building new types of tools and algorithms to monitor, explain, and improve such applications and in turn empower our customers.

🪐 About The Team:

Our engineering team is a dynamic group of builders and thinkers dedicated to solving some of the most cutting-edge challenges in AI safety and reliability. Working on exciting and an expansive range of topics, from the responsible deployment of machine learning models, large language models (LLMs), to complex agentic applications. Our projects are inherently cross-disciplinary, requiring expertise in systems engineering, product engineering, and data science to build robust, scalable solutions. We thrive in a collaborative environment where continuous learning is at the forefront, ensuring every team member stays on their toes with the latest advancements in AI. Joining our team means you'll have the opportunity to make a tangible impact on how AI evolves for the benefit of humanity.

🚀 What You’ll Do:

  • Design and build core services and components of a world-class cloud platform to help enterprises develop, monitor and improve their full suite of AI based applications (covering predictive models, LLMs, GenAI models and agentic applications)

  • Lead the design and implementation of distributed systems, microservices and applications that compute, persist, and expose new ML + agentic observability metrics (e.g., response relevancy, hallucination scores) from raw trace data

  • Spearhead the development of new types of metrics and evaluation capabilities to satisfy evolving customer needs around agentic applications. Take part in conversations with customers around discovery and support

  • Developer in-house AI Agents and GenAI capabilities to augment the Fiddler observability products

  • Define and evolve the operational maturity (reliability, observability, SLOs, observability) of core services and components, establish best practices and champion improvements across the team

  • Team & Culture Building: you will take an active role in building a world-class engineering team and actively participate in the talent acquisition process through interviewing, candidate evaluation and coaching

🎯 What You Must have:

  • Masters or Bachelors degree in Computer Science or related field, combined with 7+ years of industry experience, with demonstrated solid foundation in software development

  • Deep proficiency with Python

  • Prior experience building and operating highly complex SaaS platforms and systems

  • Work closely with product, design, and customer engineering teams to improve and expand our product offerings

Nice to haves

  • Practical working knowledge of machine learning and data science

  • Experience with OLAP systems, Postgres, Redis, Kafka, RabbitMQ, Ray and Spark

  • Familiarity with frameworks like Langchain, LangGraph, Google ADK, Amazon Strands, OpenAI, etc.

  • Experience building and integrating MCP Servers

  • Hands-on experience designing, implementing, or operating AI/ML observability or evaluation systems

  • Coaching & Mentorship: Serve as a strong collaborator and a mentor to other team members, raising the technical bar for the entire team and regularly engage in code and design reviews

  • Ability to work in our Palo Alto office 3 days a week

🫱🏼‍🫲🏾 Compensation:

Bay Area, New York City & Seattle range $190,000 - $300,000 + equity + benefits

Other Locations: $175,000 - $215,000 + equity + benefits

🩺 Benefits & Perks
  • Unlimited PTO

  • Competitive pay + equity

  • Premium health, dental & vision – for you, 100% premiums covered with buy-up options.

  • 401(k) plan

  • Monthly fitness reimbursement

  • Paid parental leave

Palo Alto HQ Vibes

  • Free annual Caltrain pass

  • Monthly in-office massages

  • Fastrak reimbursement

  • Free lunch Mon–Thurs

The posted range represents the expected salary range for this job requisition and does not include any other potential components of the compensation package and perks previously outlined. Ultimately, in determining pay, we'll consider your experience, leveling, location, and other job-related factors.

Fiddler is proud to be an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. If you require special accommodations in order to complete the interviews or perform job duties, please inform the recruiter at the beginning of the process.

Beware of job scam fraud. Our recruiters use @fiddler.ai email addresses exclusively. In the US, we do not conduct interviews via text or instant message, or ask for sensitive personal information such as bank account or social security numbers.

Top Skills

Amazon Strands
Google Adk
Kafka
Langchain
Langgraph
Olap Systems
Openai
Postgres
Python
RabbitMQ
Ray
Redis
SaaS
Spark
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Palo Alto, CA
58 Employees
Year Founded: 2018

What We Do

Fiddler is a pioneer in enterprise Model Performance Management. Data Science, MLOps, and LOB teams use Fiddler to monitor, explain, analyze, and improve their solutions and build trust into AI. The unified environment provides a common language, centralized controls, and actionable insights to operationalize ML/AI with trust. It addresses the unique challenges of building in-house stable and secure MLOps systems at scale. Unlike observability solutions, Fiddler seamlessly integrates deep XAI and analytics to help you grow into advanced capabilities over time and build a framework for responsible AI practices. F500 companies use Fiddler across training and production models to accelerate AI time-to-value and scale and increase revenue by connecting predictions to business context (or providing visibility into model performance and behavior).

Why Work With Us

Fiddler's culture is built on the values of humility, respect, kindness, transparency, and collaboration. Fiddlers are driven by the mission of the company and work hard to make a difference towards the cause.

Similar Jobs

Homeward Health Logo Homeward Health

Staff Software Engineer

Artificial Intelligence • Healthtech • Telehealth
Easy Apply
Hybrid
San Mateo, CA, USA
250 Employees
170K-210K Annually

tms Logo tms

Senior Engineer

Agency • Gaming • Marketing Tech • Mobile • Analytics
Remote or Hybrid
US
2300 Employees
30K-60K Annually

Adstra Logo Adstra

Brand Experience Lead

AdTech • Big Data • Digital Media • Marketing Tech • Database • Automation
In-Office or Remote
2 Locations
175 Employees

Micron Technology Logo Micron Technology

Designer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
San Jose, CA, USA
45000 Employees
56K-120K Hourly

Similar Companies Hiring

GC AI Thumbnail
Artificial Intelligence • Legal Tech
San Mateo, California
80 Employees
Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees
Bellagent Thumbnail
Artificial Intelligence • Machine Learning • Business Intelligence • Generative AI
Chicago, IL
20 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account