Senior AI Engineer

Posted Yesterday
Be an Early Applicant
San Mateo, CA
Hybrid
3-5 Years Experience
Software
The Role
The Senior AI Engineer will design and maintain AI features, fine-tune large language models (LLMs), and construct AI workflows to enhance system observability. Responsibilities include developing a chatbot, an extraction tool, and improving incident summarization through generative AI.
Summary Generated by Built In

Observe is a SaaS Observability product that enables businesses to investigate modern distributed applications 10x faster. Observe ingests anything with a timestamp (e.g. system and application logs, metrics, and traces), and then structures that data so that it is correlated and easy to navigate. We enable engineers to spend more time coding features and less time investigating incidents. Finally, because of Observe’s unique elastic architecture, it is priced based on usage, making it cost 10x less than incumbents.


Traditional approaches to this problem have resulted in fragmented tooling and fragile dashboards which, in turn, have resulted in exploding costs and complexity. At Observe, we believe that the core challenge lies in organizing and relating telemetry data emitted by those applications, despite the fact it is constantly changing. Solving this data problem makes observability an order of magnitude easier, faster, and less expensive. At Observe, we didn’t set out to build another monitoring tool company, we set out to build a data company. Observe is founded by top enterprise VC Sutter Hill Ventures and has a founding team from leading Enterprise SaaS companies Snowflake, Splunk, and Wavefront.


To learn more about Observe, visit www.observeinc.com or join the conversation on Twitter @Observe_Inc.


Team Overview

The AI team is a small team within Observe that is responsible for leveraging generative AI to help our customers understand their incidents faster. In order to make sense of huge quantities of unstructured data by extracting, summarizing, and retrieving information that is relevant to engineers investigating incidents, we have incorporated recent advances in generative AI into our product.


These use cases include:

1. A chatbot with hallucination guardrails that allows users to easily, and reliably, ask questions about our product, powered by an in-house RAG solution searching over our documentation.

2. An AI-powered extraction tool that makes it easy to automatically add structure to unstructured machine data with the click of a button.

3. Finetuning 7B+ LLMs to power our OPAL copilot (OPAL is our SQL-like temporal query language)

4. Automatic and efficient incident summarization.


We value collaboration, willingness to learn, and the ability to solve immediate problems quickly while building towards a long-term vision.


The Role:

- Design, improve, and maintain AI features at Observe.

- Finetune and serve LLMs in production.

- Build AI agentic workflows to improve the observability of users’ systems.


Requirements:

- 3+ years of experience working in generative AI

- Master’s in Computer Science or related field

- Experience with RAG

- Experience evaluating LLMs and RAG systems

- Experience with Huggingface Transformers

- Worked on a model that’s been deployed in production

- Python expertise

- Great written and spoken English communication skills about technical topics

- Knowledge of the Python data science stack: (Scikit-Learn, Numpy, Pandas)


Preferred:

- Experience building AI agents

- Experience pre-training and/or fine-tuning LLMs at the 1b+ scale

- Experience building scalable applications with LLMs, using frameworks such as LangChain, LlamaIndex, etc.

- Experience working with adapters, e.g. LoRA

- Experience with Pytorch

- Experience with FastAPI or Flask

- Experience with LLM-powered synthetic data labelling and evaluation

- Experience in the observability domain

- Experience with data processing tools like Apache Spark, Huggingface Datasets, or similar

- Experience with Go


Feel free to apply even if you don’t meet 100% of the requirements!

Top Skills

Python
The Company
HQ: San Mateo, CA
127 Employees
On-site Workplace
Year Founded: 2017

What We Do

Observe was founded by Sutter Hill Ventures in November 2017. Our founding team came from leading Enterprise SaaS and software companies that work with vast quantities of data such as Snowflake, Splunk and Wavefront.

Our founding thesis was that the enterprises are data rich, but information poor. Data is siloed making it difficult to understand what’s going on inside applications and infrastructure. The result is often a poor customer experience and wasted engineering time tracking down incidents. Oh, and it costs a fortune.

Observe discerns why applications and infrastructure are running the way they are from the data they emit. We enable engineers to spend more time coding features and less time investigating incidents. We reduce outages and issues with customer experience. And we leverage an elastic cloud architecture so that you only pay for what you use.

Jobs at Similar Companies

bet365 Logo bet365

Software Developer, Trading and Tools

Digital Media • Gaming • Software • eSports • Automation
Denver, CO, USA
6100 Employees
85K-120K Annually

Jobba Trade Technologies, Inc. Logo Jobba Trade Technologies, Inc.

Customer Success Specialist

Cloud • Information Technology • Productivity • Professional Services • Software
Hybrid
Chicago, IL, USA
45 Employees

Similar Companies Hiring

TrainingPeaks (A Peaksware Company) Thumbnail
Software • Fitness
Louisville, CO
69 Employees
bet365 Thumbnail
Software • Gaming • eSports • Digital Media • Automation
Denver, Colorado
6100 Employees
Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account