QA Engineer

Posted 7 Days Ago
Be an Early Applicant
Hiring Remotely in Israel
Remote
Mid level
Information Technology • Software
The Role
As a QA Engineer at Tavily, you will design test strategies for AI APIs, develop automation frameworks, and ensure quality across AI-driven features and data pipelines.
Summary Generated by Built In

About Tavily

We're building the search engine for AI agents. Our API is designed from the ground up to power RAG and real-time reasoning in AI systems. By connecting LLMs to high quality, trustworthy web content, we help developers build agents that are not only intelligent, but also informed.

We work with some of the most innovative teams in AI, from small startups shaping the ecosystem to the largest enterprises deploying AI at scale. Whether it's powering sales assistants, research copilots, or internal knowledge tools, we're the missing link between LLMs and the real world.

The Role

We're looking for a QA Engineer to own quality across our AI-powered search infrastructure. You'll work closely with engineering to ensure our APIs, scraping pipelines, and AI-driven features meet the highest standards. This role goes beyond traditional QA—you'll be testing non-deterministic AI outputs, building automation frameworks, and helping define quality metrics for LLM-integrated systems.

What You'll Do

- Design and execute test strategies for our search API, content extraction, and AI-powered research features

- Build and maintain automated testing frameworks for APIs, microservices, and data pipelines

- Develop testing approaches for non-deterministic AI outputs (LLM responses, search relevance, content quality)

- Create performance and load testing suites to ensure our systems scale reliably

- Collaborate with developers to implement CI/CD quality gates and shift-left testing practices

- Investigate production issues, perform root cause analysis, and define preventive measures

- Define and track quality metrics across our distributed system

What We're Looking For

- 3+ years of experience in QA Engineering, with strong emphasis on backend/API testing

- Hands-on experience with test automation frameworks (pytest, Playwright, or similar)

- Experience testing distributed systems, microservices, or data pipelines

- Familiarity with AI/ML systems and the challenges of testing non-deterministic outputs

- Strong understanding of REST APIs and experience with API testing tools

- Experience with CI/CD pipelines and integrating automated tests

- Familiarity with cloud environments (AWS preferred)

- Strong debugging and analytical skills

- Excellent communication in English (written and verbal)

- You're excited about an in-person office environment in Tel Aviv

- Nice to have: Experience with Elasticsearch, MongoDB, or similar data stores; exposure to LLMs and prompt engineering

Perks & Benefits

- A young, open, and inclusive culture where everyone has real impact from day one

- The chance to build alongside a fast-moving team at the forefront of agentic AI

- Full medical and dental coverage

- A deep-work culture that values curiosity, creativity, and continuous learning

- Monthly Cibus

Top Skills

APIs
AWS
Ci/Cd
Elasticsearch
MongoDB
Playwright
Pytest
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New YorkNew York, New York
41 Employees
Year Founded: 2024

What We Do

Search. Extract. Crawl. The web access stack built for builders, by builders.

Tavily powers the next generation of agents with a suite of tools for real-time Search, structured data Extraction, and fully-rendered Crawling — everything agents need to access and reason over the live web.

Purpose-built for RAG, autonomy, and production-grade agent systems.

Similar Jobs

Webbing Logo Webbing

Quality Assurance Engineer

Internet of Things • Software • Cybersecurity
In-Office or Remote
Petah Tikva, ISR
163 Employees

GE Healthcare Logo GE Healthcare

Quality Assurance Engineer

Artificial Intelligence • Healthtech • Analytics • Biotech
Remote
Rehovot, ISR
50282 Employees

Plus500 Logo Plus500

Quality Assurance Engineer

Fintech • Financial Services
In-Office or Remote
Tel Aviv, ISR
660 Employees
2-2 Annually

Dot Compliance Logo Dot Compliance

Quality Assurance Engineer

Artificial Intelligence • Software
Remote
IL
187 Employees

Similar Companies Hiring

Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account