Senior Team Lead - Data Pipelines & Agentic Web Extraction

Posted 4 Days Ago
Be an Early Applicant
Tel Aviv, ISR
Hybrid
Senior level
Artificial Intelligence • Big Data • Cloud • Information Technology • Machine Learning • Natural Language Processing • Big Data Analytics
Your agents and analytics deserve better web data. 1M+ installs on Claude.
The Role
Lead a six-person engineering team responsible for scalable production data pipelines and an agentic AI system that generates webpage extraction templates. Own architecture, delivery, scalability, cost, stability, and platform interfaces while remaining hands-on. Mentor engineers, improve AI capability and evaluation, make build-versus-buy decisions, partner with product and customers, and manage hiring and team health.
Summary Generated by Built In
Description

We're looking for a Senior Team Lead to own two things at the core of our product: the data-pipeline infrastructure that ingests and processes web data at scale, and the agentic AI system that generates Extraction Templates - the mappings that turn any webpage into structured data.

You'll lead a team of 6 engineers spanning Backend, Full-Stack, and AI - coaching, managing, and hiring across both disciplines while staying hands-on, not just directing from a distance. Exceptional internal leadership and people skills are a must: clear communication and real ownership of team health, not just delivery.

Responsibilities

Data Pipelines at Scale

  • Own end-to-end architecture and delivery of Nimble's data-pipeline infrastructure - from system design to large-scale data flow, storage, and operations - already running in production for Fortune 500 customers.
  • Continuously analyze and improve the efficiency, scalability, cost, and stability of pipeline components as volume grows by an order of magnitude or more.
  • Design and implement supporting interfaces (Skills, Plugins, MCP, UI, API) and platform engineering where needed to deliver pipeline capabilities end-to-end.
  • Partner closely with the Product and Delivery team to define and prioritize the right pipeline solutions.

Agentic Generation of Extraction Templates

  • Bring deep, hands-on expertise in LLMs, agentic architectures, evaluation/benchmarking, and modern AI/LLMOps practices; make build-vs-buy and architecture calls with authority.
  • Grow the team's AI capability day to day: actively promote and mentor AI-native development practices.
  • Continuously improve the Extraction Template generation capability's coverage, accuracy, and scale
Requirements
  • 3+ years as a Team Lead across at least two workplaces, with strong leadership and people skills - clear communication and real ownership of team health. Comfortable operating independently without a dedicated PM, including direct customer communication.
  • 6+ years as a Back-End engineer with high-scale, production data-pipeline experience - a data-engineering background is not required. Python is the primary language. able to architect solutions from scratch and deliver on time.
  • Startup experience is a must; enterprise experience is a plus.
  • Hands-on AI engineering experience: LLMs, agentic architectures, evaluation/benchmarking, prompt/context engineering.
  • Genuine day-to-day AI usage; comfortable owning build-vs-buy/architecture calls; shipping an AI product in production is a must.
About us

Nimble is the real-time web search platform built for enterprise accuracy, completeness, and trust. We run Web Search Agents that actively navigate live websites using real browsers and reasoning, turning the public web into governed, decision-grade data for AI systems and high-stakes business use.

Unlike index-based “AI search” tools or brittle legacy scraping, Nimble makes the live web queryable on demand, delivering structured outputs that teams can verify and rely on. Our platform powers use cases where correctness matters: financial due diligence, real-time pricing and promotions, market intelligence, and AI systems that depend on fresh, complete data.

Trusted by leading enterprises like Home Depot, Uber, and Coca-Cola and backed by top-tier investors, Nimble sits at the intersection of AI, automation, and real-time web intelligence.

As demand accelerates across AI, LLMs, and data-driven decisioning, we’re scaling quickly and looking for high-energy, driven teammates who thrive in fast-moving environments and want to help define a new category.

Why join Nimble?

  • Work on a deeply technical platform powering real-time AI and enterprise decisions
  • Help define the future of Web Search Agents and live web intelligence
  • Build alongside a sharp, mission-driven team that moves fast, ships often, and takes ownership

Skills Required

  • 3+ years of experience as a Team Lead across at least two workplaces
  • Strong leadership, communication, people-management, and team-health skills
  • Ability to operate independently without a dedicated Product Manager and communicate directly with customers
  • 6+ years of experience as a Back-End Engineer
  • High-scale, production data-pipeline experience
  • Strong Python experience
  • Ability to architect solutions from scratch and deliver on time
  • Startup experience
  • Hands-on AI engineering experience with LLMs, agentic architectures, evaluation or benchmarking, and prompt or context engineering
  • Day-to-day AI usage and ability to make build-versus-buy and architecture decisions
  • Experience shipping an AI product to production
  • Enterprise experience
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Monica, CA
140 Employees
Year Founded: 2021

What We Do

Nimble enables your AI agents and teams to stream the precise intelligence they need from the live web, powered by infrastructure built to reliably access even the most complex, difficult-to-reach data.

Similar Jobs

monday.com Logo monday.com

Senior Product Manager

Artificial Intelligence • Productivity • Sales • Software
Hybrid
Tel Aviv, ISR
3155 Employees

Datadog Logo Datadog

Account Executive

Artificial Intelligence • Cloud • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
Israel
6500 Employees

Riskified Logo Riskified

Partnership Manager

Big Data • eCommerce • Fintech • Machine Learning • Payments • Software
Hybrid
Tel Aviv, ISR
680 Employees

monday.com Logo monday.com

Customer Success Manager

Artificial Intelligence • Productivity • Sales • Software
Hybrid
Tel Aviv, ISR
3155 Employees

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account