Senior Engineering Manager, Search Intelligence & Data Science

Posted Yesterday
Hiring Remotely in United States
Remote
190K-265K Annually
Senior level
Artificial Intelligence • Machine Learning
The Role
Leads Search Intelligence and Data Science teams, owning the Lucidworks AI platform and roadmap from research through production. Manages ML engineering, search engineering, team growth, cloud capacity and costs, model hosting, agent-driven development, evaluations, testing, and guardrails. Partners with Product and Engineering leadership to deliver generative AI, embeddings, and machine learning capabilities while improving team effectiveness, reliability, customer adoption, and organizational standards.
Summary Generated by Built In
Lucidworks is leading digital transformation for some of the world's biggest retailers, financial services firms, manufacturers, and B2B commerce organizations. We believe that the core to a great digital experience starts with search and browse. Our Deep Learning technology captures user behavior and utilizes machine learning to connect people with the products, content, and information they need. Brands including American Airlines, Lenovo, Red Hat, and Cisco Systems rely on Lucidworks' suite of products to power commerce, customer service, and workplace applications that delight customers and empower employees. Lucidworks believes in the power of diversity and inclusion to help us do our best work. We are an Equal Opportunity employer and welcome talent across a full range of backgrounds, orientation, origin, and identity in an inclusive and non-discriminatory way.

Please note: To ensure a fair and efficient process for all applicants, we kindly ask that you refrain from direct outreach to our hiring managers or team members. All communication should go through the official application portal. We will review your application carefully and reach out to you if your qualifications match our needs. We appreciate your interest in Lucidworks!

About the Role

You'll lead our Search Intelligence and Data Science teams and be the engineering owner of Lucidworks AI (LWAI), the platform that brings generative AI, embeddings, and ML into our clients' search experiences. You'll partner with Product on the roadmap, turn research into production capability, and lead the team's shift to AI-led development, where engineers direct AI agents across the software lifecycle. This role reports to the VP of Engineering.

Lucidworks offers SaaS-native solutions that couple with our flagship enterprise software product, Fusion, to power search and discovery for some of the world's largest companies. Our MLOps platform is central to that strategy, and your teams will contribute to both product lines. We integrate with the biggest generative AI providers, and we get strong performance out of open source embedding models and LLMs that we host ourselves.

What You'll Do

  • Lead, mentor, and grow a team of data scientists, ML engineers, and search engineers.

  • Own the LWAI and Search Intelligence roadmap with Product, from research through reliable production releases.

  • Lead the team's adoption of agent-driven development, with evals, tests, and guardrails designed in from the start.

  • Own platform capacity and cost, including model hosting, LLM provider, and token spend.

  • Collaborate with Engineering and Product leadership, as well as your peer managers, to set organization-wide standards and drive the state of the art forward, both in what we deliver and how we deliver it.

  • Be the face of LWAI internally, and with customers and partners when needed.

What We're Looking For

    Must-Haves

  • A track record leading engineering or data science teams that ship production ML/AI systems.

  • Cloud-native delivery experience (GCP preferred), including capacity and cost management.

  • The technical depth to read code and eval results, challenge a design, and stay current on AI.

  • Hands-on experience with AI coding agents (e.g., Claude Code, Codex, Cursor) and a point of view on how they change how teams work.

  • Clear communication with technical and non-technical audiences alike.

  • Nice-to-Haves

  • Search and information retrieval (Solr, Vespa, embeddings, RAG).

  • Hosting and tuning open source LLMs and embedding models.

  • Designing evals for LLM-driven systems.

Our Stack

    Core: Java, Python, Solr, Vespa, GCP, Kubernetes, commercial and self-hosted LLMs

What Success Looks Like

  • Lucidworks AI roadmap commitments ship on schedule, with measurable improvement in team cycle time.

  • Agent-driven workflows are standard practice on the team, with verification designed up front and low rates of escaped defects and breaking changes.

  • Research moves into production on a predictable path, and customers adopt current capabilities over legacy implementations.

  • The team is engaged, growing, and retained, and its workflows and practices are adopted by other Lucidworks engineering teams.

Competencies

  • Resourceful: willing to jump in, be agile and flexible, leverage existing resources to accomplish goals, and work independently

  • Team player: confident in collaborating with a diverse community of people and personalities across geographies, backgrounds, and professional abilities

  • Strong verbal and written communication skills

  • Empathy and care for all stakeholders of Lucidworks, including employees, customers, partners, and guests

  • Ability to handle confidential information

  • People leadership: inspires teams to operate at their highest potential through transparent, constructive feedback and active career development

  • Judgment: knows where agents add leverage, when to intervene, and when to stop and re-plan

  • Rigor: accepts no claim that work is done without evidence, and builds systems that verify automatically

How We Interview

    Our interview process mirrors the job. Alongside conversations about your leadership experience, you'll complete working sessions such as reviewing a proposed change to an existing ML or search system using the code and evaluation results as evidence, and walking through how you would plan, staff, and verify a roadmap deliverable on an agent-driven team.

    If you need an accommodation at any stage of the interview process, please let your recruiter know.

Travel

    This is a fully remote position, with periodic in-person gatherings for planning and team-building.

Lucidworks believes in the power of diversity and inclusion to help us do our best work. We are an Equal Opportunity employer and welcome talent across a full range of backgrounds, orientation, origin, and identity in an inclusive and non-discriminatory way. Applicants receive consideration based on the relevant talents, skills, and experiences they offer to our company.

Thank you for your interest and we look forward to learning more about you.

Note to third party recruiters:
We appreciate your interest in our job opportunities. However, we kindly request that third-party recruiters and staffing agencies refrain from contacting us regarding these positions. We prefer to work directly with candidates and do not accept unsolicited resumes or candidate referrals from third-party recruiters or agencies. Unsolicited resumes and referrals will become the property of Lucidworks, and no fee will be paid should we hire a candidate whose resume was sent unsolicited.

Skills Required

  • Track record leading engineering or data science teams that ship production ML or AI systems
  • Cloud-native delivery experience, preferably with GCP
  • Experience managing platform capacity and costs
  • Technical depth to read code and evaluation results, challenge designs, and stay current on AI
  • Hands-on experience with AI coding agents such as Claude Code, Codex, or Cursor
  • Clear communication with technical and non-technical audiences
  • Search and information retrieval experience, including Solr, Vespa, embeddings, or RAG
  • Experience hosting and tuning open-source LLMs and embedding models
  • Experience designing evaluations for LLM-driven systems
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
260 Employees
Year Founded: 2007

What We Do

Lucidworks is shaping the future of digital experiences, AI, and machine learning by offering the Connect Cloud Experience (CXC). We help companies combine the power of search and machine learning to personalize experiences that meet employees' and customers' unique intent. With technology built on Solr, the global search standard used by 90 percent of Fortune 500 companies, our team includes leading search and discovery contributors and committers as well as many of the world's foremost search and machine learning innovators. Teams at Lenovo, Morgan Stanley, Goop, Reddit, Red Hat, and Commvault rely on Lucidworks every day to power product discovery, customer service, and knowledge management applications. Lucidworks’ investors include Francisco Partners, Sixth Street Partners, Top Tier Capital Partners, Shasta Ventures, Granite Ventures, and Walden International.

Similar Jobs

SailPoint Logo SailPoint

Architect

Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Remote or Hybrid
United States
2461 Employees
143K-240K Annually

Circle Logo Circle

Principal AI & HR Systems Partner

Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3
In-Office or Remote
25 Locations
1050 Employees
173K-223K Annually
In-Office or Remote
Chicago, IL, USA
1934 Employees
100K-140K Annually

Zscaler Logo Zscaler

Senior Sales Engineer

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
Texas, USA
8697 Employees
155K-221K Annually

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
85 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account