Senior Data Engineer (AI/ML)

Posted 3 Days Ago
Hiring Remotely in India
Remote
Senior level
Food • Mobile
The Role
Design and build scalable data and AI infrastructure for production LLM applications. Responsibilities include developing RAG systems, embedding and vector retrieval pipelines, AI agents, LLM evaluation and observability frameworks, and batch or streaming data platforms using Databricks, Spark, Snowflake, Delta Lake, and Airflow. The role also involves optimizing distributed workloads, establishing data governance and quality practices, and partnering with engineering and product teams to productionize AI capabilities.
Summary Generated by Built In
This role is 100% remote across India location
About OpenTable

With millions of diners, 70,000+ restaurant partners and 25+ years of experience, OpenTable, part of Booking Holdings, Inc. (NASDAQ: BKNG), is an industry leader with a passion for helping restaurants thrive. Our world-class technology empowers restaurants to focus on what matters most – their team, their guests, and their bottom line – while enabling diners to discover and book the perfect restaurant for every occasion. 

Every employee at OpenTable has a tangible impact on what we do and how we do it. You’ll also be part of a global team and its portfolio of metasearch brands. Hospitality is all about taking care of others, and it defines our culture.

About Role

We are looking for a Senior Data Engineer – AI/ML to help build the data and AI infrastructure powering our next generation of intelligent products and experiences.

This role combines modern data engineering with Generative AI. You will design scalable data platforms and pipelines while building production-grade solutions using LLMs, RAG, embeddings, vector search, and AI agents. You will work closely with data scientists, ML engineers, software engineers, and product teams to turn AI capabilities into reliable, scalable production systems.

What You'll Do
  • Design and build AI/LLM data pipelines supporting training, inference, evaluation, embeddings, and retrieval workloads.

  • Build production-grade RAG systems, including ingestion, chunking, embedding generation, indexing, retrieval, reranking, and context construction.

  • Develop AI applications using LLMs, structured outputs, function/tool calling, and agentic workflows.

  • Build and optimize semantic search and vector retrieval systems.

  • Develop frameworks for LLM evaluation, monitoring, tracing, quality measurement, latency, and cost optimization.

  • Design scalable batch and streaming pipelines using Databricks, Apache Spark, Delta Lake, Snowflake, and Airflow.

  • Build data products and platforms that make structured and unstructured enterprise data accessible to AI applications.

  • Develop reliable ETL/ELT pipelines and optimize large-scale distributed workloads for performance and cost.

  • Establish data quality, governance, lineage, security, and observability practices.

  • Partner with ML and application engineering teams to move AI prototypes into production-ready systems.

Required Qualifications
  • 5+ years of experience in data engineering, software engineering, distributed systems, or a related field.

  • Strong programming skills in Python and/or Scala/Java and advanced SQL.

  • Hands-on experience with Databricks, Snowflake, Apache Spark, Delta Lake, and Airflow.

  • Strong experience with cloud data platforms such as Snowflake and/or Databricks.

  • Practical experience building applications using LLMs or Generative AI.

  • Strong understanding of RAG architectures, embeddings, vector databases, semantic search, and retrieval systems.

  • Familiarity with LLM concepts including prompting, structured outputs, tool calling, and model evaluation.

  • Experience designing scalable, reliable, and observable production data systems.

Preferred Qualifications
  • Deep experience designing large-scale data platforms, distributed processing systems, and complex data workflows.

  • Strong experience with real-time and streaming data architectures, including Kafka, Spark Structured Streaming, or similar technologies.

  • Experience building low-latency data pipelines and event-driven architectures.

  • Experience designing complex multi-stage ETL/ELT and data orchestration workflows using Airflow or similar platforms.

  • Experience optimizing Spark/Databricks workloads, including partitioning, clustering, caching, joins, and compute optimization.

  • Experience building data platforms supporting both batch and real-time AI/ML workloads.

  • Experience with LLM and AI evaluation frameworks, including automated evaluations, offline/online evaluation, quality metrics, and experimentation.

  • Experience building evaluation datasets and pipelines for measuring LLM/RAG/agent quality, accuracy, relevance, latency, and cost.

  • Experience with AI observability and tracing, including token usage, model performance, latency, failures, and production monitoring.

  • Experience with LangGraph, LangChain, LlamaIndex, or similar AI orchestration frameworks.

  • Experience with vector databases such as Qdrant, Pinecone, Weaviate, or Databricks Vector Search.

  • Experience with Kafka, MLflow, Unity Catalog, Databricks Mosaic AI, or model-serving platforms.

  • Experience building data quality, lineage, governance, and data/AI observability frameworks.

  • Strong understanding of distributed systems, cloud architecture, APIs, CI/CD, and production operations.

Impact

You will help build the data and AI foundation for intelligent products, combining large-scale data engineering, streaming systems, and modern Generative AI to deliver reliable, scalable, measurable, and production-ready AI systems.

Benefits
  • Work from (almost) anywhere for up to 20 days per year

  • Focus on mental health and well-being:

    • Company-paid therapy sessions through SpringHealth

    • Company-paid subscription to Headspace

    • Annual company-wide week off a year - the whole team fully recharges (and returns without a pile-up of work!)

  • Paid parental leave

  • Generous paid vacation + time off for your birthday

  • Paid volunteer time

  • Focus on your career growth:

    • Development Dollars

    • Leadership development

    • Access to thousands of on-demand e-learnings

  • Travel Discounts

  • Employee Resource Groups

  • Quarterly team offsites

  • Tax optimisation options

  • Generous health insurance

  • Pension fund

Work Environment & Flexibility

At OpenTable, we pride ourselves on fostering a global and dynamic work environment. As a team member with us, you will benefit from a schedule tailored to accommodate a global workforce operating across multiple time zones. While the majority of your responsibilities may align with conventional business hours, there will be instances where you are expected to manage communications - via calls, Slack messages, or emails - outside of regular working hours to effectively collaborate with international colleagues, respond to restaurant partners, and/or address urgent matters. OpenTable will always abide by and consider local laws and regulations.

Inclusion

We’re committed to creating a workplace where everyone feels they belong and can thrive. We know the best ideas come when we bring different voices to the table, so we're building a team as dynamic as the diners and restaurants we serve—and fostering a culture where everyone feels welcome to be themselves.

If you need accommodations during the application or interview process, or on the job, we’re here to support you. Please reach out to your recruiter to request any accommodations.
#LI-Remote #LI-MK1 

Skills Required

  • 5+ years of experience in data engineering, software engineering, distributed systems, or a related field
  • Strong programming skills in Python and/or Scala/Java
  • Advanced SQL skills
  • Hands-on experience with Databricks, Snowflake, Apache Spark, Delta Lake, and Airflow
  • Strong experience with cloud data platforms such as Snowflake and/or Databricks
  • Practical experience building applications using LLMs or Generative AI
  • Strong understanding of RAG architectures, embeddings, vector databases, semantic search, and retrieval systems
  • Familiarity with prompting, structured outputs, tool calling, and model evaluation
  • Experience designing scalable, reliable, and observable production data systems
  • Experience designing large-scale data platforms, distributed processing systems, and complex data workflows
  • Experience with real-time and streaming data architectures, including Kafka or Spark Structured Streaming
  • Experience building low-latency data pipelines and event-driven architectures
  • Experience designing complex multi-stage ETL/ELT and data orchestration workflows
  • Experience optimizing Spark or Databricks workloads
  • Experience building data platforms supporting batch and real-time AI/ML workloads
  • Experience with LLM and AI evaluation frameworks
  • Experience building evaluation datasets and pipelines for LLM, RAG, or agent quality measurement
  • Experience with AI observability and tracing
  • Experience with LangGraph, LangChain, LlamaIndex, or similar AI orchestration frameworks
  • Experience with vector databases such as Qdrant, Pinecone, Weaviate, or Databricks Vector Search
  • Experience with Kafka, MLflow, Unity Catalog, Databricks Mosaic AI, or model-serving platforms
  • Experience building data quality, lineage, governance, and data or AI observability frameworks
  • Strong understanding of distributed systems, cloud architecture, APIs, CI/CD, and production operations

OpenTable Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about OpenTable and has not been reviewed or approved by OpenTable.

  • Leave & Time Off Breadth Time off is positioned as generous, including ample PTO, company-wide recharge time, and additional one-off days such as a birthday/celebration day. Paid volunteer time is also included, reinforcing a broad time-off offering beyond standard vacation and holidays.
  • Wellbeing & Lifestyle Benefits Wellbeing support is positioned as a meaningful part of the package, including company-paid therapy sessions and a paid mindfulness subscription. Flexibility policies such as meeting-free Fridays and “work from (almost) anywhere” are also framed as lifestyle-supporting benefits.
  • Strong & Reliable Incentives Variable pay and upside are highlighted for some roles, especially sales positions where on-target earnings and accelerators can meaningfully raise take-home pay when goals are met. Some postings also indicate eligibility for annual bonuses in certain roles.

OpenTable Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
1,891 Employees
Year Founded: 1998

What We Do

With millions of diners, tens of thousands of restaurants, and 20+ years of experience, OpenTable, part of Booking Holdings, Inc. (NASDAQ: BKNG), is an industry leader with a unique insight into the world of hospitality. We champion restaurants, bars, wineries, and other venues around the world, helping them attract guests, manage capacity, improve operations, and maximize revenue. Every employee at OpenTable has a tangible impact on what we do and how we do it. You’ll also be part of a global network that includes OpenTable and KAYAK's portfolio of travel brands including Swoodoo, checkfelix, momondo, Cheapflights, Mundi and HotelsCombined.

Why Work With Us

Hospitality is all about taking care of others, and it defines our culture. You’ll work in a welcoming and inclusive environment, and get the benefits, flexibility, and support you need to succeed.

Similar Jobs

In-Office or Remote
2 Locations
1151 Employees

Pfizer Logo Pfizer

Senior Manager, Scientific Learning, Medical Academy

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
26 Locations
121990 Employees

Micron Technology Logo Micron Technology

Equipment Engineer - GEL

Artificial Intelligence • Hardware • Information Technology • Machine Learning
Remote
Gujarat, IND
45000 Employees

Micron Technology Logo Micron Technology

Sr. Gas Engineer (Facilities Operations)

Artificial Intelligence • Hardware • Information Technology • Machine Learning
Remote
Gujarat, IND
45000 Employees

Similar Companies Hiring

ARB Interactive Thumbnail
Gaming • Mobile • Software
Miami, Florida
190 Employees
Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
Amalgamated Sugar Thumbnail
Food • Greentech • Agriculture • Industrial • Manufacturing
Boise, Idaho
768 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account