Prompt Engineer (LLM Systems, Evals & Safety)

Posted 25 Days Ago
Be an Early Applicant
Hiring Remotely in Amman, JOR
In-Office or Remote
Entry level
Events • Mobile • Software • Travel
The Role
Design and optimize prompts, system instructions, and tooling for accurate, safe, and cost-effective LLM features. Build evaluation harnesses, datasets, rubrics, metrics, prompt libraries, versioning, A/B tests, and telemetry. Reduce hallucinations through verification, constrained decoding, and tool use. Implement jailbreak, prompt-injection, content-policy, and PII safeguards while partnering with engineers to integrate prompt systems into production.
Summary Generated by Built In

Do you want to love what you do at work? Do you want to make a difference, an impact, and transform peoples lives? Do you want to work with a team that believes in disrupting the normal, boring, and average?

If yes, then this is the job you are looking for , webook.com is Saudi’s #1 event ticketing and experience booking platform in terms of technology, features, agility, revenue serving some of the largest mega events in the Kingdom surpassing over 2 billion in sales.  

Role Overview

Design high-quality prompts, system instructions, and tooling that make our LLM features accurate, safe, and cost-effective. You’ll own evaluation, prompt versioning, and continuous improvement.

Key Responsibilities:

  • Author, refactor, and chain prompts (system/tool/policy) for varied tasks.
  • Create offline/online evaluation harnesses (rubrics, golden sets, metrics).
  • Build prompt libraries with versioning, A/B testing, and telemetry.
  • Reduce hallucinations via verification, constrained decoding, and tool use.
  • Implement safety: jailbreak/prompt-injection tests, content policy checks, PII handling.
  • Partner with engineers to integrate prompts into production features.

Requirements
  • Demonstrated prompt design across multiple task types and models.
  • Experience building eval datasets and automated scoring (e.g., accuracy, faithfulness, utility, cost/latency).
  • Familiarity with retrieval-augmented generation concepts and tool/function calling.
  • Strong scripting (Python/TypeScript) for data prep, evals, and analysis.
  • Clear writing; ability to translate business goals into measurable prompt specs.
Nice-to-Haves
  • Experience with LangChain/LLM orchestration, vector stores, and rerankers.
  • Knowledge of safety tooling and red-teaming techniques.
  • Experiment platforms (feature flags, A/B tests), analytics.

Skills Required

  • Demonstrated prompt design experience across multiple task types and models
  • Experience building evaluation datasets and automated scoring for accuracy, faithfulness, utility, cost, and latency
  • Familiarity with retrieval-augmented generation concepts
  • Familiarity with tool and function calling
  • Strong scripting skills in Python or TypeScript for data preparation, evaluations, and analysis
  • Clear writing and ability to translate business goals into measurable prompt specifications
  • Experience with LangChain or LLM orchestration
  • Experience with vector stores and rerankers
  • Knowledge of safety tooling and red-teaming techniques
  • Experience with feature flags, A/B testing, and analytics platforms
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Riyadh
133 Employees
Year Founded: 2014

What We Do

webook.com is a Saudi Arabia-based super-app for entertainment, travel, and lifestyle. It serves as a one-stop platform for users to discover and book tickets for concerts, sporting events, cultural shows, flights, hotels, and restaurants. The platform integrates various services to provide a seamless experience for planning trips and outings, offering features like event notifications, secure ticket reselling, and dining reservations.

Similar Jobs

Capco Logo Capco

IT Technical Programme Manager

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
10 Locations
6000 Employees

Capco Logo Capco

PMO Analyst

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
10 Locations
6000 Employees

Capco Logo Capco

Project Manager

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
10 Locations
6000 Employees

Capco Logo Capco

Data Privacy & Security – Senior Manager

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
10 Locations
6000 Employees

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
US
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account