Web Researcher (AI Benchmarking)

Posted Yesterday
Be an Early Applicant
6 Locations
Remote
Entry level
Artificial Intelligence • Information Technology • Professional Services • Consulting
The Role
Design difficult open-web research problems for benchmarking frontier AI browsing agents. Responsibilities include constructing multi-step questions, validating clues through government and institutional sources, tracing evidence across archives and PDFs, documenting auditable citations, testing search difficulty, eliminating ambiguity, and delivering reproducible research documentation.
Summary Generated by Built In

About Us

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

Role overview

Our client is building advanced evaluation benchmarks for frontier AI browsing agents.

We are looking for highly skilled investigative researchers who can design research problems that remain difficult even for state-of-the-art AI systems with full web access. This is not a traditional subject-matter or content-writing role. The work is centered on open-web investigation, evidence tracing, source validation, and benchmark construction.

You will begin from a verifiable fact, work backwards to construct a difficult research question, and document a complete, auditable evidence trail showing how the answer can be independently verified.

CONTRACT: Short-term freelance/contractor assignment, 8 weeka

COMMITMENT: 40 hours per week, at least 4 hours per day, including 4 hours overlap with PST

LOCATIONS: Remote, GLOBAL

Responsibilities
  • Design challenging open-web research problems for evaluating advanced AI browsing agents.
  • Start from objectively verifiable facts and construct questions that make those facts difficult to discover.
  • Build multi-step clue structures involving dates, people, places, organizations, works, events, records, and quantities.
  • Ensure every clue is independently verifiable and subject to clear constraints.
  • Research across government databases, institutional sources, archives, registries, and PDF documents.
  • Produce complete evidence trails citing exact pages, tables, sections, or records.
  • Record validation searches and document what obvious search approaches return.
  • Test whether research questions remain difficult across multiple search attempts.
  • Refine questions to eliminate ambiguity while preserving difficulty.
  • Deliver structured, reproducible research documentation.

Requirements
  • Background in reference librarianship, archives, or special collections.
  • Experience in investigative journalism or professional fact-checking.
  • Experience with OSINT, due diligence, KYC, or investigative research.
  • Background in patent, prior-art, or legal-discovery research.
  • Experience with genealogy or historical records research.
  • Experience with competitive quizzing, puzzle design, or puzzle-hunt construction.
  • Familiarity with JSON or structured data formats.

Skills Required

  • Background in reference librarianship, archives, or special collections
  • Experience in investigative journalism or professional fact-checking
  • Experience with OSINT, due diligence, KYC, or investigative research
  • Background in patent, prior-art, or legal-discovery research
  • Experience with genealogy or historical records research
  • Experience with competitive quizzing, puzzle design, or puzzle-hunt construction
  • Familiarity with JSON or structured data formats
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
6 Employees

What We Do

Gramian Consulting Group is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong foundation in software engineering and leadership, the firm helps organizations build high-performing teams by matching them with qualified professionals. They specialize in talent augmentation and recruiting, specifically focusing on connecting engineering and data/AI talent with organizations to unlock real business value.

Similar Jobs

Ericsson Logo Ericsson

Integration Engineer

Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Remote
Cairo, EGY
88000 Employees

Ericsson Logo Ericsson

BO EPC Engineer

Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
In-Office or Remote
2 Locations
88000 Employees

Ericsson Logo Ericsson

Integration Engineer

Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
In-Office or Remote
2 Locations
88000 Employees

Mondelēz International Logo Mondelēz International

Sourcing Manager

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
Cairo, EGY
90000 Employees

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account