Web Researcher (AI Benchmarking)

Web Researcher (AI Benchmarking)

Web Researcher (AI Benchmarking)

Gramian Consulting Group

Brazil

8 minutos atrás

Nenhuma candidatura

Sobre

  • About Us
  • Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
  • Role overview
  • Our client is building advanced evaluation benchmarks for frontier AI browsing agents.
  • We are looking for highly skilled investigative researchers who can design research problems that remain difficult even for state-of-the-art AI systems with full web access. This is not a traditional subject-matter or content-writing role. The work is centered on open-web investigation, evidence tracing, source validation, and benchmark construction.
  • You will begin from a verifiable fact, work backwards to construct a difficult research question, and document a complete, auditable evidence trail showing how the answer can be independently verified.
  • CONTRACT: Short-term freelance/contractor assignment, 8 weeka
  • COMMITMENT: 40 hours per week, at least 4 hours per day, including 4 hours overlap with PST
  • LOCATIONS: Remote, Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Indonesia, Turkey, Vietnam
  • Responsibilities
  • Design challenging open-web research problems for evaluating advanced AI browsing agents.
  • Start from objectively verifiable facts and construct questions that make those facts difficult to discover.
  • Build multi-step clue structures involving dates, people, places, organizations, works, events, records, and quantities.
  • Ensure every clue is independently verifiable and subject to clear constraints.
  • Research across government databases, institutional sources, archives, registries, and PDF documents.
  • Produce complete evidence trails citing exact pages, tables, sections, or records.
  • Record validation searches and document what obvious search approaches return.
  • Test whether research questions remain difficult across multiple search attempts.
  • Refine questions to eliminate ambiguity while preserving difficulty.
  • Deliver structured, reproducible research documentation.
  • Background in reference librarianship, archives, or special collections.
  • Experience in investigative journalism or professional fact-checking.
  • Experience with OSINT, due diligence, KYC, or investigative research.
  • Background in patent, prior-art, or legal-discovery research.
  • Experience with genealogy or historical records research.
  • Experience with competitive quizzing, puzzle design, or puzzle-hunt construction.
  • Familiarity with JSON or structured data formats.