←︎ Lab · Jatin HansBeane · deep research harness

Beane · built by Jatin Hans

#1 globally on DeepResearch Bench II.

#2 on DeepResearch Bench Ahead of every OpenAI, Google and Perplexity entry on both boards

I built Beane, a deep research harness. It reads around a hundred sources, checks every quote against the page it came from, and hands back a report with a numbered source behind each claim.

DeepResearch Bench II #1 globally DeepResearch Bench #2 0.58 points behind first Official
listing
Oct 2026

DeepResearch Bench I and II

Official leaderboard, GPT-5.5 judge

#1of 9DeepResearch Bench IIScore 60.52, 1.55 ahead of second
#2of 18DeepResearch BenchScore 56.14, 0.58 behind first

232 research tasks across 22 fields, in English and Chinese, built from expert-written work. Judged by the benchmarks' maintainers and listed on 28 October 2026.

Also on these boards:

  • OpenAI
  • Google
  • Perplexity
  • xAI
  • ByteDance
  • Alibaba Cloud
BeaneOther systems on both boards
Systems listed on both boards: DeepResearch Bench score across, DeepResearch Bench II score up. Beane 56.14 and 60.52, highest on both among them. 40 44 48 52 56 30 40 50 60 DeepResearch Bench score DeepResearch Bench II score better on both ↗︎ Beane 56.14 · 60.52 SPIA DeepResearch 55.12 · 58.97 ATH-Voicepica (Alibaba Cloud) 55.99 · 57.59 Deep Cove Research Pro 55.71 · 57.02 Gemini 2.5 Pro Deep Research 49.98 · 39.89 OpenAI Deep Research 47.84 · 43.12 Perplexity Research 43.05 · 33.57 Systems listed on both boards: DeepResearch Bench score across, DeepResearch Bench II score up. Beane 56.14 and 60.52, highest on both among them. 40 44 48 52 56 30 40 50 60 DeepResearch Bench score DeepResearch Bench II score better on both ↗︎ Beane SPIA DeepResearch ATH-Voicepica Deep Cove Research Pro Gemini 2.5 Pro DR OpenAI Deep Research Perplexity Research

Official GPT-5.5 leaderboards. OpenAI Deep Research is listed as GPT-o3 Deep Research on DeepResearch Bench II. CellCog Max, first on DeepResearch Bench at 56.72, is not on DeepResearch Bench II.

Built so that the best systems fall short.

BeaneProducts from OpenAI, Google, ByteDance, Perplexity, xAI and Alibaba CloudOther systemsThe bar each benchmark sets
DeepResearch Bench II132 tasks · 9,430 expert-reviewed checks
9 entries on the board
#1 · 60.521.55 ahead of SPIA DeepResearch, 17.4 ahead of OpenAI's o3 Deep Research
DeepResearch Bench II, every entry on the official board by score: Beane first at 60.52, SPIA DeepResearch 58.97, OpenAI's o3 Deep Research 43.12; the best systems scored under 50 when the benchmark was published. 30 65 BEST AT LAUNCH: UNDER 50 Perplexity 33.57 Doubao, ByteDance 37.26 Gemini 2.5 Pro DR 39.89 Gemini 3 Pro DR 41.52 OpenAI o3 DR 43.12 Deep Cove Pro 57.02 ATH-Voicepica, Alibaba Cloud 57.59 SPIA 58.97 Beane 60.52 DeepResearch Bench II, every entry on the official board by score: Beane first at 60.52, SPIA DeepResearch 58.97, OpenAI's o3 Deep Research 43.12; the best systems scored under 50 when the benchmark was published. 30 65 UNDER 50 AT LAUNCH Beane 60.52

Above the bar

Beane 60.52SPIA 58.97ATH-Voicepica 57.59Deep Cove Pro 57.02

Below the bar

OpenAI o3 DR 43.12Gemini 3 Pro DR 41.52Gemini 2.5 Pro DR 39.89Doubao 37.26Perplexity 33.57
DeepResearch Bench100 PhD-level tasks · 22 fields
18 entries on the board
#2 · 56.140.58 from first place, 8.3 ahead of OpenAI Deep Research
DeepResearch Bench, every entry on the official board by score: CellCog Max first at 56.72, Beane second at 56.14, 12 more systems from 51.12 to 55.99, Gemini 2.5 Pro Deep Research 49.98, OpenAI Deep Research 47.84; 50 is level with the reference report. 40 60 THE REFERENCE REPORT = 50 Grok, xAI 41.22 Perplexity 43.05 OpenAI Deep Research 47.84 Gemini 2.5 Pro DR 49.98 #1 CellCog Max 56.72 #2 Beane 56.14 0.58 from first place 12 more systems, 51.12 to 55.99 8.3 points ahead of OpenAI Deep Research DeepResearch Bench, every entry on the official board by score: CellCog Max first at 56.72, Beane second at 56.14, 12 more systems from 51.12 to 55.99, Gemini 2.5 Pro Deep Research 49.98, OpenAI Deep Research 47.84; 50 is level with the reference report. 40 60 REFERENCE = 50 #1 CellCog Max 56.72 #2 Beane 56.14 0.58 from first place 8.3 ahead of OpenAI Deep Research

Above the reference

#1 CellCog Max 56.72#2 Beane 56.1412 more, 51.12 to 55.99

Below the reference

Gemini 2.5 Pro DR 49.98OpenAI Deep Research 47.84Perplexity 43.05Grok, xAI 41.22

Every entry on each official GPT-5.5 leaderboard, listed 28 October 2026, one dot each; DR is Deep Research. The bars come from the papers: the strongest systems tested in DeepResearch Bench II met under half its checks, and 50 is level with the reference report in DeepResearch Bench.

Ahead of every OpenAI, Google and Perplexity entry.

On both boards, against each company's best entry.

vs OpenAI +17.4 points ahead of o3 Deep Research on DeepResearch Bench II, and 8.3 ahead of OpenAI Deep Research on DeepResearch Bench. DeepResearch Bench II
Beane60.52
o3 Deep Research43.12
DeepResearch Bench
Beane56.14
OpenAI Deep Research47.84
vs Google +19.0 points ahead of Gemini 3 Pro Deep Research on DeepResearch Bench II, and 6.2 ahead of Gemini 2.5 Pro Deep Research on DeepResearch Bench. DeepResearch Bench II
Beane60.52
Gemini 3 Pro Deep Research41.52
DeepResearch Bench
Beane56.14
Gemini 2.5 Pro Deep Research49.98
vs Perplexity +27.0 points ahead of Perplexity Research on DeepResearch Bench II, and 13.1 ahead on DeepResearch Bench. DeepResearch Bench II
Beane60.52
Perplexity Research33.57
DeepResearch Bench
Beane56.14
Perplexity Research43.05
See both full leaderboards and the scores by dimension
DeepResearch Bench II · total score
Beane60.52
SPIA DeepResearch58.97
ATH-Voicepica57.59
Deep Cove Research Pro57.02
OpenAI o3 Deep Research43.12
Gemini 3 Pro Deep Research41.52
Gemini 2.5 Pro Deep Research39.89
Doubao Deep Research (ByteDance)37.26
Perplexity Research33.57

All nine entries.

DeepResearch Bench IITotalFacts recalledAnalysisPresentation
Beane60.5256.766.387.8
SPIA DeepResearch58.9754.766.088.0
OpenAI o3 Deep Research43.1238.246.383.6
Gemini 3 Pro Deep Research41.5236.744.084.9
Perplexity Research33.5729.136.073.5
DeepResearch Bench · RACE overall
CellCog Max56.72
Beane56.14
ATH-Voicepica55.99
SPIA DeepResearch V255.85
Deep Cove Research Pro55.71
9 more systems, 51.12 to 55.29
Gemini 2.5 Pro Deep Research49.98
OpenAI Deep Research47.84
Perplexity Research43.05
Grok Deeper Search (xAI)41.22

The top five, nine more systems between 51.12 and 55.29, then the entries from Google, OpenAI, Perplexity and xAI.

DeepResearch BenchOverallComprehensiveInsightInstructionsReadability
CellCog Max56.7257.0657.6756.5853.81
Beane56.1456.7256.9356.1752.81
ATH-Voicepica55.9956.3756.7755.9253.27
SPIA DeepResearch V255.8556.2556.7455.7052.96
OpenAI Deep Research47.8448.0546.6949.2947.62

Inside the harness.

Small models do the reading. Code does the checking.

Each stage gets the smallest model that does its job. A model picks which page is worth opening; code checks that every quote is on its page.

98 on the smallest tier: reading, extracting, checking 2 on the mid and upper-mid tiers: writing, planning
Of every 100 model calls, about 5,100 a task
4,700

claim checks a task

Python finds each quote on its page first. No quote, no finding.

156

pages and PDFs read a task

Claims trace to a passage it read, not a search snippet.

Every

claim has its source

A number in brackets means that page says it. Anything derived is marked.

24 min

a task, start to finish

Runs side by side, and each can pause and pick up again.

Figures from Beane's first 100-task DeepResearch Bench run, October 2026.

Beane report, abridged · DeepResearch Bench task 72

AI and the Fourth Industrial Revolution: A Literature Review of Labor-Market Restructuring

AI is restructuring labor markets primarily by reallocating tasks, changing skill demand and hiring, and redesigning work, not through an established, uniform collapse in employment. Whether displacement becomes net job loss depends on complementary human tasks, new work, organizational choices, and demand growth; effects therefore differ across industries and workers.[5][10][1][2]

  • Hiring changes precede aggregate effects: US AI-adopting establishments reduced non-AI hiring and changed requested skills, but the study detected no differential occupation- or industry-level employment or wage-growth effect over its early observation period.[1][11][35]
  • Measured productivity gains are substantial but task-specific: Writing time fell 40% while quality rose 18%; customer-support output rose 15%; and software developers completed 26.08% more tasks in their respective studies.[40][42][13]

It began as a diagram on paper.

Most of the questions I have been paid to answer were research questions, and the answer always sat across forty browser tabs, three PDFs and a regulator's spreadsheet.

So I drew a researcher that does the reading properly and proves every claim in code, and built it with Claude as my pair programmer. The name comes from Billy Beane of Moneyball, who spent only where it won games. I do the same with models.

Your question
Clarifyenough to go on? if not, ask
Plansplit the question into research tasks
T1searchreadevidence
T2searchreadevidence
T3searchreadevidence
… Tnin parallel
Reportwritten from the evidence
Citeevery claim mapped to its source
Verify in codequotes, figures, links, coverage
Critiquefaithfulness · coverage · the brief
thin or unsupported?
back to Plan
passes
Your report