PaperfootJoin free
arXiv

Small search agent beats rivals on almost all research benchmarks

Researchers built Glasseek, an open search framework whose nine-billion-parameter agent achieved the best overall performance among recent open-weight models on deep research benchmarks.

Paper by Cong Pang, Jiaqi Su, Chengrui Wu, 13 more authorsXin Lou
A large light blue maze holds a continuous black path and stacked sheets beside loose pages and a smaller, fragmented dark blue-green maze.
Preprint: new model

Edited by Boris Djordjevic · Paperfoot

Paper

In a preprint, researchers introduced Glasseek, an open deep-search model framework releasing all training data, model weights, and code, evaluated on deep research benchmarks across diverse task types. Deep-search systems use software agents to answer complex questions through repeated web searches. To build training data, the framework generates verifiable exploration paths. A specialized training method optimizes the search policy across context compaction, which compresses gathered text to fit memory limits. To prevent models from finding benchmark content online during testing, the team audited web leakage and released an anti-leakage tool.

Tested under this protocol, their nine-billion-parameter agent outperformed leading commercial models across almost all deep research benchmarks. The agent also achieved the best overall performance among recent open-weight models, setting a new state of the art for its size.

Why it matters

The framework provides a fully open recipe that lets researchers reproduce and build capable deep-search systems without relying on closed commercial services. Across deep research benchmarks spanning diverse task types, the findings show that a compact nine-billion-parameter open model can outperform leading commercial agents when data, training, and evaluation are carefully controlled.

Caveats

The abstract does not report numerical scores, the specific commercial baselines tested, or whether performance varied across runs. In addition, the paper is a preprint that has not yet been peer-reviewed.

In this paper

deep search

Methods
Glasseek (this paper)Compaction-Managed GSPO (CM-GSPO) (this paper)Glasseeker-9B (this paper)Glasseeker-4B (this paper)GSPO (baseline)Compaction RL (baseline)SFT (baseline)GPT-5.2 (baseline)Claude-Opus-4.5 (baseline)Gemini-3-Pro (baseline)Doubao-Seed-2.0-Pro (baseline)DeepSeek-V4-Pro (baseline)
Datasets
BrowseComp (evaluated)BrowseComp-ZH (evaluated)xbench-DeepSearch-2510 (evaluated)Seal-0 (evaluated)LiveBrowseComp (evaluated)GAIA (evaluated)GAIA-Text (evaluated)XDS-2510 (evaluated)
Links
CodeProject pageProject page

Results

Glasseeker-9B, score, on Seal-0: 50.0; Glasseeker-9B, score, on LiveBrowseComp: 31.3; Glasseeker-9B, score, on BrowseComp: 61.6; Glasseeker-9B, score, on BrowseComp-ZH: 64.0

… it surpasses GPT-5.2 on Seal-0 (50.0 vs. 42.3) and LiveBrowseComp (31.3 vs. 28.0), and exceeds Gemini-3-Pro on both BrowseComp (61.6 vs. 59.2) and BrowseComp-ZH (64.0 vs. 60.2), while trailing the strongest proprietary systems such as Doubao-Seed-2.0-Pro on most benchmarks with available results …

5.2 Main Results

Glasseeker-4B, score, on BrowseComp: 49.0

… outperforms DeepSearch-World-9B on BrowseComp, BrowseComp-ZH, and GAIA-Text, and even exceeds the 27B-scale OpenSeeker-v2 on BrowseComp (49.0 vs. 46.0), demonstrating that our training recipe yields strong parameter efficiency even at the smallest scale …

5.2 Main Results

SFT, score, on BrowseComp: 55.5

Notably, the SFT baseline alone already outperforms most comparably-sized baselines in Table 2 (e.g., 55.5 on BrowseComp), reaffirming the high quality of our synthetic search data independent of the subsequent RL stage.

5.3 Ablation Study

What it shows

Glasseeker-9B outperforms frontier proprietary agents across almost all deep research benchmarks spanning diverse task types and sets a new state of the art at the 9B scale.

Under this rigorous evaluation protocol, our 9B agent outperforms frontier proprietary agents across almost all deep research benchmarks spanning diverse task types, and achieves the best overall performance among recent open-weight agents, setting a new state of the art at the 9B scale.

Abstract

Turn-level clipping and subtrajectory reweighting are critical for stabilizing policy optimization over long, multi-turn search trajectories beyond what context compaction alone achieves.

These results demonstrate that turn-level clipping and subtrajectory reweighting are critical for stabilizing policy optimization over long, multi-turn search trajectories, beyond what context compaction alone can achieve.

5.3 Ablation Study

Quoted word for word from the full text on arXiv.

The paper

Glasseek: A Transparent Recipe for Training and Trustworthy Evaluation of DeepSearch Agents

Cong Pang, Jiaqi Su, Chengrui Wu, 13 more authorsXin Lou

arXiv, Oct 12, 2026, Open access, CC BY, Preprint, not peer-reviewed

doi.org/10.48550/arxiv.2610.16998

arXiv:2610.16998v1 in cs.AI

AbstractPDFHTML

Cite as BibTeX
@misc{pang2026glasseek,
  title = {Glasseek: A Transparent Recipe for Training and Trustworthy Evaluation of DeepSearch Agents},
  author = {Pang, Cong and Su, Jiaqi and Wu, Chengrui and Yan, Kuihao and Zhang, Tianrui and Qiu, Zixuan and Lin, Chao and Lin, Zixiu and Chen, Zixuan and Xiao, Zelin and Yao, Tiankuo and Hong, Jiawei and Chen, Zixuan and Xu, Dan and Lu, Lewei and Wang, Wenjie and Lou, Xin},
  year = {2026},
  eprint = {2610.16998},
  archivePrefix = {arXiv},
  primaryClass = {cs.AI},
  doi = {10.48550/arxiv.2610.16998},
  url = {https://arxiv.org/abs/2610.16998}
}

Related