QUEST: Training Frontier Deep Research Agents with Fully Synthetic Tasks

Jian Xie, Tianhe Lin, Zilu Wang, Yuting Ning, Yuekun Yao, Tianci Xue, Zhehao Zhang, Zhongyang Li, Kai Zhang, Yufan Wu, Shijie Chen, Boyu Gou, Mingzhe Han, Yifei Wang, Vint Lee, Xinpeng Wei, Xiangjun Wang, Yu Su, Huan Sun

arXiv:2605.24218 · 2026-05-26 공개 · arXiv · PDF

reinforcement-learning benchmarking supervised-fine-tuning data-synthesis long-horizon-reasoning context-management deep-research-agents synthetic-tasks

Abstract

Deep research agents extend the role of search engines from retrieving keyword-matched pages to synthesizing knowledge, fundamentally changing how humans interact with information. However, frontier systems remain proprietary, while existing open agents often generalize poorly across different task types, leaving unclear how to train a broadly capable deep research agent. We release QUEST, a family of open models (ranging from 2B to 35B) that serve as general-purpose deep research agents designed to handle a wide range of long-horizon search tasks, with strong capabilities in fact seeking, citation grounding, and report synthesis. To build QUEST, we propose an effective training recipe combining mid-training, supervised fine-tuning, and reinforcement learning. Central to this recipe is a curated data synthesis pipeline based on unified rubric trees, which applies to different task types and enables synthesizing training data with verifiable rewards without human annotation. In addition, QUEST incorporates a built-in context management mechanism that enables effective long-horizon reasoning and knowledge synthesis. Using only 8K synthesized tasks, QUEST approaches or even surpasses frontier closed-source agents across eight deep research benchmarks spanning diverse task types, and achieves the best overall performance among recent open-weight agents. We released everything: models, data, and training scripts.

한국어 요약

📋 한 줄 요약

**[Deep Research Agent / 합성 데이터]** QUEST가 2B~35B open model family를 8K 합성 task만으로 학습 — unified rubric tree로 task type 무관 합성 가능, 8 deep research 벤치에서 frontier closed agent에 근접·능가, open-weight SOTA.

🎯 핵심 기여도

💡 핵심 아이디어

Deep research agent의 broad 능력 달성은 task별 데이터 큐레이션이 아니라 unified rubric tree로 task type 무관 합성 가능한 verifiable-reward 데이터 + mid-training/SFT/RL의 체계 레시피 + long-horizon context management의 결합으로 가능하며, 단 8K 합성 task만으로 frontier closed agent에 근접·능가할 수 있다.

🔬 기술적 접근법

📊 주요 결과

💭 의의 및 한계

**의의**: Frontier deep research agent의 open 대안을 제공, unified rubric tree로 task 합성의 일반 레시피 정립, 8K task의 데이터 효율성, 모델·데이터·코드 전체 공개로 community 가속. **한계**: 8K 합성 task의 다양성·realistic distribution shift 처리는 후속, rubric tree 설계 품질이 verifiable reward 효과를 결정, very long-horizon task에서의 context management 한계 가능.

🚀 실용적 활용