AI agents train a small model to match official test scores
After 104 hours, the agents’ model averaged 48.2 on hidden tests, against 47.9 for the official instruction-trained version and 9.2 for the starting model.
Edited by Boris Djordjevic · Paperfoot
Researchers built Athanor, an open system for autonomous AI-training research, and tested it by having agents train a small model on public data using graphics chips. Four Claude Opus 5.5 agents worked for 104 hours, each with eight chips and no research advice. They built training data, changed training algorithms and chose subsequent experiments.
Their trained Qwen3-4B-Base model averaged 67.3 across six development tasks and 48.2 on a test suite hidden from the agents. The starting model scored 15.9 and 9.2, respectively. The official Qwen3-4B-Instruct-2507, a version trained to follow instructions, scored 66.5 and 47.9. The agents reached these scores by combining known training methods and models produced by other agents.
Why it matters
Athanor provides a way to test whether agents can conduct model-training research rather than just suggest experiments. This campaign demonstrated that ability on real hardware, with average scores matching or surpassing the official version on these test suites.
Caveats
The campaign tested a small model in a sandbox and barred external teacher models. The paper is a preprint, not yet peer-reviewed.
In this paper
autonomous post-training research
- Methods
- Athanor (this paper)Qwen3-4B-Instruct-2507 (baseline)Claude Opus 5.5Qwen3-4B-Base
- Datasets
- six-task development suite (evaluated)held-out suite (evaluated)
What it shows
- To the best of the authors' knowledge, this is the first demonstration that frontier agents can autonomously post-train a raw base model into a cross-domain generalist model matching or surpassing the official instruct version on average.
To our knowledge, this is the first demonstration that a team of frontier agents can autonomously post-train a raw base model into a cross-domain generalist model that matches or surpasses the official instruct version on average.
Abstract
- Agents reached their performance level by recombining known methods and each other's models, including SFT on public reasoning data, RL with an introduced rollout change, weight merges across agents, and rounds of self-distillation.
The campaign's full record shows that the agents reach this level by recombining known methods and each other's models: SFT on public reasoning data, RL with a rollout change one agent introduced, weight merges across agents, and rounds of self-distillation.
Abstract
- With execution handled, today's agents already possess the engineering and research ability to conquer autonomous post-training of a raw base model.
With execution handled, today's agents already have the engineering and research ability to conquer this task.
Abstract
Quoted word for word from the abstract on arXiv.
The paper
Athanor: An Agent-Native System for Autonomous Post-Training Research
arXiv, Oct 15, 2026, Open access, Preprint, not peer-reviewed