Saaket Agashe, Yuzhe Yang, Gonzalo Gonzalez-Pumariega et al.
Computer-use agents are limited by the interfaces humans give them. An agent may type a spreadsheet cell by cell when a single line of code would do, or print all two…Computer-use agents are limited by the interfaces humans give them. An agent may type a spreadsheet cell by cell when a single line of code would do, or print all two thousand lines of a file through a shell to find one function.
Yeyin Eva Zhu, Rishabh Ranawat
RTL repair benchmarks should measure whether a model can fix broken RTL given a specification.RTL repair benchmarks should measure whether a model can fix broken RTL given a specification.
Rhea Sanjay Sukthanker, Riccardo Grazzi, James Hensman et al.
Post-training quantization (PTQ) compresses the weights of a trained model with limited compute and data.Post-training quantization (PTQ) compresses the weights of a trained model with limited compute and data. Down to 4 bits it is near-lossless, but at 2 bits scalar PTQ configurations fall to chance-level accuracy.
Zhenwei Tang, Di Bai, Jintao Liu et al.
Agents are starting to sell to other agents. Seller agents write the listings of tools, services and products, and buyer agents read these listings when they choose what…Agents are starting to sell to other agents. Seller agents write the listings of tools, services and products, and buyer agents read these listings when they choose what to use.
Sahil Joshi, Prithvi Dixit, Aryan Katiyar et al.
Large Language Model inference over long contexts is increasingly bottlenecked by the cost of attending to a growing Key-Value (KV) cache.Large Language Model inference over long contexts is increasingly bottlenecked by the cost of attending to a growing Key-Value (KV) cache.
Ethan Yang, Xiangcheng Shi
Multi-agent systems (MAS) built from language models are deployed on the premise that collaboration beats a single-agent system (SAS), yet when it pays is unclear.Multi-agent systems (MAS) built from language models are deployed on the premise that collaboration beats a single-agent system (SAS), yet when it pays is unclear.
Zhaoyang Wang, Qianhui Wu, Haorui Wang et al.
Agent learning is shifting from learning from human data toward learning through interaction with the world.Agent learning is shifting from learning from human data toward learning through interaction with the world. However, scaling such learning directly in real-world computer systems is challenging and can introduce substantial…
Zixuan Dong, Yanghai Wang, Hanyan Bian et al.
A game ships when a player can launch it, finish it, and return to a saved world, none of which a successful build guarantees, yet game-creation agents are mostly tested…A game ships when a player can launch it, finish it, and return to a saved world, none of which a successful build guarantees, yet game-creation agents are mostly tested on one engine or on one-prompt browser games.
Zhanhui Zhou, Weichen Zhang, Haoran Liu et al.
Open resources for computer use agents (CUAs) – environments, datasets, and models – remain scattered: without a standard, these resources cannot be integrated and…Open resources for computer use agents (CUAs) – environments, datasets, and models – remain scattered: without a standard, these resources cannot be integrated and scaled; additionally, evaluation, RL, and SFT cannot share one…
Kazem Faghih, Yize Cheng, Shoumik Saha et al.
Language model benchmarks assign each question a single outcome from one fixed wording, even though the same underlying request can be expressed in many equivalent ways.Language model benchmarks assign each question a single outcome from one fixed wording, even though the same underlying request can be expressed in many equivalent ways.
Nima H. Siboni, Magdalena Springer, Vahid Rostami
Multi-agent systems promise to solve problems by bringing together information beyond the reach of any individual agent.Multi-agent systems promise to solve problems by bringing together information beyond the reach of any individual agent. Retrieval and tool use can distribute this information across agents, making communication essential to…
Hyunwoo Ryu, Eric Ming Chen, Max Wilcoxson et al.
Video generative models are an emerging tool for embodied agents: they can serve as scalable visual planners, generating videos that depict how to complete previously…Video generative models are an emerging tool for embodied agents: they can serve as scalable visual planners, generating videos that depict how to complete previously unseen tasks.
Shuyang Xiang
We ask how much an autoregressive transformer retains of its prompt after generating t tokens.We ask how much an autoregressive transformer retains of its prompt after generating t tokens.
Qiyan Zhao, Xiaofeng Zhang, Xu-Yao Zhang et al.
Diffusion-based multimodal large language models (dMLLMs) decode by iterative denoising with bidirectional attention, which precludes the standard autoregressive…Diffusion-based multimodal large language models (dMLLMs) decode by iterative denoising with bidirectional attention, which precludes the standard autoregressive key–value cache.
Xianglin Yang, Yechao Zhang, Jiahao Liu et al.
Coding agents use execution harnesses to constrain the consequences of prompt injection by enforcing permission boundaries.Coding agents use execution harnesses to constrain the consequences of prompt injection by enforcing permission boundaries. These systems deterministically intercept any out-of-sandbox action and prompt the user for approval.
Oriol Miro-Lopez-Feliu, Oscar Miró López-Feliu, Victor Gimenez-Abalos et al.
LLM-based agents are increasingly credited with the competences of practical reasoning: planning, monitoring, and correcting their own actions.LLM-based agents are increasingly credited with the competences of practical reasoning: planning, monitoring, and correcting their own actions.
Wenxuan Ding, Qin Lu, Changlong Yu et al.
Harness evolution automatically optimizes the prompts, skills, tools, and orchestration code around a fixed-weight model, offering a way to improve agentic systems…Harness evolution automatically optimizes the prompts, skills, tools, and orchestration code around a fixed-weight model, offering a way to improve agentic systems without updating model weights.
Tianyu Wu
Automated discovery systems propose scientific explanations and test which to accept. Does passing a test establish the intended claim?Automated discovery systems propose scientific explanations and test which to accept. Does passing a test establish the intended claim?
Yao Long Teng, Jianguo Huang, Jiayi Cai et al.
Given a state and a set of options, such as intents, tools or interface elements, System One decision models return a distribution over the options in one forward pass…Given a state and a set of options, such as intents, tools or interface elements, System One decision models return a distribution over the options in one forward pass, without generated reasoning.
Shaoang Li, Yanhang Shi, Jian Li
A reasoning trace retained at answer time plays two roles: it can raise accuracy, and it can compete with the current evidence when the two disagree.A reasoning trace retained at answer time plays two roles: it can raise accuracy, and it can compete with the current evidence when the two disagree.
Seungone Kim, Jiayi Geng, Young-Jun Lee et al.
Can AI agents carry out research on open scientific problems? We introduce Into the Unknown, a benchmark that provides an agent with a science paper along with a research…Can AI agents carry out research on open scientific problems? We introduce Into the Unknown, a benchmark that provides an agent with a science paper along with a research direction to pursue and tasks it to write a follow-up…
Chengquan Guo, Zhaorun Chen, Zinan Lin et al.
LLM agents are becoming increasingly capable of handling daily workspace tasks by interacting with application environments through tool calls.LLM agents are becoming increasingly capable of handling daily workspace tasks by interacting with application environments through tool calls.
Qingsong Xie, Jiahao Tian, Jiacheng Tang et al.
Constructing robust GUI agents relies on multimodal visual grounding: the ability to precisely map natural language intents to actionable on-screen components.Constructing robust GUI agents relies on multimodal visual grounding: the ability to precisely map natural language intents to actionable on-screen components.
Rahul Singhal, Karime Maamari, Pradyumna Tambwekar
Prompting is a widely used method for adapting general-purpose LLMs to domain-specific tasks. Effective prompts can be tedious to create manually, so prompt writing is…Prompting is a widely used method for adapting general-purpose LLMs to domain-specific tasks. Effective prompts can be tedious to create manually, so prompt writing is increasingly handed to LLMs, with recent work training LLMs to…
Will Beaumaster, Paul Schrater
Coordinators that act on what they infer about teammates are usually certified by the accuracy of those inferences.Coordinators that act on what they infer about teammates are usually certified by the accuracy of those inferences. We argue that accuracy is the wrong certificate, for two reasons.
Bofan Xie, Chaokun Wang, Guanchen Ge et al.
Long-term memory has become a core component of large language model (LLM) agents. As agents accumulate personal information over long-term use, users increasingly ask…Long-term memory has become a core component of large language model (LLM) agents. As agents accumulate personal information over long-term use, users increasingly ask them to delete sensitive or outdated facts.
Jack Lu, Yurong You, Boyi Li et al.
Textual reasoning before acting has improved vision-language-action (VLA) models, but at the cost of latency: every action conditioned on the reasoning text must wait for…Textual reasoning before acting has improved vision-language-action (VLA) models, but at the cost of latency: every action conditioned on the reasoning text must wait for autoregressive decoding.
Zhihua Liu, Kurt Butler, Damian Machlanski et al.
The success of autonomous research systems relies on the quality of the scientific hypotheses they generate.The success of autonomous research systems relies on the quality of the scientific hypotheses they generate. Recent studies report that human reviewers often rate LLM-generated ideas as more novel than those from human experts…
Reading an agent's internal state predicted unauthorized actions with an AUROC score of 0.94 and cut violations from 0.70 to 0.09 in Gemma-4.Reading an agent's internal state predicted unauthorized actions with an AUROC score of 0.94 and cut violations from 0.70 to 0.09 in Gemma-4.
Researchers built Glasseek, an open search framework whose nine-billion-parameter agent achieved the best overall performance among recent open-weight models on deep…Researchers built Glasseek, an open search framework whose nine-billion-parameter agent achieved the best overall performance among recent open-weight models on deep research benchmarks.
Hazem Hesham Yousef Shalby, Fabrizio Pittorino, Manuel Roveri
Training neural networks in reduced precision can yield significant efficiency gains, yet all existing methods that scale to standard computer vision benchmarks retain…Training neural networks in reduced precision can yield significant efficiency gains, yet all existing methods that scale to standard computer vision benchmarks retain floating-point in at least one stage, typically the weight…
Li Nanbo, Firas Laakom, Yilan Zhang et al.
Linear attention promises the efficiency needed for long-context language modelling, yet its fixed-size recurrent state must simultaneously support ongoing computation…Linear attention promises the efficiency needed for long-context language modelling, yet its fixed-size recurrent state must simultaneously support ongoing computation and preserve information from an ever-growing history.
Seyedarmin Azizi, Erfan Baghaei Potraghloo, Arya Fayyazi et al.
A recurrent-depth language model reuses one block of weights several times in a row. The number of repetitions, which we call loops, is chosen when the model runs, not…A recurrent-depth language model reuses one block of weights several times in a row. The number of repetitions, which we call loops, is chosen when the model runs, not when it is trained, and running fewer is cheaper and faster…
Zeyu Yang, Wes Armour
Benchmark scores tell us what an LLM can do, but not how much energy is required to deliver that capability.Benchmark scores tell us what an LLM can do, but not how much energy is required to deliver that capability. We directly measure this trade-off for 86 open-weight model checkpoints, evaluated on seven benchmarks and six hardware…
Zongxia Li, Zhongzhi Li, Yucheng Shi et al.
Long-horizon terminal benchmarks measure whether an agent can sustain progress through extended workflows with process rewards, not only whether its final state passes a…Long-horizon terminal benchmarks measure whether an agent can sustain progress through extended workflows with process rewards, not only whether its final state passes a binary check.
Zhengyang Zhang, Jing Xiong, Hongzhou Lin et al.
Large language model (LLM) agents are rapidly improving on long-horizon scientific and olympiad tasks. Recent systems have produced a Lean-formalized resolution of the…Large language model (LLM) agents are rapidly improving on long-horizon scientific and olympiad tasks. Recent systems have produced a Lean-formalized resolution of the Navier–Stokes problem and autonomous solutions to four open…
Weixin Guan, Liang Li, Shiyu Xie et al.
Reasoning models can benefit from test-time scaling, but continued reasoning may become ineffective or harmful, a phenomenon termed overthinking.Reasoning models can benefit from test-time scaling, but continued reasoning may become ineffective or harmful, a phenomenon termed overthinking.
Loan Bernat, Matthieu Grard, Ariane Herbulot et al.
Long-horizon embodied agents must maintain task-relevant information, coordinate heterogeneous robots, and adapt their decisions as execution unfolds.Long-horizon embodied agents must maintain task-relevant information, coordinate heterogeneous robots, and adapt their decisions as execution unfolds.
Changye Li, Zijian Zhang, Muheng Li et al.
Existing LLM-based agent approaches for long-horizon machine learning engineering (MLE) often use context engineering, implemented through custom harnesses that manage…Existing LLM-based agent approaches for long-horizon machine learning engineering (MLE) often use context engineering, implemented through custom harnesses that manage tools, skills, and accumulated experience.
Pablo Manrique, Hai Xia, Stefan Szeider
AI systems are making rapid progress in mathematics, but this progress is hard to measure. Benchmarks of solved problems saturate, and in benchmarks of open problems each…AI systems are making rapid progress in mathematics, but this progress is hard to measure. Benchmarks of solved problems saturate, and in benchmarks of open problems each problem can be resolved for the first time only once.