Zixuan Weng, Haoqi He, Weifei Jin et al.
Safety-aligned large language models (LLMs) remain vulnerable to jailbreaks and can over-refuse benign requests.Safety-aligned large language models (LLMs) remain vulnerable to jailbreaks and can over-refuse benign requests. Understanding these failures requires distinguishing harmfulness recognition from the computation that writes…
Ximing Lu, Aviral Kumar, Jan Kautz et al.
Data-centric scaling of RLVR has focused on collecting or generating verifiable training problems. However, corpus size alone does not determine whether the dataset…Data-centric scaling of RLVR has focused on collecting or generating verifiable training problems. However, corpus size alone does not determine whether the dataset provides a useful learning signal for a target policy.
Adrián Zámečník, Matěj Kripner, Martin Koutecký et al.
Large language models are increasingly contributing to mathematical research, where progress often depends on efficient proof search, incremental improvements and careful…Large language models are increasingly contributing to mathematical research, where progress often depends on efficient proof search, incremental improvements and careful verification.
Saisab Sadhu, Shreeyans Arora, Pratinav Seth
Large language models increasingly justify legal decisions by naming the statute or precedent behind a verdict, treated as evidence that the decision follows from it.Large language models increasingly justify legal decisions by naming the statute or precedent behind a verdict, treated as evidence that the decision follows from it.
Saisab Sadhu, Aadit Sengupta, Vinay Kumar Sankarapu et al.
Large language model compliance systems are deployed on the assumption that a verdict depends on the regulatory rule it is given.Large language model compliance systems are deployed on the assumption that a verdict depends on the regulatory rule it is given.
Seyedarmin Azizi, Erfan Baghaei Potraghloo, Massoud Pedram
A typed decision model reads a piece of text and returns a probability over caller-defined options, each with a short written definition, generating no text.A typed decision model reads a piece of text and returns a probability over caller-defined options, each with a short written definition, generating no text.
Sreetama Sarkar, Saptarshi Mitra, Sitao Huang et al.
Cross-model KV-cache reuse remains a key challenge in modern LLM serving. Coding agents and multi-model systems increasingly route a shared context across models: a user…Cross-model KV-cache reuse remains a key challenge in modern LLM serving. Coding agents and multi-model systems increasingly route a shared context across models: a user may switch models mid-session, or a cascade may escalate a…
Dominik Drexler, Simon Ståhlberg, Markus Fritzsche et al.
Heuristic search for a plan can store exponentially many states, even when its heuristic is almost perfect.Heuristic search for a plan can store exponentially many states, even when its heuristic is almost perfect. We instead learn search control, one specification per domain, written as an indexical policy: a generalized policy with…
Daksh Raghuvanshi, Ved Vedere, Yifan Wang
Reinforcement learning environments are now a primary lever for improving large language model (LLM) capabilities in post-training, yet most agentic benchmarks remain…Reinforcement learning environments are now a primary lever for improving large language model (LLM) capabilities in post-training, yet most agentic benchmarks remain static: the world moves only when the agent acts, the reward is…
Trained on data from 12 robot types, RoboJEPA showed predictable changes in prediction error and robotic planning performance across computing scales.Trained on data from 12 robot types, RoboJEPA showed predictable changes in prediction error and robotic planning performance across computing scales.
Python Song, Zhixuan Liang, Kelsey Fu et al.
Robot foundation models provide strong visuomotor control, yet their performance can degrade when object positions or task instructions change.Robot foundation models provide strong visuomotor control, yet their performance can degrade when object positions or task instructions change.
Renxiong Wang, Darvin Yi, Abril Herrlein et al.
Environments are the foundation of recursive self-improvement: they provide the problems agents work on and the feedback used to evaluate progress.Environments are the foundation of recursive self-improvement: they provide the problems agents work on and the feedback used to evaluate progress.
Litao Hu, Yutong Tang
Self-improving LLM systems propose changes to themselves and keep those that score better on a small evaluation set.Self-improving LLM systems propose changes to themselves and keep those that score better on a small evaluation set. We treat this keep-if-better step as selection under measurement noise, model the correlated errors of the…
Haoran Li, Zengle Ge, Xiaomin Yuan et al.
LLM-guided program evolution has enabled discoveries in mathematics and computational optimization, raising the prospect of reinforcement learning (RL) algorithms that…LLM-guided program evolution has enabled discoveries in mathematics and computational optimization, raising the prospect of reinforcement learning (RL) algorithms that self-evolve to improve how agents learn.
Kai Yi, Tarek Elgamal, Sruthikesh Surineni et al.
Extreme low-bit LLM compression is most challenging when weights, activations, and KV caches are quantized together: their distributions differ, and quantization errors…Extreme low-bit LLM compression is most challenging when weights, activations, and KV caches are quantized together: their distributions differ, and quantization errors interact throughout the network.
Arip Asadulaev
Language models are more and more often asked for structured output: JSON that follows a schema, or a tool call with typed arguments.Language models are more and more often asked for structured output: JSON that follows a schema, or a tool call with typed arguments. A small machine, an automaton, enforces the format by forbidding the tokens that would break it.
Pratyay Dutta, Kowshik Thopalli, Vivek Narayanaswamy
Explicitly eliciting reasoning substantially improves LLM performance. Existing approaches require a predefined characterization of reasoning, whether through CoT prompt…Explicitly eliciting reasoning substantially improves LLM performance. Existing approaches require a predefined characterization of reasoning, whether through CoT prompt design, contrastive CoT directions, or via SAE derived…
André G. Pereira, Augusto B. Corrêa, Felipe Meneguzzi et al.
Frontier large language models (LLMs) can generate heuristic functions that guide search to achieve state-of-the-art performance in satisficing planning, where any plan…Frontier large language models (LLMs) can generate heuristic functions that guide search to achieve state-of-the-art performance in satisficing planning, where any plan is acceptable.
Jordy Kieto
World models are usually judged from the inside: by prediction loss, by the return a policy earns in imagination, or by how convincing their frames look.World models are usually judged from the inside: by prediction loss, by the return a policy earns in imagination, or by how convincing their frames look. We judge one from the outside.
Jingyu Zhang, Shruti Palaskar, Daniel Khashabi et al.
LLM agents are increasingly capable of executing complex tasks and of recursively improving themselves on easy-to-verify objectives such as software engineering and…LLM agents are increasingly capable of executing complex tasks and of recursively improving themselves on easy-to-verify objectives such as software engineering and mathematics.
Saanvi Khetan, Sankar Balasubramanian
People increasingly ask large language models what to do with their money, yet seldom describe their finances in full. This paper asks what a model does with the gap.People increasingly ask large language models what to do with their money, yet seldom describe their finances in full. This paper asks what a model does with the gap.
Mohammadreza Sediqin, Shivali Dalmia, Srinivasa Karthikeya Reddy Kovvuri et al.
Deterministic benchmark scores show that an agent received credit, but not whether that credit was earned, reported honestly, or would hold on a second run.Deterministic benchmark scores show that an agent received credit, but not whether that credit was earned, reported honestly, or would hold on a second run.
Tong Che, Yilong Li
Internal features in LLMs are often interpreted as mechanisms when they track a concept and their manipulation changes a related behavior.Internal features in LLMs are often interpreted as mechanisms when they track a concept and their manipulation changes a related behavior. Yet steering can push a feature far outside its natural range, where its effects need not…
Across 317 million human judgments in seven domains, written rubrics and automated tests left gaps in capturing human preferences compared with densely trained models.Across 317 million human judgments in seven domains, written rubrics and automated tests left gaps in capturing human preferences compared with densely trained models.
Erfan Shayegani, Kundan Krishna, Yue Dong et al.
Vision-language models (VLMs) are increasingly trained to generate structured outputs like points and bounding boxes that downstream interfaces, agents, and robots can…Vision-language models (VLMs) are increasingly trained to generate structured outputs like points and bounding boxes that downstream interfaces, agents, and robots can act on, yet safety alignment of this output channel has not…
Shiva Pochampally
AI agents that send emails, edit files, and make purchases must decide when to act on their own and when to check with the user first.AI agents that send emails, edit files, and make purchases must decide when to act on their own and when to check with the user first. This decision is usually evaluated by showing a model a proposed action, asking whether it…
IntAct, a repair system deployed in a commercial product, recovered 79.2% of failures involving altered tool calls.IntAct, a repair system deployed in a commercial product, recovered 79.2% of failures involving altered tool calls. These agents send commands through software layers that can change them before execution.
Debeshee Das, Jacqueline Tay, Bruce Tsai et al.
Memory poisoning attacks on LLM agents typically assume an external adversary who plants content in the agent's persistent memory to steer its behavior.Memory poisoning attacks on LLM agents typically assume an external adversary who plants content in the agent's persistent memory to steer its behavior.
Rikiya Takehi, Ryo Hachiuma, Shaona Ghosh et al.
Agentic multimodal large language models (MLLMs) have recently pushed the frontier of visual reasoning by calling tools such as zooming and tagging.Agentic multimodal large language models (MLLMs) have recently pushed the frontier of visual reasoning by calling tools such as zooming and tagging.
Arman Behnam, Binghui Wang
A reasoning model asked whether a causal effect is recoverable from observational data can fail in two ways: it refuses an identifiable query or answers a nonidentifiable…A reasoning model asked whether a causal effect is recoverable from observational data can fail in two ways: it refuses an identifiable query or answers a nonidentifiable one.
Hao Jiang, Xin Li, Annan Wang et al.
A coding agent can earn a passing grade by fixing its code, or by deleting the test that exposes the bug.A coding agent can earn a passing grade by fixing its code, or by deleting the test that exposes the bug. Detecting such reward hacking requires recognizing attempted shortcuts, including those that fail.
Carsten Maple, Cagatay Yucel, Isaac Holeman et al.
Modern AI systems are designed to refuse hazardous requests. A jailbreak is a prompt crafted to bypass those safeguards and elicit outputs that the system would normally…Modern AI systems are designed to refuse hazardous requests. A jailbreak is a prompt crafted to bypass those safeguards and elicit outputs that the system would normally refuse to provide. The MLCommons Jailbreak Benchmark v1.
Sam Wang, Julia White, Sahibzada Allahyar et al.
Dynamic LLM routers promise to cut inference costs by sending each query to the cheapest model that can answer it correctly.Dynamic LLM routers promise to cut inference costs by sending each query to the cheapest model that can answer it correctly.
Chengyang Shi, Xianglin Ji, Jintao Huang et al.
Agents are increasingly given open-ended research tasks: discovering an empirical law from self-designed experiments, improving a heuristic whose optimum nobody knows, or…Agents are increasingly given open-ended research tasks: discovering an empirical law from self-designed experiments, improving a heuristic whose optimum nobody knows, or beating a standing record.
Seyedarmin Azizi, Erfan Baghaei Potraghloo, Massoud Pedram
A typed decision model answers a fixed question about an input by returning a probability for each of several caller-defined options.A typed decision model answers a fixed question about an input by returning a probability for each of several caller-defined options. Each option carries a short label and a written definition, which is where a developer states…
Harry Lyu, Neil Thompson
LLM judges are increasingly used to assess whether AI outputs meet workplace requirements, but agreement on response rankings does not establish agreement on acceptance…LLM judges are increasingly used to assess whether AI outputs meet workplace requirements, but agreement on response rankings does not establish agreement on acceptance rates or occupational aggregates.
Felix X.-F. Ye, Yu Chin Fabian Lim, Naigang Wang et al.
Streaming GPU solvers for entropic optimal transport (EOT), such as FlashSinkhorn, avoid storing the dense kernel but still evaluate all n× m point pairs in every…Streaming GPU solvers for entropic optimal transport (EOT), such as FlashSinkhorn, avoid storing the dense kernel but still evaluate all n× m point pairs in every Sinkhorn iteration.
Jiawei Li
Agent harnesses make many small, typed decisions per task: which model to call, which tool to use, whether retrieved text is relevant, whether an input carries an…Agent harnesses make many small, typed decisions per task: which model to call, which tool to use, whether retrieved text is relevant, whether an input carries an injection.
Yang Cai, Vineet Gupta, Yanchen Jiang et al.
We present Cogentic, a multi-agent harness for automated proof discovery on open research problems.We present Cogentic, a multi-agent harness for automated proof discovery on open research problems.
Qiushi Han, Keya Hu, Linlu Qiu et al.
We show that multimodal models possess strong reasoning abilities and that an appropriate harness can unlock their potential to solve tasks across diverse interactive…We show that multimodal models possess strong reasoning abilities and that an appropriate harness can unlock their potential to solve tasks across diverse interactive environments.