A preprint proves that backdoors installed through poisoned data can be reconstructed by defenders, confirming the result with experiments on instruction-tuned large…A preprint proves that backdoors installed through poisoned data can be reconstructed by defenders, confirming the result with experiments on instruction-tuned large language models.
Qiuyang Mang, Wenhao Chai, Runyuan He et al.
Can LLM agents make contributions to frontier computer science R&D? We introduce FrontierCS 2, a benchmark of 48 open-ended tasks.Can LLM agents make contributions to frontier computer science R&D? We introduce FrontierCS 2, a benchmark of 48 open-ended tasks. We take a paper and the code its authors released and delete the paper's contribution.
Shihao Shao, Dacheng Tao
Haussler's covering lemma (JCTA 1995) gives the sharp (C/δ)^d metric-entropy bound for binary VC classes under normalized ℓ₁ distance.Haussler's covering lemma (JCTA 1995) gives the sharp (C/δ)^d metric-entropy bound for binary VC classes under normalized ℓ₁ distance. We prove a sharp global dynamic analogue for bounded real-valued classes in normalized ℓ_p, for…
Leon Chlon, Julie Huang
We are the first to give a certified rule for whether unseen data belong in a pretrained model's context or its weights, built on an exact law for their information…We are the first to give a certified rule for whether unseen data belong in a pretrained model's context or its weights, built on an exact law for their information value.
Daniel Cieślak, Jacek Łubiński
Verifier stacks increasingly sit inside post-training and test-time compute loops. We study a specific control loop: a component verifier is evaluated on fresh policy…Verifier stacks increasingly sit inside post-training and test-time compute loops. We study a specific control loop: a component verifier is evaluated on fresh policy outputs against the full success label and refreshed when that…
Xiuyi Qin
NVIDIA tensor cores have supported 2:4 semi-structured sparsity since Ampere, and the pattern composes with quantization.NVIDIA tensor cores have supported 2:4 semi-structured sparsity since Ampere, and the pattern composes with quantization. When the two are combined, the practical question is which step to take next: from a given precision, add…
Mohammad Afzali, Hassan Ashtiani, Alex Bie et al.
We show that every class of distributions that is learnable up to arbitrarily small target error in total variation distance with finitely many samples is also learnable…We show that every class of distributions that is learnable up to arbitrarily small target error in total variation distance with finitely many samples is also learnable under (ε, δ)-differential privacy up to arbitrarily small…
Habibur Rahaman, Swarup Bhunia
The weights of a trained network do not have uniform sensitivity to model accuracy: the 1% most sensitive weights carry about a fifth of the damage a bit flip can do.The weights of a trained network do not have uniform sensitivity to model accuracy: the 1% most sensitive weights carry about a fifth of the damage a bit flip can do.
Yuxing Peng, Zhiqing Tang, Weijia Jia
Low curvature trace, an effective rank condition, is a common explanation for why randomized zeroth-order methods scale to high-dimensional tasks such as language model…Low curvature trace, an effective rank condition, is a common explanation for why randomized zeroth-order methods scale to high-dimensional tasks such as language model fine-tuning.
Anxin Guo, Tianlong Huang, Chenxiao Yang et al.
Frontier LLMs can copy random text almost flawlessly, yet they often overrun or truncate long blocks of repeated characters.Frontier LLMs can copy random text almost flawlessly, yet they often overrun or truncate long blocks of repeated characters. In repeated strings, matching local content no longer reliably identifies where copying should continue…
Jakob Steimle, Thomas Elsken, Daniel Ehrhardt et al.
A growing body of work proposes dynamic expert-skipping methods for Mixture-of-Experts (MoE) models that adjust the number of experts activated per token during…A growing body of work proposes dynamic expert-skipping methods for Mixture-of-Experts (MoE) models that adjust the number of experts activated per token during inference, aiming to preserve model quality while further reducing…
Leroy Odunlami, Tobias Riedlinger, Hanno Gottschalk
High-quality training data are a major bottleneck in machine learning, motivating increasing use of artificially generated data.High-quality training data are a major bottleneck in machine learning, motivating increasing use of artificially generated data. We study when a binary classifier trained on synthetic data transfers successfully to a real…
Paul Geertsema, Simon Geertsema
We introduce the target-response Jacobian J = [∂ hat y_i/∂ y_j], which measures how model predictions respond to changes in individual training targets.We introduce the target-response Jacobian J = [∂ hat y_i/∂ y_j], which measures how model predictions respond to changes in individual training targets.
Zhixiong Cheng, Shiyuan Han, Jingjing Suo et al.
Tabular foundation models (TFMs) pretrain a transformer on large-scale synthetic priors so that a single forward pass yields zero-shot tabular prediction.Tabular foundation models (TFMs) pretrain a transformer on large-scale synthetic priors so that a single forward pass yields zero-shot tabular prediction.
Yunzhe Hu, Dong Xu
Offline goal-conditioned reinforcement learning enables skill acquisition by reaching any goal from any state without dense rewards.Offline goal-conditioned reinforcement learning enables skill acquisition by reaching any goal from any state without dense rewards. Model-based methods allow for planning by scaling test-time compute to solve complex tasks.
Yuyang Zhang, Qihuang Zhang
Over-fitted Gaussian mixtures can contain many parameter configurations with nearly the same density, making the order of density cancellation central to their…Over-fitted Gaussian mixtures can contain many parameter configurations with nearly the same density, making the order of density cancellation central to their parameter-learning rates.
The method achieved 90.2% backdoor success on the Whisper-medium speech model with a 1.7% false-positive rate, using as little as two minutes of target-speaker audio.The method achieved 90.2% backdoor success on the Whisper-medium speech model with a 1.7% false-positive rate, using as little as two minutes of target-speaker audio.
Jingchu Gai, Adam Block, Andrej Risteski
Inference-time harnesses, i.e., external procedures that call a model many times and keep state across calls, can substantially improve model capabilities.Inference-time harnesses, i.e., external procedures that call a model many times and keep state across calls, can substantially improve model capabilities.
Keshigeyan Chandrasegaran, Yue Zhao, Armin W. Thomas et al.
Modern text-to-image (T2I) systems use internet-scale language pretraining for text-conditioned image generation.Modern text-to-image (T2I) systems use internet-scale language pretraining for text-conditioned image generation. We ask whether language pretraining is necessary for strong T2I generation.
Junze Zhou, David Klindt
Understanding when neural networks learn interpretable representations is central to mechanistic interpretability.Understanding when neural networks learn interpretable representations is central to mechanistic interpretability. We study this through identifiability: when can supervised learning recover the true latent variables underlying…
Felix Draxler, Robin C. Geyer, Daniel Geyfman et al.
Autoregressive language models emit one token per forward pass. This causes high inference latency, in particular as models are scaled up for quality.Autoregressive language models emit one token per forward pass. This causes high inference latency, in particular as models are scaled up for quality.
Jesson Wang, Zhanhao Hu, Minghao Lin et al.
Safety risks from fine-tuning are commonly characterized by the harmfulness of the training data:harmful fine-tuning is considered dangerous, while benign fine-tuning is…Safety risks from fine-tuning are commonly characterized by the harmfulness of the training data:harmful fine-tuning is considered dangerous, while benign fine-tuning is often assumed to preservealignment.
Daniel Barzilai
The success of neural networks is largely attributed to their ability to learn useful representations from training data.The success of neural networks is largely attributed to their ability to learn useful representations from training data. However, known results that prove a computational advantage of learned features over fixed ones are…
Across ten guardrail models, benchmark scores spanned 0 to 100 on copyright and 3.4 to 56.4 percent on over-refusal, while detection capability remained unchanged.Across ten guardrail models, benchmark scores spanned 0 to 100 on copyright and 3.4 to 56.4 percent on over-refusal, while detection capability remained unchanged.
Runguo Li
Sparse attention speeds up long-context decoding by reading few keys of the KV cache, but existing methods do not control the error of a query, and on real KV caches…Sparse attention speeds up long-context decoding by reading few keys of the KV cache, but existing methods do not control the error of a query, and on real KV caches their errors have heavy tails.
Noga Alon, Steve Hanneke, Shay Moran et al.
Uniform convergence asks how many random samples suffice for empirical averages to approximate expectations simultaneously over an entire class of functions.Uniform convergence asks how many random samples suffice for empirical averages to approximate expectations simultaneously over an entire class of functions.
Niclas Göring, Shuofeng Zhang, Branton DeMoss et al.
We derive a tight generalization bound for deterministic neural We derive a tight generalization bound for deterministic neural networks based on their last hidden layer…We derive a tight generalization bound for deterministic neural We derive a tight generalization bound for deterministic neural networks based on their last hidden layer representations.
Niclas Göring, Shuofeng Zhang, Roi Holtzman et al.
Every neuron in a trained network outputs a number that can be separated into its sign (positive or negative) and its magnitude (absolute size).Every neuron in a trained network outputs a number that can be separated into its sign (positive or negative) and its magnitude (absolute size). We call the set of all neuron signs the sign code.
Ivan Fomin, Ivan Koryabkin, Boris Sheludko
Real-time inference on small devices needs low activation memory without extra latency, which makes operator order the most valuable memory lever: it is free in time.Real-time inference on small devices needs low activation memory without extra latency, which makes operator order the most valuable memory lever: it is free in time.
Srinivasan Iyengar
A common way to make language models and agents more accurate is to spend more compute at inference time: generate many candidate solutions and submit the one a verifier…A common way to make language models and agents more accurate is to spend more compute at inference time: generate many candidate solutions and submit the one a verifier prefers.
A mathematical proof establishes a nearly linear upper bound on the training examples needed for private classification, improving on an earlier fifth-power bound.A mathematical proof establishes a nearly linear upper bound on the training examples needed for private classification, improving on an earlier fifth-power bound.
Rachel Morris, Ryan Murray, Kerrek Stinson
For non-parametric binary classification in the presence of an adversary, we prove an optimal quantitative estimate for adversarial classifiers controlling geometric…For non-parametric binary classification in the presence of an adversary, we prove an optimal quantitative estimate for adversarial classifiers controlling geometric accuracy, as measured by the Hausdorff distance to the Bayes…
Gabe Schulman, Lucius E. J. Bynum, Yoav Wald
Causal foundation models (CFMs) show promising results for treatment-effect estimation, with unit-level estimates that are competitive on standard benchmarks.Causal foundation models (CFMs) show promising results for treatment-effect estimation, with unit-level estimates that are competitive on standard benchmarks.
Amin Najafgholizadeh, Mohsen Afsharchi
The Long-Range Ising Model benchmark (LRIM) guarantees long-range dependence by construction: each label is the node's spin times the spin field convolved with a…The Long-Range Ising Model benchmark (LRIM) guarantees long-range dependence by construction: each label is the node's spin times the spin field convolved with a power-law coupling, so any model's distance from the target is…
Thomas Nagler
We study uniform approximation of the H"older ball mathcal H₁^s([0,1]^D) by fully connected ReLU networks.We study uniform approximation of the H"older ball mathcal H₁^s([0,1]^D) by fully connected ReLU networks. Except in the one-dimensional Lipschitz case, existing constructions remain separated from the information-theoretic…
Nadir Kutluozen, Christian Internò, David Klindt
The linear representation hypothesis holds that pretrained vision models encode generative factors as linearly decodable directions in feature space, and comes with a…The linear representation hypothesis holds that pretrained vision models encode generative factors as linearly decodable directions in feature space, and comes with a standard methodology: train a linear probe, declare a factor…
Karim Abdel Sadek, Federico Di Gennaro, Fanny Yang
Training models on their own outputs has attracted widespread attention as a possible route to advance AI capabilities.Training models on their own outputs has attracted widespread attention as a possible route to advance AI capabilities. One prominent approach is self-distillation, where a model is trained to match the token-level predictions it…
Muhammad Usman Altaf
Studies of what fine-tuning does to a language model often summarise the weight update Δ W by its rank.Studies of what fine-tuning does to a language model often summarise the weight update Δ W by its rank. We compare the rank measures used for this against the same measures on a random matrix of the same shape, and against two…
Rodney Lafuente-Mercado, Salman Rahman, Jingyan Shen et al.
AI systems now write long and difficult mathematical proofs, and checking their step-by-step validity is becoming a bottleneck.AI systems now write long and difficult mathematical proofs, and checking their step-by-step validity is becoming a bottleneck. A learned verifier could check proofs cheaply, but training one requires a correctness label on every…
Walter Simoncini, Dheeraj Varghese, Gertjan J. Burghouts et al.
Scaling up transformers has produced models with broad capabilities, deployed across heterogeneous hardware and fluctuating workloads.Scaling up transformers has produced models with broad capabilities, deployed across heterogeneous hardware and fluctuating workloads. Yet, model families offer only a few fixed sizes (e.g., S, B, L), forcing users to commit to a…