Tested anomaly detectors read prompt scale, not text meaning
Across seven medical datasets, detectors with random numerical replacements for text tracked those using correct descriptions when the distance between reference points matched.
Edited by Boris Djordjevic · Paperfoot
The study tested what text contributed to trained vision-language anomaly detectors, which use images and descriptions to flag abnormal appearances, across seven medical datasets and two industrial benchmarks. These systems represented normal and abnormal descriptions as numerical reference points and trained an image-processing component to use them.
For the single-pair setup, the authors proved that replacement reference points allowed exactly the same abnormality probabilities if the distance between them stayed unchanged. Medical tests covered three underlying image models, training with few examples or full datasets, and three families of trainable components. Random reference points tracked correct descriptions when this distance matched. When one component served many categories, the points’ joint arrangement also mattered. Rotations that spread category directions apart without preserving meaning improved performance on both industrial benchmarks.
Why it matters
The proof and benchmark tests separated what text meant from how its numerical representations were arranged. They challenged the attribution of these trained detectors’ gains to meaningful descriptions.
Caveats
The abstract does not report performance scores or variation across runs, leaving the size and consistency of the differences unclear. The work is an arXiv preprint, not yet peer-reviewed.
In this paper
vision-language anomaly detection
- Methods
- Gram-matched random anchors (this paper)matched orthogonal anchors (this paper)unmatched orthogonal anchors (this paper)learned scale (this paper)prompt-scale (this paper)MVFA (baseline)MadCLIP (baseline)CLIP ViT-L/14DINOv3-L/16DINOv2-L/14
- Datasets
- BraTS2021 (evaluated)LiverCT (evaluated)RESC (evaluated)OCT2017 (evaluated)BUSI (evaluated)CheXpert (evaluated)Kaggle BrainMRI (evaluated)MVTec-AD (evaluated)VisA (evaluated)
Results
- MVFA, mean image AUROC: 94.8%
At K{=}16, mean image AUROC was 94.8% with prompts and 93.9% with Gram-matched random anchors.
6.3 Extensions across adapter families, residual detectors, and learned prompts
- MVFA, mean image AUROC: 94.5%
Unmatched orthogonal anchors reduced it to 73.7%; restoring only their scale recovered 94.5% (Table 2).
6.3 Extensions across adapter families, residual detectors, and learned prompts
- learned scale, mean image AUROC: 96.3%
At K{=}16, learned prompts and the text-free learned scale obtained 96.2% and 96.3% mean image AUROC.
6.3 Extensions across adapter families, residual detectors, and learned prompts
- prompt-scale, image AUROC: 95.3%
The prompt-scale arm reached 95.3% at K{=}16 but was less stable at small K; Appendix Tables 20 and 21 report all image and pixel results.
6.3 Extensions across adapter families, residual detectors, and learned prompts
- DINOv2-L/14, image AUROC gains, on VisA: up to 8.8%; DINOv2-L/14, pixel AUROC gains, on VisA: 8.3%
DINOv2-L/14 and DINOv3-L/16 reproduced the result on both benchmarks, with gains up to 8.8% image and 8.3% pixel AUROC on VisA; Appendix Table 22 reports all three vision backbones.
6.4 Unified multi-category detection: joint anchor geometry
- DINOv3-L/16, image AUROC gap, on OCT2017, K=2: 11.8%
Without scale matching, the mean absolute gap increased to 1.46% with real-anomaly support and 0.93% with normal-only training (maxima 11.8% and 3.4% ); the 11.8% maximum occurred on DINOv3-L/16 OCT2017 at K=2 ( 93.6% versus 81.8% ).
6.2 Few-shot medical anchor controls: effective scale, not prompt content
What it shows
- Scale-matched text-free anchors can reproduce every abnormal-probability map achievable with prompts, and any training objective or evaluation statistic computed only from those maps has the same attainable values under both choices.
Any training objective or evaluation statistic computed only from those maps has the same attainable values under both choices.
Theorem 1 (Single-pair equivalence and effective scale).
- Scale-matched random and orthogonal text-free anchors track correct prompts in few-shot medical anomaly detection with small mean absolute gaps.
Scale-matched random and orthogonal anchors track correct medical prompts with mean gaps of 0.16% – 0.26% image AUROC; breaking the scale opens a clear gap that restoring it closes with no text.
1 Introduction
- Spreading the near-collinear prompt scoring axes apart with meaning-free independent rotations improves performance on both industrial anomaly detection benchmarks for a shared adapter.
For the tested CLIP prompts, these axes are nearly collinear, and meaning-free rotations that spread them apart improve performance on both industrial benchmarks.
Abstract
- Under frozen zero-shot transfer, a retained text-free random anchor frame transfers as well as the prompt frame.
Even under frozen zero-shot transfer, a random anchor frame transfers as well as the prompt frame: coordinate consistency, not meaning.
Abstract
- The theoretical equivalence guarantees require prescribed fixed anchors, rotation-closed adapters, and cosine-based binary maps, and no longer follow if the adapter cannot absorb the required rotation or is frozen.
Our guarantees require prescribed fixed anchors, rotation-closed adapters, and cosine-based binary maps (Proposition 1).
7 Conclusion
Quoted word for word from the full text on arXiv.
The paper
Do Words Matter? What Text Contributes to Few and Full-Shot Vision-Language Anomaly Detection
arXiv, Oct 25, 2026, Open access, CC BY, Preprint, not peer-reviewed
doi.org/10.48550/arxiv.2610.34610
arXiv:2610.34610v1 in cs.CV
Comments: 36 pages, 1 figure, 28 tables
Cite as BibTeX
@misc{basaran2026words,
title = {Do Words Matter? What Text Contributes to Few and Full-Shot Vision-Language Anomaly Detection},
author = {Basaran, Arda Baris and Ceylan, Mesut and Fleisch, Elgar and Barata, Filipe},
year = {2026},
eprint = {2610.34610},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
doi = {10.48550/arxiv.2610.34610},
url = {https://arxiv.org/abs/2610.34610}
}