Jiahua Dong, Anurag Bagchi, Yash Jangir et al.
World models offer a promising alternative to physics-based simulators, yet remain far from practical deployment.World models offer a promising alternative to physics-based simulators, yet remain far from practical deployment. We ask how far scaling ego-centric human video takes them, using a dataset of 30,000 hours spanning over 1,000 scene…
Subsets of about 2,000 training examples collectively improved scores on 22 of 26 external tests by up to 27.3 percentage points.Subsets of about 2,000 training examples collectively improved scores on 22 of 26 external tests by up to 27.3 percentage points. In a preprint, researchers developed WOVEN, a training source and benchmark of 36,076 video…
Xue Yang, Peiyuan Zhang, Yilun Zhu et al.
Large Multi-modality Models (LMMs) have made significant progress in visual understanding and generation, but still face challenges in visual editing, particularly in…Large Multi-modality Models (LMMs) have made significant progress in visual understanding and generation, but still face challenges in visual editing, particularly in following complex instructions, preserving appearance…
Tao Yang, Jianying Zhou
Adversarial attacks on vision-language models optimize an image toward a text target, then cite the attacked model's similarity score as evidence of success.Adversarial attacks on vision-language models optimize an image toward a text target, then cite the attacked model's similarity score as evidence of success.
Yawen Shao, Yubo Zhu, Ziyun Dai et al.
Modern video generators can realize increasingly complex visual narratives, positioning the prompt enhancer (PE) as a critical bridge from concise user instructions and…Modern video generators can realize increasingly complex visual narratives, positioning the prompt enhancer (PE) as a critical bridge from concise user instructions and multimodal references to structured cinematic plans.
Boaz Meivar, Ofir Kedem, Amit Edenzon et al.
Visual instance retrieval often fails when the same object appears at different apparent sizes in the query and gallery.Visual instance retrieval often fails when the same object appears at different apparent sizes in the query and gallery. We show that the dominant cause is usually not resolution loss but object-to-image (O2I) ratio mismatch: the…
Hong Huang, Chenhongyi Yang, Junzhe Sun et al.
Unified multimodal diffusion large language models (dLLMs) offer a single architecture for both image generation and multimodal understanding, but their iterative…Unified multimodal diffusion large language models (dLLMs) offer a single architecture for both image generation and multimodal understanding, but their iterative decoding requires tens to hundreds of forward passes.
Youssef Saied, François Fleuret
Scaling a learned flow-matching velocity field v_θ by a gain γ(t) was recently shown to greatly improve generation quality.Scaling a learned flow-matching velocity field v_θ by a gain γ(t) was recently shown to greatly improve generation quality. Prior work argued that velocity fields trained with mean-squared error (MSE) systematically underestimate…
Dayou Li, Hao Wang, Qianqian Yang et al.
Large-scale egocentric human interaction data is becoming an important source of physical supervision for embodied learning, yet video alone leaves the contact and…Large-scale egocentric human interaction data is becoming an important source of physical supervision for embodied learning, yet video alone leaves the contact and pressure that characterize physical interaction unrecorded.
Carlotta Segna, Joel Tschesche, Anna Rohrbach
Reliable and practical audio-visual DeepFake detection requires benchmarks that reflect diverse linguistic contexts and modern data synthesis pipelines for visual as well…Reliable and practical audio-visual DeepFake detection requires benchmarks that reflect diverse linguistic contexts and modern data synthesis pipelines for visual as well as audio manipulations.
Subhransu S. Bhattacharjee, Dylan Campbell, Rahul Shome
Procrustes-Wasserstein alignment jointly estimates a matching and rotation without supplied correspondences, but alternating minimization can stop at suboptimal…Procrustes-Wasserstein alignment jointly estimates a matching and rotation without supplied correspondences, but alternating minimization can stop at suboptimal solutions.
Maximilian Seitzer, Gabriele Trivigno, Antonín Vobecký et al.
Self-supervised learning (SSL) at scale produces powerful visual representations. However, most scalable SSL methods rely on ad hoc combinations of multiple objectives…Self-supervised learning (SSL) at scale produces powerful visual representations. However, most scalable SSL methods rely on ad hoc combinations of multiple objectives and stabilization mechanisms.
Bill Psomas, Mohammad Mahdi, Michalis Thomas et al.
Standard information retrieval metrics, such as mean Average Precision (mAP), assess performance one query at a time, based on how the similarities between a query and…Standard information retrieval metrics, such as mean Average Precision (mAP), assess performance one query at a time, based on how the similarities between a query and its positives compare against those with its negatives.
Akshat Dobhal, Sanjay Singh
Camouflaged object detection requires pixel-accurate masks, but obtaining such annotations is slow and costly, making synthetic training images an attractive alternative.Camouflaged object detection requires pixel-accurate masks, but obtaining such annotations is slow and costly, making synthetic training images an attractive alternative.
Hanqiu Li Cai, Chema Garabito
Pixel-space diffusion models avoid the lossy VAE of latent models, which suggests an advantage on downstream tasks where fine-grained detail matters.Pixel-space diffusion models avoid the lossy VAE of latent models, which suggests an advantage on downstream tasks where fine-grained detail matters. We test this claim along both routes to a pixel-space backbone.
Nikita Kukuzei, Artem Borisov, Evgeney Bogatyrev et al.
Diffusion-based image super-resolution (SR) can create visually plausible detail that is not supported by the low-resolution input.Diffusion-based image super-resolution (SR) can create visually plausible detail that is not supported by the low-resolution input. We introduce DISRQAD, a subjective-quality dataset and diagnostic benchmark for this setting.
At that operating point, most baseline detectors reached near-zero recall, including the strongest detector tested with 93% accuracy.At that operating point, most baseline detectors reached near-zero recall, including the strongest detector tested with 93% accuracy. A detection method evaluated in a preprint outputs a calibrated prediction of whether content…
Tobias Hallmen, Robin-Nico Kampa, Elisabeth André
Facial affect models are trained almost entirely on adults, yet are increasingly applied to children in education, health, and developmental research.Facial affect models are trained almost entirely on adults, yet are increasingly applied to children in education, health, and developmental research.
Zhen Guo, Rongyuan Wu, Qiaosi Yi et al.
Recent diffusion-based image generation backbones have grown substantially in scale, making the network inference cost increase rapidly.Recent diffusion-based image generation backbones have grown substantially in scale, making the network inference cost increase rapidly. While diffusion distillation techniques can reduce the number of inference steps…
Yuan Feng, Qize Yang, Ruizhe Chen et al.
Multimodal large language models have become the dominant paradigm for visual understanding, but incur substantial costs by encoding inputs into dense, fixed-size patch…Multimodal large language models have become the dominant paradigm for visual understanding, but incur substantial costs by encoding inputs into dense, fixed-size patch tokens.
Hyeongheon Cha, Hyungjun Yoon, Sung-Ju Lee
Training-free token reduction accelerates vision transformers by removing redundant tokens across layers, recovering most of the original accuracy at a fraction of the…Training-free token reduction accelerates vision transformers by removing redundant tokens across layers, recovering most of the original accuracy at a fraction of the compute.
Peng Xie, Amr Alanwar
Video world models track objects they can see; we ask what they keep of objects they cannot. We hide an object from a frozen V-JEPA 2 predictor and compare its prediction…Video world models track objects they can see; we ask what they keep of objects they cannot. We hide an object from a frozen V-JEPA 2 predictor and compare its prediction for the hidden region with the encoder's representation of…
Dheeraj Varghese, Anna Vettoruzzo, Walter Simoncini et al.
Recent advances in multimodal foundation models yield strong performance on static perception and reasoning benchmarks, yet such evaluations largely overlook a central…Recent advances in multimodal foundation models yield strong performance on static perception and reasoning benchmarks, yet such evaluations largely overlook a central aspect of intelligence: acting competently in dynamic…
Tinghe Zhang, Chunyu Liu, Yu Leon Liu et al.
Joint-embedding predictive architectures (JEPAs) for world modeling train an encoder so a predictor maps a current embedding and action to the next frame's embedding…Joint-embedding predictive architectures (JEPAs) for world modeling train an encoder so a predictor maps a current embedding and action to the next frame's embedding, always from a single rendered frame.
Sinan Wang, Jinjin He, Yuchen Sun et al.
Feed-forward 3D Gaussian Splatting (3DGS) increasingly aggregates multi-view evidence with heavy learned 3D networks.Feed-forward 3D Gaussian Splatting (3DGS) increasingly aggregates multi-view evidence with heavy learned 3D networks.
Jiahuan Cheng, Zhiyi Li, Tian Xia et al.
Dense 3D point tracking has been a prominent paradigm for modeling motion in dynamic scenes, but a point track is just a 3-DoF translation curve per pixel: it captures…Dense 3D point tracking has been a prominent paradigm for modeling motion in dynamic scenes, but a point track is just a 3-DoF translation curve per pixel: it captures where pixels go, not the rotation of the underlying part, nor…
Susmit Agrawal, Rebecca Wanner, Juliane Verwiebe et al.
Video saliency prediction is inherently harder to model than static image saliency due to the additional temporal dimension.Video saliency prediction is inherently harder to model than static image saliency due to the additional temporal dimension. Video saliency benchmarks rest on the premise that predicting gaze on video requires utilizing temporal…
Haipeng Wang
3D Gaussian Splatting achieves excellent visual quality with real-time rendering, but at the scale of entire cities it does not fit: a trained model carries millions of…3D Gaussian Splatting achieves excellent visual quality with real-time rendering, but at the scale of entire cities it does not fit: a trained model carries millions of primitives and gigabytes of memory, and real-time rendering…
Jihwan Hong, Woohyeon Park, Jaeik Kim et al.
Video Object Segmentation (VOS) in complex and long videos is increasingly important for real-world applications, where target objects often appear only intermittently…Video Object Segmentation (VOS) in complex and long videos is increasingly important for real-world applications, where target objects often appear only intermittently within long temporal horizons.
Yuxing Wang, Yizhou Wang, Anqi Li et al.
Physical AI Smart Spaces is, to the best of our knowledge, the first benchmark to simultaneously provide large-scale, multi-class, and multi-camera 3D perception data for…Physical AI Smart Spaces is, to the best of our knowledge, the first benchmark to simultaneously provide large-scale, multi-class, and multi-camera 3D perception data for indoor smart spaces.
A. Said Gurbuz, Ahmed Nassar, Sunghwan Hong et al.
Computer-use agents need to reliably ground action targets in complex desktop scenes, where multiple applications, overlapping windows, and visually similar controls…Computer-use agents need to reliably ground action targets in complex desktop scenes, where multiple applications, overlapping windows, and visually similar controls compete for attention.
Mehmet Emre Andıran, Zhuoqian Yang, Liying Lu et al.
Single-image HDR reconstruction requires inferring missing detail while preserving the visible content of an LDR image.Single-image HDR reconstruction requires inferring missing detail while preserving the visible content of an LDR image. Differences in sensor dynamic range and exposure cause LDR images to lose varying amounts of information in…
Mohammed Irfan Kurpath, Jaseel Muhammad Kaithakkodan, Sahal Shaji Mullappilly et al.
Extending a text embedding model to new modalities typically degrades text retrieval quality, and existing omni-modal embedders compensate with multi-billion parameters.Extending a text embedding model to new modalities typically degrades text retrieval quality, and existing omni-modal embedders compensate with multi-billion parameters. We present Omni-Embed-Mini, a 0.
Baoke Dou, Ziye Wang, Hao Wang et al.
Reliable evaluation of image forgery localization (IFL) requires assessing models under diverse distribution changes, yet existing benchmarks often cover limited…Reliable evaluation of image forgery localization (IFL) requires assessing models under diverse distribution changes, yet existing benchmarks often cover limited manipulation conditions or entangle multiple factors in…
Yuan Huang, Zirui Song, Xiuying Chen
Multimodal large language models (MLLMs) are increasingly used as automated judges for instruction-based image editing and as reward signals for model training.Multimodal large language models (MLLMs) are increasingly used as automated judges for instruction-based image editing and as reward signals for model training.
Enxin Song, Yinuo Xu, Shusheng Yang et al.
A video benchmark should reward the capability it claims to measure, yet models can exploit answer options, question text, or partial visual evidence.A video benchmark should reward the capability it claims to measure, yet models can exploit answer options, question text, or partial visual evidence.
Vu Dinh Xuan, Duc-Hai Nguyen, Minh-Dung Dao et al.
Qualitative comparison figures are central evidence in computer vision papers, and vision-language models (VLMs) are increasingly used to judge them.Qualitative comparison figures are central evidence in computer vision papers, and vision-language models (VLMs) are increasingly used to judge them.
Kaixuan Fan, Kaituo Feng, Tianshuo Peng et al.
Visual perception is conventionally formulated as a one-shot prediction from a single glance at the image, under the assumption that the image content and the model's…Visual perception is conventionally formulated as a one-shot prediction from a single glance at the image, under the assumption that the image content and the model's parametric knowledge suffice to resolve the query.