Martin Thißen, Elke Hergenröther
Despite the success of foundation models in image synthesis, achieving fine-grained spatial control remains a significant challenge, typically requiring auxiliary…Despite the success of foundation models in image synthesis, achieving fine-grained spatial control remains a significant challenge, typically requiring auxiliary structural adapters or complex inference-time steering.
Razieh Rezaei, Ehsaneddin Asgary, Masoud Jalili Sabet
Multi-modal Large Language Models (MLLMs) have seen broad adoption, but their biases are still far less examined than those of standard LLMs, creating possible social…Multi-modal Large Language Models (MLLMs) have seen broad adoption, but their biases are still far less examined than those of standard LLMs, creating possible social harms when deployed in real-world settings.
Abdullah Hamdi
Promptable segmentation models such as SAM 3 achieve remarkable open-vocabulary performance but require dedicated architectures, large-scale annotation engines, and…Promptable segmentation models such as SAM 3 achieve remarkable open-vocabulary performance but require dedicated architectures, large-scale annotation engines, and task-specific training.
Genpei Zhang
Amodal video segmentation asks for the complete mask of an object in every frame, including the parts hidden behind other objects.Amodal video segmentation asks for the complete mask of an object in every frame, including the parts hidden behind other objects. The best current methods generate these masks with fine-tuned video diffusion models, which need…
Yongsheng Lian
Estimating food mass from a photograph is central to image-based dietary assessment, but whether trained models transfer to new cameras and foods is unclear.Estimating food mass from a photograph is central to image-based dietary assessment, but whether trained models transfer to new cameras and foods is unclear.
Jiahan Li, Huangyuan Su, Shengbang Tong et al.
Most unified multimodal models treat images and text asymmetrically: a pretrained language model generates text, an attached diffusion head generates images, and outputs…Most unified multimodal models treat images and text asymmetrically: a pretrained language model generates text, an attached diffusion head generates images, and outputs that contain both are produced in a fixed order, so the…
Smaller open models trained to predict edit regions sustained roughly seven times the success rate of the best proprietary editor on five-step robot tasks.Smaller open models trained to predict edit regions sustained roughly seven times the success rate of the best proprietary editor on five-step robot tasks.
Aymen Lassoued, Angelique Loesch, Romaric Audigier
Instruction-based image editing models can now add, remove a specified number of objects or change their category while preserving the scene.Instruction-based image editing models can now add, remove a specified number of objects or change their category while preserving the scene.
Sascha Saralajew, Eleonora Poeta, Eliana Pastor et al.
Concept Bottleneck Models (CBMs) promise predictions that humans can inspect and correct through concepts such as "curved beak".Concept Bottleneck Models (CBMs) promise predictions that humans can inspect and correct through concepts such as "curved beak". Yet on CUB-200-2011, their standard benchmark, progress is measured like that of ordinary…
Jihai Zhang, Runjia Qian, Kaiqin Kong et al.
Moving from controllable videos to genuinely playable worlds requires persistent world state, executable game rules, and low-latency interaction.Moving from controllable videos to genuinely playable worlds requires persistent world state, executable game rules, and low-latency interaction.
Kavyansh Tyagi, Paolo Russo
Class unlearning for video segmentation aims to ensure that a removed category cannot be reconstructed from a deployed model's outputs.Class unlearning for video segmentation aims to ensure that a removed category cannot be reconstructed from a deployed model's outputs.
Eachen Soong, Zijian Niu, Haoran Xu et al.
Simulation-ready world reconstruction demands physical interactivity beyond visual realism, which existing black-box 3D generation fails to deliver.Simulation-ready world reconstruction demands physical interactivity beyond visual realism, which existing black-box 3D generation fails to deliver.
Rohit Saxena, Alessandro Suglia, Marek Rei et al.
Scaling laws suggest that increasing model size, training data, and compute generally yields monotonic performance improvements.Scaling laws suggest that increasing model size, training data, and compute generally yields monotonic performance improvements.
Tianqi Liu, Hanfei Zhao, Qifeng Liang et al.
World models enable embodied agents to anticipate action consequences, yet jointly modeling locomotion and manipulation across diverse embodiments remains challenging due…World models enable embodied agents to anticipate action consequences, yet jointly modeling locomotion and manipulation across diverse embodiments remains challenging due to heterogeneous action spaces and limited multimodal…
Hao Chen, Junnan Xu
Invisible watermarks are used to mark who owns a painting. We show that a simple attack removes the most robust one we test.Invisible watermarks are used to mark who owns a painting. We show that a simple attack removes the most robust one we test. The attack redraws the watermarked painting with brush strokes, using a pretrained stroke-based renderer.
Xiaokang Yuan, Binhui Yao, Luwei Yang et al.
Document understanding is increasingly judged on where an answer comes from, scored against annotated gold locations as if each fact lived in one place.Document understanding is increasingly judged on where an answer comes from, scored against annotated gold locations as if each fact lived in one place.
Imad Buljić, Delaida Muminović
Image harmonization methods adjust the colour and lighting of an object pasted into a photograph so that it looks native to its new scene, and they are ranked by average…Image harmonization methods adjust the colour and lighting of an object pasted into a photograph so that it looks native to its new scene, and they are ranked by average error on one benchmark whose test images are real…
Ronen Schaffer, Hila Manor, Tomer Michaeli
Transformers are widely assumed to exhibit token-decoding explainability. In particular, in vision transformer (ViT) classifiers, decoding individual patch tokens has…Transformers are widely assumed to exhibit token-decoding explainability. In particular, in vision transformer (ViT) classifiers, decoding individual patch tokens has become a common diagnostic tool due to its tendency to yield…
Xinhao Liu, Yunsheng Tian, Yuheng Qiu et al.
Pretrained VLMs bring rich world knowledge and semantic priors to object-goal navigation, and fine-tuning a VLM into a navigation policy has become a common recipe.Pretrained VLMs bring rich world knowledge and semantic priors to object-goal navigation, and fine-tuning a VLM into a navigation policy has become a common recipe.
Simon Giebenhain, Tobias Kirschstein, Liam Schoneveld et al.
Video diffusion models (VDMs) trained on internet-scale data encode a rich prior on appearance, motion, and physics that is difficult to replicate with explicit 3D…Video diffusion models (VDMs) trained on internet-scale data encode a rich prior on appearance, motion, and physics that is difficult to replicate with explicit 3D rendering and costly 3D data capture.
Hsin-Ling Hsu, Neeraja Kirtane, Kuan-Hao Huang
Object hallucination in vision-language models (VLMs) is usually measured by checking each object a caption names against the image.Object hallucination in vision-language models (VLMs) is usually measured by checking each object a caption names against the image. Most benchmarks and detectors alike treat every object mention as a claim that the object is…
Mengtan Zhang, Yuchuan Cui, Yu Ma et al.
Self-supervised monocular depth estimation is appealing for its potential to scale with unlabeled data, yet existing methods often degrade when trained on diverse scenes.Self-supervised monocular depth estimation is appealing for its potential to scale with unlabeled data, yet existing methods often degrade when trained on diverse scenes.
Julius Erbach, Dominik Narnhofer, Bernt Schiele et al.
We introduce PONDER, a method that learns in which order an image generator should fill in content and which of its earlier predictions to revise.We introduce PONDER, a method that learns in which order an image generator should fill in content and which of its earlier predictions to revise.
Jae Joong Lee, Bedrich Benes
FOR-species20K is the largest public LiDAR benchmark for tree-species classification, pooling 25 independently collected terrestrial, mobile, and airborne laser-scanning…FOR-species20K is the largest public LiDAR benchmark for tree-species classification, pooling 25 independently collected terrestrial, mobile, and airborne laser-scanning datasets across 33 species.
Chen Chen, Zheming Liang, Jiaqi Wang
Visual world knowledge is a core capability of multimodal large language models (MLLMs), underpinning knowledge-intensive visual question answering and fine-grained…Visual world knowledge is a core capability of multimodal large language models (MLLMs), underpinning knowledge-intensive visual question answering and fine-grained visual reasoning.
Shanyan Guan, Shiyu Li, Xin Li et al.
Instruction-driven image editing has reached native 4K, yet how such editors are trained remains undisclosed, and pretraining one from scratch is beyond most teams.Instruction-driven image editing has reached native 4K, yet how such editors are trained remains undisclosed, and pretraining one from scratch is beyond most teams.
Mochamad Rizal Fauzan, Irgi Surya
Physics-guided networks for underwater image restoration predict transmission and backscatter and invert the image-formation model, yet rarely test whether this physics…Physics-guided networks for underwater image restoration predict transmission and backscatter and invert the image-formation model, yet rarely test whether this physics does any work.
Soumick Sarker, Mengmi Zhang
Geometry foundation models estimate camera poses and 3D scene structure from video sequences, but maintaining consistent reconstructions over long horizons remains…Geometry foundation models estimate camera poses and 3D scene structure from video sequences, but maintaining consistent reconstructions over long horizons remains challenging.
Zeyang Zhang, Linxiang Gao, Meiqi Gu et al.
Recent work has explored visual reasoning through image generation, where models solve visual-reasoning problems by directly generating solution images.Recent work has explored visual reasoning through image generation, where models solve visual-reasoning problems by directly generating solution images.
Nikolay Semenov, Artem Riabinin, Sergey Bassenko et al.
We present Kandinsky S2V 1.0, an open family of speech-to-video models for controllable audio-driven human animation, comprising Kandinsky S2V 1.0 Lite (2B parameters)…We present Kandinsky S2V 1.0, an open family of speech-to-video models for controllable audio-driven human animation, comprising Kandinsky S2V 1.0 Lite (2B parameters) and Kandinsky S2V 1.0 Pro (21B parameters).
Fabian Gröger, Naël Ouerghemi, Shuo Wen et al.
Multimodal LLMs are typically trained by first aligning a vision encoder with a language model via projector training on large image-caption datasets, followed by joint…Multimodal LLMs are typically trained by first aligning a vision encoder with a language model via projector training on large image-caption datasets, followed by joint training of the full multimodal model.
Boaz Meivar, Shai Avidan
A common practice in instance retrieval is to grow the gallery size to improve a benchmark's discrimination capability.A common practice in instance retrieval is to grow the gallery size to improve a benchmark's discrimination capability. One prominent example is ILIAS, which adds up to 100 million distractor images.
Lei Yang, Yuner Zhang, Ziyang Liu et al.
Recent advances in multimodal foundation models, exemplified by GPT-6 Astra, raise the prospect of general-purpose embodied reasoning and planning.Recent advances in multimodal foundation models, exemplified by GPT-6 Astra, raise the prospect of general-purpose embodied reasoning and planning.
Fazhong Liu, Yan Meng, Tian Dong et al.
Pose-guided diffusion models can now synthesize entire human figures in motion, spawning a new class of deepfakes: Motion Aware Deepfake (MAD) that have already reached…Pose-guided diffusion models can now synthesize entire human figures in motion, spawning a new class of deepfakes: Motion Aware Deepfake (MAD) that have already reached hundreds of millions of viewers.
Zhaowei Chen, Yikai Ge, Linze Li et al.
Representation alignment with pretrained visual encoders improves diffusion transformer training but requires auxiliary encoders and extra training overhead.Representation alignment with pretrained visual encoders improves diffusion transformer training but requires auxiliary encoders and extra training overhead.
Xiaoyang Ma, Chi Wang, Hong Sun
Multimodal large language models process the complete visual token sequence, increasing prefill cost even when many tokens are irrelevant to the instruction.Multimodal large language models process the complete visual token sequence, increasing prefill cost even when many tokens are irrelevant to the instruction.
Nadav Alali, Ohad Ben-Shahar
Unlike the clean and pixel-aligned complete pieces of standard jigsaw benchmarks, real-world puzzle fragments lose their boundary regions to erosion, destroying the…Unlike the clean and pixel-aligned complete pieces of standard jigsaw benchmarks, real-world puzzle fragments lose their boundary regions to erosion, destroying the signal that classical compatibility measures (CMs) rely on.
Md Abdul Kadir, Daniel Sonntag
Attention heads that attend to image regions relevant to a question are increasingly used to steer, ground and interpret vision-language models (VLMs) and to reduce their…Attention heads that attend to image regions relevant to a question are increasingly used to steer, ground and interpret vision-language models (VLMs) and to reduce their hallucinations.
Zihao Pan, Mengting Chen, Cheng Shi et al.
Visual representations are largely developed for understanding, yet what makes them useful for generation remains unclear.Visual representations are largely developed for understanding, yet what makes them useful for generation remains unclear. We study this question in pixel diffusion transformers and uncover two key insights.
Hui Wei, Hao Yu, Hui Kuurila-Zhang et al.
Face de-identification (FDeID) has emerged as a critical privacy-preserving technology, yet its evaluation remains fundamentally fragmented.Face de-identification (FDeID) has emerged as a critical privacy-preserving technology, yet its evaluation remains fundamentally fragmented.