Xinliang Xiao, Bowen Yang, Wenjing Zhang et al.
A robot that assists people must often act on what a person has shown rather than said: which of several identical cartons was pointed at, or which box was handled.A robot that assists people must often act on what a person has shown rather than said: which of several identical cartons was pointed at, or which box was handled.
Ruixiang Wang, Yongyi Su, Wenlve Zhou et al.
World action models (WAMs) aim to answer a coupled physical question: given a task instruction, what motion should the robot execute, and how will that motion change the…World action models (WAMs) aim to answer a coupled physical question: given a task instruction, what motion should the robot execute, and how will that motion change the surrounding world?
Chengjun Zhang, Yuhao Zhang, Jie Yang et al.
End-to-end autonomous driving demands trajectory planners that are both highly accurate and cheap enough for edge deployment.End-to-end autonomous driving demands trajectory planners that are both highly accurate and cheap enough for edge deployment.
Mahed Dadgostar, Guillem Alenyà, Júlia Borràs
Although cloth is known to exhibit different outcomes under repeated fast dynamic motions, even when the same trajectory is applied, this variability has not yet been…Although cloth is known to exhibit different outcomes under repeated fast dynamic motions, even when the same trajectory is applied, this variability has not yet been systematically characterized.
Wei Huang, Bohan Zhang, Chenzhi Liu et al.
Real-time robot control demands enough visual history to infer motion and task progress, but processing that history can delay action.Real-time robot control demands enough visual history to infer motion and task progress, but processing that history can delay action. We present Long-WAM, a model-system framework for scaling the context of causal world-action…
Liu Renhang, Navonil Majumder, Tej Deep Pala et al.
Recent advances in multimodal foundation models have made them capable generalist physical agents for a range of manipulation tasks.Recent advances in multimodal foundation models have made them capable generalist physical agents for a range of manipulation tasks.
Haoran Chen, Jingtian Ji, Samuel Wheeler et al.
Autoregressive action-token policies such as vision-language-action models require action tokenizers to translate discrete token sequences into precise control actions in…Autoregressive action-token policies such as vision-language-action models require action tokenizers to translate discrete token sequences into precise control actions in continuous space.
Thinh D. Le, Son T. Nguyen, Duong Q. Nguyen et al.
Vision-Language-Action (VLA) models have achieved impressive results in robotic manipulation and ground-mobile navigation, yet language-conditioned control of unmanned…Vision-Language-Action (VLA) models have achieved impressive results in robotic manipulation and ground-mobile navigation, yet language-conditioned control of unmanned aerial vehicles (UAVs) in smart warehouses remains largely…
Nanhe Chen, Runqiu Yang, Jiawei Tang et al.
Multi-task manipulation policies differ in architecture, scale, and pretrained priors all at once, so published comparisons cannot attribute performance to any single…Multi-task manipulation policies differ in architecture, scale, and pretrained priors all at once, so published comparisons cannot attribute performance to any single component.
Heng Yu, David D. Yuan, Juze Zhang et al.
World-action models (WAMs) couple future prediction with robot control, yet existing systems often vary the video backbone, interaction structure, supervision, and…World-action models (WAMs) couple future prediction with robot control, yet existing systems often vary the video backbone, interaction structure, supervision, and inference procedure simultaneously, making their design choices…
Jicong Ao, Shuhan Jiang, Yuling Zhong et al.
The ability to interact with articulated objects is essential for embodied intelligent systems, but collecting large-scale real-world demonstrations for these…The ability to interact with articulated objects is essential for embodied intelligent systems, but collecting large-scale real-world demonstrations for these interactions remains challenging due to the precise contact and…
Rahath Malladi, Arshia Sangwan, Rajesh K. Gupta et al.
A robot description does more than specify a physical mechanism: it also encodes arbitrary conventions, such as joint-axis direction, joint-angle zero, and the order and…A robot description does more than specify a physical mechanism: it also encodes arbitrary conventions, such as joint-axis direction, joint-angle zero, and the order and names of links and joints.
Sripad Karne, Arjun Balaji
Vision-language-action models (VLAs) act on instructions without being able to refuse, so screening harmful requests falls to monitors.Vision-language-action models (VLAs) act on instructions without being able to refuse, so screening harmful requests falls to monitors. We test whether these monitors catch ordinary robot tasks requested for harmful reasons…
Jiaxuan Luo, Xingguo Xu, Shanshan Wang et al.
Learned visual reward models are increasingly used to optimize robot policies, yet a reward model can score an execution that acts on the wrong object as highly as one…Learned visual reward models are increasingly used to optimize robot policies, yet a reward model can score an execution that acts on the wrong object as highly as one that completes the task.
Zhaoyang Chu, Earl T. Barr, Claire Le Goues et al.
Coding agents are extending their reach into the physical world by writing and executing robot control programs.Coding agents are extending their reach into the physical world by writing and executing robot control programs. One might expect the agents to use the existing mature software stack that engineers have developed over decades to…
Chongyang Xu, Zhao Wu, Jin Chen et al.
Humanoid whole-body manipulation has advanced rapidly, enabling policies to coordinate locomotion, posture, bimanual interaction, and dexterous hand movements.Humanoid whole-body manipulation has advanced rapidly, enabling policies to coordinate locomotion, posture, bimanual interaction, and dexterous hand movements.
Yuriy Dorn, Darina Dvinskikh, Timofei Loginov et al.
We study the query complexity of optimization with exact scalar-value information. For globally L-smooth convex functions on mathbb R^d with a minimizer in a Euclidean…We study the query complexity of optimization with exact scalar-value information. For globally L-smooth convex functions on mathbb R^d with a minimizer in a Euclidean ball of radius R, we prove the lower bound Ω(dmin{d,√LR²/ε})…
Hung-Jen Chen, Yu-Hsun Hou, Yan-Hong Chen et al.
Vision-language-action (VLA) models can exceed 90% success on in-distribution tasks and withstand nuisance changes that preserve the required action, yet fail under…Vision-language-action (VLA) models can exceed 90% success on in-distribution tasks and withstand nuisance changes that preserve the required action, yet fail under counterfactual changes that demand a different action.
Huimin Pan, Yufan Ren, Kunpeng Song et al.
Egocentric human video offers a scalable data source for dexterous manipulation, yet using it to train humanoid robots presents two challenges: (1) an embodiment gap, as…Egocentric human video offers a scalable data source for dexterous manipulation, yet using it to train humanoid robots presents two challenges: (1) an embodiment gap, as human hands differ structurally from robot end-effectors and…
Ali Alrasheed, Basim Azam, Naveed Akhtar
World models offer a promising way to help robots understand how the physical world evolves and plan complex behaviours through imagination.World models offer a promising way to help robots understand how the physical world evolves and plan complex behaviours through imagination.