The Era AI Lab team proposes E0.5, a geometry-native world-action model built directly on 3D foundation models that treats 3D geometry as the native representation for world modeling and action prediction, and explicitly predicts future 3D states and actions.
The study proposes the Just Action Model (JAM) framework, which breaks down the differences between VLA and WAM into three separable choices: backbone initialization, the future-observation objective, and whether that loss mechanism is retained at inference. It uses a pretrained visual backbone plus an action expert, trained with an action loss and a foresight loss.
ThinkWorld is a VLA learning framework that represents each action thought as a Chain-of-Dynamics (CoD), a sequence of discrete motion tokens that captures the intermediate dynamics from the current world to a future state and serves as a common action representation across embodiments.
Researchers propose SO-101 Bench, a language-conditioned spatial manipulation simulation benchmark built on an Isaac Lab digital twin of a real SO-101 setup, comprising four task types, 138 objects, 916 evaluation episodes, and 3,629 simulated demonstrations.
Suzhou National Laboratory, Shanghai AI Laboratory, Shanghai Jiao Tong University and others jointly launched the "Caihua·MatVerse" materials multimodal large model and agent application system, which uses an "independent encoders plus unified decoder" architecture to align XRD spectra, electron microscope images and molecular structures into the same semantic space.
Why it matters: The materials present a multimodal unified representation architecture and 19-category disciplinary evaluation benchmarks, offering insight into how materials large models can move from retrieval to mechanistic reasoning.
Harbin Institute of Technology (Shenzhen), the National University of Singapore, and other institutions propose SkeLAM, built on Cosmos-Predict2.5-2B and trained on about 10 hours of robot interaction data, using robot skeletons to supervise latent actions in video.
Researchers from UIUC, Google, Stanford, UC Berkeley and CMU jointly published the review "Proactive AI for Superintelligent Agents," systematically mapping the research landscape of proactive AI and proposing a 6A framework composed of six capabilities: Awareness, Anticipation, Agenda, Arbitration, Action and Adaptation.
Ropedia released six studies at the first Ropedia Super Week, held October 19 to 23, centered on how first-person human video can be turned into training and execution information usable by robots.
Why it matters: The six studies collectively address how first-person human data can be converted into training and execution information usable by robots, and present cross-embodiment and real-robot comparison results.
FastHarness is an experience-driven robot execution framework that uses π0.5 to generate actions and GPT-6 Astra to review and correct them, adjusting the review interval according to task stage and past review results. Across four simulated manipulation tasks in RoboDojo, it achieved an average success rate of 97.19%, higher than the 80% reported for π0.5 + GPT-6 Astra in the GPT-as-Policy report.
The Institute for AI Industry Research (AIR) at Tsinghua University, together with Tsinghua's Department of Electronic Engineering and the University of Science and Technology of China, has proposed OxyGen, which uses unified KV Cache management to let an embodied model's action and language reasoning share prefix computation. The paper has been accepted to NeurIPS 2026.
Why it matters: The paper presents a unified KV Cache management scheme and measured data across multiple platforms, offering a reference for on-device embodied inference deployment.
Researchers from Southern University of Science and Technology and other institutions published NI-skins artificial skin in Nature Machine Intelligence; it reads more than 10,000 sensing elements per second and processes signals hierarchically, taking about 23 milliseconds from sensing to interpretation.
A Tsinghua University research team proposes SimpleTouch, which adds a tactile expert to the pretrained VLA π0.5 and uses single-stage training with only 50 demonstrations per task, without additional tactile policy pretraining or a separate alignment stage.
An ECCV'26 paper proposes MV2GF, a multi-view pedestrian detection method that uses the multi-view features and 3D point maps of the pretrained visual geometry foundation model DA3 to aggregate BEV features instead of perspective projection. Under the setting where training and test camera configurations differ, MV2GF achieves MODA on GMVD-D, MVPerception, and Wildtrack that is 4.6, 4.7, and 2.2 points higher than the previous best, respectively.
EmbodiedLab is a benchmark that requires robots to "acquire knowledge through action," covering 30 quantitative science experiments across 5 disciplines on 14 apparatus platforms. The parameters of each instance are resampled, so results cannot be known in advance but can be scored precisely.
The authors propose the world action model Video Prediction Policy 2 (VPP2), which uses event-level pretraining on large-scale manipulation video, distills the video model into a single-step visual planner, and connects an action module via a MoT architecture to learn implicit inverse dynamics.
The authors propose the IG-VLA framework, which lets a vision-language-action model imagine task-relevant future scene evolution in visual representation space and internalize the reasoning results into a compact Scene Gist Token via Scene Gist Memory, thereby skipping explicit future imagination at inference time.
The authors propose JRDB-AVR, an active visual reasoning benchmark built on real JRDB robotics data: after receiving a visual reasoning question, an embodied agent must request limited observations by timestamp and viewing angle, and evaluation examines both the final answer and the visual evidence supporting it.
FlatVPR proposes a plug-and-play geometric linear residual adapter that applies a residual transformation to features from foundation models such as DINOv2-ViT-S/14 and uses a Pullback Flatness Loss to reduce manifold curvature, so that descriptors between adjacent anchors can be reconstructed by linear interpolation. On the NCLT dataset, the adapter still delivers clear performance gains even when anchor spacing reaches 100 m and severe seasonal changes are present. Map construction is incorporated into an EM framework, split into a continuous M-step for manifold adaptation and an E-step for the anchor selection criterion.
An ICLR 2026 paper re-examines the question of whether differentiable simulators can give better policy gradients, arguing that bias from discontinuous dynamics is not the main obstacle. The authors propose DDCG, a lightweight test that switches estimators in nonsmooth regions; it requires only one hyperparameter and remains reliable with small samples. They also propose IVW-H, a per-step inverse-variance implementation that stabilizes variance in differentiable robot control tasks without explicit discontinuity detection. The paper concludes that estimator switching can improve robustness in controlled experiments, while in real deployment variance control is often more critical.
Prateeth Rao and Sachit Rao propose a geometry-aware epipolar correspondence graph method that uses epipolar constraints to guide the construction and pruning of correspondence graphs, then a graph learning module generates a geometric context vector, which is passed through an MLP to output rotation and translation for camera pose estimation.
The authors propose ActECC, which addresses the difficulty of determining the valid range of action chunks and scheduling replanning requests in edge-cloud collaborative VLA inference through kinematics-guided usable range assessment and delay-aware replanning scheduling. Experiments show it reduces per-action latency by up to 27.4%, cuts cloud calls by up to 45.1%, and lowers average execution error.
A research team proposed a simulation-to-real robot learning framework for agricultural reaching and grasping, building a MuJoCo-based agricultural environment with diverse tomato plant structures and collecting expert demonstrations via joystick teleoperation. Two pretrained generalist policies, Octo and π0.5, were first adapted with simulated demonstrations, then fine-tuned with real demonstrations on a Franka Research 3 robotic arm. Results showed that π0.5 scored higher than Octo on task performance and degraded less under distribution shifts such as viewpoint and spatial offsets; the study also examined the effect of proprioceptive information on policy performance.
CLARO is a VLM agent that orchestrates skills such as open-vocabulary object detection, segmentation, 6-DoF grasping, and non-prehensile pushing to locate and retrieve a language-specified target in cluttered environments. It records past actions to support long-horizon execution and outputs grasp poses or 3D waypoints, enabling transfer to different robot arms without task-specific training. In a dynamic simulation environment, CLARO achieved an average success rate of 89.1%, a relative improvement of over 16% on the strongest competing method in highly cluttered scenes; on a real robot arm, its success rate was 88.8%.
The authors propose the PlayPolicy framework, in which a robot first learns a play policy from minutes of human play data through behavior cloning, then deploys it autonomously to collect hours of interaction data to train a world model; at inference time, this policy proposes candidate action sequences for model-predictive control (MPC).
The authors propose an inspection planning framework that replaces geometric visibility checks with a learned camera information metric based on a classifier variational autoencoder (VAE), to address inspection failures caused by drastic orbital illumination changes. The method implements a guidance, navigation, and control architecture in a photorealistic physics simulator and tests multiple orbital illumination conditions and viewpoints: average brightness reaches 0.57, with 81.6% of observations above 0.25, compared with 0.02 (3.0%) for geometric planning with illumination bands and 0.04 (6.0%) for pure geometric planning.
This study formulates upper-limb functional mobility estimation as an active perception problem, parameterizing reductions in healthy joint limits with impairment coefficients and integrating this into a human model used during robot interaction. The authors propose an online active perception pipeline in which the robot actively probes the user through repeated handover requests while progressively updating a Bayesian belief over the impairment coefficients. Simulation studies and a proof of concept on a robotic platform show that the pipeline can recover the impairment coefficients with relatively high accuracy in real human-robot handovers.
Researchers propose the CapPro framework, which lets a vision-language-action (VLA) policy adapt to previously unseen manipulation tasks using only a single human demonstration video, without robot demonstrations or fine-tuning for the target task. The framework has two components: a phase-aware human video representation module, which learns task-relevant query representations through visual token selection and phase-caption supervision, and a video-conditioned adaptation module, which injects the compact video and query representations into the action-conditioning context of a pretrained VLA policy.
OneDemo proposes a reinforcement learning framework that edits a single successful demonstration into trajectories suited to new task configurations; the learned editor serves both as a task policy and as a reusable demonstration generator. On 15 Meta-World tasks, it reaches a 92.7% success rate using an average of 53.7k environment interactions; on 9 DexMimicGen tasks, it generates demonstrations with an average success rate of 98.4%, and BC-RNN policies trained on the generated data reach an average success rate of 99.6% at the same data scale.
DiVeR estimates decision criticality from the dispersion of sampled action representations and uses it to reweight verifier learning, focusing learning on states where action selection matters most, without requiring step-level annotations or additional environment interaction. In experiments on LIBERO, RoboCasa, and a Franka Research 3 real robot, DiVeR consistently improves task success rates by guiding action selection with a more effective verifier, and verifier inference overhead is negligible.
CognitiveReality builds a semantically indexed Gaussian-TSDF map from a robot's RGB-D stream, shared by a VR operator and a tool-calling language agent. A single mapping program adapts to different platforms through configuration alone, accepting poses from robot SLAM, joint kinematics, motion capture, or visual tracking, and handles localization outages with shadow tracking and keyframe-anchored PnP, maintaining open-vocabulary instance identities and per-object quality at 2 Hz.
DGT-Map proposes a self-supervised framework that learns global, directional, and vehicle-conditioned traversability costmaps from RGB-D observations and locomotion signals. It uses a shared multi-task backbone to learn common terrain features across vehicles, while vehicle-specific prediction heads preserve platform-dependent responses. At inference, it outputs a heading-indexed costmap for use by direction-aware planners.
StepTrigger is a contact-state-triggered backdoor attack on VLM-powered legged robots. The trigger signal comes from the foot-ground contact pressure patterns produced when a Unitree Go1 quadruped walks across dense terrain, rather than from prompts or visible markers.
H2RBench is a Real2Sim benchmark for evaluating human-to-robot (H2R) transfer methods. It establishes a standardized protocol based on real human video demonstrations and simulated robot demonstrations, covering four categories of manipulation tasks.
The authors propose Expert-Play Contouring Control (EPCC), which combines slow expert demonstrations with fast, non-expert play to achieve execution speeds faster than the demonstrations. Expert demonstrations train a latent trajectory generator whose predictions are reparameterized into a time-independent contour of task progress, while play data trains a world model of fast-action outcomes. At deployment, the planner optimizes actions along this contour and penalizes deviation from it.
The paper proposes a path-tracking algorithm for articulated vehicles with a single trailer. It applies a lateral control law at the trailer level and makes short-horizon predictive adjustments to the tractor steering angle, so that both forward and reverse motion converge stably to the target path. The method is geometry-based and requires no per-vehicle calibration or training. In a high-fidelity physics simulation, the steady-state or final lateral error on straight-line, circular-arc, and reverse docking trajectories was 0.02–0.05 m. The authors tested it on a small-scale tractor-trailer robot, with the controller running on a low-cost microcontroller; under about 200 ms of pose-detection latency, the lateral error in repeated reverse docking was below 13 mm.
The authors propose VLN on the Fly, an onboard vision-language navigation stack that keeps instruction grounding, planning, and control as separately inspectable stages: a quantized VLM grounds the instruction to a coarse image cell, depth lifts it to a 3D goal, a fast B-spline planner generates a feasible trajectory, and a pretrained reinforcement learning policy tracks the trajectory and outputs motor commands across multiple quadrotors.
ForceDelta-VLA proposes a correction-distillation framework that constructs an explicit force-correction target from the force-conditioned and force-agnostic predictions of a frozen teacher model, and adds a separate delay-correction target to handle reference-action mismatch. Across nine single-arm and bimanual contact-rich tasks, the system achieves a mean success rate of 82.2%, compared with 54.4% for the ForceVLA baseline and 70.6% for direct execution of the Stage-1 temporal teacher. Compared with ForceVLA, the full system reduces the mean peak contact force of successful trials by about 26% on both platforms.
X-WBC is a cross-embodiment humanoid whole-body control foundation framework that separates relatively shared human motion semantics from embodiment-specific physical execution. It uses human-centered command tokens to align full human motion, robot reference motion, and sparse VR observations; a causal Transformer learns reusable temporal structure from mixed multi-robot rollouts, and lightweight robot-specific modules map the shared representation to each robot's proprioception and action space.
Why it matters: The paper proposes a cross-embodiment humanoid whole-body control framework that decouples shared human motion semantics from each embodiment's execution, and validates joint training on nine simulated embodiments and four real robots.
Researchers propose a "motion communication" method that encodes arbitrary short messages (such as an agent's current intent) as noise into the actions of any pre-trained policy, making robot motion detectable via remote vision or motion capture without degrading policy performance. This physical channel does not rely on wireless communication and requires no additional hardware or direct link to the robot. On real robots running at 50 Hz, four robots jointly recovered an 8-bit message at a total rate of 0.8 bits/s, with validation completed in both simulated environments and real-robot deployment.
The authors annotated each failure of OpenVLA-OFT and pi0.5 on out-of-distribution LIBERO-90 tasks, identifying four failure modes, of which only execution misalignment can be fixed by a single retrospective language correction.