Skip to content
Oct 22Thu
  1. arXiv cs.RO57

    Research on Resource Allocation for Heterogeneous Multi-Team Robot Collaboration Based on Hamilton's Rule

    This paper studies the dynamic robot allocation problem in heterogeneous multi-team collaboration, treating robots as transferable resources, drawing on Hamilton's rule from ecology to design an altruistic decision-making mechanism, and proving that the generalized heterogeneous resource allocation problem is combinatorial optimization and NP-hard.

  2. arXiv cs.RO60

    Feedback World Model Enables Precise Guidance of Diffusion Policy (NeurIPS 2026)

    This paper proposes a feedback world model that uses the true states observed after robot execution to perform online closed-loop correction of predictions at inference time, without additional training data or parameter updates. The method can be interpreted as a latent-space observer and provides convergence guarantees under bounded, asymptotically convergent dynamics residuals and a stable feedback gain; it also introduces action-aware guidance to better translate corrected predictions into control.

  3. arXiv cs.RO62

    WARPED: Synthesizing wrist-view observations from first-person human demonstrations to train robot visuomotor policies

    WARPED is a framework that synthesizes realistic wrist-view observations and actions from human demonstration videos, enabling visuomotor policy training with only monocular RGB data. The system uses vision foundation models to initialize the interactive scene, employs a hand-object interaction pipeline to track the hand and manipulated object and retarget trajectories to a robotic end-effector, and finally uses Gaussian Splatting to synthesize photorealistic wrist-view observations for directly training policies.

  4. arXiv cs.RO60

    Safe-Night VLA: Thermal-Perceptive Vision-Language-Action Models for Safety-Critical Manipulation

    Safe-Night VLA is a multimodal manipulation framework that integrates long-wave infrared thermal perception into a pre-trained vision-language backbone, enabling robots to perform semantic reasoning based on thermodynamic properties and to enforce deterministic workspace constraints during policy execution through a control barrier functions safety filter.

  5. arXiv cs.RO65

    ExtremControl: 50ms humanoid robot teleoperation with scaled velocity feedforward

    ExtremControl proposes a low-latency whole-body control framework for humanoid robots that reduces end-to-end teleoperation latency from about 200ms to as low as 50ms. Its core is adding scaled velocity feedforward in low-level control, which cuts tracking delay by about 70ms, and operating directly on the SE(3) poses of selected rigid links to avoid joint-space retargeting; the paper also derives a closed-form Cartesian-space mapping that needs only a single anthropomorphic calibration to adapt to operators of different body proportions.

  6. arXiv cs.RO47

    HEHA: Bounded Suboptimal Constrained Path Planning for Heterogeneous Multi-Robot Exploration of Unknown Environments

    HEHA (Hierarchical Exploration with Heterogeneous Agents) proposes a hierarchical framework that uses a new routing algorithm, RCH (Routing with Constraints and Heterogeneity), to quickly solve large-scale multiple Hamiltonian path problems (mHPP) with traversability constraints, assigning areas to be explored to drones, wheeled robots, and legged robots and determining the order in which those areas are visited.

  7. arXiv cs.RO55

    AFFORD2ACT studies the capability ceiling of robot manipulation policies with sparse 2D keypoint input

    AFFORD2ACT (Affordance-Guided Keypoints to Act) studies how much manipulation capability can be retained when only sparse 2D keypoints are used as input: an off-the-shelf language-conditioned affordance model locates task-relevant regions, selects up to 15 object keypoints plus 4 end-effector keypoints, compresses the policy input to 19 2D keypoints (38 coordinates), and then uses lightweight gating to decide which keypoints to focus on during execution.

  8. arXiv cs.RO73

    AgiBot World Colosseo releases large-scale manipulation data platform and GO-1 generalist policy

    AgiBot World Colosseo introduces the AgiBot World large-scale manipulation platform, containing over 1 million trajectories covering 217 tasks across 5 deployment scenarios, an order-of-magnitude increase in data scale over existing datasets, and uses a standardized collection pipeline with human-in-the-loop verification.

  9. arXiv cs.RO36

    Implementation of Dynamic Microsegmentation in Multi-Robot Networks

    A laboratory study used a commercial software-defined microsegmentation tool to implement dynamic microsegmentation in an Internet-of-Things multi-robot network, with policies adaptively adjusted and automatically deployed based on asset functional and health tags. The demonstration showed that the approach can automatically isolate a designated threat in real time while maintaining normal operation of unaffected nodes, validating the feasibility of microsegmentation for addressing threats and disruptions in IoT networks.

  10. arXiv cs.RO38

    Extending graspable-part segmentation to multi-object images

    A study proposes introducing a laser pointer into a vision-based portable pipeline for target disambiguation in multi-object scenes, to support grasp selection and preshaping in upper-limb prostheses. The method uses a mixed reality strategy to reuse existing high-quality segmentation masks to generate training images and retrains a deep convolutional neural network. Experimental results show target disambiguation accuracy improves by up to 9% over existing solutions while computational cost remains unchanged.

  11. arXiv cs.RO55

    AOV-GS: Active Open-Vocabulary Semantic Mapping with 3D Gaussian Splatting

    AOV-GS is an active 3D Gaussian Splatting mapping system that uses frozen foundation models to guide exploration, without requiring manually annotated segmentation masks or closed semantic categories. In its coarse exploration stage, it re-ranks geometric candidate views by the novelty of CLIP mask embeddings computed from SAM instance segmentation, biasing exploration toward semantically informative regions; a lightweight scene language field fitted offline directly aligns the collected CLIP embeddings, enabling open-vocabulary text-query segmentation.

  12. arXiv cs.RO51

    Causal world models under physical parameter shifts: explicit affine coefficients improve extrapolative prediction

    This study examines the degradation of world-model predictions when physical conditions fall outside the training distribution, comparing two causal modeling elements: the inputs available to the predictor and how its mechanism computes their effects. On a synthetic benchmark with shortcut features, a frozen dependency mask derived from paired interventions reduced the out-of-distribution RMSE of a fully connected predictor from 1.769 to 0.697, close to the generator-oracle mask's 0.694.

  13. arXiv cs.RO55

    RoPT: A Robust 6DoF Object Pose Tracking Framework for Video

    RoPT is a 6DoF object pose tracking framework for robotic interaction that couples visual perception, temporal kinematics, and global re-localization into a closed loop to counter catastrophic divergence in monocular pipelines under fast motion. Its visual module tracks object masks to handle partial and severe occlusions; a kinematic factor graph regularizes frame-to-frame updates, predicts forward poses, and drives parallel multi-hypothesis verification to avoid local minima; and an active re-localization module gives the system failure awareness and deterministic self-recovery.

  14. arXiv cs.RO56

    AW-0: An Embodied World Action Model Framework Unifying Code-Based Planning and Video-Action Prediction

    The paper proposes AW-0, an agentic world action model framework that combines code-based planning with joint video and action prediction. Within a unified mixture-of-transformers architecture, it simultaneously models three coupled generative streams: code, future video, and robot actions. A code expert generates parameterized skill routines and control logic, while video and action experts generate future visual states and low-level motor commands.

  15. arXiv cs.RO57

    CW-WAM: A Force-Sensitive Manipulation World Action Model That Jointly Predicts Contact Wrench

    CW-WAM is a world action model that jointly predicts video, motion, and contact wrench. Inspired by hybrid motion-force control, it uses a unified interaction module to predict time-aligned motion-wrench chunks as control references. It structures motion-wrench dependencies with pair-causal attention and retains past interaction information in a fixed-length wrench memory; the predicted wrench chunk serves as the force reference for a 20 Hz outer-loop admittance controller.

  16. arXiv cs.RO56

    AtomicRL: An Atomic Reinforcement Learning Post-Training Framework for Long-Horizon Robotic Manipulation

    The paper proposes AtomicRL, a framework that uses atomic task structure to improve reinforcement learning post-training of vision-language-action (VLA) policies. Its core components include Semantic-Aware Policy Optimization (SAPO), which uses semantic gating to prevent TD residuals from failed atomic subtasks from propagating across tasks, thereby mitigating credit contamination; and Bottleneck-Adaptive Target Exploration (BATE), which dynamically coordinates task sampling and local exploration incentives based on the mastery level of each subtask.

  17. arXiv cs.RO58

    RISE: Test-Time Motion Steering for Perceptive Humanoid Fall Recovery

    RISE is a perceptive humanoid fall-recovery method that uses task objectives at inference time to steer how the robot stands up. It learns a recovery vocabulary that links intended movements to motor actions through sensory feedback; a visual diffusion planner learns from executions of this vocabulary to predict motion intent as future body states, and task costs steer that prediction toward a desired heading, rise speed, or path, after which motion latents are generated accordingly. Simulations demonstrate diverse recoveries, terrain adaptation, and test-time steering without retraining, with a real-robot demo on the Unitree G1.

  18. arXiv cs.RO57

    SP-HLM: Sparse-Pose-Driven Motion Generation and Whole-Body Control Framework for Humanoid Loco-Manipulation

    SP-HLM proposes a sparse-pose-driven interface framework that uses five task-critical body poses plus a learned implicit motion prior to represent spatial intent and whole-body coordination in complementary forms. The SP-VLA vision-language-action model first predicts task-relevant sparse poses and finger joint positions from multimodal observations and language instructions via asynchronous action-chunk inference. The SP-MGM motion generation model, trained through two-stage distillation, reconstructs coordinated full-body motion in real time, and the SP-GMT general motion tracker then combines the explicit sparse targets with the implicit motion prior for whole-body control.

  19. arXiv cs.RO58

    TARSphere: A Robot-Oriented Full-Stack Framework and Benchmark for Long-Horizon Embodied Agents

    TARSphere is a robot-oriented full-stack framework for long-horizon embodied agents operating under continuously changing physical and social environments. It includes TARSphere-Infra, which runs robot policies in physics simulation; TARSphere-Harness, which lets a frozen multimodal large language model make decisions through multi-level executable skills; and TARSphere-Bench, an evaluation benchmark comprising 360 episodes across 30 indoor scenes.

  20. arXiv cs.RO50

    Object- and Task-Aware Active Perception Framework for Mobile Manipulators in Semi-Static Environments

    An arXiv paper proposes an object- and task-aware active perception framework that lets a high-degree-of-freedom mobile manipulator use its hand camera to actively inspect uncertain or safety-critical regions during navigation. The framework uses a probabilistic next-best-view (NBV) formulation and is integrated with hierarchical task model predictive control (HTMPC), exploiting kinematic redundancy to adjust viewpoints while preserving the higher priority of base-trajectory tracking. Real-world tests showed that, compared with passive or non-task-aware baselines, the system improved map consistency and reduced task-related map entropy and navigation risk.

  21. arXiv cs.RO56

    HuMiT: Low-Latency Whole-Body Humanoid Teleoperation via Compact Reference Tracking

    HuMiT is a whole-body humanoid teleoperation system whose unified tracking policy requires only a compact reference target—root height, root velocity, and the SE(3) poses of four sparse keypoints at the current frame—yet achieves tracking accuracy comparable to methods that rely on full joint positions, dense body-part transformations, and even future frames.

  22. arXiv cs.RO47

    Spacetime Splines for Adaptive Robot Motions

    This study proposes a spline-based movement primitive representation that unifies spatial geometry and temporal progression into a common set of continuous variables, jointly estimates a shared Bezier curve, and allows spatial and temporal model complexity to be adapted independently. Simulations validated joint recovery accuracy, refinement from modifications to model complexity and continuity, and improved robustness to variance in the demonstration set. In a robot-assisted patient-turning task, online retiming and synchronization capabilities were evaluated with a physical manikin.

  23. arXiv cs.RO51

    Paper proposes path to improve robot zero-shot generalization through data diversity

    An arXiv paper formalizes zero-shot generalization in physical AI as coverage of the deployment distribution, noting that more samples from the same collector can only slowly shrink the unseen region, while each additional contributor can expand coverage. Based on this, the paper proposes a shared latent space for robot actions that combines multimodal alignment, generative augmentation, and noisy-label learning, and suggests that developers build applications around the standard robot Origmi to provide diverse data. It concludes with a testable hypothesis and evaluation protocol linking real-robot zero-shot success rates to data diversity.

  24. arXiv cs.RO51

    OMAR: Open-World Multi-Attribute Reasoning for Scene-Conditioned Shelf Organization

    An arXiv paper proposes OMAR, an open-world multi-attribute reasoning pipeline for inferring a shelf's latent organization and ranking placement positions for new objects without user preference instructions. A vision-language model first proposes object labels and attributes such as content and packaging type, which are grounded through segmentation, depth, and multi-view association; an LLM then reasons over an instance-level 3D scene graph to produce scene-consistent placement rankings, followed by geometric and kinematic feasibility checks before execution.

  25. arXiv cs.RO45

    Sufficient and Necessary Causal Explanations for Autonomous System Failure Analysis

    An arXiv paper proposes distinguishing two goals in autonomous system failure analysis, reproduction and avoidance, and formalizes the concept of "necessary causal explanations," which together with existing "sufficient explanations" forms a unified causal analysis framework. Based on actual causality and causal responsibility, the paper presents an efficient approximation algorithm for generating necessary explanations, evaluates its efficiency across multiple environments, and uses counterfactual generation to verify that it outperforms existing methods on failure avoidance.

  26. arXiv cs.RO67

    SpatialDex: Pre-training 3D-Grounded Bimanual Dexterous Manipulation from RGB-Only Human Videos

    SpatialDex is a framework that learns 3D-grounded bimanual dexterous manipulation from RGB-only human videos through reconstruction-augmented visuomotor pre-training, learning human behavior together with its spatial context. It reconstructs scene geometry and estimates hand motion from each video, aligns the two at a video-level scale using the hand-size prior of 3D hand estimates, and uses the reconstructed geometry as both a policy input and a prediction target.

  27. arXiv cs.RO57

    CausGround: Supporting Adaptive Embodied Planning with Causal Interaction Knowledge

    CausGround proposes a non-parametric causal interaction grounding framework that distills interaction experience into reusable, action-centered causal knowledge, identifies action preconditions and effects, and organizes them into a factorized world-state representation. At planning time, it aligns task-relevant causal dependencies with current observations, supporting backward reasoning over preconditions and forward reasoning over effects.

  28. arXiv cs.RO55

    FlowVLA: Flow-Aware Physical Completion Estimation for Quantitative Robotic Pouring

    FlowVLA separates action generation from physical-completion estimation. A shared π0.5 action expert learns approach, pour, and return, while a target-independent estimator fuses visual, joint, wrist-wrench, and recurrent force-belief histories to estimate transferred mass. It triggers return when this estimate plus predicted residual outflow reaches the requested mass.