Skip to content
Only Research#arXiv
Nov 2Mon
  1. arXiv cs.RO60

    Study: Learning and Transferring Closed-Loop Robot Software

    The research treats complete closed-loop robot policy implementations as reusable execution experience: a coding agent generates policy code from a few successful demonstrations and iteratively improves it using simulation feedback. Across four source tasks in RoboCasa, iterative optimization raised the success rate from 28.3% with initially generated code to 64.2% with validation-selected code, and the learning approach was validated on a physical Unitree G1.

Oct 27Tue
  1. Xbotics具身智能实验室 · 微信公众号75

    Tsinghua team proposes SimpleTouch: fine manipulation learned from 50 demonstrations without tactile policy pretraining

    A Tsinghua University research team proposes SimpleTouch, which adds a tactile expert to the pretrained VLA π0.5 and uses single-stage training with only 50 demonstrations per task, without additional tactile policy pretraining or a separate alignment stage.

  2. arXiv cs.RO62

    VPR-Space: A Benchmark for Visual Place Recognition in Space Analog Domains

    The paper proposes the VPR-Space benchmark to evaluate visual place recognition (VPR) capabilities in extraterrestrial surface scenarios such as the Moon and Mars. The authors built 16 database-query datasets based on existing data from Space Analog Domains (SAD), covering challenges including environment, viewpoint change, and illumination conditions.

  4. arXiv cs.RO60

    OSMA-Bench: Evaluating Safety Under Obstacle Conditions in Household Robot Navigation

    The authors propose OSMA-Bench, a benchmark that uses spatially matched scenario sets differing only in obstacle type to test whether robot navigation adjusts clearance and speed according to obstacle semantics, and they propose the Semantic Sensitivity Index (SSI) to measure this adaptation. Evaluating VLM and vision-language-action (VLA) policies on the benchmark, they find that even with explicit safety prompts, neither consistently adjusts its motion according to obstacle safety levels.

Oct 26Mon
  1. 机器之心 · 微信公众号78

    RoboCoach: Using World Models to Locate Weak Subtasks and Improve Long-Horizon Task Success Through Targeted Teaching

    Zhang Changshui and Cui Sen's team at Tsinghua University propose RoboCoach, an embodied intelligence system that uses the world model CoachWorld to run closed-loop trials of long-horizon tasks in imagination, identify the first weak subtask that times out, and request targeted human teaching for it, updating only the corresponding skill expert. Under a fixed demonstration budget, the success rate rises from 13.3% to 75.0% on Franka and from 40.0% to 83.8% on AgileX, while the uniform collection baseline reaches only 30.0% and 47.5%, respectively. On four unseen new task routes, the average success rate is 35.0%, compared with 0% for the shared-policy baseline.

    Why it matters: The paper presents a complete experiment on using a world model to locate weak subtasks and improve success rates through targeted teaching; its approach to data budget allocation may be a useful reference.

Oct 23Fri
  1. 深蓝AI · 微信公众号67

    IROS 2026 NIDAR uses RGB for zero-shot LiDAR point cloud intensity generation

    The IROS 2026 paper NIDAR proposes generating pseudo near-infrared images from RGB images and using intrinsic decomposition to add point-level intensity to existing point clouds; after offline training, it can transfer zero-shot to target scenes. In the Warehouse and Hospital sequences in Isaac Sim, after replacing with NIDAR intensity, the ATE RMSE of ISC-LOAM decreased by about 43.0% and 41.1%, respectively, compared with the simulator's built-in intensity.

Oct 22Thu
  2. Xbotics具身智能实验室 · 微信公众号62

    HKU team proposes YOCO for dexterous-hand teleoperation mocap calibration with few paired poses

    Researchers from the University of Hong Kong, Yisheng Technology, and Shenzhen Hetao College have proposed YOCO, a few-shot session calibration method for 3D keypoints, aimed at correcting bias in low-cost motion-capture gloves used in dexterous-hand teleoperation. The paper has been accepted to CoRL 2026.

  3. Xbotics具身智能实验室 · 微信公众号72

    TaskAnchor lets VLA use execution history to address task-state confusion in long-horizon manipulation tasks

    TaskAnchor connects execution history to VLA's existing language and vision interfaces through a lightweight adapter, aiming to alleviate task-state confusion in long-horizon manipulation. It uses a dual-path design: a normalized task-state coordinate that describes semantic execution stages, and a visual residual based on context-adaptive test-time training (CA-TTT) that preserves historical details.

  4. HuggingFace Daily Papers56

    SERA: A Self-Evolving Robotic Agent Framework for History-Dependent Manipulation

    The study proposes SERA (Self-Evolving Robotic Agent), which organizes a high-level VLM into a robotic agent through an editable harness, with a fixed VLA executor providing low-level control. The harness uses observations and execution feedback to maintain task context, and the self-evolution mechanism proposes and evaluates harness revisions through environment rollouts, with the selected configuration fixed before held-out testing. On RoboMME, SERA autonomously selects a configuration reaching 51.38% overall success rate, versus 44.38% without self-evolution.

  5. 机器之心 · 微信公众号55

    ReGDiff: Exploring Metamaterial Voxel Geometry with Guided Diffusion in a Controlled Latent Space

    A team led by Dawei Zhou at Virginia Tech and researchers at Meta propose ReGDiff in a NeurIPS 2026 paper to generate metamaterial voxel structures that satisfy geometric constraints. The method has two steps: first, an RAS mechanism organizes the autoencoder latent space into a form where good and bad structures are clearly separated and good structures are evenly distributed; then, short-range repulsion (SRR) pushes latent variables away from the near neighbors of known samples during sampling, and it takes effect only at inference time.

  6. arXiv cs.RO56

    TrackDeform3D: A Markerless 3D Keypoint Tracking and Dataset Collection Framework for Deformable Objects Using RGB-D Cameras

    TrackDeform3D is an affordable and autonomous framework for collecting 3D datasets of deformable objects using only RGB-D cameras. It identifies 3D keypoints and robustly tracks their trajectories with motion consistency constraints, producing temporally smooth and geometrically consistent data.

  7. arXiv cs.RO55

    PaceVLA: Adaptive Temporal Action Quantization in Vision-Language-Action Models

    PaceVLA proposes an adaptive temporal execution framework for VLAs that uses multi-granularity action decoders on a shared action expert, along with quantizability-guided mode selection and context-conditioned routing, to decide at each inference step whether to adopt coarse-grained execution. Experiments cover three multi-task simulation benchmarks and six real-world tasks, improving execution efficiency while maintaining task success rates across multiple embodiments, including long-horizon and dexterous manipulation.

  8. arXiv cs.RO60

    VQ-WM: A Latent Feedback Motion Planning Framework for Robot Manipulation

    The paper proposes Vector-Quantized World Model (VQ-WM), a latent feedback motion planning framework that combines discrete long-horizon search with continuous visual feedback control: a discrete latent state predictor models transitions between vector-quantized latent states, allowing the planner to search for the shortest path over long distances, while a continuous learned controller then reaches the planned states step by step through visual feedback to correct deviations and mitigate compounding errors.

  9. arXiv cs.RO57

    HarnessPAI: An Evolvable Harness Framework for Physical AI

    HarnessPAI proposes a model- and embodiment-agnostic Harness framework for Physical AI that treats code as the executable, evolvable interface organizing underlying action primitives. The framework separates two timescales: within a single rollout, it executes open-loop at the program level with a fixed program guiding and checking execution; across rollouts, it evolves closed-loop, using execution feedback to revise the program and distill failures into reusable skills.

  11. arXiv cs.RO55

    MiTaS multi-resolution tactile imitation learning framework for contact-rich manipulation tasks

    MiTaS is a multi-resolution tactile representation framework that uses modality-specific convolutional stems and a Transformer-based fusion structure to integrate information from an RGB camera, a GelSight Mini vision-based tactile sensor, and a high-frequency event-based Evetac sensor, then conditions a flow-matching policy to perform downstream tasks.

  12. arXiv cs.RO62

    WARPED: Synthesizing wrist-view observations from first-person human demonstrations to train robot visuomotor policies

    WARPED is a framework that synthesizes realistic wrist-view observations and actions from human demonstration videos, enabling visuomotor policy training with only monocular RGB data. The system uses vision foundation models to initialize the interactive scene, employs a hand-object interaction pipeline to track the hand and manipulated object and retarget trajectories to a robotic end-effector, and finally uses Gaussian Splatting to synthesize photorealistic wrist-view observations for directly training policies.

  13. arXiv cs.RO38

    Extending graspable-part segmentation to multi-object images

    A study proposes introducing a laser pointer into a vision-based portable pipeline for target disambiguation in multi-object scenes, to support grasp selection and preshaping in upper-limb prostheses. The method uses a mixed reality strategy to reuse existing high-quality segmentation masks to generate training images and retrains a deep convolutional neural network. Experimental results show target disambiguation accuracy improves by up to 9% over existing solutions while computational cost remains unchanged.

  14. arXiv cs.RO55

    AOV-GS: Active Open-Vocabulary Semantic Mapping with 3D Gaussian Splatting

    AOV-GS is an active 3D Gaussian Splatting mapping system that uses frozen foundation models to guide exploration, without requiring manually annotated segmentation masks or closed semantic categories. In its coarse exploration stage, it re-ranks geometric candidate views by the novelty of CLIP mask embeddings computed from SAM instance segmentation, biasing exploration toward semantically informative regions; a lightweight scene language field fitted offline directly aligns the collected CLIP embeddings, enabling open-vocabulary text-query segmentation.

  15. arXiv cs.RO58

    RISE: Test-Time Motion Steering for Perceptive Humanoid Fall Recovery

    RISE is a perceptive humanoid fall-recovery method that uses task objectives at inference time to steer how the robot stands up. It learns a recovery vocabulary that links intended movements to motor actions through sensory feedback; a visual diffusion planner learns from executions of this vocabulary to predict motion intent as future body states, and task costs steer that prediction toward a desired heading, rise speed, or path, after which motion latents are generated accordingly. Simulations demonstrate diverse recoveries, terrain adaptation, and test-time steering without retraining, with a real-robot demo on the Unitree G1.

  17. arXiv cs.RO50

    Object- and Task-Aware Active Perception Framework for Mobile Manipulators in Semi-Static Environments

    An arXiv paper proposes an object- and task-aware active perception framework that lets a high-degree-of-freedom mobile manipulator use its hand camera to actively inspect uncertain or safety-critical regions during navigation. The framework uses a probabilistic next-best-view (NBV) formulation and is integrated with hierarchical task model predictive control (HTMPC), exploiting kinematic redundancy to adjust viewpoints while preserving the higher priority of base-trajectory tracking. Real-world tests showed that, compared with passive or non-task-aware baselines, the system improved map consistency and reduced task-related map entropy and navigation risk.

  18. arXiv cs.RO51

    Paper proposes path to improve robot zero-shot generalization through data diversity

    An arXiv paper formalizes zero-shot generalization in physical AI as coverage of the deployment distribution, noting that more samples from the same collector can only slowly shrink the unseen region, while each additional contributor can expand coverage. Based on this, the paper proposes a shared latent space for robot actions that combines multimodal alignment, generative augmentation, and noisy-label learning, and suggests that developers build applications around the standard robot Origmi to provide diverse data. It concludes with a testable hypothesis and evaluation protocol linking real-robot zero-shot success rates to data diversity.

  19. arXiv cs.RO51

    OMAR: Open-World Multi-Attribute Reasoning for Scene-Conditioned Shelf Organization

    An arXiv paper proposes OMAR, an open-world multi-attribute reasoning pipeline for inferring a shelf's latent organization and ranking placement positions for new objects without user preference instructions. A vision-language model first proposes object labels and attributes such as content and packaging type, which are grounded through segmentation, depth, and multi-view association; an LLM then reasons over an instance-level 3D scene graph to produce scene-consistent placement rankings, followed by geometric and kinematic feasibility checks before execution.

  20. arXiv cs.RO67

    SpatialDex: Pre-training 3D-Grounded Bimanual Dexterous Manipulation from RGB-Only Human Videos

    SpatialDex is a framework that learns 3D-grounded bimanual dexterous manipulation from RGB-only human videos through reconstruction-augmented visuomotor pre-training, learning human behavior together with its spatial context. It reconstructs scene geometry and estimates hand motion from each video, aligns the two at a video-level scale using the hand-size prior of 3D hand estimates, and uses the reconstructed geometry as both a policy input and a prediction target.

  21. arXiv cs.RO57

    CausGround: Supporting Adaptive Embodied Planning with Causal Interaction Knowledge

    CausGround proposes a non-parametric causal interaction grounding framework that distills interaction experience into reusable, action-centered causal knowledge, identifies action preconditions and effects, and organizes them into a factorized world-state representation. At planning time, it aligns task-relevant causal dependencies with current observations, supporting backward reasoning over preconditions and forward reasoning over effects.

  22. arXiv cs.RO47

    Reading the Room: Scale-ambiguous Sparse Semantic VSLAM Map Registration to Floor Plans of Partially Built Environments

    Reading the Room (RR) proposes a global-local method for registering scale-ambiguous sparse semantic VSLAM maps to floor plans of partially built environments. Its core is a single robust, differentiable, class-balanced semantic-geometric energy function that runs through the entire pipeline. Evaluated on 33 sequences from 3 construction sites, it improves mean absolute trajectory error by 4.5 times over the strongest baseline in the general unconstrained setting, rising to 7.6 times when anchor correspondences are provided.

  24. arXiv cs.RO60

    End-to-End Reinforcement Learning for Quadrupedal Jumping in Lunar Gravity

    The study proposes a multistage reinforcement learning method that produces a single end-to-end control policy for commanded point-to-point jumping by a quadruped robot under lunar gravity. The policy architecture is simple and relies only on mission-compatible onboard sensing; in simulation, landing errors are smaller than the robot's body size. The work also analyzes torque and power demands and characterizes performance degradation under extreme outlier events, including control-update freezes of up to 1 second during flight. In hardware transfer tests, the policy successfully completed a vertical jump under lunar-gravity offloading, and measured torque and power profiles matched the simulation and stayed within hardware limits.

  25. arXiv cs.RO45

    Joint-Angle Invariance of Jacobian-Based Performance Indices for Serial Robotic Manipulators

    The study reveals the kinematic conditions under which Jacobian-based performance indices of serial robotic manipulators, such as manipulability and stiffness, are independent of the first and last joint angles, i.e., joint-angle invariance (JAI). This property systematically reduces the dimensionality of the effective configuration space and simplifies performance evaluation. In two scenarios, workspace performance map construction and task layout optimization, the JAI strategy reduces computational effort and storage requirements without compromising effectiveness. The work has been accepted to IROS 2026.

  26. arXiv cs.RO51

    Make it Walk: Computational Design Methods for LEGO Walkers

    The paper proposes the first computational approach for designing LEGO walkers that support multiple gaits beyond stable walking. The method has two parts: first, a specially designed gear-linkage mechanism controls the foot trajectory of each leg, incorporating a pair of 3D-printed non-circular gears working with a LEGO Technic mechanism; second, each leg is driven by an independent motor, with a simple yet flexible control algorithm synchronizing the timing of multiple leg motions.

  27. arXiv cs.RO47

    Linear Twisting Sidewinding Gait Motion Planning for Snake Robots on Complex Terrain

    The study proposes a linear twisting function that distributes torsional load across the entire body of a snake robot, replacing the existing rolling vector method's approach of concentrating it in two middle twisting joints. Under matched turning speed and total output power, the new gait reduces the peak output power of a single twisting joint by 42%. Real-robot experiments show it can move on various terrains that the existing rolling vector method cannot traverse, and is up to 49% faster than the traditional sidewinding gait without twisting.

  28. arXiv cs.RO55

    Distance-Field-Based Reinforcement Learning for Reactive and Robust Obstacle Avoidance in Robotic Arms

    This paper proposes a reinforcement learning framework that integrates the Euclidean Distance Field (EDF) directly into the observation space, providing the agent with continuous geometric cues to achieve stable and responsive obstacle avoidance behavior and simplifying reward design; it effectively avoids obstacles both with and without artificial potential field guidance.

  31. arXiv cs.RO50

    State-dependent objective coordination enables end-to-end balance and navigation for two-wheeled robots

    An arXiv paper proposes a lightweight state-dependent objective coordination method for end-to-end balance and navigation of two-wheeled inverted-pendulum robots. The method introduces a pitch-angle-conditioned scalar coefficient β(s)∈[0,1] that dynamically adjusts the relative weight of balance stabilization and navigation objectives during training, without requiring an additional control hierarchy or attitude-stabilization controllers such as PID or LQR.

  32. arXiv cs.RO55

    SLoSa: A Small, Low-Power, Safety-Aware Foundation Model Framework for Robotic Task Planning

    SLoSa is a neuro-symbolic compression and fine-tuning framework that builds a safety-aware dataset using classical planners, a teacher large language model, and formal verifiers, then applies supervised fine-tuning and reinforcement learning fine-tuning guided by a verification-based reward machine to train small, low-power, safety-aware robotic task planning models.