Skip to content
Oct 22Thu
  1. arXiv cs.RO49

    VeriCalib: Verifiable Target-Based LiDAR-Camera Calibration

    VeriCalib formulates target-based LiDAR-camera extrinsic calibration as a verifiable estimation problem and outputs a calibration state indicating whether to accept the result or collect more data. It uses a structured covariance to decouple rotation and translation accuracy, guiding data collection toward the weakest directions, and uses in-view and cross-view checks plus the minimum detectable deviation to define the smallest fault detectable in each direction.

  2. arXiv cs.RO44

    Meta-Learning-Based Mode Recognition and Adaptive Control for Human-Robot Interaction

    The framework uses a meta-learning-trained neural network to recognize two human-robot interaction modes, active guidance and passive following, without manually setting switching thresholds. The passive mode recognition rate rose from 90.1% to 99.1%, and the active mode from 79.8% to 97.1%. An adaptive meta-learning controller can compensate for human disturbances and adapt online to varying interaction forces. A multi-trajectory meta-learning algorithm jointly learns an environment basis representation and force-related parameters to handle unmodeled dynamics. Experiments verified its robust control and reliable mode recognition performance.

  3. arXiv cs.RO38

    Real-Time Ground Normal Vector Estimation for Spherical Mobile 3D Mapping Using LiDAR-Inertial Odometry

    The study proposes two RANSAC-based ground normal vector estimation methods: single-scan estimation and estimation based on a LiDAR-inertial odometry (LIO) global 3D map, for odometry in a spherical mobile mapping system (SMMS). Evaluated on diverse real-world datasets against terrestrial laser scanner ground truth, the LIO method significantly outperforms the single-scan method in accuracy and robustness. Integrating ground normal vector estimation into the motion model improves pose estimation and supports autonomous navigation in hazardous environments.

Oct 21Wed
  1. arXiv cs.RO55

    CondenseVLA: Improving Multi-Frame VLA Policy Efficiency with Learnable History Compression

    CondenseVLA proposes adding a learnable history compression module to the decoding side of VLA policies. It uses learnable queries and multi-head cross-attention to distill the per-frame features cached by the VLM backbone into a fixed number of slot tokens, and applies auxiliary regularization that penalizes overlap among slot attention maps and decorrelates slot embeddings to reduce redundancy.

  2. arXiv cs.RO51

    InteractAgent: A Memory-Augmented Reflection Agent for Long-Horizon Human-Scene Interaction Animation

    The paper proposes InteractAgent, a multimodal large language model agent system for long-horizon human-scene interaction that completes planning, execution, observation, and reflection in a closed loop, with a single MLLM serving as both planner and evaluator and a frozen MotionLLM as the executor.

  3. arXiv cs.RO60

    FIBER: An Action-Aligned Latent Planning Framework for Humanoid Loco-Manipulation

    The paper proposes the FIBER framework, which uses the executable latent space of a frozen behavioral foundation model (BFM) as a shared planning representation for heterogeneous interaction skills. Its latent policy projection (LPP) maps independently trained task policies into this representation, enabling low-frequency planning while retaining the BFM's high-frequency state feedback; a single perceptive flow planner is then trained entirely offline. The paper also proposes an adaptive-horizon BFM (AH-BFM) trained with multi-gamma forward-backward learning.

  4. arXiv cs.RO61

    ForeTac: A Predictive Contact Guidance Framework for Generative Robot Policies

    ForeTac is a predictive contact guidance framework for contact-rich manipulation that uses a represent-predict-evaluate-guide loop: it encodes the current tactile state, predicts future tactile latent trajectories conditioned on candidate action sequences, and evaluates each trajectory with a contact-quality objective learned from successful and failed physical interactions. At inference, gradients of this objective are backpropagated through the tactile predictor to guide action generation before execution, while all model parameters remain frozen.

  5. arXiv cs.RO67

    Learning Bimanual Laparoscopic Appendectomy Without Robot-Collected Demonstrations, Validated on Live Animals

    The paper proposes an end-to-end pipeline that uses an instrument-state logger mounted on the shaft of a standard laparoscopic instrument (combining inertial, time-of-flight, and Hall sensors, with no external camera or tracker) to capture the instrument pose and jaw state during a surgeon's operation, which is then used to train a surgical robot policy and validated on live animals.

  6. arXiv cs.RO55

    Joints, Camera, Action! A Co-Generation Model for 3D Motion and Video for Arbitrary Skeletons

    The paper proposes a model that can simultaneously co-generate video and 3D motion for any given skeleton, along with a camera that registers that motion to the scene. The model keeps 3D motion in a separate module to support arbitrary skeletons, connects it to a pretrained video model through a small number of cross-attention layers, and uses a generative video editor to curate nearly 200K training pairs. Evaluations show that its text-driven animation of diverse skeletons is more faithful than video-first pipelines, that the motion responds to the surrounding scene, and that it also supports video-to-skeleton motion, skeleton motion-to-video, and keyframe-based 3D motion control.

  7. arXiv cs.RO46

    Planning Under Noise (PUN): A Neural Operator Planning Method Under Noise

    PUN (Planning Under Noise) is a neural operator that learns noise-aware value fields to enable motion planning with control execution noise in unseen geometric environments. It changes obstacle boundary conditions to reflecting Neumann conditions and sets a Dirichlet condition at the goal, and extends the Monte Carlo solver Walk on Stars (WoSt) to higher dimensions, learning the mapping from geometry to value field from noisy, partially converged labels.

  8. arXiv cs.RO55

    SynCalib: Breaking Dataset Shortcuts in LiDAR-Camera Calibration via Extrinsic-Controllable Synthesis

    The paper proposes SynCalib, a data generation framework that addresses overfitting and poor generalization caused by insufficient extrinsic diversity in training data for deep learning-based online LiDAR-camera calibration. Using omnidirectional image datasets annotated with depth ground truth, it synthesizes multimodal calibration data under strict extrinsic constraints. Experiments show that this pipeline significantly improves the generalization and robustness of learning-based calibration networks, and real-world evaluations across various camera-LiDAR configurations validate the zero-shot transfer capability of models trained solely on synthetic data; the data generation code, pretrained models, and online benchmark dataset will be made public.

  9. arXiv cs.RO57

    AdaDex: Learning Generalizable Dexterous Skills from a Single Trajectory via Hybrid Dexterous Mimicking

    AdaDex is a goal-conditioned reinforcement learning framework that turns a few seconds of human hand-object trajectory (from motion capture data or HOI reconstruction from in-the-wild RGB(D) video) into generalizable dexterous skills. Its core, Hybrid Dexterous Mimicking, trains a shared policy across two sets of massively parallel environments: environments with dense motion tracking objectives inject the human prior, while environments with noised initial states and goals and a sparse object-success reward force the skill to work even when it deviates from the reference trajectory.

  10. arXiv cs.RO62

    REACT: VLM-Guided Contact Retargeting and Generative Partner Modeling for Humanoid-Human Interaction

    REACT is a framework for learning deployable humanoid-human interaction policies from human-human demonstrations, using semantic contact structure as the supervisory signal that links demonstration processing, interaction learning, and onboard control. It uses a VLM-guided contact modeling and retargeting pipeline to identify semantic contacts and transfer them onto humanoid-human geometry, then distills a privileged interaction policy into an egocentric depth policy that relies entirely on onboard sensing, and introduces a generative partner state modeling objective to predict partner motion from occluded viewpoints.

  11. arXiv cs.RO55

    From Predictive Geometry to Action: Learning Complementary Predictive Representations for Embodied Manipulation

    The paper proposes a two-stage framework that learns complementary predictive representations from multi-view video clips to enhance embodied manipulation policies. In the pretraining stage, a frozen 3D foundation model provides dense geometric features, which are compressed into predictive geometric representations and optimized to preserve scene structure and its temporal evolution; action supervision is then applied to geometric transitions to extract a motor representation that emphasizes action-relevant transitions. In the downstream post-training stage, predictive geometry is transferred through geometry queries, and the motor representation guides intermediate features along the action-generation pathway. Future observations serve only as privileged supervision during training and are not needed at inference time.

  12. arXiv cs.RO47

    Probabilistic Reach-Avoid Value Function (PVF): A Temporal-Difference Learning Method for Computing Probabilistic Reach-Avoid Sets

    Proposes a self-supervised method, the Probabilistic Reach-Avoid Value Function (PVF), for computing reach-avoid sets for robot tasks under stochastic, potentially unbounded disturbances, applicable to black-box systems. Compared with Hamilton-Jacobi reachability (HJR)-based baselines on systems of increasing complexity, up to the Hopper locomotion task, results show that when disturbances are non-adversarial, PVF's probabilistic reach-avoid sets are less conservative and more accurate than adversarial HJR sets. The method has been submitted to ICRA 2027.

  13. arXiv cs.RO47

    Hierarchical QP control and authority-guided recovery planning achieve high-precision RCM motion for ophthalmic robots

    A study proposes a high-precision remote center of motion (RCM) servo architecture for ophthalmic robots, using a hierarchical QP controller and authority-guided recovery planning to address servo oscillation caused by conflicts between RCM and tip-tracking objectives. In a 200-scenario kinematic benchmark, the approach achieved a 100% reach rate for 128 near-singular targets and a 99% reach rate for 72 near-joint-limit targets, with software RCM residual below 0.142 mm.

  14. arXiv cs.RO67

    Multi-View Latent Action Pretraining for Cross-Embodiment Robot Video Learning

    The paper proposes a latent action model (LAM) that can ingest synchronized multi-camera views, using cross-attention to resolve depth and occlusion issues, then compresses them into latent actions that are fed into a policy in which a latent expert and an action expert are coupled by sequential flow matching around a frozen VLM backbone.

  15. arXiv cs.RO47

    Orthogonal Residual Learning for Adaptive Sideslip Angle and Cornering Stiffness Estimation

    An orthogonal residual learning method constrains a model corrector via null-space parameterization to be orthogonal to cornering stiffness sensitivity, preventing the corrector from absorbing stiffness-change information and suppressing online adaptation. In full-vehicle simulation, the method reduces sideslip angle error by 12.7% to 22.0% and maintains the same adaptation speed as an uncorrected filter under step changes in stiffness. On public real-vehicle data, a 430-parameter orthogonal corrector retained more response to nominal stiffness offsets than an unconstrained corrector of the same size.

  16. arXiv cs.RO55

    Failure Attribution for VLA Models: Estimating the Benefit of Removing Visual Corruptions

    The paper defines the problem of failure attribution for vision-language-action (VLA) models: when multiple visual corruptions coexist, determining which corruptions contribute to failure risk and how much benefit their removal would bring. The authors propose a factorized risk model that learns separate representations of the scene and of corruptions, and estimates removal benefits through latent intervention using only the current image and task instruction, without paired clean images or additional counterfactual rollouts.

  17. arXiv cs.RO45

    Theoretical Analysis of the Relationship Between Maximum Clique and Maximum Consensus in Point Cloud Registration

    arXiv:2610.27275 studies the relationship between maximum clique and maximum consensus, two robust registration formulations for point cloud registration. It proves that the alignment error of maximum clique solutions can be arbitrarily large and that the set size can far exceed that of the maximum consensus set, and it derives geometric conditions that bound this error. When rotation is fixed, it gives exact error bounds and a discriminating test for the translation subproblem. The study also determines the minimum group size in group-k consistency that guarantees an error bound independent of point cloud scale: d+1 for rotation and translation in d≥2 dimensions, and d+2 when reflections are allowed. An interactive example and Lean theorem prover verification have been made public.

  18. arXiv cs.RO41

    Visual Task Modeling and Automated Planning for Nao Robots in Autism Spectrum Disorder Education

    A method for autism spectrum disorder (ASD) education enables a camera-equipped Nao robot, using a vision-based large language model, to convert photos of a Shoebox Task into a Planning Domain Definition Language (PDDL) representation and generate action plans, autonomously executing the task, prompting the next step, or reporting failures through action demonstrations, voice, and gestures.

  19. HuggingFace Daily Papers63

    LaLa-World: Scaling latent world models with natural language actions

    The paper proposes LaLa-World, a language-conditioned latent world model (LWM) that learns jointly from simulation and robot trajectories as well as broader image and video data. Its key design is to describe both numerical actions and visual changes in language, enabling training of a single future predictor across heterogeneous datasets, and to build the predictor on a language model so it can interpret language conditions.

  20. NASA44

    NASA's new Mars helicopter rotor blade roamx-0201 could extend single-flight distance to 18.7 km

    NASA researchers, working with Imperial College London and Nagoya University, have designed a new Mars helicopter rotor blade airfoil called roamx-0201. Through high-fidelity simulations and wind tunnel tests, it could increase the maximum single uninterrupted flight distance from Ingenuity's 0.7 km to up to 18.7 km while carrying scientific instruments.

Oct 20Tue
  1. The Humanoid Hub76

    Ropedia releases open-world model W0, trained on about 10,000 hours of first-person human video

    Ropedia released the open-world model W0, trained on about 10,000 hours of first-person human video. A single set of weights can predict the first-person view of humans, robotic arms, and humanoid robots (Unitree G1, Fourier GR-1), using a shared camera-plus-skeleton representation; adding a new robot requires only its URDF.

    Why it matters: The original article provides the training data scale, the cross-embodiment transfer method, and measured comparisons, so readers can judge the world model's actual impact on robot policy training workflows.

  2. HuggingFace Daily Papers62

    AnyGoal: Evaluating World Models' Compositional Generalization Beyond Expert Trajectories

    The study introduces the AnyGoal benchmark and open-source library to evaluate world models' compositional generalization on goal-shifted task variants. The task design ensures that individual state factors and actions remain within the training support, but their combinations are underrepresented in expert trajectories. Experiments across multiple environments and world model families show that current models consistently fail under these recombination scenarios, and the authors further analyze where failures occur at the dynamics and representation levels.

  3. HuggingFace Daily Papers55

    EgoXperience: Learning World-Aligned Egocentric Representations from Human Experience

    EgoXperience proposes a complete pipeline covering data collection, automatic annotation, unified modeling, and benchmark evaluation, aimed at jointly reconstructing observer motion, scene geometry, and hand-object interactions from egocentric video. At its core is the automatic annotation engine EgoXX-Engine, which combines geometrically verified object tracking with SLAM-based world alignment to produce the 50-hour dataset EgoX-Data-6M (with second-level task descriptions) and the 1-hour evaluation set EgoX-Bench.

  4. HuggingFace Daily Papers57

    ScaleNav: Internet Video Pretraining for Language-Conditioned Local Navigation

    ScaleNav proposes a unified world-action framework that achieves language-conditioned local navigation through three-stage training: first, instruction-conditioned video pretraining on internet first-person videos to learn how observations evolve as the camera approaches a target; then, aligning predicted executable action chunks using action-labeled simulation data; and finally, jointly fine-tuning all trainable components.

Oct 19Mon
  1. 雷科技78

    WorldOracle world-model evaluation platform launched, using real-robot testing to fact-check the industry

    On October 16, WorldOracle, an action-driven world-model evaluation platform jointly completed by researchers from AgiBot, NVIDIA, Princeton University, the University of Texas at Austin, and the University of Toronto, was officially released, opening evaluation submissions to developers.

    Why it matters: The evaluation compares world-model predictions frame by frame against real execution records, revealing a common problem in which robotic arm motion is replicated but object states are systematically hallucinated, providing concrete reference points for judging model usability.

  2. arXiv cs.RO64

    GroundingPI releases 4B grounding foundation model, averaging 73.68% across 34 benchmarks

    GroundingPI is a 4B-parameter grounding foundation model that outputs points and boxes as quantized coordinates in a shared vocabulary; its training combines multimodal and spatial pretraining, supervised fine-tuning, and GRPO reinforcement learning. It averages 73.68% across 34 grounding benchmarks and 44 baselines, above GPT-6 Astra's 71.54%.

  3. arXiv cs.RO51

    NEXUS: An Embodied Planning Framework Jointly Learning Safety Constraints and Action Models

    NEXUS is a modular neuro-symbolic framework that jointly maintains a PDDL action domain model and an LTL safety specification: execution failures are used to repair action schemas, while detected hazards are converted into reusable LTL constraints through hierarchical semantic and translation sampling with equivalence consensus.

  4. arXiv cs.RO67

    RoboHarness: Simple Robot Harness Lets LLM Agents Outperform VLA and World Action Models on BEHAVIOR Challenge 2025

    An arXiv paper presents RoboHarness, a robot harness that gives LLM agents a visual-geometric control panel so they can directly understand and invoke embodied tasks. The authors argue that coding agents have the potential to achieve generalist embodied manipulation without the route of large-scale VLA training. Experiments show that, with RoboHarness, Qwen3.8-Flash-Next outperforms state-of-the-art VLA models on BEHAVIOR Challenge 2025 tasks, and the implementation is open source.