Skip to content
#Research
Oct 28Wed
  1. 爱范儿58

    Vine-inspired soft robotic intubation system SRIS achieves 87% first-attempt success rate in cadaver tests

    A team led by Elliot Hawkes at Stanford University designed the soft robotic intubation system SRIS based on the vine robot principle. In cadaver tests, 12 participants, including 8 emergency responders, received 5 minutes of training; 87% achieved successful intubation on the first attempt, with an average time of 21 seconds. Under the same conditions, video laryngoscopy had a 63% success rate and an average time of 44 seconds.

  3. 量子位55

    Wika releases high-quality dataset for embodied intelligence-enabled construction machinery

    Wika Mobile Control released the "High-Quality Dataset for Embodied Intelligence-Enabled Construction Machinery" at the 10th Xuzhou Artificial Intelligence Conference 2026, and it is now available on data repositories including Hugging Face. The first phase of the dataset has 36 million frames, covers 12 typical operation scenarios, and synchronizes five dimensions of data—vision, LiDAR, pose, force feedback, and joystick input—using a unified timestamp. Wika says real-machine data collection for excavators costs about 5,000 yuan per hour, and training a usable model roughly requires data on the order of 100,000 hours.

  4. HuggingFace Daily Papers78

    RynnWorld-Latent: A Cross-Embodiment World Model Conditioned on Universal Latent Actions

    The research team proposes RynnWorld-Latent, a cross-embodiment video world model that uses the 3D-grounded latent actions of RynnLAM as a shared conditioning interface, enabling joint pretraining on human interaction videos, robot demonstrations, and simulation data.

    Why it matters: This work proposes using universal latent actions as a shared cross-embodiment conditioning interface, allowing human videos, robot demonstrations, and simulation data to jointly pretrain a world model.

  5. HuggingFace Daily Papers66

    PDRVLA: A Vision-Language-Action Model with Physical Dynamics Representations

    PDRVLA introduces a lightweight Physical Dynamics Module that extracts physical tokens from vision-language features to condition action generation, without requiring online future-video generation. The module learns by directly predicting future RGB, depth, and optical-flow features, with auxiliary supervision from a frozen pretrained video world model. Training uses only public data, expanded through human-to-robot synthesis, subtask annotation, and embodied chain-of-thought (ECoT) annotation.

  6. arXiv cs.RO62

    SCRIM: Quantifying State Criticality in Imitation Learning

    The authors propose SCRIM, a state criticality measure that uses an adversarial perturbation policy and a value critic to estimate the worst-case degradation in downstream value caused by small perturbations to expert actions, scoring each demonstration state. These scores can be used to reweight behavior-cloning losses or to select compact, high-value subsets of demonstrations, reducing training data while maintaining performance. The method is evaluated on a variety of simulated and real robot manipulation tasks, and the paper was accepted to CoRL 2026.

  8. arXiv cs.RO62

    Goal2Pixel: A Vision-Language Navigation Method That Grounds Goals to Pixels

    Goal2Pixel proposes a pure pixel paradigm that reformulates vision-and-language navigation in continuous environments (VLN-CE) as navigable pixel grounding: the model predicts navigable pixels on the image plane, which are then back-projected into 3D waypoints for forward movement, while turning and stopping are encoded by auxiliary left, right, and bottom regions.

  9. arXiv cs.RO62

    AWARE: Action-Entropy-Weighted and Attention-Guided Retrieval of Observation Evidence for Vision-Language-Action Models

    The authors propose AWARE, a training-free, plug-and-play module for Vision-Language-Action (VLA) models that tracks layer-wise uncertainty via element-wise action entropy and retrieves observation evidence into the feed-forward networks' key-value memory through associative memory lookup.

  10. arXiv cs.RO60

    Semantic World Models: Using Vision-Language Models to Predict Semantic Information for Robot Planning

    The paper proposes Semantic World Models, which model the world model as visual question answering about the semantic information of future frames rather than reconstructing future pixels, so that vision-language models can be obtained through supervised fine-tuning on image-action-text data. The authors validated it on simulated robot tasks, where it outperformed typical reconstruction-based action-conditioned world models.

  11. arXiv cs.RO60

    QUAN: Quaternion Approximate Networks Improve Image Classification and Oriented Object Detection

    The paper proposes Quaternion Approximate Networks (QUAN), which use Hamilton product decomposition to approximate quaternion convolution with real-valued operations, paired with custom CUDA kernels to achieve rotation-equivariant image classification and object detection. The authors also propose Independent Quaternion Batch Normalization (IQBN) to stabilize training and extend quaternion operations to spatial attention mechanisms.

  12. arXiv cs.RO72

    BiDex-100: A Bimanual Dexterous Manipulation Benchmark Covering 100+ Simulation Tasks

    The authors propose BiDex-100, a simulation benchmark for bimanual dexterous manipulation comprising 106 tasks organized along five capability dimensions: generalization, instruction following, limited demonstrations, long horizon, and memory. Each task is paired with an out-of-domain variant featuring controlled visual and spatial changes for evaluating robustness. The benchmark supports two embodiments and provides 8,080 success-validated teleoperated demonstrations totaling 6.25 million frames. The authors evaluate seven recent vision-language-action models under a unified protocol, establishing baselines for capability-specific performance, robustness, and data efficiency.

  14. arXiv cs.RO69

    IDTD: Information-Decoupled Trajectory Design for Sim-to-Real System Identification

    The authors propose an information-decoupled trajectory design framework, IDTD, which constructs an exploration objective from a Schur complement score derived from the Fisher information matrix, then normalizes by parameter, selects the optimal trajectory segment for each parameter, and aggregates the scores logarithmically, to mitigate unreliable identification caused by indistinguishable parameters.

  16. arXiv cs.RO58

    Compact Force Sensor and Tension-Aware Outer-Loop Control for Dual-UAV Cable-Suspended Payload Transport

    This study proposes a dual-UAV payload transport framework that uses a custom compact force sensor at the cable anchor point to measure interaction forces, with static and dynamic tests evaluating its linearity, hysteresis, repeatability, and crossload. Control uses a cascade structure: inner loops handle vehicle stabilization, while outer loops compensate for the measured forces, validated in simulations and indoor experiments under position uncertainty. Payload-drop and constrained-space tests compared with literature-based distributed methods show improved stability, coordination, and disturbance rejection.

  17. arXiv cs.RO52

    When Is Test-Time Physical Diagnosis Effective? Six Ordered Empirical Conditions and a Failure Analysis of Frozen Policies

    Zhengshu Zhang proposes in an arXiv paper that for diagnosis to improve behavior when a robot faces unfamiliar physical conditions, six ordered empirical conditions must hold: a meaningful reference, identifiability of the physical condition, use of the acquired evidence, decision value, selection value relative to a fixed alternative, and safe realization.

  18. arXiv cs.RO50

    Constraining World-Model Planning with Legal Reasoning: Validation of a Defeasible Deontic Logic Planning Stack on a Simulated Robotic Arm

    The paper proposes a legal planning stack that uses Defeasible Deontic Logic (DDL) to constrain a motion planner, leveraging a learned world model for planning and to supply legal context, thereby enabling ex ante intervention before an illegal action is executed. The stack was deployed in a scenario where a simulated robotic arm pushes blocks on a 3x3 grid. Results show that the legally constrained agent complied with norms at a markedly higher rate than the unconstrained one, and that modeling perceptual uncertainty further raised the compliance rate; legal reasoning ran efficiently at runtime, its rulings were auditable, and the stack adapted to exogenous signals and endogenous rule changes.

  19. arXiv cs.RO65

    Gradient-Free Neural Hamilton-Jacobi Reachability for Scalable Safety-Critical Control

    The authors propose a discrete-time neural reachability framework that learns backward reachable tubes (BRTs) and backward reach-avoid tubes (BRATs) through Bellman-Isaacs value propagation, and uses gradient-free value probes to construct approximate teacher actions, turning adversarial actor learning into supervised policy learning.

  20. arXiv cs.RO66

    Learning-Based Informative Path Planning for Multi-Robot Systems: A Spatio-Temporal Gaussian Process Kalman Filter Framework

    The authors propose a grid-based spatio-temporal Gaussian process-Kalman filter framework for learning-based multi-robot informative path planning, representing anonymous target presence as a single latent variable field over a discrete workspace grid rather than maintaining one Gaussian process per target.

  21. arXiv cs.RO60

    Temporal Tactile Encoding and Compliant Control for Intent-Aware Robot-to-Human Bimanual Handover

    This study combines a VLA model with a compliant controller, fine-tuning the model using RGB observations, temporally encoded tactile feedback, and proprioception from human demonstrations to achieve robot-to-human bimanual handover. In a human-subject study, the system was compared against two baselines: one without tactile feedback and one with tactile feedback but no compliant control. Results show that compliant control and tactile history are complementary, with performance clearly outperforming the baselines. The project page is publicly available.

  22. arXiv cs.RO60

    From Language to Navigation Goals: A Vision-Language Approach for Semantic Navigation of Mobile Robots Using RGB-D Perception

    The study proposes a language-driven navigation framework that enables mobile robots to understand natural-language requests such as "go to the mailbox," identify the referenced object, estimate its position using RGB-D data, and generate a navigation goal that is then executed by the ROS 2 Nav2 navigation stack.

  23. arXiv cs.RO70

    From Grasping to Dexterous Manipulation: Large-Scale Grasp Pretraining for Dexterous Manipulation

    The research team proposes pretraining the low-level controller of a hierarchical imitation learning framework with large-scale dexterous grasp data, then fine-tuning it on downstream task demonstrations to support functional dexterity in articulated tool use. They built a 355k-trajectory grasp-pretraining dataset from large-scale dexterous grasp annotations and introduced DexCraft, a simulation benchmark with six articulated tool-use tasks. In simulation and real-world experiments, the method outperforms end-to-end diffusion policy baselines and hierarchical policies trained from scratch, improving real-world full-task success by 33.3 percentage points over DP3.

  24. arXiv cs.RO61

    LOPAL: Local Performance-Aware Active Learning from Imperfect Demonstrations

    LOPAL is a local performance-aware active learning method that uses a Gaussian Mixture Model (GMM) to jointly encode demonstration trajectories and their local quality assessments, thereby generating trajectories that outperform the imperfect demonstrations. The method also uses a shared autonomy (SA) mechanism to actively request user corrections in areas with insufficient data, while the robot autonomously executes its learned behavior during this process.

  25. arXiv cs.RO78

    FTP-1: A Generalist Foundation Tactile Policy Across Tactile Sensors

    The research team proposes FTP-1, a generalist foundation tactile policy pretrained across multiple tactile sensors and embodiments. It uses heterogeneous encoders to map image-, array-, and state-based tactile signals into unified morphology-aware latent tokens, which are jointly modeled by a shared tactile Transformer expert.

    Why it matters: This work unifies multiple tactile signals into a shared policy and reports changes in success rates for cross-sensor transfer, offering a reference for tactile manipulation research.

  26. arXiv cs.RO70

    FAWAM: Force-Aware World Action Model for Closed-Loop Contact-Rich Manipulation

    The authors propose FAWAM, a force-aware world action model that incorporates force information at three levels: perception, prediction, and closed-loop execution. It first encodes historical 6-axis force/torque signals to modulate action generation, then jointly predicts future actions and end-effector wrenches to explicitly model contact evolution, and uses the predicted wrench trajectory as an execution-time reference while correcting actions online with real-time force feedback. In real-world experiments across multiple contact-rich tasks, FAWAM achieved an average success rate 36.25% higher than vision-only baselines and 21.25% higher than existing force-aware baselines.

  27. arXiv cs.RO64

    GTP-FA: A Two-Stage Grasp-Then-Plan Manipulation Framework with Failure Attribution

    The authors propose GTP-FA, a two-stage "grasp-then-plan" framework for robotic manipulation: it first generates grasp candidates, then performs downstream motion planning conditioned on the selected grasp. The framework learns a failure attribution model that outputs a distribution over failure modes for failed trajectories, and uses it to separately optimize the grasp scoring and planning modules. Simulation and real-robot experiments show that GTP-FA improves overall task success rates over baselines including RL, IL, diffusion policies, and VLA, and the paper has been accepted to NeurIPS 2026.

  28. arXiv cs.RO71

    RePO-VLA: Recovery-Driven Policy Optimization for Vision-Language-Action Models

    RePO-VLA proposes a recovery-driven policy optimization framework that assigns distinct roles to success, recovery, and failure trajectories for long-horizon, contact-rich manipulation tasks. The method first uses recovery-aware initialization to slice corrective segments into new episodes, then learns a progress-aware semantic value function, and uses value-conditioned refinement to make the policy prefer high-progress actions.

  30. arXiv cs.RO62

    RAPID: A Robotic Agent Platform for EV Battery Pack Disassembly

    The authors propose RAPID, a robotic agent disassembly platform that integrates a gantry-mounted industrial robotic arm, RGB-D perception, and an automated nut-running tool to remove fasteners on a full-scale EV battery pack. Open-vocabulary object detection achieves 0.9757 mAP50; among three one-shot fastener removal strategies, taught-in poses achieved a 97% success rate in 24 minutes, one-shot vision execution achieved 57% in 29 minutes, and visual servoing achieved 83% in 36 minutes (n=204).

  31. arXiv cs.RO65

    MO-Playground: Massively Parallel Multi-Objective Reinforcement Learning for Robotics

    The authors propose MORLAX, a GPU-native multi-objective reinforcement learning algorithm, and MO-Playground, a pip-installable GPU-accelerated multi-objective environment library. They can approximate Pareto sets within minutes, achieving 26-271x speedups over traditional CPU methods and up to 19x speedups over prior GPU methods, while learning Pareto front hypervolumes that are superior. The team also implemented a custom BRUCE humanoid robot environment, learning Pareto-optimal locomotion policies in simulation across 6 practical objectives such as smoothness, energy efficiency, and arm swinging.

  34. arXiv cs.RO60

    RPT*: Global Planning with Probabilistic Terminals for Target Search in Complex Environments

    The paper studies the Hamiltonian Path Problem with Probabilistic Terminals (HPP-PT), whose goal is for a mobile robot to visit all candidate locations to find a target while minimizing expected path cost. The authors propose RPT*, a search method with optimality guarantees that uses dynamic programming in a new state space to bypass history dependency, along with a heuristic to speed up computation. The RPT*-based HATS system, combined with Bayesian filtering or autonomous exploration, found targets faster than baseline methods on average in both simulation and real-robot experiments.

  35. arXiv cs.RO62

    Semantic-Geometric Task Representation for Bimanual Manipulation from Human Demonstrations to Robot Action Planning

    The authors propose a semantic-geometric graph task representation that jointly encodes object identities, inter-object semantic relations, and each object's motion history, consisting of an MPNN encoder and a Transformer decoder; the encoder processes only the temporal scene graph and produces structured representations decoupled from action labels.

  36. arXiv cs.RO67

    DreamTacVLA: A VLA framework that uses a tactile world model to predict future contact

    DreamTacVLA proposes a framework that grounds VLA models in contact physics, learning contact dynamics by predicting future tactile signals. The model uses hierarchical perception, taking high-resolution tactile images as micro-vision inputs combined with wrist-camera local vision and third-person macro vision, and uses a Hierarchical Spatial Alignment (HSA) loss to align tactile tokens with their spatial counterparts in the wrist and third-person views.

  37. arXiv cs.RO62

    CLEAR-IR: Reconstructing Infrared Images into RGB-Style Images to Support Robot Perception in Dark Environments

    CLEAR-IR proposes a dual-stream architecture that reconstructs clean, RGB-style images from infrared images containing structured-light emitter patterns, allowing vision pipelines originally trained on RGB to keep working when no visible light is available. Inspired by DeepMAO, the architecture was evaluated on object detection, ArUco marker detection, and visual SLAM, covering scenarios ranging from well-lit to completely dark; in complete darkness, passive RGB enhancement methods fail because the sensor receives no signal. The paper has been accepted to IEEE/RSJ IROS 2026.

  38. arXiv cs.RO59

    Study: Active sampling with vision-based tactile sensors for hardness classification

    The paper investigates active sampling strategies based on vision-based tactile sensors (VBTS) for sample-efficient hardness classification, using information-theoretic measures of model uncertainty. The authors evaluated three probabilistic classifiers, two active sampling strategies, and a random sampling baseline on a hardness classification task using their own VBTS dataset collected by a robot and a previously published dataset, and also conducted a human study on hardness classification with the same objects. Results show that the active sampling methods using variance and entropy as uncertainty measures performed best, reaching 90% accuracy, compared with human accuracy of 48%.

  39. arXiv cs.RO62

    Research team builds egocentric tennis dataset and evaluates vision models' spatiotemporal prediction capabilities

    The research team collected an annotated egocentric tennis dataset and trained and evaluated image encoders, video encoders, and vision-language models on seven spatiotemporal prediction tasks. The best models achieved current-frame localization errors of 0.14 m for the egocentric player and 0.54 m for the ball, with trajectory prediction errors of 0.34 m and 0.91 m respectively within 1.1 seconds, and a mean error of 0.14 seconds for contact-time prediction. Auxiliary depth information notably improved 3D ball localization, while longer image histories did not improve ball trajectory prediction; the team also proposed a conditional diffusion model that generates full-body tennis kinematics from egocentric video at real-time rates.

  40. arXiv cs.RO40

    Understanding Human-Robot Collaboration Through Joint Action Theory: A Systematic Review of 83 Empirical Studies

    A systematic review following PRISMA 2020 examined 83 empirical papers on human-robot collaboration published between 2021 and 2026, using Joint Action theory to classify them into nine constructs under three capacities: Representation, Prediction, and Integration. The analysis reveals how these constructs are distributed and co-occur across studies, identifies where empirical evidence is concentrated and where it is absent, and offers guidelines for future research.