Skip to content
TodayNov 11Wed1 updates
Nov 10Tue
  1. 新智元 · 微信公众号71

    Xi'an Jiaotong University's Lan Xuguang team proposes AffordSim: generating robot manipulation data via 3D affordance prediction

    Professor Lan Xuguang's team at Xi'an Jiaotong University has proposed AffordSim, which connects open-vocabulary 3D affordance prediction to simulation trajectory generation. Starting from a natural language task description, it locates an object's functional regions, then combines cuRobo motion planning to generate executable manipulation demonstrations.

  2. 机器人前瞻 · 微信公众号72

    Gamma Intelligence, TeleAI and Unitree launch LocoManiLab humanoid mobile manipulation evaluation framework

    Gamma Intelligence, TeleAI and Unitree have jointly launched LocoManiLab, a unified evaluation framework for humanoid robot mobile manipulation. It covers five types of home spaces, 13 scenario instances and 234 tasks, with the Unitree G1 and Dex3 dexterous hands as the unified test platform.

  3. Tech Xplore Robotics58

    UC San Diego proposes EgoThumb wearable robotic thumb for one-handed completion of two-handed tasks

    A team at the University of California San Diego proposed EgoThumb in an arXiv preprint, a wearable robotic thumb driven by a palm-side wide-angle camera and an imitation learning model that can autonomously grasp and stabilize objects, allowing users to complete tasks such as unscrewing bottle caps and stirring tea with one hand.

Nov 9Mon
  1. Tech Xplore Robotics78

    UC Berkeley and NVIDIA propose agentic robotics to generate and improve robot programs in simulation

    Ken Goldberg's team at UC Berkeley and Spencer Huang, NVIDIA's head of robotics engineering, proposed an "agentic robotics" method that lets AI agents generate, test, and correct robot control programs in simulation without additional data collection.

    Why it matters: The report describes a method for using multi-agent systems to generate, test, and correct robot programs in simulation, and presents real-world data from warehouse sorting.

  2. Tech Xplore Robotics38

    DTU joint project uses PVD coatings and metasurfaces to alter drone radar signatures

    DTU is collaborating with Aarhus University, the Danish Technological Institute, and companies including TICRA and Arctic Unmanned to use physical vapor deposition (PVD) to produce ultrathin coatings that enhance or reduce drone radar reflection signals. Initial tests on simple shapes such as rectangular plates and cylinders achieved significant attenuation of reflected signals. The next step will be to adapt the method to drones with more complex geometries and test its radar detection effects in real environments. Another route in the project is to develop tunable artificial metasurfaces, which are said to potentially cost less to manufacture than PVD processing.

  3. arXiv cs.RO62

    FHNW Muttenz dataset: assessing the accuracy potential of street-level visual localization

    The authors release the FHNW Muttenz dataset, covering a contiguous 10 km street network and two mobile mapping campaigns about 1.5 years apart, with ground-truth poses accurate to 6-9 mm in position and orientation error below 0.1°. Using this dataset, they systematically evaluate sparse-feature visual localization; with daytime imagery and pre-calibrated cameras, median translation error is 1-5 cm and rotation error is 0.03-0.1°. The authors note that, provided the scene representation is precisely georeferenced, visual localization can approach survey-grade GNSS positioning accuracy and additionally provides full orientation information.

  4. arXiv cs.RO57

    Spectral Alignment of Forward-Backward Representations: Mitigating Spectral Mismatch via Temporal Abstraction

    The paper analyzes the spectral mismatch between the high-rank transition dynamics of continuous environments and the low-rank bottleneck in forward-backward (FB) representations, and proposes temporal abstraction to mitigate this problem. Starting from the spectral properties of the transition operator, the authors show that temporal abstraction acts like a low-pass filter: it suppresses high-frequency components and reduces the effective rank of the successor representation, while preserving a formal bound on the value function error. Experiments show that this alignment is a key factor for stable FB learning at high discount factors. The work has been accepted to NeurIPS 2026.

  5. arXiv cs.RO60

    LeWAM: Robot planning method based on JEPA world action model and diffusion-guided MPC

    The authors propose LeWAM, a bidirectional Transformer trained end-to-end on a decoder-free JEPA latent space that supports four modes: forward, backward, inverse dynamics, and policy prediction. Linear probe experiments show that LeWAM's latent space reads robot and object state better than the forward-only Le World Model, and that its degree of ignoring visual distractors is comparable to LeWM and clearly better than reconstruction-based WAM.

  6. arXiv cs.RO62

    VOMMI: A Portable Demonstration Collection and Learning Framework for Mobile Manipulation

    VOMMI is a portable demonstration collection and learning framework that connects portable RGB demonstrations to VLA post-training through offline trajectory reconstruction and online visual-motion conditioning. R2-VO refines trajectories using sparse geometric anchors, reducing the average absolute trajectory error of body and hand streams by 24.6%; a policy post-trained only on portable demonstrations has an 18.2% lower base velocity error than a policy trained on robot-collected demonstrations, with comparable end-effector translation accuracy.

  7. arXiv cs.RO60

    Geometric Prior Pretraining Improves Manipulation Imitation Learning Efficiency

    The study constructs a geometric visual pretraining dataset containing only a plane, an object, and a cube hand, with trajectories generated automatically and scenes without textures or backgrounds, so that the policy is first exposed to the geometric relationship between the hand and the object. The authors evaluate ACT on three simulated robots with five manipulation tasks each and on three real-world robot tasks; in most combinations, fine-tuning from the geometric prior yields higher success rates in early training than training from scratch, and requires only a small number of task demonstrations. The results indicate that highly simplified geometric scenes can also provide an initialization that transfers across robots and to real-world tasks.

  8. arXiv cs.RO71

    Onboard Dynamic Obstacle Avoidance System for Small Quadrotor UAVs Based on mmWave Radar

    The authors propose the first mmWave radar-based onboard perception-and-control dynamic obstacle avoidance system for small quadrotor UAVs. The system combines a lightweight interacting multiple models (IMM) tracker with a control barrier function (CBF) controller that directly outputs evasive accelerations, and derives sufficient avoidance conditions relating sensing range, relative speed, and control delay.

  9. arXiv cs.RO58

    MATE: Asynchronous Multi-Rate Diffusion Policy Composition Framework

    The authors propose LAG-Fusion, a latency-aware guidance fusion framework for asynchronous multimodal diffusion policy composition that allows modality-specific policies to run at their own inference rates and provide denoising guidance whenever output is available. To keep asynchronous composition consistent, the authors derive a reference-frame rebasing rule for diffusion variables under relative action representations, so that delayed guidance is aligned before fusion. In contact-rich manipulation, the authors compose a low-frequency vision policy with a high-frequency force policy; experiments with heterogeneous modality latency show better responsiveness and task performance than synchronous fusion and a purpose-designed force-aware baseline.

  10. arXiv cs.RO62

    NoContactNoWorries: Estimating contact via vision and proprioception to support in-hand dexterous manipulation

    NoContactNoWorries proposes a Transformer-based multimodal framework that fuses RGB-D vision with robot proprioception to infer binary contact states for hand-object interaction as a pseudo-tactile signal. The authors train a single contact prediction model on multiple objects and verify that this inferred signal can support downstream reinforcement learning agents in completing in-hand object reorientation, and that it generalizes to new objects. Both simulation and real-robot experiments validate the feasibility of inferring contact from vision and proprioception. The paper has been accepted to IROS 2026.

  11. arXiv cs.RO67

    DexTeleop-0: A Force-Aware Bimanual Dexterous Teleoperation Framework for Shared Autonomy

    The authors propose DexTeleop-0, a bimanual dexterous teleoperation framework that uses fingertip tactile feedback to overlay robot-side contact corrections on human tracking commands, mitigating kinematic mapping errors and the inability of vision alone to regulate contact force. The method computes localized corrections in real time via contact-stiffness approximation and the kinematic Jacobian, and adds per-contact force tracking, soft regularization of predicted contact moments, and bounded hand-joint residuals.

  12. arXiv cs.RO58

    SGM-SLAM: Scene Graph Matching for Data-Efficient Distributed SLAM

    The authors propose SGM-SLAM, a distributed SLAM framework for multi-robot collaboration in GPS-denied, communication-constrained environments, where robots can each initialize their coordinate frames independently and share only limited spatial overlap. The method uses fused RGB-LiDAR point clouds to build a scene graph containing a semantically segmented point cloud layer and a discrete bounded object layer, and performs collaborative matching by exchanging and matching object data with neighboring robots, using multi-step data exchange and optimization to improve communication efficiency. The authors validated effectiveness and communication efficiency on real-world datasets containing limited trajectory overlap, viewpoint variation, repeated structures, and degraded visual conditions.

  13. arXiv cs.RO62

    Autoregressive policies achieve real-time execution via tokenization horizon adjustment and constrained decoding

    The paper proposes that autoregressive policies can achieve real-time execution by adjusting the tokenization horizon and applying constrained decoding, thereby guaranteeing strict latency bounds and enabling multi-trajectory decoding. In simulated and real-world environments, the autoregressive policy significantly improves task completion speed over synchronous inference and consistently outperforms equivalent-level flow-matching policies. The authors note that autoregressive policies also have inherent advantages of faster convergence and better generalization in instruction following. The work was published at CoRL 2026.

  14. arXiv cs.RO62

    MosaicIMU: A Generalizable Neural Inertial Odometry Framework for Multiple Carriers

    MosaicIMU is a carrier-conditioned Mixture-of-Experts (MoE) pretraining and adaptation framework for generalizable neural inertial odometry. It composes carrier-specific expert features through a prototype-based router, decodes local velocity and uncertainty constraints, and integrates them with a history-aware EKF. For unseen domains, it freezes the pretrained base model and learns a lightweight expert residual branch; for edge deployment, it reuses the router to select online samples for incremental updates.

  15. arXiv cs.RO67

    CLAW: Learning continuous latent action world models from action-free video via adversarial regularization

    CLAW is a fully end-to-end self-supervised framework that jointly learns a world model and continuous latent action representations directly from videos without action annotations. It uses adversarial latent regularization to prevent the latent variables from encoding future observations, so that they capture action structure, and a diffusion model models environment dynamics as a distribution over future observations rather than a single deterministic rollout. The authors say this latent action world model supports imitation learning from observation and goal-directed planning, and outperforms existing methods in multi-task, multi-embodiment experiments.

  16. arXiv cs.RO58

    GELS: Gradiometer-Based Electromagnetic Localization System Achieves Closed-Form 6-DoF Pose Estimation for Medical Tools

    The authors propose GELS, a gradiometer-based electromagnetic localization system that uses a compact magnetometer array as an embedded quasi-gradiometer to estimate the local magnetic field and gradient tensor, then maps displacements via the Euler homogeneous relation and uses Procrustes registration with at least three noncollinear sources to recover the array's orientation and position. The closed-form algorithm requires only known source positions and array geometry, with no pre-calibrated workspace field maps, initial pose guesses, or calibrated source magnetic moments; in benchtop experiments, the solver's median runtime was 172.00 microseconds. Perturbation analysis identifies inter-sensor inconsistency and dipole model mismatch as the main accuracy limits.

  17. arXiv cs.RO80

    Learning-augmented robotic automation achieves cable insertion and soldering on motor production line

    The study proposes Learning-Augmented Robotic Automation, a hybrid system that integrates learned task controllers and a neural 3D safety monitor into conventional industrial workflows to automatically perform flexible cable insertion and soldering on a motor production line. Using less than 20 minutes of real-world data per task, the system ran continuously for 5 hours 10 minutes without physical fencing, producing 108 motors with a 99.4% pass rate on product-level quality inspection, a takt time close to that of human workers with smaller cycle-time variation, and solder-joint quality comparable to that of skilled operators.

    Why it matters: The paper reports data from continuous operation of learning-augmented industrial automation on a real production line for 5 hours 10 minutes, with 108 motors and a 99.4% pass rate, serving as a practical reference for learned control entering manufacturing.

  18. arXiv cs.RO62

    VLD: Visual Learned Distance as an Interface for Reinforcement Learning Navigation

    The authors propose the Visual Learned Distance (VLD) framework, which decouples perception learning from policy learning for image-goal navigation: first, a distance-to-goal predictor is trained self-supervised on about 3,000 hours of internet and simulated video; then, in simulation, a reinforcement learning policy is trained using privileged geometric distances perturbed by GeoNoise; at deployment, VLD predictions are used zero-shot.

  19. arXiv cs.RO60

    Evolutionary algorithm generates multicopter body morphologies with agile flight performance superior to standard quadcopters

    The paper uses an evolutionary algorithm to search for multicopter body morphologies suited to different objectives and constraints, and uses the non-dominated sorting genetic algorithm II (NSGA-II) to generate a set of bodies with performance trade-offs. Compared with a standard quadcopter, the Pareto front extrema improve maneuverability, thrust-to-weight ratio, and size by 489.2%, 23%, and 4.8%, respectively; the maneuverability improvement comes from motor tilt angles, and the thrust-to-weight ratio improvement comes from more propellers. Real drone racing experiments show that the evolved bodies outperform the standard body in number of gates passed, flight speed, and lap time.

  20. arXiv cs.RO58

    Adaptive collision sensitivity framework for efficient and safe human-robot collaboration

    The authors propose an adaptive collision sensitivity framework that dynamically estimates collision force based on the effective mass (EM) of each robot link and uses it to decide whether to interrupt motion, instead of applying a fixed contact threshold to the whole robot. Experiments were conducted on a real UR10e robot with AIRSKIN sensitive skin and in simulation, supplemented by simulated experiments on a KUKA LBR iiwa using joint torque sensing. In a mock pick-and-place scenario including both transient and quasi-static collisions, production efficiency improved by more than 45% compared with the standard method.

  21. arXiv cs.RO60

    Flex-RSI: Benchmarking recursive self-improvement of frontier agents on vision and robotics tasks

    Flex-RSI is a benchmark for evaluating agents' recursive self-improvement capability under a fixed budget, covering perception, reasoning, robot action, 3D reconstruction, visual creation, and infrastructure tasks. In each round, an executor improves the task solution, which is kept only if it scores higher on held-out validation data; an improver then revises the harness, including the executor and itself. Final solutions are scored on hidden test data.

  22. arXiv cs.RO50

    Ordered Policy Optimization (OPO): A reinforcement learning policy optimization method with adaptive clipping ordered by importance ratios

    Addressing the problem that PPO uses a fixed clipping interval for all samples and cannot distinguish extreme importance ratios from tolerable large changes, the authors propose Ordered Policy Optimization (OPO): within each minibatch, it sorts the importance ratios, selects the extreme ratios that have the greatest effect on the update, and assigns them adaptive per-sample clipping radii according to a preset tail profile. The objective remains first-order and requires only minibatch sorting and a modified policy loss.

  23. arXiv cs.RO80

    Paper analyzes agentic manipulation policies: AMP1 achieves 85.6% zero-shot success rate

    The paper proposes agentic manipulation policies (AMP), in which a generalist AI model directly controls a robotic arm and adjusts its actions as the task progresses. The authors' reference implementation, AMP1, runs unchanged across single-arm, bimanual, and mobile manipulation.

    Why it matters: The paper reports zero-shot success rates and real-world trial data for a generalist AI model directly controlling a robotic arm, which can be compared with specialist policies such as VLA and WAM.

  24. arXiv cs.RO65

    Seeing What Matters: A Benchmark for Task-Conditioned Actionable Spatial Belief for Manipulation

    The authors propose the Seeing What Matters benchmark to evaluate task-conditioned actionable spatial belief in simulated tabletop manipulation, covering 860 frozen evaluation cases across three scenarios—coffee workstation, drawer/cabinet, and microwave—which expand to more than 115,000 evaluation episodes.

  25. arXiv cs.RO58

    Wearable haptic interface learns personalized touch perception models

    The research team developed a wearable haptic input/output device that integrates a 36-channel electrotactile array with capacitive touch sensing, enabling stimulation locations and user-reported perceived locations to be aligned within the same body-referenced coordinate frame. Experiments with 24 participants showed notable individual differences in electrotactile and thermal percept maps, but both modalities retained electrode-pair-specific spatial structure across participants.

  26. arXiv cs.RO60

    SURE: Spatiotemporal Uncertainty Representation for Efficient Vision-Language-Action Learning

    SURE is a data-efficient vision-language-action (VLA) training framework that models spatial uncertainty with a lightweight transposed-convolutional probabilistic action decoder and uses Soft-DTW alignment supervision to accommodate temporal variation across demonstrations. On LIBERO, RoboTwin 2.0, and real manipulation tasks, SURE matches or exceeds baseline VLA manipulation success rates using only 10% of demonstration data or 20% of training steps.

  27. arXiv cs.RO60

    ODEAction proposes chunk-free action generation paradigm using ODE evolution instead of action-chunk prediction

    ODEAction proposes a chunk-free action generation paradigm that replaces the action-chunk prediction common in VLA models with continuous action evolution. It characterizes the rate of change of the current action over evolution time using a transition field over action space; during execution, it takes the current action as the initial condition and recursively generates subsequent actions via ODE integration. The method is implemented as an action head and does not depend on a specific vision-language backbone architecture. Experiments on LIBERO, EBench, RoboTwin, and real robots show better task performance and trajectory quality than matched action-chunking baselines, with particularly notable gains on fine manipulation tasks.