Skip to content
Oct 19Mon
  1. arXiv cs.RO71

    Self-Building Labs: An automated system that builds and runs laboratories according to scientific goals

    The authors propose the self-building laboratory (SBL) system, which can design, configure, and operate laboratory setups based on high-level scientific goals. Starting from an empty room or an existing self-driving laboratory, it fills in the laboratory layout, digital twin, robot skills, and experimental workflows. The system was demonstrated on a variety of robots and setups, and can scale from a single workstation to a laboratory with multiple robots working together. Its end-to-end capabilities were validated through a real-world quantum-dot synthesis experiment. The authors say this shifts the role of human researchers from manually configuring and programming device automation to specifying scientific goals.

  2. arXiv cs.RO44

    Structural Affinity: A Regularization Algorithm for Cage-Based Shape Design

    Structural Affinity is an explicit regularization method for cage-based deformation (CBD). It uses a two-cage structure and an affinity matrix precomputed with mean-value coordinates to couple the motion of inner and outer control cages, so that control handle displacements propagate smoothly to neighboring handles, greatly reducing and often eliminating cage self-intersection and mesh distortion, while adding only linear overhead during deformation.

  3. arXiv cs.RO59

    EmbodiedMidtrain: Bridging the gap between vision-language models and VLAs via mid-training

    The paper proposes EmbodiedMidtrain, which bridges the gap between vision-language models (VLMs) and vision-language-action models (VLAs) through mid-training. The authors first characterize the data distribution gap between the two, finding that VLA data occupy compact regions largely separated from the VLM distribution. They then build a mid-training data engine that uses a lightweight learnable proximity estimator to select the candidates most aligned with VLA from a large VLM pool, producing the EmbodiedMidtrain-1M dataset for mid-training VLMs.

  4. arXiv cs.RO70

    Blind assembly strategy: peg-in-hole assembly of diverse parts using proprioception alone

    This study trains blind assembly policies that observe only joint positions, velocities, and a short history of their own actions, without using visual, force, torque, or tactile sensing, and uses reinforcement learning in simulation to complete peg insertion, gear meshing, and nut tightening. The peg insertion policy transfers zero-shot to the real world and successfully inserts pegs of different shapes and sizes in 73% of trials; controlled experiments show that the blind policy generalizes better to unseen part shapes and sizes but may be slower.

  5. arXiv cs.RO58

    PRIME: Learning Precise Progress Estimation from Imprecise Demonstrations

    The paper proposes PRIME, a progress estimator for generating dense reward signals in reinforcement learning for robotic manipulation, learning precise task progress estimation from imprecise demonstration data. PRIME builds a weighted graph over observed states, connecting states across trajectories based on spatial proximity and visual consistency; edge weights encode spatial distance as transition cost, and shortest-path search approximates the geodesic distance to success, whose changes can distinguish progress, stagnation, and regression without assuming that progress is monotonic over time.

  6. arXiv cs.RO58

    Learning Robot Metareasoning: Adaptive Computation Budgets for Real-Time Control

    The arXiv paper Learning Robot Metareasoning proposes modeling the determination of the optimal computation budget as a semi-Markov decision process (SMDP), in which a single decision jointly determines the robot's action commitment duration and the time allocated to the solver. The authors trained a reinforcement learning policy conditioned on the current state, the executing plan, and low-cost planner statistics. Across three task types—ground robot navigation, agile quadrotor flight, and contact-rich manipulation—the policy adjusts its budget according to scene demands and outperforms fixed-budget baselines.

  7. arXiv cs.RO46

    TransNav: Transformer-Based End-to-End Static and Dynamic Obstacle Avoidance for Quadrotors

    TransNav proposes a Transformer-based end-to-end navigation method for quadrotors that achieves obstacle avoidance in environments with mixed static and dynamic obstacles. The method uses a patch-based point-cloud encoding scheme, integrates perception and navigation into a single architecture, and directly predicts a finite-horizon action sequence and executes the first action. It also introduces a lightweight point-mass dynamics model that optimizes trajectory-level costs through numerical gradient propagation, enabling unsupervised training without expert demonstrations.

  8. arXiv cs.RO60

    Foundation-Model-Based 3D Scene Graphs for Mobile Manipulation

    The paper integrates FOUND-IT into a mobile manipulation robot platform, validating that foundation-model-based 3D scene graphs can support object change detection, multiple mapping sessions, navigable path determination, and object grasping in scene rearrangement tasks. Based on rigorous real-robot experiments, the authors provide an analysis of the effectiveness and limitations of a monocular, foundation-model-driven 3D scene graph construction system. The code is open-sourced in the MIT-SPARK/FOUND-IT repository on GitHub.

  9. arXiv cs.RO45

    TRACO: Enhancing Visual Task-Redirection Attacks on Vision-Language-Action Models via Closed-Loop Optimization

    The TRACO framework enhances targeted visual attacks on vision-language-action (VLA) models through closed-loop optimization. Its Execution-Driven Supervision rebuilds supervision signals based on the states actually reached under attack, while Progress-Guided Selection concentrates updates where task progress stalls and maintains supervision of prior behavior. Experiments across multiple VLA models and simulated environments show that TRACO improves task redirection success rates, highlighting the security implications of closed-loop attack optimization.

  10. arXiv cs.RO53

    Embodiment-Aware Planning for Heterogeneous Dual-Arm Manipulation

    This study proposes an embodiment-aware planning method in which two Franka FR3 arms equipped with different simple grippers (a suction cup and a parallel-jaw gripper) cooperate to complete manipulation tasks that a single gripper cannot perform reliably. Given a desired object motion specified by a human demonstration, the planner optimizes arm-trajectory assignments over a finite horizon, determining segment by segment whether single-arm manipulation or a coordinated dual-arm handover is required, while jointly considering heterogeneous grasp feasibility, motion constraints, manipulability, and cross-gripper compatibility; it also computes globally consistent assignments and adds explicit switching regularization.

  11. arXiv cs.RO38

    Reason-Guided Human Reward Modeling for Preference-Based Reinforcement Learning

    This paper proposes a reason-guided preference-based reinforcement learning (PbRL) framework that learns a human reward model from trajectory-level feedback, introducing reason tags that explain why a behavior is preferred in addition to preference labels. Compared with preference-only reward learning, this method provides additional supervision for learning human-aligned rewards and improves the interpretability of the policy. The learned human reward is combined with the environment reward for policy optimization, enabling the agent to improve task performance while producing more interpretable behavior that better matches human preferences and aligns with human intent.

  12. arXiv cs.RO55

    Reinforcement Learning-Based Multi-Terrain Whole-Body Control for a Quadruped Mobile Manipulator

    The paper proposes a reinforcement learning-based whole-body control framework for quadruped loco-manipulation on complex terrain. The framework combines a hybrid task representation with task-prioritized whole-body learning to coordinate locomotion and manipulation while preserving task-consistent end-effector behavior. The authors also developed a lightweight quadruped mobile manipulation platform for validation, and real-world experiments successfully deployed on complex terrains including slopes up to 30 degrees, stairs, and deformable terrain.

  13. arXiv cs.RO55

    FLoTS-SLAM: Two-Stage Optimization Using Optical Flow Uncertainty for Dynamic Monocular SLAM

    FLoTS-SLAM proposes deriving motion uncertainty from the residual between optical flow and camera-motion-induced flow, for monocular RGB SLAM in dynamic scenes. The system first estimates camera pose using high-confidence pixels, then reprojects dynamic pixels to jointly optimize pose and depth, reducing the impact of object motion on pose and depth updates. On DAVIS, the average IoU of dynamic masks improves by 35% over advanced baselines; on Bonn and TUM, average ATE is reduced by 59% and 19%, respectively, relative to the SLAM backbone used. The source code will be made public.

  14. arXiv cs.RO70

    No Vision Needed: Touch-Only Dexterous Hand Baoding Ball Manipulation Achieves Zero-Shot Transfer

    The research team achieved Baoding ball rotation on the Shadow Dexterous Hand Lite using only proprioception and binary tactile feedback, enabling zero-shot sim-to-real transfer. In a single continuous trial on the physical hand, it completed 225 180° rotations (112.5 full rotations) at about 0.36 rotations per second, with no vision or object-state information throughout. The authors also compared the roles of touch and pure proprioception, identifying the hand regions where tactile information is most critical.

  15. arXiv cs.RO55

    AWAM: Active Trajectory-Conditioned View Imagination for Robust Robot Manipulation

    AWAM (Active World-Action Model) introduces a virtual active-perception paradigm that actively plans observation positions and, before execution, imagines what will be seen along the planned trajectory. It treats the predicted task-related virtual camera motion as a structured query into a geometry-conditioned world model, yielding a reusable spatial prior that is compressed into a fixed memory and fused with live observations through cross-attention for diffusion-based action prediction.

  16. arXiv cs.RO68

    ActiveAlign bridges active perception and VLA policies via observation-aligned data adaptation

    The paper proposes ActiveAlign, a data adaptation framework that addresses the mismatch between the initial observation state produced by active camera motion and the manipulation policy's training distribution (first-frame distribution sensitivity): on LIBERO, directly prepending camera repositioning to pi_0.5 reduces the success rate from 46.3% to 11.5%.

  17. arXiv cs.RO60

    Beyond Success Rate: Interventional Evaluation of Memory in Vision-Language-Action Systems

    The paper proposes an Interventional Memory Evaluation Protocol (IMEP) for vision-language-action (VLA) systems, used to determine whether memory truly influences robot decision-making, covering four questions: the net benefit of memory, the conditions under which it takes effect, changes to task outcomes, and whether the effects are specific to task-relevant facts.

  18. arXiv cs.RO52

    Dual-Perspective Survey of Long-Horizon Robot VLA Memory Paradigms: From Sliding Windows to Lifelong Self-Evolving Memory

    arXiv has published a survey that systematically reviews the memory mechanisms of long-horizon robot Vision-Language-Action (VLA) models, dividing them by memory scope and persistence into five representative paradigms and one emerging frontier. The survey compares representative VLA memory systems across memory characteristics, architectural complexity, and open-source maturity, finding a trade-off in which greater architectural complexity is generally accompanied by lower open-source maturity. It also discusses key challenges in building full-lifecycle memory systems, including efficient memory management and lifelong knowledge evolution.

  19. arXiv cs.RO51

    SkyAgent proposes Revisable Target Memory (RTM) to improve continuous aerial search

    SkyAgent proposes Revisable Target Memory (RTM) to address the problem in continuous aerial search where, after evidence becomes contradictory, old candidates still trigger approach or verification actions (which the authors call false candidate persistence, FCP). RTM associates evidence with persistent candidates, suppresses repeated counting of correlated views, and lets candidates be revised among three states: Tentative, Confirmed, and Rejected.

  20. arXiv cs.RO51

    CoEvolve: A Self-Evolving Code Policy Framework for Humanoid Robots

    CoEvolve is a framework that represents team coordination as executable code over fixed robot motor skills. Through verifier-guided co-evolution, multimodal foundation models instantiate coordination strategies, physical verification evaluates each executed transition, and rejected behaviors trigger structured revisions starting from an accepted checkpoint.

  21. arXiv cs.RO54

    ORD-WM: Object-Centric Rigid Dynamics 3D World Model for Robotic Manipulation

    ORD-WM proposes a 3D world model that learns object-centric rigid-body dynamics for robotic manipulation tasks. It uses a vector-neuron variational autoencoder supervised by signed distance fields to encode each object point cloud into a geometry-aware latent representation composed of 3D vector features, and uses an action-conditioned dynamics model to predict per-object SE(3) motion increments. It then analytically applies the predicted rigid-body transformations to the current latent state rather than generating an unconstrained next latent state, thereby separating persistent geometry from pose changes.

  22. arXiv cs.RO55

    SCOPE: A Selective Program Edit Certification Method for Embodied Heuristic Learning

    SCOPE (Selective Certification Of Program Edits) uses failed and successful executions as complementary evidence to guide program revision: frontier-guided program search annotates a shared diagnostic graph with execution evidence to distinguish verified progress from unresolved checks, while selective behavioral certification uses stateful API replay to restore recorded responses and mutations and checks whether edits preserve selected historical successful behaviors.

  23. arXiv cs.RO45

    GRASP: Global-Local Representation Alignment and Spatial-Physical Grounding for Bimanual Robotic Manipulation

    GRASP proposes a training-phase prior injection framework for bimanual robotic manipulation. A physics-grounded flow-matching loss uses differentiable forward kinematics (FK) to supervise tool center point (TCP) poses and inter-arm relative poses, and the framework introduces a global query group distilled from DINOv3 together with local interaction queries supervised by Grounding DINO; the teacher models are removed at inference. Simulation and real-world long-horizon bimanual task experiments show that the two priors are complementary under different deployment conditions: the full model performs better in in-distribution deployment, while the distilled query branch is more suitable under strong visual randomization.

  24. arXiv cs.RO47

    InstAgent: A Recursively Self-Improving Agent Operating System for Heterogeneous Robot Collaboration

    InstAgent proposes a recursively self-improving (RSI) agent operating system that uses agentic behavior trees (BTs) to explicitly model capability assignment, inter-robot dependencies, and handoff checks for heterogeneous robots, and updates collaboration programs from execution feedback while preserving successful revisions for reuse in later tasks. Experiments on 20 real-world multi-robot tasks with 3 high-level models show consistent gains in task success rate, first-attempt completion rate, and execution efficiency.

  25. arXiv cs.RO38

    Bio-Inspired Magnetic Navigation via Rao-Blackwellized Particle Filter Gradient Descent

    The paper proposes a gradient descent bio-inspired magnetic navigation (BIMN) method based on local gradient estimation with a Rao-Blackwellized particle filter (RBPF) for navigation in GPS-denied environments. The method does not rely on complex, bulky, and costly magnetic maps; gradient descent naturally draws the system toward the destination, enabling magnetic navigation without magnetic maps as a simple and memory-efficient approach.

  26. arXiv cs.RO47

    A Review of Foundation Models for Autonomous Space Robotics: Architectures, Physical Adaptation, and Validation

    A critical arXiv review systematically examines the architectures, physical adaptation, and validation pathways of foundation models in autonomous space robotics, focusing on orbital manipulation and proximity operations. The article notes that event cameras can provide timely motion observations under strong illumination contrast, that spiking neural networks offer a possible route to sparse local computation, and organizes validation as an iterative "simulation-ground-space" closed loop, using a satellite capture case to connect observation, approach, contact, and recovery. The full text is 23 pages with 7 figures, accompanied by a source list and evidence document.

  27. arXiv cs.RO53

    Connecting VLA and world-action models with a unified model-to-policy formal framework

    The paper proposes an architecture-agnostic probabilistic formal framework based on stochastic kernels for uniformly describing embodied foundation models. The framework has two parts: characterizing models with conditional output distributions and action-realization kernels to induce task-conditioned robot policies, and connecting pretraining, post-training, and policy deployment. The authors instantiate it on OpenVLA and DreamZero, covering both autoregressive action-token prediction and joint video-action generation paradigms.

  28. arXiv cs.RO47

    PASS: A Trustworthy Precision Approach Simulation System for CAT III Integrity Algorithm Development

    PASS is a trustworthy precision approach simulation system for fixed-wing aircraft CAT III integrity algorithm development. Within a unified spatiotemporal geometric framework, it integrates configurable airport environments, prescribed trajectories, inertial simulation, calibrated stereo images, and continuous runway-relative ground truth, supporting navigation and integrity research under controllable sensor errors and environmental variations.

  29. arXiv cs.RO58

    VLA-Fabric: Learning Composable Interaction Mechanisms for Multi-Arm VLA Agents

    VLA-Fabric assigns a complete vision-language-action (VLA) model to each robotic arm, preserving each arm's local perception and action ownership, and achieves coordination through explicitly learned interaction across policy boundaries. The paper systematically studies where interaction should occur, how peer information should be aggregated, and how interaction should be learned, finding that shared context, peer-specific latent variables, and action-stage interaction play complementary coordination roles, and reproduces this principle on structurally different VLA architectures.

  30. arXiv cs.RO56

    What Makes a Good Symbol for Hybrid Discrete-Continuous Planning?

    The paper proposes defining symbol usefulness from the perspective of the solving algorithm: a good symbol should expose the discrete decisions that simplify solving the original planning problem. The authors first introduce the concept of solver-sufficient symbolization for finite-horizon piecewise-affine systems and design a counterexample-guided symbol invention algorithm, then extend it to optimization objectives whose energy functions are general neural networks. Experiments on simulated and real-robot tasks show that the resulting symbols reduce solving cost while maintaining solution quality, and improve interpretability and controllability.