The paper proposes a latent action model (LAM) that can ingest synchronized multi-camera views, using cross-attention to resolve depth and occlusion issues, then compresses them into latent actions that are fed into a policy in which a latent expert and an action expert are coupled by sequential flow matching around a frozen VLM backbone.
The paper proposes replacing the wrist camera, pose tracker, and their separate data streams in the UMI glove setup with a single monocular camera (USD 122) worn on the collector's head. It reads printed fiducial markers on an electronics-free glove (USD 22) and paper tiles in the workspace, producing the 6-DoF gripper pose and jaw width from the same frames the policy will see. At deployment, the same camera is mounted on a low-cost (USD 120) robotic arm beside the robot and mimics the collector's head motion based on the robot's joint states.
A CoRL 2026 paper proposes the Action Influence Maximization (AIM) algorithm, which actively collects training data to increase the action influence of the dataset, thereby improving the controllability of action-conditioned video world models. The authors prove that a data's action influence metric upper-bounds the action influence any model trained on that data can express, and that the narrow action distribution of expert demonstrations causes this ceiling to be low.
The authors propose Embodied Playground, a benchmark for evaluating how foundation-model agents coordinate physical, strategic, and spatial reasoning across long-horizon tasks. It contains 410 task environments spanning basic manipulation, sequential puzzles, and multi-stage household activities.
The paper proposes Video-Point Model (VPM), a world model that conditions on multi-view video histories and language instructions to jointly predict future videos from arbitrary viewpoints and the 3D trajectories of persistent scene points. The authors add camera-conditioned multi-view processing and a trajectory prediction head to a pretrained world model, and build the VPM-Data simulation corpus and the VP-WorldBench benchmark; they further add robot actions as a token modality in the generator, so that the policy shares the point-supervised backbone.
OpenAI's official website listed 27 robotics-related positions in October 2026, all in San Francisco, with base annual salaries from $177,000 to $500,000; 4 of them are actuator-specific roles requiring candidates to lead the development of custom electromechanical actuators end to end.
An evaluation by SenseTime together with teams including Daxiao Robotics and Nanyang Technological University shows that GPT-6-Astra came close to full marks on several of 12 simulation benchmarks (100% on LIBERO-Long++, 98.8% on SIMPLE), but after deployment on 8 real robot platforms, all 11 attempts to plug in a plug failed and folding clothes ran into trouble. Its high scores also depend on two "boosters": in-context learning (ICL) and relaxing the action step limit to 10x; on the long-horizon household benchmark BEHAVIOR, its success rate was only 37.0%.
The paper identifies two types of decode amplification when randomly sampling videos for AI training: sequential reconstruction of unrelated frames, and reconstruction of the reference chains needed for sampled targets. The authors propose dependency-aware sparse decoding, which reconstructs only the requested frames and their necessary references without transcoding the source video; optional offline DDRA encoding constrains each interior frame between two intra-coded anchors, so that reconstruction of each requested target requires no more than three frames. On a large robotics corpus, the method achieves 1.45x the loading throughput of LeRobot v3 at similar reconstruction quality, with 58.7% less media data.
CausalAlign proposes a causal alignment framework that uses linear probes and causal interventions to locate the representation layers for camera ego-motion in video generation models, then aligns the representations at those layers to a 3D foundation model via delta-token space. After fine-tuning Wan2.2 on DL3DV and RealEstate10K, geometric consistency improves by more than 20% over the base model, and on RoboCasa365 mobile manipulation tasks it raises the success rate of the world action model (WAM) by 10 percentage points.
CausGround proposes a non-parametric causal interaction grounding framework that distills interaction experience into action-centered precondition and effect knowledge, and combines it with current observations during planning for backward and forward reasoning.
TARSphere proposes a full-stack framework for robots that evaluates long-horizon embodied agents under physical and social constraints. Its TARSphere-Infra runs robot policies in a physics simulator with embodied NPCs and constrained dialogue, and uses an event-driven finite-state machine to update task states based on completed actions and delivered information; TARSphere-Harness lets a frozen multimodal large language model revise its decisions through multi-level executable skills, observations, hierarchical memory, and execution feedback.
The authors deployed decentralized multi-agent reinforcement learning (MARL) on two physical robots for joint task assignment and navigation in a setting where multiple robots serve multiple production machines. Policies were first trained in high-fidelity simulation in Isaac Lab/Isaac Sim, then transferred zero-shot to the real robots via a self-built ROS 2 deployment pipeline. Paper: https://arxiv.org/abs/2609.14567.
AI company HUMXN has launched a program in three US cities—Minneapolis, Chicago, and Miami—covering the cost of eligible home repairs such as drain clearing, electrical, HVAC, duct, and carpet cleaning, on the condition that technicians wear wearable devices to record the work for training AI and robotic systems.
Nature Will recently released a demonstration video of the Natura-1 model, in which robotic hands, without human assistance, completed tasks such as wrapping wontons, packing express deliveries, brewing tea, applying phone screen protectors, and writing Chinese calligraphy with a brush. Natura-1 is a 50-billion-parameter mixture-of-experts (MoE) model, with data processing covering nearly 1 million hours of first-person human interaction data. It can drive a 20-degree-of-freedom dexterous hand within a 100-millisecond control loop and follow complex natural language instructions to generalize in unseen scenarios.
Someone on Reddit r/robotics asked how to define a "usable" human demonstration clip before collecting data. The author's initial checklist includes: whether the target object is visible at grasp onset, contact, and release; how to define task start and end points; whether the hand stays in frame throughout; and whether to split holdout sets by person or by site rather than by clip. The author also asks people with experience training on demonstration data which item most often causes rework and what they themselves missed.
A Reddit user who recently graduated from a health-focused university and has just entered the robotics field asks whether video, motion, eye-tracking, depth-sensing, and expert-annotated data that sit idle in university labs after papers are published could be used to train robot policies, for example for specialized procedures such as surgery. The poster is looking to connect with practitioners working on robotics data pipelines (collection, cleaning, annotation, training).
VAST has open-sourced EdenLive, a real-time generative renderer in the Project Eden series. The upstream interaction system maintains game rules and state, while EdenLive handles real-time image rendering. It supports white-box models, 2D/3D scenes, or real footage as references, and changing the first frame and prompt can alter the look among photorealistic, hand-drawn, cartoon, and other styles.
RLinf, an open-source training framework for embodied reinforcement learning developed by Tsinghua University, Infinigence AI, and the Beijing Zhongguancun Academy, has officially released v0.4, with updates across four areas: a Lego-style real-machine system, real-machine post-training algorithms, full-modality model support, and a domestic computing power foundation.
Why it matters: It outlines the framework's evolution from simulation to real-machine training, helping readers understand the capability boundaries of the embodied reinforcement learning engineering stack.
Isaac Lab 3.0 has been officially released, and the official recommendation is for new projects and projects migrating from 2.x to use v3.0.0 as their base. The new version adopts a multi-backend architecture with a unified task API, supporting backends such as Newton and OV Libraries. Supported tasks can switch physics, rendering, and visualization backends without rewriting logic, and most workflows do not require installing or launching Isaac Sim.
Why it matters: The original article lists the specific changes in the multi-backend architecture and the removal of the Isaac Sim installation requirement, as well as the environment and interface changes needed for migration, making it easier to judge the upgrade cost for existing projects.
The paper proposes performing 3D scene generation directly in a high-dimensional implicit 3D latent space derived from 2D foundation models (such as DINOv2, SigLIP2, and DA3), using a diffusion Transformer to model within that 3D latent space and achieve 3D-grounded scene generation.
Ropedia released the open-world model W0, trained on about 10,000 hours of first-person human video. A single set of weights can predict the first-person view of humans, robotic arms, and humanoid robots (Unitree G1, Fourier GR-1), using a shared camera-plus-skeleton representation; adding a new robot requires only its URDF.
Why it matters: The original article provides the training data scale, the cross-embodiment transfer method, and measured comparisons, so readers can judge the world model's actual impact on robot policy training workflows.
VAST has open-sourced EdenLive, a real-time generative renderer in the Project Eden series, including 5B and 14B model weights (each with bidirectional generation and few-step streaming generation versions), real-time streaming inference code, EdenGolem v0.1, a front-end workbench, and a technical report.
Founded by a former NVIDIA world model team, Dream Labs has emerged from stealth, announcing the completion of a $90 million (about RMB 600 million) seed round led by B Capital, and simultaneously launching the Dream API, opening up its world action model Dream-1.
Altman confirmed on the Engadget podcast that OpenAI will develop its own humanoid robots, and gave a timeline of a striking demo in 2027, with real deployment on the streets still several years away. The article reviews OpenAI's trajectory from disbanding its robotics team in 2021, leading Figure AI's $675 million Series B in 2024, ending its partnership with Figure in February 2025, to establishing the OpenAI Robotics department in May 2026.
Hesai Technology launched the Kosmo 3D world data engine on October 14 and introduced the Kosmo One 8K ultra-high-definition AI spatial camera.
The Gao Fei team at Zhejiang University, together with Weifen Zhifei, launched the CrossFly benchmark, building 23 reconstructed real-world scenes and 15,263 complete trajectories, covering three task types: indoor, outdoor, and indoor-outdoor cross-domain, accompanied by a hierarchical VLA baseline, CrossFly-Agent; the full simulation dataset, evaluation protocol, and baseline code are all open source.
A Reddit user proposed designing a tiny RGB + depth recorder for hand-object manipulation demonstrations and compared single-frame model outputs from three depth approaches in the same synthetic scene (a chest-view grasp of a mug): a D405-class stereo camera, the TMF8829 dToF (48 × 32 zones), and a generic iToF (240 × 180).
Toyota Material Handling Europe is working with Nvidia and SoftServe on a simulation-first approach that completes testing and validation before equipment reaches customer sites, aiming to cut commissioning effort by up to 50% and shorten time to market for autonomous material handling systems by up to 40%.
An AI engineer has open-sourced roboreview, a tool for annotating factory videos captured by head-mounted cameras for robot imitation learning, cutting the annotation time for a 5-minute clip from 40-50 minutes to 5 minutes. The workflow first uses a small model to predict each step, then confirms or fine-tunes the start and end points one by one in a review app; the review results are exported as training data and used to retrain the model.
The research team proposes HandsOn, a composable cross-embodiment dexterous manipulation simulation platform and benchmark supporting 5 robotic arms, 6 dexterous hands, and about 200 rigid, articulated, and deformable assets. The benchmark contains 18,000 human demonstrations and 66 human-verified tasks, of which Core-50 is used for demonstration-based learning and execution tests, while Transfer-16 evaluates asset and relation transfer, skill composition, and deformable manipulation without target-task demonstrations.
A Reddit user has proposed and is advancing a mini RGB + depth camera concept for close-range robotics experiments and hand-object demonstrations. The Mini version measures 44 x 44 x 30 mm and is planned to use a Camera Module 3 + TMF8829 dToF, an IMU, and an ESP32-P4; a separate Pi development enclosure version also exists.
The study proposes the HOLI-WORLD integrated ecosystem, which connects experience collection, world representation, automated data construction, model learning, and independent evaluation. HOLIWORLD-Foundry combines static and dynamic perception to automatically construct world records, and HOLIWORLD-Data organizes approximately 100 self-collected scenes into approximately 80K QA pairs used to train HOLIWORLD-VL-4B; independently human-annotated held-out recordings form HOLIWORLD-Bench.
The study introduces the AnyGoal benchmark and open-source library to evaluate world models' compositional generalization on goal-shifted task variants. The task design ensures that individual state factors and actions remain within the training support, but their combinations are underrepresented in expert trajectories. Experiments across multiple environments and world model families show that current models consistently fail under these recombination scenarios, and the authors further analyze where failures occur at the dynamics and representation levels.
EgoXperience proposes a complete pipeline covering data collection, automatic annotation, unified modeling, and benchmark evaluation, aimed at jointly reconstructing observer motion, scene geometry, and hand-object interactions from egocentric video. At its core is the automatic annotation engine EgoXX-Engine, which combines geometrically verified object tracking with SLAM-based world alignment to produce the 50-hour dataset EgoX-Data-6M (with second-level task descriptions) and the 1-hour evaluation set EgoX-Bench.
The paper proposes the Stateful Harness framework, which separates world evolution from video rendering, using a frozen video model to render events and write back the world state, in order to support rule-governed interaction with hidden state. The authors build the WorldState-Bench benchmark, containing 50 counterfactual twin pairs that share an initial frame and action but differ in hidden state and required outcome.
The paper proposes InfiniDream, a VLM-driven framework for open-ended procedural 3D world generation. Its core components include Symbolically Constrained Asset Generation.
X Square Robot released the X2Real simulation benchmark for evaluating the performance of embodied models in the real physical world, proposing three design principles: credibility, validity, and objectivity. In testing, X2Real simulation evaluation achieved a 0.96 correlation with real-robot evaluation in task success rate and a 0.99 correlation in progress score; control parameter calibration achieved millimeter-level trajectory consistency, covering embodiments including Franka, ArtiXon Arm-6A, ARX R5, and Quanta X1.
Fréchet Forcing proposes a fine-tuning method that keeps streaming video world models stable during long-horizon generation beyond the training length and lets them continue to follow action commands. The method applies a flow-matching loss where self-generated history meets real data, constrains context fidelity with a Fréchet distance centered on the real clip itself, and enforces visual realism with a Fréchet distance on real frames in a frozen perceptual space. All three constraints come from short video clips, with no teacher model, online judge, or long videos needed.
ScaleNav proposes a unified world-action framework that achieves language-conditioned local navigation through three-stage training: first, instruction-conditioned video pretraining on internet first-person videos to learn how observations evolve as the camera approaches a target; then, aligning predicted executable action chunks using action-labeled simulation data; and finally, jointly fine-tuning all trainable components.
A joint research team from SenseTime, Nanyang Technological University and other institutions has introduced the SenseNova-RoboRSI unified Harness, which raises GPT-6-Astra's manipulation success rate on 42 RoboDojo tasks from 15.83% in the baseline configuration to 54.17%, with model parameters unchanged.