Skip to content
#Data and simulation
Oct 22Thu
  1. 差评X.PIN · 微信公众号57

    Differential Review's On-Site Visit: How Shengtong Energy and Qiten Robotics' Metaverse Intelligent Inspection Enables Inspection Robots to Work Across Plants

    Differential Review traveled to Chongqing to speak with engineers from Shengtong Energy and Qiten Robotics, and introduced the Metaverse Intelligent Inspection solution for high-risk industrial inspection. The solution first uses reconstruction technologies such as 3D Gaussian to build a digital factory on a computer, and a large model automatically identifies instruments.

Oct 21Wed
  1. Robotics 24/755

    Generative Bionics to build Europe's largest physical AI data factory in Italy, with AMD providing compute

    Italian deep-tech company Generative Bionics announced at CES Unveiled Milan that it plans to build a multi-site network of proprietary physical AI data factories. The first hub, covering 5,000 square meters, will be located in Italy and is expected to begin operations in Q4 2027, followed by one each in other European regions and global markets.

  2. 新智元 · 微信公众号69

    Nvidia unveils Agile ONE SN reference humanoid robot and MicroDuck simulation training demo at GTC Berlin

    In his GTC Berlin keynote, Jensen Huang announced that Nvidia and Agile Robots are launching the Agile ONE SN reference humanoid robot, standing 1.4 meters tall, weighing 40 kilograms, with 31 degrees of freedom, preloaded with the Isaac GR00T model and powered by Jetson Thor. Expected to launch in early 2027, it is intended to cut the time needed to set up robot research hardware and software from weeks to days.

  3. 腾讯科技 · 微信公众号72

    NVIDIA expands Isaac platform at GTC Berlin and partners with Agile Robots to launch humanoid robot reference platform

    At GTC Berlin 2026, NVIDIA expanded its Isaac robotics development platform. The now generally available Isaac Lab 3.0 supports multi-GPU training and connects to physics engines such as Newton and PhysX, while the open-source runtime framework Isaac OS connects AI models, sensors, control systems, and robot hardware.

  4. 机器之心 · 微信公众号57

    Agnes AI showcases Agnes Harness agent runtime framework: command multi-device coordination with a single sentence

    The 2026 Physical AI and World Models Conference opened in Nanjing, where Agnes AI showcased its self-developed agent runtime framework, Agnes Harness, in the exhibition area. Through the device access protocol MHS, it extends full-modal model capabilities to hardware including the Go2 robot dog and the Car01 robot vehicle.

  5. HuggingFace Daily Papers55

    OverSeer: Improving Multi-Agent World Model Consistency with Fixed Auxiliary Views

    The study proposes OverSeer, a multi-agent world model that adds auxiliary camera views fixed in space alongside agents' egocentric views, serving as a proxy for a world-centric representation to improve temporal and cross-agent consistency. The auxiliary views are redundant and nearly static, so they can be efficiently compressed with a delta-VAE that encodes only changes relative to a static reference image, reducing the number of tokens required.

  6. 机器人前瞻 · 微信公众号82

    NVIDIA open-sources robot data engine Flora, labeling cost about 1/125 that of GPT-6 Astra

    NVIDIA released and open-sourced the data engine Flora, which converts raw robot video into training data such as timestamped action descriptions, process rewards, and outcome rewards; it is already used to train the GR00T series models. Flora consists of an action description model, a temporal segmentation model, and a reward model, fine-tuned from the Qwen3.5 series of vision-language models, and can label 200,000 hours of data per day on 512 GB300 GPUs.

    Why it matters: NVIDIA's open-source data engine cuts robot video labeling costs to about 1/125 of a general-purpose large model and provides several benchmark comparisons, which can be used to assess the substitution space in the data labeling segment.

  7. 机器人前瞻 · 微信公众号72

    NVIDIA Open-Sources Cosmos3-H-Dreams, a Real-Time Generative Surgical World Model That Runs on a Single GPU

    NVIDIA has released and open-sourced Cosmos3-H-Dreams, a real-time generative surgical world model that can generate surgical imagery in real time based on robot operation commands, simulating instrument movement, tissue traction, and deformation, with support for laparoscopic cholecystectomy scenarios.

  9. 36Kr Embodied Intelligence64

    NVIDIA upgrades Isaac robotics platform, launches humanoid robot reference framework and simulation tools

    NVIDIA announced an upgrade to its Isaac general-purpose robotics development platform, launching a new humanoid robot reference framework, simulation workflows, and data tools aimed at accelerating general-purpose robot development. The updates cover robot training, simulation validation, and deployment processes, helping developers train robots using synthetic data and simulation environments and validate robot behavior before actual deployment.

  10. NVIDIA80

    NVIDIA Expands Isaac Platform with New Humanoid Reference Platform, Isaac OS, and Isaac Lab 3.0

    At GTC Berlin, NVIDIA announced an expansion of the Isaac open-source robotics development platform, adding the Isaac OS runtime, the officially released Isaac Lab 3.0 learning framework, and an open-source reference workflow based on DGX Station.

    Why it matters: The original text lists the runtime, learning framework, and open-source workflow newly added to the Isaac platform, allowing readers to judge the specific changes in the data-to-deployment pipeline.

  11. Reddit r/robotics44

    Robot that can self-evolve and 3D print its own tools

    A robotics project uses evolutionary search and AI-generated CAD in simulation to let a robot iteratively design and test tools such as grippers to improve task performance; the robot's motions still come from a predefined task controller. The next step is to validate on real hardware using an Arctos robot and a 3D printer, and the author is seeking suggestions for automatically removing gripper fingers from the print bed.

  13. 36Kr Embodied Intelligence58

    Nvidia expands open model lineup with Cosmos 3.5 world model and more

    Nvidia announced an expansion of its open model lineup, introducing the Nemotron Retriever retrieval model, the Kumo structured enterprise data model, the Cosmos 3.5 world model, the Alpamayo 2 Edge autonomous driving model, the BioNeMo protein design model, and the Ising quantum computing model, among others. In a benchmark covering proteins of 200 amino acids, BioNeMo RFD4-Proteina generated designs about 13 times faster than RFdiffusion3.

  15. 古月居 · 微信公众号50

    ROS2 and Gazebo Simulation: From URDF Modeling to Differential Control and Noise Injection

    This tutorial explains how to build a robot simulation environment with ROS2 and Gazebo, covering URDF modeling, lidar and differential drive plugin configuration, SDF world editing, and sensor noise injection. It highlights common pitfalls such as use_sim_time, the TF tree, and physical parameter calibration, and presents advanced directions including multi-robot simulation, hardware-in-the-loop, and CI automated testing, helping developers validate algorithms such as Nav2 and SLAM in simulation before migrating to real hardware.

  16. HuggingFace Daily Papers63

    JCA model jointly generates 3D motion and video for arbitrary skeletons

    An NVIDIA research team proposes the JCA model, which can simultaneously generate video and replayable 3D motion for any given skeleton, and output a camera that registers the motion to the scene. The model keeps 3D motion in a separate model that supports arbitrary skeletons, connects to a pretrained video model through a small number of cross-attention layers, and the motion model first learns skeleton movement from motion-only data.

  17. 钛媒体62

    Rural women mentor robots: the grassroots supply chain of embodied AI data collection

    Rural women in Henan wear data-collection devices to gather embodied AI training data, earning 80 yuan a day and more than 2,000 yuan a month; their job title is data collector. After Nvidia's EgoScale results were released, bodyless collection became the mainstream method, greatly lowering the barrier to entry and drawing in grassroots workers such as labor outsourcing firms, street promoters, and loan brokers.

  18. 量子位62

    Qianjue Technology releases predictive world model Polibrain

    Tsinghua-affiliated embodied intelligence company Qianjue Technology released the predictive world model Polibrain at the 2026 Physical AI and World Models Conference. It focuses on learning physical laws and cross-embodiment reuse; rather than generating complete future frames, it predicts state changes in a task-relevant latent representation space, forming a closed loop of perception, decision-making, execution, and feedback.

  19. 机器人产业应用 · 微信公众号66

    Kaiwang Data and Schaeffler Advance Industrial Embodied Data Collaboration, Taicang Smart Factory Opens

    On October 20, Schaeffler's embodied intelligent robot smart factory officially opened in Taicang, Jiangsu. At the same time, Schaeffler Embodied Intelligent Robot (Taicang) Co., Ltd. and Kaiwang Data announced progress on their industrial embodied data collaboration. Focusing on 7 typical scenarios, the two parties used real-robot teleoperation, UMI, EGO and other equipment to complete trial collection, quality inspection and annotation, producing the first batch of more than 1,000 valid data entries and putting them into training of embodied industrial vertical models.

  21. arXiv cs.RO56

    EMMA framework uses generative visual models to improve visual generalization of VLA manipulation policies

    The EMMA framework enhances vision-language-action (VLA) policies through a generative data engine and training pipeline, addressing the high cost of collecting robot manipulation data across varied appearances. Its core component, DreamTransfer, is based on a diffusion Transformer and generates multi-view-consistent, geometrically plausible manipulation videos, supporting text-driven editing of foreground, background, and lighting while preserving 3D structure.

  22. arXiv cs.RO45

    Gibson Env: A Real-World Perceptual Virtual Environment for Embodied Agents

    Gibson Virtual Environment provides a perceptual training environment for embodied agents by virtualizing real spaces, and currently contains more than 1,400 floor spaces from 572 full buildings. Its built-in "Goggles" synthesis mechanism allows trained models to be deployed directly to the real world without additional domain adaptation. The environment subjects agents to physical and spatial constraints, and the paper demonstrates sample perceptual tasks learned within it; the code, dataset, and project website are openly available.

  23. arXiv cs.RO67

    Learning Bimanual Laparoscopic Appendectomy Without Robot-Collected Demonstrations, Validated on Live Animals

    The paper proposes an end-to-end pipeline that uses an instrument-state logger mounted on the shaft of a standard laparoscopic instrument (combining inertial, time-of-flight, and Hall sensors, with no external camera or tracker) to capture the instrument pose and jaw state during a surgeon's operation, which is then used to train a surgical robot policy and validated on live animals.

  24. arXiv cs.RO58

    WorldScape Policy 2.0: Steerable World Action Modeling via Reasoning-Augmented Memory and In-Context Learning

    The paper proposes WorldScape Policy 2.0, a controllable World Action Model (WAM) with reasoning-augmented long short-term memory. Its causal short-term visual memory supplies recent observations as DiT prefill to preserve local interaction dynamics, while its long-term event memory organizes historical VLM outputs into global-history, local-active, and event-boundary representations for progress-aware retrieval and to generate implicit subgoal conditions.

  25. arXiv cs.RO62

    Autonomous Data Collection and Offline Reinforcement Learning for Local Contact-Rich Manipulation Tasks

    The paper proposes a modular method that autonomously collects data in local segments of contact-rich tasks and uses offline reinforcement learning to train local policies, which are then integrated with traditional motion planning to complete long-horizon assembly tasks. Across four real-world tasks, using only 2-2.5 hours of autonomous data collection, the method achieved an average success rate of 96% on long-horizon tasks, compared with 55% for a planning-only baseline and 37% for the strongest end-to-end baseline; the local policies also reduced applied force by 49%. Performance remained at 90% in scene-level out-of-distribution scenarios, with more than 1,500 real-world evaluation rollouts completed in total.

  27. arXiv cs.RO55

    Joints, Camera, Action! A Co-Generation Model for 3D Motion and Video for Arbitrary Skeletons

    The paper proposes a model that can simultaneously co-generate video and 3D motion for any given skeleton, along with a camera that registers that motion to the scene. The model keeps 3D motion in a separate module to support arbitrary skeletons, connects it to a pretrained video model through a small number of cross-attention layers, and uses a generative video editor to curate nearly 200K training pairs. Evaluations show that its text-driven animation of diverse skeletons is more faithful than video-first pipelines, that the motion responds to the surrounding scene, and that it also supports video-to-skeleton motion, skeleton motion-to-video, and keyframe-based 3D motion control.

  28. arXiv cs.RO56

    RoboJudge-Bench evaluates multimodal large models as judges of embodied video generation

    The paper introduces RoboJudge-Bench to assess the reliability of multimodal large language models (MLLMs) as judges of embodied video generation, covering two dimensions, physical consistency and instruction alignment, with 800 human-annotated videos from 8 source corpora and 10 video generators, spanning grippers, human hands, and dexterous hands.

  29. arXiv cs.RO55

    PanoGraphGS unifies panoptic segmentation and hierarchical 3D scene graph construction, releases NaviGS dataset

    PanoGraphGS integrates panoramic 3D Gaussian representation learning and hierarchical 3D scene graph construction into a single framework, learning semantic and instance features on shared Gaussian geometry to achieve cross-view-consistent panoptic prediction and novel-view panoptic segmentation.

  30. arXiv cs.RO55

    SynCalib: Breaking Dataset Shortcuts in LiDAR-Camera Calibration via Extrinsic-Controllable Synthesis

    The paper proposes SynCalib, a data generation framework that addresses overfitting and poor generalization caused by insufficient extrinsic diversity in training data for deep learning-based online LiDAR-camera calibration. Using omnidirectional image datasets annotated with depth ground truth, it synthesizes multimodal calibration data under strict extrinsic constraints. Experiments show that this pipeline significantly improves the generalization and robustness of learning-based calibration networks, and real-world evaluations across various camera-LiDAR configurations validate the zero-shot transfer capability of models trained solely on synthetic data; the data generation code, pretrained models, and online benchmark dataset will be made public.

  31. arXiv cs.RO58

    arXiv releases 12-chapter, 388-page monograph 'Physical AI: Concepts, Techniques, and Challenges'

    arXiv has released a monograph titled 'Physical AI: Concepts, Techniques, and Challenges,' comprising 12 chapters, 388 pages, and 64 figures. It defines physical AI as artificial systems that perceive, model, and act upon the physical world through continuous feedback under real-world constraints, and distinguishes it from digital AI, embodied AI, cyber-physical systems, and digital twins.

  32. arXiv cs.RO57

    AdaDex: Learning Generalizable Dexterous Skills from a Single Trajectory via Hybrid Dexterous Mimicking

    AdaDex is a goal-conditioned reinforcement learning framework that turns a few seconds of human hand-object trajectory (from motion capture data or HOI reconstruction from in-the-wild RGB(D) video) into generalizable dexterous skills. Its core, Hybrid Dexterous Mimicking, trains a shared policy across two sets of massively parallel environments: environments with dense motion tracking objectives inject the human prior, while environments with noised initial states and goals and a sparse object-success reward force the skill to work even when it deviates from the reference trajectory.

  36. arXiv cs.RO62

    MARE: An open-source lunar rover simulator with shadow ground truth

    The authors present MARE, an open-source lunar rover perception and autonomy simulation suite built on Unreal Engine 5 and ROS 2, comprising three parts: terrain generation, dual-physics lunar rover sensor simulation, and GNC mission control. The simulator provides stereo, lidar, event, and SPAD camera data along with pixel-level ground truth; at low solar elevation angles, the mean IoU between predicted shadows and rendered shadows is 0.79. Stereo depth analysis shows that pixel coverage in shadowed regions is lower than in sunlit regions.

  37. arXiv cs.RO67

    Idealworks and NVIDIA evaluate sim-to-real transfer of COMPASS navigation

    Idealworks and NVIDIA systematically evaluated the sim-to-real transfer of the X-Mobility and COMPASS learned navigation pipeline on industrial mobile robots. After training in a digital twin with Cosmos-generated sim-to-real data, real-robot success rates across four scenarios rose from 65.3% to 91.7%, weighted travel time nearly halved, the gap to the production-line navigation stack was 8.3 percentage points, and everything ran on the onboard Jetson AGX Xavier.

  39. arXiv cs.RO57

    PointHand user study: How keypoint hand rendering affects novice teleoperation demonstrations and diffusion policy success rates

    The paper proposes the PointHand teleoperation interface, which renders a multi-fingered robotic hand as sparse keypoints at the fingertips and joints, matching the keypoints observable by the policy. In a simulated mug-in-box task, 18 novices and 4 experts collected 2,200 trials across three rendering conditions; among them, novices who saw emphasized rendering of the thumb and index finger achieved 441 successful demonstrations out of 600 trials, higher than the 320 out of the real hand-shape rendering.