Event
SceneAgent: Converting 3D/4D Captures into Interactive Simulation Environments
1 reports · 1 sources
Luke Hollis, Tianxing Fan, and Heng Yang published a paper proposing SceneAgent, an agent pipeline that converts 3D Gaussian Splatting, photogrammetry, LiDAR captures, AI-generated 3DGS scenes, and 4D dynamic videos into interactive simulation environments through simulator-based visual inspection and repair. The pipeline covers object segmentation, physical parameter estimation, part decomposition, and articulated and deformable simulation. The authors state that they also demonstrated a variety of simulated interactions and completed preliminary policy transfer to a real robot.
Report timeline
- SceneAgent: An agentic pipeline from 3D and 4D captures to simulation environments
SceneAgent is an agentic pipeline that converts 3D Gaussian Splatting, photogrammetry, LiDAR captures, AI-generated 3DGS scenes, and 4D dynamic videos into interactive simulation environments through simulator-based visual inspection and repair. The pipeline covers object segmentation, physical parameter estimation, part decomposition, articulation, and deformable simulation.
arXiv cs.RO ·