Article

JCA model jointly generates 3D motion and video for arbitrary skeletons

An NVIDIA research team proposes the JCA model, which can simultaneously generate video and replayable 3D motion for any given skeleton, and output a camera that registers the motion to the scene. The model keeps 3D motion in a separate model that supports arbitrary skeletons, connects to a pretrained video model through a small number of cross-attention layers, and the motion model first learns skeleton movement from motion-only data.

Part of the event: A model for co-generating 3D motion and video for arbitrary skeletons

This page provides a summary and source link only.