DreamFree: A world action model without future video generation, reusing video diffusion priors via representation distillation

DreamFree proposes a world action model (WAM) that does not require generating future videos. Through representation distillation, it turns a pretrained video diffusion model into a predictive visual encoder that predicts the frozen video model's representation using only the current observation; an action module then extracts action-relevant information.