Off-policy RL inversion method for diffusion models

A new method for off-policy RL with diffusion: given off-policy data, we need to determine what its diffusion latent steps would be under the *current* policy (rather than the policy that collected it), which requires inverting the diffusion process on the off-policy data.