Preprint Open access
SGF+: Decoupling Gradient Flows for Autoregressive Video Generation
Autoregressive video generation requires denoising the current frames while writing their key-value representations as context for future predictions. However, these two roles typically share parameters, and we find that their gradients exhibit distinct patterns and systematic negative alignment, hindering the joint op …