AR-Edit:无需反演的训练无关自回归视频编辑
AR-Edit: Training-Free Autoregressive Video Editing without Inversion
Hovhannes Margaryan, Quentin Bammey, Christian Sandor, Vicky Kalogeiton
AI 速读 基于摘要
作者提出 AR-Edit,利用 DMD 蒸馏自回归视频扩散模型中自注意力 value 的稳定性,缓存并注入源视频 value,实现无需训练、无需反演的实时流式视频编辑。
cs.CV
查看原文摘要
Editing a video stream in real time, without access to future frames, is essential for interactive applications. Existing training-free video editing methods, however, assume full offline access to the entire sequence, while streaming approaches either rely on additional training or are limited to specific editing techniques. We show that this limitation can be removed by analyzing the self-attention dynamics of DMD-distilled autoregressive (AR) video diffusion models. We uncover a key asymmetry: queries and keys remain stable and aligned with their source counterparts across denoising timesteps, while values diverge and encode the evolving content. Inherited from the non-distilled bidirectional teacher, this asymmetry is strongest at high noise, where few-step streaming models operate. The resulting mechanism is simple: a single forward pass suffices to capture source identity in the value features, which can be reused throughout generation. Starting from pure Gaussian noise and injecting only these source values reconstructs the input with fidelity matching or surpassing inversion-based methods, effectively eliminating inversion. Based on this insight, we introduce AR-Edit, a training-free, inversion-free method that caches source values once and selectively injects them during denoising. Across multiple AR backbones, AR-Edit enables real-time streaming editing with superior source preservation and tonal fidelity at minimal overhead.