Variational Trajectory Optimization of Anisotropic Diffusion Schedules
Pengxi Liu, Zeyu Michael Li, Xiang Cheng
原文摘要
We introduce a variational framework for diffusion models with anisotropic noise schedules parameterized by a matrix-valued path $M_t(θ)$ that allocates noise across subspaces. Central to our framework is a trajectory-level objective that jointly trains the score network and \emph{learns} $M_t(θ)$, which encompasses general parameterization classes of matrix-valued noise schedules. We further derive an estimator for $\partial_θ\nabla \log p_t$ that enables efficient optimization of the $M_t(θ)$ schedule. For inference, we develop an efficiently-implementable reverse-ODE solver that is an anisotropic generalization of the second-order Heun discretization algorithm. Across CIFAR-10, AFHQv2, FFHQ, and ImageNet-64, our method consistently improves FID with largest gains at low NFE. Code is available at https://github.com/kilonova801/anisotropic-diffusion.
cs.LG · cs.CV