arXiv:2609.23555 · v2

Resolution-Flexible Decoding for Hybrid Neural Video Representations

首次提交 2026-09-20 19:10

版本更新 2026-11-02 20:10

雷达观测 2026-11-04 23:42

摘要

Neural video representations (NVRs) represent videos using neural network parameters and, in hybrid formulations, frame-wise latent embeddings. In conventional hybrid NVRs, the spatial size of frame-wise latent embeddings and the decoder upsampling schedule depend on the target resolution, potentially requiring large and non-uniform upsampling factors. In this paper, we propose a resolution-flexible decoder framework for hybrid NVRs. The decoder is constructed from uniform \(2\times\) upsampling stages, whose target feature sizes are obtained by tracing the spatial resolution backward from the final output resolution. After each upsampling stage, the feature map is aligned with the target size by minimal padding or cropping when necessary. To support this progressive decoding process, we further use intermediate reconstruction supervision and a reconstruction-difficulty-aware frame sampling strategy based on recent frame-wise losses. The framework preserves the basic representation format of hybrid NVRs and can therefore be applied to different backbones. Experiments on the UVG dataset at resolutions of \(1080\times1920\) and \(810\times1440\) show that the proposed approach improves reconstruction quality over the corresponding NVR baselines.

作者备注：Accepted to VCIP 2026