跳到正文
研踪PaperTrail
← 研踪 PaperTrail

arXiv:2604.09220 · v2

TinyNeRV: Compact Neural Video Representations via Capacity Scaling, Distillation, and Low-Precision Inference

首次提交 2026-04-10 19:26
版本更新 2026-11-16 21:35
雷达观测 2026-11-17 17:11
arXiv ↗PDF ↗

摘要

Neural Representations for Videos (NeRV) encode video sequences within neural decoder parameters, enabling direct frame reconstruction from temporal indices. Deploying NeRV in resource-constrained settings remains challenging because reconstruction quality, model capacity, decoding cost, and numerical precision are tightly coupled. This paper presents TinyNeRV, a deployment-oriented framework for compact neural video representations based on capacity scaling, teacher-guided quality recovery, and low-precision inference. We introduce NeRV-T (0.80M parameters, 22.62 GFLOPs) and NeRV-T+ (1.68M parameters, 89.80 GFLOPs) as minimum-compute and balanced low-capacity configurations. To recover detail without increasing inference cost, frequency-focal knowledge distillation emphasizes high-frequency teacher-student discrepancies, improving PSNR on Big Buck Bunny by 0.84 dB for NeRV-T and 0.88 dB for NeRV-T+. We also evaluate weights-only INT8, INT6, and INT4 quantization using post-training quantization (PTQ), quantization-aware training (QAT), and distillation-assisted QAT. Across the seven-sequence UVG benchmark, frequency-focal distillation improves baseline PSNR by an average of 0.70 dB for NeRV-T and 0.78 dB for NeRV-T+. Across UVG and Big Buck Bunny, INT8 is nearly lossless; INT6 causes modest PTQ degradation largely recovered by QAT; and INT4 benefits from retraining-aware adaptation and teacher supervision. The results establish practical capacity-supervision-precision trade-offs for real-time, resource-constrained neural video reconstruction.

作者备注:20 pages. Published in IEEE Access, 2026. Revised version incorporating peer-review changes

期刊信息:IEEE Access, vol. 14, 2026

AI 论文解读

基于摘要 · 非全文审阅

此版本尚未生成 AI 解读。解读由后台任务生成并按论文版本保存,登录后共享已有结果。

版本差异

本站首次收录为 v2,暂无更早版本可对照。

观测到的版本

相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。

v2 · 2026-11-16 21:35 · 最新观测版本

TinyNeRV: Compact Neural Video Representations via Capacity Scaling, Distillation, and Low-Precision Inference

Neural Representations for Videos (NeRV) encode video sequences within neural decoder parameters, enabling direct frame reconstruction from temporal indices. Deploying NeRV in resource-constrained settings remains challenging because reconstruction quality, model capacity, decoding cost, and numerical precision are tightly coupled. This paper presents TinyNeRV, a deployment-oriented framework for compact neural video representations based on capacity scaling, teacher-guided quality recovery, and low-precision inference. We introduce NeRV-T (0.80M parameters, 22.62 GFLOPs) and NeRV-T+ (1.68M parameters, 89.80 GFLOPs) as minimum-compute and balanced low-capacity configurations. To recover detail without increasing inference cost, frequency-focal knowledge distillation emphasizes high-frequency teacher-student discrepancies, improving PSNR on Big Buck Bunny by 0.84 dB for NeRV-T and 0.88 dB for NeRV-T+. We also evaluate weights-only INT8, INT6, and INT4 quantization using post-training quantization (PTQ), quantization-aware training (QAT), and distillation-assisted QAT. Across the seven-sequence UVG benchmark, frequency-focal distillation improves baseline PSNR by an average of 0.70 dB for NeRV-T and 0.78 dB for NeRV-T+. Across UVG and Big Buck Bunny, INT8 is nearly lossless; INT6 causes modest PTQ degradation largely recovered by QAT; and INT4 benefits from retraining-aware adaptation and teacher supervision. The results establish practical capacity-supervision-precision trade-offs for real-time, resource-constrained neural video reconstruction.

查看此版本解读 →查看此版本原文 ↗