← 研踪 PaperTrailarXiv:2611.19285 · v1
Generate, Align, and Restore: MLLM-Empowered Diffusion for Generalizable Low-light Image Enhancement
首次提交 2026-11-14 17:28
版本更新 2026-11-14 17:28
雷达观测 2026-11-17 12:06
摘要
Low-light image enhancement (LLIE) is essential to numerous vision applications operating under adverse illumination. Despite substantial advances, real-world nighttime enhancement remains challenging due to the scarcity of strictly aligned day-night pairs and complex degradations involving extreme darkness and heterogeneous artificial light sources, leading to fragile generalization. To overcome these challenges, we propose MrLIE (MLLM-empowered reference Low-light Image Enhancement), a novel reference-based unsupervised LLIE framework that synergizes the generative and reasoning capabilities of multimodal large language models (MLLMs) with conditional diffusion. MrLIE employs the MLLM as a high-fidelity reference synthesizer and diagnostic critic, iteratively generating, diagnosing, and correcting normal-light references directly from degraded nighttime observations. Based on this, our method governs the enhancement process through two complementary mechanisms, in which a confidence offset module rectifies spatial-geometric inconsistencies for reference reliability and a structure-anchored injection scheme harmonizes aligned reference cues, low-light structural constraints, and ControlNet additive anchoring during the denoising process. Extensive experiments on diverse benchmarks demonstrate that MrLIE achieves superior perceptual quality, natural appearance, and robust generalization.
作者备注:14 pages, 13 figures
观测到的版本
相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。
v1 · 2026-11-14 17:28 · 最新观测版本
Generate, Align, and Restore: MLLM-Empowered Diffusion for Generalizable Low-light Image Enhancement
Low-light image enhancement (LLIE) is essential to numerous vision applications operating under adverse illumination. Despite substantial advances, real-world nighttime enhancement remains challenging due to the scarcity of strictly aligned day-night pairs and complex degradations involving extreme darkness and heterogeneous artificial light sources, leading to fragile generalization. To overcome these challenges, we propose MrLIE (MLLM-empowered reference Low-light Image Enhancement), a novel reference-based unsupervised LLIE framework that synergizes the generative and reasoning capabilities of multimodal large language models (MLLMs) with conditional diffusion. MrLIE employs the MLLM as a high-fidelity reference synthesizer and diagnostic critic, iteratively generating, diagnosing, and correcting normal-light references directly from degraded nighttime observations. Based on this, our method governs the enhancement process through two complementary mechanisms, in which a confidence offset module rectifies spatial-geometric inconsistencies for reference reliability and a structure-anchored injection scheme harmonizes aligned reference cues, low-light structural constraints, and ControlNet additive anchoring during the denoising process. Extensive experiments on diverse benchmarks demonstrate that MrLIE achieves superior perceptual quality, natural appearance, and robust generalization.
查看此版本解读 →查看此版本原文 ↗