Perception, Understanding and Reasoning: A Multimodal Benchmark for Video Fake News Detection
Cui Yakun The Hong Kong University of Science and Technology, Peng Qi Centre for Trusted Internet and Community, National University of Singapore, Fushuo Huo The Hong Kong University of Science and Technology, Hang Du Beijing University of Posts and Telecommunications, Weijie Shi Hong Kong University of Science and Technology, Juntao Dai Peking University, Zhenghao Zhu, Sirui Han The Hong Kong University of Science and Technology
原文摘要
The advent of multi-modal large language models (MLLMs) has greatly advanced research on video fake news detection (VFND) tasks. Existing benchmarks typically focus on the detection accuracy, while failing to provide fine-grained assessments for the entire detection process. To address these limitations, we introduce POVFNDB (Process-oriented Video Fake News Detection Benchmark), a process-oriented benchmark comprising 10 tasks designed to systematically evaluate MLLMs’ perception, understanding, and reasoning capabilities in VFND. This benchmark contains 36,240 human-annotated question-answer (QA) in structured or open-ended formats, spanning 15 distinct evaluation dimensions that characterize different aspects of the video fake news detection process.Using POVFNDB, we conduct comprehensive evaluations on both proprietary and open-source MLLMs. Moreover, We fine-tune Qwen2.5VL-7B-Instruct on a reasoning dataset generated by our proposed POVFND-CoT, a chain-of-thought method that utilizes rationales from evaluation results and rationale validation. The resulting model achieves sota performance on VFND.
cs.CL · cs.CV
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · 2026 · 正式发表