面向可解释深度伪造检测的指标对齐组相对策略优化
Metric-Aligned Group Relative Policy Optimization for Explainable Deepfake Detection
Luka Dragar, Peter Peer, Vitomir Štruc, Borut Batagelj
AI 速读 基于摘要
提出先预测后解释的解耦流程,并用指标对齐的GRPO优化解释器,以提升深度伪造检测的可解释性与评测表现。
cs.CV
查看原文摘要
Deepfake detectors are commonly evaluated on real/fake classification alone, but real-world applications require explanations of the visual evidence behind each prediction. Joint vision-language models struggle with authenticity assessment, producing "real" narratives for manipulated images. To address this, we propose a decoupled predict-then-explain pipeline as our submission to the ACM Multimedia 2026 Explainable Deepfake Detection Challenge, with methods trained and evaluated on the XPlainVerse benchmark. A vision-foundation-model ensemble first classifies the image, then a Qwen3-VL-8B model generates a decision-conditioned explanation of the visual evidence. For fake images, a second Qwen3-VL-8B compresses that text into a short non-expert summary without using the image. We further apply metric-aligned Group Relative Policy Optimization (GRPO) to optimize both explainers against the challenge criteria. Under matched conditions, GRPO raises complex BERTScore-F1 from 0.686 to 0.712 and also improves grounding (entity and evidence F1); our submission ranked first on complex BERTScore-F1 and seventh overall.