← 研踪 PaperTrailarXiv:2609.07369 · v2
DF26: We Cannot Tell Fake From Real Anymore
首次提交 2026-09-07 19:44
版本更新 2026-11-19 19:32
雷达观测 2026-11-20 16:53
摘要
We introduce DF26, a novel benchmark for detecting AI-generated videos containing fully synthetic clips produced by recent text-to-video and image-to-video models. The videos capture single-person public-speaking scenarios, spanning direct-to-camera recordings, official statements, and studio interviews - 271 real and 2,420 synthetic videos generated by seven modern video models. The study on DF26 shows that human accuracy in detecting AI-generated videos is 52.6% while recognizing 76.0% of real ones, and that state-of-the-art deepfake detectors, using the current evaluation setup, perform close to random chance. Our results highlight the limitations of current evaluation protocols and motivate the need for benchmarks that explicitly measure robustness to modern generative model distribution shifts. DF26 can be accessed at https://huggingface.co/datasets/DF26/DF26
观测到的版本
相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。
v2 · 2026-11-19 19:32 · 最新观测版本
DF26: We Cannot Tell Fake From Real Anymore
We introduce DF26, a novel benchmark for detecting AI-generated videos containing fully synthetic clips produced by recent text-to-video and image-to-video models. The videos capture single-person public-speaking scenarios, spanning direct-to-camera recordings, official statements, and studio interviews - 271 real and 2,420 synthetic videos generated by seven modern video models. The study on DF26 shows that human accuracy in detecting AI-generated videos is 52.6% while recognizing 76.0% of real ones, and that state-of-the-art deepfake detectors, using the current evaluation setup, perform close to random chance. Our results highlight the limitations of current evaluation protocols and motivate the need for benchmarks that explicitly measure robustness to modern generative model distribution shifts. DF26 can be accessed at https://huggingface.co/datasets/DF26/DF26
查看此版本解读 →查看此版本原文 ↗