Seeing Is No Longer Believing: Frontier Image Generation Models, Synthetic Visual Evidence, and Real-World Risk
Shuai Wu, Xue Li, Zhijun Wang, Bolun Liu, Weilin Cai, Zihao Su, Ran Wang
原文摘要
Image generation systems can produce plausible photographs, readable documents, and consistent depictions of people and places. Presented as records of real events, these outputs can influence decisions in news, finance, identity verification, medicine, and law. This narrative review examines public model documentation, incident reports, empirical studies, governance materials, and illustrative English and Chinese practitioner commentary available through 1 October 2026. We separate vendor capability claims, documented incidents, experimental findings, and prospective harm pathways. Realism, text rendering, reference consistency, conversational editing, search grounding, and low generation cost shape the conditions under which synthetic images acquire evidentiary weight. Documented episodes show how fabricated visuals enter public and institutional workflows, although public reporting cannot measure misuse prevalence for current releases. Comparing provider safeguards, provenance credentials, watermarks, platform labels, and statutory duties shows that origin signals do not verify a depicted event or transaction. Our framework matches artifact types and decision stakes to specific controls. Consequential decisions require authenticated source records, independent channel corroboration, and proportionate review before action.
cs.CL · cs.AI