文本感知、视觉盲区:多模态图像编辑系统如何处理不安全输入
Text-Aware, Vision-Blind: How Multimodal Image Editing Systems Handle Unsafe Inputs
Ziqing Yang, Yixin Wu, Michael Backes, Yang Zhang
AI 速读 基于摘要
作者构建 EditSafetyBench 基准,发现主流图像编辑系统存在系统性的文本-视觉安全错配:对不安全文本指令拒绝率高,但对携带风险的不安全图像拒绝率低。
cs.CR · cs.CV · cs.LG
查看原文摘要
Multimodal image generation systems have made rapid progress and increasingly emphasize content safety. However, their safety mechanisms tend to rely on a single modality and lack joint consideration of both visual content and text prompts, particularly in instruction-guided image editing, where the uploaded image may itself carry risk. We thus introduce EditSafetyBench, a benchmark that measures system-level safety awareness of advanced image editing systems, containing 5,940 image-instruction pairs, covering safe and unsafe images across 11 risk categories and three edit intents. We then probe the benchmark dataset on four systems, including Gemini, GPT, Qwen API, and Qwen Local. Based on our evaluation, we observe a systematic text-vision safety mismatch: Gemini and GPT refuse 87.1\% and 81.6\% cases containing unsafe-intent editing prompts, while only refusing 24.2\% and 22.4\% cases with both unsafe images and neutral instructions. At the category level, most risks are considered inconsistently by different systems, e.g., GPT allows 70.4\% editing attempts of unsafe political content while Gemini only allows 34.8\%. Notably, sexual content shows the strongest visual sensitivity, likely benefiting from mature NSFW identification works. Our findings highlight the need for safety guardrails that jointly reason over both visual and textual modalities in image editing systems.