Multimodal-SEA:多模态社会工程攻击下的AI智能体安全基准测试
Multimodal-SEA: Benchmarking AI Agent Security under Multimodal Social Engineering Attacks
Zhitao He, Chi Him Zhang, Chengru Han, Yi R Fung
AI 速读 基于摘要
作者提出一个包含608个专家设计任务的多模态社会工程攻击交互式基准,用于评估个人AI智能体的内在安全性,并报告七款多模态模型均存在被攻击风险。
cs.CL
查看原文摘要
Personal AI agents face social engineering attacks supported by forged multimodal content, but existing evaluations mainly focus on text-based dialogue, leaving their intrinsic security under such attacks insufficiently studied. We introduce Multimodal-SEA, an interactive benchmark comprising 608 expert-designed tasks grounded in real-world fraud cases, covering 14 domains and 152 attack scenarios with prepared multimodal content. The tasks span four difficulty levels and reflect the distinct social and cultural contexts of Chinese and English environments. Agents inspect content, verify requests, and execute actions in simulated applications, with attack outcomes grounded in verifiable tool execution logs. To enable controlled red teaming of personal agents, we design a multimodal attack harness that integrates task information, attack progression control, and multimodal content construction to evaluate their intrinsic security against adaptive social engineering attacks in simulated environments. Evaluating seven widely used multimodal models across six dimensions reveals that all are vulnerable, with attack success rates of 7.1% to 34.5%. Adding multimodal content increases attack success from 19.9% to 29.2%, despite increased proactive verification coverage. Stronger safety instructions reduce attack success without improving recognition of deceptive multimodal content, while lower attack success rates for some models accompany excessive refusal of legitimate requests.