DAT: Dual-Aware Adaptive Transmission with Small-Large Model Collaboration for Edge-Cloud Anomaly Detection
Qi Guo, Zheming Yang, Yunqing Hu, Chang Zhao, Wen Ji
原文摘要
Continuous video anomaly detection is critical for timely safety monitoring in edge--cloud visual systems, but it remains challenging because abnormal events are sparse, transient, and require both low-latency anomaly detection and verifiable visual evidence. Multimodal large language models (MLLMs) offer strong semantic understanding and visual reasoning capabilities for such event-centric analysis, yet applying them to continuous video streams incurs prohibitive computation and communication overhead under bandwidth-constrained edge--cloud deployments. To address this challenge, we propose DAT, a dual-aware adaptive transmission framework that supports high-quality semantic generation, low-latency anomaly detection, and progressive visual evidence supplementation. DAT first uses a collaborative small--large model cascade, where a lightweight edge-side model filters non-target-event frames, performs object detection, and triggers MLLM inference only for suspicious frames. Building on this cascade, DAT introduces visual guidance and semantic prompting to improve structured event understanding, localization, and output consistency. It further schedules semantic anomaly alarms and visual evidence through a semantic- and bandwidth-aware multi-stream transmission optimization method. Experimental results show that DAT achieves 97.77\% F1 in traffic-accident detection while substantially reducing inference and communication overhead. On continuous video workloads, DAT lowers the MLLM call rate to 13.71\% and reduces upload volume by at least 95.72\% compared with representative edge--cloud baselines. Under severe congestion, DAT reduces weighted alarm delay by up to 87.9\%, demonstrating efficient MLLM-based anomaly detection under constrained edge--cloud networks.
cs.MM