← 研踪 PaperTrailarXiv:2604.05375 · v2
DAT: Dual-Aware Adaptive Transmission with Small-Large Model Collaboration for Edge-Cloud Anomaly Detection
首次提交 2026-04-07 11:21
版本更新 2026-11-17 23:46
雷达观测 2026-11-18 16:38
摘要
Continuous video anomaly detection is critical for timely safety monitoring in edge--cloud visual systems, but it remains challenging because abnormal events are sparse, transient, and require both low-latency anomaly detection and verifiable visual evidence. Multimodal large language models (MLLMs) offer strong semantic understanding and visual reasoning capabilities for such event-centric analysis, yet applying them to continuous video streams incurs prohibitive computation and communication overhead under bandwidth-constrained edge--cloud deployments. To address this challenge, we propose DAT, a dual-aware adaptive transmission framework that supports high-quality semantic generation, low-latency anomaly detection, and progressive visual evidence supplementation. DAT first uses a collaborative small--large model cascade, where a lightweight edge-side model filters non-target-event frames, performs object detection, and triggers MLLM inference only for suspicious frames. Building on this cascade, DAT introduces visual guidance and semantic prompting to improve structured event understanding, localization, and output consistency. It further schedules semantic anomaly alarms and visual evidence through a semantic- and bandwidth-aware multi-stream transmission optimization method. Experimental results show that DAT achieves 97.77\% F1 in traffic-accident detection while substantially reducing inference and communication overhead. On continuous video workloads, DAT lowers the MLLM call rate to 13.71\% and reduces upload volume by at least 95.72\% compared with representative edge--cloud baselines. Under severe congestion, DAT reduces weighted alarm delay by up to 87.9\%, demonstrating efficient MLLM-based anomaly detection under constrained edge--cloud networks.
作者备注:9 pages, 7 figures. Submitted to AAAI 2027
观测到的版本
相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。
v2 · 2026-11-17 23:46 · 最新观测版本
DAT: Dual-Aware Adaptive Transmission with Small-Large Model Collaboration for Edge-Cloud Anomaly Detection
Continuous video anomaly detection is critical for timely safety monitoring in edge--cloud visual systems, but it remains challenging because abnormal events are sparse, transient, and require both low-latency anomaly detection and verifiable visual evidence. Multimodal large language models (MLLMs) offer strong semantic understanding and visual reasoning capabilities for such event-centric analysis, yet applying them to continuous video streams incurs prohibitive computation and communication overhead under bandwidth-constrained edge--cloud deployments. To address this challenge, we propose DAT, a dual-aware adaptive transmission framework that supports high-quality semantic generation, low-latency anomaly detection, and progressive visual evidence supplementation. DAT first uses a collaborative small--large model cascade, where a lightweight edge-side model filters non-target-event frames, performs object detection, and triggers MLLM inference only for suspicious frames. Building on this cascade, DAT introduces visual guidance and semantic prompting to improve structured event understanding, localization, and output consistency. It further schedules semantic anomaly alarms and visual evidence through a semantic- and bandwidth-aware multi-stream transmission optimization method. Experimental results show that DAT achieves 97.77\% F1 in traffic-accident detection while substantially reducing inference and communication overhead. On continuous video workloads, DAT lowers the MLLM call rate to 13.71\% and reduces upload volume by at least 95.72\% compared with representative edge--cloud baselines. Under severe congestion, DAT reduces weighted alarm delay by up to 87.9\%, demonstrating efficient MLLM-based anomaly detection under constrained edge--cloud networks.
查看此版本解读 →查看此版本原文 ↗