2602.10549

Total: 1

#1 Enhancing Weakly Supervised Multimodal Video Anomaly Detection through Text Guidance [PDF2] [Copy] [Kimi] [REL]

Authors: Shengyang Sun, Jiashen Hua, Junyi Feng, Xiaojin Gong

Weakly supervised multimodal video anomaly detection has gained significant attention, yet the potential of the text modality remains under-explored. Text provides explicit semantic information that can enhance anomaly characterization and reduce false alarms. However, extracting effective text features is challenging due to the inability of general-purpose language models to capture anomaly-specific nuances and the scarcity of relevant descriptions. Furthermore, multimodal fusion often suffers from redundancy and imbalance. To address these issues, we propose a novel text-guided framework. First, we introduce an in-context learning-based multi-stage text augmentation mechanism to generate high-quality anomaly text samples for fine-tuning the text feature extractor. Second, we design a multi-scale bottleneck Transformer fusion module that uses compressed bottleneck tokens to progressively integrate information across modalities, mitigating redundancy and imbalance. Experiments on UCF-Crime and XD-Violence demonstrate state-of-the-art performance.

Subjects: Computer Vision and Pattern Recognition , Artificial Intelligence

Publish: 2026-02-11 05:44:30 UTC