Surveillance Video Anomaly Detection via Automatic Caption Generation Using Multimodal Large Language Models
Year: 2025
Type: article
Abstract: Recently, state-of-the-art performance in video anomaly detection has been achieved by fine-tuning multimodal large language models (MLLM). However, the necessity of extensive caption annotations in training data imposes significant practical constraints. To overcome this limitation, we propose a novel MLLM-based video anomaly detection method that does not require manual caption annotation. The proposed method consists of an anomaly detection model for identifying and selecting key video samples, and an MLLM that autonomously generates and enhances captions to explain anomalous events. Extensive experiments demonstrate that our method achieves high detection accuracy and generates task-specific explanatory descriptions effectively.
Authors: Satoshi HASHIMOTO, Hitoshi NISHIMURA, Mori KUROKAWA
Institutions: KDDI Research (Japan), KDDI (Japan)
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: bronze
OpenAlex ID: W4417010403