2507.09512

Total: 1

#1 Online Micro-gesture Recognition Using Data Augmentation and Spatial-Temporal Attention [PDF1] [Copy] [Kimi] [REL]

Authors: Pengyu Liu, Kun Li, Fei Wang, Yanyan Wei, Junhui She, Dan Guo

In this paper, we introduce the latest solution developed by our team, HFUT-VUT, for the Micro-gesture Online Recognition track of the IJCAI 2025 MiGA Challenge. The Micro-gesture Online Recognition task is a highly challenging problem that aims to locate the temporal positions and recognize the categories of multiple micro-gesture instances in untrimmed videos. Compared to traditional temporal action detection, this task places greater emphasis on distinguishing between micro-gesture categories and precisely identifying the start and end times of each instance. Moreover, micro-gestures are typically spontaneous human actions, with greater differences than those found in other human actions. To address these challenges, we propose hand-crafted data augmentation and spatial-temporal attention to enhance the model's ability to classify and localize micro-gestures more accurately. Our solution achieved an F1 score of 38.03, outperforming the previous state-of-the-art by 37.9%. As a result, our method ranked first in the Micro-gesture Online Recognition track.

Subject: Computer Vision and Pattern Recognition

Publish: 2025-07-13 06:38:17 UTC