MVST: A Multi-view Spatio-temporal Transformer for Skill-aware Tennis Stroke Recognition from Skeleton Sequences
Year: 2026
Type: article
Abstract: This paper proposes a Multi-View Spatio-Temporal Transformer (MVST) for skill-aware tennis stroke recognition from paired skeleton sequences.Estimating a player's skill level from movement patterns, beyond recognizing the performed action itself, remains a challenging problem in computer vision.A shared transformer encoder models spatial landmark relationships and temporal motion dynamics, while back-view and side-view representations are fused to reduce viewpoint ambiguity.A Cross-View Alignment (CVA) objective is introduced as an auxiliary contrastive loss that aligns view-level embeddings of the same stroke instance during training, with no inference overhead.On a self-collected dataset of eight subjects and 96 paired stroke instances, evaluated under a reproducible five-seed, four-fold subject-independent protocol, MVST with CVA achieves a final-epoch accuracy of 0.83, showing higher mean accuracy than ST-GCN, SkateFormer and SA-TDGFormer while achieving comparable performance to CTR-GCN with 2.4 times fewer parameters and 1.4 times fewer FLOPs.A leave-one-subject-out analysis achieves 0.85 skill-classification accuracy on subjects excluded from training, indicating that the learned representation can generalize to unseen subjects within this cohort.
Authors: Ibnu Asror(Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Validation, Visualization, Writing – original draft, Writing – review & editing), Maman Abdurohman(Conceptualization, Funding acquisition, Supervision, Validation, Writing – review & editing), Bayu Erfianto(Supervision, Validation, Writing – review & editing), Achmad Rizal(Supervision, Validation, Writing – review & editing)
Institution: Telkom University
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Funder: Universitas Telkom
OpenAlex ID: W7235732399
