Work

MFKP-VVTO: Mask-Free Video Virtual Try-On via Keyframe Guidance

Year: 2026
Type: preprint
Abstract: Video virtual try-on aims to accurately transfer a target garment image onto a person in a video, generating try-on results that seamlessly align with human poses and dynamic motion. However, existing methods rely heavily on mask priors, generalize poorly, suffer from unstable temporal semantics, and lack authentic paired training data. Consequently, they yield suboptimal generation performance in challenging scenarios involving crossed limbs, large-scale pose variations, and self-occlusions. To address these limitations, we propose a keyframe-guided mask-free video virtual try-on framework, termed MFKP-VVTO. The proposed method comprises modules for pseudo-pair construction, dual-metric adaptive keyframe sampling (DA-KFS), mask-free keyframe try-on, and keyframe-guided video generation. Specifically, we leverage the pre-trained ViViD model to construct pseudo-paired samples, effectively alleviating the scarcity of real annotated data. DA-KFS integrates weighted joint distances and pose feature similarities to select representative keyframes, capturing global motion through sparse anchor frames. Furthermore, we design a mask-free try-on module built on SD-UNet to fuse dual-modal representations from CLIP and Qwen-VL and characterize garment textures and structures. We also introduce an inter-keyframe garment consistency loss that acts strictly as a regional constraint during training and does not participate in forward inference, thereby satisfying the mask-free inference requirement. Finally, the high-quality keyframe try-on results serve as temporal conditions to steer the video diffusion model, facilitating inter-frame semantic propagation. Extensive experiments on the ViViD, VVT, VITON-HD, and DressCode datasets show that MFKP-VVTO outperforms competitive baselines in occlusion and complex motion scenarios, demonstrating superior generalization and temporal coherence and providing an effective solution for mask-free video virtual try-on under complex dynamic conditions.
Language: English
Open Access status: green
OpenAlex ID: W7236663409
Cites: 38
Cited by:
Related to: 10