Year: 2025
Type: article
Abstract: ABSTRACT Although Transformer‐based image restoration methods have demonstrated impressive performance, existing Transformers still insufficiently exploit multiscale information. Previous non‐Transformer‐based studies have shown that incorporating multiscale features is crucial for improving restoration results. In this paper, we propose a multiscale Transformer (MST) that captures cross‐scale attention among tokens, thereby effectively leveraging the multiscale patch recurrence prior of natural images. Furthermore, we introduce a channel‐gate feed‐forward network (CGFN) to enhance inter‐channel information aggregation and reduce channel redundancy. To simultaneously utilise global, local and multiscale features, we design a multitype feature integration block (MFIB). Extensive experiments on both image super‐resolution and HEVC compressed video artefact reduction demonstrate that the proposed MST achieves state‐of‐the‐art performance. Ablation studies further verify the effectiveness of each proposed module.
DOI: 10.1049/cit2.70079
Authors: Wuzhen Shi, Youwei Pan, Chun Zhao, Yuqing Liu, Shaobo Zhang, Heng Zhang, Yang Wen
Institutions: Shenzhen University, Xiaomi (China)
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $2,760
OpenAlex ID: W4416540841