Get started
Work

StyleMI: An Image Processing-Based Method for Detecting Unauthorized Style Mimicry in Fine-Tuned Diffusion Models in a More Realistic Scenario

Year: 2025
Type: article
Abstract: The rapid development of diffusion models and model fine-tuning methods have enabled widespread applications in artistic style mimicry while also leading to significant concerns about copyright infringement. Existing approaches protect artists from unauthorized style mimicry by introducing adversarial examples, watermarks, or membership inference attacks. However, the former two are vulnerable to image pre-processing and unable to be applied to published artworks, while the latter requires access to the target model, which is typically inaccessible in real-world scenarios. To this end, the task of detecting unauthorized style mimicry without access to the target model is formulated into a novel membership inference problem. The key insight is that images generated by a diffusion model inherently carry information of its training dataset. A style comparison-based method is proposed, which consists of a LoRA-based style transfer module and a CLIP-based style extraction and comparison module. The style transfer module first learns the artist’s artistic style, then removes the style of the given image to avoid its influence, and finally transfers the artist’s style to the given image. The style extraction and comparison module utilizes a diffusion model to extract the content information of an image and then remove it in a latent semantic space with the pre-trained CLIP model to acquire style-related features and compare them. Experiments on Stable Diffusion demonstrate the effectiveness of the proposed method. The best result achieved a True Positive Rate of 85%, a False Positive Rate of 0%, an Attack Success Rate of 99.29%, a Precision of 100%, and an Area Under the Curve of 1.
Source: IEEE Access
DOI: 10.1109/access.2025.3574053
Authors: Xinjun Zhang, Shixin Zuo, Yu Sang
Language: English
Open Access status: gold
Estimated APC paid: $2,075
OpenAlex ID: W4410770268
FWCI:
Cites: 33
Cited by:
Related to: 10