Work

Linearly Transformed Color Guide for Low-Bitrate Diffusion-Based Image Compression

Year: 2024

Type: article

Abstract: This study addresses the challenge of controlling the global color aspect of images generated by a diffusion model without training or fine-tuning. We rewrite the guidance equations to ensure that the outputs are closer to a known color map, without compromising the quality of the generation. Our method results in new guidance equations. In the context of color guidance, we show that the scaling of the guidance should not decrease but rather increase throughout the diffusion process. In a second contribution, our guidance is applied in a compression framework, where we combine both semantic and general color information of the image to decode at very low cost. We show that our method is effective in improving the fidelity and realism of compressed images at extremely low bit rates ($10^{-2}$bpp), performing better on these criteria when compared to other classical or more semantically oriented approaches. The implementation of our method is available on gitlab athttps://gitlab.inria.fr/tbordin/color-guidance.

Source: IEEE Transactions on Image Processing

DOI: 10.1109/tip.2024.3521301

Authors: Tom Bordin, Thomas Maugey

Institutions: Institut national de recherche en sciences et technologies du numérique, Centre Inria de l'Université de Rennes

Language: English

Topic: Generative Adversarial Networks and Image Synthesis

Subfield: Computer Vision and Pattern Recognition

Field: Computer Science

Domain: Physical Sciences

Open Access status: green

Funder: Agence Nationale de la Recherche

Award: MAssive Multimedia DAta collection REpurposing