Year: 2003
Type: article
Abstract: We apply statistical mechanics to an inverse problem of linear mapping to investigate the physics of the irreversible compression. We use the replica symmetry breaking (RSB) technique with a toy model to demonstrate the Shannon result. The rate distortion function, which is widely known as the theoretical limit of the compression with a fidelity criterion, is derived using the Parisi one step RSB scheme. The bound cannot be achieved in the sparsely-connected systems, where suboptimal solutions dominate the capacity.
Authors: Tatsuto Murayama, Masato Okada
Institutions: RIKEN Center for Brain Science, RIKEN
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: bronze
Funder: RIKEN
OpenAlex ID: W2002504600