Year: 2010
Type: article
Abstract: The entropy of an ergodic source is the limit of properly rescaled one-block entropies of sources obtained applying successive non-sequential recursive pair substitutions (NSRPS). In this paper we prove that the cross-entropy and the Kullback–Leibler divergence can be obtained in a similar way.
Authors: D Benedetto, E Caglioti, G Cristadoro, M Degli Esposti
Institutions: Sapienza University of Rome, University of Bologna
Language: English
Subfield: Mathematical Physics
Field: Mathematics
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W2079983103