Work

Entropy and Its Discontents: A Note on Definitions

Year: 2014
Type: article
Abstract: The routine definitions of Shannon entropy for both discrete and continuous probability laws show inconsistencies that make them not reciprocally coherent. We propose a few possible modifications of these quantities so that: (1) they no longer show incongruities; and (2) they go one into the other in a suitable limit as the result of a renormalization. The properties of the new quantities would slightly differ from that of the usual entropies in a few other respects.
Source: Entropy
Language: English
Open Access status: gold
Estimated APC paid: $3,137
OpenAlex ID: W2026384642
FWCI: 0.434
Cites: 9
Cited by: 4
Related to: 10