Work

A simpler derivation of the coding theorem

Year: 2012
Type: preprint
Abstract: A simple proof for the Shannon coding theorem, using only the Markov inequality, is presented. The technique is useful for didactic purposes, since it does not require many preliminaries and the information density and mutual information follow naturally in the proof. It may also be applicable to situations where typicality is not natural.
Institution: Tel Aviv University
Language: English
Open Access status: green
OpenAlex ID: W118811504
Cites: 7
Cited by: 4
Related to: 10