Elements of Information Theory
My annotations of the book "Elements of Information Theory" (Cover & Thomas).
Open document ↗Annotated copy of Cover & Thomas, Elements of Information Theory — the source text behind the information theory notes that cite it.
Mentioned in
- Channel Capacity
- Data Compression and Source Coding
- Differential Entropy
- Entropy Rates of a Stochastic Process
- Information Theory and Statistics
- Information Theory in Gambling and Portfolios
- Information Theory Inequalities
- Information, Entropy, Relative Entropy, and Mutual Information
- Kolmogorov Complexity
- Maximum Entropy
- Network Information Theory
- Rate Distortion Theory
- The Asymptotic Equipartition Property
- The Gaussian Channel
- Universal Source Coding