Entropy of Information: How much information is in a coin flip, a gene, a photograph, a language? This book explains the quantity that answers all of them: entropy of information, Claude Shannon's 1948 measure of uncertainty in bits, and the theory built on it. Chapters build the formula from its four exact readings — average surprise, binary questions, shortest description, missing knowledge — then follow it through coding (compression floors and capacity ceilings that run every zip file and satellite link), cryptography, the physics bridge to thermodynamics (Maxwell's demon, Landauer's price of erasure), quantum en
How much information is in a coin flip, a gene, a photograph, a language? This book explains the quantity that answers all of them: entropy of information, Claude Shannon's 1948 measure of uncertainty in bits, and the theory built on it. Chapters build the formula from its four exact readings — average surprise, binary questions, shortest description, missing knowledge — then follow it through coding (compression floors and capacity ceilings that run every zip file and satellite link), cryptography, the physics bridge to thermodynamics (Maxwell's demon, Landauer's price of erasure), quantum en.
Space & Astronomy Starter Set: 5 books for S$6.90 →
Ko-fi PDFRead a free sampleListen on ElevenReader
Also on Payhip Ko-fi itch.io Fourthwall
Table of contents
- Introduction
- Chapter 1: The Discovery of Entropy of Information
- Chapter 2: Understanding Entropy of Information
- Chapter 3: Key Characteristics of Entropy of Information
- Chapter 4: The Science Behind Entropy of Information
- Chapter 5: Observation and Measurement of Entropy of Information
- Chapter 6: Important Features of Entropy of Information
- Chapter 7: Entropy of Information in Context
- Chapter 8: Modern Understanding of Entropy of Information
- Chapter 9: Research and Exploration of Entropy of Information
- Chapter 10: Significant Discoveries About Entropy of Information
- Chapter 11: Challenges and Mysteries of Entropy of Information
- Chapter 12: Future Directions in Entropy of Information Research
- Chapter 13: Fun Facts and Trivia About Entropy of Information
- Chapter 14: Conclusion: The Significance of Entropy of Information