Ebook: Coding Theorems of Information Theory

The objective of the present edition of this monograph is the same as that of earlier editions, namely, to provide readers with some mathemati­ cal maturity a rigorous and modern introduction to the ideas and principal theorems of probabilistic information theory. It is not necessary that readers have any prior knowledge whatever of information theory. The rapid development of the subject has had the consequence that any one book can now cover only a fraction of the literature. The latter is often written by engineers for engineers, and the mathematical reader may have some difficulty with it. The mathematician who understands the content and methods of this monograph should be able to read the literature and start on research of his own in a subject of mathematical beauty and interest. The present edition differs from the second in the following: Chapter 6 has been completely replaced by one on arbitrarily varying channels. Chapter 7 has been greatly enlarged. Chapter 8 on semi-continuous channels has been drastically shortened, and Chapter 11 on sequential decoding completely removed. The new Chapters 11-15 consist entirely of material which has been developed only in the last few years. The topics discussed are rate distortion, source coding, multiple access channels, and degraded broadcast channels. Even the specialist will find a new approach in the treatment of these subjects. Many of the proofs are new, more perspicuous, and considerably shorter than the original ones.

---

---

Content:
Front Matter....Pages I-XI
Heuristic Introduction to the Discrete Memoryless Channel....Pages 1-5
Combinatorial Preliminaries....Pages 6-14
The Discrete Memoryless Channel....Pages 14-33
Compound Channels....Pages 33-52
The Discrete Finite-Memory Channel....Pages 52-61
Channels with Arbitrarily Varying Channel Probability Functions....Pages 62-76
General Discrete Channels....Pages 76-104
The Semi-Continuous Memoryless Channel....Pages 104-109
Continuous Channels with Additive Gaussian Noise....Pages 109-117
Mathematical Miscellanea....Pages 118-124
Fundamentals of Rate Distortion Theory....Pages 125-133
Source Coding....Pages 134-144
Source Coding and Rate Distortion....Pages 145-155
Multiple Access Channels....Pages 155-160
Degraded Broadcast Channels....Pages 161-170
Back Matter....Pages 171-176

---

Content:
Front Matter....Pages I-XI
Heuristic Introduction to the Discrete Memoryless Channel....Pages 1-5
Combinatorial Preliminaries....Pages 6-14
The Discrete Memoryless Channel....Pages 14-33
Compound Channels....Pages 33-52
The Discrete Finite-Memory Channel....Pages 52-61
Channels with Arbitrarily Varying Channel Probability Functions....Pages 62-76
General Discrete Channels....Pages 76-104
The Semi-Continuous Memoryless Channel....Pages 104-109
Continuous Channels with Additive Gaussian Noise....Pages 109-117
Mathematical Miscellanea....Pages 118-124
Fundamentals of Rate Distortion Theory....Pages 125-133
Source Coding....Pages 134-144
Source Coding and Rate Distortion....Pages 145-155
Multiple Access Channels....Pages 155-160
Degraded Broadcast Channels....Pages 161-170
Back Matter....Pages 171-176
....