**Instructor**

Srikrishna Bhashyam

Office: NAC1 343

Phone: 2257 4439

**Course Content**

- Entropy, Relative Entropy and Mutual Information
- The Asymptotic Equipartition Property
- Entropy Rate
- Data Compression
- Channel Capacity
- Differential Entropy
- The Gaussian Channel
- Information Theory and Statistics

**Evaluation**

Lecture Summary - 10%

Quiz 1 -- 20%

Quiz 2 -- 20%

Final -- 50%

**References**

[1] T. M. Cover, J. A. Thomas, "Elements of Information Theory," Second
edition, John Wiley & Sons, 2006.

(First edition of this book is available as a low priced edition)