EE5143 Information Theory (Jul-Nov 2021)

Instructor

Srikrishna Bhashyam
Office: NAC1 343
Phone: 2257 4439

Course Content

• Entropy, Relative Entropy and Mutual Information
• The Asymptotic Equipartition Property
• Entropy Rate
• Data Compression
• Channel Capacity
• Differential Entropy
• The Gaussian Channel
• Information Theory and Statistics

Evaluation
Lecture Summary - 10%
Quiz 1 -- 20%
Quiz 2 -- 20%
Final -- 50%

References

[1] T. M. Cover, J. A. Thomas, "Elements of Information Theory," Second edition, John Wiley & Sons, 2006.
(First edition of this book is available as a low priced edition)