EE5143 Information Theory (Jan-May 2025)

Instructor

Srikrishna Bhashyam
Office: ESB2 405
Phone: 2257 4439

Class Timings

E Slot
Tuesday 11.00-11.50 am
Wednesday 10.00-10.50 am
Thursday 08.00-08.50 am

Course Content

• Entropy, Relative Entropy and Mutual Information
• The Asymptotic Equipartition Property
• Entropy Rate
• Data Compression
• Channel Capacity
• Differential Entropy
• The Gaussian Channel

Evaluation
Quiz 1 -- 20%
Quiz 2 -- 20%
Lecture Summary/Assignment -- 10%
Final -- 50%

References

[1] T. M. Cover, J. A. Thomas, "Elements of Information Theory," Second edition, John Wiley & Sons, 2006.
(First edition of this book is available as a low priced edition)