**Instructor**

Srikrishna Bhashyam

Office: ESB 212D

Phone: 2257 4439

**Class Timings**

Mondays 12-12.50pm, Thursdays 10-10.50am, and Fridays 9-9.50am: in ESB350

**Course Content**

- Entropy, Relative Entropy and Mutual Information
- The Asymptotic Equipartition Property
- Entropy Rate
- Data Compression
- Channel Capacity
- Differential Entropy
- The Gaussian Channel
- Parallel Gaussian Channels

**Evaluation**

Quiz 1 -- Feb 28, 2013 (20%)

Quiz 2 -- Apr 8, 2013 (20%)

Final -- May 10, 2013 (60%)

**Assignments**

- Problem Set 1
- Solutions to Problem Set 1
- Problem Set 2
- Solutions to Problem Set 2
- Problem Set 3
- Solutions to Problem Set 3
- Problem Set 4
- Solutions to Problem Set 4
- Problem Set 5
- Solutions to Problem Set 5
- Problem Set 6
- Solutions to Problem Set 6
- Problem Set 7
- Solutions to Problem Set 7
- Problem Set 8
- Solutions to Problem Set 8

**References**

[1] T. M. Cover, J. A. Thomas, "Elements of Information Theory," Second
edition, John Wiley & Sons, 2006.

(First edition of this book is available as a low priced edition)