EE511 Communication Theory (Jul-Nov 2007)


B. Srikrishna
Office: ESB 337A
Phone: 2257 4439

Course Content

Basic Probability: Various definitions of probability, axioms of probability, basic properties derived from the axioms, conditional probability, total probability, Bayes' rule, Independence of events, combined experiments and independence, binary communication channel example (MAP and ML decoding).

Random variables: Definition, cumulative distribution function (cdf), continuous, discrete and mixed random variables, probability density function (pdf), examples of random variables, physical interpretation of pdf's (histograms), multiple random variables, joint distribution - definition and properties, joint density - definition and properties, marginal distribution and density, conditional distribution and density, independence of random variables, expectations, moments, central moments, properties of expectation operator, mean, variance, Markov inequality, Chebyshev inequality, Chernoff bound, effect of linear transformations on mean and variance, autocorrelation, cross-correlation, covariance, Cauchy-Schwartz inequality, conditional expectation, characteristic function, cental limit theorem, transformations of single and multiple random variables, random vectors, properties of Gaussian random vectors.

Random processes: Definition, stationarity, mean, correlation and covariance, wide-sense stationary random processes, examples of random processes, cross-correlation functions, joint wide-sense stationarity, time averages and ergodicity, measuremen of mean and autocorrelation function, transmission of random process through a linear filter - relationship between input and output processes, power spectral density (PSD) - definition and proporties, examples, relationship between input and output process PSD for a linear filter, periodograms, cross spectral densities, Gaussian process - properties, white noise, noise equivalent bandwidth, narrowband noise, bandpass processes - representation, sampling.

Other topics (some of these will be covered depending on time available): Cyclostationary random processes, PAM signals, Baseband shaping (raised cosine), optimum transmitting and receiving filters for noise immunity, matched filtering, sampling and expansion of random processes.


Quiz I: September 14, 2007
Quiz II: October 19, 2007
Final exam: November 28, 2007


[1] A. Papoulis, S. U. Pillai, "Probability, Random Variables and Stochastic Processes", 4th edition, McGraw-Hill, 2002.
[2] R. M. Gray, L. D. Davisson, "An Introduction to Statistical Signal Processing," Cambridge University Press, 2004.
[3] H. Stark and J. W. Woods, "Probability and Random Processes with Applications to Signal Processing", 3rd edition, Pearson Education, 2002.
[4] Y. Viniotis, "Probability and Random Processes for Electrical Engineers", McGraw-Hill, 1998.
[5] S. Haykin, "Communication Systems", 4th edition, John Wiley & Sons, 2001.
[6] J. G. Proakis and M. Salehi, "Communication Systems Engineering", 2nd edition, Pearson Education, 2002.
[7] G. Grimmett, D. Stirzaker, "Probability and Random Processes," 3rd edition, Oxford Univ. Press, 2001.

Problem sets

Problem Set 1 Solution to Problem Set 1
Problem Set 2 Solution to Problem Set 2
Problem Set 3 Solution to Problem Set 3
Problem Set 4 Solution to Problem Set 4
Problem Set 5 Solution to Problem Set 5
Problem Set 6 Solution to Problem Set 6
Problem Set 7 Solution to Problem Set 7
Problem Set 8 Solution to Problem Set 8


Part 1
Part 2
Part 3