The course covers information measures, the source and the channel coding theorems, statistical inference ... It expects familiarity with undergraduate-level calculus, probability theory, and linear ...

Probabilistic measure of information. Introduction to compression algorithms including L-Z, MPEG, JPEG, and Huffman encoding. Determination of the information ...