Lecture 16: Data Compression and Shannon’s Noiseless Coding Theorem

Om kurset

We start with the history of data compression. We define a first-order source, and what it means to compress it. We define entropy. We then state and prove Shannon’s noiseless coding theorem, which gives the optimal compression ratio a first-order source.