Information theory, pattern recognition, and neural networks



1  Noisy-channel coding
 Source coding (Data compression)
2  Information content, entropy
3  Typicality and the source coding theorem
4  Symbol codes

 www.inference.phy.cam.ac.uk/itprnn/