Information theory

Side information

Code length

Output length

Collision rate

Mutual information

Sharpness

Round-trip integrity

Filter load

Predictive information

entropy reduction

Claude Elwood Shannon: Collected Papers

The Mathematical Theory of Communication

Shannon's sampling theorem

Nyquist rate

One-time pad

Perfect secrecy

Unicity distance

Communication Theory of Secrecy Systems

Quantum information

Huffman coding

Shannon–Fano coding

Error-correcting codes

Channel capacity

Channel coding theorem

Data compression

Source coding theorem

Shannon entropy

Bit

Information theory