The story
In July and October 1948 Claude Shannon, a mathematician and engineer at Bell Labs, published 'A Mathematical Theory of Communication' in the Bell System Technical Journal. The paper created a precise way to measure information. Its basic unit was the bit, short for binary digit, a single yes-or-no choice; Shannon credited the word to his colleague John Tukey. Any message, whether text, sound or pictures, could be represented as a string of bits, and the amount of information in a source could be measured by a quantity Shannon called entropy, roughly how unpredictable its messages are.
Shannon built on his own earlier work and on earlier engineers. His 1937 master's thesis had shown that electrical switching circuits could carry out Boolean logic, the algebra of true and false, which laid the groundwork for digital circuits. In the 1920s Harry Nyquist and Ralph Hartley at Bell Labs had studied how fast signals could be sent over telegraph and telephone lines. During World War II Shannon worked on cryptography and fire-control systems, problems about extracting a signal from noise and hiding it from enemies.
The paper proved two landmark results. First, messages can be compressed down to their entropy but no further: English text, which is highly predictable, can be squeezed far more than random noise. Second, every communication channel, whether a telephone wire, a radio link or later a fiber optic cable, has a maximum rate called its capacity. Below that rate, Shannon showed, clever coding can make errors as rare as you like, even over a noisy channel; above it, reliable communication is impossible. He proved such codes exist without showing how to build them, and engineers spent the next half century approaching his limit.
Shannon's ideas made the digital age possible. Every compressed file, from ZIP archives to MP3 music and streaming video, relies on his theory of compression, and every error-correcting code, used in CDs, mobile phones, Wi-Fi and spacecraft sending pictures across billions of kilometers, aims at his capacity limit. The theory also spread into biology, linguistics, physics and economics.
Why it mattered
- Packet switching and digital networks were designed with Shannon's framework for measuring and protecting information.
- Public-key cryptography and modern encryption build on Shannon's mathematical treatment of secrecy.
- Data compression formats such as JPEG and MP3 apply his theory of entropy.
- Error-correcting codes let deep-space probes, mobile phones and storage devices work reliably.
Sources
- A Mathematical Theory of Communication Bell System Technical Journal (Harvard-hosted PDF)
- Information theory Britannica
Drafted by AI (Claude) from the sources above and checked against them by AI; no historian has reviewed this page. Spot a mistake? Suggest a correction. How pages are made
Community notes
Loading notes…