information theory
Introduction
information theory or communication theory, mathematical theory formulated principally by the American scientist Claude E. Shannon to explain aspects and problems of information and communication. While the theory is not specific in all respects, it proves the existence of optimum coding schemes without showing how to find them. For example, it succeeds remarkably in outlining the engineering requirements of communication systems and the limitations of such systems.
In information theory, the term information is used in a special sense; it is a measure of the freedom of choice with which a message is selected from the set of all possible messages. Information is thus distinct from meaning, since it is entirely possible for a string of nonsense words and a meaningful sentence to be equivalent with respect to information content.
Sections in this article:
- Introduction
- Measurement of Information Content
- Analysis of the Transfer of Messages through Channels
- Bibliography
The Columbia Electronic Encyclopedia, 6th ed. Copyright © 2012, Columbia University Press. All rights reserved.
See more Encyclopedia articles on: Computers and Computing
Browse by Subject
- Earth and the Environment +-
- History +-
- Literature and the Arts +-
- Medicine +-
- People +-
- Philosophy and Religion +-
- Places +-
- Africa
- Asia
- Australia and Oceania
- Britain, Ireland, France, and the Low Countries
- Commonwealth of Independent States and the Baltic Nations
- Germany, Scandinavia, and Central Europe
- Latin America and the Caribbean
- Oceans, Continents, and Polar Regions
- Spain, Portugal, Italy, Greece, and the Balkans
- United States, Canada, and Greenland
- Plants and Animals +-
- Science and Technology +-
- Social Sciences and the Law +-
- Sports and Everyday Life +-