Tag: Probability
-
Norbert Wiener on the Probability and Entropy of Information
Messages are themselves a form of pattern and organization. Indeed, it is possible to treat sets of messages as having entropy like sets of states in the external world. Just as entropy is a measure of the disorganization, the information carried by a set of messages is a measure of organization. In fact, it is…