Order, Disorder and Entropy

It is commonly said that the magnitude of the entropy measures the disorder in a system, and that the tendency of the entropy to increase is the same as the tendency for increasing disorder. These concepts and relationships take on a more definite and quantitative character within information theory, which is related in this way to thermodynamics. Here we exemplify only a few of these concepts in connection with the simple paramagnetic model, without giving detailed definitions and without entering into a formal discussion…