Algorithmic entropy

The following sections are included:

• Information theory entropy

  • Probability

  • Shannon information and entropy

  • Jaynes' principle

  • Information theory based scenarios for entropy increase

• Algorithmic probability

• Symbolic dynamics and metric entropy

• Metric entropy and Lyapunov exponents

• Algorithmic information based scenarios for entropy increase

  • “Creation” of algorithmic information by infinite computations

  • “Creation” of algorithmic information by uncomputable processes

  • “Unfolding” of the algorithmic information content of the initial value

  • Uncomputability of algorithmic information theory entropy