Concentration theorems for entropy and free energy

V. V. V'yugin, V. P. Maslov

Research output: Contribution to journalArticlepeer-review

8 Citations (Scopus)


Jaynes's entropy concentration theorem states that, for most words ω1...ωN of length N such that ∑i=1N f(ωi) ≈ vN, empirical frequencies of values of a function f are close to the probabilities that maximize the Shannon entropy given a value v of the mathematical expectation of f. Using the notion of algorithmic entropy, we define the notions of entropy for the Bose and Fermi statistical models of unordered data. New variants of Jaynes's concentration theorem for these models are proved. We also present some concentration properties for free energy in the case of a nonisolated isothermal system. Exact relations for the algorithmic entropy and free energy at extreme points are obtained. These relations are used to obtain tight bounds on fluctuations of energy levels at equilibrium points.

Original languageEnglish
Pages (from-to)134-149
Number of pages16
JournalProblems of information transmission
Issue number2
Publication statusPublished - Apr 2005
Externally publishedYes


Dive into the research topics of 'Concentration theorems for entropy and free energy'. Together they form a unique fingerprint.

Cite this