Dashboard

Now you are in the subtree of Lecture Notes public knowledge tree. 

[SCI] Statistical Mechanics

Statistical Mechanics connects the microscopic behaviour of atoms and molecules to the macroscopic thermodynamic quantities of temperature, pressure, and entropy.

Overview

Ludwig Boltzmann (1872–1877) derived the kinetic theory of gases, proved the H-theorem (entropy increase), and defined entropy as S = k_B log W — the logarithm of the number of accessible microstates. Josiah Willard Gibbs (1902) developed ensemble theory, giving a rigorous framework for systems in thermal equilibrium. The Boltzmann/Gibbs entropy S = −k_B Σ pᵢ log pᵢ is mathematically identical to Shannon's information entropy, a connection that proved profound.

Statistical mechanics explains phase transitions, chemical equilibria, the third law of thermodynamics, and the foundations of the kinetic theory of gases.

Key Figures & Recognition

  • Ludwig Boltzmann (1844–1906): Boltzmann equation, entropy formula. No Nobel (predates prize; died by suicide, partly due to opposition from positivists).
  • J. W. Gibbs (1839–1903): Elementary Principles in Statistical Mechanics, 1902.
  • Max Planck (1858–1947): Applied statistical mechanics to blackbody radiation. Nobel Prize 1918.

Seminal Papers

  • Boltzmann, L. "Weitere Studien über das Wärmegleichgewicht unter Gasmolekülen." Wien. Ber. 66 (1872).
  • Gibbs, J.W. Elementary Principles in Statistical Mechanics. Yale University Press, 1902.

What This Enables

  • [SCI] Blackbody Radiation & Planck's Law — Planck derived the correct radiation spectrum by applying statistical mechanics to quantised EM field modes.
  • [SCI] Theory of Metals — Fermi-Dirac statistics applied to the electron gas explain electrical and thermal conductivity in metals.
  • [SCI] Information Theory — Shannon's entropy H = −Σpᵢ log pᵢ is mathematically identical to Boltzmann's entropy — same formula, independently derived.
  • [TECH] Chemical Industry — Partition functions, free-energy landscapes, and rate theory underpin catalyst design and process optimisation.
  • [SCI] Machine Learning Theory — Probability distributions, maximum likelihood, Boltzmann machines, and mean-field approximations in ML are statistical mechanics concepts.

Discovery Character

Surprise level: High — The claim that macroscopic irreversibility (entropy) emerges from reversible microscopic dynamics was paradoxical and bitterly contested. Boltzmann faced fierce opposition from positivists who denied atoms existed; he died by suicide in 1906, his work unrecognised in his lifetime.

Mode: Systematic-theoretical with philosophical struggle. Boltzmann's H-theorem and entropy formula S = k log W were derived systematically, but the conceptual leap — entropy as disorder, the statistical arrow of time — was radical. The identical formula reappearing in Shannon's information theory 70 years later in a completely different domain suggests the result is about something deeper than either physicist intended.