The Ising model

Spins on a lattice point up or down, and neighbors prefer to align. That is all, yet below a critical temperature Tc a magnetization appears spontaneously, without any external field. Explore the model directly, compute its thermodynamics exactly for small lattices, compare it with non-interacting spins, and measure the quantities of interest near the critical point.

Based on lecture notes by Sang Hoon Lee for Chapter 2 (part 1), following K. Christensen and N. R. Moloney, Complexity and Criticality (2005). Units: kB = 1 and J = 1, so temperatures and fields are in units of J. References

Up spins are white and down spins are black, as in the lecture notes. Periodic boundaries.

T/Tc =
Tc
Temperature T (in units of J/kB)
–
Magnetization per spin m
–
Time average of |m|
–
Onsager’s m0(T) for an infinite lattice
–
Energy per spin ε
–
Sweeps since the last change
–
Magnetization per spin over timeBelow Tc a small lattice flips now and then between +m and −m (dashed: Onsager’s ±m0); a large one stays put.
Distribution of m over timeOne peak at m = 0 above Tc, two peaks at ±m0 below it, and a broad distribution at Tc.
Spin–spin correlation function g(r) of this latticeg(r) = ⟨sisi+r⟩ − ⟨|m|⟩², averaged over time along both axes. Log–log; dashed: r−(d−2+η) = r−1/4, the decay at Tc.

Defining the Ising model

Every site i of a lattice carries a spin si = +1 or −1, like a magnetic dipole that can point only along one axis. A pair of neighboring spins has energy −J when parallel and +J when antiparallel, and a uniform external field H adds −H for each spin along it and +H for each against it:

E{si} = −J Σ⟨ij⟩ sisj − H Σi si

The first sum runs over distinct nearest-neighbor pairs. For J > 0 parallel spins are favored, a ferromagnet; for J < 0 antiparallel ones, an antiferromagnet. Click spins below to flip them. Even this 5 × 5 lattice has 225 = 33 554 432 microstates, while a macrostate such as “14 up and 11 down” lumps many of them together.

Free boundaries, 40 nearest-neighbor pairs. Blue bonds lower the energy and red bonds raise it: for J > 0 blue joins parallel spins, for J < 0 antiparallel ones.

Coupling
sisjConfigurationInteraction energy −J sisj
+1+1↑ ↑−J
−1−1↓ ↓−J
+1−1↑ ↓+J
−1+1↓ ↑+J

The interest is in how the model behaves as the temperature changes. When kBT ≪ J the interactions dominate and spins align to lower the energy; when kBT ≫ J they are effectively independent and point up and down at random, maximizing the entropy. Between these limits a high-temperature disordered (paramagnetic) phase gives way to a low-temperature ordered (ferromagnetic) phase. Try the temperature presets at the top: the lattice looks random at 4Tc, grows ever larger domains on the way down, is a fractal of droplets within droplets at Tc, and is almost fully aligned at 0.7Tc.

Statistical mechanics by exact enumeration

In the canonical ensemble, a system in contact with a heat reservoir at temperature T is found in microstate {si} with probability P = e−βE/Z, with β = 1/kBT. Every observable is an ensemble average, and everything follows from the partition function and the free energy:

Z(T, H) = Σ{si} e−βE{si}, F = ⟨E⟩ − TS = −kBT ln Z

Per spin: m = −(∂f/∂H)T, ε = −(1/N)(∂ ln Z/∂β)H, S/N = (ε − f)/T, and the response functions are second derivatives, χ = (∂m/∂H)T and c = (∂ε/∂T)H. Differentiating Z once more gives the fluctuation–dissipation relations kBTχ = (⟨M²⟩ − ⟨M⟩²)/N and kBT²c = (⟨E²⟩ − ⟨E⟩²)/N: the response to a small push equals the size of the spontaneous fluctuations. For a small periodic lattice the page sums over every microstate exactly and checks both relations.

Interaction
Magnetization m(T) at the chosen HBlue: ⟨m⟩. Light: ⟨|m|⟩. Dashed: non-interacting spins, tanh(H/T). Exact for this finite lattice, so smooth everywhere.
Susceptibility χ(T): response equals fluctuationLine: χ = ∂m/∂H, a numerical derivative. Dots: (⟨M²⟩ − ⟨M⟩²)/(N kBT).
Specific heat c(T): response equals fluctuationLine: c = ∂ε/∂T. Dots: (⟨E²⟩ − ⟨E⟩²)/(N kBT²).
Free energy, energy and entropy per spinf = −T ln Z/N, ε, and S/N = (ε − f)/T, which rises to ln 2 (dotted) when the spins become random.
Magnetization m(H) at the chosen TBlue: this lattice. Dashed: tanh(H/T). Interactions make the response steeper.
Probability of each total magnetization MAt the chosen T and H. At H = 0 it is always symmetric, so ⟨M⟩ = 0 exactly; a small field tips it to one side.
QuantityRelationResponse function
Partition functionZ = Σ{si} e−βE{si}
Free energy per spinf = −(1/N) kBT ln Z
Magnetization per spinm = −(∂f/∂H)Tχ = (∂m/∂H)T = −(∂²f/∂H²)T
Energy per spinε = −(1/N)(∂ ln Z/∂β)H = f − T(∂f/∂T)Hc = (∂ε/∂T)H = −T(∂²f/∂T²)H
Entropy per spinS/N = −(∂f/∂T)H = (ε − f)/T

With 2N terms, Z is a finite sum of analytic functions, so f is analytic and nothing can be singular: no finite system has a phase transition. Only in the thermodynamic limit N → ∞, where boundary effects vanish and f → Fbulk/N, can derivatives of f become discontinuous or diverge.

Non-interacting spins

With J = 0 the partition function factorizes into N identical terms, and everything is exact:

Z = [2 cosh(βH)]N, f = −kBT ln[2 cosh(H/kBT)], m = tanh(H/kBT), χ = β sech²(βH)

Only the ratio H/kBT matters. When it is small the entropy wins and spins point at random; when it is large the energy wins and all spins follow the field. f is analytic for every T and H, and at H = 0 the magnetization is zero for any T > 0: there is no spontaneous magnetization and no phase transition, because a transition is a cooperative phenomenon that needs interactions. The energy is ε = −H tanh(βH) and the specific heat c = (H/kBT)² sech²(βH), a Schottky peak.

m(H) = tanh(H/T)For T = 0.02 (blue), 0.5 (green), 1 (orange) and 2 (pink). As T → 0 it becomes a step: m = ±1 for H → 0±.
χ(H) = β sech²(βH)For T = 0.5 (green), 1 (orange) and 2 (pink). At H = 0, χ = 1/T, which diverges only as T → 0.
Energy ε(T) and specific heat c(T) at the chosen Hε = −H tanh(H/T) (blue) and c = (H/T)² sech²(H/T) (red).
Distribution of m = M/N for N = 16 (orange), 256 (green) and 4 096 (blue)At the chosen T and H. It narrows around tanh(βH) as N grows: relative fluctuations shrink as 1/√N.

Quantities of interest near Tc

Back to the interacting model at H = 0. On the square lattice Onsager’s exact solution puts the transition at kBTc/J = 2/ln(1 + √2) ≈ 2.269. The page simulates 16 × 16, 32 × 32 and 64 × 64 lattices with the Wolff cluster algorithm at temperatures across Tc, and compares them with the exact infinite-lattice results. As in percolation, the singular behavior is described by power laws:

ExponentDefinition2D Ising (exact)Mean field2D percolationThis run
Spontaneous magnetization m0(T)Dots: ⟨|m|⟩ for each L. Dashed: Onsager, m0 = [1 − sinh−4(2J/kBT)]1/8, which rises with β = 1/8 and a vertical tangent at Tc.
Susceptibility χ(T)From the fluctuations, χ = N(⟨m²⟩ − ⟨|m|⟩²)/kBT. The peak grows as Lγ/ν = L7/4.
Specific heat c(T)From energy fluctuations. Dashed: Onsager’s exact c for the infinite lattice, which diverges logarithmically (α = 0).
Energy per spin ε(T)Dashed: Onsager’s exact result. Continuous at Tc, but with an infinite slope.
Finite-size scaling at Tc⟨|m|⟩ ∝ L−β/ν (blue) and N⟨m²⟩/kBTc ∝ Lγ/ν (red), as for percolation on finite lattices. At Tc the full ⟨m²⟩ is used, because subtracting ⟨|m|⟩² there removes part of the signal on small lattices.

The correlation length ξ is the typical size of the largest cluster of aligned spins, or equivalently the scale of the largest fluctuations away from the fully aligned state below Tc and away from the random state above it. It diverges as ξ ∝ |T − Tc|−ν and is defined through the spin–spin correlation function g(ri, rj) = ⟨sisj⟩ − ⟨si⟩⟨sj⟩. Summing g over all sites gives kBTχ, so a diverging χ means g cannot decay exponentially at Tc; it decays as r−(d−2+η). The correlation chart under the live lattice shows this when it runs at Tc.

Symmetry breaking

At H = 0 flipping every spin leaves the energy unchanged, so the microstates {si} and {−si} are equally probable and their magnetizations cancel: ⟨M⟩ = 0 exactly, at every temperature. A small field changes the ratio of their probabilities to

P{si} / P{−si} = exp(2βHM{si}), with M ∝ N

Taking H → 0 first, at fixed N, the ratio returns to 1 and ⟨M⟩ = 0. Taking N → ∞ first, the ratio becomes infinite for H → 0+ and zero for H → 0−: one half of configuration space becomes inaccessible. This is ergodicity breaking, and it is what lets a nonzero magnetization survive. Simulations therefore usually record |m|.

The demo button sets the live lattice at the top to 8 × 8, T = 0.95Tc, H = 0 and Metropolis updates at 16 sweeps per frame: its magnetization jumps between +m and −m every few hundred sweeps, and the distribution of m fills in both peaks. At 16 × 16 the jumps are already about ten times rarer. A 128 × 128 lattice practically never does, and any small field picks the side.

References

Key reference. K. Christensen and N. R. Moloney, Complexity and Criticality, Imperial College Press, London (2005), Chapter 2.

  1. E. Ising, “Beitrag zur Theorie des Ferromagnetismus,” Z. Phys. 31, 253 (1925).
  2. S. G. Brush, “History of the Lenz–Ising model,” Rev. Mod. Phys. 39, 883 (1967).
  3. L. Onsager, “Crystal statistics. I. A two-dimensional model with an order-disorder transition,” Phys. Rev. 65, 117 (1944).
  4. C. N. Yang, “The spontaneous magnetization of a two-dimensional Ising model,” Phys. Rev. 85, 808 (1952).
  5. N. Metropolis, A. W. Rosenbluth, M. N. Rosenbluth, A. H. Teller and E. Teller, “Equation of state calculations by fast computing machines,” J. Chem. Phys. 21, 1087 (1953).
  6. U. Wolff, “Collective Monte Carlo updating for spin systems,” Phys. Rev. Lett. 62, 361 (1989).
  7. D. V. Schroeder, An Introduction to Thermal Physics, Addison-Wesley (2000), Chapter 6.
  8. N. Goldenfeld, Lectures on Phase Transitions and the Renormalization Group, Addison-Wesley (1992).