Singular Learning Theory: Part I—Why classical parameter counting fails
Classical statistics, Bayesian volume, and singularities in overparameterized models.
published
brookmachine learningsingular learning theorysltinterpretability
By: Johannes Choo
This reflection on the final Week 8’s session conducted by Ming Liang will be in three parts, which altogether motivates the development of the Real Log Canonical Threshold (RLCT) and its practical cousin the Local Learning Coefficient (LLC). The session itself was a whirlwind tour forming useful bones on which digestion with the aid of a chatbot was needed to help me plug in holes and form an organized, motivated explanation. The structure, thesis, and section outline in what follows are entirely mine, while the prose exposition was generated with AI. I actively steered the drafting process, stepped in to redirect or rewrite sections where needed, and reviewed the final text.
Classical statistical learning theory relies on a simple proxy for model complexity: the number of parameters. Each adjustable weight is treated as an independent degree of freedom that can be tuned to fit noise in the training set. If we fit a tenth-degree polynomial to eight data points, the curve oscillates wildly between them; to keep a model from memorizing noise, we count its parameters, penalize complexity accordingly, and keep the number of degrees of freedom well below the sample size.
Modern neural networks break this picture. Large networks routinely contain far more parameters than training examples, yet they still generalize smoothly rather than memorizing data verbatim. Just as striking is the geometry of how they learn. Instead of sliding uniformly toward a single minimum, training trajectories often pass through long plateaus of little apparent change punctuated by sudden drops in loss, during which internal mechanisms form, reorganize, or simplify. Classical theory predicts the wrong complexity penalties in this regime because its assumptions fail inside neural parameter spaces.
Traditional accounts of overfitting judge a model class by its worst-case capacity—asking whether some setting of its parameters could memorize arbitrary noise in the training set, a test that any network with more weights than examples automatically fails. Rather than asking what a model could memorize in the worst case, we examine how parameter settings actually organize around good solutions, using a central quantity from Bayesian statistics and statistical physics: the marginal likelihood (or partition function), and its negative logarithm, the Bayesian free energy. By averaging fit across the entire parameter space, free energy captures not merely whether a single weight setting approximates the data well, but how much volume of configurations supports that approximation. Although free energy is a Bayesian quantity rather than a literal equation of motion for gradient descent, its trade-off between training fit and parameter volume provides both a useful physical model for why noisy training drifts toward flatter, more redundant basins and a direct way to measure the geometry around real checkpoints.
We include the explicit equations and derivations for technically curious readers comfortable with undergraduate multivariable calculus, linear algebra, and probability. At the same time, every mathematical expression is paired with a geometric explanation so that readers without those prerequisites can read past the symbolic steps and still walk away with a clear intuitive picture of how Singular Learning Theory (SLT), the Real Log Canonical Threshold (RLCT, ), and the Local Learning Coefficient (LLC, ) help researchers describe and measure phenomena observed when training overparameterized models—phenomena that classical parameter counting cannot express. The progression across the three parts is as follows:
- In Part I, we frame neural networks as parameterized probabilistic models within the Bayesian framework, see why parameter-space volume illuminates training behavior through the partition function and free energy, examine how classical model selection approximates free energy via the Laplace approximation and the Bayesian information criterion (BIC), and see why symmetries and redundant neurons create singularities that break BIC.
- In Part II, we introduce Sumio Watanabe’s Singular Learning Theory and the Real Log Canonical Threshold (RLCT), which replaces parameter counting with volume scaling near zero-loss sets and explains why compact circuits capture vastly more posterior volume than memorization, leading to phase transitions during training.
- In Part III, we move from the global, theoretical RLCT to its empirical counterpart, the Local Learning Coefficient (LLC), showing how Stochastic Gradient Langevin Dynamics (SGLD) measures local effective complexity across training checkpoints to track circuit formation and pruning.
Parameterized models and the Bayesian framework
When a practitioner trains a neural network, they run a learning algorithm (such as gradient descent) on a dataset to arrive at one working computer program chosen from a predefined set of possible outputs of that algorithm. All candidate programs in that set share a fixed architecture and differ only in a list of adjustable numerical weights, . Selecting a vector of weights selects one concrete program from this parameterized model family.
At first glance, treating a neural network as a probability distribution can seem unnatural, especially when a model appears to output deterministic numbers or discrete choices. Yet virtually every deep learning model defines, explicitly or implicitly, a probability distribution parameterized by its weights . For example, a language model or image classifier with a softmax layer explicitly outputs probabilities over next tokens or class labels, while even a regression network trained with mean-squared error implicitly specifies a Gaussian distribution centered at the network’s predicted value.
That probabilistic description also highlights a difference in perspective between engineering and theory. In an applied setting, a practitioner runs a chosen training recipe on a specific dataset to obtain one final parameter vector for the task at hand—for instance, whether a fine-tuned classifier performs reliably on a support queue. A researcher studying learning more generally, however, needs a way to reason about the model family across arbitrary data distributions without tying every conclusion to a single run, random seed, or optimization recipe.
The Bayesian framework provides that common language. Rather than picking out a single vector , we start from a prior density assigning initial plausibility across the parameter space , observe training examples , and update to a posterior distribution over all candidate programs:
Taking negative logarithms turns this product into the familiar regularized objective of deep learning: is the total training loss on , and acts as a regularization term (such as weight decay under a zero-mean Gaussian prior) that keeps parameter-space volume finite. Whereas standard training runs an optimizer to settle on a single minimum of that objective, conditioning on retains the entire distribution across . Because depends solely on the model family, the prior, and the dataset—abstracting away optimizer specifics—studying how it concentrates as grows isolates the geometry of how the architecture represents a task.
Bayesian volume and training dynamics
What does retaining the full posterior reveal that looking only at a single optimum misses? Above all, it reveals parameter-space volume. Picture the parameter space as the horizontal floor of a terrain equipped with ordinary Euclidean distance and volume, and assign each point a vertical elevation equal to its training loss. This forms what practitioners call the loss landscape, where well-fitting programs sit at the bottoms of valleys. Compare two valleys whose lowest points reach the exact same minimum loss:
- A narrow ravine: moving even a tiny Euclidean distance from the bottom in some directions may cause the training loss to climb steeply.
- A broad basin: one can move across a wide Euclidean region around the bottom while the training loss barely rises.
How does this loss landscape translate into the Bayesian posterior ? Because lower training loss corresponds to higher data likelihood , a low-loss valley in the loss landscape becomes a high peak of probability density in the posterior. At their exact bottom points, both valleys achieve the same minimum loss—and, assuming comparable prior density , the same peak probability density.
In a continuous space , however, a single point has zero volume, so density at one point does not determine how much posterior weight a region holds. What actually measures how strongly the posterior favors a valley is its probability mass—the integral of the probability density over Euclidean volume in that neighborhood. In the narrow ravine, the loss shoots up and the probability density drops off almost immediately away from the floor along those steep directions, leaving a thin ridge of high density with very little total mass. In the broad basin, the loss stays low—and the probability density remains high—across a large Euclidean volume, accumulating vastly more posterior probability mass.
Although gradient-based optimizers such as SGD or Adam do not literally sample from , they traverse this same Euclidean loss landscape under mini-batch gradient noise and finite step sizes, making it hard to stay balanced inside a narrow ravine and biasing trajectories toward broad, high-volume basins. The Bayesian trade-off between depth (loss at the valley floor) and volume (the Euclidean region over which loss remains low), measured by free energy, therefore captures both the intrinsic geometry of a solution and its pull on noisy optimization.
Measuring fit and curvature: KL divergence and Fisher information
To describe this landscape geometry precisely, we need one quantity to measure fit and another to measure the steepness of a valley around a minimum.
Suppose the training examples are drawn independently from an underlying data distribution , and recall that each parameter vector in our model family defines a predicted distribution . We measure the average discrepancy between the data-generating distribution and the model’s predictions using the Kullback–Leibler (KL) divergence:
with integration replaced by summation when is discrete. Intuitively, averages the prediction mismatch over all possible data points . It is always nonnegative (), and in the realizable setting—where the model family is expressive enough to represent exactly—there exists at least one optimal parameter matching everywhere (), at which .1
In practice, we never have access to itself; we only observe the training examples . Rather than computing directly, training evaluates the empirical negative log-likelihood—the standard cross-entropy training loss averaged over the training set:
Its expected value over fresh draws from is , where is the constant entropy of , so minimizing is equivalent to minimizing an empirical estimate of up to an additive constant. Moreover, rewriting the dataset likelihood as shows why poor fits disappear exponentially fast from the posterior as dataset size grows.
Now suppose we stand at a realizable optimum where and the slope . How steeply do the valley walls rise as we nudge ? Expanding to second order gives a quadratic bowl approximation:
where the matrix of second derivatives coincides at the realizable optimum with the Fisher information matrix . Geometrically, a multi-dimensional quadratic bowl has a set of perpendicular principal axes, and the eigenvalues of are simply the steepnesses (curvatures) of the bowl along each of those axes: a large eigenvalue corresponds to a steep wall where tiny weight changes sharply distort predictions, a small eigenvalue corresponds to a gentle slope, and a zero eigenvalue corresponds to a completely flat trough along which the model’s predictions do not change at all. Those steepnesses also govern local optimization behavior: when some axes are vastly steeper than others, gradient descent oscillates across steep directions while creeping slowly along shallow ones. Viewing a parameterized model family as a geometric space whose local distance and curvature are governed by the Fisher matrix is the centerpiece of information geometry, pioneered by Shun-ichi Amari—who also introduced the natural gradient (), rescaling updates by the inverse Fisher matrix to equalize steep and shallow axes whenever is invertible.
Local curvature also governs how reliably a solution survives noisy training steps. Near a minimum —where the full-batch gradient vanishes and updates are dominated by mini-batch noise—an SGD step of bounded Euclidean distance acts as a small random perturbation . When that noise is spread across directions rather than aimed solely along the steepest axis, the quadratic approximation yields a simple probabilistic bound: the probability that a bounded noisy step remains a good fit (keeping the increase in error below a small tolerance) is controlled by the fraction of the local Euclidean ball around where the walls of stay shallow or flat. The more directions that are flat or gentle, the smaller the chance that a bounded step knocks the model into a high-loss region.
Classical model selection and the Laplace approximation
With training fit and local curvature in place, we step back from tracking and updating a single parameter instance through gradient steps to evaluating the model family as a whole. Rather than modifying one weight vector, Bayesian model selection integrates out across parameter space against the regularizing prior (such as Gaussian weight decay), which keeps total parameter volume finite. Averaging the dataset likelihood under gives the marginal likelihood, known in statistical physics as the partition function :
Although integrates over all of , local curvature around still governs its value as grows: because suppresses high-loss regions exponentially fast, almost the entire integral concentrates inside the low-loss valley around . Taking the negative logarithm of gives the Bayesian free energy:
Because of the minus sign, a larger partition function —meaning a better combination of low training loss and generous supporting volume—corresponds to a smaller free energy . Returning to our earlier terrain comparison, suppose we evaluate two landscapes (or two local regions with comparable prior weight) whose bottoms reach the exact same minimum training loss: the broad basin keeps large across a much wider Euclidean neighborhood than the narrow ravine, giving it a larger integral and therefore a lower free energy .
Consider what happens to as dataset size in a regular statistical model—one whose loss landscape around the optimal parameter is a single smooth bowl curving upward in every direction, with no flat troughs or ridges (formally, sits as an isolated point in the interior of with , and every principal axis of has strictly positive curvature so is positive definite). As grows, the empirical minimizer (the weight setting minimizing training loss on the dataset) moves within distance of , and the factor concentrates almost all of the integral inside a small Gaussian peak around . Because the loss rises quadratically like around the bottom of the bowl, keeping bounded as grows forces the width of that peak to shrink by along every one of the independent parameter axes. Shrinking a -dimensional box by along each axis shrinks its total volume by .
Approximating the integral by treating the log-integrand as a quadratic bowl around its peak—the Laplace approximation—turns that shrinking volume into an asymptotic formula for the free energy:
Multiplying the leading terms by (with evaluated at the empirical minimizer ) gives the classical Bayesian information criterion (BIC). Reading each term geometrically shows why classical parameter counting works here:
- Training fit (): Because this term grows linearly with dataset size , even a slight improvement in fitting the data eventually outweighs complexity penalties once enough samples are collected.
- Dimensional volume penalty (): This comes directly from . Each of the independent parameters shrinks the surviving volume by , adding to the free energy regardless of what the parameter represents.
- Local curvature (): The determinant is the product of the bowl’s steepnesses across all principal axes. Steeper bowls have smaller volume and pay a slightly higher constant penalty.
- Lower-order remainder (): This collects terms that stay bounded as grows, including the prior density , the Gaussian normalization constant , and the bounded fluctuation between the empirical minimum and .
For classical regular models such as linear or logistic regression, this expansion matches both model selection and optimization geometry: there is an isolated bowl, every parameter constrains predictions, and the posterior contracts uniformly around .
Look closely, however, at the product of steepnesses inside . It requires every single eigenvalue of to be strictly greater than zero. If even one direction in parameter space is completely flat at —curvature zero—then the product vanishes, a Gaussian bowl fails to confine probability along that flat axis, and the BIC expansion breaks down.
Symmetries, redundancy, and singularities in neural networks
In neural networks, flat directions are not rare edge cases; they are built directly into the architecture through symmetries and overparameterization.
First, consider continuous rescaling symmetries. Take a single hidden ReLU neuron computing for an input vector , incoming weights , and outgoing weight , where sets negative numbers to zero and passes positive numbers through unchanged. Because positive scaling passes straight through , multiplying the incoming weights by any positive number and dividing the outgoing weight by cancels out identically:
Doubling and halving , for instance, produces the exact same output for every input . Varying traces a continuous curve in parameter space along which the predicted distribution and never change. Along that curve, the valley has zero steepness, giving a zero eigenvalue.2
Second, consider redundant units. Suppose the true data distribution can be represented exactly by a single hidden neuron, and we fit a two-neuron network instead. The second neuron can be switched off in two distinct ways without disturbing :
- setting its outgoing weight to zero (), which leaves its incoming weights free to take any values; or
- setting its incoming weights to zero (), which silences the unit for every input and leaves its outgoing weight free to take any values.
Where and meet, two flat zero-loss sheets cross along a crease, much like two perpendicular walls meeting at a corner.
When the set of optimal weights is no longer a collection of isolated points sitting in round bowls—forming instead continuous curves, flat sheets, and intersecting creases where has zero eigenvalues—we call the model a singular statistical model. Amari and collaborators showed that these intersecting redundant-neuron singularities also degenerate the Fisher metric along training trajectories, trapping gradient descent on the long plateaus followed by sudden drops in loss observed when training neural networks.
Beyond slowing optimization, singularities also break the Laplace approximation for free energy because flat and intersecting valleys leave vastly more room for weights to vary without hurting training fit. Where quadratic curvature disappears, valley walls flatten out into gentler higher-order slopes such as quartics () or cross-terms like . In a quartic direction, the region of acceptable parameters shrinks at rate rather than (since keeping bounded allows up to order rather than ); along an exact symmetry curve, it does not shrink with at all. Posterior volume therefore contracts far more slowly than , and raw parameter count dramatically overstates the model’s effective complexity.
In Part II, we replace raw parameter counting with a geometric measure of how fast near-optimal volume shrinks—the Real Log Canonical Threshold ()—and see how it governs competition between basins inside a single network.
Footnotes
-
If the model is slightly misspecified so that , the local volume and free-energy theory still holds by replacing with the excess divergence under appropriate regularity conditions around the optimal set. ↩
-
Watanabe’s formal proofs assume that is real-analytic, which excludes piecewise-linear activations such as ReLU at their nondifferentiable boundaries. However, networks with smooth activations (such as or GELU) as well as deep linear networks satisfy analyticity and exhibit the exact same continuous rescaling symmetries and intersecting degeneracies, and empirical SLT extends smoothly to ReLU architectures in practice. ↩