EPS Dashboard

Authors: Lurong Pan

Summary

This paper introduces CDLinear, a circulant-structured neural network layer inspired by a physics framework, that diagonalizes the training Hessian (the matrix of second derivatives of the loss) via discrete Fourier transform. The result is near-perfect conditioning (eigenvalue ratios close to 1) and 3.8× fewer parameters than a dense MLP for comparable accuracy on MNIST. The construction gives provable bounds on the Hessian condition number and specifies a principled dropout rate from a physics-calibrated "noise rate."

Main takeaways:

CDLinear layers are block-circulant, so their Hessian can be FFT-diagonalized, yielding eigenvalues you can read off from input statistics.
Under whitened inputs, the population Hessian condition number is exactly 1; empirically it stays very low even on finite samples.
A CDLinear MLP with 2,380 parameters achieves 97.5% on MNIST vs. 98.15% for a dense MLP with 8,970 parameters, and the CD-MLP's Hessian is 310× better conditioned.
The method transfers a physics-derived "Shannon noise rate" to set dropout, offering a non-arbitrary hyperparameter choice.

Relevance

Not directly related to my persona/midtraining work—this is a general neural architecture paper. It's only tangentially relevant if I ever need to understand how LoRA or other low-rank methods interact with gradient conditioning during fine-tuning.

Threat model

Potential threat/caveat for clean result "Fine-tuning one persona on a two-marker chunk and another on the start marker plants the end marker at every donor answer's end, not chained to the start (LOW confidence)": this item discusses evaluation.

Abstract

arXiv:2605.08171v1 Announce Type: new Abstract: Background and motivation. The Communication Dynamics (CD) framework, introduced in two earlier papers for atomic-energy prediction and field-induced superconductivity, treats each physical channel as a (2l+1)-vertex polygon whose discrete Fourier transform yields its energy spectrum. This paper applies the same circulant-spectral machinery to neural-network design. Layer construction. CDLinear is a block-circulant linear layer with block size B = 2l+1 and 1/B the parameter count of a dense layer of equal input/output dimensions. Three properties follow from the construction. (i) The Hessian of mean-squared loss with respect to the weights is diagonalized by the discrete Fourier transform, with eigenvalues |FXj|^2 read directly from the input statistics (Theorem 1). (ii) Under input pre-whitening, the population Hessian condition number satisfies kappa = 1 exactly, with the empirical condition number bounded by 1+O(sqrt(B/N)) on N samples (Theorem 2). (iii) The Shannon noise rate alpha_CD = 0.0118 calibrated in the parent CD papers from the Na D-doublet specifies a transferable, non-arbitrary dropout rate. Empirical evaluation. A CDLinear MLP at B = 4 achieves 97.50% +/- 0.23% test accuracy with 2,380 parameters versus 98.15% +/- 0.47% for a parameter-matched dense MLP at 8,970 parameters, a 3.8x parameter reduction at 0.65% accuracy cost, within one standard deviation of the seed-to-seed spread. The CD-MLP mean Hessian condition number kappa = 1.9x10^4 is 310x smaller than the dense baseline kappa = 5.9x10^6, in quantitative agreement with Theorem 2.