Disordered Systems and Neural Networks

2025-03-28 | | Total: 9

#1 Renormalization group analysis of noisy neural field [PDF] [Copy] [Kimi] [REL]

Authors: Jie Zang, Pascal Helson, Shenquan Liu, Arvind Kumar, Dhrubaditya Mitra

Neurons in the brain show great diversity in their individual properties and their connections to other neurons. To develop an understanding of how neuronal diversity contributes to brain dynamics and function at large scales we borrow from the framework of replica methods, that has been successfully applied to a large class of problems with quenched noise in equilibrium statistical mechanics. We analyze two linearized versions of Wilson-Cowan model with random coefficients which are correlated in space. In particular: (A) a model where the properties of the neurons themselves are heterogeneous and (B) where their connectivities are anisotropic. In both of these models, the averaging over the quenched randomness gives rise to additional nonlinearities. These nonlinearities are analyzed within the framework of Wilsonian renormalization group. We find that for Model A, if the spatial correlation of noise decays with distance with an exponent smaller than $-2$, at large spatial scales the effect of the noise vanishes. By contrast, for model B, the effect of noise in neuronal connectivity vanishes only if the spatial correlations decay with an exponent smaller than $-1$. Our calculations also suggest that the presence of noise, under certain conditions, can give rise to travelling wave like behavior at large scales, although it remains to be seen whether this result remains valid at higher orders in perturbation theory.

Subject: Disordered Systems and Neural Networks

Publish: 2025-03-27 15:27:08 UTC


#2 Non-reciprocal interactions and high-dimensional chaos: comparing dynamics and statistics of equilibria in a solvable model [PDF] [Copy] [Kimi] [REL]

Authors: Samantha J. Fournier, Alessandro Pacco, Valentina Ros, Pierfrancesco Urbani

We investigate a model of high-dimensional dynamical variables with all-to-all interactions that are random and non-reciprocal. We characterize its phase diagram and point out that the model can exhibit chaotic dynamics. We show that the equations describing the system's dynamics exhibit a number of equilibria that is exponentially large in the dimensionality of the system, and these equilibria are all linearly unstable in the chaotic phase. Solving the effective equations governing the dynamics in the infinite-dimensional limit, we determine the typical properties (magnetization, overlap) of the configurations belonging to the attractor manifold. We show that these properties cannot be inferred from those of the equilibria, challenging the expectation that chaos can be understood purely in terms of the numerous unstable equilibria of the dynamical equations. We discuss the dependence of this scenario on the strength of non-reciprocity in the interactions. These results are obtained through a combination of analytical methods such as Dynamical Mean-Field Theory and the Kac-Rice formalism.

Subjects: Disordered Systems and Neural Networks , Statistical Mechanics

Publish: 2025-03-26 18:26:08 UTC


#3 Synchronization and chaos in complex ecological communities with delayed interactions [PDF] [Copy] [Kimi] [REL]

Authors: Francesco Ferraro, Christian Grilletta, Emanuele Pigani, Samir Suweis, Sandro Azaele, Amos Maritan

Explaining the wide range of dynamics observed in ecological communities is challenging due to the large number of species involved, the complex network of interactions among them, and the influence of multiple environmental variables. Here, we consider a general framework to model the dynamics of species-rich communities under the effects of external environmental factors, showing that it naturally leads to delayed interactions between species, and analyze the impact of such memory effects on population dynamics. Employing the generalized Lotka-Volterra equations with time delays and random interactions, we characterize the resulting dynamical phases in terms of the statistical properties of community interactions. Our findings reveal that memory effects can generate persistent and synchronized oscillations in species abundances in sufficiently competitive communities. This provides an additional explanation for synchronization in large communities, complementing known mechanisms such as predator-prey cycles and environmental periodic variability. Furthermore, we show that when reciprocal interactions are negatively correlated, time delays alone can induce chaotic behavior. This suggests that ecological complexity is not a prerequisite for unpredictable population dynamics, as intrinsic memory effects are sufficient to generate long-term fluctuations in species abundances. The techniques developed in this work are applicable to any high-dimensional random dynamical system with time delays.

Subjects: Populations and Evolution , Disordered Systems and Neural Networks , Statistical Mechanics , Dynamical Systems , Biological Physics

Publish: 2025-03-27 14:38:47 UTC


#4 Exploring the Energy Landscape of RBMs: Reciprocal Space Insights into Bosons, Hierarchical Learning and Symmetry Breaking [PDF] [Copy] [Kimi1] [REL]

Authors: J. Quetzalcóatl Toledo-Marin, Anindita Maiti, Geoffrey C. Fox, Roger G. Melko

Deep generative models have become ubiquitous due to their ability to learn and sample from complex distributions. Despite the proliferation of various frameworks, the relationships among these models remain largely unexplored, a gap that hinders the development of a unified theory of AI learning. We address two central challenges: clarifying the connections between different deep generative models and deepening our understanding of their learning mechanisms. We focus on Restricted Boltzmann Machines (RBMs), known for their universal approximation capabilities for discrete distributions. By introducing a reciprocal space formulation, we reveal a connection between RBMs, diffusion processes, and coupled Bosons. We show that at initialization, the RBM operates at a saddle point, where the local curvature is determined by the singular values, whose distribution follows the Marcenko-Pastur law and exhibits rotational symmetry. During training, this rotational symmetry is broken due to hierarchical learning, where different degrees of freedom progressively capture features at multiple levels of abstraction. This leads to a symmetry breaking in the energy landscape, reminiscent of Landau theory. This symmetry breaking in the energy landscape is characterized by the singular values and the weight matrix eigenvector matrix. We derive the corresponding free energy in a mean-field approximation. We show that in the limit of infinite size RBM, the reciprocal variables are Gaussian distributed. Our findings indicate that in this regime, there will be some modes for which the diffusion process will not converge to the Boltzmann distribution. To illustrate our results, we trained replicas of RBMs with different hidden layer sizes using the MNIST dataset. Our findings bridge the gap between disparate generative frameworks and also shed light on the processes underpinning learning in generative models.

Subjects: Machine Learning , Disordered Systems and Neural Networks

Publish: 2025-03-27 14:28:37 UTC


#5 Measurement-Induced Entanglement Phase Transition in Free Fermion Chains [PDF] [Copy] [Kimi] [REL]

Authors: Han-Ze Li, Jian-Xin Zhong, Xue-Jia Yu

Measurement-induced entanglement phase transitions (MIET) highlight how local measurements drive quantum systems between area-law and volume-law entangled states. This review surveys MIET in free fermion models, focusing on how unitary hopping competes with measurement-induced non-unitarity. We discuss controversies regarding the existence of measurement-induced entanglement phase transition in one dimension, the impact of non-Hermitian skin effects, and potential experimental platforms. We conclude with open challenges, including feedback control and higher-dimensional extensions.

Subjects: Quantum Physics , Disordered Systems and Neural Networks

Publish: 2025-03-27 12:13:33 UTC


#6 Statistics of the Random Matrix Spectral Form Factor [PDF] [Copy] [Kimi] [REL]

Authors: Alex Altland, Francisco Divi, Tobias Micklitz, Silvia Pappalardi, Maedeh Rezaei

The spectral form factor of random matrix theory plays a key role in the description of disordered and chaotic quantum systems. While its moments are known to be approximately Gaussian, corrections subleading in the matrix dimension, $D$, have recently come to attention, with conflicting results in the literature. In this work, we investigate these departures from Gaussianity for both circular and Gaussian ensembles. Using two independent approaches -- sine-kernel techniques and supersymmetric field theory -- we identify the form factor statistics to next leading order in a $D^{-1}$ expansion. Our sine-kernel analysis highlights inconsistencies with previous studies, while the supersymmetric approach backs these findings and suggests an understanding of the statistics from a complementary perspective. Our findings fully agree with numerics. They are presented in a pedagogical way, highlighting new pathways (and pitfalls) in the study of statistical signatures at next leading order, which are increasingly becoming important in applications.

Subjects: Quantum Physics , Disordered Systems and Neural Networks , High Energy Physics - Theory

Publish: 2025-03-27 11:34:12 UTC


#7 Monopole current control in artificial spin ice via localized fields [PDF] [Copy] [Kimi] [REL]

Authors: Julia Frank, Johan van Lierop, Robert L. Stamps

Artificial spin ice systems are metamaterials composed of interacting nanomagnets arranged on a lattice, exhibiting geometrical frustration and emergent phenomena such as monopole excitations. We explore magnetization dynamics and monopole current control in square artificial spin ice with added vertical control elements. Using Monte Carlo simulations, we examine how localized magnetic fields from these elements influence vertex configurations and domain propagation, enabling directional and polarity control of monopole currents. The control elements suppress monopole nucleation along one edge, steering monopole flow across the lattice, sometimes even against the applied field direction. These elements also reshape the system's energy landscape, producing tailored hysteresis and guided state transitions. Our results offer a strategy for manipulating collective behaviours in artificial spin ice using localized fields. This has implications for magnetic memory, physical reservoir computing, enabling reconfigurable magnetic logic and spin-based information processing, and device architectures requiring directional magnetic charge transport.

Subjects: Mesoscale and Nanoscale Physics , Disordered Systems and Neural Networks

Publish: 2025-03-26 20:50:21 UTC


#8 Solvable Quantum Circuits in Tree+1 Dimensions [PDF] [Copy] [Kimi] [REL]

Authors: Oliver Breach, Benedikt Placke, Pieter W. Claeys, S. A. Parameswaran

We devise tractable models of unitary quantum many-body dynamics on tree graphs, as a first step towards a deeper understanding of dynamics in non-Euclidean spaces. To this end, we first demonstrate how to construct strictly local quantum circuits that preserve the symmetries of trees, such that their dynamical light cones grow isotropically. We show that, for trees with coordination number z, such circuits can be built from z-site gates. We then introduce a family of gates for which the dynamics is exactly solvable; these satisfy a set of constraints that we term 'tree-unitarity'. Notably, tree-unitarity reduces to the previously-established notion of dual-unitarity for z=2, when the tree reduces to a line. Among the unexpected features of tree-unitarity is a trade-off between 'maximum velocity' dynamics of out-of-time-order correlators and the existence of non-vanishing correlation functions in multiple directions, a tension absent in one-dimensional dual-unitary models and their Euclidean generalizations. We give various examples of tree-unitary gates, discuss dynamical correlations, out-of-time-order correlators, and entanglement growth, and show that the kicked Ising model on a tree is a physically-motivated example of maximum-velocity tree-unitary dynamics.

Subjects: Quantum Physics , Disordered Systems and Neural Networks , Statistical Mechanics

Publish: 2025-03-26 19:00:01 UTC


#9 Generalized Lotka-Volterra model with sparse interactions: non-Gaussian effects and topological multiple-equilibria phase [PDF] [Copy] [Kimi] [REL]

Authors: Tommaso Tonolo, Maria Chiara Angelini, Sandro Azaele, Amos Maritan, Giacomo Gradenigo

We study the equilibrium phases of a generalized Lotka-Volterra model characterized by a species interaction matrix which is random, sparse and symmetric. Dynamical fluctuations are modeled by a demographic noise with amplitude proportional to the effective temperature T. The equilibrium distribution of species abundances is obtained by means of the cavity method and the Belief Propagation equations, which allow for an exact solution on sparse networks. Our results reveal a rich and non-trivial phenomenology that deviates significantly from the predictions of fully connected models. Consistently with data from real ecosystems, which are characterized by sparse rather than dense interaction networks, we find strong deviations from Gaussianity in the distribution of abundances. In addition to the study of these deviations from Gaussianity, which are not related to multiple-equilibria, we also identified a novel topological glass phase, present at both finite temperature, as shown here, and at T=0, as previously suggested in the literature. The peculiarity of this phase, which differs from the multiple-equilibria phase of fully-connected networks, is its strong dependence on the presence of extinctions. These findings provide new insights into how network topology and disorder influence ecological networks, particularly emphasizing that sparsity is a crucial feature for accurately modeling real-world ecological phenomena.

Subjects: Statistical Mechanics , Disordered Systems and Neural Networks , Populations and Evolution

Publish: 2025-03-26 18:01:38 UTC