Disordered Systems and Neural Networks

2024-12-03 | | Total: 12

#1 Diffusion in liquid metals is directed by competing collective modes [PDF] [Copy] [Kimi] [REL]

Authors: Franz Demmel, Noel Jakse

The self-diffusion process in a dense liquid is influenced by collective particle movements. Extensive molecular dynamics simulations for liquid aluminium and rubidium evidence a crossover in the diffusion coefficient at about $1.4$ times the melting temperature $T_m$, indicating a profound change in the diffusion mechanism. The corresponding velocity auto-correlation functions demonstrate a decrease of the cage effect with a gradual set-in of a power-law decay, the celebrate {\it long time tail}. This behavior is caused by a competition of density fluctuations near the melting point with vortex-type particle patterns from transverse currents in the hot fluid. The investigation of the velocity autocorrelation function evidences a gradual transition in dynamics with rising temperature. The competition between these two collective particle movements, one hindering and one enhancing the diffusion process, leads to a non-Arrhenius-type behavior of the diffusion coefficient around $1.4~T_m$, which signals the transition from a dense to a fluid-like liquid dynamics in the potential energy landscape picture.

Subject: Disordered Systems and Neural Networks

Publish: 2024-12-02 14:52:22 UTC


#2 Universal Spreading Dynamics in Quasiperiodic Non-Hermitian Systems [PDF] [Copy] [Kimi] [REL]

Authors: Ze-Yu Xing, Shu Chen, Haiping Hu

Non-Hermitian systems exhibit a distinctive type of wave propagation, due to the intricate interplay of non-Hermiticity and disorder. Here, we investigate the spreading dynamics in the archetypal non-Hermitian Aubry-André model with quasiperiodic disorder. We uncover counter-intuitive transport behaviors: subdiffusion with a spreading exponent $\delta=1/3$ in the localized regime and diffusion with $\delta=1/2$ in the delocalized regime, in stark contrast to their Hermitian counterparts (halted vs. ballistic). We then establish a unified framework from random-variable perspective to determine the universal scaling relations in both regimes for generic disordered non-Hermitian systems. An efficient method is presented to extract the spreading exponents from Lyapunov exponents. The observed subdiffusive or diffusive transport in our model stems from Van Hove singularities at the tail of imaginary density of states, as corroborated by Lyapunov-exponent analysis.

Subjects: Disordered Systems and Neural Networks , Mesoscale and Nanoscale Physics , Quantum Gases , Optics , Quantum Physics

Publish: 2024-12-02 09:13:43 UTC


#3 Simplified derivations for high-dimensional convex learning problems [PDF] [Copy] [Kimi] [REL]

Authors: David G. Clark, Haim Sompolinsky

Statistical physics provides tools for analyzing high-dimensional problems in machine learning and theoretical neuroscience. These calculations, particularly those using the replica method, often involve lengthy derivations that can obscure physical interpretation. We give concise, non-replica derivations of several key results and highlight their underlying similarities. Specifically, we introduce a cavity approach to analyzing high-dimensional learning problems and apply it to three cases: perceptron classification of points, perceptron classification of manifolds, and kernel ridge regression. These problems share a common structure -- a bipartite system of interacting feature and datum variables -- enabling a unified analysis. For perceptron-capacity problems, we identify a symmetry that allows derivation of correct capacities through a naïve method. These results match those obtained through the replica method.

Subjects: Disordered Systems and Neural Networks , Neural and Evolutionary Computing , Neurons and Cognition

Publish: 2024-12-02 04:32:14 UTC


#4 The Accuracy and Performance Analysis of the 1/t Wang-Landau Algorithm in the Joint Density of States Estimation [PDF] [Copy] [Kimi] [REL]

Authors: Vladislav Egorov, Boris Kryzhanovsky

The 1/t Wang-Landau algorithm is analyzed from the viewpoint of execution time and accuracy when it is used in computations of the density of states of a two-dimensional Ising model. We find that the simulation results have a systematic error, the magnitude of which decreases with increasing the lattice size. The relative error has two maxima: the first one is located near the energy of the ground state, and the second maximum corresponds to the value of the internal energy at the critical point. We demonstrate that it is impossible to estimate the execution time of the 1/t Wang-Landau algorithm in advance when simulating large lattices. The reason is that the criterion for switching to the 1/t mode was not met when the final value of the modification factor was reached. The simultaneous calculations of the density of states for energy and magnetization are shown to lead to higher accuracy in estimating statistical moments of internal energy.

Subject: Disordered Systems and Neural Networks

Publish: 2024-12-01 13:42:43 UTC


#5 Task learning through stimulation-induced plasticity in neural networks [PDF] [Copy] [Kimi] [REL]

Authors: Francesco Borra, Simona Cocco, Rémi Monasson

Synaptic plasticity dynamically shapes the connectivity of neural systems and is key to learning processes in the brain. To what extent the mechanisms of plasticity can be exploited to drive a neural network and make it perform some kind of computational task remains unclear. This question, relevant in a bioengineering context, can be formulated as a control problem on a high-dimensional system with strongly constrained and non-linear dynamics. We present a self-contained procedure which, through appropriate spatio-temporal stimulations of the neurons, is able to drive rate-based neural networks with arbitrary initial connectivity towards a desired functional state. We illustrate our approach on two different computational tasks: a non-linear association between multiple input stimulations and activity patterns (representing digit images), and the construction of a continuous attractor encoding a collective variable in a neural population. Our work thus provides a proof of principle for emerging paradigms of in vitro computation based on real neurons.

Subjects: Neurons and Cognition , Disordered Systems and Neural Networks

Publish: 2024-12-02 16:29:51 UTC


#6 On the phase diagram of the multiscale mean-field spin-glass [PDF] [Copy] [Kimi] [REL]

Authors: Francesco Camilli, Pierluigi Contucci, Emanuele Mingione, Daniele Tantari

In this paper we study the phase diagram of a Sherrington-Kirkpatrick (SK) model where the couplings are forced to thermalize at different times scales. Besides being a challenging generalization of the SK model, such settings may arise naturally in physics whenever part of the many degrees of freedom of a system relaxes to equilibrium considerably faster than the others. For this model we compute the asymptotic value of the second moment of the overlap distribution. Furthermore, we provide a rigorous sufficient condition for an annealed solution to hold, identifying a high temperature region. In addition, we also prove that for sufficiently low temperature the solution must present a number of replica symmetry breaking levels at least equal to the number of time scales already present in the multiscale model. Finally, we give a sufficient condition for the existence of gaps in the support of the functional order parameters.

Subjects: Mathematical Physics , Disordered Systems and Neural Networks , Probability

Publish: 2024-12-01 22:45:39 UTC


#7 Brownian spin-locking effect [PDF] [Copy] [Kimi] [REL]

Authors: Xiao Zhang, Peiyang Chen, Mei Li, Yuzhi Shi, Erez Hasman, Bo Wang, Xianfeng Chen

Brownian systems are characterized by spatiotemporal disorder, which arises from the erratic motion of particles driven by thermal fluctuations. When light interacts with such systems, it typically produces unpolarized and uncorrelated fields. Here, we report the observation of a large-scale spin-locking effect of light within a Brownian medium. In an observation direction perpendicular to the incident wave momentum, scattering naturally divides into two diffusion regions, each associated with an opposite spin from the Brownian nanoparticles. This effect arises from the intrinsic spin-orbit interactions of scattering from individual nanoparticles, which ubiquitously generate radiative spin fields that propagate through the Brownian medium with multiple incoherent scattering. It offers a novel experimental platform for exploring macroscale spin behaviors of diffused light, with potential applications in precision metrology for measuring various nanoparticle properties. Our findings may inspire the study of analogous phenomena for different waves from novel spin-orbit interactions in complex disordered systems.

Subjects: Optics , Disordered Systems and Neural Networks , Applied Physics , Biological Physics

Publish: 2024-12-01 16:38:49 UTC


#8 Solving and visualizing fractional quantum Hall wavefunctions with neural network [PDF] [Copy] [Kimi] [REL]

Authors: Yi Teng, David D. Dai, Liang Fu

We introduce an attention-based fermionic neural network (FNN) to variationally solve the problem of two-dimensional Coulomb electron gas in magnetic fields, a canonical platform for fractional quantum Hall (FQH) liquids, Wigner crystals and other unconventional electron states. Working directly with the full Hilbert space of $N$ electrons confined to a disk, our FNN consistently attains energies lower than LL-projected exact diagonalization (ED) and learns the ground state wavefunction to high accuracy. In low LL mixing regime, our FNN reveals microscopic features in the short-distance behavior of FQH wavefunction beyond the Laughlin ansatz. For moderate and strong LL mixing parameters, the FNN outperforms ED significantly. Moreover, a phase transition from FQH liquid to a crystal state is found at strong LL mixing. Our study demonstrates unprecedented power and universality of FNN based variational method for solving strong-coupling many-body problems with topological order and electron fractionalization.

Subjects: Strongly Correlated Electrons , Disordered Systems and Neural Networks , Quantum Physics

Publish: 2024-11-30 23:58:18 UTC


#9 Extending the atomic decomposition and many-body representation, a chemistry-motivated monomer-centered approach for machine learning potentials [PDF] [Copy] [Kimi] [REL]

Authors: Qi Yu, Ruitao Ma, Chen Qu, Riccardo Conte, Apurba Nandi, Priyanka Pandey, Paul L. Houston, Dong H. Zhang, Joel M. Bowman

Most widely used machine learned (ML) potentials for condensed phase applications rely on many-body permutationally invariant polynomial (PIP) or atom-centered neural networks (NN). However, these approaches often lack chemical interpretability in atomistic energy decomposition and the computational efficiency of traditional force fields has not been fully achieved. Here, we present a novel method that combines aspects of both approaches, and achieves state-of-the-art balance of accuracy and force field-level speed. This method utilizes a monomer-centered representation, where the potential energy is decomposed into the sum of chemically meaningful monomeric energies. Without sophisticated neural network design, the structural descriptors of monomers are described by 1-body and 2-body effective interactions, enforced by appropriate sets of PIPs as inputs to the feed forward NN. We demonstrate the performance of this method through systematic assessments of models for gas-phase water trimer, liquid water, and also liquid CO2. The high accuracy, fast speed, and flexibility of this method provide a new route for constructing accurate ML potentials and enabling large-scale quantum and classical simulations for complex molecular systems.

Subjects: Chemical Physics , Disordered Systems and Neural Networks , Atomic and Molecular Clusters , Computational Physics

Publish: 2024-11-30 16:13:44 UTC


#10 Localization Phenomena in Large-Scale Networked Systems: Implications for Fragility [PDF] [Copy] [Kimi] [REL]

Authors: Poorva Shukla, Bassam Bamieh

We study phenomena where some eigenvectors of a graph Laplacian are largely confined in small subsets of the graph. These localization phenomena are similar to those generally termed Anderson Localization in the Physics literature, and are related to the complexity of the structure of large graphs in still unexplored ways. Using spectral perturbation theory and pseudo-spectrum analysis, we explain how the presence of localized eigenvectors gives rise to fragilities (low robustness margins) to unmodeled node or link dynamics. Our analysis is demonstrated by examples of networks with relatively low complexity, but with features that appear to induce eigenvector localization. The implications of this newly-discovered fragility phenomenon are briefly discussed.

Subjects: Systems and Control , Disordered Systems and Neural Networks , Mathematical Physics

Publish: 2024-11-29 20:48:50 UTC


#11 Supercurrent flow in inhomogeneous superconductors [PDF] [Copy] [Kimi] [REL]

Authors: Mikhail A. Skvortsov, Oleg B. Zuev, Dina I. Fazlizhanova

We study how the supercurrent flow pattern is altered by inhomogeneities in superconducting films. Working in the vicinity of the critical temperature and assuming a model of short-range disorder in the quadratic term of the Ginzburg-Landau functional, we develop a perturbation theory in the inhomogeneity strength. Absorbing the ultraviolet divergences into the renormalization of the critical temperature, we arrive at a well-defined theory governed by large-scale physics. In the presence of inhomogeneities, the correlation functions of the order parameter and supercurrent exhibit a long-range power-law behavior, which can be attributed to the mixing of the amplitude and phase modes. The fluctuation magnitude grows with increasing the average current, and the system becomes strongly inhomogeneous near the critical current.

Subjects: Superconductivity , Disordered Systems and Neural Networks , Mesoscale and Nanoscale Physics

Publish: 2024-11-29 19:01:36 UTC


#12 Differential learning kinetics govern the transition from memorization to generalization during in-context learning [PDF] [Copy] [Kimi] [REL]

Authors: Alex Nguyen, Gautam Reddy

Transformers exhibit in-context learning (ICL): the ability to use novel information presented in the context without additional weight updates. Recent work shows that ICL emerges when models are trained on a sufficiently diverse set of tasks and the transition from memorization to generalization is sharp with increasing task diversity. One interpretation is that a network's limited capacity to memorize favors generalization. Here, we examine the mechanistic underpinnings of this transition using a small transformer applied to a synthetic ICL task. Using theory and experiment, we show that the sub-circuits that memorize and generalize can be viewed as largely independent. The relative rates at which these sub-circuits learn explains the transition from memorization to generalization, rather than capacity constraints. We uncover a memorization scaling law, which determines the task diversity threshold at which the network generalizes. The theory quantitatively explains a variety of other ICL-related phenomena, including the long-tailed distribution of when ICL is acquired, the bimodal behavior of solutions close to the task diversity threshold, the influence of contextual and data distributional statistics on ICL, and the transient nature of ICL.

Subjects: Machine Learning , Disordered Systems and Neural Networks , Artificial Intelligence , Neural and Evolutionary Computing , Neurons and Cognition

Publish: 2024-11-27 22:12:29 UTC