Disordered Systems and Neural Networks

2024-10-22 | | Total: 9

#1 Networks: The Visual Language of Complexity [PDF] [Copy] [Kimi] [REL]

Authors: Blai Vidiella ; Salva Duran-Nebreda ; Sergi Valverde

Understanding the origins of complexity is a fundamental challenge with implications for biological and technological systems. Network theory emerges as a powerful tool to model complex systems. Networks are an intuitive framework to represent inter-dependencies among many system components, facilitating the study of both local and global properties. However, it is unclear whether we can define a universal theoretical framework for evolving networks. While basic growth mechanisms, like preferential attachment, recapitulate common properties such as the power-law degree distribution, they fall short in capturing other system-specific properties. Tinkering, on the other hand, has shown to be very successful in generating modular or nested structures "for-free", highlighting the role of internal, non-adaptive mechanisms in the evolution of complexity. Different network extensions, like hypergraphs, have been recently developed to integrate exogenous factors in evolutionary models, as pairwise interactions are insufficient to capture environmentally-mediated species associations. As we confront global societal and climatic challenges, the study of network and hypergraphs provides valuable insights, emphasizing the importance of scientific exploration in understanding and managing complexity.

Subjects: Disordered Systems and Neural Networks ; Physics and Society ; Molecular Networks ; Populations and Evolution

Publish: 2024-10-21 16:22:02 UTC

#2 Amorphization-induced topological and insulator-metal transitions in bidimensional Bi$_x$Sb$_{1-x}$ alloys [PDF] [Copy] [Kimi] [REL]

Authors: A. J. Uría-Álvarez ; J. J. Palacios

Bismuth has been shown to be topological in its different allotropes and compounds, with one of the most notable examples being the Bi-Sb alloy, the first 3D topological insulator ever discovered. In this paper we explore two-dimensional alloys of Bi and Sb, both crystalline and amorphous, to determine the critical concentrations that render the alloys topological. For the amorphous alloy, we determine the effect of structural disorder on its topological properties, remarkably observing a trivial to topological transition as disorder increases. The alloys are modelled using a Slater-Koster tight-binding model and the topological behaviour is assessed through the entanglement spectrum together with artificial neural networks. Additionally, we perform electronic transport calculations with results compatible with those of the entanglement spectrum, which, furthermore, reveal an insulator to metal transition in the highly disordered regime.

Subjects: Disordered Systems and Neural Networks ; Materials Science

Publish: 2024-10-21 14:08:49 UTC

#3 Classifying extended, localized and critical states in quasiperiodic lattices via unsupervised learning [PDF1] [Copy] [Kimi] [REL]

Authors: Bohan Zheng ; Siyu Zhu ; Xingping Zhou ; Tong Liu

Classification of quantum phases is one of the most important areas of research in condensed matter physics. In this work, we obtain the phase diagram of one-dimensional quasiperiodic models via unsupervised learning. Firstly, we choose two advanced unsupervised learning algorithms, Density-Based Spatial Clustering of Applications with Noise (DBSCAN) and Ordering Points To Identify the Clustering Structure (OPTICS), to explore the distinct phases of Aubry-André-Harper model and quasiperiodic p-wave model. The unsupervised learning results match well with traditional numerical diagonalization. Finally, we compare the similarity of different algorithms and find that the highest similarity between the results of unsupervised learning algorithms and those of traditional algorithms has exceeded 98\%. Our work sheds light on applications of unsupervised learning for phase classification.

Subjects: Disordered Systems and Neural Networks ; Quantum Physics

Publish: 2024-10-19 10:49:47 UTC

#4 Modelling Structured Data Learning with Restricted Boltzmann Machines in the Teacher-Student Setting [PDF] [Copy] [Kimi] [REL]

Authors: Robin Thériault ; Francesco Tosello ; Daniele Tantari

Restricted Boltzmann machines (RBM) are generative models capable to learn data with a rich underlying structure. We study the teacher-student setting where a student RBM learns structured data generated by a teacher RBM. The amount of structure in the data is controlled by adjusting the number of hidden units of the teacher and the correlations in the rows of the weights, a.k.a. patterns. In the absence of correlations, we validate the conjecture that the performance is independent of the number of teacher patters and hidden units of the student RBMs, and we argue that the teacher-student setting can be used as a toy model for studying the lottery ticket hypothesis. Beyond this regime, we find that the critical amount of data required to learn the teacher patterns decreases with both their number and correlations. In both regimes, we find that, even with an relatively large dataset, it becomes impossible to learn the teacher patterns if the inference temperature used for regularization is kept too low. In our framework, the student can learn teacher patterns one-to-one or many-to-one, generalizing previous findings about the teacher-student setting with two hidden units to any arbitrary finite number of hidden units.

Subjects: Machine Learning ; Disordered Systems and Neural Networks

Publish: 2024-10-21 16:18:19 UTC

#5 On the Geometry of Regularization in Adversarial Training: High-Dimensional Asymptotics and Generalization Bounds [PDF] [Copy] [Kimi] [REL]

Authors: Matteo Vilucchio ; Nikolaos Tsilivis ; Bruno Loureiro ; Julia Kempe

Regularization, whether explicit in terms of a penalty in the loss or implicit in the choice of algorithm, is a cornerstone of modern machine learning. Indeed, controlling the complexity of the model class is particularly important when data is scarce, noisy or contaminated, as it translates a statistical belief on the underlying structure of the data. This work investigates the question of how to choose the regularization norm $\lVert \cdot \rVert$ in the context of high-dimensional adversarial training for binary classification. To this end, we first derive an exact asymptotic description of the robust, regularized empirical risk minimizer for various types of adversarial attacks and regularization norms (including non-$\ell_p$ norms). We complement this analysis with a uniform convergence analysis, deriving bounds on the Rademacher Complexity for this class of problems. Leveraging our theoretical results, we quantitatively characterize the relationship between perturbation size and the optimal choice of $\lVert \cdot \rVert$, confirming the intuition that, in the data scarce regime, the type of regularization becomes increasingly important for adversarial training as perturbations grow in size.

Subjects: Machine Learning ; Disordered Systems and Neural Networks ; Machine Learning ; Statistics Theory

Publish: 2024-10-21 14:53:12 UTC

#6 Active Inhomogeneous Mode-Coupling Theory (aIMCT) for Dense Systems of Self-Propelled Particles [PDF] [Copy] [Kimi] [REL]

Authors: Soumitra Kolya ; Puneet Pareek ; Saroj Kumar Nandi

Glassy dynamics in a dense system of active particles with self-propulsion force $f_0$ and persistence time $\tau_p$ are crucial for many biological processes. Recent studies have shown that, unlike relaxation dynamics, dynamic heterogeneity (DH) in active glasses exhibits nontrivial behavior. However, the mechanism by which activity affects DH remains unknown. We have developed an active inhomogeneous mode-coupling theory (aIMCT) for DH in active glasses. We show that the nontrivial behavior of DH comes from a novel nonequilibrium effect of activity that leads to distinct behaviors of DH and relaxation dynamics in active glasses. When activity is small, DH exhibits equilibrium-like behavior with a power-law divergence of the peak height of the four-point correlation function, $\chi_C^\text{peak}$, and the aIMCT value of the exponent, $\mu\simeq 1.0$, is consistent with the existing and our new simulations of active glasses. However, $\chi_C^\text{peak}$ deviates from the scaling relations at higher $f_0$ values because of the novel effect on DH, although the deviation with varying $\tau_p$ is relatively weak.

Subjects: Soft Condensed Matter ; Disordered Systems and Neural Networks

Publish: 2024-10-21 11:56:13 UTC

#7 On the Replica Symmetric Solution in General Diluted Spin Glasses [PDF] [Copy] [Kimi] [REL]

Authors: Ratul Biswas ; Wei-Kuo Chen ; Arnab Sen

We present a unifying approach to studying the replica symmetric solution in general diluted spin glass models on random $p$-uniform hypergraphs with sparsity parameter $\alpha$. Our result shows that there exist two key regimes in which the model exhibits replica symmetry and the free energy can be explicitly represented as the evaluation of an energy functional at the unique fixed point of a recursive distributional equation. One is called the high temperature regime, where the temperature and the sparsity parameter are essentially inversely proportional to each other; the other is the subcritical regime defined as $\alpha p (p-1)\leq 1$. In particular, the fact that the second regime is independent of the temperature parameter further allows us to deduce an analogous representation of the ground state energy in the subcritical regime. Along the way, we revisit several well-known formulas and also derive new ones for the free and ground state energies in the constraint satisfaction problem, Potts model, XY model, and continuous hardcore model.

Subjects: Probability ; Disordered Systems and Neural Networks

Publish: 2024-10-21 02:48:45 UTC

#8 Emerging quantum critical phase in a cluster spin-glass [PDF] [Copy] [Kimi] [REL]

Authors: Fang Zhang ; Tao Feng ; Yurong Ruan ; Xiaoyuan Ye ; Bing Wen ; Liang Zhou ; Minglin He ; Zhaotong Zhuang ; Liusuo Wu ; Hongtao He ; Peijie Sun ; Zhiyang Yu ; Weishu Liu ; Wenqing Zhang

Magnetic frustration has been recognized as pivotal to investigating new phases of matter in correlation-driven Kondo breakdown quantum phase transitions that are not clearly associated with broken symmetry. The nature of these new phases, however, remains underexplored. Here, we report quantum criticalities emerging from a cluster spin-glass in the heavy-fermion metal TiFe$_x$Cu$_{2x-1}$Sb, where frustration originates from intrinsic disorder. Specific heat and magnetic Grüneisen parameter measurements under varying magnetic fields exhibit quantum critical scaling, indicating a quantum critical point near 0.13 Tesla. As the magnetic field increases, the cluster spin-glass phase is progressively suppressed. Upon crossing the quantum critical point, resistivity and Hall effect measurements reveal enhanced screening of local moments and an expanding Fermi surface, consistent with the Kondo breakdown scenario.

Subjects: Strongly Correlated Electrons ; Disordered Systems and Neural Networks ; Materials Science

Publish: 2024-10-20 03:12:34 UTC

#9 Noise resilience in adaptive and symmetric monitored quantum circuits [PDF] [Copy] [Kimi] [REL]

Authors: Moein N. Ivaki ; Teemu Ojanen ; Ali G. Moghaddam

Monitored quantum circuits offer great perspectives for exploring the interplay of quantum information and complex quantum dynamics. These systems could realize the extensively studied entanglement and purification phase transitions, as well as a rich variety of symmetry-protected and ordered non-equilibrium phases. The central question regarding such phases is whether they survive in real-world devices exhibiting unavoidable symmetry-breaking noise. We study the fate of the symmetry-protected absorbing state and charge-sharpening transitions in the presence of symmetry-breaking noise, and establish that the net effect of noise results in coherent and incoherent symmetry-breaking effects. The coherent contribution removes a sharp distinction between different phases and renders phase transitions to crossovers. Nevertheless, states far away from the original phase boundaries retain their essential character. In fact, corrective feedback in adaptive quantum circuits and postselected measurements in symmetric charge-conserving quantum circuits can suppress the effects of noise, thereby stabilizing the absorbing and charge-sharp phases, respectively. Despite the unavoidable noise in current quantum hardwares, our findings offer an optimistic outlook for observing symmetry-protected phases in currently available Noisy Intermediate-Scale Quantum (NISQ) devices. Moreover, our work suggests a symmetry-based benchmarking method as an alternative for characterizing noise and evaluating average local gate fidelity.

Subjects: Quantum Physics ; Disordered Systems and Neural Networks ; Statistical Mechanics ; Strongly Correlated Electrons

Publish: 2024-10-18 18:00:33 UTC