2024-08-15 | | Total: 18

Despite the recent popularity of attention-based neural architectures in core AI fields like natural language processing (NLP) and computer vision (CV), their potential in modeling complex physical systems remains under-explored. Learning problems in physical systems are often characterized as discovering operators that map between function spaces based on a few instances of function pairs. This task frequently presents a severely ill-posed PDE inverse problem. In this work, we propose a novel neural operator architecture based on the attention mechanism, which we coin Nonlocal Attention Operator (NAO), and explore its capability towards developing a foundation physical model. In particular, we show that the attention mechanism is equivalent to a double integral operator that enables nonlocal interactions among spatial tokens, with a data-dependent kernel characterizing the inverse mapping from data to the hidden parameter field of the underlying operator. As such, the attention mechanism extracts global prior information from training data generated by multiple systems, and suggests the exploratory space in the form of a nonlinear kernel map. Consequently, NAO can address ill-posedness and rank deficiency in inverse PDE problems by encoding regularization and achieving generalizability. We empirically demonstrate the advantages of NAO over baseline neural models in terms of generalizability to unseen data resolutions and system states. Our work not only suggests a novel neural operator architecture for learning interpretable foundation models of physical systems, but also offers a new perspective towards understanding the attention mechanism.

This paper continues the study of controlled interacting particle systems with common noise started in [W. Gangbo, S. Mayorga and A. {\'{S}}wi{\k{e}}ch, \textit{SIAM J. Math. Anal.} 53 (2021), no. 2, 1320--1356] and [S. Mayorga and A. {\'{S}}wi{\k{e}}ch, \textit{SIAM J. Control Optim.} 61 (2023), no. 2, 820--851]. First, we extend the following results of the previously mentioned works to the case of multiplicative noise: (i) We generalize the convergence of the value functions $u_n$ corresponding to control problems of $n$ particles to the value function $V$ corresponding to an appropriately defined infinite dimensional control problem; (ii) we prove, under certain additional assumptions, $C^{1,1}$ regularity of $V$ in the spatial variable. The second main contribution of the present work is the proof that if $DV$ is continuous (which, in particular, includes the previously proven case of $C^{1,1}$ regularity in the spatial variable), the value function $V$ projects precisely onto the value functions $u_n$. Using this projection property, we show that optimal controls of the finite dimensional problem correspond to optimal controls of the infinite dimensional problem and vice versa. In the case of a linear state equation, we are able to prove that $V$ projects precisely onto the value functions $u_n$ under relaxed assumptions on the coefficients of the cost functional by using approximation techniques in the Wasserstein space, thus covering cases where $V$ may not be differentiable.

We study the motion of a rigid body within a compressible, isentropic, and viscous fluid contained in a fixed bounded domain $\Omega \subset \mathbb{R}^3$. The fluid's behavior is described by the Navier-Stokes equations, while the motion of the rigid body is governed by ordinary differential equations representing the conservation of linear and angular momentum. We prescribe a time-independent fluid velocity along the boundary of $\Omega$ and a time-independent fluid density at the inflow boundary of $\Omega$. Additionally, we assume a no-slip boundary condition at the interface between the fluid and the rigid body. We prove existence of a weak solution to the given problem within a time interval where the rigid body does not touch the boundary $\partial\Omega$.

A Stokes wave is a traveling free-surface periodic water wave that is constant in the direction transverse to the direction of propagation. In 1981 McLean discovered via numerical methods that Stokes waves are unstable with respect to transverse perturbations. In \cite{CreNguStr} for the case of infinite depth we proved rigorously that the spectrum of the water wave system linearized at small Stokes waves, with respect to transverse perturbations, contains unstable eigenvalues lying approximately on an ellipse. In this paper we consider the case of finite depth and prove that the same spectral instability result holds for all but finitely many values of the depth. The computations and some aspects of the theory are considerably more complicated in the finite depth case.

Consider the family of semilinear parabolic problems \begin{equation*} \left\{ \begin{array}{lll} u_{t}(x,t) = \Delta u(x,t) - au(x,t) + f(u(x,t)), \,\,\, x \in \Omega_{\epsilon}, t > 0, \\ \frac{\partial u}{\partial N} (x,t) = g(u(x,t)), \,\,\, x \in \partial \Omega_{\epsilon}, t > 0, \end{array} \right. \end{equation*} where $a > 0$, $\Omega$ is the unit square, $\Omega_{\epsilon} = h_{\epsilon}(\Omega)$, $h_{\epsilon}$ is a family of $C^{m}$ - diffeomorphisms, $m \geq 1$, which converge to the identity of $\Omega$ in $C^{\alpha}$ norm, if $\alpha <1$ but do not converge in the $C^{1}$ - norm and, $f,g: \mathbb{R} \rightarrow \mathbb{R}$ are real functions. We show that a weak version of this problem, transported to the fixed domain $\Omega$ by a ``pull-back'' procedure, is well posed for $0 <\epsilon \leq \epsilon_{0}$, $\epsilon_{0} > 0$, in a suitable phase space, the associated semigroup has a global attractor $\mathcal{A}_{\epsilon}$ and the family $\{ \mathcal{A}_{\epsilon} \}_{0 \, < \, \epsilon \, \leq \, \epsilon_{0}}$ converges as $\epsilon \to 0$ to the attractor of the limiting problem: \begin{equation*}\ \left\{ \begin{array}{lll} u_{t}(x,t) = \Delta u(x,t) - au(x,t) + f(u(x,t)), \,\,\, x \in \Omega, t > 0, \\ \frac{\partial u}{\partial N} (x,t) = g(u(x,t))\mu, \,\,\, x \in \partial \Omega, t > 0, \end{array} \right. \end{equation*} where $\mu$ is essentially the limit of the Jacobian determinant of the diffeomorphism ${h_{\epsilon}}_{| \partial \Omega} : \partial \Omega \rightarrow \partial h_{\epsilon}(\Omega)$ (but does not depend on the particular family $h_{\epsilon})$.

We consider an electrodiffusion model describing the evolution of $N$ ionic species in a three-dimensional fluid flowing through a porous medium and forced by added body charges. We address the global well-posedness and long-time dynamics of the model. In the absence of added charges, we prove that the ionic concentrations decay exponentially fast in time to their initial spatial averages in all Sobolev norms. When the fluid undergoes the influence of given time-independent charges, we obtain the existence of a finite-dimensional global attractor.

In the theory of viscoelasticity, an important class of models admits a representation in terms of springs and dashpots. Widely used members of this class are the Maxwell model and its extended version. The paper concerns about the exact boundary controllability (abbreviated by EBC) for the reduced system (abbreviated by RS) associated to the extended Maxwell model (EMM). The initial boundary value problem (abbreviated by IBP) with a mixed type boundary condition (abbreviated by MBC) in the absence of the exterior force is called the augmented system (abbreviated by AD system). Here, the MBC consists of a homogeneous displacement boundary condition and inhomogeneous traction boundary condition with a boundary control. The RS is a closed subsystem inside the AD system (see Section \ref{sec1} for the details of the EMM and the RS). For the RS, we consider the IBP for the associated AD system. By using a dissipative structure of the RS in relation with the AD system, we will prove the EBC for the RS by a modified version of Russell's principle. Also, as an application of this EBC, we will show a partial boundary controllability (abbreviated by PBC) for the Boltzmann type viscoelastic system of equations (abbreviated by BVS) associated to the EMM. That is, for a large enough time $T>0$ and any pair of given speeds $(v_0, v_1)$, there is a boundary control which steers to have $v(0)=v^0,\,v(t)=v^1$, where $v(t)=\partial_t u(t)$ is the speed of the displacement vector $u(t)$ of BVS at time $t$.

We propose a nonlocal epidemic model whose spatial domain evolves over time and is represented by $[0,h(t)]$ with $h(t)$ standing for the spreading front of epidemic. It is assumed that the agents can cross the fixed boundary $x=0$, but they will die immediately if they do it, which implies that the area $(-\infty,0)$ is a hostile environment for the agents. We first show that this model is well posed, then prove that the longtime behaviors are governed by a spreading-vanishing dichotomy and finally give some criteria determining spreading and vanishing. Particularly, we obtain the asymptotical behaviors of the principal eigenvalue of a cooperative system with nonlocal diffusions without assuming the related nonlocal operator is self-adjoint, and the steady state problem of such cooperative system on half space $[0,\infty)$ is studied in detail.

We study a nonlocal Cahn-Hilliard model for a multicomponent mixture with cross-diffusion effects and degenerate mobility. The nonlocality is described by means of a symmetric singular kernel. We define a notion of weak solution adapted to possible degeneracies and prove, as our first main result, its global-in-time existence. The proof relies on an application of the formal gradient flow structure of the system (to overcome the lack of a-priori estimates), combined with an extension of the boundedness-by-entropy method, in turn involving a careful analysis of an auxiliary variational problem. This allows to obtain solutions to an approximate, time-discrete system. Letting the time step size go to zero, we recover the desired nonlocal weak solution where, due to their low regularity, the Cahn-Hilliard terms require a special treatment. Finally, we prove convergence of solutions for this class of nonlocal Cahn-Hilliard equations to their local counterparts.

We show existence and uniqueness of strong solutions to a Navier-Stokes/Cahn-Hilliard type system on a given two-dimensional evolving surface in the case of different densities and a singular (logarithmic) potential. The system describes a diffuse interface model for a two-phase flow of viscous incompressible fluids on an evolving surface. We also establish the validity of the instantaneous strict separation property from the pure phases. To show these results we use our previous achievements on local well-posedness together with suitable novel regularity results for the convective Cahn-Hilliard equation. The latter allows to obtain higher-order energy estimates to extend the local solution globally in time. To this aim the time evolution of energy type quantities has to be calculated and estimated carefully.

The energetically most efficient way how a deformed red blood cell regains equilibrium is mathematically described by the gradient flow of the Canham-Helfrich functional, including a spontaneous curvature and the conservation of surface area and enclosed volume. Using a recently discovered multiplicity inequality, we prove global existence and convergence of smooth solutions for spheres and axisymmetric tori, provided the initial energy lies below explicit thresholds.

We give a comprehensive description of Wasserstein gradient flows of maximum mean discrepancy (MMD) functionals $\mathcal F_\nu := \text{MMD}_K^2(\cdot, \nu)$ towards given target measures $\nu$ on the real line, where we focus on the negative distance kernel $K(x,y) := -|x-y|$. In one dimension, the Wasserstein-2 space can be isometrically embedded into the cone $\mathcal C(0,1) \subset L_2(0,1)$ of quantile functions leading to a characterization of Wasserstein gradient flows via the solution of an associated Cauchy problem on $L_2(0,1)$. Based on the construction of an appropriate counterpart of $\mathcal F_\nu$ on $L_2(0,1)$ and its subdifferential, we provide a solution of the Cauchy problem. For discrete target measures $\nu$, this results in a piecewise linear solution formula. We prove invariance and smoothing properties of the flow on subsets of $\mathcal C(0,1)$. For certain $\mathcal F_\nu$-flows this implies that initial point measures instantly become absolutely continuous, and stay so over time. Finally, we illustrate the behavior of the flow by various numerical examples using an implicit Euler scheme and demonstrate differences to the explicit Euler scheme, which is easier to compute, but comes with limited convergence guarantees.

We consider a two-species reaction-diffusion system in one space dimension that is derived from an epidemiological model in a spatially periodic environment with two types of pathogens: the wild type and the mutant. The system is of a hybrid nature, partly cooperative and partly competitive, but neither of these entirely. We study under what conditions the spreading of infection occurs when the pathogen are localized initially. We show that there is a well-defined spreading speed and that it coincides with the minimal speed of the traveling waves. Next, we study the homogenization limit of the traveling waves when the spatial period of the coefficients tends to zero. Finally, we give an example of the coefficients for which the right-bound and left-bound traveling waves have different speeds, via an analysis of a certain singular limit problem. Note that such an example never exists in scalar reaction-diffusion equations even with non-symmetric spatial heterogeneity.

In this paper, we consider the full compressible, viscous, non-resistive MHD system under the assumption that the fluids move on a plane while the magnetic field is oriented vertically. Within the framework of Besov spaces, by introducing several new unknown quantities and exploiting the intrinsic structure of the system, we prove the global well-posedness of strong solutions for initial data close to a constant equilibrium state. Furthermore, under some suitable additional conditions involving only the low-frequency part of the initial perturbation, we develop a Lyapunov-type energy argument, which yields the optimal time-decay rates of the global solution. To the best of our knowledge, our result is the first one on global solvability to the full compressible, viscous, non-resistive MHD system in multi-dimensional whole space.

In this paper, we concern with the existence of solutions of the complex $m-$Hessian type equation $-\chi(u)H_{m}(u)=\mu$ in the class $\mathcal{E}_{m,\chi}(f,\Omega)$ if there exists subsolution in this class, where the given boundary value $f\in\mathcal{N}_m(\Omega)\cap MSH_m(\Omega).$

In this paper, we are concerned with the initial boundary values problem associated to the compressible viscous non-resistive and heat-conducting magnetohydrodynamic flow, where the magnetic field is vertical. More precisely, by exploiting the intrinsic structure of the system and introducing several new unknown quantities, we overcome the difficulty stemming from the lack of dissipation for density and magnetic field, and prove the global well-posedness of strong solutions in the framework of Soboles spaces $H^3$. In addition, we also get the exponential decay for this non-resistive system. Different from the known results [23], [24], [42], we donot need the assumption that the background magnetic field is positive here.

The construction of Ekman boundary layer solutions near the non-flat boundaries presents a complex challenge, with limited research on this issue. In Masmoudi's pioneering work [Comm. Pure Appl. Math. 53 (2000), 432--483], the Ekman boundary layer solution was investigated on the domain $\mathbb{T}^2\times [\varepsilon B(x,y), 1]$, where $\varepsilon$ is a small constant and $B(x,y)$ denotes a periodic smooth function. This study investigates the influence of the geometric structure of the boundary $B(x,y)$ within the boundary layer. Specifically, for well-prepared initial data in the domain $\mathbb{R}^2\times[B(x,y), B(x,y)+2]$, if the boundary surface $B(x,y)$ is smooth and satisfies certain geometric constraints concerning its Gaussian and mean curvatures, then we derive an approximate boundary layer solution. Additionally, according to the curvature and incompressible conditions, the limit system we constructed is a 2D primitive system with damping and rotational effects. From the model's background, it reflects the characteristics arising from rotational effects. Finally, we validate the convergence of this approximate solution. No smallness condition on the amplitude of boundary $B(x, y)$ is required.

The paper contains a survey of the results obtained during the last ten years in the theory of elliptic boundary problems in H\"ormander function spaces, developed by the authors, and other related results of modern analysis. The basics of this theory and some of its applications are systematically expounded in the monograph "H\"ormander Spaces, Interpolation, and Elliptic Problems" (De Gruyter, Berlin/Boston, 2014) by the first two authors of the survey.