Processing math: 100%

Numerical Analysis

2025-07-09 | | Total: 17

#1 Aliasing in Convnets: A Frame-Theoretic Perspective [PDF1] [Copy] [Kimi1] [REL]

Authors: Daniel Haider, Vincent Lostanlen, Martin Ehler, Nicki Holighaus, Peter Balazs

Using a stride in a convolutional layer inherently introduces aliasing, which has implications for numerical stability and statistical generalization. While techniques such as the parametrizations via paraunitary systems have been used to promote orthogonal convolution and thus ensure Parseval stability, a general analysis of aliasing and its effects on the stability has not been done in this context. In this article, we adapt a frame-theoretic approach to describe aliasing in convolutional layers with 1D kernels, leading to practical estimates for stability bounds and characterizations of Parseval stability, that are tailored to take short kernel sizes into account. From this, we derive two computationally very efficient optimization objectives that promote Parseval stability via systematically suppressing aliasing. Finally, for layers with random kernels, we derive closed-form expressions for the expected value and variance of the terms that describe the aliasing effects, revealing fundamental insights into the aliasing behavior at initialization.

Subjects: Machine Learning , Numerical Analysis

Publish: 2025-07-08 16:34:43 UTC


#2 Fredholm Neural Networks for forward and inverse problems in elliptic PDEs [PDF] [Copy] [Kimi1] [REL]

Authors: Kyriakos Georgiou, Constantinos Siettos, Athanasios N. Yannacopoulos

Building on our previous work introducing Fredholm Neural Networks (Fredholm NNs/ FNNs) for solving integral equations, we extend the framework to tackle forward and inverse problems for linear and semi-linear elliptic partial differential equations. The proposed scheme consists of a deep neural network (DNN) which is designed to represent the iterative process of fixed-point iterations for the solution of elliptic PDEs using the boundary integral method within the framework of potential theory. The number of layers, weights, biases and hyperparameters are computed in an explainable manner based on the iterative scheme, and we therefore refer to this as the Potential Fredholm Neural Network (PFNN). We show that this approach ensures both accuracy and explainability, achieving small errors in the interior of the domain, and near machine-precision on the boundary. We provide a constructive proof for the consistency of the scheme and provide explicit error bounds for both the interior and boundary of the domain, reflected in the layers of the PFNN. These error bounds depend on the approximation of the boundary function and the integral discretization scheme, both of which directly correspond to components of the Fredholm NN architecture. In this way, we provide an explainable scheme that explicitly respects the boundary conditions. We assess the performance of the proposed scheme for the solution of both the forward and inverse problem for linear and semi-linear elliptic PDEs in two dimensions.

Subjects: Numerical Analysis , Machine Learning

Publish: 2025-07-08 14:40:44 UTC


#3 Conservative approximation-based feedforward neural network for WENO schemes [PDF] [Copy] [Kimi1] [REL]

Authors: Kwanghyuk Park, Jiaxi Gu, Jae-Hun Jung

In this work, we present the feedforward neural network based on the conservative approximation to the derivative from point values, for the weighted essentially non-oscillatory (WENO) schemes in solving hyperbolic conservation laws. The feedforward neural network, whose inputs are point values from the three-point stencil and outputs are two nonlinear weights, takes the place of the classical WENO weighting procedure. For the training phase, we employ the supervised learning and create a new labeled dataset for one-dimensional conservative approximation, where we construct a numerical flux function from the given point values such that the flux difference approximates the derivative to high-order accuracy. The symmetric-balancing term is introduced for the loss function so that it propels the neural network to match the conservative approximation to the derivative and satisfy the symmetric property that WENO3-JS and WENO3-Z have in common. The consequent WENO schemes, WENO3-CADNNs, demonstrate robust generalization across various benchmark scenarios and resolutions, where they outperform WENO3-Z and achieve accuracy comparable to WENO5-JS.

Subjects: Numerical Analysis , Machine Learning

Publish: 2025-07-08 17:19:48 UTC


#4 Notes on L2-estimates in linear elliptic equations with general coefficients [PDF] [Copy] [Kimi] [REL]

Author: Haesung Lee

This paper establishes an explicit L2-estimate for weak solutions u to linear elliptic equations in divergence form with general coefficients and external source term f, stating that the L2-norm of u over U is bounded by a constant multiple of the L2-norm of f over U. In contrast to classical approaches based on compactness arguments, the proposed method, which employs a divergence-free transformation method, provides a computable and explicit constant C>0. The L2-estimate remains robust even when there is no zero-order term, and the analysis further demonstrates that the constant C>0 decreases as the diffusion coefficient or the zero-order term increases. These quantitative results provide a rigorous foundation for applications such as a posteriori error estimates in Physics-Informed Neural Networks (PINNs), where explicit error bounds are essential.

Subject: Analysis of PDEs

Publish: 2025-07-07 12:38:04 UTC


#5 Approximate direct and inverse scattering for the AKNS system [PDF] [Copy] [Kimi] [REL]

Author: Vladislav V. Kravchenko

We study the direct and inverse scattering problems for the AKNS (Ablowitz-Kaup-Newell-Segur) system. New representations for the Jost solutions are obtained in the form of the power series in terms of a transformed spectral parameter. In terms of that parameter, the Jost solutions are convergent power series in corresponding unit disks. For the coefficients of the series simple recurrent integration procedures are devised. Solution of the direct scattering problem reduces to computing the coefficients and locating zeros of corresponding analytic functions in the interior of the unit disk. Solution of the inverse scattering problem reduces to the solution of two systems of linear algebraic equations for the power series coefficients, while the potentials are recovered from the first coefficients. The overall approach leads to a simple and efficient method for the numerical solution of both direct and inverse scattering problems, which is illustrated by numerical examples.

Subjects: Classical Analysis and ODEs , Mathematical Physics , Numerical Analysis , Exactly Solvable and Integrable Systems , Optics

Publish: 2025-07-07 22:45:04 UTC


#6 A Generalized 1-Merit Function SQP Method Using Function Approximations with Tunable Accuracy [PDF] [Copy] [Kimi] [REL]

Authors: Dane S. Grundvig, Matthias Heinkenschloss

This paper develops a generalization of the line-search sequential quadratic programming (SQP) algorithm with 1-merit function that uses objective and constraint function approximations with tunable accuracy to solve smooth equality-constrained optimization problems. The evaluation of objective and constraint functions and their gradients is potentially computationally expensive, but it is assumed that one can construct effective, computationally inexpensive models of these functions. This paper specifies how these models can be used to generate new iterates. At each iteration, the models have to satisfy function error and relative gradient error tolerances determined by the algorithm based on its progress. Moreover, bounds for the model errors are used to explore regions where the combined objective function and constraint models are sufficiently accurate. The algorithm has the same first-order global convergence properties as a line-search SQP algorithm with 1-merit function, but only uses objective and constraint function models and the model error bounds. The algorithm is applied to a discretized boundary control problem in which the evaluation of the objective and constraint functions requires the solution of the Boussinesq partial differential equation (PDE). The models are constructed from projection-based reduced-order models of the Boussinesq PDE.

Subjects: Optimization and Control , Numerical Analysis

Publish: 2025-07-08 17:26:21 UTC


#7 Multi-patch/multiple-scattering frequency-time hybrid solver for interior and exterior wave equation problems [PDF] [Copy] [Kimi] [REL]

Authors: Shuai Pan, Gang Bao, Tao Yin, Oscar P. Bruno

This paper proposes a new multiple-scattering frequency-time hybrid (FTH-MS) integral equation solver for problems of wave scattering by obstacles in two dimensional space, including interior problems in closed cavities and problems exterior to a set of disconnected open or closed scattering obstacles. The multiple-scattering FTH-MS method is based on a partition of the domain boundary into a user-prescribed set of overlapping open arcs, along with a corresponding sequence of multiple-scattering problems that effectively decompose the interior problem into a series of open-arc wave equation subproblems. The new strategy provides a significant extension of the original FTH-MS algorithm originally presented in [22], in that (1) By allowing for use of an arbitrary of number of component arcs, and not just two as in the previous contribution, the new approach affords (1a) A significantly increased geometric flexibility, as well as, (1b) The use of partitions for which each open arc leads to small numbers of iterations if iterative linear-algebra solvers are employed; and, (2) It facilitates parallelization -- as the subproblem solutions that are needed at each multiple scattering step can be evaluated in an embarrassingly parallel fashion. Utilizing a suitably-implemented Fourier transformation, each sub-problem is reduced to a Helmholtz frequency-domain problem that is tackled via a uniquely-solvable boundary integral equation. Similar FTH-MS methods are also presented for problems exterior to a number of bounded obstacles. All of the algorithms considered incorporate the previously introduced ``time-windowing and recentering'' methodology (that enables both treatment of incident signals of long duration and long time simulation), as well as a high-frequency Fourier transform algorithm that delivers numerically dispersionless, spectrally-accurate time evolution for arbitrarily long times.

Subject: Numerical Analysis

Publish: 2025-07-08 07:19:13 UTC


#8 A direct PinT algorithm for higher-order nonlinear equations [PDF] [Copy] [Kimi] [REL]

Authors: Shun-Zhi Zhong, Yong-Liang Zhao

This paper mainly studies a direct time-parallel algorithm for solving time-dependent differential equations of order 1 to 3. Different from the traditional time-stepping approach, we directly solve the all-at-once system from higher-order evolution equations by diagonalization the time discretization matrix B. Based on the connection between the characteristic equation and Chebyshev polynomials, we give explicit formulas for the eigenvector matrix V of B and its inverse V1 , and prove that cond2(V)=O(n3), where n is the number of time steps. A fast algorithm B designed by exploring the structure of the spectral decomposition of B. Numerical experiments were performed to validate the acceleration performance of the fast spectral decomposition algorithm. The results show that the proposed fast algorithm achieves significant computational speedup.

Subject: Numerical Analysis

Publish: 2025-07-08 07:42:30 UTC


#9 Regularized boundary integral equation methods for open-arc scattering problems in thermoelasticity [PDF] [Copy] [Kimi] [REL]

Authors: Yixuan X. Kong, José Pinto, Tao Yin

This paper devotes to developing novel boundary integral equation (BIE) solvers for the problem of thermoelastic scattering by open-arcs with four different boundary conditions in two dimensions. The proposed methodology is inspired by the Calderón formulas, whose eigenvalues are shown to accumulate at particular points depending only on Lamé parameters, satisfied by the thermoelastic boundary integral operators (BIOs) on both closed- and open-surfaces. Regularized BIEs in terms of weighted BIOs on open-arc that explicitly exhibits the edge singularity behavior, depending on the types of boundary conditions, of the unknown potentials are constructed to effectively reduce the required iteration number to solve the corresponding discretized linear systems. We implement the new formulations utilizing regularizations of singular integrals, which reduces the strongly- and hyper-singular integrals into weakly-singular integrals. Combined with spectrally accurate quadrature rules, numerical examples are presented to illustrate the accuracy and efficiency of the proposed solvers.

Subject: Numerical Analysis

Publish: 2025-07-08 07:48:24 UTC


#10 On the detection of medium inhomogeneity by contrast agent: wave scattering models and numerical implementations [PDF] [Copy] [Kimi] [REL]

Authors: Zhe Wang, Ahcene Ghandriche, Jijun Liu

We consider the wave scattering and inverse scattering in an inhomogeneous medium embedded a homogeneous droplet with a small size, which is modeled by a constant mass density and a small bulk modulus. Based on the Lippmann-Schwinger integral equation for scattering wave in inhomogeneous medium, we firstly develop an efficient approximate scheme for computing the scattered wave as well as its far-field pattern for any droplet located in the inhomogeneous background medium. By establishing the approximate relation between the far-field patterns of the scattered wave before and after the injection of a droplet, the scattered wave of the inhomogeneous medium after injecting the droplet is represented by a measurable far-field patterns, and consequently the inhomogeneity of the medium can be reconstructed from the Helmholtz equation. Finally, the reconstruction process in terms of the dual reciprocity method is proposed to realize the numerical algorithm for recovering the bulk modulus function inside a bounded domain in three dimensional space, by moving the droplet inside the bounded domain. Numerical implementations are given using the simulation data of the far-field pattern to show the validity of the reconstruction scheme, based on the mollification scheme for dealing with the ill-posedness of this inverse problem.

Subjects: Numerical Analysis , Mathematical Physics

Publish: 2025-07-08 08:25:10 UTC


#11 A nonsmooth extension of the Brezzi-Rappaz-Raviart approximation theorem via metric regularity techniques and applications to nonlinear PDEs [PDF] [Copy] [Kimi] [REL]

Authors: Jules Berry, Olivier Ley, Francisco José Silva

We generalize the Brezzi-Rappaz-Raviart approximation theorem, which allows to obtain existence and a priori error estimates for approximations of solutions to some nonlinear partial differential equations. Our contribution lies in the fact that we typically allow for nonlinearities having merely Lipschitz regularity, while previous results required some form of differentiability. This is achieved by making use of the theory of metrically regular mappings, developed in the context of variational analysis. We apply this generalization to derive some quasi-optimal error estimates for finite element approximations to solutions of viscous Hamilton-Jacobi equations and second order mean field games systems.

Subject: Numerical Analysis

Publish: 2025-07-08 08:27:50 UTC


#12 A generalized Hessian-based error estimator for an IPDG formulation of the biharmonic problem in two dimensions [PDF] [Copy] [Kimi] [REL]

Authors: Théophile Chaumont-Frelet, Joscha Gedicke, Lorenzo Mascotto

We consider a two dimensional biharmonic problem and its discretization by means of a symmetric interior penalty discontinuous Galerkin method. Based on the ``div-div'' complex, a novel split of an error measure based on a generalized Hessian into two terms measuring the conformity and nonconformity of the scheme is proven. This splitting is the departing point for the design of a new reliable and efficient error estimator, which does not involve any DG stabilization. Such an error estimator can be bounded from above by the standard DG residual error estimator. Numerical results assess the theoretical predictions, including the efficiency of the proposed estimator.

Subject: Numerical Analysis

Publish: 2025-07-08 08:30:37 UTC


#13 A relaxation scheme for the equations of isentropic gas dynamics on a network with jump transmission conditions [PDF] [Copy] [Kimi] [REL]

Authors: Magali Ribot, Roberto Natalini, Maya Briani

In this paper we propose a new numerical scheme of relaxation type to approximate the Euler equations of isentropic gas dynamics on the arcs of a network. At the junction mass conservation and a jump transmission condition on the density are given, and a new solver is introduced to deal with both subsonic and supersonic cases. Consistency properties of the solver are proven and numerical tests are displayed to show its good performance also with respect to other possible solvers.

Subject: Numerical Analysis

Publish: 2025-07-08 08:37:28 UTC


#14 The Neural Approximated Virtual Element Method for Elasticity Problems [PDF] [Copy] [Kimi] [REL]

Authors: Stefano Berrone, Moreno Pintore, Gioana Teora

We present the Neural Approximated Virtual Element Method to numerically solve elasticity problems. This hybrid technique combines classical concepts from the Finite Element Method and the Virtual Element Method with recent advances in deep neural networks. Specifically, it is a polygonal method in which the virtual basis functions are element-wise approximated by a neural network, eliminating the need for stabilization or projection operators typical of the standard virtual element method. We present the discrete formulation of the problem and provide numerical tests on both linear and non-linear elasticity problems, demonstrating the advantages of having a simple discretization, particularly in handling non-linearities.

Subject: Numerical Analysis

Publish: 2025-07-08 08:44:15 UTC


#15 Weak Galerkin Methods for the Brinkman Equations [PDF] [Copy] [Kimi] [REL]

Authors: Chunmei Wang, Shangyou Zhang

This paper introduces a novel weak Galerkin (WG) finite element method for the numerical solution of the Brinkman equations. The Brinkman model, which seamlessly integrates characteristics of both the Stokes and Darcy equations, is employed to describe fluid flow in multiphysics contexts, particularly within heterogeneous porous media exhibiting spatially variable permeability. The proposed WG method offers a unified and robust approach capable of accurately capturing both Stokes- and Darcy-dominated regimes. A discrete inf-sup condition is established, and optimal-order error estimates are rigorously proven for the WG finite element solutions. Furthermore, a series of numerical experiments is performed to corroborate the theoretical analysis, demonstrating the method's accuracy and stability in addressing the complexities inherent in the Brinkman equations.

Subject: Numerical Analysis

Publish: 2025-07-08 12:51:05 UTC


#16 A posteriori analysis of neural network approximations [PDF] [Copy] [Kimi] [REL]

Authors: Thomas Führer, Sergio Rojas

In a general setting, we study a posteriori estimates used in finite element analysis to measure the error between a solution and its approximation. The latter is not necessarily generated by a finite element method. We show that the error is equivalent to the sum of two residuals provided that the underlying variational formulation is well posed. The first contribution is the projection of the residual to a finite-dimensional space and is therefore computable, while the second one can be reliably estimated by a computable upper bound in many practical scenarios. Assuming sufficiently accurate quadrature, our findings can be used to estimate the error of, e.g., neural network outputs. Two important applications can be considered during optimization: first, the estimators are used to monitor the error in each solver step, or, second, the two estimators are included in the loss functional, and therefore provide control over the error. As a model problem, we consider a second-order elliptic partial differential equation and discuss different variational formulations thereof, including several options to include boundary conditions in the estimators. Various numerical experiments are presented to validate our findings.

Subject: Numerical Analysis

Publish: 2025-07-08 14:23:55 UTC


#17 Learning-Enhanced Variational Regularization for Electrical Impedance Tomography via \Calderon's Method [PDF] [Copy] [Kimi] [REL]

Authors: Kai Li, Kwancheol Shin, Zhi Zhou

This paper aims to numerically solve the two-dimensional electrical impedance tomography (EIT) with Cauchy data. This inverse problem is highly challenging due to its severe ill-posed nature and strong nonlinearity, which necessitates appropriate regularization strategies. Choosing a regularization approach that effectively incorporates the \textit{a priori} information of the conductivity distribution (or its contrast) is therefore essential. In this work, we propose a deep learning-based method to capture the \textit{a priori} information about the shape and location of the unknown contrast using \Calderon's method. The learned \textit{a priori} information is then used to construct the regularization functional of the variational regularization method for solving the inverse problem. The resulting regularized variational problem for EIT reconstruction is then solved using the Gauss-Newton method. Extensive numerical experiments demonstrate that the proposed inversion algorithm achieves accurate reconstruction results, even in high-contrast cases, and exhibits strong generalization capabilities. Additionally, some stability and convergence analysis of the variational regularization method underscores the importance of incorporating \textit{a priori} information about the support of the unknown contrast.

Subject: Numerical Analysis

Publish: 2025-07-08 15:55:22 UTC