Processing math: 100%

2410.14759

Total: 1

#1 Universal approximation results for neural networks with non-polynomial activation function over non-compact domains [PDF] [Copy] [Kimi] [REL]

Authors: Ariel Neufeld, Philipp Schmocker

In this paper, we generalize the universal approximation property of single-hidden-layer feed-forward neural networks beyond the classical formulation over compact domains. More precisely, by assuming that the activation function is non-polynomial, we derive universal approximation results for neural networks within function spaces over non-compact subsets of a Euclidean space, e.g., weighted spaces, Lp-spaces, and (weighted) Sobolev spaces over unbounded domains, where the latter includes the approximation of the (weak) derivatives. Furthermore, we provide some dimension-independent rates for approximating a function with sufficiently regular and integrable Fourier transform by neural networks with non-polynomial activation function.

Subjects: Machine Learning , Machine Learning , Neural and Evolutionary Computing , Classical Analysis and ODEs

Publish: 2024-10-18 09:53:20 UTC