Statistics Theory

Date: Fri, 19 Jul 2024 | Total: 9

#1 Optimal rates for estimating the covariance kernel from synchronously sampled functional data [PDF] [Copy] [Kimi]

Authors: Max Berger ; Hajo Holzmann

We obtain minimax-optimal convergence rates in the supremum norm, including infor-mation-theoretic lower bounds, for estimating the covariance kernel of a stochastic process which is repeatedly observed at discrete, synchronous design points. In particular, for dense design we obtain the $\sqrt n$-rate of convergence in the supremum norm without additional logarithmic factors which typically occur in the results in the literature. Surprisingly, in the transition from dense to sparse design the rates do not reflect the two-dimensional nature of the covariance kernel but correspond to those for univariate mean function estimation. Our estimation method can make use of higher-order smoothness of the covariance kernel away from the diagonal, and does not require the same smoothness on the diagonal itself. Hence, as in Mohammadi and Panaretos (2024) we can cover covariance kernels of processes with rough sample paths. Moreover, the estimator does not use mean function estimation to form residuals, and no smoothness assumptions on the mean have to be imposed. In the dense case we also obtain a central limit theorem in the supremum norm, which can be used as the basis for the construction of uniform confidence sets. Simulations and real-data applications illustrate the practical usefulness of the methods.

Subjects: Statistics Theory ; Methodology ; Statistics Theory

Publish: 2024-07-18 16:19:25 UTC

#2 Parameter estimation in hyperbolic linear SPDEs from multiple measurements [PDF] [Copy] [Kimi]

Authors: Anton Tiepner ; Eric Ziebell

The coefficients of elastic and dissipative operators in a linear hyperbolic SPDE are jointly estimated using multiple spatially localised measurements. As the resolution level of the observations tends to zero, we establish the asymptotic normality of an augmented maximum likelihood estimator. The rate of convergence for the dissipative coefficients matches rates in related parabolic problems, whereas the rate for the elastic parameters also depends on the magnitude of the damping. The analysis of the observed Fisher information matrix relies upon the asymptotic behaviour of rescaled $M, N$-functions generalising the operator sine and cosine families appearing in the undamped wave equation. In contrast to the energetically stable undamped wave equation, the $M, N$-functions emerging within the covariance structure of the local measurements have additional smoothing properties similar to the heat kernel, and their asymptotic behaviour is analysed using functional calculus.

Subjects: Statistics Theory ; Statistics Theory

Publish: 2024-07-18 12:35:49 UTC

#3 Wasserstein Distributionally Robust Optimization with Heterogeneous Data Sources [PDF] [Copy] [Kimi]

Authors: Yves Rychener ; Adrian Esteban-Perez ; Juan M. Morales ; Daniel Kuhn

We study decision problems under uncertainty, where the decision-maker has access to $K$ data sources that carry {\em biased} information about the underlying risk factors. The biases are measured by the mismatch between the risk factor distribution and the $K$ data-generating distributions with respect to an optimal transport (OT) distance. In this situation the decision-maker can exploit the information contained in the biased samples by solving a distributionally robust optimization (DRO) problem, where the ambiguity set is defined as the intersection of $K$ OT neighborhoods, each of which is centered at the empirical distribution on the samples generated by a biased data source. We show that if the decision-maker has a prior belief about the biases, then the out-of-sample performance of the DRO solution can improve with $K$ -- irrespective of the magnitude of the biases. We also show that, under standard convexity assumptions, the proposed DRO problem is computationally tractable if either $K$ or the dimension of the risk factors is kept constant.

Subjects: Optimization and Control ; Probability ; Statistics Theory ; Statistics Theory

Publish: 2024-07-18 15:24:54 UTC

#4 Nonconvex landscapes for $\mathbf{Z}_2$ synchronization and graph clustering are benign near exact recovery thresholds [PDF] [Copy] [Kimi]

Authors: Andrew D. McRae ; Pedro Abdalla ; Afonso S. Bandeira ; Nicolas Boumal

We study the optimization landscape of a smooth nonconvex program arising from synchronization over the two-element group $\mathbf{Z}_2$, that is, recovering $z_1, \dots, z_n \in \{\pm 1\}$ from (noisy) relative measurements $R_{ij} \approx z_i z_j$. Starting from a max-cut--like combinatorial problem, for integer parameter $r \geq 2$, the nonconvex problem we study can be viewed both as a rank-$r$ Burer--Monteiro factorization of the standard max-cut semidefinite relaxation and as a relaxation of $\{ \pm 1 \}$ to the unit sphere in $\mathbf{R}^r$. First, we present deterministic, non-asymptotic conditions on the measurement graph and noise under which every second-order critical point of the nonconvex problem yields exact recovery of the ground truth. Then, via probabilistic analysis, we obtain asymptotic guarantees for three benchmark problems: (1) synchronization with a complete graph and Gaussian noise, (2) synchronization with an Erd\H{o}s--R\'enyi random graph and Bernoulli noise, and (3) graph clustering under the binary symmetric stochastic block model. In each case, we have, asymptotically as the problem size goes to infinity, a benign nonconvex landscape near a previously-established optimal threshold for exact recovery; we can approach this threshold to arbitrary precision with large enough (but finite) rank parameter $r$. In addition, our results are robust to monotone adversaries.

Subjects: Optimization and Control ; Statistics Theory ; Statistics Theory

Publish: 2024-07-18 11:21:58 UTC

#5 Sampling from mixture distributions based on regime-switching diffusions [PDF] [Copy] [Kimi]

Author: M. V. Tretyakov

It is proposed to use stochastic differential equations with state-dependent switching rates (SDEwS) for sampling from finite mixture distributions. An Euler scheme with constant time step for SDEwS is considered. It is shown that the scheme converges with order one in weak sense and also in the ergodic limit. Numerical experiments illustrate the use of SDEwS for sampling from mixture distributions and confirm the theoretical results.

Subjects: Numerical Analysis ; Numerical Analysis ; Probability ; Statistics Theory ; Statistics Theory

Publish: 2024-07-18 10:57:14 UTC

#6 Movement-based models for abundance data [PDF] [Copy] [Kimi]

Authors: Ricardo Carrizo Vergara ; Marc Kéry ; Trevor Hefley

We develop two statistical models for space-time abundance data based on the modelling of an underlying continuous movement. Different from other models for abundance in the current statistical ecology literature, our models focus especially on an explicit connection between the movement of the individuals and the count, and on the space-time auto-correlation thus induced. Our first model (Snapshot) describes the count of free individuals with a false-negative detection error. Our second model (Capture) describes the capture and retention in traps of moving individuals, and it is constructed using an axiomatic approach establishing three simple principles, from which it is deduced that the density of the capture time is the solution of a Volterra integral equation of the second kind. We make explicit the space-time mean and covariance structures of the abundance fields thus generated, and we develop simulation methods for both models. The joint distribution of the space-time counts is an instance of a new multivariate distribution, here baptised the Evolving-Categories Multinomial distribution, for which we establish some key properties. Since a general expression of the likelihood remains intractable, we propose an approximated MLE fitting method by replacing it by a multivariate Gaussian one, which is justified by central limit theorem and respects mean and covariance structures. We apply this method to experimental data of fruit flies released in a meadow and repeatedly captured and counted in an array of traps. We estimate spread and advection parameters, compare our models to an Ecological Diffusion model, and conduct simulation studies to validate our analysis. Asymptotic consistency is experimentally verified. We conclude that we can estimate movement parameters using only abundance data, but must be aware of the necessary conditions to avoid underestimation of spread parameters.

Subjects: Applications ; Statistics Theory ; Statistics Theory

Publish: 2024-07-18 10:42:51 UTC

#7 Regularisation for the approximation of functions by mollified discretisation methods [PDF] [Copy] [Kimi]

Authors: Camille Pouchol ; Marc Hoffmann

Some prominent discretisation methods such as finite elements provide a way to approximate a function of $d$ variables from $n$ values it takes on the nodes $x_i$ of the corresponding mesh. The accuracy is $n^{-s_a/d}$ in $L^2$-norm, where $s_a$ is the order of the underlying method. When the data are measured or computed with systematical experimental noise, some statistical regularisation might be desirable, with a smoothing method of order $s_r$ (like the number of vanishing moments of a kernel). This idea is behind the use of some regularised discretisation methods, whose approximation properties are the subject of this paper. We decipher the interplay of $s_a$ and $s_r$ for reconstructing a smooth function on regular bounded domains from $n$ measurements with noise of order $\sigma$. We establish that for certain regimes with small noise $\sigma$ depending on $n$, when $s_a > s_r$, statistical smoothing is not necessarily the best option and {\it not regularising} is more beneficial than {\it statistical regularising}. We precisely quantify this phenomenon and show that the gain can achieve a multiplicative order $n^{(s_a-s_r)/(2s_r+d)}$. We illustrate our estimates by numerical experiments conducted in dimension $d=1$ with $\mathbb P_1$ and $\mathbb P_2$ finite elements.

Subjects: Numerical Analysis ; Numerical Analysis ; Statistics Theory ; Statistics Theory

Publish: 2024-07-18 08:14:48 UTC

#8 Rényi-infinity constrained sampling with $d^3$ membership queries [PDF] [Copy] [Kimi]

Authors: Yunbum Kook ; Matthew S. Zhang

Uniform sampling over a convex body is a fundamental algorithmic problem, yet the convergence in KL or R\'enyi divergence of most samplers remains poorly understood. In this work, we propose a constrained proximal sampler, a principled and simple algorithm that possesses elegant convergence guarantees. Leveraging the uniform ergodicity of this sampler, we show that it converges in the R\'enyi-infinity divergence ($\mathcal R_\infty$) with no query complexity overhead when starting from a warm start. This is the strongest of commonly considered performance metrics, implying rates in $\{\mathcal R_q, \mathsf{KL}\}$ convergence as special cases. By applying this sampler within an annealing scheme, we propose an algorithm which can approximately sample $\varepsilon$-close to the uniform distribution on convex bodies in $\mathcal R_\infty$-divergence with $\widetilde{\mathcal{O}}(d^3\, \text{polylog} \frac{1}{\varepsilon})$ query complexity. This improves on all prior results in $\{\mathcal R_q, \mathsf{KL}\}$-divergences, without resorting to any algorithmic modifications or post-processing of the sample. It also matches the prior best known complexity in total variation distance.

Subjects: Data Structures and Algorithms ; Machine Learning ; Statistics Theory ; Machine Learning ; Statistics Theory

Publish: 2024-07-17 19:20:08 UTC

#9 Concentration and moment inequalities for heavy-tailed random matrices [PDF] [Copy] [Kimi]

Authors: Moritz Jirak ; Stanislav Minsker ; Yiqiu Shen ; Martin Wahl

We prove Fuk-Nagaev and Rosenthal-type inequalities for the sums of independent random matrices, focusing on the situation when the norms of the matrices possess finite moments of only low orders. Our bounds depend on the "intrinsic" dimensional characteristics such as the effective rank, as opposed to the dimension of the ambient space. We illustrate the advantages of such results in several applications, including new moment inequalities for sample covariance matrices and the corresponding eigenvectors of heavy-tailed random vectors. Moreover, we demonstrate that our techniques yield sharpened versions of the moment inequalities for empirical processes.

Subjects: Probability ; Statistics Theory ; Statistics Theory

Publish: 2024-07-17 18:29:58 UTC