Numerical Analysis
- [1] arXiv:2405.09835 [pdf, ps, html, other]
-
Title: A high-order Eulerian-Lagrangian Runge-Kutta finite volume (EL-RK-FV) method for scalar conservation lawsComments: 29 pagesSubjects: Numerical Analysis (math.NA)
We present a class of high-order Eulerian-Lagrangian Runge-Kutta finite volume methods that can numerically solve Burgers' equation with shock formations, which could be extended to general scalar conservation laws. Eulerian-Lagrangian (EL) and semi-Lagrangian (SL) methods have recently seen increased development and have become a staple for allowing large time-stepping sizes. Yet, maintaining relatively large time-stepping sizes post shock formation remains quite challenging. Our proposed scheme integrates the partial differential equation on a space-time region partitioned by linear approximations to the characteristics determined by the Rankine-Hugoniot jump condition. We trace the characteristics forward in time and present a merging procedure for the mesh cells to handle intersecting characteristics due to shocks. Following this partitioning, we write the equation in a time-differential form and evolve with Runge-Kutta methods in a method-of-lines fashion. High-resolution methods such as ENO and WENO-AO schemes are used for spatial reconstruction. Extension to higher dimensions is done via dimensional splitting. Numerical experiments demonstrate our scheme's high-order accuracy and ability to sharply capture post-shock solutions with large time-stepping sizes.
- [2] arXiv:2405.09952 [pdf, ps, html, other]
-
Title: Low-rank Tree Tensor Network Operators for Long-Range Pairwise InteractionsSubjects: Numerical Analysis (math.NA)
Compactly representing and efficently applying linear operators are fundamental ingredients in tensor network methods for simulating quantum many-body problems and solving high-dimensional problems in scientific computing. In this work, we study such representations for tree tensor networks, the so called tree tensor network operators (TTNOs), paying particular attention to Hamiltonian operators that involve long-range pairwise interactions between particles. Generalizing the work by Lin, Tong, and others on matrix product operators, we establish a direct connection between the hierarchical low-rank structure of the interaction matrix and the TTNO property. This connection allows us to arrive at very compact TTNO representations by compressing the interaction matrix into a hierarchically semi-separable matrix. Numerical experiments for different quantum spin systems validate our results and highlight the potential advantages of TTNOs over matrix product operators.
- [3] arXiv:2405.10146 [pdf, ps, html, other]
-
Title: Single-ensemble multilevel Monte Carlo for discrete interacting-particle methodsSubjects: Numerical Analysis (math.NA)
To solve problems in domains such as filtering, optimization, and posterior sampling, interacting-particle methods have recently received much attention. These parallelizable and often gradient-free algorithms use an ensemble of particles that evolve in time, based on a combination of well-chosen dynamics and interaction between the particles. For computationally expensive dynamics -- for example, dynamics that solve inverse problems with an expensive forward model -- the cost of attaining a high accuracy quickly becomes prohibitive. We exploit a hierarchy of approximations to this forward model and apply multilevel Monte Carlo (MLMC) techniques, improving the asymptotic cost-to-error relation. More specifically, we use MLMC at each time step to estimate the interaction term within a single, globally-coupled ensemble. This technique was proposed by Hoel et al. in the context of the ensemble Kalman filter; the goal of the present paper is to study its applicability to a general framework of interacting-particle methods. After extending the algorithm and its analysis to a broad set of methods with fixed numbers of time steps, we motivate the application of the method to the class of algorithms with an infinite time horizon, which includes popular methods such as ensemble Kalman algorithms for optimization and sampling. Numerical tests confirm the improved asymptotic scaling of the multilevel approach.
New submissions for Friday, 17 May 2024 (showing 3 of 3 entries )
- [4] arXiv:2405.09752 (cross-list from eess.SP) [pdf, ps, html, other]
-
Title: Time-Varying Graph Signal Recovery Using High-Order Smoothness and Adaptive Low-ranknessSubjects: Signal Processing (eess.SP); Numerical Analysis (math.NA); Optimization and Control (math.OC)
Time-varying graph signal recovery has been widely used in many applications, including climate change, environmental hazard monitoring, and epidemic studies. It is crucial to choose appropriate regularizations to describe the characteristics of the underlying signals, such as the smoothness of the signal over the graph domain and the low-rank structure of the spatial-temporal signal modeled in a matrix form. As one of the most popular options, the graph Laplacian is commonly adopted in designing graph regularizations for reconstructing signals defined on a graph from partially observed data. In this work, we propose a time-varying graph signal recovery method based on the high-order Sobolev smoothness and an error-function weighted nuclear norm regularization to enforce the low-rankness. Two efficient algorithms based on the alternating direction method of multipliers and iterative reweighting are proposed, and convergence of one algorithm is shown in detail. We conduct various numerical experiments on synthetic and real-world data sets to demonstrate the proposed method's effectiveness compared to the state-of-the-art in graph signal recovery.
- [5] arXiv:2405.09826 (cross-list from nlin.SI) [pdf, ps, html, other]
-
Title: Lie symmetry analysis of (2+1)-dimensional time fractional Kadomtsev-Petviashvili equationSubjects: Exactly Solvable and Integrable Systems (nlin.SI); Mathematical Physics (math-ph); Analysis of PDEs (math.AP); Numerical Analysis (math.NA)
In this paper, Lie symmetry analysis method is applied to the (2+1)-dimensional time fractional Kadomtsev-Petviashvili (KP) equation with the mixed derivative of Riemann-Liouville time-fractional derivative and integer-order $x$-derivative. We obtained all the Lie symmetries admitted by the KP equation and used them to reduce the (2+1)-dimensional fractional partial differential equation with Riemann-Liouville fractional derivative to some (1+1)-dimensional fractional partial differential equations with Erdélyi-Kober fractional derivative or Riemann-Liouville fractional derivative, thereby getting some exact solutions of the reduced equations. In addition, the new conservation theorem and the generalization of Noether operators are developed to construct the conservation laws for the equation studied.
- [6] arXiv:2405.09992 (cross-list from math.PR) [pdf, ps, html, other]
-
Title: Convergence of kinetic Langevin samplers for non-convex potentialsComments: 44 pages, 3 figuresSubjects: Probability (math.PR); Numerical Analysis (math.NA)
We study three kinetic Langevin samplers including the Euler discretization, the BU and the UBU splitting scheme. We provide contraction results in $L^1$-Wasserstein distance for non-convex potentials. These results are based on a carefully tailored distance function and an appropriate coupling construction. Additionally, the error in the $L^1$-Wasserstein distance between the true target measure and the invariant measure of the discretization scheme is bounded. To get an $\varepsilon$-accuracy in $L^1$-Wasserstein distance, we show complexity guarantees of order $\mathcal{O}(\sqrt{d}/\varepsilon)$ for the Euler scheme and $\mathcal{O}(d^{1/4}/\sqrt{\varepsilon})$ for the UBU scheme under appropriate regularity assumptions on the target measure. The results are applicable to interacting particle systems and provide bounds for sampling probability measures of mean-field type.
- [7] arXiv:2405.10263 (cross-list from cs.LG) [pdf, ps, other]
-
Title: On Partially Unitary LearningComments: A working algorithm implementing Partially Unitary Learning arXiv:2212.14810 is developed and generalizedSubjects: Machine Learning (cs.LG); Numerical Analysis (math.NA); Quantum Physics (quant-ph); Machine Learning (stat.ML)
The problem of an optimal mapping between Hilbert spaces $IN$ of $\left|\psi\right\rangle$ and $OUT$ of $\left|\phi\right\rangle$ based on a set of wavefunction measurements (within a phase) $\psi_l \to \phi_l$, $l=1\dots M$, is formulated as an optimization problem maximizing the total fidelity $\sum_{l=1}^{M} \omega^{(l)} \left|\langle\phi_l|\mathcal{U}|\psi_l\rangle\right|^2$ subject to probability preservation constraints on $\mathcal{U}$ (partial unitarity). Constructed operator $\mathcal{U}$ can be considered as a $IN$ to $OUT$ quantum channel; it is a partially unitary rectangular matrix of the dimension $\dim(OUT) \times \dim(IN)$ transforming operators as $A^{OUT}=\mathcal{U} A^{IN} \mathcal{U}^{\dagger}$. An iteration algorithm finding the global maximum of this optimization problem is developed and it's application to a number of problems is demonstrated. A software product implementing the algorithm is available from the authors.
Cross submissions for Friday, 17 May 2024 (showing 4 of 4 entries )
- [8] arXiv:2210.07667 (replaced) [pdf, ps, html, other]
-
Title: A $\mu$-mode approach for exponential integrators: actions of $\varphi$-functions of Kronecker sumsSubjects: Numerical Analysis (math.NA)
We present a method for computing actions of the exponential-like $\varphi$-functions for a Kronecker sum $K$ of $d$ arbitrary matrices $A_\mu$. It is based on the approximation of the integral representation of the $\varphi$-functions by Gaussian quadrature formulas combined with a scaling and squaring technique. The resulting algorithm, which we call PHIKS, evaluates the required actions by means of $\mu$-mode products involving exponentials of the small sized matrices $A_\mu$, without forming the large sized matrix $K$ itself. PHIKS, which profits from the highly efficient level 3 BLAS, is designed to compute different $\varphi$-functions applied on the same vector or a linear combination of actions of $\varphi$-functions applied on different vectors. In addition, thanks to the underlying scaling and squaring techniques, the desired quantities are available simultaneously at suitable time scales. All these features allow the effective usage of PHIKS in the exponential integration context. In fact, our newly designed method has been tested on popular exponential Runge--Kutta integrators of stiff order from one to four, in comparison with state-of-the-art algorithms for computing actions of $\varphi$-functions. The numerical experiments with discretized semilinear evolutionary 2D or 3D advection--diffusion--reaction, Allen--Cahn, and Brusselator equations show the superiority of the proposed $\mu$-mode approach.
- [9] arXiv:2211.08375 (replaced) [pdf, ps, html, other]
-
Title: Stability and convergence of the Euler scheme for stochastic linear evolution equations in Banach spacesSubjects: Numerical Analysis (math.NA); Probability (math.PR)
For the Euler scheme of the stochastic linear evolution equations, discrete stochastic maximal $ L^p $-regularity estimate is established, and a sharp error estimate in the norm $ \|\cdot\|_{L^p((0,T)\times\Omega;L^q(\mathcal O))} $, $ p,q \in [2,\infty) $, is derived via a duality argument.
- [10] arXiv:2211.13739 (replaced) [pdf, ps, html, other]
-
Title: Numerical Approximation of Gaussian random fields on Closed SurfacesComments: 36 pages, 5 figures, 5 tablesSubjects: Numerical Analysis (math.NA)
We consider the numerical approximation of Gaussian random fields on closed surfaces defined as the solution to a fractional stochastic partial differential equation (SPDE) with additive white noise. The SPDE involves two parameters controlling the smoothness and the correlation length of the Gaussian random field. The proposed numerical method relies on the Balakrishnan integral representation of the solution and does not require the approximation of eigenpairs. Rather, it consists of a sinc quadrature coupled with a standard surface finite element method. We provide a complete error analysis of the method and illustrate its performances by several numerical experiments.
- [11] arXiv:2212.05694 (replaced) [pdf, ps, html, other]
-
Title: Open Source Implementations of Numerical Algorithms for Computing the Complete Elliptic Integral of the First KindComments: 22 pages, 11 figures, 5 tablesSubjects: Numerical Analysis (math.NA)
The complete elliptic integral of the first kind (CEI-1) plays in a significant role in mathematics, physics and engineering. There is no simple formula for its computation, thus numerical algorithms are essential for coping with practical problems involved. The commercial implementations for the numerical solutions, such as the functions ellipticK and EllipticK provided by MATLAB and Mathematica respectively, are based on $\mathcal{K}_{\mathrm{cs}}(m)$ instead of the usual form $K(k)$ such that $m = k^2$ and $\mathcal{K}_{\mathrm{cs}}(k^2) = K(k)$. It is necessary to develop open source implementations for the computation of the CEI-1 in order to avoid potential risks of using commercial software and possible limitations due to the unknown factors. In this paper, the infinite series method, arithmetic-geometric mean (AGM) method, Gauss-Chebyshev method and Gauss-Legendre methods are discussed in details with a top-down strategy. The four key algorithms for computing CEI-1 are designed, verified, validated and tested, which can be utilized in R\& D and be reused properly. Numerical results show that our open source implementations based on $K(k)$ are equivalent to the commercial implementation based on $\mathcal{K}_{\mathrm{cs}}(m)$. The general algorithms for computing orthogonal polynomials developed are significant byproducts in the sense of STEM education and scientific computation.
- [12] arXiv:2212.14853 (replaced) [pdf, ps, other]
-
Title: Particle method and quantization-based schemes for the simulation of the McKean-Vlasov equationJournal-ref: ESAIM: Mathematical Modelling and Numerical Analysis, 58(2), 571-612 (2024)Subjects: Numerical Analysis (math.NA); Probability (math.PR)
In this paper, we study three numerical schemes for the McKean-Vlasov equation \[\begin{cases} \;dX_t=b(t, X_t, \mu_t) \, dt+\sigma(t, X_t, \mu_t) \, dB_t,\: \\ \;\forall\, t\in[0,T],\;\mu_t \text{ is the probability distribution of }X_t, \end{cases}\] where $X_0$ is a known random variable. Under the assumption on the Lipschitz continuity of the coefficients $b$ and $\sigma$, our first result proves the convergence rate of the particle method with respect to the Wasserstein distance, which extends a previous work [BT97] established in one-dimensional setting. In the second part, we present and analyse two quantization-based schemes, including the recursive quantization scheme (deterministic scheme) in the Vlasov setting, and the hybrid particle-quantization scheme (random scheme, inspired by the $K$-means clustering). Two examples are simulated at the end of this paper: Burger's equation and the network of FitzHugh-Nagumo neurons in dimension 3.
- [13] arXiv:2305.04937 (replaced) [pdf, ps, html, other]
-
Title: Randomly sampling bipartite networks with fixed degree sequencesSubjects: Numerical Analysis (math.NA); Methodology (stat.ME)
Statistical analysis of bipartite networks frequently requires randomly sampling from the set of all bipartite networks with the same degree sequence as an observed network. Trade algorithms offer an efficient way to generate samples of bipartite networks by incrementally `trading' the positions of some of their edges. However, it is difficult to know how many such trades are required to ensure that the sample is random. I propose a stopping rule that focuses on the distance between sampled networks and the observed network, and stops performing trades when this distribution stabilizes. Analyses demonstrate that, for over 650 different degree sequences, using this stopping rule ensures a random sample with a high probability, and that it is practical for use in empirical applications.
- [14] arXiv:2306.07010 (replaced) [pdf, ps, html, other]
-
Title: Analytic and Gevrey class regularity for parametric elliptic eigenvalue problems and applicationsComments: 27 pages, 2 figuresSubjects: Numerical Analysis (math.NA)
We investigate a class of parametric elliptic eigenvalue problems with homogeneous essential boundary conditions where the coefficients (and hence the solution $u$) may depend on a parameter $y$. For the efficient approximate evaluation of parameter sensitivities of the first eigenpairs on the entire parameter space we propose and analyse Gevrey class and analytic regularity of the solution with respect to the parameters. This is made possible by a novel proof technique which we introduce and demonstrate in this paper. Our regularity result has immediate implications for convergence of various numerical schemes for parametric elliptic eigenvalue problems, in particular, for elliptic eigenvalue problems with infinitely many parameters arising from elliptic differential operators with random coefficients.
- [15] arXiv:2306.11365 (replaced) [pdf, ps, html, other]
-
Title: Discrete maximal regularity for the discontinuous Galerkin time-stepping method without logarithmic factorComments: The manuscript has been slightly modifiedSubjects: Numerical Analysis (math.NA)
Maximal regularity is a kind of a priori estimates for parabolic-type equations and it plays an important role in the theory of nonlinear differential equations. The aim of this paper is to investigate the temporally discrete counterpart of maximal regularity for the discontinuous Galerkin (DG) time-stepping method. We will establish such an estimate without logarithmic factor over a quasi-uniform temporal mesh. To show the main result, we introduce the temporally regularized Green's function and then reduce the discrete maximal regularity to a weighted error estimate for its DG approximation. Our results would be useful for investigation of DG approximation of nonlinear parabolic problems.
- [16] arXiv:2307.10980 (replaced) [pdf, ps, html, other]
-
Title: Denoising of Sphere- and SO(3)-Valued Data by Relaxed Tikhonov RegularizationSubjects: Numerical Analysis (math.NA); Optimization and Control (math.OC)
Manifold-valued signal- and image processing has received attention due to modern image acquisition techniques. Recently, a convex relaxation of the otherwise nonconvex Tikhonov-regularization for denoising circle-valued data has been proposed by Condat (2022). The circle constraints are here encoded in a series of low-dimensional, positive semi-definite matrices. Using Schur complement arguments, we show that the resulting variational model can be simplified while leading to the same solution. The simplified model can be generalized to higher dimensional spheres and to SO(3)-valued data, where we rely on the quaternion representation of the latter. Standard algorithms from convex analysis can be applied to solve the resulting convex minimization problem. As proof-of-the-concept, we use the alternating direction method of multipliers to demonstrate the denoising behavior of the proposed method. In a series of experiments, we demonstrate the numerical convergence of the signal- or image values to the underlying manifold.
- [17] arXiv:2310.16906 (replaced) [pdf, ps, html, other]
-
Title: Sensitivity Analysis of the Information Gain in Infinite-Dimensional Bayesian Linear Inverse ProblemsComments: 20 pages, 7 figuresSubjects: Numerical Analysis (math.NA)
We study the sensitivity of infinite-dimensional Bayesian linear inverse problems governed by partial differential equations (PDEs) with respect to modeling uncertainties. In particular, we consider derivative-based sensitivity analysis of the information gain, as measured by the Kullback-Leibler divergence from the posterior to the prior distribution. To facilitate this, we develop a fast and accurate method for computing derivatives of the information gain with respect to auxiliary model parameters. Our approach combines low-rank approximations, adjoint-based eigenvalue sensitivity analysis, and post-optimal sensitivity analysis. The proposed approach also paves way for global sensitivity analysis by computing derivative-based global sensitivity measures. We illustrate different aspects of the proposed approach using an inverse problem governed by a scalar linear elliptic PDE, and an inverse problem governed by the three-dimensional equations of linear elasticity, which is motivated by the inversion of the fault-slip field after an earthquake.
- [18] arXiv:2311.17032 (replaced) [pdf, ps, other]
-
Title: Stability estimates of Nystr\"om discretizations of Helmholtz decomposition boundary integral equation formulations for the solution of Navier scattering problems in two dimensions with Dirichlet boundary conditionsComments: 34 pages, 4 figuresSubjects: Numerical Analysis (math.NA)
Helmholtz decompositions of elastic fields is a common approach for the solution of Navier scattering problems. Used in the context of Boundary Integral Equations (BIE), this approach affords solutions of Navier problems via the simpler Helmholtz boundary integral operators (BIOs). Approximations of Helmholtz Dirichlet-to-Neumann (DtN) can be employed within a regularizing combined field strategy to deliver BIE formulations of the second kind for the solution of Navier scattering problems in two dimensions with Dirichlet boundary conditions, at least in the case of smooth boundaries. Unlike the case of scattering and transmission Helmholtz problems, the approximations of the DtN maps we use in the Helmholtz decomposition BIE in the Navier case require incorporation of lower order terms in their pseudodifferential asymptotic expansions. The presence of these lower order terms in the Navier regularized BIE formulations complicates the stability analysis of their Nyström discretizations in the framework of global trigonometric interpolation and the Kussmaul-Martensen kernel singularity splitting strategy. The main difficulty stems from compositions of pseudodifferential operators of opposite orders, whose Nyström discretization must be performed with care via pseudodifferential expansions beyond the principal symbol. The error analysis is significantly simpler in the case of arclength boundary parametrizations and considerably more involved in the case of general smooth parametrizations which are typically encountered in the description of one dimensional closed curves.
- [19] arXiv:2209.09936 (replaced) [pdf, ps, html, other]
-
Title: Solving Fredholm Integral Equations of the First Kind via Wasserstein Gradient FlowsComments: Accepted for publication in Stochastic Processes and their Applications. In the journal version we erroneously state that convergence to the unregularized functional requires stronger assumptions on the kernel $k$ than those considered here; in fact, this is not the case and one can apply [27, Theorem 4.1] or [82, Theorem 1] to obtain this result under A1 and A3Subjects: Optimization and Control (math.OC); Functional Analysis (math.FA); Numerical Analysis (math.NA); Computation (stat.CO); Methodology (stat.ME)
Solving Fredholm equations of the first kind is crucial in many areas of the applied sciences. In this work we adopt a probabilistic and variational point of view by considering a minimization problem in the space of probability measures with an entropic regularization. Contrary to classical approaches which discretize the domain of the solutions, we introduce an algorithm to asymptotically sample from the unique solution of the regularized minimization problem. As a result our estimators do not depend on any underlying grid and have better scalability properties than most existing methods. Our algorithm is based on a particle approximation of the solution of a McKean--Vlasov stochastic differential equation associated with the Wasserstein gradient flow of our variational formulation. We prove the convergence towards a minimizer and provide practical guidelines for its numerical implementation. Finally, our method is compared with other approaches on several examples including density deconvolution and epidemiology.
- [20] arXiv:2308.16731 (replaced) [pdf, ps, html, other]
-
Title: An Efficient Framework for Global Non-Convex Polynomial Optimization over the HypercubeSubjects: Optimization and Control (math.OC); Mathematical Software (cs.MS); Numerical Analysis (math.NA)
We present a novel efficient theoretical and numerical framework for solving global non-convex polynomial optimization problems. We analytically demonstrate that such problems can be efficiently reformulated using a non-linear objective over a convex set; further, these reformulated problems possess no spurious local minima (i.e., every local minimum is a global minimum). We introduce an algorithm for solving these resulting problems using the augmented Lagrangian and the method of Burer and Monteiro. We show through numerical experiments that polynomial scaling in dimension and degree is achievable for computing the optimal value and location of previously intractable global polynomial optimization problems in high dimension.