Search NASA⌕ Search

SEARCH · Search NASA

Results for “Inverse problem”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

An Augmented Lagrangian Method for a Class of Inverse Quadratic Programming Problems

We consider an inverse quadratic programming (QP) problem in which the parameters in the objective function of a given QP problem are adjusted as little as possible so that a known feasible solution becomes the optimal one. We formulate this problem as a minimization problem with a positive semidefinite cone constraint and its dual is a linearly constrained semismoothly differentiable (SC{sup 1}) convex programming problem with fewer variables than the original one. We demonstrate the global convergence of the augmented Lagrangian method for the dual problem and prove that the convergence rate of primal iterates, generated by the augmented Lagrange method, is proportional to 1/r, and the rate of multiplier iterates is proportional to 1/{radical}r, where r is the penalty parameter in the augmented Lagrangian. As the objective function of the dual problem is a SC{sup 1} function involving the projection operator onto the cone of symmetrically semi-definite matrices, the analysis requires extensive tools such as the singular value decomposition of matrices, an implicit function theorem for semismooth functions, and properties of the projection operator in the symmetric-matrix space. Furthermore, the semismooth Newton method with Armijo line search is applied to solve the subproblems in the augmented Lagrange approach, which is proven to have global convergence and local quadratic rate. Finally numerical results, implemented by the augmented Lagrangian method, are reported.

97 MATHEMATICS AND COMPUTING↗

Programmable In Situ System for Iterative Workflows

We describe an in situ system for solving iterative problems. We specifically target inverse problems, where expensive simulations are approximated using a surrogate model. The model explores the parameter space of the simulation through iterative trials, each of which becomes a job managed by a parallel scheduler. Our work extends Henson [1], a cooperative multi-tasking system for in situ execution of loosely coupled codes.

Lohrmann, Erich↗

A composite neural network that learns from multi-fidelity data: Application to function approximation and inverse PDE problems

Presently the training of neural networks relies on data of comparable accuracy but in real applications only a very small set of high-fidelity data is available while inexpensive lower fidelity data may be plentiful. We propose a new composite neural network (NN) that can be trained based on multi-fidelity data. It is comprised of three NNs, with the first NN trained using the low-fidelity data and coupled to two high-fidelity NNs, one with activation functions and another one without, in order to discover and exploit nonlinear and linear correlations, respectively, between the low-fidelity and the high-fidelity data. We first demonstrate the accuracy of the new multi-fidelity NN for approximating some standard benchmark functions but also a 20-dimensional function that is not easy to approximate with other methods, e.g. Gaussian process regression. Subsequently, we extend the recently developed physics-informed neural networks (PINNs) to be trained with multi-fidelity data sets (MPINNs). MPINNs contain four fully-connected neural networks, where the first one approximates the low-fidelity data, while the second and third construct the correlation between the low- and high-fidelity data and produce the multi-fidelity approximation, which is then used in the last NN that encodes the partial differential equations (PDEs). Specifically, by decomposing the correlation into a linear and nonlinear part, the present model is capable of learning both the linear and complex nonlinear correlations between the low- and high-fidelity data adaptively. By training the MPINNs, we can: (1) obtain the correlation between the low- and high-fidelity data, (2) infer the quantities of interest based on a few scattered data, and (3) identify the unknown parameters in the PDEs. In particular, we employ the MPINNs to learn the hydraulic conductivity field for unsaturated flows as well as the reactive models for reactive transport. The results demonstrate that MPINNs can achieve relatively high accuracy based on a very small set of high-fidelity data. Despite the relatively low dimension and limited number of fidelities (two-fidelity levels) for the benchmark problems in the present study, the proposed model can be readily extended to very high-dimensional regression and classification problems involving multi-fidelity data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Collapse and backward motion of axisymmetric toroidal vortices in an accretion flow

The problem of the interaction of two coaxial, counter-rotating ring vortices in the presence of a convergent (accretion) flow with a sink at the center of symmetry has been solved. The vortices that would recede from each other in the absence of a flow (the problem inverse to the Helmholtz problem) are shown to be brought closer together by the flow and then ejected with acceleration along the axis of symmetry. The ejection velocity increases with sink strength. However, if the sink strength exceeds some critical value that depends on the initial conditions, then no ejection occurs and the vortices are captured by the flow and collapse. A similar capture and collapse are also possible during the motion of a single vortex in a flow. The difference from the planar case, where no collapse occurs, is significant. The detected phenomenon can be applied when studying nonlinear processes in atmospheric vortices as well as in active galactic nuclei and planetary atmospheres.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Material Discrimination for Treaty Verification with Multi-energy, X-ray Radiography

As nuclear warhead stockpiles are reduced under current and future arms treaties, accuracy in accountancy of material stockpiles becomes increasingly important. Image-based active interrogation offers advantages to spectroscopic detection in its ability to measure the location and extent of a material, or materials, of interest from a declaration. However, the detail that imaging provides is often viewed as too intrusive due to its potential to disseminate sensitive information. In this work, we present a method for reducing multi-energy, x-ray radiography data to a few important attributes, based on declarations from behind an information barrier, which can then be used to confirm or deny a declaration. We build on previous work by improving the physics modeling; considering currently attainable, multiple-endpoint x-ray systems; and posing the problem as a nonlinear, inverse problem. Regularization is added to the problem, which smooths the solution and stabilizes an otherwise unstable solution. Here we show the ability to discriminate high-atomic–number materials from others with simulated single-view multiple-endpoint radiography data and present results from initial bench-top measurements.

imaging↗

Generalized Multiscale Inversion for Heterogeneous Problems

In this work, we propose a generalized multiscale inversion algorithm for heterogeneous problems that aims at solving an inverse problem on a computational coarse grid. Previous inversion techniques for multiscale problems seek a coarse-grid medium properties, e.g., permeability and conductivity, and by doing so, they assume that there exists a homogenized representation of the underlying fine-scale permeability field on a coarse grid. Generally such assumptions do not hold for highly heterogeneous fields, e.g., fracture media or channelized fields, where the width of channels are very small compared to the scale of coarse grids. In these cases, grid refinement can lead to many degrees of freedom, and thus numerically unattractive to apply. The proposed algorithm is based on the Generalized Multiscale Finite Element Method (GMsFEM), which uses local spectral problems to identify non-localized features, i.e., channels (high-conductivity inclusions that connect the boundaries of the coarse-grid block). The inclusion of these features in the coarse space enables one to achieve a good accuracy. The approach is valid under the assumption that the solution can be well represented in a reduced-dimensional space spanned by multiscale basis functions. In practice, these basis functions are non-observable as we do not identify the fine-scale features of the permeability field. Our inversion algorithm finds the discretization parameters of the resulting system on the coarse grid. By doing so, we identify the appropriate coarse-grid parameters representing the permeability field instead of fine-grid permeability field. We illustrate the potential of the approach by numerical results for fractured media.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Adaptive Activation Functions Accelerate Convergence in Deep and Physics-informed Neural Networks

We employ adaptive activation functions for regression in deep and physics-informed neural networks (PINNs) to approximate smooth and discontinuous functions as well as solutions of linear and nonlinear partial differential equations. In particular, we solve the nonlinear Klein-Gordon equation, which has smooth solutions, the nonlinear Burgers equation, which can admit high gradient solutions, and the Helmholtz equation. We introduce a scalable hyper-parameter in the activation function, which can be optimized to achieve best performance of the network as it changes dynamically the topology of the loss function involved in the optimization process. The adaptive activation function has better learning capabilities than the traditional one (fixed activation) as it improves greatly the convergence rate, especially at early training, as well as the solution accuracy. To better understand the learning process, we plot the neural network solution in the frequency domain to examine how the network captures successively different frequency bands present in the solution. We consider both forward problems, where the approximate solutions are obtained, as well as inverse problems, where parameters involved in the governing equation are identified. Our simulation results show that the proposed method is a very simple and effective approach to increase the efficiency, robustness and accuracy of the neural network approximation of nonlinear functions as well as solutions of partial differential equations, especially for forward problems. We theoretically prove that in the proposed method, gradient descent algorithms are not attracted to suboptimal critical points or local minima.

machine leaning, Bad minima, Inverse problems, Phy↗

DiaMonD: An Integrated Multifaceted Approach to Mathematics at the Interfaces of Data, Models, and Decisions

For many problems in computational science and engineering, the so-called forward problem—solution of the underlying mathematical model to yield output quantities of interest, given input parameters—is difficult enough for frontier complex models, which are often characterized by coupled multiphysics and possibly stochastic behavior over a wide range of length and time scales. However, we face the need to move beyond the forward problem, to address what is often the ultimate goal of CS&E: decision making. This requires us to tackle a spectrum of mathematical problems that subsume, and are thus even more difficult than, the forward problem. First, given experimental data, we wish to estimate unknown parameters characterizing a model of a natural or engineered system by solving an inverse problem. Second, we seek the optimal configuration of the system (or experiments) by solving an optimal design problem. Third, the optimal operation of the system must be determined by solving an optimal control problem. And fourth, we must quantify uncertainties as they propagate through all of the preceding problems, from data to model inference to prediction and finally to optimal design and control. Optimal mathematical methods and algorithms for such end-to-end, data-to-decisions modeling and simulation of complex problems—requiring integrated solution of forward, inverse, optimization, and UQ problems for large, multiphysics, multiscale models—entails challenges of the highest order, while also presenting great opportunities for applied mathematics research. Unfortunately, research on forward, inverse, optimization, and UQ problems has all-too-often progressed in isolation. This has led to mathematical methods that perform well when considering the forward simulation in isolation, but are prohibitive or suboptimal or unstable when combined with other methods within the framework of inversion, optimization, or UQ. The reverse is also true: general-purpose methods developed within the inversion, optimization, and UQ fields often become prohibitive when applied to complex CS&E problems since they do not exploit their structure.

58 GEOSCIENCES↗