Search NASA⌕ Search

SEARCH · Search NASA

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Nonlinear registration of serial coronary CT angiography (CCTA) for assessment of changes in atherosclerotic plaque

Purpose: Coronary CT angiography (CCTA) is a high-resolution three-dimensional imaging technique for the evaluation of coronary arteries in suspected or confirmed coronary artery disease (CAD). Coregistration of serial CCTA scans would allow precise superimposition of images obtained at two different points in time, which could aid in recognition of subtle changes and precise monitoring of coronary plaque progression or regression. To this end, the authors aimed at developing a fully automatic nonlinear volume coregistration for longitudinal CCTA scan pairs. Methods: The algorithm combines global displacement and local deformation using nonlinear volume coregistration with a volume-preserving constraint. Histogram matching of intensities between two serial scans is performed prior to nonlinear coregistration with dense nonparametric local deformation in which sum of squared differences is used as a similarity measure. The approximate segmentation of coronary arteries obtained from commercially available software provides initial anatomical landmarks for the coregistration algorithm that help localize and emphasize the structure of interest. To avoid possible bias caused by incorrect segmentation, the authors convolve the Gaussian kernel with the segmented binary coronary tree mask and define an extended weighted region of interest. A multiresolution approach is employed to represent coarse-to-fine details of both volumes and the energy function is optimized using a gradient descent method. The authors applied the algorithm in ten paired CCTA datasets (20 scans in total) obtained within 10.7{+-}5.7 months from each other on a dual source CT scanner to monitor progression of CAD. Results: Serial CCTA coregistration was successful in 9/10 cases as visually confirmed. The global displacement and local deformation of target registration error obtained from four anatomical landmarks were 2.22{+-}1.15 and 1.56{+-}0.74 mm, respectively, and the inverse consistency error of local deformation was 0.14{+-}0.06 mm. The observer variability between two expert observers was 1.31{+-}0.91 mm. Conclusions: The proposed coregistration algorithm demonstrates potential to accurately register serial CCTA scans, which may allow direct comparison of calcified and noncalcified atherosclerotic plaque changes between the two scans.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Streaming Generalized Canonical Polyadic Tensor Decompositions

In this paper, we develop a method which we call OnlineGCP for computing the Generalized Canonical Polyadic (GCP) tensor decomposition of streaming data. GCP differs from traditional canonical polyadic (CP) tensor decompositions as it allows for arbitrary objective functions which the CP model attempts to minimize. This approach can provide better fits and more interpretable models when the observed tensor data is strongly non-Gaussian. In the streaming case, tensor data is gradually observed over time and the algorithm must incrementally update a GCP factorization with limited access to prior data. In this work, we extend the GCP formalism to the streaming context by deriving a GCP optimization problem to be solved as new tensor data is observed, formulate a tunable history term to balance reconstruction of recently observed data with data observed in the past, develop a scalable solution strategy based on segregated solves using stochastic gradient descent methods, describe a software implementation that provides performance and portability to contemporary CPU and GPU architectures and integrates with Matlab for enhanced usability, and demonstrate the utility and performance of the approach and software on several synthetic and real tensor data sets.

97 MATHEMATICS AND COMPUTING↗

Reliable and Efficient Machine Learning (Final Technical Report)

Modern scientific experiments generate massive amounts of data at a pace much faster than humans can manually analyze. While machine learning has revolutionized commercial data analysis (such as recommending movies or recognizing faces), applying these tools to complex scientific discovery is challenging because scientific answers must be precise, interpretable, and adhere to physical laws. The research under this project aims to develop new mathematical tools and computer algorithms specifically designed for scientific applications. Major progress has been made in automatically cleaning and deconstructing messy experimental data, analyzing the visual information of physical phenomena, determining the underlying physical variables, and providing rig orous mathematical analysis of interesting algorithms and concepts widely used in machine learning. This project addressed the critical gap between our ability to generate massive scientific data and our ability to extract interpretable information from it. We established mathematical foundations for Scientific Machine Learning (SciML) aimed at effective data analytics and automated discovery. Our work focused on three core objectives: (1) developing reliable feature extraction methods for dynamic high-dimensional data, (2) establishing mathematical foundations for discovering dynamics via neural networks, and (3) creating rigorous optimization techniques for these models. Key outcomes come from two fronts. On the practical side, they include the development of algorithms that significantly enhance the extraction of signals from field data, as well as the capability to handle situations that exhibit smooth variations or physical stretching due to temperature changes. They also include the creation of an automated framework for discovering fundamental state variables from raw experimental data, demonstrating the ability to identify intrinsic physical dimensions without prior knowledge of the governing laws. On the theoretical front, the research results in theoretical advances in Optimal Transport, a widely used notion in SciML, specifically regarding functions with fixed-size nodal sets, provide sharp bounds relevant to uncertainty quantification. Meanwhile, the outcomes also include the establishment of convergence theories for nonlocal gradient descent methods, enabling robust optimization with noisy data in high-dimensional settings commonly encountered in scientific modeling. The project also helps creating opportunities to train the next generation of researchers, equipping them with the necessary technical skills for today’s workplace and preparing them for future advances.

97 MATHEMATICS AND COMPUTING↗

ON A METHOD TO RESOLVE THE NUCLEAR ACTIVITY IN GALAXIES AS APPLIED TO THE SEYFERT 2 GALAXY NGC 1358

Nuclear regions of galaxies generally host a mixture of components with different excitations, compositions, and kinematics. Derivation of emission line ratios and kinematics could then be misleading if due correction is not made for the limited spatial and spectral resolutions of the observations. The aim of this paper is to demonstrate, with application to a long-slit spectrum of the Seyfert 2 galaxy NGC 1358, how line intensities and velocities, together with modeling and knowledge of the point-spread function, may be used to resolve the differing structures. In the situation outlined above, the observed kinematics differs for different spectral lines. From the observed intensity and velocity distributions of a number of spectral lines, and with some reasonable assumptions about the structure of different subcomponents to diminish the number of free parameters, the true line ratios and velocity structures may be deduced. A preliminary solution for the nuclear structure of NGC 1358 is obtained, involving a nuclear point source and an emerging outflow of high excitation, ending with shock and postshock cloud as revealed by the velocities, as well as a nuclear emission-line disk rotating in the potential of a stellar bulge and expressing a radial excitation gradient. The method results in a likely scenario for the nuclear structure of the Seyfert 2 galaxy NGC 1358. For definitive results, an extrapolation of the method to two dimensions combined with the use of integral field spectroscopy will be necessary.

79 ASTRONOMY AND ASTROPHYSICS↗

An extended variational method for the resistive wall mode in toroidal plasma confinement devices

The external-kink stability of a toroidal plasma surrounded by a rigid resistive wall is investigated. The well-known analysis of Haney and Freidberg is rigorously extended to allow for a wall that is sufficiently thick that the thin-shell approximation does not necessarily hold. A generalized Haney–Freidberg formula for the growth-rate of the resistive wall mode is obtained. Thick-wall effects do not change the marginal stability point of the mode but introduce an interesting asymmetry between growing and decaying modes. Growing modes have growth-rates that exceed those predicted by the original Haney–Freidberg formula. On the other hand, decaying modes have decay-rates that are less than those predicted by the original formula. The well-known Hu–Betti formula for the rotational stabilization of the resistive wall mode is also generalized to take thick-wall effects into account. Increasing wall thickness facilitates the rotational stabilization of the mode, because it decreases the critical toroidal electromagnetic torque that the wall must exert on the plasma. On the other hand, the real frequency of the mode at the marginal stability point increases with increasing wall thickness.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Tailoring the Electronic Structures and Spectral Properties of ZnO with Irradiation Defects Generated Under Intense Electronic Excitation: A Combined Experimental and DFT Approach

Here, the relationship between the composition of the internal defect states, spectral properties, and correlated electronic structures of wurtzite zinc oxide (ZnO) crystals under 645 MeV Xe 35+ irradiation is systematically investigated, employing experimental characterizations combined with first-principle calculations. Based on the ion irradiation-induced thermal expansion and relaxation processes, the high concentration of vacancy/interstitial defects produced from the transient disordered phase in molten track states trigger photoelectric changes, as follows: i) the generation of internal defect states effectively reduces the intrinsic bandgap (3.25 eV → 2.66 eV); ii) a large number of defective active sites inhibits the recombination between electron–hole pairs, causing dark conductance and photoconductance to increase with increasing damage levels until optimal fluence is achieved. Based on the density functional theory (DFT) with the GGA + U (GGA = generalized gradient approximation) method, the defective models associated with the different electronic structures, density of states, formation energy, and the nature of the chemical bonding are established. The narrowing of the bandgap observed experimentally and the enhancement of carrier concentration originating from the internal electron defect states are qualitatively verified, therefore laying the foundation for designing future nanoscale photoelectronic devices and microelectronics applications.

36 MATERIALS SCIENCE↗

Mechanisms of Complete Dissociation of CO 2 on Iron Clusters

Dissociation of CO 2 on iron clusters was studied by using semilocal density functional theory and basis sets of triple-zeta quality. Fe 2 , Fe 4 , and Fe 16 clusters were selected as the representative host clusters. When searching for isomers of Fe n CO 2 , n=2, 4 and 16 corresponding to carbon dioxide attachment to the host clusters, its reduction to O and CO, and to the complete dissociation, it was found that the total spin magnetic moments of the lowest energy states of the isomers are often quenched with respect to those of initial reagents Fe n +CO 2 . Dissociation pathways of the Fe 2 +CO 2 , Fe 4 +CO 2 , and Fe 16 +CO 2 reactions contain several transition states separated by the local minima states; therefore, a natural question is where do the spin flips occur? Since lifetimes of magnetically excited states were shown to be of the order of 100 fs, the search for the CO 2 dissociation pathways was performed under the assumption that magnetic deexcitation may occur at the intermediate local minima. Two dissociation pathways were obtained for each Fe n +CO 2 reaction using the gradient-based methods. It was found that the Fe 2 +CO 2 reaction is endothermic with respect to both reduction and complete dissociation of CO 2 , whereas the Fe 4 +CO 2 and Fe 16 +CO 2 reactions are exothermic to both reduction and complete dissociation of carbon dioxide. Finally, the CO 2 reduction was found to be more favorable than its complete dissociation in the Fe 4 case.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A nonlinearly preconditioned conjugate gradient algorithm for rank‐ R canonical tensor approximation

Summary Alternating least squares (ALS) is often considered the workhorse algorithm for computing the rank‐ R canonical tensor approximation, but for certain problems, its convergence can be very slow. The nonlinear conjugate gradient (NCG) method was recently proposed as an alternative to ALS, but the results indicated that NCG is usually not faster than ALS. To improve the convergence speed of NCG, we consider a nonlinearly preconditioned NCG (PNCG) algorithm for computing the rank‐ R canonical tensor decomposition. Our approach uses ALS as a nonlinear preconditioner in the NCG algorithm. Alternatively, NCG can be viewed as an acceleration process for ALS. We demonstrate numerically that the convergence acceleration mechanism in PNCG often leads to important pay‐offs for difficult tensor decomposition problems, with convergence that is significantly faster and more robust than for the stand‐alone NCG or ALS algorithms. We consider several approaches for incorporating the nonlinear preconditioner into the NCG algorithm that have been described in the literature previously and have met with success in certain application areas. However, it appears that the nonlinearly PNCG approach has received relatively little attention in the broader community and remains underexplored both theoretically and experimentally. Thus, this paper serves several additional functions, by providing in one place a concise overview of several PNCG variants and their properties that have only been described in a few places scattered throughout the literature, by systematically comparing the performance of these PNCG variants for the tensor decomposition problem, and by drawing further attention to the usefulness of nonlinearly PNCG as a general tool. In addition, we briefly discuss the convergence of the PNCG algorithm. In particular, we obtain a new convergence result for one of the PNCG variants under suitable conditions, building on known convergence results for non‐preconditioned NCG. Copyright © 2014 John Wiley & Sons, Ltd.

Sterck, Hans De↗

Response tailoring of elasto-plastic trusses

Abstract In this work we tailor the response of trusses loaded beyond their yield limit. The truss structures are modeled using finite strain theory and rate-independent elasto-plasticity. We design trusses with a tailored mechanical response that is between “elastic” and “elastic-ideal-plastic” subject to the volume constraint. The design updates are generated by the gradient-based Method of Moving Asymptotes (MMA) solver and the sensitivities of the response functions are computed using a path-dependent adjoint sensitivity analysis. The computations are performed in Matlab.

42 ENGINEERING↗

On the Sampling-Based Computation of Nash Equilibria Under Uncertainty via the Nikaido–Isoda Function

We consider the computation of an equilibrium of a stochastic Nash equilibrium problem, where the player objectives are assumed to be L 0 -Lipschitz continuous and convex, given rival decisions with convex and closed player-specific feasibility sets. To address this problem, we consider minimizing a suitably defined value function defined using the Nikaido–Isoda function. Such an avenue does not necessitate either monotonicity properties of the concatenated gradient map or potentiality requirements on the game but does require a suitable regularity requirement under which a stationary point is a Nash equilibrium. We design and analyze a sampling-enabled projected-gradient-response method, reliant on inexact resolution of a player-level best-response subproblem. Here, by deriving suitable Lipschitzian guarantees on the value function, we derive both asymptotic guarantees for the sequence of generated iterates as well as rate and complexity guarantees for computing a stationary point by appropriate choices of the sampling rate and inexactness sequence.

Nikaido-Isoda function↗

Effects of La Doping and Zn or O Vacancy on the Magnetic Property of ZnO

Research on the magnetic origin and mechanism of La-doped ZnO system has been controversial. To solve this problem, we studied the effects of La doping and Zn or O vacancy on the magnetic property of ZnO using geometry optimization and energy calculation on the basis of first-principle generalized gradient approximation method of density functional theory. The electronic structures and magnetic properties of undoped ZnO, La-doped ZnO system, and systems with coexisting La doping and Zn or O vacancies were calculated. Results showed that the systems of La-doped ZnO and the coexistence of La doping and O vacancy are nonmagnetic. In addition, the system of La replacing Zn and one Zn vacancy exhibits long-range orderly ferromagnetism, and the Curie temperature of the doping system can achieve room temperature. The magnetism source of the systems with La doping and Zn vacancy coexisting in ZnO demonstrates strong hybrid coupling electron exchange effects existing among Zn-4s, Zn-3p, O-2p, and La-5s orbits that are nearest to the Zn vacancy. The next nearest distance between doping and Zn vacancy leads to the lowest formation energy and highest stability under the same doping condition.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Learning generative neural networks with physics knowledge

Deep generative neural networks have enabled modeling complex distributions, but incorporating physics knowledge into the neural networks is still challenging and is at the core of current physics-based machine learning research. To this end, we propose a physics generative neural network (PhysGNN), a new class of generative neural networks for learning unknown distributions in a physical system described by partial differential equations (PDE). PhysGNN couples PDE systems with generative neural networks. It is a fully differentiable model that allows back-propagation of gradients through both numerical PDE solvers and generative neural networks, and is trained by minimizing the discrete Wasserstein distance between generated and observed probability distributions of the PDE outputs using the stochastic gradient descent method. Moreover, PhysGNN does not require adversarial training like standard generative neural networks, which offers better stability than adversarial training. We show that PhysGNN can learn complex distributions in stochastic inverse problems, where conventional methods such as maximum likelihood estimation and momentum matching methods may be inapplicable when little knowledge is known about the form of unknown distributions or the physical model is too complex. Furthermore, our method allows physics-based generative neural network training for learning complex distributions in the context of differential equations.

97 MATHEMATICS AND COMPUTING↗

Bayesian inference of heterogeneous epidemic models: Application to COVID-19 spread accounting for long-term care facilities

Here we propose a high dimensional Bayesian inference framework for learning heterogeneous dynamics of a COVID-19 model, with a specific application to the dynamics and severity of COVID-19 inside and outside long-term care (LTC) facilities. We develop a heterogeneous compartmental model that accounts for the heterogeneity of the time-varying spread and severity of COVID-19 inside and outside LTC facilities, which is characterized by time-dependent stochastic processes and time-independent parameters in ~ 1500 dimensions after discretization. To infer these parameters, we use reported data on the number of confirmed, hospitalized, and deceased cases with suitable post-processing in both a deterministic inversion approach with appropriate regularization as a first step, followed by Bayesian inversion with proper prior distributions. To address the curse of dimensionality and the ill-posedness of the high-dimensional inference problem, we propose use of a dimension-independent projected Stein variational gradient descent method, and demonstrate the intrinsic low-dimensionality of the inverse problem. We present inference results with quantified uncertainties for both New Jersey and Texas, which experienced different epidemic phases and patterns. Moreover, we also present forecasting and validation results based on the empirical posterior samples of our inference for the future trajectory of COVID-19.

42 ENGINEERING↗

Topology optimization of compliant mechanisms under transient thermal conditions

This work considers multi-material topology optimization of compliant mechanisms under transient thermal and quasi-static mechanical conditions wherein thermally actuated devices are optimized for different operating conditions. The materials are modeled using finite strain thermo-hyperelasticity and a two way coupling between the energy balance and equilibrium equations is investigated. The design updates are generated from the gradient-based method of moving asymptotes optimizer and the sensitivities are computed using the time dependent adjoint sensitivity analysis. Results show the impact of designing for short versus long actuation times.

42 ENGINEERING↗

A finite-temperature Hartree–Fock code for shell-model Hamiltonians

The codes HFgradZ.py and HFgradT.py find axially symmetric minima of a Hartree–Fock energy functional for a Hamiltonian supplied in a shell model basis. The functional to be minimized is the Hartree–Fock energy for zero-temperature properties or the Hartree–Fock grand potential for finite-temperature properties (thermal energy, entropy). The minimization may be subjected to additional constraints besides axial symmetry and nucleon numbers. A single-particle operator can be used to constrain the minimization by adding it to the single-particle Hamiltonian with a Lagrange multiplier. One can also constrain its expectation value in the zero-temperature code. Also the orbital filling can be constrained in the zero-temperature code, fixing the number of nucleons having given $K^π$ quantum numbers. So, this is particularly useful to resolve near-degeneracies among distinct minima.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Machine learning surrogate of physics-based building-stock simulator for end-use load forecasting

Building energy models are used to simulate heat and mass transfer and estimate end-use load in buildings. With the proliferation of solar photovoltaics on residential and commercial buildings, increasingly, buildings are expected to provide grid services, for which accurate and computationally efficient building energy simulations and end-use load prediction are imperative. Existing building energy simulation tools, however, have significant computational overhead that make them less practical in real-time deployment for optimization, design, uncertainty quantification and control in building energy management systems. Here this article presents a data-driven machine learning model based on light gradient boosting method (LightGBM) as a surrogate for a physics-based simulator for residential buildings to predict end-use load. The machine learning based surrogate model accounts for time-series related variables, seasonality and trend component of end-use load, and history of end-use load. The accuracy of the surrogate model is assessed on the prediction of the load profiles of 100 different houses in Cook County, Illinois, USA. The LightGBM surrogate model is shown to reduce the root-mean-squared error by 53% relative to a reference decision tree (DT) based model reported previously in the literature. Moreover, the model predicts the load spikes and high-ramp rate events throughout the year which are often the Achilles heel of other models in the literature. The machine learning based surrogate model is demonstrated to be computationally efficient, with a ten-fold reduction in the computational time compared to a physics-based building energy simulation, and suitable for uncertainty analysis and real-time control of building characteristics in response to uncertainty.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Dynamic calibration of differential equations using machine learning, with application to turbulence models

We present a methodology for calibration of parametric ordinary and partial differential equation models, using off-the-shelf software for back-propagation in Neural Networks (NN). As a prototypical example, we consider calibration of a Reynolds-averaged Navier-Stokes (RANS) turbulence closure model, against ground truth data from direct numerical simulations (DNS) of two different turbulent flows. Numerical time integration is represented as a custom NN, where only the RANS model parameters are trainable. A loss function is defined to quantify the mismatch between the NN prediction and the ground truth over a predefined, finite time integration window. This loss function is then minimized using a gradient descent method utilizing the back-propagation algorithm. Furthermore, this dynamic approach to training is to be contrasted with a static approach, wherein a least square regression estimate for parameters is obtained in the limit of an infinitesimal time integration window. In a first test of static and dynamic approaches against ground truth data generated by the model, the former proves to be significantly faster and more accurate than the latter at recovering the parameters. When both calibration approaches are tested against DNS data, for which it is known that the model cannot achieve a perfect fit, the static approach yields a good prediction only for short times, while the dynamic approach results in physical and stable predictions over the entire integration window. After optimization of the dynamic approach for time step, spatial resolution, stability, and physics-based constraints, we obtain a 50% improvement of outcomes over those obtained from the existing, manually calibrated set of parameters, demonstrating the merits of this systematic and automated procedure.

97 MATHEMATICS AND COMPUTING↗

Magnetism and finite-temperature effects in UZr 2 : A density functional theory analysis

The structure and the thermophysical properties of d-UZr 2 are investigated using 0 K density functional theory and ab initio molecular dynamics (AIMD). Modeling the true paramagnetic state of this intermetallic compound has been challenging using first-principles calculations. For the first time, we find that the generalized gradient approximation method without applying an on-site Coulomb interaction term (Hubbard U) can result in a ground state that is antiferromagnetic (AFM). We believe that this weak AFM ground state is the closest to the real paramagnetic state. We found that structure optimization at finite temperatures using AIMD is necessary to achieve this ground state instead of the non-magnetic and ferromagnetic states previously reported in the literature. Our findings indicate that applying the Hubbard U on uranium f-orbitals in this metallic system is unnecessary and not recommended, as it leads to a large overestimation of the volume and introduces an unphysical strong spin polarization. Finally, our approach results in atomic volume, thermal expansion, and heat capacities that have strong agreement with experiments.

36 MATERIALS SCIENCE↗