Search NASA⌕ Search

SEARCH · Search NASA

Results for “Parameterization method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

A persistent adjoint method with dynamic time-scaling and an application to mass action kinetics

In this article, we consider an optimization problem where the objective function is evaluated at the fixed-point of a contraction mapping parameterized by a control variable, and optimization takes place over this control variable. Since the derivative of the fixed-point with respect to the parameter can usually not be evaluated exactly, an adjoint dynamical system can be used to estimate gradients. Using this estimation procedure, the optimization algorithm alternates between derivative estimation and an approximate gradient descent step. We analyze a variant of this approach involving dynamic time-scaling, where after each parameter update the adjoint system is iterated until a convergence threshold is passed. Here, we prove that, under certain conditions, the algorithm can find approximate stationary points of the objective function. We demonstrate the approach in the settings of an inverse problem in chemical kinetics, and learning in attractor networks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

The continuum and leading twist limits of parton distribution functions in lattice QCD

In this study, we present continuum limit results for the unpolarized parton distribution function of the nucleon computed in lattice QCD. This study is the first continuum limit using the pseudo-PDF approach with Short Distance Factorization for factorizing lattice QCD calculable matrix elements. Our findings are also compared with the pertinent phenomenological determinations. Inter alia, we are employing the summation Generalized Eigenvalue Problem (sGEVP) technique in order to optimize our control over the excited state contamination which can be one of the most serious systematic errors in this type of calculations. A crucial novel ingredient of our analysis is the parameterization of systematic errors using Jacobi polynomials to characterize and remove both lattice spacing and higher twist contaminations, as well as the leading twist distribution. This method can be expanded in further studies to remove all other systematic errors.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Machine Learned Empirical Numerical Integrator from Simulated Data

Recently, a number of state-of-the-art surrogate machine learning (ML) models have been designed for global weather and climate prediction, which have been trained using reanalysis data products. Reanalysis data products are constructed using numerical model simulations that combine numerical integration of partial differential equations and parameterization schemes. These products are typically only archived and made available using coarsened spatial and temporal resolutions. This study explores the impact of the numerical generation methods used to produce the training datasets and the temporal resolution of those datasets on machine learning surrogate models. Using the nonlinear vector autoregression (NVAR) machine as an explainable ML technique, simple dynamical systems are emulated with ML models trained on data produced by three classical numerical integration schemes. NVAR is validated as a skillful ML method, capable of producing accurate predictions and, more importantly, reconstructing both the underlying dynamics and the numerical integration scheme used to generate the training data. However, the machine fails to generalize predictions on unseen test data generated by different numerical integration schemes, despite the underlying dynamical system being the same. This result provides a word of caution for the growing field of machine learning emulation of weather and climate dynamics. Furthermore, we illustrate using NVAR that training on temporally coarsened data may increase the required complexity of ML models and potentially introduce new numerical challenges. Finally, we discover that empirical integration schemes with arbitrary time-stepping sizes can be constructed directly from the data, which implies a potential for the development of empirical numerical integration schemes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Quasar UV Luminosity Function at 3.5 < z < 5.0 from SDSS Deep Imaging Data

We present a well-designed sample of more than 1000 type 1 quasars at 3.5 < z < 5 and derive UV quasar luminosity functions (QLFs) in this redshift range. These quasars were selected using the Sloan Digital Sky Survey (SDSS) imaging data in the Stripe 82 and overlap regions with repeat imaging observations that are about 1 mag fainter than the SDSS single-epoch data. The follow-up spectroscopic observations were conducted by the SDSS-III Baryon Oscillation Spectroscopic Survey (BOSS) as one of the BOSS ancillary programs. Reaching i ~ 21.5 mag, our sample bridges previous samples from brighter and deeper surveys. We use a 1/V a method to derive binned QLFs at 3.6 < z < 4.0, 4.0 < z < 4.5, and 4.5 < z < 4.9 and then use a double power-law model to parameterize the QLFs. We also combine our data with literature QLFs to better constrain the QLFs across a much wider luminosity baseline. The faint- and bright-end slopes of the QLFs in this redshift range are around –1.7 and –3.7, respectively, with uncertainties from 0.2 to 0.3 to >0.5. The evolution of the QLFs from z ~ 5 to 3.5 can be described by a pure density evolution model (∝10 kz ) with a parameter k similar to that at 5 < z < 7, suggesting a nearly uniform evolution of the quasar density at z = 3.5–7.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Development of Density Functional Tight-Binding Parameters Using Relative Energy Fitting and Particle Swarm Optimization

We provide a strategy to optimize density functional tight-binding (DFTB) parameterization for the calculation of the structures and properties of organic molecules consisting of hydrogen, carbon, nitrogen, and oxygen. We utilize an objective function based on similarity measurements and the Particle Swarm Optimization (PSO) method to find an optimal set of parameters. This objective function considers not only the common DFTB descriptors of binding energies and atomic forces but also incorporates relative energies of isomers into the fitting procedure for more chemistry-driven results. The quality in the description of the binding energies and atomic forces is measured based on the Ballester similarity index and relative energies through a similarity index induced by the Levenshtein edit distance to quantify the correct energetic order of isomers. Training and testing datasets were created to include all relevant chemical functional groups. Finally, the accuracy of this strategy is assessed, and its range of applicability is discussed by comparison against our previous parameterization. The improved performance of the new DFTB parameterization is validated with respect to the density functional theory large datasets QM-9 and ANI-1, where excellent agreement is found between the structures and properties available in these datasets, and the ones obtained with DFTB.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

A neural network‐enhanced reproducing kernel particle method for modeling strain localization

Abstract Modeling the localized intensive deformation in a damaged solid requires highly refined discretization for accurate prediction, which significantly increases the computational cost. Although adaptive model refinement can be employed for enhanced effectiveness, it is cumbersome for the traditional mesh‐based methods to perform while modeling the evolving localizations. In this work, neural network‐enhanced reproducing kernel particle method (NN‐RKPM) is proposed, where the location, orientation, and shape of the solution transition near a localization is automatically captured by the NN approximation via a block‐level neural network (NN) optimization. The weights and biases in the blocked parameterization network control the location and orientation of the localization. The designed basic four‐kernel NN block is capable of capturing a triple junction or a quadruple junction topological pattern, while more complicated localization topological patters are captured by the superposition of multiple four‐kernel NN blocks. The standard RK approximation is then utilized to approximate the smooth part of the solution, which permits a much coarser discretization than the high‐resolution discretization needed to capture sharp solution transitions with the conventional methods. A regularization of the NN approximation is additionally introduced for discretization‐independent material responses. The effectiveness of the proposed NN‐RKPM is verified by a series of numerical verifications.

Baek, Jonghyuk↗
DOE OSTI2021

Large gradients via correlation in random parameterized quantum circuits

Scaling of variational quantum algorithms to large problem sizes requires efficient optimization of random parameterized quantum circuits. For such circuits with uncorrelated parameters, the presence of exponentially vanishing gradients in cost function landscapes is an obstacle to optimization by gradient descent methods. In this work, we prove that reducing the dimensionality of the parameter space by utilizing circuit modules containing spatially or temporally correlated gate layers can allow one to circumvent the vanishing gradient phenomenon. Here, examples are drawn from random separable circuits and asymptotically optimal variational versions of Grover's algorithm based on the quantum alternating operator ansatz. In the latter scenario, our bounds on cost function variation imply a transition between vanishing gradients and efficient trainability as the number of layers is increased toward $\mathcal{O}\left({2}^{n/2}\right)$, the optimal oracle complexity of quantum unstructured search.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Advanced extraction of the deuteron charge radius from electron-deuteron scattering data

To extract the charge radius of the proton, $r_{p}$, from the electron scattering data, the PRad collaboration at Jefferson Lab has developed a rigorous framework for finding the best functional forms - the fitters - for a robust extraction of $r_{p}$ from a wide variety of sample functions for the range and uncertainties of the PRad data. In this work we utilize and further develop this framework. Herein we discuss methods for searching for the best fitter candidates as well as a procedure for testing the robustness of extraction of the deuteron charge radius, $r_{d}$, from parameterizations based on elastic electron-deuteron scattering data. The ansatz proposed in this paper for the robust extraction of $r_{d}$, for the proposed low-$Q^{2}$ DRad experiment at Jefferson Lab, can be further improved once there are more data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Learning to Predict and Improve Build Successes in Package Ecosystems

Software has become increasingly complex, with a typical application depending on tens or hundreds of packages. Finding compatible versions and build configurations of these packages is challenging. This paper presents a method to learn the likelihood of software build success, and techniques for leveraging this information to guide dependency solvers to better software configurations. We leverage the heavily parameterized package recipes from the Spack package manager to produce a training data set of builds, and we use Graph Neural Networks to learn whether a given package configuration will build successfully or not. We apply our tool to the U.S. Exascale Computing Project’s software stack. We demonstrate its effectiveness in predicting whether a given package will build successfully. We show that our technique can be used to improve the solutions generated by dependency solvers, reducing the need for developers to find working builds by trial and error.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Deformation heterogeneity and intragrain lattice misorientation in high strength contrast, dual-phase bridgmanite/periclase

A bridgmanite/periclase aggregate is investigated due to its prevalence in the Earth’s lower mantle and its importance for understanding geodynamic processes. In dual-phase polycrystalline aggregates, both strength contrast between phases and single crystal elastic and plastic anisotropy are known to influence the development of intragrain misorientation, and the evolution of crystallographic texture. In this study, full-field crystal plasticity simulations are performed with a finite element solution method, and applied to an aggregate of a mechanically strong orthorhombic phase with perovskite structure (bridgmanite, MgSiO 3 ), and a relatively weaker cubic phase (periclase, MgO). The relative strengths of the phases are parameterized to elucidate the effect that strength contrast has on texture evolution and single-phase simulations are performed for comparison. Altogether, results indicate that the relative strength between the two phases influences the development of plasticity, and the overall texture evolution. Results are discussed in light of trends related to the evolution of plasticity and misorientation in the aggregate, and their dependence on both the strength contrast between phases as well as the spatial distribution of grains and phases.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Modeling diffusion and types I-V sorption of water vapor in heterogeneous systems

Here, a sorption and diffusion model is developed using a mobile-immobile decomposition of the vapor concentration. Henry’s mode represents the mobile species which diffuses through the solid, while Langmuir and pooling modes represent possible immobilization processes that cause nonlinearities in sorption capacity. The model can simulate the five classical sorption types and can incorporate additional dynamics compared to models based on thermodynamic equilibrium. Additionally, the framework allows for discontinuities in material properties encountered in multi-material systems. The resulting non-linear coupled equations are solved by employing a finite element method to discretize in space, and a backward Euler method to discretize in time. The discretized system of equations is solved via a Newton-type iteration scheme at each time-step. Four different materials are parameterized for the model, which are then used in examples to demonstrate the model’s ability to capture complex sorption processes in multi-material systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Bayesian sequential optimal experimental design for nonlinear models using policy gradient reinforcement learning

We present a mathematical framework and computational methods for optimally designing a finite sequence of experiments. This sequential optimal experimental design (sOED) problem is formulated as a finite-horizon partially observable Markov decision process (POMDP) under a Bayesian setting and with information-theoretic utilities. The formulation is general and may accommodate continuous random variables, non-Gaussian posteriors, and nonlinear forward models. The sOED design policy incorporates elements of feedback and lookahead simultaneously, and we show it to generalize the commonly-used batch and greedy design strategies. We solve for the sOED policy using the policy gradient (PG) method from reinforcement learning, and provide a derivation for the PG expression in the sOED context. Adopting an actor-critic approach, the policy and value functions are parameterized using deep neural networks and improved via PG estimates produced from simulated episodes of designs and observations. The new PG-sOED algorithm is first validated on a linear-Gaussian benchmark, and then compared against other design baselines on a sensor movement problem for contaminant source inversion in a convection-diffusion field. As a result, we provide explanation for the policy behaviors using knowledge of the underlying physical process.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

An efficient protocol for excited states of large biochromophores

Efficient energy transport in photosynthetic antenna is a long-standing source of inspiration for artificial light harvesting materials. However, characterizing the excited states of the constituent chromophores poses a considerable challenge to mainstream quantum chemical and semiempirical excited state methods due to their size and complexity and the accuracy required to describe small but functionally important changes in their properties. In this paper, we explore an alternative approach to calculating the excited states of large biochromophores, exemplified by a specific method for calculating the Q y transition of bacteriochlorophyll a, which we name Chl-xTB. Using a diagonally dominant approximation to the Casida equation and a bespoke parameterization scheme, Chl-xTB can match time-dependent density functional theory’s accuracy and semiempirical speed for calculating the potential energy surfaces and absorption spectra of chlorophylls. We demonstrate that Chl-xTB (and other prospective realizations of our protocol) can be integrated into multiscale models, including concurrent excitonic and point-charge embedding frameworks, enabling the analysis of biochromophore networks in a native environment. We exploit this capability to probe the low-frequency spectral densities of excitonic energies and interchromophore interactions in the light harvesting antenna protein LH2 (light harvesting complex 2). The impact of low-frequency protein motion on interchromophore coupling and exciton transport has routinely been ignored due to the prohibitive costs of including it in simulations. Our results provide a more rigorous basis for continued use of this approximation by demonstrating that exciton transition energies are unaffected by low-frequency vibrational coupling to exciton interaction energies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

When ancient numerical demons meet physics-informed machine learning: adjoint-based gradients for implicit differentiable modeling

Recent advances in differentiable modeling, a genre of physics-informed machine learning that trains neural networks (NNs) together with process-based equations, have shown promise in enhancing hydrological models' accuracy, interpretability, and knowledge-discovery potential. Current differentiable models are efficient for NN-based parameter regionalization, but the simple explicit numerical schemes paired with sequential calculations (operator splitting) can incur numerical errors whose impacts on models' representation power and learned parameters are not clear. Implicit schemes, however, cannot rely on automatic differentiation to calculate gradients due to potential issues of gradient vanishing and memory demand. Here we propose a “discretize-then-optimize” adjoint method to enable differentiable implicit numerical schemes for the first time for large-scale hydrological modeling. The adjoint model demonstrates comprehensively improved performance, with Kling–Gupta efficiency coefficients, peak-flow and low-flow metrics, and evapotranspiration that moderately surpass the already-competitive explicit model. Therefore, the previous sequential-calculation approach had a detrimental impact on the model's ability to represent hydrological dynamics. Furthermore, with a structural update that describes capillary rise, the adjoint model can better describe baseflow in arid regions and also produce low flows that outperform even pure machine learning methods such as long short-term memory networks. The adjoint model rectified some parameter distortions but did not alter spatial parameter distributions, demonstrating the robustness of regionalized parameterization. Despite higher computational expenses and modest improvements, the adjoint model's success removes the barrier for complex implicit schemes to enrich differentiable modeling in hydrology.

58 GEOSCIENCES↗
DOE OSTI2024

Uncertainty quantification of graph convolution neural network models of evolving processes

The application of neural network models to scientific machine learning tasks has proliferated in recent years. In particular, neural networks have proved to be adept at modeling processes with spatial–temporal complexity. Nevertheless, these highly parameterized models have garnered skepticism in their ability to produce outputs with quantified error bounds over the regimes of interest. Hence there is a need to find uncertainty quantification methods that are suitable for neural networks. In this work we present comparisons of the parametric uncertainty quantification of neural networks modeling complex spatial–temporal processes with Hamiltonian Monte Carlo and Stein variational gradient descent and its projected variant. Specifically we apply these methods to graph convolutional neural network models of evolving systems modeled with recurrent neural network and neural ordinary differential equations architectures. We show that Stein variational inference is a viable alternative to Monte Carlo methods with some clear advantages for complex neural network models. For our exemplars, Stein variational interference gave similar pushed forward uncertainty profiles through time compared to Hamiltonian Monte Carlo, albeit with generally more generous variance. As a result, projected Stein variational gradient descent also produced similar uncertainty profiles to the non-projected counterpart, but large reductions in the active weight space were confounded by the stability of the neural network predictions and the convoluted likelihood landscape.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Development and assessment of hierarchical multi-reward reinforcement learning based potential for silicene with state-of-the-art models

We develop a new interatomic force field for Silicene, a 2D material with a buckled hexagonal lattice structure with high polymorphism. We introduce new parameterizations of a Tersoff model using a hierarchical multi-reward reinforcement learning (RL) methodology coupled with a continuous Monte Carlo Tree Search optimization. Our model significantly outperforms existing methods by enhancing the accuracy of predictions for the structural and thermodynamic properties of seven silicene polymorphs-including structure, energy, equation of state, elasticity, and phonon dispersion-when compared to established models. We further make a comprehensive comparison of the various models in predicting the mechanical and thermal properties of silicene. We trace the origin of the improved performance to the description of the angular dependence in the bond-order term, suggesting that modifying the angular terms in short-range models is essential to capture the structural diversity in low dimensional systems.

2D materials↗
DOE OSTI2023

Quantum-inspired tempering for ground state approximation using artificial neural networks

A large body of work has demonstrated that parameterized artificial neural networks (ANNs) can efficiently describe ground states of numerous interesting quantum many-body Hamiltonians. However, the standard variational algorithms used to update or train the ANN parameters can get trapped in local minima, especially for frustrated systems and even if the representation is sufficiently expressive. We propose a parallel tempering method that facilitates escape from such local minima. This methods involves training multiple ANNs independently, with each simulation governed by a Hamiltonian with a different "driver" strength, in analogy to quantum parallel tempering, and it incorporates an update step into the training that allows for the exchange of neighboring ANN configurations. We study instances from two classes of Hamiltonians to demonstrate the utility of our approach using Restricted Boltzmann Machines as our parameterized ANN. The first instance is based on a permutation-invariant Hamiltonian whose landscape stymies the standard training algorithm by drawing it increasingly to a false local minimum. The second instance is four hydrogen atoms arranged in a rectangle, which is an instance of the second quantized electronic structure Hamiltonian discretized using Gaussian basis functions. We study this problem in a minimal basis set, which exhibits false minima that can trap the standard variational algorithm despite the problem’s small size. We show that augmenting the training with quantum parallel tempering becomes useful to finding good approximations to the ground states of these problem instances.

Albash, Tameem↗
DOE OSTI2022

Global Barotropic Tide Modeling Using Inline Self‐Attraction and Loading in MPAS‐Ocean

Abstract We examine ocean tides in the barotropic version of the Model for Prediction Across Scales (MPAS‐Ocean), the ocean component of the Department of Energy Earth system model. We focus on four factors that affect tidal accuracy: self‐attraction and loading (SAL), model resolution, details of the underlying bathymetry, and parameterized topographic wave drag. The SAL term accounts for the tidal loading of Earth's crust and the self‐gravitation of the ocean and the load‐deformed Earth. A common method for calculating SAL is to decompose mass anomalies into their spherical harmonic constituents. Here, we compare a scalar SAL approximation versus an inline SAL using a fast spherical harmonic transform package. Wave drag accounts for energy lost by breaking internal tides that are produced by barotropic tidal flow over topographic features. We compare a series of successively finer quasi‐uniform resolution meshes (62.9, 31.5, 15.7, and 7.87 km) to a variable resolution (45 to 5 km) configuration. We ran MPAS‐Ocean in a single‐layer barotropic mode forced by five tidal constituents. The 45 to 5 km variable resolution mesh obtained the best total root‐mean‐square error (5.4 cm) for the deep ocean ( 1,000 m) tide compared to TPXO8 and ran twice as fast as the quasi‐uniform 8 km mesh, which had an error of 5.8 cm. This error is comparable to those found in other forward (non‐assimilative) ocean tide models. In future work, we plan to use MPAS‐Ocean to study tidal interactions with other Earth system components, and the tidal response to climate change.

54 ENVIRONMENTAL SCIENCES↗