Search NASA⌕ Search

SEARCH · Search NASA

Results for “Parameterization method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Data Imbalance, Uncertainty Quantification, and Transfer Learning in Data‐Driven Parameterizations: Lessons From the Emulation of Gravity Wave Momentum Transport in WACCM

Abstract Neural networks (NNs) are increasingly used for data‐driven subgrid‐scale parameterizations in weather and climate models. While NNs are powerful tools for learning complex non‐linear relationships from data, there are several challenges in using them for parameterizations. Three of these challenges are (a) data imbalance related to learning rare, often large‐amplitude, samples; (b) uncertainty quantification (UQ) of the predictions to provide an accuracy indicator; and (c) generalization to other climates, for example, those with different radiative forcings. Here, we examine the performance of methods for addressing these challenges using NN‐based emulators of the Whole Atmosphere Community Climate Model (WACCM) physics‐based gravity wave (GW) parameterizations as a test case. WACCM has complex, state‐of‐the‐art parameterizations for orography‐, convection‐, and front‐driven GWs. Convection‐ and orography‐driven GWs have significant data imbalance due to the absence of convection or orography in most grid points. We address data imbalance using resampling and/or weighted loss functions, enabling the successful emulation of parameterizations for all three sources. We demonstrate that three UQ methods (Bayesian NNs, variational auto‐encoders, and dropouts) provide ensemble spreads that correspond to accuracy during testing, offering criteria for identifying when an NN gives inaccurate predictions. Finally, we show that the accuracy of these NNs decreases for a warmer climate (4 × CO 2 ). However, their performance is significantly improved by applying transfer learning, for example, re‐training only one layer using ∼1% new data from the warmer climate. The findings of this study offer insights for developing reliable and generalizable data‐driven parameterizations for various processes, including (but not limited to) GWs.

54 ENVIRONMENTAL SCIENCES↗

The accuracies of effective interactions in downfolding coupled-cluster approaches for small-dimensionality active spaces

Here, this paper evaluates the accuracy of the Hermitian form of the downfolding procedure using the double unitary coupled cluster (DUCC) ansatz on the benchmark systems of linear chains of hydrogen atoms, H6 and H8. The computational infrastructure employs the occupation-number-representation codes to construct the matrix representation of arbitrary second-quantized operators, allowing for the exact representation of exponentials of various operators. The tests demonstrate that external amplitudes from standard single-reference coupled cluster methods that sufficiently describe external (out-of-active-space) correlations reliably parameterize the Hermitian downfolded effective Hamiltonians in the DUCC formalism. The results show that this approach can overcome the problems associated with losing the variational character of corresponding energies in the corresponding SR-CC theories.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Bridging Time-series Image Phenotyping and Functional–Structural Plant Modeling to Predict Adventitious Root System Architecture

Root system architecture (RSA) is an important measure of how plants navigate and interact with the soil environment. However, current methods in studying RSA must make tradeoffs between precision of data and proximity to natural conditions, with root growth in germination papers providing accessibility and high data resolution. Functional–structural plant models (FSPMs) can overcome this tradeoff, though parameterization and evaluation of FSPMs are traditionally based in manual measurements and visual comparison. Here, we applied a germination paper system to study the adventitious RSA and root phenology of Populus trichocarpa stem cuttings using time-series image-based phenotyping augmented by FSPM. We found a significant correlation between timing of root initiation and thermal time at cutting collection (P value = 0.0061, R 2 = 0.875), but little correlation with RSA. We also present a use of RhizoVision [1] for automatically extracting FSPM parameters from time series images and evaluating FSPM simulations. A high accuracy of the parameterization was achieved in predicting 2D growth with a sensitivity rate of 83.5%. This accuracy was lost when predicting 3D growth with sensitivity rates of 38.5% to 48.7%, while overall accuracy varied with phenotyping methods. Despite this loss in accuracy, the new method is amenable to high throughput FSPM parameterization and bridges the gap between advances in time-series phenotyping and FSPMs.

60 APPLIED LIFE SCIENCES↗

A Gradient Based Subgrid-Scale Parameterization for Ocean Mesoscale Eddies

Mesoscale eddies play an important role in transport of heat and biogeochemical tracers in the global ocean circulation. Resolving these energetic eddies, however, is challenging in ocean general circulation models (OGCM) because it requires a horizontal grid spacing of ≲1/8° that is computationally expensive. As a result, we are required to parameterize mesoscale eddy effects on large-scale ocean flows. In this work, we introduce a new subgrid-scale (SGS) model that is developed based on a Taylor series expansion of resolved variables to parameterize subgrid mesoscale eddy transports and momentum fluxes in OGCM. We have performed an a priori study to evaluate the performance of our new gradient model using high-resolution ocean simulations. Our results show that the gradient model well predicts the actual SGS thickness fluxes in the zonal and meridional directions in coarse-resolution simulations with the grid spacing ≳1/4°. The unresolved kinetic energy at the ocean surface is also skillfully estimated. More importantly, unlike current mesoscale eddy parameterizations, which are mainly developed based on an assumption of flat bottom ocean, our new SGS model can capture the structure of unresolved standing meanders at the ocean surface. We have also developed a dynamic procedure for setting in non-dimensional parameters in our new parameterization through a non-ad hoc and tuning-free method. Overall, this work suggests that implementing the gradient model in OGCM can improve the model accuracy with an affordable computational cost in eddy-permitting and non-eddying simulations.

54 ENVIRONMENTAL SCIENCES↗

Enhancing quantum annealing accuracy through replication-based error mitigation *

Abstract Quantum annealers like those manufactured by D-Wave Systems are designed to find high quality solutions to optimization problems that are typically hard for classical computers. They utilize quantum effects like tunneling to evolve toward low-energy states representing solutions to optimization problems. However, their analog nature and limited control functionalities present challenges to correcting or mitigating hardware errors. As quantum computing advances towards applications, effective error suppression is an important research goal. We propose a new approach called replication based mitigation (RBM) based on parallel quantum annealing (QA). In RBM, physical qubits representing the same logical qubit are dispersed across different copies of the problem embedded in the hardware. This mitigates hardware biases, is compatible with limited qubit connectivity in current annealers, and is well-suited for currently available noisy intermediate-scale quantum annealers. Our experimental analysis shows that RBM provides solution quality on par with previous methods while being more flexible and compatible with a wider range of hardware connectivity patterns. In comparisons against standard QA without error mitigation on larger problem instances that could not be handled by previous methods, RBM consistently gets better energies and ground state probabilities across parameterized problem sets.

Djidjev, Hristo N. (ORCID:0000000192868824)↗

A Probabilistic Approach To Selecting Build Configurations in Package Managers

In the past decade software has grown significantly in complexity and scale. Likewise the number of dependencies for most software has increased with typical software packages depending on tens to hundreds of other packages. Such large numbers of dependencies place a significant burden on package managers to correctly maintain dependency lists and constraints between them. Due to this package managers have incorporated sophisticated tooling such as SAT solvers into their dependency management mechanisms. Despite these tools package managers still rely on many human annotated constraints for dependency and version selection. These are error-prone and require a significant amount of labor to constantly update and test. In this paper we propose a methodology to make use of historical build results in selecting the version for package dependencies. Our method utilizes the flexibility of the Spack package manager’s heavily parameterized package configurations to incorporate a machine learning model trained to predict the probability of build outcomes. This work is able to build and install packages with a 13% higher success rate than the default version selection mechanism in Spack.

97 MATHEMATICS AND COMPUTING↗

Variational Autoencoders for Learning Nonlinear Dynamics of Physical Systems

We develop data-driven methods for incorporating physical information for priors to learn parsimonious representations of nonlinear systems arising from parameterized PDEs and mechanics. Our approach is based on Variational Autoencoders (VAEs) for learning nonlinear state space models from observations. We develop ways to incorporate geometric and topological priors through general manifold latent space representations. We investigate the performance of our methods for learning low dimensional representations for the nonlinear Burgers equation and constrained mechanical systems.

97 MATHEMATICS AND COMPUTING↗

Interrelationships among methods of estimating microbial biomass across multiple soil orders and biomes

Understanding the role of soil microbes is critical to ecosystem processes, and more thorough comparisons of measurement proxies for soil microbial biomass could broaden the inclusion of explicit microbial parameterization in soil carbon cycling and earth system models. We measured physical, chemical, and biological data from eight soil orders representing 11 major biomes and four climate regions. Four prominent methods to measure microbial abundance—chloroform fumigation extraction (CFE), total DNA yield, gene copy number by quantitative polymerase chain reaction (GCN), and phospholipid fatty acids (PLFA)—were compared to assess their relationships with each other and with soil characteristics. Correlations were observed when comparing methods, with CFE correlating strongly with total DNA yield, GCN, and PLFA; CFE with bacterial GCN and bacterial PLFA; and to a lesser extent, total PLFA and total DNA yield. Correlations improved with the removal of organic soils (Histosols, Gelisols). Comparisons involving extracted DNA were improved by correcting for clay content, due to DNA extraction inefficiencies in clay-rich soils. Correlations involving fungi (PLFA or GCN) were always less significant. These methods could serve as reliable, inter-relatable proxies for the estimation of total soil microbial biomass while recognizing that the proxies are less effective at parsing differences between bacteria and fungi. Here, we provide specific equations to relate measures of soil microbial biomass by these four different methods to enable microbial models to utilize a greater diversity of observed data sources in parameterizations and simulations. Caveats for the equations and their values are also discussed.

59 BASIC BIOLOGICAL SCIENCES↗

Using ARM Data to Retrieve Entrainment Rates in Stratocumulus Cloud Systems (Final Report)

A stratocumulus-topped boundary layer (STBL) is a shallow convecting layer in which both the updraft and the downdraft branches of the convective circulation are saturated (cloudy) in the upper part of the boundary layer. The convective circulation is vigorous, yet the cloud-top entrainment velocity, $w_e$, is small and difficult to measure. Differences between currently used parameterizations of $w_e$ in GCMs can lead to STBLs that differ by as much as a factor of two in climatologically important properties such as liquid water path and boundary layer depth. We have developed a new method to retrieve entrainment rates in STBLs which uses vertical velocity retrievals from surface-based cloud radar, in conjunction with other surface-based measurements. These new estimates will allow a more comprehensive evaluation of parameterizations of entrainment rate for STBLs. The new method will also provide ground-based estimates of entrainment in STBLs over long time periods. We use retrievals of vertical velocity and liquid water content profiles to estimate the turbulent liquid water flux, which is then used in combination with observed cloud-top jumps of temperature, water vapor, and calculated radiative flux profiles to estimate the entrainment rate. We present results for three days for which observational data was not significantly contaminated by drizzle. The resulting average entrainment rates are 0.58 cm/s, 1.51 cm/s, and 0.31 cm/s.

54 ENVIRONMENTAL SCIENCES↗

Learning subgrid-scale models with neural ordinary differential equations

We propose a new approach to learning the subgrid-scale model when simulating partial differential equations (PDEs) solved by the method of lines and their representation in chaotic ordinary differential equations, based on neural ordinary differential equations (NODEs). Solving systems with fine temporal and spatial grid scales is an ongoing computational challenge, and closure models are generally difficult to tune. Machine learning approaches have increased the accuracy and efficiency of computational fluid dynamics solvers. In this approach neural networks are used to learn the coarse- to fine-grid map, which can be viewed as subgrid-scale parameterization. We propose a strategy that uses the NODE and partial knowledge to learn the source dynamics at a continuous level. Our method inherits the advantages of NODEs and can be used to parameterize subgrid scales, approximate coupling operators, and improve the efficiency of low-order solvers. Numerical results with the two-scale Lorenz 96 ODE, the convection-diffusion PDE, and the viscous Burgers' PDE are used to illustrate this approach.

97 MATHEMATICS AND COMPUTING↗

Genetic programming for interpretable, data-driven continuum damage models.

The damage mechanisms that lead to failure in engineering alloys have been studied extensively, but converting this knowledge into constitutive models that are suitable for engineering-scale analysis remains a challenge. Evolution laws for continuum damage have been developed in the past and have proven effective but suffer from many non-physical assumptions that inhibit the overall accuracy of the model. Further, the assumptions inherent in these existing models prevent them from being applicable to a broad class of materials. At the same time, computational models of fine-scale damage mechanisms continue to advance making it tractable to generate large training data sets through computer simulation. Data-driven machine learning approaches can leverage these data sets to avoid making limiting assumptions, and instead produce models directly from the results of microstructural simulations and/or experiments. Many of these machine learning approaches are rapid and accurate, but they offer little to no insight into the underlying relationships among state variables being discovered. Conversely, genetic programming symbolic regression (GPSR) is a machine learning method that produces analytic expressions relating the state variables, allowing maximal insight and interpretability. To that end, we propose using GPSR as a data-driven method of obtaining microstructurally informed continuum damage models. Data is generated using microstructural simulations of damage evolution, parameterized over microstructural statistics (i.e., pore shape) and nominally applied deformations. Analytic expressions for damage evolution are obtained from the data using GPSR, and these expressions are then utilized within a continuum constitutive model. Overall, this approach is a promising method of automatically obtaining analytic relations describing constitutive phenomena in a material.

Buche, Michael Robert↗

Role of Ocean and Atmosphere Variability in Scale-Dependent Thermodynamic Air-Sea Interactions

This study investigates the influence of oceanic and atmospheric processes in extratropical thermodynamic air-sea interactions resolved by satellite observations (OBS) and by two climate model simulations run with eddy-resolving high-resolution (HR) and eddy-parameterized low-resolution (LR) ocean components. Here, in this work, spectral methods are used to characterize the sea surface temperature (SST) and turbulent heat flux (THF) variability and co-variability over scales between 50 and 10,000 km and 60 days to 80 years in the Pacific Ocean. The relative roles of the ocean and atmosphere are interpreted using a stochastic upper-ocean temperature evolution model forced by noise terms representing intrinsic variability in each medium, defined using climate model data to produce realistic rather than white spectral power density distributions. The analysis of all datasets shows that the atmosphere dominates the SST and THF variability over zonal wavelengths larger than ~2,000–2,500 km. In HR and OBS, ocean processes dominate the variability of both quantities at scales smaller than the atmospheric first internal Rossby radius of deformation (R 1 , ~600–2,000 km) due to a substantial ocean forcing coinciding with a weaker atmospheric modulation of THF (and consequently of SST) than at larger scales. The ocean forcing also induces oscillations in SST and THF with periods ranging from intraseasonal to multidecadal, reflecting a red spectrum response to ocean forcing similar to that driven by atmospheric forcing. Such features are virtually absent in LR due to a weaker ocean forcing relative to HR.

54 ENVIRONMENTAL SCIENCES↗

Evaluating Sea Breezes and Associated Convective Cloud Evolution in the Model Gray Zone

We characterize convective clouds associated with sea‐breeze circulations (SBC) using multi‐agency observations and multi‐case ensemble model simulations. The focus is on assessing convective cloud lifecycle properties and their merging behavior, as well as the environmental conditions they are embedded in, particularly SBC features. In total, 46 SBC days over the Houston‐Galveston region are selected and simulated using the Weather Research and Forecasting (WRF) model at a gray zone scale with a forecast‐like parameterization setup. Advanced techniques, including change‐point detection, a Lagrangian cloud tracking method, and a newly developed cell merging and splitting detection algorithm, are applied and/or developed for this study. Our findings indicate that the WRF model at 1 km grid spacing well represents the thermodynamic conditions over the region, as well as SBC timing and intensity. However, for the associated convective cells, WRF overestimates the 30‐dBZ echo top height, cell area, and maximum radar reflectivity compared to radar observations. This overestimation is potentially due to under‐resolved entrainment processes, an overestimated merging frequency, and the overestimation of updraft intensity. Furthermore, the model exhibits a deficiency in simulating congestus clouds, showing a more rapid transition from shallow to deep convection compared to observed behavior. Moreover, observations indicate stronger, deeper, and wider clouds when merging happens. Conversely, in simulations, the merging process does not necessarily lead to higher or longer‐lived cells, as many cases experience rapid and frequent merging and splitting which may result in more variance in convective updraft velocity during the convection lifetime.

54 ENVIRONMENTAL SCIENCES↗

Learning Physically Interpretable Atmospheric Models From Data With WSINDy

The multiscale and turbulent nature of Earth's atmosphere has historically rendered accurate weather modeling a hard problem. Recently, there has been an explosion of interest surrounding data-driven approaches to weather modeling, which in many cases show improved forecasting accuracy and computational efficiency when compared to traditional methods. However, many of the current data-driven approaches employ highly parameterized neural networks, often resulting in uninterpretable models and limited gains in scientific understanding. In this work, we address the interpretability problem by explicitly discovering partial differential equations governing atmospheric phenomena, identifying symbolic mathematical models with direct physical interpretations. The purpose of this paper is to demonstrate that, in particular, the weak-form sparse identification of nonlinear dynamics (WSINDy) algorithm can learn effective atmospheric models from both simulated and assimilated data. Our approach adapts the standard WSINDy algorithm to work with high-dimensional fluid data of arbitrary spatial dimension.

58 GEOSCIENCES↗

pnnl/mol_dgnn

Molecular dynamics simulations often rely on parameterized atomistic potentials, which can be inaccurate compared to ab initio simulation methods. However, dynamic ab initio simulations come with high computational cost. Deep learning techniques offer a method to obtain both high accuracy and low cost predictions of dynamics. Our method gives a prediction of the structural dynamics of a molecule accounting for the prior dynamics, giving high-accuracy predictions at low computational cost

Ashby, Michael↗

Deep learning of parameterized equations with applications to uncertainty quantification

We propose a learning algorithm for discovering unknown parameterized dynamical systems by using observational data of the state variables. Our method is built upon and extends the recent work of discovering unknown dynamical systems, in particular those using deep neural network (DNN). We propose a DNN structure, largely based upon the residual network (ResNet), to not only learn the unknown form of the governing equation but also take into account the random effect embedded in the system, which is generated by the random parameters. Once the DNN model is successfully constructed, it is able to produce system prediction over longer term and for arbitrary parameter values. For uncertainty quantification, it allows us to conduct uncertainty analysis by evaluating solution statistics over the parameter space.

97 MATHEMATICS AND COMPUTING↗

Porting Classical Approaches for Quantum Simulations to Quantum Computers

Simulating quantum many-body systems is one of the most promising problems in which we might anticipate that quantum computers should show quantum advantage. Unfortunately, there is still a gap between this promise and actual practice. New quantum algorithms need to be developed and the current quantum algorithms have various difficulties - e.g efficient state preparation - which must be overcome and improved upon. In many cases, classical approaches need to be ported over to quantum devices. In this project we have developed a suite of new quantum algorithms which makes progress in this regard. We developed a new optimization scheme for variational quantum eigensolvers, UBOS, which mitigates problems with local minimas and barren plateaus while improving convergence to the ground state by an order of magnitude. We developed a new way to utilize qubitization to find ground states of nearly frustration-free Hamiltonians faster than all previous methods. We developed a series of state preparation techniques which helps initialize parameterized quantum circuits into reasonable starting points on which quantum algorithms are then applied. In addition to the development of novel algorithms, it is critical to have classical simulation techniques for approximately simulating quantum circuits which can be used to benchmark and understand quantum algorithms. Toward that end, we developed a novel POVM formalism to simulate quantum circuits as well as exemplify the massive parallelization of tensor network methodologies. Finally, we developed physical understanding of entanglement phase transitions such as many-body localization and random tensor networks.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗