Search NASA⌕ Search

SEARCH · Search NASA

Results for “Ensemble methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Multi-source Estimates of Land / Ocean Moisture Transport Variability over the Satellite Era

It is widely appreciated that atmospheric transport of water from the world’s oceans is a process key to planetary energy balance as well as Earth's habitability. What is not yet clear is the extent of variability in moisture transports, the relative importance of interdecadal variability versus climate change signals, and importantly, our ability to quantify these changes. This work assesses variations in moisture transport variability during the satellite era (~1980 to present) by comparing several different estimates. (i) The most direct estimate is the vertically integrated flux convergence of moisture from reanalyses which use observed wind and moisture information. (ii) One alternative estimate comes from P-ET over land taken from global hydrologic models constrained with precipitation and near-surface meteorology. Here we use an ensemble of six models. An adjunct to this method is to employ satellite derive ET (e.g., GLEAM or DOLCE). (iii) Complementary to this is E-P over the global oceans derived from satellite estimates of P such as TRMM, GPM and GPCP and SeaFlux V3 or J-OFURO3 estimates of E, all relying heavily upon microwave measurements. Transport between land and oceans must essentially balance at monthly scales, i.e., vanish globally. (iv) a fourth perspective comes from estimate of terrestrial RO + storage rate, delta S. G-RUN Ensemble which uses observed streamflow and P measurements to calibrate a statistical model provides the former while GRACE, GRACE-FO provide total water storage anomalies used to calculate storage rate changes. GRACE REC uses GRACE data to train a precipitation-driven statistical model to extend storage estimates before the GRACE era. (All of these alternatives to reanalysis estimates also consider the small atmospheric column water vapor contribution.) We examine the transport changes from these three different methodologies, their relative accuracies and discuss the origin of their differences. Regional trends in moisture flux divergence and their role in multi-decadal trends are considered. Interannual variability arising in connection with ENSO variability is a dominant signal, driven largely by P changes. Trends since 1980 include reductions in moisture delivery to the western U.S., eastern Brazil, and central Africa with recovery of moisture convergence to the Sahel and parts of eastern North America.

Franklin Robertson↗

Dressed-State Hamiltonian Engineering in a Strongly Interacting Solid-State Spin Ensemble

In quantum science applications, ranging from many-body physics to quantum metrology, dipolar interactions in spin ensembles are often controlled via Floquet engineering. However, this technique typically reduces the interaction strength between spins and effectively weakens the coupling to a target sensing field, limiting the metrological sensitivity. In this Letter, we develop and demonstrate an alternative method that directly tunes the native dipolar interaction in an ensemble of nitrogen-vacancy (NV) centers in diamond, thereby overcoming these limitations inherent to Floquet engineering. Our approach utilizes dressed-state qubit encoding under a bias magnetic field applied perpendicular to the crystal lattice orientation. This method leads to a 3.2× enhancement of the dimensionless coherence parameter JT 2 compared to state-of-the-art Floquet engineering and a 2.6× (8.3 dB) enhanced sensitivity in ac magnetometry. Furthermore, our results provide a powerful Hamiltonian engineering tool for future studies with NV ensembles and other interacting higher-spin (S > $\frac{1}{2}$) systems.

Quantum control↗

The Power of Many: An Ensemble Approach to Spectral Similarity

Quantifying the similarity between two mass spectra─a known reference mass spectrum and an unidentified sample mass spectrum─is at the heart of compound identification workflows in gas chromatography–mass spectrometry (GC-MS). The reference spectrum most like the sample is assigned as its identification (provided some quantitative similarity threshold is met, e.g., 80%) and thus accurately measuring similarity is essential. Significant research has gone toward developing metrics for this purpose, each of which has attempted to improve upon existing methods by incorporating GC-MS-specific information (e.g., peak ratios or retention times) or adopting various statistical and algorithmic frameworks. While this active development has led to a plethora of similarity metrics with demonstrated value across different contexts, the unfortunate consequence has been confusion surrounding which metric should be used as a global standard. No such metric is currently accepted as the standard method because different metrics have demonstrated optimal performance in different contexts. In this work, we propose an ensemble approach to spectral similarity scoring that combines the collective information from across existing similarity metrics to form an improved, globally representative similarity metric as a step toward establishing a global standard method. In conclusion, the resulting ensemble metrics are evaluated on over 88,000 spectra of varying complexity and demonstrate improved abilities to accurately rank the correct reference spectrum as the top-matching candidate for a sample relative to the rankings generated by individual similarity scores.

Carbohydrates↗

Conformalized-KANs: Uncertainty Quantification with Coverage Guarantees for Kolmogorov-Arnold Networks (KANs) in Scientific Machine Learning

This paper explores uncertainty quantification (UQ) methods in the context of Kolmogorov–Arnold Networks (KANs). We apply an ensemble approach to KANs to obtain a heuristic measure of UQ, enhancing interpretability and robustness in modeling complex functions. Building on this, we introduce Conformalized-KANs, which integrate conformal prediction, a distribution-free UQ technique, with KAN ensembles to generate calibrated prediction intervals with guaranteed coverage.} Extensive numerical experiments are conducted to evaluate the effectiveness of these methods, focusing particularly on the robustness and accuracy of the prediction intervals under various hyperparameter settings. We show that the conformal KAN predictions can be applied to recent extensions of KANs, including Finite Basis KANs (FBKANs) and multifideilty KANs (MFKANs). The results demonstrate the potential of our approaches to significantly improve the reliability and applicability of KANs in scientific machine learning.

• Artificial intelligence (AI) / machine learning ↗

Plasma effects on the spontaneous emission of synchrotron radiation from weakly relativistic electrons

A method for computing the spectral emissivity of spontaneous synchrotron radiation is discussed. The Klimontovich (1967) formalism in plasma kinetic theory is adopted in which an ensemble average of the microscopically emitted power is considered. The present method clarifies the meaning of the random phase approximation which is imposed in several existing theories of synchrotron radiation. Both the effects of dielectric polarization and two-particle correlations are included in the present discussion. The theory is applied to the case of a plasma in thermal equilibrium, for which it is shown that the effect of pair correlations on the emissivity vanishes. On the other hand, the effect of dielectric polarization is studied numerically for a wide range of parameters.

Freund, H. P.↗

An analytical approach to gravitational lensing by an ensemble of axisymmetric lenses

The problem of gravitational lensing by an ensemble of identical axisymmetric lenses randomly distributed on a single lens plane is considered and a formal expression is derived for the joint probability density of finding shear and convergence at a random point on the plane. The amplification probability for a source can be accurately estimated from the distribution in shear and convergence. This method is applied to two cases: lensing by an ensemble of point masses and by an ensemble of objects with Gaussian surface mass density. There is no convergence for point masses whereas shear is negligible for wide Gaussian lenses.

Lee, Man Hoi↗

CONCURRENT, CONDENSED STEIN VARIATIONAL GRADIENT DESCENT FOR UNCERTAINTY QUANTIFICATION OF NEURAL NETWORKS

In this work, we propose a Stein variational gradient descent (SVGD) method to concurrently sparsify, train, and provide uncertainty quantification (UQ) of a complexly parameterized model, such as a neural network (NN). It employs a graph reconciliation and condensation process to reduce complexity and increase similarity in the Stein ensemble of parameterizations. Therefore, the proposed concurrent, condensed SVGD (ccSVGD) method can provide UQ on parameters, not just outputs. Furthermore, the parameter reduction speeds up the convergence of the Stein gradient descent as it reduces the combinatorial complexity by aligning and differentiating the sensitivity to parameters. These properties are demonstrated with an illustrative example and an application to a mechanical response representation problem in solid mechanics.

42 ENGINEERING↗

Synchrotron emissivity from mildly relativistic particles

A simple approximate method for the evaluation of the spectrum and directivity of the synchrotron radiation from an ensemble of particles in a given magnetic field is considered, taking into account the results of this method for the total emissivity at high harmonics. The general formula is presented along with the details of the derivation of the emissivity for an arbitrary energy spectrum and pitch angle distribution of particles. The emissivities for some commonly encountered particle distributions are provided and some empirical formulae valid for a large range of the parameters are given. The results from the analytic expressions are compared with those obtained by detailed numerical calculations. For isotropic pitch angle distributions, spectra from the simple analytic expressions agree with the numerical results to a high degree of accuracy even at lower harmonics.

Petrosian, V.↗

Portable, heterogeneous ensemble workflows at scale using libEnsemble

libEnsemble is a Python-based toolkit for running dynamic ensembles, developed as part of the DOE Exascale Computing Project. The toolkit utilizes a unique generator–simulator–allocator paradigm, where generators produce input for simulators, simulators evaluate those inputs, and allocators decide whether and when a simulator or generator should be called. The generator steers the ensemble based on simulation results. Generators may, for example, apply methods for numerical optimization, machine learning, or statistical calibration. libEnsemble communicates between a manager and workers. Flexibility is provided through multiple manager–worker communication substrates each of which has different benefits. These include Python’s multiprocessing, mpi4py, and TCP. Multisite ensembles are supported using Balsam or Globus Compute. We overview the unique characteristics of libEnsemble as well as current and potential interoperability with other packages in the workflow ecosystem. We highlight libEnsemble’s dynamic resource features: libEnsemble can detect system resources, such as available nodes, cores, and GPUs, and assign these in a portable way. These features allow users to specify the number of processors and GPUs required for each simulation; and resources will be automatically assigned on a wide range of systems, including Frontier, Aurora, and Perlmutter. Such ensembles can include multiple simulation types, some using GPUs and others using only CPUs, sharing nodes for maximum efficiency. We also describe the benefits of libEnsemble’s generator–simulator coupling, which easily exposes to the user the ability to cancel, and portably kill, running simulations based on models that are updated with intermediate simulation output. We demonstrate libEnsemble’s capabilities, scalability, and scientific impact via a Gaussian process surrogate training problem for the longitudinal density profile at the exit of a plasma accelerator stage. In conclusion, the study uses gpCAM for the surrogate model and employs either Wake-T or WarpX simulations, highlighting efficient use of resources that can easily extend to exascale.

Dynamic ensembles↗

An efficient hybrid downscaling framework to estimate high-resolution river hydrodynamics

Flow depth and velocity are the most important hydrodynamic variables that govern various river functions, including water resources, navigation, sediment transport, and biogeochemical cycling. Existing high-resolution flow depth simulations rely on either computationally expensive river hydrodynamic models (RHMs) or data-driven models with formidable training costs, whereas data-driven modeling of flow velocity has rarely been explored. Here, using the hybrid Low-fidelity, Spatial analysis, and Gaussian process learning (LSG) model, we developed a downscaling approach to construct high-resolution flow depth and velocity from a two-dimensional (2-D) RHM simulation at coarse resolution. The LSG models were trained and tested in an urban watershed in Houston using two different hurricane-driven flood events. The high-resolution (as fine as 30 m resolution) and low-resolution (mostly 1000 m resolution) meshes include 664 724 and 14 536 grid cells, respectively. The results showed that through downscaling, the simulation errors were reduced to less than one-fourth and one-third of the errors of the low-resolution 2-D RHM for flow depth and velocity, respectively. Our analysis further revealed that the dominant uncertainty sources of the downscaled hydrodynamics are different, with flow velocity dominated by the dimensionality reduction error, which we reduced by using a regionalized training procedure. The downscaling approach achieves an 84-fold acceleration in computational time compared to the high-resolution 2-D RHM, making high-fidelity ensemble flood modeling feasible. More importantly, the developed method provides an opportunity to couple large-scale hydrodynamical processes with local physical, chemical, and biological processes in river models.

Tan, Zeli [Pacific Northwest National Laboratory (↗

Principal component analysis of solar flares in the soft X-ray flux

The paper considers principal component analysis of solar flares in the soft X-ray flux, a technique for extracting the salient features from a mass of data. The method applies particularly to the analysis of nonstationary ensembles, and its computations require the evaluation of eigenvalues of matrices. The Eispack matrix eigen system routines were used to analyze full-disk proportional-counter data from the X-ray event analyzer which was part of the Skylab experiment. Empirical orthogonal functions were derived for events in the soft X-ray spectrum between 2.5 and 20 A during different time periods, indicating that about 90% of the cumulative power of each analyzed flare is contained in the largest eigenvector. The first two largest eigenvectors are sufficient for an empirical curve fit through the raw data and a characterization of solar flares in the soft X-ray flux, and power spectra of two largest eigenvectors reveal a reported periodicity of about 5 min.

Teuber, D. L.↗

Computing diffuse reflection from particulate planetary surface with a new function

An equation is derived to compute the amount of diffuse light reflected by a particulate surface, such as on Mars or an asteroid. The method traces the paths of rays within an ensemble of randomly shaped grains and finds the eventual probability of emission. The amount of diffuse, unpolarized emitted light is obtained in terms of the real index of refraction, the imaginary index, and the average diameter of particles making up the surface. The equation is used to compute the empirical rule for obtaining the planetary albedo from the slope of its polarization curve. Accuracy of the equation, estimated at + or - 4%, seems justified because of quantitative agreement with experimental measures of the empirical rule. It is also shown that the equation can be applied to bubble-enclosing surfaces such as volcanic foams. Results for the indices of the moon, Mars, Io, and Europa are obtained and compared with other data.

Wolff, M.↗

Dynamic response of shock waves in transonic diffuser and supersonic inlet - An analysis with the Navier-Stokes equations and adaptive grid

An existing method which solves the multi-dimensional ensemble-averaged compressible time-dependent Navier-Stokes equations in conjunction with mixing length turbulence model and shock capturing technique has been extended to include the shock-tracking adaptive grid systems. The numerical scheme for solving the governing equations is based on a linearized block implicit approach. The effects of grid-motion and grid-distribution on the calculated flow solutions have been studied in relative detail and this is carried out in the context of physically steady, shocked flows computed with non-stationary grids. Subsequently, the unsteady dynamics of the flows occurring in a supercritically operated transonic diffuser and a mixed compression supersonic inlet have been investigated with the adaptive grid systems by solving the Navier-Stokes equations.

Liu, N.-S.↗

Light scattering instrumentation for micro gravity research

The analysis of light scattered from an ensemble of particles has long been a preferred method for characterizing their physical properties. Instrumentation to perform the measurements which forms the basis for such analysis is available in many forms based upon a variety of different experimental techniques. A system is presented which is singularly applicable for making many types of measurements in a microgravity environment. The commercial version of this device, the DAWN-F, has been used in many labs throughout the world to perform analyses of particular importance for both research and production. Light scattering theory is reviewed and the structure and function of the system is described.

Wyatt, Philip J.↗

A Single-column Model Ensemble Approach Applied to the TWP-ICE Experiment

Single-column models (SCM) are useful test beds for investigating the parameterization schemes of numerical weather prediction and climate models. The usefulness of SCM simulations are limited, however, by the accuracy of the best estimate large-scale observations prescribed. Errors estimating the observations will result in uncertainty in modeled simulations. One method to address the modeled uncertainty is to simulate an ensemble where the ensemble members span observational uncertainty. This study first derives an ensemble of large-scale data for the Tropical Warm Pool International Cloud Experiment (TWP-ICE) based on an estimate of a possible source of error in the best estimate product. These data are then used to carry out simulations with 11 SCM and two cloud-resolving models (CRM). Best estimate simulations are also performed. All models show that moisture-related variables are close to observations and there are limited differences between the best estimate and ensemble mean values. The models, however, show different sensitivities to changes in the forcing particularly when weakly forced. The ensemble simulations highlight important differences in the surface evaporation term of the moisture budget between the SCM and CRM. Differences are also apparent between the models in the ensemble mean vertical structure of cloud variables, while for each model, cloud properties are relatively insensitive to forcing. The ensemble is further used to investigate cloud variables and precipitation and identifies differences between CRM and SCM particularly for relationships involving ice. This study highlights the additional analysis that can be performed using ensemble simulations and hence enables a more complete model investigation compared to using the more traditional single best estimate simulation only.

numerical weather forecasting↗

Goddard Cumulus Ensemble (GCE) Model: Application for Understanding Precipitation Processes

One of the most promising methods to test the representation of cloud processes used in climate models is to use observations together with Cloud Resolving Models (CRMs). The CRMs use more sophisticated and realistic representations of cloud microphysical processes, and they can reasonably well resolve the time evolution, structure, and life cycles of clouds and cloud systems (size about 2-200 km). The CRMs also allow explicit interaction between out-going longwave (cooling) and incoming solar (heating) radiation with clouds. Observations can provide the initial conditions and validation for CRM results. The Goddard Cumulus Ensemble (GCE) Model, a cloud-resolving model, has been developed and improved at NASA/Goddard Space Flight Center over the past two decades. Dr. Joanne Simpson played a central role in GCE modeling developments and applications. She was the lead author or co-author on more than forty GCE modeling papers. In this paper, a brief discussion and review of the application of the GCE model to (1) cloud interactions and mergers, (2) convective and stratiform interaction, (3) mechanisms of cloud-radiation interaction, (4) latent heating profiles and TRMM, and (5) responses of cloud systems to large-scale processes are provided. Comparisons between the GCE model's results, other cloud-resolving model results and observations are also examined.

Tao, Wei-Kuo↗

Scalable Bayesian Physics-Informed Kolmogorov-Arnold Networks

Uncertainty quantification (UQ) plays a pivotal role in scientific machine learning, especially when surrogate models are used to approximate complex systems. Although multilayer perceptions (MLPs) are commonly employed as surrogates, they often suffer from overfitting due to their large number of parameters. Kolmogorov-Arnold networks (KANs) offer an alternative solution with fewer parameters. However, gradient-based inference methods, such as Hamiltonian Monte Carlo (HMC), may result in computational inefficiency when applied to KANs, especially for large-scale datasets, due to the high cost of back-propagation. To address these challenges, we propose a novel approach, combining the dropout Tikhonov ensemble Kalman inversion (DTEKI) with Chebyshev KANs. This gradient-free method effectively mitigates overfitting and enhances numerical stability. In addition, we incorporate the active subspace method to reduce the parameter-space dimensionality, allowing us to improve the accuracy of predictions and obtain more reliable uncertainty estimates. Extensive experiments demonstrate the efficacy of our approach in various test cases, including scenarios with large datasets and high noise levels. Our results show that the new method achieves comparable or better accuracy, much higher efficiency as well as stability compared to HMC, in addition to scalability. Moreover, by leveraging the low-dimensional parameter subspace, our method preserves prediction accuracy while substantially reducing further the computational cost.

97 MATHEMATICS AND COMPUTING↗

Uncertainty Models for the Hybrid Parametric Variation Method of Uncertainty Quantification; Analysis

There is some level of uncertainty in every finite element model (FEM), which flows to a level of uncertainty in predicted results. The purpose of uncertainty quantification (UQ) is to provide statistical bounds on prediction accuracy based on model uncertainty. This is distinct from model updating, which attempts to modify models to improve their accuracy. UQ does not improve the accuracy of models, but accepts that the models are inherently inaccurate and attempts to quantify the impact of that inaccuracy on predicted results. Previously, an alternate method for UQ, called the Hybrid Parametric Variation (HPV) method, was applied to Space Launch System (SLS) Hurty/Craig-Bampton (HCB) components to predict system-level statistics for launch vehicle attitude control transfer functions and core stage section loads due to buffet. The HPV method combines a parametric variation of the HCB fixed-interface (FI) modal frequencies with a nonparametric variation (NPV) method that randomly varies the HCB mass and stiffness matrices as Wishart random matrix distributions using random matrix theory (RMT). Alternatively, the most common method for modeling uncertainty in the structural dynamics community is a parametric approach, which varies physical parameters in the model. However, there are several disadvantages associated with the parametric method. Determining a reduced set of parameters that have a significant impact on the system response can be time consuming, and the selected parameter probability distributions are rarely reliably known. Therefore, in practice, the parameters are surrogates for the actual errors, and the link to parameter uncertainty is unknown. Another major drawback is that the uncertainty that can be represented is limited to the form of the nominal FEM. It is the experience of the authors that based on numerous aerospace programs, almost all FEM errors are in form rather than parameter values. This hypothesis is supported by the observation of the authors that it is almost never possible to ‘tune’ a FEM to match modal test results by only modifying model parameters. Model-form uncertainty cannot be directly represented by FEM input parameters nor included in a parametric approach. However, model-form uncertainty can be modeled using RMT, where a probability distribution is developed for the matrix ensemble of interest. The major advantage of the NPV method is that it covers errors in model form. The HPV method anchors uncertainty at the HCB component level to component modal test results by matching the HCB and test modes based on mode descriptions or other methods, and then applying differing levels of frequency variation. The specific variations depend on the confidence to which a component FEM has been validated through modal testing. The NPV method is layered on the frequency variation to match modal test self-orthogonality and cross-orthogonality (XO) results. Once the component uncertainty models are identified, they are assembled, and the uncertainty is propagated to the system level using a Monte Carlo (MC) analysis approach that generates statistics for system-level predictions This provides a UQ method that can be traced to test data, which can be updated as additional data and improved correlated models become available. The purpose of this paper is to collect and present all of the theory for HPV that has been previously published in reports and papers and to present examples of its application. Specifically, component uncertainty models based on the dispersion of corresponding mass and stiffness matrices using proposed test/analysis correlation metrics are investigated. The first example is purely academic so that the true answers are known, and the validity of the HPV method and the corresponding uncertainty models can be determined. The purpose of this paper is to collect and present all of the theory for HPV that has been previously published in reports and papers and to present examples of its application. Specifically, component uncertainty models based on the dispersion of corresponding mass and stiffness matrices using proposed test/analysis correlation metrics are investigated. The first example is purely academic so that the true answers are known, and the validity of the HPV method and the corresponding uncertainty models can be determined. The second example is an application to a component that is design specific to the SLS. Based on this work and other assessments, the HPV method provides another tool to the toolset used for complex system UQ analysis. From experience gathered to date using the HPV method, additional design specific applications must be investigated to provide further confidence in the validity of the HPV method of UQ analysis.

Uncertainty quantification↗