Search NASA⌕ Search

SEARCH · Search NASA

Results for “Ensemble methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
NASA NTRS2019

Solar Activity Modeling: From Subgranular Dynamical Scales to the Solar Cycles

The dynamical effects of solar magnetoconvection span a wide range spatial and temporal scales that extend from the interior to the corona and from fast turbulent motions to global magnetic activity. To study the solar activity on short temporal scales (from minutes to hours), we use 3D radiative MHD simulations that allow us to investigate complex turbulent interactions that drive various phenomena, such as plasma eruptions, spontaneous formation of magnetic structures, funnel-like structures and magnetic loops in the corona, and others. In particular, we focus on multi-scale processes of energy exchange across layers of the solar interior and atmosphere, which contribute to coronal heating and eruptive dynamics. For modeling global-scale activity, we use a data assimilation approach that has demonstrated great potential for building reliable long-term forecasts of solar activity. In particular, it has been shown that the Ensemble Kalman Filter (EnKF) method applied to the Parker-Kleeorin-Ruzmakin dynamo model is capable of predicting solar activity up to one sunspot cycle ahead in time, as well as estimating the properties of the next cycle a few years before it begins. In this presentation, using the available magnetogram data, we discuss development of the methodology and forecast quality criteria (including forecast uncertainties and sources of errors). We demonstrate the influence of observational limitations on prediction accuracy, and we present the EnKF predictions of the upcoming Solar Cycle (25) based on both the sunspot number series and observed magnetic fields and discuss the uncertainties and potential of the data assimilation approach for modeling and forecasting solar activity.

Kitiashvili, I. N.↗
NASA NTRSDate not supplied

Measured and Modeled Vineyard Canopy Development and Water Use

Two publicly available applications relevant to vineyard irrigation management are described. OpenET is a satellite-based system that applies an ensemble of remote sensing methods to enable wide-area monitoring of evapotranspiration (ET) and related measures such as vegetation canopy development (via the NDVI spectral index). Data are freely available at one-quarter acre spatial resolution, and may be automatically aggregated to the individual block level. The satellite-based daily ET data were compared with in-situ eddy covariance measurements collected by micro-meteorological instrumentation in a Central Coast vineyard over a three-year period (2020-2022). Estimation uncertainties were reasonably consistent with prior reports for GRAPEX sites in the Central Valley and North Coast. The CropManage (CM) web application is a free software tool developed and operated U.C. Cooperative Extension for ET-based irrigation scheduling of major specialty crops. CM provides specific guidance for irrigation events in terms of irrigation system runtime. Applied water recommendations are based largely on estimated ET, derived from assumed canopy cover and associated crop coefficients, since the last irrigation or rainfall event. The application was recently adapted to vineyards by accounting for presence of winter/spring cover crop, and vine water stress imposed by regulated deficit irrigation. A 2022 field campaign involved 12 Central Coast and San Joaquin Valley commercial vineyards, and OpenET data were used to help evaluate CM output. Maximum percent vine cover was compared to estimates derived from average July satellite NDVI. The difference for 10 sites lacking midseason groundcover ranged from 0-7% between datasets with average agreement near 4%. Cumulative ET estimates agreed with OpenET to within 12% at the majority of sites, while larger discrepancies at the remaining sites may require additional data collection and analysis during the 2023 season. Satellite based systems such as OpenET have the potential to help parameterize CropManage and similar agricultural decision-support systems.

Measured↗
DOE OSTI2024

Classical field approximation of ultralight dark matter: Quantum break times, corrections, and decoherence

The classical field approximation is widely used to better understand the predictions of ultralight dark matter. Here, in this work, we use the truncated Wigner approximation method to test the classical field approximation of ultralight dark matter. This method approximates a quantum state as an ensemble of independently evolving realizations drawn from its Wigner function. The method is highly parallelizable and allows the direct simulation of quantum corrections and decoherence times in systems many times larger than have been previously studied in reference to ultralight dark matter. Our study involves simulation of systems in 1, 2, and 3 spatial dimensions. We simulate three systems, the condensation of a Gaussian random field in three spatial dimensions, a stable collapsed object in three spatial dimensions, and the merging of two stable objects in two spatial dimensions. We study the quantum corrections to the classical field theory in each case. We find that quantum corrections grow exponentially during nonlinear growth with the timescale being approximately equal to the system dynamical time. In stable systems the corrections grow quadratically. We also find that the primary effect of quantum corrections is to reduce the amplitude of fluctuations on the de Broglie scale in the spatial density. Finally, we find that the timescale associated with decoherence due to gravitational coupling to baryonic matter is at least as fast as the quantum corrections due to gravitational interactions. These results are consistent with the predictions of the classical field theory being accurate.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Nonlinear Ensemble Filtering with Diffusion Models: Application to the Surface Quasigeostrophic Dynamics

The intersection between classical data assimilation methods and novel machine learning techniques has attracted significant interest in recent years. Here, we explore another promising solution in which diffusion models are used to formulate a robust nonlinear ensemble filter for sequential data assimilation. Unlike standard machine learning methods, the proposed ensemble score filter (EnSF) is completely training free and can efficiently generate a set of analysis ensemble members. Here, in this study, we apply the EnSF to a surface quasigeostrophic model and compare its performance against the popular local ensemble transform Kalman filter (LETKF), which makes Gaussian assumptions in the analysis step. Numerical tests demonstrate that EnSF maintains stable performance in the absence of localization and for a variety of experimental settings. We find that while LETKF maintains optimal performance in the case of linear observations of the entire state and a perfect model, EnSF shows improvements over LETKF when nonlinear observations are assimilated and the system is subject to unexpected model errors. A spectral decomposition of the analysis results in this nonlinear observation regime shows that the largest improvements over LETKF occur at large scales (small wavenumbers), where LETKF lacks sufficient ensemble spread. Overall, this initial application of EnSF to a geophysical model of intermediate complexity motivates further development of the algorithm for more realistic problems.

Artificial intelligence↗
NASA NTRS2017

Early Estimation of Solar Activity Cycle: Potential Capability and Limits

The variable solar magnetic activity known as the 11-year solar cycle has the longest history of solar observations. These cycles dramatically affect conditions in the heliosphere and the Earth's space environment. Our current understanding of the physical processes that make up global solar dynamics and the dynamo that generates the magnetic fields is sketchy, resulting in unrealistic descriptions in theoretical and numerical models of the solar cycles. The absence of long-term observations of solar interior dynamics and photospheric magnetic fields hinders development of accurate dynamo models and their calibration. In such situations, mathematical data assimilation methods provide an optimal approach for combining the available observational data and their uncertainties with theoretical models in order to estimate the state of the solar dynamo and predict future cycles. In this presentation, we will discuss the implementation and performance of an Ensemble Kalman Filter data assimilation method based on the Parker migratory dynamo model, complemented by the equation of magnetic helicity conservation and longterm sunspot data series. This approach has allowed us to reproduce the general properties of solar cycles and has already demonstrated a good predictive capability for the current cycle, 24. We will discuss further development of this approach, which includes a more sophisticated dynamo model, synoptic magnetogram data, and employs the DART Data Assimilation Research Testbed.

Kitiashvili, Irina N.↗
NASA NTRS2017

Using Data Assimilation Methods of Prediction of Solar Activity

The variable solar magnetic activity known as the 11-year solar cycle has the longest history of solar observations. These cycles dramatically affect conditions in the heliosphere and the Earth's space environment. Our current understanding of the physical processes that make up global solar dynamics and the dynamo that generates the magnetic fields is sketchy, resulting in unrealistic descriptions in theoretical and numerical models of the solar cycles. The absence of long-term observations of solar interior dynamics and photospheric magnetic fields hinders development of accurate dynamo models and their calibration. In such situations, mathematical data assimilation methods provide an optimal approach for combining the available observational data and their uncertainties with theoretical models in order to estimate the state of the solar dynamo and predict future cycles. In this presentation, we will discuss the implementation and performance of an Ensemble Kalman Filter data assimilation method based on the Parker migratory dynamo model, complemented by the equation of magnetic helicity conservation and long-term sunspot data series. This approach has allowed us to reproduce the general properties of solar cycles and has already demonstrated a good predictive capability for the current cycle, 24. We will discuss further development of this approach, which includes a more sophisticated dynamo model, synoptic magnetogram data, and employs the DART Data Assimilation Research Testbed.

Prediction↗
NASA NTRS2017

Using Data Assimilation Methods for Prediction of Solar Activity

The variability of solar magnetic activity known as the 11-­‐year solar cycles has the longest history of observations. These solar cycles dramatically affect conditions in the heliosphere and the Earth’s space environment. Our current understanding of the physical processes that make up global solar dynamics and the dynamo that generates the magnetic fields is sketchy, resulting in unrealistic descriptions in theoretical and numerical models of the solar cycles. The absence of long-­‐term observations of solar interior dynamics and photospheric magnetic fields hinders development of accurate dynamo models and their calibration. In such situations, mathematical data assimilation methods provide an optimal approach for combining the available observational data and their uncertainties with theoretical models in order to estimate the state of the solar dynamo and predict future cycles. In this presentation, we will discuss the implementation and performance of an Ensemble Kalman Filter data assimilation method based on the Parker migratory dynamo model complemented by the equation of magnetic helicity conservation and long-­‐term sunspot data series. This approach has allowed us to reproduce the general properties of the solar cycles and has already demonstrated a good predictive capability for the current cycle, 24. We will discuss further development of this approach, which includes a more sophisticated dynamo model, synoptic magnetogram data, and employs the DART Data Assimilation Research Testbed.

Solar Activity↗
NASA NTRS2004

Estimating the instability of a composite clock

A composite clock created from a local clock ensemble is known by its time offsets from the ensemble clocks. By a geometrical argument, estimate for the instability of the composite clock are calculated from the instabilities of the ensemble clocks, individually and against the composite clock. The method is illustrated by examples using simulated and real ensembles.

timescale↗
DOE OSTI2025

Colloidal quantum dots for optoelectronics

Colloidal quantum dots (QDs) are semiconductor nanocrystals that have unique size-tunable optoelectronic properties and are suitable for wet processing. QD research aims to answer fundamental questions about the chemical and physical properties of nanoscale materials and use these tools for technological applications ranging from bio-imaging to quantum optics. At the core of this field is a set of synthetic, processing and analytical methods designed to produce QDs in uniform ensembles that meet the highest performance standards. Here, this Primer reviews QD fabrication methods with a focus on the applications of QDs in printed optoelectronics and quantum optics. After outlining the current state-of-the-art QD syntheses, the experimental and computational analysis of QDs is discussed. These topics are then connected to the methodologies, processes and concepts required for developing QD-based photodetectors, light-emitting devices and quantum optics applications. Special attention is paid to challenges in reproducibility and current limitations of the field, such as the need to balance non-restricted material composition with high performing technology while achieving long-term stability in QD devices under operating conditions. Finally, the ongoing advancement in QD synthesis, precise atomic-level analysis and computational methodologies are highlighted as key drivers towards rational QD design, particularly in understanding how structural changes under loading impact QD properties.

optical materials↗
DOE OSTI2025

Boosting efficiency and reducing graph reliance: Basis adaptation integration in Bayesian multi-fidelity networks

The computational cost of high-fidelity numerical models makes outer-loop analysis, which requires repeated interrogation of the model such as uncertainty quantification, computationally demanding. Multi-fidelity methods, which construct a surrogate model using data from an ensemble of models of varying cost and accuracy, can substantially reduce the cost of outer-loop analysis. However, these methods can be difficult to apply when the model ensemble does not admit a clear hierarchy a priori and the correlations between models are low. Consequently, in this paper, we present a multi-fidelity method that leverages dimension reduction to enhance the correlation between models, thereby reducing the amount of data needed to train a surrogate from an unordered ensemble of models. Our method utilizes basis adaptation to build low-dimensional polynomial chaos expansions of each model and employs Multi-fidelity Networks to encode the relationships among models. We show that the resulting method exhibit two notable advantages over its counterpart: (1) enhanced accuracy (both reduced bias and variance); and (2) reduced dependency on the graph structure encoding relationships among models. We demonstrate the approach on an analytical test problem and a challenging finite element model for a spent nuclear fuel. Our method produces a surrogate model that is significantly more accurate than either a single-fidelity surrogate or a multi-fidelity surrogate constructed without basis adaptation.

42 ENGINEERING↗
NASA NTRS1984

Lagged average forecasting, some operational considerations

The Lagged Average Forecast (LAF) method differs from the Monte Carlo Forecast (MCF) method in the definition of the ensemble of initial states which are used to generate the ensemble of forecasts. The LAF initial states are the current analysis and the forecasts made from previous analyses verifying the current time. Thus the LAF ensemble is composed of forecasts which are made by a regular operational system of numerical weather prediction and the LAF method is therefore operationally attractive. The application of the authors' previous ideas and results to an operational model requires the resolution of what might be called the degrees of freedom problem, i.e., how to obtain a homogeneous sample large enough to calculate stable statistics. It is suggested that this problem may be solved by carefully modeling the required statistics in terms of a small set of parameters and then estimating only these few parameters from the data. It is noted that there may be considerable information in each initial ensemble relating to the predictability of each particular case, and that this information may be incorporated in the model of the statistics.

Hoffman, R. N.↗
DOE OSTI2025

Solving high-dimensional inverse problems using amortized likelihood-free inference with noisy and incomplete data

Here, we present a likelihood-free probabilistic inversion method based on normalizing flows for high-dimensional inverse problems. The proposed method is composed of two complementary networks: a summary network for data compression and an inference network for parameter estimation. The summary network encodes raw observations into a fixed-size vector of summary features, while the inference network generates samples of the approximate posterior distribution of the model parameters based on these summary features. The posterior samples are produced in a deep generative fashion by sampling from a latent Gaussian distribution and passing these samples through an invertible transformation. We construct this invertible transformation by sequentially alternating conditional invertible neural network and conditional neural spline flow layers. The summary and inference networks are trained simultaneously. We apply the proposed method to an inversion problem in groundwater hydrology to estimate the posterior distribution of the log-conductivity field conditioned on spatially sparse time-series observations of the system’s hydraulic head responses. The conductivity field is represented with 706 degrees of freedom in the considered problem. Comparison with the likelihood-based iterative ensemble smoother PEST-IES method demonstrates that the proposed method accurately estimates the parameter posterior distribution and the observations’ predictive posterior distribution at a fraction of the inference time of PEST-IES.

conditional invertible neural network↗
DOE OSTI2026

Enhancing weak lensing redshift distribution characterization by optimizing the Dark Energy Survey Self-Organizing Map Photo-z method

Characterization of the redshift distribution of ensembles of galaxies is pivotal for large scale structure cosmological studies. In this work, we focus on improving the Self-Organizing Map (SOM) methodology for photometric redshift estimation (SOMPZ), specifically in anticipation of the Dark Energy Survey Year 6 (DES Y6) data. This data set, featuring deeper and fainter galaxies than DES Year 3 (DES Y3), demands adapted techniques to ensure accurate recovery of the underlying redshift distribution. We investigate three strategies for enhancing the existing SOM-based approach used in DES Y3: 1) Replacing the Y3 SOM algorithm with one tailored for redshift estimation challenges; 2) Incorporating $\textit{g}$-band flux information to refine redshift estimates (i.e. using $\textit{griz}$ fluxes as opposed to only $\textit{riz}$); 3) Augmenting redshift data for galaxies where available. These methods are applied to DES Y3 data, and results are compared to the Y3 fiducial ones. Our analysis indicates significant improvements with the first two strategies, notably reducing the overlap between redshift bins. By combining strategies 1 and 2, we have successfully managed to reduce redshift bin overlap in DES Y3 by up to 66$\%$. Conversely, the third strategy, involving the addition of redshift data for selected galaxies as an additional feature in the method, yields inferior results and is abandoned. Our findings contribute to the advancement of weak lensing redshift characterization and lay the groundwork for better redshift characterization in DES Year 6 and future stage IV surveys, like the Rubin Observatory.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS1991

Backscattering by nonspherical particles - A review of methods and suggested new approaches

Scattering of electromagnetic radiation near the backward direction is more sensitive to particle shape than scattering near the forward direction. Mie theory is therefore of dubious applicability to predicting backscattering by atmospheric particles known to be irregular or to inverting measurements on such particles. An irregular particle is one with an uncertain shape. In the face of uncertainty one must adopt a statistical approach in which scattering properties of ensembles are determined. To obtain ensemble averages, a basis is needed for averaging over a set of electromagnetic microstates. Ensemble averages based on the Rayleigh theory for small ellipsoids and on the T matrix method for spheroids agree better with measurements than Mie theory does. The coupled-dipole method also provides a basis for ensemble averaging. This method also leads to a simple physical interpretation of why backscattering is so sensitive to particle shape and can be used to calculate scattering by one- and two-dimensional analogs to three-dimensional irregular particles.

Bohren, Craig F.↗
DOE OSTI2025

Implementation of stacked ensemble machine learning for the detection of surrogate plutonium contamination in soil via LIBS

Supervised machine learning methods have demonstrated increased utility for the quantification of lanthanide and actinide elements in atomic spectroscopy applications. This study implements laser-induced breakdown spectroscopy (LIBS) for the identification of plutonium surrogate material (CeO 2 ) in soil matrices by training supervised machine learning methods on the recorded spectral data. A bagged ensemble using Random Forest yields the highest sensitivity predictions with a detection limit of 0.015 wt.% CeO 2 . However, high precision in Ce content prediction required the use of a stacked ensemble regression, which provided the superlative Ce quantification model with an error of 0.107% and a detection limit of 0.022 wt.%. Furthermore, the high performance of the stacked ensemble demonstrates its potential to enhance the accuracy and sensitivity of nuclear contaminant detection using field-deployable spectroscopic analyzers in real-world scenarios.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Pushing the frontiers in climate modelling and analysis with machine learning

Climate modelling and analysis are facing new demands to enhance projections and climate information. Here, in this study, we argue that now is the time to push the frontiers of machine learning beyond state-of-the-art approaches, not only by developing machine-learning-based Earth system models with greater fidelity, but also by providing new capabilities through emulators for extreme event projections with large ensembles, enhanced detection and attribution methods for extreme events, and advanced climate model analysis and benchmarking. Utilizing this potential requires key machine learning challenges to be addressed, in particular generalization, uncertainty quantification, explainable artificial intelligence and causality. This interdisciplinary effort requires bringing together machine learning and climate scientists, while also leveraging the private sector, to accelerate progress towards actionable climate science.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Localization of infrasonic sources via Bayesian back projection

SUMMARY A Bayesian framework is investigated for event-specific localization of infrasonic sources using back projection ray tracing. Direction-of-arrival information from array-based detection analysis is used to initialize a back projection ray path originating from the detecting array location and quantifying propagation characteristics from hypothetical source locations. The Fisher statistic, computed from the array’s beam coherence, is mapped into uncertainty in the launch angles of the ray path. Auxiliary parameters previously introduced for solving the Transport equation to compute geometric spreading along ray paths are used to map uncertainty in the ray launch angles into spatial and temporal uncertainties in the ray path. An atmospheric ensemble approach is applied to account for atmospheric uncertainty, and the relation between uncertainties in the atmospheric state and confidence in estimated localization are evaluated using several ensembles with specified variances. The method is evaluated using a synthetic event in the western United States constructed via forward propagation simulations as well as a single-station, multi-arrival detection from a surface explosion in the western United States. Localization results using this event-specific approach are more accurate and exhibit improved precision than existing Bayesian localization methods that leverage generalized, pre-computed propagation statistics.

58 GEOSCIENCES↗
DOE OSTI2024

Designs from Local Random Quantum Circuits with SU ( d ) Symmetry

The generation of k -designs (pseudorandom distributions that emulate the Haar measure up to k moments) with local quantum circuit ensembles is a problem of fundamental importance in quantum information and physics. Despite the extensive understanding of this problem for ordinary random circuits, the crucial situations in which symmetries or conservation laws are in play are known to pose fundamental challenges and remain little understood. Here, we construct explicit local unitary ensembles that can achieve high-order unitary k -designs under transversal continuous symmetry, in the particularly important SU ( d ) case. Specifically, we define the convolutional quantum alternating (CQA) group generated by 4-local SU ( d ) -symmetric Hamiltonians as well as associated 4-local SU ( d ) -symmetric random unitary circuit ensembles and prove that they form and converge to SU ( d ) -symmetric k -designs, respectively, for all k < n ( n − 3 ) / 2 , with n being the number of qudits. A key technique that we employ to obtain the results is the Okounkov-Vershik approach to S n representation theory. To study the convergence time of the CQA ensemble, we develop a numerical method using the Young orthogonal form and the S n branching rule. We provide strong evidence for a subconstant spectral gap and certain convergence time scales of various important circuit architectures, which contrast with the symmetry-free case. We also provide comprehensive explanations of the difficulties and limitations in rigorously analyzing the convergence time using methods that have been effective for cases without symmetries, including Knabe’s local gap threshold and Nachtergaele’s martingale methods. This suggests that a novel approach is likely necessary for understanding the convergence time of SU ( d ) -symmetric local random circuits. Published by the American Physical Society 2024

Li, Zimu (ORCID:0000000314736492)↗