Search NASA⌕ Search

SEARCH · Search NASA

Results for “ensemble data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
NASA NTRS1999

Investigation of the Influence of Microgravity on Transport Mechanisms in a Virtual Spaceflight Chamber: A Ground Based Program

In January 1992, the IML-1 FES experiment produced a set of classic experimental data and a 40 hour holographic "movie" of an ensemble of spheres in a fluid in microgravity. Because the data are in the form of holograms, we can study the three-dimensional distribution of particles with unprecedented detail by a variety of methods and for a wide variety of interests. The possession of the holographic movie is tantamount to having a complex experiment in space while working in an easily accessible laboratory on earth. The movie contains a vast amount of useful data, including residual g, g-jitter, convection and transport data, and particle fluid interaction data. The information content in the movie is so great that we have scarcely begun to tap into the data that is actually available in the more than 1000 holograms, each containing as much as 1000 megabytes of information. This ground-based project is exploiting this data and the concept of holographic storage of spaceflight data to provide an understanding of the effects of microgravity in materials processing. This paper provides the foundation, objectives, and status of the ground based project. The primary objective of this project is to advance the understanding of microgravity effects on crystal growth, convection in materials processing in the space environment, and complex transport phenomena at low Reynolds numbers. This objective is being achieved both experimentally and theoretically. Experiments are making use of existing holographic data recorded during the IML- I spaceflight. A parallel theoretical effort is providing the models for understanding the particle fields and their physics in the microgravity environment.

Trolinger, James D.↗
DOE OSTI2025

A Data-Agnostic, Continuous Machine Learning Framework for Application in High Energy Physics and Beyond: Phase 1 Final Scientific/Technical Report

This Phase 1 effort has focused on the development of continual learning frameworks for use in machine learning, specifically in the applied context of High Energy Physics (HEP). Machine learning (ML) is a transformative technology by which computers, typically through the use of neural networks, are able to perform tasks with proficiency that rivals or surpasses that of human users. Model Degradation & Catastrophic Forgetting are two undesired phenomena which can occur in ML where the performance of a model degrades when either deployed on novel data streams, or trained on novel data which are sufficiently different than the data the models were initially trained on. A natural example where these sorts of effects can be observed is in the performance of detectors in harsh environments, where the detector signature may change over the lifetime of the detector as it ages and deteriorates — precisely what occurs in the experiments conducted in HEP. Real world HEP data is therefore an excellent test-ground and use-case for Continual Learning paradigms, which are techniques used in ML to counteract these problems. Ensemble learning is one such technique, where multiple smaller models are trained on subsets of the overall data and are ensembled together during inference. The intuition behind this technique is that, although there are shifts in the distributions which govern the incoming data streams, these shifts are not expected to be homogeneous or global. If a sufficient diversity in solutions within the various sub-models has been achieved, then at least one sub-model is expected to retain its performance within the overall ensemble. One further strength of this approach is that the architectures of the various models do not need to be identical, and in fact even different modalities of data can naturally be combined in this way. This work focused on applying ensemble learning techniques to derive results using two main datasets, anomaly detection in HEP data & time-series forecasting in semiconductor manufacturing data. Semiconductor manufacturing involves data with surprising similarity to that of HEP (e.g. wafer maps look very similar to digi-occupancy maps) and Cerium Lab’s prominence within the semiconductor industry makes semiconductor manufacturing a natural opportunity for commercialization of this work. Our efforts have led to two strong results. The first is that we evaluated the proposed ensembling techniques using previously proposed machine learning architectures for use in anomaly detection, namely AutoEncoder based models and their derivatives. We also developed new architectures which have not been evaluated in this context before. In fact, this work marks the first use of Vision Transformers for anomaly detection in HEP. Second, we demonstrated that ensemble learning significantly improves model performance in scenarios prone to degradation, validating its effectiveness across both HEP and semiconductor datasets. These results further support ensemble learning as a powerful strategy for mitigating catastrophic forgetting and maintaining robust performance in evolving data environments.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS1999

The Behavior of Filters and Smoothers for Strongly Nonlinear Dynamics

The Kalman filter is the optimal filter in the presence of known Gaussian error statistics and linear dynamics. Filter extension to nonlinear dynamics is non trivial in the sense of appropriately representing high order moments of the statistics. Monte Carlo, ensemble-based, methods have been advocated as the methodology for representing high order moments without any questionable closure assumptions (e.g., Miller 1994). Investigation along these lines has been conducted for highly idealized dynamics such as the strongly nonlinear Lorenz (1963) model as well as more realistic models of the oceans (Evensen and van Leeuwen 1996) and atmosphere (Houtekamer and Mitchell 1998). A few relevant issues in this context are related to the necessary number of ensemble members to properly represent the error statistics and, the necessary modifications in the usual filter equations to allow for correct update of the ensemble members (Burgers 1998). The ensemble technique has also been applied to the problem of smoothing for which similar questions apply. Ensemble smoother examples, however, seem to quite puzzling in that results of state estimate are worse than for their filter analogue (Evensen 1997). In this study, we use concepts in probability theory to revisit the ensemble methodology for filtering and smoothing in data assimilation. We use Lorenz (1963) model to test and compare the behavior of a variety implementations of ensemble filters. We also implement ensemble smoothers that are able to perform better than their filter counterparts. A discussion of feasibility of these techniques to large data assimilation problems will be given at the time of the conference.

Zhu, Yanqiu↗
DOE OSTI2024

Prediction of Distributed River Sediment Respiration Rates Using Community-Generated Data and Machine Learning

River sediment microbial respiration is a key indicator of ecosystem functioning and the biogeochemical fluxes across this critical zone link surface and subsurface waters. As such, there is tremendous interest in measuring and mapping these respiration rates. Respiration observations are expensive and labor intensive; there is limited data available to the community. An open science, collaborative initiative is collecting samples for respiration rate analysis and multi-scale metadata; this evolving data set is being used for making machine learning (ML) predictions at unsampled sites to help inform continued community engagement. However, it is a challenge to find an optimum configuration for ML models to work with this feature-rich (i.e., 100+ possible input variables) data set. Here, we present results from a two-tiered approach to managing the analysis of this complex data set: (a) a stacked ensemble of models that automatically optimizes hyperparameters and manages the training of many models and (b) feature permutation importance to detect the most important features in the models. The major elements of this workflow are modular, portable, open, and cloud-based thus making this implementation a potential template for other applications. The models developed here predict that sediment organic matter chemistry is one of the most important features for predicting sediment respiration rate. Other larger-scale, important features fall into the categories of climatic, ecological, geological, and fluvial settings. Leveraging these larger-scale features to generate data-driven estimates of river sediment respiration rates reveals spatially consistent but heterogeneous patterns across the river network of the Columbia River Basin.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2004

AveBoost2: Boosting for Noisy Data

AdaBoost is a well-known ensemble learning algorithm that constructs its constituent or base models in sequence. A key step in AdaBoost is constructing a distribution over the training examples to create each base model. This distribution, represented as a vector, is constructed to be orthogonal to the vector of mistakes made by the pre- vious base model in the sequence. The idea is to make the next base model's errors uncorrelated with those of the previous model. In previous work, we developed an algorithm, AveBoost, that constructed distributions orthogonal to the mistake vectors of all the previous models, and then averaged them to create the next base model s distribution. Our experiments demonstrated the superior accuracy of our approach. In this paper, we slightly revise our algorithm to allow us to obtain non-trivial theoretical results: bounds on the training error and generalization error (difference between training and test error). Our averaging process has a regularizing effect which, as expected, leads us to a worse training error bound for our algorithm than for AdaBoost but a superior generalization error bound. For this paper, we experimented with the data that we used in both as originally supplied and with added label noise-a small fraction of the data has its original label changed. Noisy data are notoriously difficult for AdaBoost to learn. Our algorithm's performance improvement over AdaBoost is even greater on the noisy data than the original data.

Oza, Nikunj C.↗
DOE OSTI2025

Hyperspectral segmentation of plants in fabricated ecosystems

Hyperspectral imaging provides a powerful tool for analyzing above-ground plant characteristics in fabricated ecosystems, offering rich spectral information across diverse wavelengths. This study presents an efficient workflow for hyperspectral data segmentation and subsequent data analytics, minimizing the need for user annotation through the use of ensembles of sparse mixed scale convolution neural networks. The segmentation process leverages the diversity of ensembles to achieve high accuracy with minimal labeled data, reducing labor-intensive annotation efforts. To further enhance robustness, we incorporate image alignment techniques to address spatial variability in the dataset. Downstream analysis focuses on using the segmented data for processing spectral data, enabling monitoring of plant health. This approach provides a scalable solution for spectral segmentation, and facilitates actionable insights into plant conditions in complex, controlled environments. Our results demonstrate the utility of combining advanced machine learning techniques with hyperspectral analytics for high-throughput plant monitoring.

Zwart, Petrus H.↗
NASA NTRS2020

Ensemble-Based Deep Learning for Estimating PM2.5 over California with Multisource Big Data Including Wildfire Smoke

Estimating PM2.5 concentrations and their prediction uncertainties at a high spatiotemporal resolution is important for air pollution health effect studies. This is particularly challenging for California, which has high variability in natural (e.g. wildfires, dust) and anthropogenic emissions, meteorology, topography (e.g. desert surfaces, mountains, snow cover) and land use.

air quality↗
NASA NTRS1996

Appendix A: The Impact of the HP 5071A on International Atomic Time

The international clock ensemble, which contributes to the generation of International Atomic Time (TAI and UTC) has improved dramatically over the last few years. The main change has been the introduction of a significant number of HP 5071A clocks. Of the 313 clocks contributing to TAI/UTC during 1994, 94 of these were HP 5071As. The environmental insensitivity of the HP 5071A clocks is more than an order of magnitude better than that of previously contributing clocks. This environmental insensitivity translates to outstanding long-term stability - with a typical flicker floor of a few x10(sup -15). in addition, there are now several hydrogen masers with cavity tuning contributing to TAI/UTC. These not only have outstanding short-term stability, but comparatively low frequency drifts and excellent intermediate-type frequency stability. By analyzing data available from the international ensemble, we have obtained two important results. First the frequency stability obtainable with an optimum algorithm is about 10(sup -15) for both the intermediate and long-term regions. It could be as good in the short-term (if time transfer measurement instabilities were reduced sufficiently. Second, with cooperation, this performance can be made available on an international basis in near real time. The recent enhancements in the contributing clocks are already providing a significant improvement in the accuracy with which UTC is made available to the world from several of the national timing centers, such as the National Institute for Standards and Technology (NIST) and the US Naval Observatory (USNO).

Allan, David W.↗
NASA NTRS1999

Behavior of Filters and Smoothers for Strongly Nonlinear Dynamics

The Kalman filter is the optimal filter in the presence of known gaussian error statistics and linear dynamics. Filter extension to nonlinear dynamics is non trivial in the sense of appropriately representing high order moments of the statistics. Monte Carlo, ensemble-based, methods have been advocated as the methodology for representing high order moments without any questionable closure assumptions. Investigation along these lines has been conducted for highly idealized dynamics such as the strongly nonlinear Lorenz model as well as more realistic models of the means and atmosphere. A few relevant issues in this context are related to the necessary number of ensemble members to properly represent the error statistics and, the necessary modifications in the usual filter situations to allow for correct update of the ensemble members. The ensemble technique has also been applied to the problem of smoothing for which similar questions apply. Ensemble smoother examples, however, seem to be quite puzzling in that results state estimates are worse than for their filter analogue. In this study, we use concepts in probability theory to revisit the ensemble methodology for filtering and smoothing in data assimilation. We use the Lorenz model to test and compare the behavior of a variety of implementations of ensemble filters. We also implement ensemble smoothers that are able to perform better than their filter counterparts. A discussion of feasibility of these techniques to large data assimilation problems will be given at the time of the conference.

Zhu, Yanqui↗
DOE OSTI2026

Contrasting Parametric Sensitivities in Two Global Vegetation Models Using Parameter Perturbation Ensembles

Uncertainty in land model projections remains high and the roles of parametric and structural uncertainty are difficult to disentangle. To compare parametric sensitivity across model structures we present two parameter perturbation ensembles using the Community Land Model (CLM) operating in satellite phenology mode. The ensembles contrast two vegetation modules: (a) the default CLM vegetation module and (b) the Functionally Assembled Terrestrial Ecosystem Simulator (CLM-FATES). We perturbed over 300 parameters and quantified their effects on biophysical fluxes globally and across biomes. Most parameters have minimal impact on biophysical fluxes, with only a few substantially influencing results. While both models exhibit similar parameter sensitivity for some fluxes, CLM-FATES shows larger spread in gross primary productivity (GPP), driven by strong sensitivity to carboxylation rate. CLM-FATES also shows a weaker GPP response to soil hydrology parameters and exhibits higher water use efficiency (WUE). Cross-model comparisons reveal similar sensitivities for some parameters (e.g., leaf dimension) but divergent responses to others (e.g., stomatal intercept), highlighting underlying structural differences. Differences in WUE and sensitivity to hydrology and stomatal conductance parameters underscore how model structure fundamentally alters parametric sensitivity. The data sets generated from these ensembles can be used to identify influential parameters and guide future calibration efforts.

Foster, A. C. [NSF National Center for Atmospheric↗
DOE OSTI2026

Taming nuclear mass models with Gaussian processes

We propose a new set of nuclear mass predictions based on multiple theoretical mass models. By employing Gaussian process regression with the Matérn kernel, we achieved root-mean-square (rms) deviations below 100 keV for the training dataset. The best-performing mass models achieved rms deviations below 150 keV for the new precise mass data from AME2020, whereas the ensemble average showed robust performance across the nuclear chart. Our approach uniquely combines: (1) systematic refinement of eight mass models through their residuals, (2) physics-informed features, including magic numbers, nucleon parity numbers, neutron excess, and nuclear collectivity, and (3) theory-to-theory validation demonstrating robust extrapolation capability. We find that the Matérn kernel provides superior uncertainty quantification compared to the RBF kernel, with a length-scale analysis revealing enhanced inter-nuclei correlations. We provide complete mass predictions for all unknown nuclides in AME2020, offering valuable constraints for nuclear structure studies and astrophysical modeling when used with proper uncertainty propagation.

Gaussian processes↗
NASA NTRS1992

Semiprognostic tests of the Arakawa-Schubert cumulus parameterization using simulated data

Semiprognostic tests are performed against data simulated by a cumulus ensemble model to evaluate the Arakawa-Schubert (A-S) cumulus parametrization. It is found that the A-S cumulus parametrization is generally valid despite the existence of mesoscale organization in cumulus convection. The nondiagnostic and nondeterministic aspects of the A-S cumulus parametrization are examined by testing the sensitivity of the parametrization to the horizontal grid resolution. It is also shown that the inclusion of convective-scale downdrafts improves the results of semiprognostic tests.

Xu, Kuan-Man↗
NASA NTRS1994

A comparison between general circulation model simulations using two sea surface temperature datasets for January 1979

Simulations with the UCLA atmospheric general circulation model (AGCM) using two different global sea surface temperature (SST) datasets for January 1979 are compared. One of these datasets is based on Comprehensive Ocean-Atmosphere Data Set (COADS) (SSTs) at locations where there are ship reports, and climatology elsewhere; the other is derived from measurements by instruments onboard NOAA satellites. In the former dataset (COADS SST), data are concentrated along shipping routes in the Northern Hemisphere; in the latter dataset High Resolution Infrared Sounder (HIRS SST), data cover the global domain. Ensembles of five 30-day mean fields are obtained from integrations performed in the perpetual-January mode. The results are presented as anomalies, that is, departures of each ensemble mean from that produced in a control simulation with climatological SSTs. Large differences are found between the anomalies obtained using COADS and HIRS SSTs, even in the Northern Hemisphere where the datasets are most similar to each other. The internal variability of the circulation in the control simulation and the simulated atmospheric response to anomalous forcings appear to be linked in that the pattern of geopotential height anomalies obtained using COADS SSTs resembles the first empirical orthogonal function (EOF 1) in the control simulation. The corresponding pattern obtained using HIRS SSTs is substantially different and somewhat resembles EOF 2 in the sector from central North America to central Asia. To gain insight into the reasons for these results, three additional simulations are carried out with SST anomalies confined to regions where COADS SSTs are substantially warmer than HIRS SSTs. The regions correspond to warm pools in the northwest and northeast Pacific, and the northwest Atlantic. These warm pools tend to produce positive geopotential height anomalies in the northeastern part of the corresponding oceans. Both warm pools in the Pacific produce large-scale circulation anomalies with a pattern that resembles that obtained using COADS SSTs as well as EOF 1 of the control simulation; the warm pool in the Atlantic does not. These results suggest that the differences obtained with COADS SSTs and HIRS SSTs are mostly due to the differences in the datasets over the northern Pacific. There was a blocking episode near Greenland in late January 1979. Both simulations with warm SST anomalies over the northwest and northeast Pacific show a tendency toward increased incidence of North Atlantic blocking; the simulation with warm SST anomalies over the northwest Atlantic shows a tendency toward decreased incidence. These results suggest that features in both SST datasets that do not have a counterpart in the other dataset contribute signficantly to the differences between the simulated and observed fields. The results of this study imply that uncertainties in current SST distributions for the world oceans can be as important as the SST anomalies themselves in terms of their impact on the atmospheric circulation. Caution should be exercised, therefore, when linking anomalous circulation and SST patterns, especially in long-range prediction.

Ose, Tomoaki↗
NASA NTRS1995

Experimental studies of the properties of 'simulated' upstream turbulence using a statistical multipoint method

In this report we present a different approach to the multipoint measurement of magnetic fields and plasma. This is called the multi-spacecraft ensemble technique (MET), essentially free of process restrictions, such as linearity and stationarity. We comprehensively discuss the other conditions and limitations intrinsic to this statistical method. We also show the results of the application of the ensemble method to the synthetic data obtained from a hybrid simulation in the region upstream of a quasi-parallel shock. The important implications of the above approach for the CLUSTER mission are discussed.

Orlowski, D. S.↗
NASA NTRS2000

An NOy* Algorithm for SOLVE

De-nitrification and excess re-nitrification was widely observed by ER-2 instruments in the Arctic vortex during SOLVE in winter/spring 2000. Analyses of these events requires a knowledge of the initial or pre-vortex state of the sampled air masses. The canonical relationship of NOy to the long-lived tracer N2O observed in the unperturbed stratosphere is generally used for this purpose. In this paper we will attempt to establish the current unperturbed NOy:N2O relationship (NOy* algorithm) using the ensemble of extra-vortex data from in situ instruments flying on the ER-2 and DC-8, and from the Mark IV remote measurements on the OMS balloon. Initial analysis indicates a change in the SOLVE NOy* from the values predicted by the 1994 Northern Hemisphere NOy* algorithm which was derived from the observations in the ASHOE/MAESA campaign.

Loewenstein, M.↗
NASA NTRS2015

RACORO Continental Boundary Layer Cloud Investigations: 1. Case Study Development and Ensemble Large-Scale Forcings

Observation-based modeling case studies of continental boundary layer clouds have been developed to study cloudy boundary layers, aerosol influences upon them, and their representation in cloud- and global-scale models. Three 60 h case study periods span the temporal evolution of cumulus, stratiform, and drizzling boundary layer cloud systems, representing mixed and transitional states rather than idealized or canonical cases. Based on in situ measurements from the Routine AAF (Atmospheric Radiation Measurement (ARM) Aerial Facility) CLOWD (Clouds with Low Optical Water Depth) Optical Radiative Observations (RACORO) field campaign and remote sensing observations, the cases are designed with a modular configuration to simplify use in large-eddy simulations (LES) and single-column models. Aircraft measurements of aerosol number size distribution are fit to lognormal functions for concise representation in models. Values of the aerosol hygroscopicity parameter, kappa, are derived from observations to be approximately 0.10, which are lower than the 0.3 typical over continents and suggestive of a large aerosol organic fraction. Ensemble large-scale forcing data sets are derived from the ARM variational analysis, European Centre for Medium-Range Weather Forecasts, and a multiscale data assimilation system. The forcings are assessed through comparison of measured bulk atmospheric and cloud properties to those computed in "trial" large-eddy simulations, where more efficient run times are enabled through modest reductions in grid resolution and domain size compared to the full-sized LES grid. Simulations capture many of the general features observed, but the state-of-the-art forcings were limited at representing details of cloud onset, and tight gradients and high-resolution transients of importance. Methods for improving the initial conditions and forcings are discussed. The cases developed are available to the general modeling community for studying continental boundary clouds.

Boundary layers↗
NASA NTRS2021

Mid-Pliocene Atlantic Meridional Overturning Circulation simulated in PlioMIP2

In the Pliocene Model Intercomparison Project Phase 2 (PlioMIP2), coupled climate models have been used to simulate an interglacial climate during the mid-Piacenzian warm period (mPWP; 3.264 to 3.025 Ma). Here, we compare the Atlantic Meridional Overturning Circulation (AMOC), poleward ocean heat transport and sea surface warming in the Atlantic simulated with these models. In PlioMIP2, all models simulate an intensified mid-Pliocene AMOC. However, there is no consistent response in the simulated Atlantic ocean heat transport nor in the depth of the Atlantic overturning cell. The models show a large spread in the simulated AMOC maximum, the Atlantic ocean heat transport and the surface warming in the North Atlantic. Although a few models simulate a surface warming of ~8–12°C in the North Atlantic, similar to the reconstruction from Pliocene Research, Interpretation and Synoptic Mapping (PRISM) version 4, most models appear to underestimate this warming. The large model spread and model–data discrepancies in the PlioMIP2 ensemble do not support the hypothesis that an intensification of the AMOC, together with an increase in northward ocean heat transport, is the dominant mechanism for the mid-Pliocene warm climate over the North Atlantic.

Pliocene Model Intercomparison Project Phase 2 (Pl↗