SEARCH · Search NASA

Results for “ensemble data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

NASA NTRS1989

Estimating laser transit anemometry noise performance capabilities

A Monte Carlo based LTA (laser transit anemometry) simulation system has been used to perform a detailed evaluation of a set of processing algorithms proposed by Mayo and Smart (1984) for the extraction of two-dimensional flow parameters from LTA data sets collected in a plane normal to the optical axis of the system. The present evaluation includes data ensembles containing 0.0, 5.0, 10.0, and 20.0 percent background noise levels in the constituent correlograms. The results of these evaluations indicate that for turbulence levels of up to 10.0 percent the processing system is able to extract the necessary flow parameters accurately from the LTA data sets. Mean velocity magnitude and flow angle are measurable to within 2.0 percent for turbulence intensity levels of up to 14.0 percent. Standard deviations are measureable to within 10.0 percent over a turbulence range of 3.0-10.0 percent at the same noise levels. These results indicate that the algorithms described have applications in fluid flow surveys.

Humphreys, William M., Jr.↗

DOE OSTI2022

Enabling machine learning-ready HPC ensembles with Merlin

With the growing complexity of computational and experimental facilities, many scientific researchers are turning to machine learning (ML) techniques to analyze large scale ensemble data. With complexities such as multi-component workflows, heterogeneous machine architectures, parallel file systems, and batch scheduling, care must be taken to facilitate this analysis in a high performance computing (HPC) environment. Here, we present Merlin, a workflow framework to enable large ML-friendly ensembles of scientific HPC simulations. By augmenting traditional HPC with distributed compute technologies, Merlin aims to lower the barrier for scientific subject matter experts to incorporate ML into their analysis. As a producer–consumer workflow model, Merlin enables multi-machine, cross-batch job, dynamically allocated yet persistent workflows capable of utilizing surge-compute resources. Key features of Merlin are a flexible HPC-centric interface, low per-task overhead, multi-tiered fault recovery, and a hierarchical sampling algorithm that allows for $\mathscr{O}$(N) task execution and $\mathscr{O}$(N ln N) task queuing to ensembles of millions of tasks. In addition to Merlin’s design, we test the algorithm’s performance in an HPC center and demonstrate the ability to enqueue 40 million simulations in 100 s, with a 30 millisecond per-task overhead that is independent of ensemble size. Finally, we describe some example applications that Merlin has enabled on leadership-class HPC resources, such as the ML-augmented optimization of nuclear fusion experiments and the calibration of infectious disease models to study the progression of and possible mitigation strategies for COVID-19.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Constraining dark-matter ensembles with supernova data

The constraints on nonminimal dark sectors involving ensembles of unstable dark-matter species are well established and quite stringent in cases in which these species decay to visible-sector particles. Nevertheless, in cases in which these ensembles decay exclusively to other, lighter dark-sector states, the corresponding constraints are less well established. In this paper, we investigate how information about the expansion rate of the universe at low redshifts gleaned from observations of Type Ia supernovae can be used to constrain ensembles of unstable particles which decay primarily into dark radiation.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Micromechanical Surrogate Machine Learning Model for Creep Deformation Modeling

Process variability during the manufacture of gas turbine engine hot section components can significantly affect the material’s resulting microstructure. In casting, for instance, geometric variation within a component (thin sections versus thick sections, radial location) influences cooling rates and the resulting grain size. The high temperature creep response is known to be sensitive to grain size owing to a diffusional creep mechanism which occurs more readily along grain boundaries. Microstructural variation correspondingly drives mechanical behavior which propagates into component scale performance uncertainty. These factors are essential when planning inspection, maintenance, and repair strategies within a reliability framework. These benefits provide opportunities to increase overall energy efficiency through refined margins. Critically, there is an opportunity to bolster existing data-driven reliability models using physics-driven process-structure-property relations. Here we present recent work establishing a framework for evaluating the probabilistic creep performance of high-temperature materials. A novel microstructure-sensitive crystal plasticity finite element model is established that captures both grain boundary and crystallographic deformation effects. The computationally expensive physics model is calibrated using a statistical approach and this high-fidelity model is subsequently used to train a computationally efficient machine learning surrogate model. The surrogate model is essential for sampling a large ensemble of simulated structure-property pair results. The ensemble data are then mined to extract salient trends to be incorporated into a microstructure-sensitive reliability model. The proposed approach represents a novel way to capture microstructure-sensitive trends from physics-based models within a modern reliability framework.

Fernandez-Zelaia, Patxi [ORNL]↗

DOE OSTI2023

FunMC^2: A Filter for Uncertainty Visualization of Marching Cubes on Multi-Core Devices

Visualization is an important tool for scientists to extract understanding from complex scientific data. Scientists need to understand the uncertainty inherent in all scientific data in order to interpret the data correctly. Uncertainty visualization has been an active and growing area of research to address this challenge. Algorithms for uncertainty visualization can be expensive, and research efforts have been focused mainly on structured grid types. Further, support for uncertainty visualization in production tools is limited. In this paper, we adapt an algorithm for computing key metrics for visualizing uncertainty in Marching Cubes (MC) to multi-core devices and present the design, implementation, and evaluation for a Filter for uncertainty visualization of Marching Cubes on Multi-Core devices (FunMC2). FunMC2 accelerates the uncertainty visualization of MC significantly, and it is portable across multi-core CPUs and GPUs. Evaluation results show that FunMC2 based on OpenMP runs around 11× to 41× faster on multi-core CPUs than the corresponding serial version using one CPU core. FunMC2 based on a single GPU is around 5× to 9× faster than FunMC2 running by OpenMP. Moreover, FunMC2 is flexible enough to process ensemble data with both structured and unstructured mesh types. Furthermore, we demonstrate that FunMC2 can be seamlessly integrated as a plugin into ParaView, a production visualization tool for post-processing.

Wang, Jay↗

DOE OSTI2023

Amplified drought trends in Nepal increase the potential for Himalayan wildfires

Here we report in the spring 2021, Nepal underwent a record wildfire season in which active fires were detected at a rate 10 times greater than the 2002–2020 average. Prior to these major wildfire events, the country experienced a prolonged precipitation deficit and extreme drought during the post-monsoon period (starting in October 2020). An analysis using observational, reanalysis, and climate model ensemble data indicates that both climate variability and climate change-induced severe drought conditions were at play. Further analysis of climate model outputs suggests the likely reoccurrence of drought conditions, thus favoring active wildfire seasons in Nepal throughout the twenty-first century. While the inter-model uncertainty is large and direct modeling of wildfire spread and suppression has not been completed, the demonstrated relationship between a drought index (the standardized precipitation and evapotranspiration index) and subsequent fire activity may offer actionable opportunities for forest managers to employ the monitoring and projection of climate anomalies at sub-seasonal to decadal timescales to inform their management strategies for Nepal’s wildlands.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2016

Fluorescence-excitation and Emission Spectroscopy on Single FMO Complexes

In green-sulfur bacteria sunlight is absorbed by antenna structures termed chlorosomes, and transferred to the RC via the Fenna-Matthews-Olson (FMO) complex. FMO consists of three monomers arranged in C 3 symmetry where each monomer accommodates eight Bacteriochlorophyll a (BChl a) molecules. It was the first pigment-protein complex for which the structure has been determined with high resolution and since then this complex has been the subject of numerous studies both experimentally and theoretically. Here we report about fluorescence-excitation spectroscopy as well as emission spectroscopy from individual FMO complexes at low temperatures. The individual FMO complexes are subjected to very fast spectral fluctuations smearing out any possible different information from the ensemble data that were recorded under the same experimental conditions. In other words, on the time scales that are experimentally accessible by single-molecule techniques, the FMO complex exhibits ergodic behaviour.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2019

Analysis of TP53 gene in uterine myomas: No mutations but P72R polymorphism is associated with myoma development

Abstract Aim The aim of the present study was to investigate the familial and somatic mutations as well as polymorphisms of TP53 gene in patients with uterine leiomyoma. Methods The study included 35 women with histologically diagnosed as uterine leiomyomas at the Gynecology Department of Adnan Menderes University Faculty of Medicine. Tissue and blood samples were analyzed for mutations and polymorphisms of TP53 gene by next generation sequencing (Miseq—Illumina). Acquired data was compared with the normal data in Ensembl database. Data from 1000 genome project and data from exome sequencing analyses in Intergen Genetic Diagnosis Center (Ankara) were used as controls for polymorphism analyses. Results There were no mutations in tissue and blood samples. However, when the polymorphisms were evaluated, a significant difference was found in NM_000546.5(TP53):c.215C > G (p.Pro72Arg) polymorphism between the study and control groups. The results indicated that P72R/P72R genotype increased the risk of leiomyoma development by 6.3 fold (95% confidence interval [CI]: 2.880–13.793). There was a negative correlation between P72R/WT genotype and leiomyoma development (OR = 0.261, 95% CI: 0.114–0.596). P72R/P72R genotype was statistically higher in the patients with leiomyoma compared with the controls and 1000 genomes from Asian, European and World populations. Conclusion The results of the present study suggested that P72R/P72R genotype may be associated with development of uterine leiomyoma in the Turkish population in the Western part of the country.

Altinkaya, S. Ozlem↗

DOE OSTI2022

Impact of heavy-quark production measurements in the CT18 global QCD analysis of PDFs

We discuss the impact of heavy-flavor production measurements in semi-inclusive deep inelastic scattering at HERA on the CTEQ-TEA PDFs. In particular, we study the impact of the latest charm and bottom production measurements from the H1 and ZEUS collaborations on the gluon, and the interplay of these measurements with the data ensemble of the recent CT18 global QCD analysis.

Guzzi, Marco↗

NASA NTRS1987

Oblateness, radius, and mean stratospheric temperature of Neptune from the 1985 August 20 occultation

The oblateness and equatorial radius of Neptune at the 1-microbar pressure level, together with the position angle of the projected spin axis, are the goals of a general oblate atmosphere model for Neptune employing a data ensemble obtained from the occultation of a bright IR star that provided accurate measurements of the limb position at these and several other stations. The observed reduction in central flash intensity is explained by a 150-135 K temperature decrease as pressure rises from 1 to 400 microbar. Attention is given to the implications of these oblateness results for models of the Neptune interior.

Hubbard, W. B.↗

NASA NTRS1997

Analysis of Particle Image Velocimetry (PIV) Data for Application to Subsonic Jet Noise Studies

Global velocimetry measurements were taken using Particle Image Velocimetry (PIV) in the subsonic flow exiting a 1 inch circular nozzle in an attempt to better understand the turbulence characteristics of its shear layer region. This report presents the results of the PIV analysis and data reduction portions of the test and details the processing that was done. Custom data analysis and data validation algorithms were developed and applied to a data ensemble consisting of over 750 PIV 70 mm photographs taken in the 0.85 mach flow facility. Results are presented detailing spatial characteristics of the flow including ensemble mean and standard deviation, turbulence intensities and Reynold's stress levels, and 2-point spatial correlations.

Blackshire, James L.↗

NASA NTRS2015

The Impact of Assimilating Precipitation-affected Radiance on Cloud and Precipitation in Goddard WRF-EDAS Analyses

High-frequency TMI and AMSR-E radiances, which are sensitive to precipitation over land, are assimilated into the Goddard Weather Research and Forecasting Model- Ensemble Data Assimilation System (WRF-EDAS) for a few heavy rain events over the continental US. Independent observations from surface rainfall, satellite IR brightness temperatures, as well as ground-radar reflectivity profiles are used to evaluate the impact of assimilating rain-sensitive radiances on cloud and precipitation within WRF-EDAS. The evaluations go beyond comparisons of forecast skills and domain-mean statistics, and focus on studying the cloud and precipitation features in the jointed rainradiance and rain-cloud space, with particular attentions on vertical distributions of height-dependent cloud types and collective effect of cloud hydrometers. Such a methodology is very helpful to understand limitations and sources of errors in rainaffected radiance assimilations. It is found that the assimilation of rain-sensitive radiances can reduce the mismatch between model analyses and observations by reasonably enhancing/reducing convective intensity over areas where the observation indicates precipitation, and suppressing convection over areas where the model forecast indicates rain but the observation does not. It is also noted that instead of generating sufficient low-level warmrain clouds as in observations, the model analysis tends to produce many spurious upperlevel clouds containing small amount of ice water content. This discrepancy is associated with insufficient information in ice-water-sensitive radiances to address the vertical distribution of clouds with small amount of ice water content. Such a problem will likely be mitigated when multi-channel multi-frequency radiances/reflectivity are assimilated over land along with sufficiently accurate surface emissivity information to better constrain the vertical distribution of cloud hydrometers.

WRF-EDAS Analyses↗

NASA NTRS2010

Application of Ensemble Detection and Analysis to Modeling Uncertainty in Non Stationary Process

Characterization of non stationary and nonlinear processes is a challenge in many engineering and scientific disciplines. Climate change modeling and projection, retrieving information from Doppler measurements of hydrometeors, and modeling calibration architectures and algorithms in microwave radiometers are example applications that can benefit from improvements in the modeling and analysis of non stationary processes. Analyses of measured signals have traditionally been limited to a single measurement series. Ensemble Detection is a technique whereby mixing calibrated noise produces an ensemble measurement set. The collection of ensemble data sets enables new methods for analyzing random signals and offers powerful new approaches to studying and analyzing non stationary processes. Derived information contained in the dynamic stochastic moments of a process will enable many novel applications.

Racette, Paul↗

DOE OSTI2016

Kaon semileptonic decays with $N_f=2+1+1$ HISQ fermions and physical light-quark masses

We discuss the reduction of errors in the calculation of the form factor $f_+^{K \pi}(0)$ with HISQ fermions on the $N_f=2+1+1$ MILC configurations from increased statistics on some key ensembles, new data on ensembles with lattice spacings down to 0.042 fm and the study of finite-volume effects within staggered ChPT. We also study the implications for the unitarity of the CKM matrix in the first row and for current tensions with leptonic determinations of $\vert V_{us}\vert$.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NASA NTRS1982

Ensemble averaging of acoustic data

A computer program called Ensemble Averaging of Acoustic Data is documented. The program samples analog data, analyzes the data, and displays them in the time and frequency domains. Hard copies of the displays are the program's output. The documentation includes a description of the program and detailed user instructions for the program. This software was developed for use on the Ames 40- by 80-Foot Wind Tunnel's Dynamic Analysis System consisting of a PDP-11/45 computer, two RK05 disk drives, a tektronix 611 keyboard/display terminal, and FPE-4 Fourier Processing Element, and an analog-to-digital converter.

Stefanski, P. K.↗

DOE OSTI2020

Evaluation of the Four-Dimensional Ensemble-Variational Hybrid Data Assimilation with Self-Consistent Regional Background Error Covariance for Improved Hurricane Intensity Forecasts

The feasibility of a hurricane initialization framework based on the Gridpoint Statistical Interpolation (GSI)-based four-dimensional ensemble-variational (GSI-4DEnVar) hybrid data assimilation system for the Hurricane Weather Research and Forecasting model (HWRF) model is evaluated in this study. The system considers the temporal evolution of error covariances via the use of four-dimensional ensemble perturbations that are provided by high-resolution, self-consistent HWRF ensemble forecasts. It is different from the configuration of the GSI-based three-dimensional ensemble-variational (GSI-3DEnVar) hybrid data assimilation system, similar to that used in the operational HWRF, which employs background error covariances provided by coarser-resolution global ensembles from the National Centers for Environmental Prediction (NCEP) Global Forecast System (GFS) ensemble Kalman filtering data assimilation system. In addition, our proposed initialization framework discards the empirical intensity correction in the vortex initialization package that is employed by the GSI-3DEnVar initialization framework in operational HWRF. Data assimilation and numerical simulation experiments for Hurricanes Joaquin (2015), Patricia (2015), and Matthew (2016) are conducted during their intensity changes. The impacts of two initialization frameworks on the HWRF analyses and forecasts are compared. It is found that GSI-4DEnVar leads to a reduction in track, minimum sea level pressure (MSLP), and maximum surface wind (MSW) forecast errors in all of the HWRF simulations, compared with the GSI-3DEnVar initialization framework. With assimilating high-resolution observations within the hurricane inner-core region, GSI-4DEnVar can produce the initial hurricane intensity reasonably well without the empirical vortex intensity correction. Further diagnoses with Hurricane Joaquin indicate that GSI-4DEnVar can significantly alleviate the imbalances in the initial conditions and enhance the performance of the data assimilation and subsequent hurricane intensity and precipitation forecasts

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Improving the accuracy of freight mode choice models: A case study using the 2017 CFS PUF data set and ensemble learning techniques

Here, the US Census Bureau has collected two rounds of experimental data from the Commodity Flow Survey, providing shipment-level characteristics of nationwide commodity movements, published in 2012 (i.e., Public Use Microdata) and in 2017 (i.e., Public Use File). With this information, data-driven methods have become increasingly valuable for understanding detailed patterns in freight logistics. In this study, we used the 2017 Commodity Flow Survey Public Use File data set to explore building a high-performance freight mode choice model, considering three main improvements: (1) constructing local models for each separate commodity/industry category; (2) extracting useful geographical features, particularly the derived distance of each freight mode between origin/destination zones; and (3) applying additional ensemble learning methods such as stacking or voting to combine results from local and unified models for improved performance. The proposed method achieved over 92% accuracy without incorporating external information, an over 19% increase compared to directly fitting Random Forests models over 10,000 samples. Furthermore, SHAP (Shapely Additive Explanations) values were computed to explain the outputs and major patterns obtained from the proposed model. The model framework could enhance the performance and interpretability of existing freight mode choice models.

42 ENGINEERING↗

DOE OSTI2016

Evaluating lossy data compression on climate simulation data within a large ensemble

High-resolution Earth system model simulations generate enormous data volumes, and retaining the data from these simulations often strains institutional storage resources. Further, these exceedingly large storage requirements negatively impact science objectives, for example, by forcing reductions in data output frequency, simulation length, or ensemble size. To lessen data volumes from the Community Earth System Model (CESM), we advocate the use of lossy data compression techniques. While lossy data compression does not exactly preserve the original data (as lossless compression does), lossy techniques have an advantage in terms of smaller storage requirements. To preserve the integrity of the scientific simulation data, the effects of lossy data compression on the original data should, at a minimum, not be statistically distinguishable from the natural variability of the climate system, and previous preliminary work with data from CESM has shown this goal to be attainable. However, to ultimately convince climate scientists that it is acceptable to use lossy data compression, we provide climate scientists with access to publicly available climate data that have undergone lossy data compression. In particular, we report on the results of a lossy data compression experiment with output from the CESM Large Ensemble (CESM-LE) Community Project, in which we challenge climate scientists to examine features of the data relevant to their interests, and attempt to identify which of the ensemble members have been compressed and reconstructed. We find that while detecting distinguishing features is certainly possible, the compression effects noticeable in these features are often unimportant or disappear in post-processing analyses. In addition, we perform several analyses that directly compare the original data to the reconstructed data to investigate the preservation, or lack thereof, of specific features critical to climate science. Overall, we conclude that applying lossy data compression to climate simulation data is both advantageous in terms of data reduction and generally acceptable in terms of effects on scientific results.

54 ENVIRONMENTAL SCIENCES↗