SEARCH · Search NASA

Results for “statistical metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

All sources NASA NTRS DOE OSTI

DOE OSTI2025

A new metrics framework for quantifying and intercomparing atmospheric rivers in observations, reanalyses, and climate models

We present a new atmospheric river (AR) analysis and benchmarking tool, namely Atmospheric River Metrics Package (ARMP). It includes a suite of new AR metrics that are designed for quick analysis of AR characteristics via statistics in gridded climate datasets such as model output and reanalysis. This package can be used for climate model evaluation in comparison with reanalysis and observational products. Integrated metrics such as mean bias and spatial pattern correlation are efficient for diagnosing systematic AR biases in climate models. For example, the package identifies the fact that, in CMIP5 and CMIP6 (Coupled Model Intercomparison Project Phases 5 and 6) models, AR tracks in the South Atlantic are positioned farther poleward compared to ERA5 reanalysis, while in the South Pacific, tracks are generally biased towards the Equator. For the landfalling AR peak season, we find that most climate models simulate a completely opposite seasonal cycle over western Africa. This tool can also be used for identifying and characterizing structural differences among different AR detectors (ARDTs). For example, ARs detected with the Mundhenk algorithm exhibit systematically larger size, width, and length compared to the TempestExtremes (TE) method. The AR metrics developed from this work can be routinely applied for model benchmarking and during the development cycle to trace performance evolution across model versions or generations and set objective targets for the improvement of models. They can also be used by operational centers to perform near-real-time climate and extreme event impact assessments as part of their forecast cycle.

58 GEOSCIENCES↗

DOE OSTI2022

Statistical perspective on embrittling potency for intergranular fracture

Embrittling potency is a thermodynamic metric that assesses the influence of solute segregation to a grain boundary (GB) on intergranular fracture. Historically, authors of studies have reported embrittling potency as a single scalar value, assuming a single segregation site of importance at a GB and a particular cleavage plane. However, the topography of intergranular fracture surfaces is not generally known a priori. Accordingly, we, in this study, present a statistical ensemble approach to compute embrittling potency, where many free surface (FS) permutations are systematically considered to model fracture of a GB. The result is a statistical description of the thermodynamics of GB embrittlement. As a specific example, embrittling potency distributions are presented for Cr segregation to sites at two Ni $\langle 111 \rangle$ symmetric tilt GBs using atomistic simulations. We show that the average embrittling potency for a particular GB site, considering an ensemble of FS permutations, is not equal to the embrittling potency computed using the lowest energy pair of FSs. A mean GB embrittlement is proposed, considering both the likelihood of formation of a particular FS and the probability of solute occupancy at each GB site, to compare the relative embrittling behavior of two distinct GBs.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Reliability Improvement and Effective Switching Layer Model of Thin-Film MoS 2 Memristors

2D memristors have demonstrated attractive resistive switching characteristics recently but also suffer from the reliability issue, which limits practical applications. Previous efforts on 2D memristors have primarily focused on exploring new material systems, while damage from the metallization step remains a practical concern for the reliability of 2D memristors. Here, the impact of metallization conditions and the thickness of MoS 2 films on the reliability and other device metrics of MoS 2 -based memristors is carefully studied. The statistical electrical measurements show that the reliability can be improved to 92% for yield and improved by ≈16× for average DC cycling endurance in the devices by reducing the top electrode (TE) deposition rate and increasing the thickness of MoS 2 films. Intriguing convergence of switching voltages and resistance ratio is revealed by the statistical analysis of experimental switching cycles. An “effective switching layer” model compatible with both monolayer and few-layer MoS 2 , is proposed to understand the reliability improvement related to the optimization of fabrication configuration and the convergence of switching metrics. In conclusion, the Monte Carlo simulations help illustrate the underlying physics of endurance failure associated with cluster formation and provide additional insight into endurance improvement with device fabrication optimization.

36 MATERIALS SCIENCE↗

DOE OSTI2026

Image Distinguishability Analysis Testing Through Principal Components and Its Application to Hot Spot Scale Invariance

Hot spots are spatial regions of intense energy localization that govern initiation of secondary high explosives. Studies that characterize or compare simulated hot spots are frequently either qualitatively descriptive or resort to quantitative distribution functions that neglect stochastic variations and spatial correlations—effects that are also neglected in common comparison tests like the Kolmogorov–Smirnov test. To this end, we develop an image distinguishability analysis (IDA) test based on principal component (PC) analysis that makes pixel-by-pixel comparisons between small, for example, O(<10), image data sets. The IDA test makes comparisons through a generalized distance metric in the PC space and a test statistic that is derived to calculate mathematical equation-values. Here, we derive a statistical distribution and criticality criterion to determine whether images are distinguishable from established baselines. We apply the IDA test on images generated from molecular dynamics simulations of hot spots from pore collapse in TATB to assess scale invariance in the complex patterns of hot spots that form in a representative high explosive crystal. The IDA test shows that TATB hot spot spatial temperature fields and their derived temperature histograms exhibit scale-invariant features over specific intervals of shock orientation, strength, and initial pore diameter. However, the IDA test also shows that qualitatively different conclusions regarding invariance can be reached depending on whether the hot spot is treated as a spatially correlated field as opposed to a distribution function that lacks spatial information.

organic↗

DOE OSTI2021

Deep learning-based segmentation of lithium-ion battery microstructures enhanced by artificially generated electrodes

Accurate 3D representations of lithium-ion battery electrodes, in which the active particles, binder and pore phases are distinguished and labeled, can assist in understanding and ultimately improving battery performance. Here, we demonstrate a methodology for using deep-learning tools to achieve reliable segmentations of volumetric images of electrodes on which standard segmentation approaches fail due to insufficient contrast. We implement the 3D U-Net architecture for segmentation, and, to overcome the limitations of training data obtained experimentally through imaging, we show how synthetic learning data, consisting of realistic artificial electrode structures and their tomographic reconstructions, can be generated and used to enhance network performance. We apply our method to segment x-ray tomographic microscopy images of graphite-silicon composite electrodes and show it is accurate across standard metrics. We then apply it to obtain a statistically meaningful analysis of the microstructural evolution of the carbon-black and binder domain during battery operation.

25 ENERGY STORAGE↗

DOE OSTI2023

zPerf: A Statistical Gray-Box Approach to Performance Modeling and Extrapolation for Scientific Lossy Compression

With the scaling up of simulation-based scientific discovery on high-performance computing systems, the disparity between compute and I/O has increased, forcing domain scientists to save only a small amount of simulation data to persistent storage. This can result in the loss of essential physics fields that are needed for data analysis. While error-bounded lossy compression has made tremendous progress in bridging the gap between compute and I/O, the lack of understanding of compression performance remains a key hurdle to its wide adoption. Here, in this work, we present zPerf, a statistical gray-box performance modeling approach for scientific lossy compression. Our contributions are threefold: 1) We develop zPerf to estimate the performance of lossy compression techniques, based on in-depth understanding and statistical modeling for data features and core compression metrics; 2) We demonstrate the in-detailed implementation of zPerf using two case studies, where we derive the performance modeling for SZ and ZFP, two leading lossy compressors; 3) We evaluate the effectiveness of zPerf on real-world datasets across various domains. Based on the evaluation, we demonstrate the efficacy of the zPerf performance model; 4) We further discuss three case studies where zPerf is applied to extrapolate the compression ratio of SZ and ZFP with alternative encoding schemes as well as ZFP with an alternative transform scheme. Through the case studies, we demonstrate the potential of zPerf for exploring the design space of lossy compression, which has hardly been studied in the literature.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Tree-Based Ensemble Learning Models for Wall Temperature Predictions in Post-Critical Heat Flux Flow Regimes at Subcooled and Low-Quality Conditions

Accurately predicting post-critical heat flux (CHF) heat transfer is an important but challenging task in water-cooled reactor design and safety analysis. Although numerous heat transfer correlations have been developed to predict post-CHF heat transfer, these correlations are only applicable to relatively narrow ranges of flow conditions due to the complex physical nature of the post-CHF heat transfer regimes. In this paper, a large quantity of experimental data is collected and summarized from the literature for steady-state subcooled and low-quality film boiling regimes with water as the working fluid in vertical tubular test sections. In addition, a low-quality water film boiling (LWFB) database is consolidated with a total of 22,813 experimental data points, which cover a wide flow range of the system pressure from 0.1 to 9.0 MPa, mass flux from 25 to 2750 kg/m 2 s, and inlet subcooling from 1 to 70 °C. Two machine learning (ML) models, based on random forest (RF) and gradient boosted decision tree (GBDT), are trained and validated to predict wall temperatures in post-CHF flow regimes. The trained ML models demonstrate significantly improved accuracies compared to conventional empirical correlations. To further evaluate the performance of these two ML models from a statistical perspective, three criteria are investigated and three metrics are calculated to quantitatively assess the accuracy of these two ML models. For the full LWFB database, the root-mean-square errors between the measured and predicted wall temperatures by the GBDT and RF models are 5.7% and 6.2%, respectively, confirming the accuracy of the two ML models.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2025

What CMIP6 Models Tell Us About the Impact of AMOC Variability on the Arctic

In this paper we address the question whether variability in the Atlantic Meridional Overturning Circulation (AMOC) and its associated heat transport at mid-latitudes impacts the Arctic Earth system. To that end, we perform coherence analysis on time series of ocean heat transport, AMOC strength, and Arctic climate metrics across a large number of models from the CMIP6 ensemble. We find that, on multidecadal timescales, the majority of CMIP6 models indeed display a statistically significant relationship between AMOC at mid-latitudes (45 °N) and metrics like Arctic surface air temperatures and sea ice. However, our results do not support the narrative that heat transport anomalies at lower latitudes propagate northward toward the Arctic. Instead, our results confirm that variability in meridional ocean heat transport arises in the subpolar North Atlantic and propagates southward and northward.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Cluster characterization in atom probe tomography: Machine learning using multiple summary functions

In this work, we develop a machine learning-based method to characterize intracluster concentration (ρ c ), background concentration (ρ b ), clustering radius (r̄), and radius dispersity (δ r ) in simulated atom probe tomography data using multiple spatial statistics summary functions to train a Bayesian regularized neural network. Here, we build upon previous work that utilized Ripley’s K-function by incorporating additional features from nearest-neighbor spatial statistics summary functions to better characterize concentration-based metrics. The addition of nearest-neighbor based features allows for highly accurate estimates of ρ c and ρ b , both with 90% of the predictions within 4.0% of the real value; the root-mean-square errors are reduced by 81.5% and 92.8% from predictions using only K-function based features, respectively. Additionally, including these nearest-neighbor based features improves the ability to differentiate between r̄ and δ r .

36 MATERIALS SCIENCE↗

DOE OSTI2023

A VOI Web Application for Distinct Geothermal Domains: Statistical Evaluation of Different Data Types within the Great Basin

The Great Basin region contains different domains that have different structural and hydrothermal flow patterns. Depending on the characteristics of these patterns, certain data types may be more successful at detecting hidden geothermal resources. In this paper, we quantitatively evaluate if certain data types are more successful in certain domains. Given different aquifer, strain and structural conditions, we explore which data types statistically reveal positively labeled geothermal sites. We utilize value of information (VOI) metrics to help quantify the reliability of data types to discriminate against "positive" and "negative" labeled geothermal sites. We also evaluate how kernel density estimation can help generalize the statistics that inform VOI, which is necessary given the limited data in geothermal exploration. Except for the Carbonate Aquifer, the highest ranking of the Vimperfect is the Local Structural Setting. Next, the slip and dilation tendency is first for Carbonate Aquifer and second for Central Nevada Seismic Belt and Western Great Basin. For the Carbonate Aquifer, heat flow is has the lowest Vimperfect value compared to the other three domains, which is consistent with the understanding of how heat flow measurements are masked by regional groundwater flow.

Bayesian analysis↗

DOE OSTI2024

Shrubs Strongly Influence Snow Properties in Two Subarctic Watersheds

Understanding changes in snow distribution in permafrost ecosystems is fundamental to predicting their response to future climate change. The expansion of tall shrubs into tundra ecosystems can trap snow and insulate permafrost ecosystems during the winter, but the overall insulation effect is dependent upon many ecosystem properties. To study shrub–snow–ground interactions, small temperature sensors were deployed at two research sites on the Seward Peninsula of Alaska, USA, during the 2019–2020 winter. Snow temperatures were used to extrapolate multiple metrics, including freezing n-factors, the snow insulation effect, snow cover duration, and the length of the snowmelt period. Statistical and spatial analysis showed that shrub patches were a dominant control on all snow metrics. Within shrub patches, average ground temperatures were 2.1°C warmer, snow persisted 50 days longer, snow insulation was double, and a longer, later spring snowmelt period occurred compared to nonshrubby areas. Site-level differences contributed relatively little to variation in snow metrics, indicating that shrub presence is an overarching driver of snow–ground interactions at the locations examined. Shrub expansion, which is anticipated under climate change, will strongly impact future permafrost distribution and Arctic energy, water, and carbon cycles through snow–shrub–ground feedbacks.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Evaluating Retention Index Score Assumptions to Refine GC–MS Metabolite Identification

As metabolomics grows into a high-throughput and high demand research field, current metrics for the identification of small molecules in gas chromatography–mass spectrometry (GC–MS) still require manual verification. Though steps have been taken to improve scoring metrics by combining spectral similarity (SS) and retention index (RI), the problem persists. A large body of literature has analyzed and refined SS scores, but few studies have explicitly studied improvements to RI scores. Here, in this study, we examined whether uninvestigated assumptions of the RI score are valid and propose ways to improve them. Query RIs were matched to library RI with a generous window of ±35 to avoid unintentional removal of valid compound identifications. Each match was manually verified as a true positive (TP), true negative, or unknown. Metabolites with at least 30 TP identifications were included in downstream analyses, resulting in a total of 87 metabolites from samples of varying complexity and type (e.g., amino acid mixtures, human urine, fungal species, and so on.). Our results showed that the RI score assumptions of normality, consistent variance across metabolites, and a mean error centered at 0 are often violated. We demonstrated through a cross-validation analysis that modifying these underlying assumptions according to empirical metabolite-specific distributions improved the TP and negative rankings. Further, we statistically determined the minimum number of samples required to estimate distributional parameters for scoring metrics. Overall, this work proposes a robust statistical pipeline to reduce the time bottleneck of metabolite identification by improving RI scores and thus minimize the effort to complete manual verification.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2020

Statistical Treatment of Inverse Problems Constrained by Differential Equations-based Models with Stochastic Terms

This paper introduces a statistical treatment of inverse problems constrained by models with stochastic terms. The solution of the forward problem is given by a distribution represented numerically by an ensemble of simulations. The goal is to formulate the inverse problem, in particular the objective function, to find the closest forward distribution (i.e., the output of the stochastic forward problem) that best explains the distribution of the observations in a certain metric. We use proper scoring rules, a concept employed in statistical forecast verification, namely energy, variogram, and hybrid (i.e., combination of the two) scores. We study the performance of the proposed formulation in the context of two applications: a coefficient field inversion for subsurface flow governed by an elliptic partial differential equation with a stochastic source and a parameter inversion for power grid governed by differential-algebraic equations. In both cases we show that the variogram and the hybrid scores produce better parameter inversion results than does the energy score, whereas the energy score leads to better probabilistic predictions.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Explainable AI (XAI)-driven vibration sensing scheme for surface quality monitoring in a smart surface grinding process

Local Interpretable and Model-agnostic Explanation (LIME), an explainable artificial intelligence (XAI) approach is adapted to identify the globally important time-frequency bands for predicting average surface roughness (Ra) in a smart grinding process. The smart grinding setup consisted of a Supertech CNC precision surface grinding machine, instrumented with a Dytran piezoelectric accelerometer attached to the tailstock quill along the tangential direction (Y-axis). For every grinding pass, vibration signatures were captured, and the ground truth surface roughness values were recorded using a Mahr Marsurf M300C portable surface roughness profilometer. The roughness values ranged from 0.06 to 0.14 microns over the complete set of experiments. Time-frequency domain spectrogram frames were extracted for each of the vibration signals collected during the grinding process. Convolutional Neural Networks (CNNs) were modeled to predict the surface roughness based on these spectrogram frames and their image augmentations. The best CNN model was able to predict the roughness values with an overall R2-score of 0.95, training R2-score of 0.99, and testing R2-score of 0.81 with only 80 sets of vibration signals corresponding to 4 experiments with 20 trials each. Although the data size is not large enough to guarantee such performance metrics in real-world scenarios, one can extract statistically consistent explanations underlying the relationships these complex deep learning models capture. Further, the LIME methodology was implemented on the developed surface roughness CNN model to identify the important time-frequency bands (i.e., the superpixels of a spectrogram) influencing the predictions. Based on the identified important regions on the spectrogram frames, the corresponding frequency characteristics were determined that influence the surface roughness predictions. The important frequency range based on LIME results was approximately 11.7 to 19.1 kHz. The power of XAI was demonstrated by cutting down the sampling rate from 160 kHz to 30, 20, 10, and 5 kHz based on the important frequency range and considering Nyquist criteria. Separate CNN models were developed for these ranges by only extracting time-frequency contents below their corresponding Nyquist cut-offs. A proper data acquisition strategy is proposed by comparing the model performances to argue the selection of a sufficient sampling rate to capture the grinding process successfully and robustly.

42 ENGINEERING↗

DOE OSTI2023

Reprint of: Explainable AI (XAI)-driven vibration sensing scheme for surface quality monitoring in a smart surface grinding process

47 OTHER INSTRUMENTATION↗

DOE OSTI2023

MultiLoad-GAN: A GAN-Based Synthetic Load Group Generation Method Considering Spatial-Temporal Correlations

This paper presents a deep-learning framework, Multi-load Generative Adversarial Network (MultiLoad-GAN), for generating a group of synthetic load profiles (SLPs) simultaneously. The main contribution of MultiLoad-GAN is the capture of spatial-temporal correlations among a group of loads that are served by the same distribution transformer. This enables the generation of a large amount of correlated SLPs required for microgrid and distribution system studies. Here, the novelty and uniqueness of the MultiLoad-GAN framework are three-fold. First, to the best of our knowledge, this is the first method for generating a group of load profiles bearing realistic spatial- temporal correlations simultaneously. Second, two complementary realisticness metrics for evaluating generated load profiles are developed: computing statistics based on domain knowledge and comparing high-level features via a deep-learning classifier. Third, to tackle data scarcity, a novel iterative data augmentation mechanism is developed to generate training samples for enhancing the training of both the classifier and the MultiLoad-GAN model. Simulation results show that MultiLoad- GAN can generate more realistic load profiles than existing approaches, especially in group level characteristics. With little finetuning, MultiLoad-GAN can be readily extended to generate a group of load or PV profiles for a feeder or a service area.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

Data and code for Daily and Multi-Day Extreme Rainfall Analysis Under Future Climates Using Stochastic Storm Transposition and NEX-GDDP-CMIP6 Over CONUS

This data package provides inputs, codes, and outputs for a comprehensive analysis of projected changes in extreme precipitation across 10 regions of the continental United States, using 34 downscaled Earth System Models (ESMs) from the NASA Earth Exchange Global Daily Downscaled Projections, Coupled Model Intercomparison Project Phase 6 (NEX-GDDP-CMIP6) dataset. These models are part of the Coupled Model Intercomparison Project Phase 6 (CMIP6), a coordinated climate modeling framework widely used to assess climate change impacts. The analysis applies a stochastic storm transposition method to quantify changes in extreme rainfall under two Shared Socioeconomic Pathway (SSP) climate scenarios—SSP2-4.5 (moderate emissions) and SSP5-8.5 (high emissions)—compared to historical conditions (1995–2014 vs. 2081–2100). The dataset includes rainfall depth estimates for extreme events with return periods from 2 to 500 years across multiple storm durations (1, 3, and 5 days) for each of the 10 U.S. regions. Weighted ensemble statistics are derived from individual ESM performance against historical precipitation patterns, enabling robust uncertainty quantification through both sign-based and permutation-test-based model agreement assessments. Key analyses address: (1) relative changes in extreme precipitation for each climate scenario, (2) differences between SSP scenarios (SSP5-8.5 vs. SSP2-4.5), (3) contrasts between rare and frequent events, and (4) variations between multi-day and daily storm durations. The workflow produces ensemble statistics—median, 5th, 25th, 75th, and 95th percentiles—along with model agreement metrics that identify regions and event types with robust climate change signals. The dataset includes: processed rainfall depth outputs (netCDF format) from the RainyDay Python package, ESM weights from historical performance evaluation using DayMet observations, ensemble statistics across all storm dimensions, and figures summarizing key findings.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Rewarding Grid-Friendly Behavior: Estimating the Potential Bill Reduction and Load Shifting Benefits of Dynamic Prices

Shifting electric load from times of peak demand can be a key strategy to slow price growth as reducing peak demand avoids the cost of upgrading generation, transmission and distribution infrastructure. Utilities are releasing time-varying prices, such as time of use rates or dynamic prices, to incentivize grid-friendly load shifting. New dynamic price programs provide insight into the true cost of operating electricity grids and the potential economic benefits of load shifting. Program developers and device manufacturers need to understand the economic opportunities in terms of 1) the variation in prices across hours, days, and seasons; 2) the change in utility bills for customers who don’t shift load; and 3) the potential load shifted and economic value of different technologies if manufacturers or aggregators deploy price-responsive controls. This paper estimates possible impacts of dynamic price adoption and load shifting controls if customers paid the dynamic rate from one pilot program. Statistical analysis of historical prices identified annual and seasonal metrics as well as representative price curves for each circuit in the pilot. Simulations for residential technologies with price-responsive controls including unitary heat pump water heaters, central multifamily heat pump water heaters, heating & cooling + storage systems, and pool pumps estimated the potential impacts of highly dynamic prices both with and without load shifting controls. Results showed the potential to reduce electricity costs on representative days by 42-94% and reduce consumption during times of high electricity prices by 63-100% compared to baseline operation for those flex-friendly devices.

Grant, Peter↗