SEARCH · Search NASA

Results for “statistical metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Object-Based Evaluation of Dynamical and Statistical Downscaled Precipitation Products over CONUS

High-resolution precipitation data, generated through dynamical downscaling (DD) or statistical downscaling (SD) of global climate model output, provide critical information for regional climate assessment and adaptation planning. Most downscaling development and validation have focused on accurate gridscale precipitation construction and ignored the spatial structure of precipitation across model grids and at the event scale. However, many applications, e.g., hydrologic modeling and the analysis using the downscaled precipitation, require a reasonable representation of the spatial structure of precipitation within watersheds. Therefore, a set of standard metrics to evaluate the representation of the spatial structure of individual storms across diverse downscaled precipitation products is desired. To address this need, we conducted an object-based evaluation of precipitation in decades-long DD and SD products over the contiguous United States (CONUS). Specifically, we evaluate their ability to reproduce various features of precipitation objects in the observations: total volume, precipitation area, peak intensity, and spatial structure. Multiple metrics (bias, Perkins score, and nonparametric statistical tests) are used to quantify model performance. Our evaluation reveals notable variations in performance among individual products across different climate zones and seasons, as well as between extreme and nonextreme events. In general, most DD products exhibit balanced performance across the four precipitation object features, while SD products vary more significantly in their performance across products. Based on this comprehensive evaluation, we provide guidance on choosing downscaled products for specific regions, seasons, and precipitation object features. These findings and recommendations can inform precipitation-relevant modeling and analysis over CONUS, guide future downscaling technique developments, and provide actionable information for climate impact assessment and adaptation.

Downscaling↗

DOE OSTI2026

Object-Based Evaluation of Dynamical and Statistical Downscaled Precipitation Products over CONUS

Environmental sciences↗

DOE OSTI2020

An Improved Risk Priority Measure for the Management of Project Risk

Monte Carlo-based project risk models are essential tools in project risk management, particularly for large, complex projects in which it is difficult to glean intuitively the importance of individual risks to the overall project. Conventional correlation-based methods for measuring the importance of contributing risks in such models are argued here to be both statistically flawed and unintuitive in the importance metrics they produce. Drawing on and adapting methods more traditionally associated with engineering risk models, Risk Reduction Worth (RRW) is introduced as an importance measure. RRW is shown to be statistically robust and provide an easily interpretable, quantitative measure of the importance of a risk to the overall performance of a project; specifically, measuring the extent to which removal of a risk would improve confidence in project outcomes. To ensure practicality of the method, an approach is described in which RRWs can be produced for all contributing risks based on a single Monte Carlo sample. This is demonstrated through application to a large, complex project risk model from which intuitive risk importance insights provide a robust, transparent basis for the allocation of risk management resources.

Risk↗

DOE OSTI2023

Developing and applying quantifiable metrics for diagnostic and experiment design on Z

This project applies methods in Bayesian inference and modern statistical methods to quantify the value of new experimental data, in the form of new or modified diagnostic configurations and/or experiment designs. We demonstrate experiment design methods that can be used to identify the highest priority diagnostic improvements or experimental data to obtain in order to reduce uncertainties on critical inferred experimental quantities and select the best course of action to distinguish between competing physical models. Bayesian statistics and information theory provide the foundation for developing the necessary metrics, using two high impact experimental platforms on Z as exemplars to develop and illustrate the technique. We emphasize that the general methodology is extensible to new diagnostics (provided synthetic models are available), as well as additional platforms. We also discuss initial scoping of additional applications that began development in the last year of this LDRD.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Deuterium scattering experiments in CTEQ global QCD analyses: a comparative investigation

Abstract Experimental measurements in deep-inelastic scattering and lepton-pair production on deuterium targets play an important role in the flavor separation of u and d (anti)quarks in global QCD analyses of the parton distribution functions (PDFs) of the nucleon. We investigate the impact of theoretical corrections accounting for the light-nuclear structure of the deuteron upon the fitted u , d -quark, gluon, and other PDFs in the CJ15 and CT18 families of next-to-leading order CTEQ global analyses. The investigation is done using the $$L_2$$ L 2 sensitivity statistical method, which provides a common metric to quantify the strength of experimental constraints on various PDFs and ratios of PDFs in the two distinct fitting frameworks. Using the $$L_2$$ L 2 sensitivity and other approaches, we examine the compatibility of deuteron data sets with other fitted experiments under varied implementations of the deuteron corrections. We find that freely-fitted deuteron corrections modify the PDF uncertainty at large momentum fractions and will be relevant for future PDFs affecting electroweak precision measurements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2026

STAT_UQ_AI

Code to reproduce results in "Statistical Uncertainty Quantification for Aggregate Performance Metrics in Machine Learning Benchmarks".

Gopalan, Giri↗

DOE OSTI2024

Square Root Statistics of Density Matrices and Their Applications

To estimate the degree of quantum entanglement of random pure states, it is crucial to understand the statistical behavior of entanglement indicators such as the von Neumann entropy, quantum purity, and entanglement capacity. These entanglement metrics are functions of the spectrum of density matrices, and their statistical behavior over different generic state ensembles have been intensively studied in the literature. As an alternative metric, in this work, we study the sum of the square root spectrum of density matrices, which is relevant to negativity and fidelity in quantum information processing. In particular, we derive the finite-size mean and variance formulas of the sum of the square root spectrum over the Bures–Hall ensemble, extending known results obtained recently over the Hilbert–Schmidt ensemble.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Debris Disk Results from the Gemini Planet Imager Exoplanet Survey's Polarimetric Imaging Campaign

We report the results of a ∼4 yr direct imaging survey of 104 stars to resolve and characterize circumstellar debris disks in scattered light as part of the Gemini Planet Imager (GPI) Exoplanet Survey. We targeted nearby (≲150 pc), young (≲500 Myr) stars with high infrared (IR) excesses (L {sub IR}/L {sub ⋆} > 10{sup −5}), including 38 with previously resolved disks. Observations were made using the GPI high-contrast integral field spectrograph in H-band (1.6 μm) coronagraphic polarimetry mode to measure both polarized and total intensities. We resolved 26 debris disks and 3 protoplanetary/transitional disks. Seven debris disks were resolved in scattered light for the first time, including newly presented HD 117214 and HD 156623, and we quantified basic morphologies of five of them using radiative transfer models. All of our detected debris disks except HD 156623 have dust-poor inner holes, and their scattered-light radii are generally larger than corresponding radii measured from resolved thermal emission and those inferred from spectral energy distributions. To assess sensitivity, we report contrasts and consider causes of nondetections. Detections were strongly correlated with high IR excess and high inclination, although polarimetry outperformed total intensity angular differential imaging for detecting low-inclination disks (≲70°). Based on postsurvey statistics, we improved upon our presurvey target prioritization metric predicting polarimetric disk detectability. We also examined scattered-light disks in the contexts of gas, far-IR, and millimeter detections. Comparing H-band and ALMA fluxes for two disks revealed tentative evidence for differing grain properties. Finally, we found no preference for debris disks to be detected in scattered light if wide-separation substellar companions were present.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

Automated, high-accuracy classification of textured microstructures using a convolutional neural network

Crystallographic texture is an important descriptor of material properties but requires time-intensive electron backscatter diffraction (EBSD) for identifying grain orientations. While some metrics such as grain size or grain aspect ratio can distinguish textured microstructures from untextured microstructures after significant grain growth, such morphological differences are not always visually observable. This paper explores the use of deep learning to classify experimentally measured textured microstructures without knowledge of crystallographic orientation. A deep convolutional neural network is used to extract high-order morphological features from binary images to distinguish textured microstructures from untextured microstructures. The convolutional neural network results are compared with a statistical Kolmogorov–Smirnov tests with traditional morphological metrics for describing microstructures. Results show that the convolutional neural network achieves a significantly improved classification accuracy, particularly at early stages of grain growth, highlighting the capability of deep learning to identify the subtle morphological patterns resulting from texture. The results demonstrate the potential of a convolutional neural network as a tool for reliable and automated microstructure classification with minimal preprocessing.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Investigation into the instantaneous centre of rotation for enhanced design of floating offshore wind turbines

The dynamic behaviour of floating offshore wind turbines (FOWTs) involves complex interactions of multivariate loads from wind, waves, and currents, which result in complex motion characteristics. Although methods for analysing global motion responses are well-established, the time- and location-dependent kinematics remain underexplored. This paper investigates the instantaneous centre of rotation (ICR), a point of zero velocity at a time instance of general plane motion. Understanding and strategically positioning the ICR can reduce the dynamic motion in critical structural locations, enhancing the performance and structural robustness of FOWTs. The paper presents a method for computing the ICR using time-domain simulation results and proposes a statistical analysis approach suitable for design studies. Building on prior research, it examines the sensitivity of the ICR to external loading and design features, providing insights into how these factors influence motion response and how the motion response influences the statistics of the ICR, structural loads, and other performance metrics of interest. The study explores two FOWT configurations, a spar and a semisubmersible, identifying design variables that most effectively control the ICR statistics and identifying the ICR statistics most correlated with the responses of interest. Finally, through two case studies, we demonstrate how to apply these new insights in a practical design scenario. By adjusting the design variables most correlated with the ICR (fairlead vertical position and centre of mass for the spar and mooring line length and offset column diameter for the semisubmersible), we successfully modified the designs of the floating support structures to reduce the loads in the mooring lines, tower base, and blade roots, improving the ultimate strength and fatigue characteristics compared to the original designs.

17 WIND ENERGY↗

DOE OSTI2025

Solar Cell Metallization Wear is Sensitive to Loading Frequency

Here, we performed cyclic loading of photovoltaic laminates with precracked silicon cells to explore if and how loading frequency and contact pressure influence the ensuing gridline wear-out process. A measurement of parallel resistance across cracked gridlines on a laminated cell coupon was used as the metric for gridline electrical contact degradation. A statistical analysis of variance (ANOVA) analysis of the experimental results discerned that loading frequency is a more significant factor than contact pressure for gridline degradation.

14 SOLAR ENERGY↗

DOE OSTI2025

rmon (Resource monitor) [SWR-24-128]

The resource monitor application provides monitoring, collection, and visualization of resource utilization in compute nodes. This package contains utilities to monitor system resource utilization (CPU, memory, disk, network). Here are the ways you can use it: -Monitor resource utilization for a compute node for a given set of resource types and process IDs. -Start a process and monitor its resource utilization. -Monitor resource utilization for a compute node asynchronously with the ability to dynamically change the resource types and process IDs being monitored. -Produce JSON reports of aggregated metrics. -Produce interactive HTML plots of the statistics.

Thom, Daniel [National Renewable Energy Laboratory↗

DOE OSTI2026

Sub-daily virus sampling at the Bermuda Atlantic Time Series reveals diel and depth-structured population dynamics without community-level shifts

Ocean microbes contribute to biogeochemical cycles and ecosystem function, but they do so under top-down pressure imposed by viruses. While viruses are increasingly understood spatially and beginning to be incorporated into predictive modeling, high-frequency ocean virus dynamics remain understudied due to methodological challenges. Here we sampled stratified Bermuda Atlantic Time Series (BATS) waters for 112 hours at sub-daily 4- (surface) or 12- (deep chlorophyll maximum) hour intervals, purified viral particles from these samples, sequenced their metagenomes, and used the resulting data to characterize high-frequency virus community dynamics. Aggregated community diversity metrics changed with depth, but were not statistically significant temporally at a fixed location. However, finer-scale population-level analyses revealed both depth and temporal change, including physicochemical depth-driven differences and, in surface waters, thousands of viral populations that exhibited statistically significant diel rhythms. Statistical analyses revealed three main archetypes of temporal dynamics that themselves differed in abundance patterns, host predictions, viral taxonomy, and gene functions. Among these, highlights include viruses resembling an archetype with a night peaking pattern in activity that include an over-representation of viruses that putatively infect Prochlorococcus, a phototrophic cyanobacteria. Together, these efforts provide baseline community- and population-scale short-time-frame observations relevant to future climate state modeling.

Carrillo, Alfonso [The Ohio State University, Colu↗

DOE OSTI2021

International collaboration framework for the calculation of performance loss rates: Data quality, benchmarks, and trends (towards a uniform methodology)

Abstract The IEA PVPS Task 13 group, experts who focus on photovoltaic performance, operation, and reliability from several leading R&D centers, universities, and industrial companies, is developing a framework for the calculation of performance loss rates of a large number of commercial and research photovoltaic (PV) power plants and their related weather data coming across various climatic zones. The general steps to calculate the performance loss rate are (i) input data cleaning and grading; (ii) data filtering; (iii) performance metric selection, corrections, and aggregation; and finally, (iv) application of a statistical modeling method to determine the performance loss rate value. In this study, several high‐quality power and irradiance datasets have been shared, and the participants of the study were asked to calculate the performance loss rate of each individual system using their preferred methodologies. The data are used for benchmarking activities and to define capabilities and uncertainties of all the various methods. The combination of data filtering, metrics (performance ratio or power based), and statistical modeling methods are benchmarked in terms of (i) their deviation from the average value and (ii) their uncertainty, standard error, and confidence intervals. It was observed that careful data filtering is an essential foundation for reliable performance loss rate calculations. Furthermore, the selection of the calculation steps filter/metric/statistical method is highly dependent on one another, and the steps should not be assessed individually.

14 SOLAR ENERGY↗

DOE OSTI2026

Multidimensional scaling informed by F -statistic: Visualizing grouped microbiome data with inference

Multidimensional scaling (MDS) is a widely used dimensionality reduction technique in microbial ecology data analysis that captures the multivariate structure of the data while preserving pairwise distances between samples. While improvements in MDS have enhanced the ability to reveal group-specific data patterns, these MDS-based methods require prior assumptions for inference, limiting their application in general microbiome analysis. Here, in this study, we introduce a new MDS-based ordination method, “F-informed MDS,” which configures the data distribution based on the F-statistic, the ratio of dispersion between groups sharing common and different characteristics. Using semisynthetic datasets, we demonstrate that the proposed method is robust to hyperparameter selection while maintaining statistical significance throughout the ordination process. Various quality metrics for evaluating dimensionality reduction confirm that F-informed MDS is comparable to state-of-the-art methods in preserving both local and global data structures. Its application to a diatom-associated bacterial community suggests the role of this new method in interpreting the community’s response to the host. Our approach offers a well-founded refinement of MDS that aligns with statistical test results, which can be beneficial for broader multidimensional data analyses in microbiology and ecology. This new visualization tool can be incorporated into standard microbiome data analyses.

Biological and medical sciences↗

DOE OSTI2022

A Comparison of Infectious Disease Forecasting Methods across Locations, Diseases, and Time

Accurate infectious disease forecasting can inform efforts to prevent outbreaks and mitigate adverse impacts. This study compares the performance of statistical, machine learning (ML), and deep learning (DL) approaches in forecasting infectious disease incidences across different countries and time intervals. We forecasted three diverse diseases: campylobacteriosis, typhoid, and Q-fever, using a wide variety of features (n = 46) from public datasets, e.g., landscape, climate, and socioeconomic factors. We compared autoregressive statistical models to two tree-based ML models (extreme gradient boosted trees [XGB] and random forest [RF]) and two DL models (multi-layer perceptron and encoder–decoder model). The disease models were trained on data from seven different countries at the region-level between 2009–2017. Forecasting performance of all models was assessed using mean absolute error, root mean square error, and Poisson deviance across Australia, Israel, and the United States for the months of January through August of 2018. The overall model results were compared across diseases as well as various data splits, including country, regions with highest and lowest cases, and the forecasted months out (i.e., nowcasting, short-term, and long-term forecasting). Overall, the XGB models performed the best for all diseases and, in general, tree-based ML models performed the best when looking at data splits. There were a few instances where the statistical or DL models had minutely smaller error metrics for specific subsets of typhoid, which is a disease with very low case counts. Feature importance per disease was measured by using four tree-based ML models (i.e., XGB and RF with and without region name as a feature). The most important feature groups included previous case counts, region name, population counts and density, mortality causes of neonatal to under 5 years of age, sanitation factors, and elevation. This study demonstrates the power of ML approaches to incorporate a wide range of factors to forecast various diseases, regardless of location, more accurately than traditional statistical approaches.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2020

NREL Solar Data, Analysis, & Tools: FY19 Research Dissemination Statistics

This report summarizes the key Fiscal Year 2019 (FY19) outreach metrics for the NREL Solar Data, Analysis, and Tools (DAT) portfolio. All metrics herein reflect the reporting period of Oct. 1, 2018, through Sept. 30, 2019. These projects are all supported by the U.S. Department of Energy Solar Energy Technologies Office Soft Costs program.

14 SOLAR ENERGY↗

DOE OSTI2026

Improving the Confidence in Retrievals of Vertical Distributions of Cloud Condensation Nuclei Number Concentration from ARM Supported by Aircraft In Situ Observations

Accurate quantification of the vertical distribution of cloud condensation nuclei (CCN) number concentrations is critical for improving our understanding of aerosol–cloud interactions. Ground-based Raman lidars operated by the Atmospheric Radiation Measurement (ARM) program, together with surface CCN measurements, are used to retrieve vertically resolved CCN number concentrations (Retrieved Number concentration of CCN, RNCCN). These retrievals rely on several assumptions, including that aerosol composition is vertically homogeneous. To assess this assumption, we developed and tested a framework to infer the dominant aerosol classes/types at different altitudes. This was done by applying a k-Nearest-Neighbors (kNN) algorithm to lidar ratio and linear depolarization ratio measurements from Raman lidar. We evaluated the framework using aircraft aerosol and CCN measurements from the ARM Holistic Interactions of Shallow Clouds, Aerosols, and Land Ecosystems (HI-SCALE) field campaign. The results show that RNCCN performance degrades as vertical aerosol complexity increases, i.e., RNCCN agrees with the aircraft CCN in vertically homogeneous conditions, but closure decreases in layered aerosol structures. To generalize beyond individual examples, we introduce a metric (heterogeneity index) that quantifies the vertical complexity by assessing the variation of inferred aerosol classes/types. Case-level statistics show a tendency for RNCCN and aircraft differences to increase with this metric. By detecting retrievals that are likely compromised by aerosol vertical heterogeneity, the proposed framework improves the interpretability and effective use of RNCCN used for long-term evaluation of models and aerosol–cloud interactions.

Tian, Jingjing↗