Search NASA⌕ Search

SEARCH · Search NASA

Results for “science metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Evaluation of probabilistic photometric redshift estimation approaches for The Rubin Observatory Legacy Survey of Space and Time (LSST)

Many scientific investigations of photometric galaxy surveys require redshift estimates, whose uncertainty properties are best encapsulated by photometric redshift (photo-z) posterior probability density functions (PDFs). A plethora of photo-z PDF estimation methodologies abound, producing discrepant results with no consensus on a preferred approach. We present the results of a comprehensive experiment comparing twelve photo-z algorithms applied to mock data produced forLarge Synoptic Survey Telescope The Rubin Observatory Legacy Survey of Space and Time (lsst) Dark Energy Science Collaboration (desc). By supplying perfect prior information, in the form of the complete template library and a representative training set as inputs to each code, we demonstrate the impact of the assumptions underlying each technique on the output photo-z PDFs. In the absence of a notion of true, unbiased photo-z PDFs, we evaluate and interpret multiple metrics of the ensemble properties of the derived photo-z PDFs as well as traditional reductions to photo-z point estimates. Additionally, we report systematic biases and overall over/under-breadth of the photo-z PDFs of many popular codes, which may indicate avenues for improvement in the algorithms or implementations. Furthermore, we raise attention to the limitations of established metrics for assessing photo-z PDF accuracy; though we identify the conditional density estimate (CDE) loss as a promising metric of photo-z PDF performance in the case where true redshifts are available but true photo-z PDFs are not, we emphasize the need for science-specific performance metrics.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Graph Metric Learning Quantifies Morphological Differences between Two Genotypes of Shoot Apical Meristem Cells in Arabidopsis

We present a method for learning “spectrally descriptive” edge weights for graphs. We generalize a previously known distance measure on graphs (Graph Diffusion Distance), thereby allowing it to be tuned to minimize an arbitrary loss function. Because all steps involved in calculating this modified GDD are differentiable, we demonstrate that it is possible for a small neural network model to learn edge weights which minimize loss. We apply this method to discriminate between graphs constructed from shoot apical meristem images of two genotypes of Arabidopsis thaliana specimens: wild-type and trm678 triple mutants with cell division phenotype. Training edge weights and kernel parameters with contrastive loss produces a learned distance metric with large margins between these graph categories. We demonstrate this by showing improved performance of a simple k-nearest-neighbors classifier on the learned distance matrix. We also demonstrate a further application of this method to biological image analysis. Once trained, we use our model to compute the distance between the biological graphs and a set of graphs output by a cell division simulator. Comparing simulated cell division graphs to biological ones allows us to identify simulation parameter regimes which characterize mutant vs. wild-type Arabidopsis cells. We find that trm678 mutant cells are characterized by increased randomness of division planes and decreased ability to avoid previous vertices between cell walls.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

The Surface-Topography Challenge: A Multi-Laboratory Benchmark Study to Advance the Characterization of Topography

Surface performance is critically influenced by topography in virtually all real-world applications. The current standard practice is to describe topography using one of a few industry-standard parameters. The most commonly reported number is Ra, the average absolute deviation of the height from the mean line (at some, not necessarily known or specified, lateral length scale). However, other parameters, particularly those that are scale-dependent, influence surface and interfacial properties; for example the local surface slope is critical for visual appearance, friction, and wear. The present Surface-Topography Challenge was launched to raise awareness for the need of a multi-scale description, but also to assess the reliability of different metrology techniques. In the resulting international collaborative effort, 153 scientists and engineers from 64 research groups and companies across 20 countries characterized statistically equivalent samples from two different surfaces: a “rough” and a “smooth” surface. The results of the 2088 measurements constitute the most comprehensive surface description ever compiled. We find wide disagreement across measurements and techniques when the lateral scale of the measurement is ignored. Consensus is established through scale-dependent parameters while removing data that violates an established resolution criterion and deviates from the majority measurements at each length scale. Our findings suggest best practices for characterizing and specifying topography. The public release of the accumulated data and presented analyses enables global reuse for further scientific investigation and benchmarking.

42 ENGINEERING↗
DOE OSTI2025

Carbon Storage Technical Viability Approach (CS TVA) Matrix

The Carbon Storage Technical Viability Approach (CS TVA) Matrix is a knowledge framework developed to outline the information needed for geologic carbon storage. The CS TVA Matrix contains 5 categories, 14 sub-categories, and 47 components. This framework can be leveraged to assess the availability of data and information needed for a carbon storage project. The information categories of the matrix are tied to a list of required data using weighted mapping, published herein.

carbon storage↗
DOE OSTI2021

Nuclear Science User Facilities FY 2020 Program Performance Summary

The Nuclear Science User Facilities (NSUF) first gathered and reported metric data for Fiscal Year (FY) 2014. The goal of the FY 2014 NSUF Metric Report was to establish metric measures and to provide baseline data to evaluate future performance of the NSUF. Each metric goal and objective was established through NSUF discussions with Department of Energy (DOE) Idaho Operations Office and Office of Nuclear Energy staff. This report provides the data, analysis, and conclusions for the FY 2020 metrics.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Nuclear Science User Facilities FY 2019 Program Performance Summary

The Nuclear Science User Facilities (NSUF) first gathered and reported metric data for Fiscal Year (FY) 2014. The goal of the FY 2014 NSUF Metric Report was to establish metric measures and to provide baseline data to evaluate future performance of the NSUF. Each metric goal and objective were established through NSUF discussions with Department of Energy (DOE) Idaho Operations Office and Office of Nuclear Energy staff. This report provides the data, analysis, and conclusions for the FY 2019 metrics.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Harnessing land-atmosphere interactions to enhance subseasonal-to-seasonal predictability

2025 Advancing Understanding of Land-Atmosphere Interactions and Processes on S2S Predictability Workshop What: 227 registered workshop participants gathered in person (43%) and online (57%) to discuss state-of-the-art scientific understanding and modeling of land-atmosphere interactions and related processes in the context of subseasonal-to-seasonal (S2S) predictability. Topics covered sources of S2S predictability, land model initialization methods, model diagnosis and evaluation metrics, AI/ML analysis and applications, and coordination of future community multi-model S2S forecast focused experiments. To advance the science, this community workshop, organized by NSF NCAR, NOAA, NASA, and DOE, aimed to 1) identify process- and application-oriented metrics for assessing S2S prediction skill and 2) develop experimental protocols for coordinated experiments to isolate, quantify, and understand the role of land-atmosphere interactions in S2S predictability. When: June 16-18, 2025 Where: Boulder, CO, USA, and online.

Land-Atmosphere Interaction↗
DOE OSTI2022

Utilization of the Critic Subnetwork of a Generative Adversarial Network as Detector of Morphological Material Change in Image Data

The resolution of computed tomography (CT) has become high enough to monitor morphological changes due to aging in materials in long-term applications. For this work, we explored the utility of the critic of a generative adversarial network (GAN) to automatically detect such changes. The GAN was trained with images of pristine Pharmatose, which is used as a surrogate energetic material. It is important to note that images of the material with altered morphology were only used during the test phase. The GAN-generated images reproduced the microstructure of Pharmatose well, although some unrealistic particle fusion was seen. Calculated morphological metrics (volume fraction, interfacial line length, and local thickness) for the synthetic images also showed good agreement with the training data, albeit with signs of mode collapse in the interfacial line length. While the critic exposed changes in particle size, it showed limited ability to distinguish images by particle shape. The detection of shape differences was also a more challenging task for the selected morphological metrics that related to energetic material performance. We further tested the critic with images of aged Pharmatose. Subtle changes due to aging are difficult for the human analyst to detect; but both critic and morphological metrics analysis showed image differentiation.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Development of polarization-sensitive optical coherence tomography imaging platform and metrics to quantify electrostimulation-induced peripheral nerve injury in vivo in a small animal model

Neuromodulation devices are rapidly evolving for the treatment of neurological diseases and conditions. Injury from implantation or long-term use without obvious functional losses is often only detectable through terminal histology. New technologies are needed that assess the peripheral nervous system (PNS) under normal and diseased or injured conditions. We aim to demonstrate an imaging and stimulation platform that can elucidate the biological mechanisms and impacts of neurostimulation in the PNS and apply it to the sciatic nerve to extract imaging metrics indicating electrical overstimulation. A sciatic nerve injury model in a 15-rat cohort was observed using a newly developed imaging and stimulation platform that can detect electrical overstimulation effects with polarization-sensitive optical coherence tomography. The sciatic nerve was electrically stimulated using a custom-developed nerve holder with embedded electrodes for 1 h, followed by a 1-h recovery period, delivered at above-threshold Shannon model k-values in experimental groups: sham control (SC, n = 5, 0.0 mA / 0 Hz), stimulation level 1 (SL1, n = 5, 3.4 mA / 50 Hz, and k = 2.57), and stimulation level 2 (SL2, n = 5, 6.8 mA / 100 Hz, and k = 3.17). The stimulation and imaging system successfully captured study data across the cohort. When compared to a SC after a 1-week recovery, the fascicle closest to the stimulation lead showed an average change of +4 % / – 309 % (SL1/SL2) in phase retardation and –79 % / – 148 % in optical attenuation relative to SC. Analysis of immunohistochemistry (IHC) shows a +1 % / – 36 % difference in myelin pixel counts and –13 % / + 29 % difference in axon pixel counts, and an overall increase in cell nuclei pixel count of +20 % / + 35 % . These metrics were consistent with IHC and hematoxylin/eosin tissue section analysis. The poststimulation changes observed in our study are manifestations of nerve injury and repair, specifically degeneration and angiogenesis. Optical imaging metrics quantify these processes and may help evaluate the safety and efficacy of neuromodulation devices.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Correlation Effects and Magnetism in Actinides: Elements and Compounds (Final Close-out Report)

This is a final close-out report for DOE contract DE-FG02-99ER45761 entitled “Correlation Effects and Magnetism in Actinides: Elements and Compounds” at Rutgers University in New Jersey. It funded condensed matter physics basic energy science research from 04/15/1999 through 02/14/2020. A list of postdocs that received support from this grant are presented below, along with an overview of the research accomplishments of the grant with highlights of research results from the last funding period and a list of original papers published thru the duration of the grant with impact factor metrics are presented.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Carbon flux estimates are sensitive to data source: a comparison of field and lab temperature sensitivity data

Abstract A large literature exists on mechanisms driving soil production of the greenhouse gases CO 2 and CH 4 . Although it is common knowledge that measurements obtained through field studies vs. laboratory incubations can diverge because of the vastly different conditions of these environments, few studies have systematically examined these patterns. These data are used to parameterize and benchmark ecosystem- to global-scale models, which are then susceptible to the biases of the source data. Here, we examine how greenhouse gas measurements may be influenced by whether the measurement/incubation was conducted in the field vs. laboratory, focusing on CO 2 and CH 4 measurements. We use Q 10 of greenhouse gas flux (temperature sensitivity) for our analyses because this metric is commonly used in biological and Earth system sciences and is an important parameter in many modeling frameworks. We predicted that laboratory measurements would be less variable, but also less representative of true field conditions. However, there was greater variability in the Q 10 values calculated from lab-based measurements of CO 2 fluxes, because lab experiments explore extremes rarely seen in situ , and reflect the physical and chemical disturbances occurring during sampling, transport, and incubation. Overall, respiration Q 10 values were significantly greater in laboratory incubations (mean = 4.19) than field measurements (mean = 3.05), with strong influences of incubation temperature and climate region/biome. However, this was in part because field measurements typically represent total respiration (Rs), whereas lab incubations typically represent heterotrophic respiration (Rh), making direct comparisons difficult to interpret. Focusing only on Rh-derived Q 10 , these values showed almost identical distributions across laboratory ( n = 1110) and field ( n = 581) experiments, providing strong support for using the former as an experimental proxy for the latter, although we caution that geographic biases in the extant data make this conclusion tentative. Due to a smaller sample size of CH 4 Q 10 data, we were unable to perform a comparable robust analysis, but we expect similar interactions with soil temperature, moisture, and environmental/climatic variables. Our results here suggest the need for more concerted efforts to document and standardize these data, including sample and site metadata.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Leveraging Open-Source Satellite-Derived Building Footprints for Height Inference

At a global scale, cities are growing and characterizing the built environment is essential for deeper understanding of human population patterns, urban development, energy usage, climate change impacts, among others. Buildings are a key component of the built environment and significant progress has been made in recent years to scale building footprint extractions from satellite datum and other remotely sensed products. Billions of building footprints have recently been released by companies such as Microsoft and Google at a global scale. However, research has shown that depending on the methods leveraged to produce a footprint dataset, discrepancies can arise in both the number and shape of footprints produced. Therefore, each footprint dataset should be examined and used on a case-by-case study. In this work, we find through two experiments on Oak Ridge National Laboratory and Microsoft footprints within the same geographic extent that our approach of inferring height from footprint morphology features is source agnostic. Regardless of the differences associated with the methods used to produce a building footprint dataset, our approach of inferring height was able to overcome these discrepancies between the products and generalize, as evidenced by 98% of our results being within 3m of the ground-truthed height. This signifies that our approach can be applied to the billions of open-source footprints which are freely available to infer height, a key building metric. This work impacts the broader domain of urban science in which building height is a key, and limiting factor.

Stipek, Clinton [ORNL] (ORCID:0000000280501096)↗
DOE OSTI2020

Emulating climate extreme indices

We use simple pattern scaling and time-shift to emulate changes in a set of climate extreme indices under future scenarios, and evaluate the emulators' accuracy. We propose a metric for the error in emulation in the context of initial condition ensembles, to specifically characterize the role of internal variability in the emulation performance. Our metric separates systematic emulation errors from unavoidable discrepancies between emulated and target values due to internal variability. We compute the metricis at grid-point scale, and we show geographically resolved results, or aggregate them at global scale. We demonstrate the use of our error metric in the emulation of a suite of temperature and precipitation extreme indices. We test and compare simple pattern scaling and time-shift using a range of trajectories spanning targets inspired by the Paris agreement -- warming to 1.5C and 2.0C from the pre-industrial baseline -- and two of the longer-established trajectories, RCP4.5 and RCP8.5. With this suite of scenarios we can test the effects on the performance of the size of the temperature gap between emulation origin and target. We find that for most indices emulation the dominant source of discrepancy is internal variability. For at least one index, however, counting exceedances of a high temperature threshold, significant portions of the globally aggregated discrepancy and its regional pattern originate from the systematic emulation error. This error exceeds internal variability of both the target and the emulated quantities in large coherent regions at low latitudes, and the explanation can be found in the differential behavior of temperature distributions across latitudes. The metric also highlights a fundamental difference in the two methods related to the simulation of internal variability, which is dampened significantly by simple pattern scaling. This aspect is of consequence when using these methods for specific applications, where preserving variability for uncertainty quantification is deemed important. With this study we offer our metric as a diagnostic tool, facilitating the formulation of scientific hypotheses on the reasons for the error. In the meantime, we show that for many impact relevant indices by now traditional emulation techniques can be accurate within the variations unavoidably introduced by internal variability, establishing the fundamental condition for using their emulation in impact modeling.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Summary Report on the Refined User Requirements for U.S. Fusion Prototypic Neutron Source

The Fusion Prototypic Neutron Source (FPNS) is proposed as an urgent near-term facility necessary for understanding D-T fusion neutron degradation processes in materials and for the development of high-performance radiation tolerant materials for fusion power reactors. This facility is central to our goal of predicting the behavior of materials in the harsh D-T neutron environment and calibrating and verifying the materials performance models necessary to support design of next-generation fusion reactors. Key FPNS performance metrics were previously defined for the cost-efficient facility necessary to adequately and expediently resolve key materials science knowledge gaps required to move to next-step fusion devices. This brief report is intended to expand upon this previous metrics discussion as an aid to selecting the most desirable FPNS concept and enabling a facility that meets the program needs.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Carbon Storage Technical Viability Approach (CS TVA) Data Availability Results Database

The Carbon Storage Technical Viability Approach (CS TVA) Data Availability Results Database v1.0 is the output of a data availability assessment workflow that was developed by NETL to create a tool for spatial data availability assessment. This results database is the output of the first version of the workflow performed on the data with the CS TVA Database v2.0.

carbon storage↗
DOE OSTI2024

The Effect of Luminance Pattern on Nighttime Discomfort Glare Response - CRADA 653 (Abstract)

Light Emitting Diode (LED) adoption is critical for widespread energy savings from commercial outdoor lighting systems. A complaint from the public, concerns glare from LED light fixtures especially those with exposed LED arrays. This human factor study will examine luminance uniformity of the fixture aperture to identify parameters related to this response. The outcome will inform optical design by lighting manufacturers, retaining LED energy efficiency while mitigating glare. The results may also lead to improved industry standard glare metrics for lighting. Pacific Northwest National Laboratory’s (PNNL) Lighting Science and Technology Lab in Portland OR has a purpose-built apparatus with exposed LED arrays that have been used for prior work. It can easily be adapted for use in this experiment. Interchangeable templates will allow changing patterns for the stimulus. Glare ratings from the recruited subjects will be analyzed and reported in a peer-reviewed journal for application by luminaire manufacturers for improved products. The McClung Foundation’s interest is to better understand human perception of lighting, leading to more comfortable and effective visual environments. Members of the Foundation’s Technical Review Committee will be instrumental in reviewing the experimental design, analysis, and the final report. They will also help disseminate information about the results within the lighting community.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

“One Table to Rule Them All”: How a Single Table can Enable Extensive Insights, Analytics and Assessment on Human Mobility Data

While much research has been conducted in Human Mobility Science, most studies on the analytics/insights part generally focus on one of the following: processing and analytics on human stop-trip behavior, design of individual mobility metrics (often in silos), calculation and characterization of only a handful (typically 5-6) of human mobility metrics on geospatial-temporal human mobility data of interest. Although human mobility research offers a vast and diverse array of available metrics, most individual studies typically compute only a small subset of five or six metrics at a time when analyzing trajectory datasets of human mobility across different areas of interest. This paper is motivated by the critical need to repeatedly compute an extensive array of human mobility metrics across several trajectory datasets and perform individual metric-level benchmarking to establish a new, standardized Test and Evaluation (T&E) suite for the field of Human Mobility Science. We first present our findings on the minimal yet sufficient pre-processing required to reliably and efficiently compute a wide range of human mobility metrics. The key findings are specifically related to the proposed Composite Stop Locations table, which serves as a core pre-processing data layer. Subsequently, we present a case study demonstrating how the Composite Stop Locations table facilitates computation of at least 14 distinct human mobility metrics (unlike 5-6 different set of metrics used for studies in the literature) using the popular and open-source OpenPFLOW dataset. Finally, we have also presented an example of our benchmarking methodology to evaluate the quality and performance of the trajectory dataset of interest, assessed across multiple human mobility metrics.

De, Debraj [ORNL] (ORCID:0000000233630020)↗