SEARCH · Search NASA

Results for “metric standardization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

Applying Sensor Uncertainty Mitigation Schemes to Detect-and-Avoid Systems

Impact of sensor noise on the performance of Detect-And-Avoid (DAA) systems can be reduced by implementing various mitigation schemes. This paper evaluates the Sensor Uncertainty Mitigation (SUM) method, implemented in the Detect and Avoid Alerting Logic for Unmanned Systems (DAIDALUS) algorithm, a reference implementation in the DAA minimum operational performance standards. DAIDALUS SUM performance is evaluated using a few safety and operational suitability metrics and compared with more traditional approaches using static safety buffers. A large number of encounters representative of low-speed unmanned aircraft against non-cooperative manned aircraft are simulated and evaluated. An air-to-air radar model produces representative sensor noise for the DAA system. Results show that increasing the tunable parameters for horizontal and vertical uncertainty in DAIDALUS SUM improves the safety metric at the cost of increasing the number of system alerts leading to increased workload. A range of SUM parameters is recommended as suitable values for the type of operations considered for this work. General trends and optimal SUM configurations were found to be nearly the same for two large and very different encounter data sets.

detect and avoid↗

DOE OSTI2022

A Distributed Trust Model Simulator for Energy Grid of Things Distributed Energy Resource Management System

The evolution of networks into more distributed, self-reliant nodes has mitigated single-point failures that plagued traditional centralized networks. Applied to power grids, distributed systems can increase the integrity and availability of grid services while also offering a power management solution. However, while distributed networks provide scalability, security, and sustainability compared to centralized networks, their distributed nature makes them harder for anomaly detection and prevention. Incorporating a Distributed Trust Model (DTM) System into an Energy Grid of Things Distributed Energy Resource Management System (EGOT DERMS) allows grid participants to be characterized and their communication to be analyzed for possible attacks. A Trust Model simulator is needed to evaluate and improve the DTM System.Trustworthiness is calculated using a Trust Model. While many trust models exist, most only consider 2-3 matrices to evaluate trust. The TM proposed in this thesis uses a Metric Vector of Trust (MVoT) monitoring 17 parameters when assessing trust. Moreover, unlike standard trust models, the proposed trust model establishes a method to test the trust between various actors within the network and probe the trust model itself. Using a Trust Model Simulator, MVoT calaculations, initial values, and parameters are fine-tuned to achieve high-confidence message classifications and minimize false positives. The DTM System and Trust Mode Simulation Suite allow for distributed trust evaluation with a real-time classification of EGOT DERMS actors, providing additional security for distributed systems.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2024

The New Face of Standard 100

In January 2024, ASHRAE published a significant overhaul to ANSI/ASHRAE/IES Standard 100-2018, Energy Efficiency in Existing Buildings. You may almost not recognize it. Standard 100-2024, Energy and Emissions Building Performance Standard for Existing Buildings, now addresses both energy and emissions performance as a model building performance standard (BPS). ASHRAE Standing Standard Project Committee (SSPC) 100, with direction from ASHRAE and its Task Force for Building Decarbonization (TFBD) has been working to update the standard to make it a model for building performance standard adoption across the U.S. and internationally. Here, the new edition of Standard 100 addresses key issues of climate change surrounding building performance, including new metrics for greenhouse gas (GHG) emissions targets, continuing to support the imperative of improving our existing building stock and meeting global climate change commitments.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

NASA NTRS2009

Evaluating Algorithm Performance Metrics Tailored for Prognostics

Prognostics has taken a center stage in Condition Based Maintenance (CBM) where it is desired to estimate Remaining Useful Life (RUL) of the system so that remedial measures may be taken in advance to avoid catastrophic events or unwanted downtimes. Validation of such predictions is an important but difficult proposition and a lack of appropriate evaluation methods renders prognostics meaningless. Evaluation methods currently used in the research community are not standardized and in many cases do not sufficiently assess key performance aspects expected out of a prognostics algorithm. In this paper we introduce several new evaluation metrics tailored for prognostics and show that they can effectively evaluate various algorithms as compared to other conventional metrics. Specifically four algorithms namely; Relevance Vector Machine (RVM), Gaussian Process Regression (GPR), Artificial Neural Network (ANN), and Polynomial Regression (PR) are compared. These algorithms vary in complexity and their ability to manage uncertainty around predicted estimates. Results show that the new metrics rank these algorithms in different manner and depending on the requirements and constraints suitable metrics may be chosen. Beyond these results, these metrics offer ideas about how metrics suitable to prognostics may be designed so that the evaluation procedure can be standardized. 1

Saxena, Abhinav↗

DOE OSTI2025

Abiotic influences on continuous conifer forest structure across a subalpine watershed

Understanding the abiotic drivers of high-elevation forest physiognomy is essential for forecasting how mountain ecosystems will respond to emerging environmental pressures. Most prior studies of these relationships have relied on small samples of the full landscape, resulting in limited power to detect dominant covariates and their interactions. Here we report the first evaluation of abiotic influences on a complement of accurate, wall-to-wall estimates of conifer forest structure and composition at the watershed scale. In a subalpine conifer domain in the Colorado Rocky Mountains (USA), we developed a novel method for deriving stand structure metrics from waveform LiDAR data, which showed high fidelity with field inventory. We quantified the relationships between structural and compositional metrics and climate, topographic, edaphic, and geologic factors. Our results showed that peak snow water equivalent (SWE), snow disappearance rate, and elevation explained most of the variation in forest structure. The highest stand density, basal area, maximum canopy height, and quadratic mean diameter occurred in sites with SWE around one standard deviation below mean, but with long snow residence times. Stand density decreased linearly with elevation, while other metrics peaked between 3000 m and 3200 m. Substrate properties had weaker influence. Continuous mapping of through-canopy forest structure enabled our novel findings of the dominant role of snowpack in explaining structural and compositional variation, and of elevation thresholds. Our reproducible approach facilitates assessment of forest-topoclimate relationships in other conifer-dominated landscapes and improves understanding of the baseline patterns controlling forest structure, which is needed for predicting long-term ecological change.

forest ecology↗

DOE OSTI2024

Efficient estimation of the modified Gromov–Hausdorff distance between unweighted graphs

Abstract Gromov–Hausdorff distances measure shape difference between the objects representable as compact metric spaces, e.g. point clouds, manifolds, or graphs. Computing any Gromov–Hausdorff distance is equivalent to solving an NP-hard optimization problem, deeming the notion impractical for applications. In this paper we propose a polynomial algorithm for estimating the so-called modified Gromov–Hausdorff (mGH) distance, a relaxation of the standard Gromov–Hausdorff (GH) distance with similar topological properties. We implement the algorithm for the case of compact metric spaces induced by unweighted graphs as part of Python library , and demonstrate its performance on real-world and synthetic networks. The algorithm finds the mGH distances exactly on most graphs with the scale-free property. We use the computed mGH distances to successfully detect outliers in real-world social and computer networks.

Oles, Vladyslav (ORCID:0000000188727463)↗

NASA NTRSDate not supplied

A Psychoacoustic Test for Urban Air Mobility Vehicle Sound Quality

This paper describes a psychoacoustic test in the Exterior Effects Room (EER) at the NASA Langley Research Center. The test investigated the degree to which sound quality metrics (sharpness, tonality, etc.) are predictive of annoyance to notional sounds of Urban Air Mobility (UAM) vehicles (i.e., air taxis). A suite of 136 unique (4.6 second duration) UAM rotor noise stimuli was generated. These stimuli were based on aeroacoustic predictions of a NASA reference UAM quadrotor aircraft under two flight conditions. The synthesizer changed rotor noise parameters such as the blade passage frequency, the relative level of broadband self-noise, and the relative level of tonal motor noise. With loudness constant, the synthesis parameters impacted sound quality in a way that created a spread of predictors both in synthesizer parameters and in sound quality metrics. Forty subjects listened to the suite of UAM noise stimuli in the EER and judged each sound individually on a standard scale of annoyance. Additionally, a subset of the UAM noise stimuli were compared to a reference sound that varied in loudness. From these responses, the relative effect of changes in loudness or changes in other sound quality metrics on annoyance was evaluated. This paper covers background and motivation for the test, details of how the sound stimuli were generated, and details of the test design and execution. Test results investigate how sound quality may affect perceived annoyance to UAM vehicle noise, indicating the importance of sharpness, tonality, impulsiveness, and roughness on annoyance to UAM noise.

UAM↗

NASA NTRS2004

Software Quality Assurance Metrics

Software Quality Assurance (SQA) is a planned and systematic set of activities that ensures conformance of software life cycle processes and products conform to requirements, standards and procedures. In software development, software quality means meeting requirements and a degree of excellence and refinement of a project or product. Software Quality is a set of attributes of a software product by which its quality is described and evaluated. The set of attributes includes functionality, reliability, usability, efficiency, maintainability, and portability. Software Metrics help us understand the technical process that is used to develop a product. The process is measured to improve it and the product is measured to increase quality throughout the life cycle of software. Software Metrics are measurements of the quality of software. Software is measured to indicate the quality of the product, to assess the productivity of the people who produce the product, to assess the benefits derived from new software engineering methods and tools, to form a baseline for estimation, and to help justify requests for new tools or additional training. Any part of the software development can be measured. If Software Metrics are implemented in software development, it can save time, money, and allow the organization to identify the caused of defects which have the greatest effect on software development. The summer of 2004, I worked with Cynthia Calhoun and Frank Robinson in the Software Assurance/Risk Management department. My task was to research and collect, compile, and analyze SQA Metrics that have been used in other projects that are not currently being used by the SA team and report them to the Software Assurance team to see if any metrics can be implemented in their software assurance life cycle process.

McRae, Kalindra A.↗

DOE OSTI2024

LTE Electrolyzer Data Collection

The goal for NREL is to collect, develop and publish performance metrics relative to low temperature electrolyzer installations. This will be done through the development of: Secure storage solution to house the collection of data from multiple projects Standardization of data to be collected and analyzed. This will be done using data templates developed with the help of partners involved with electrolyzer installations. Analysis that produces metrics of interest for all stakeholders Aggregation of results from multiple projects to view industry progress as a whole Publication of aggregated results in the form of composite data products (CDPs) Collaboration with Idaho National Lab and their work with high temperature electrolyzer installations will enable efficient use of storage and analysis tools.

data↗

DOE OSTI2023

Perspective: Performance Loss Rate in Photovoltaic Systems

Photovoltaic systems may underperform expectations for several reasons, including inaccurate initial estimates, suboptimal operations and maintenance, or component degradation. Accurate assessment of these loss factors aids in addressing root causes of underperformance and in realizing accurate expectations and models. The performance loss rate (PLR) is a commonly cited high‐level metric for the change in system output over time, but there is no precise, standard definition. Herein, an annualized definition of PLR that is inclusive of all loss factors and that can capture nonlinear changes to performance over time is proposed. The importance of distinguishing between recoverable and nonrecoverable losses which underly PLR is highlighted.

14 SOLAR ENERGY↗

DOE OSTI2024

Best Practices for Measuring the Modulation Transfer Function of Video Endoscopes

Endoscopes are crucial for assisting in surgery and disease diagnosis, including the early detection of cancer. The effective use of endoscopes relies on their optical performance, which can be characterized with a series of metrics such as resolution, vital for revealing anatomical details. The modulation transfer function (MTF) is a key metric for evaluating endoscope resolution. However, the 2020 version of the ISO 8600-5 standard, while introducing an endoscope MTF measurement method, lacks empirical validation and excludes opto-electronic video endoscopes, the largest family of endoscopes. Measuring the MTF of video endoscopes requires tailored standards that address their unique characteristics. This paper aims to expand the scope of ISO 8600-5:2020 to include video endoscopes, by optimizing the MTF test method and addressing parameters affecting measurement accuracy. We studied the effects of intensity and uniformity of image luminance, chart modulation compensation, linearity of image digital values, auto gain control, image enhancement, image compression and the region of interest dimensions on images of slanted-edge test charts, and thus the MTF based on these images. By analyzing these effects, we provided recommendations for setting and controlling these factors to obtain accurate MTF curves. Our goal is to enhance the standard’s relevance and effectiveness for measuring the MTF of a broader range of endoscopic devices, with potential applications in the MTF measurement of other digital imaging devices.

47 OTHER INSTRUMENTATION↗

NASA NTRS2009

Evaluating Effectiveness of Modeling Motion System Feedback in the Enhanced Hess Structural Model of the Human Operator

In order to use the Hess Structural Model to predict the need for certain cueing systems, George and Cardullo significantly expanded it by adding motion feedback to the model and incorporating models of the motion system dynamics, motion cueing algorithm and a vestibular system. This paper proposes a methodology to evaluate effectiveness of these innovations by performing a comparison analysis of the model performance with and without the expanded motion feedback. The proposed methodology is composed of two stages. The first stage involves fine-tuning parameters of the original Hess structural model in order to match the actual control behavior recorded during the experiments at NASA Visual Motion Simulator (VMS) facility. The parameter tuning procedure utilizes a new automated parameter identification technique, which was developed at the Man-Machine Systems Lab at SUNY Binghamton. In the second stage of the proposed methodology, an expanded motion feedback is added to the structural model. The resulting performance of the model is then compared to that of the original one. As proposed by Hess, metrics to evaluate the performance of the models include comparison against the crossover models standards imposed on the crossover frequency and phase margin of the overall man-machine system. Preliminary results indicate the advantage of having the model of the motion system and motion cueing incorporated into the model of the human operator. It is also demonstrated that the crossover frequency and the phase margin of the expanded model are well within the limits imposed by the crossover model.

Zaychik, Kirill↗

DOE OSTI2024

Applying energy justice metrics to photovoltaic materials research

Abstract Achieving the energy transition sustainably requires addressing how new technologies may impact justice in the energy system. The Justice Underpinning Science and Technology Research (JUST-R) metrics framework was recently proposed to aid researchers in considering justice in early-stage research on energy technologies; however, case study evaluations of the framework revealed a desire from researchers to see metrics specialized to particular fields of study. Here, we refine metrics from the JUST-R framework to enhance its applicability to photovoltaic (PV) materials research. Metrics are reorganized to align with aspects of the research process (e.g., research team or source materials). For most metrics, baseline values are suggested to enable researchers to compare their project to competing technologies or standards at their institutions. These refinements are integrated into a tool to facilitate easier understanding and evaluation of justice considerations in early-stage PV research, which can serve as a template for evaluating other energy technologies. Graphical abstract

14 SOLAR ENERGY↗

DOE OSTI2025

Thermal Resilience of Buildings and Communities: A Multistakeholder Review of Metrics and Approaches

Increasing temperature-related hazards require a collective effort to assess and enhance the thermal resilience of buildings and communities to protect occupants’ safety and minimize property or infrastructure damage. However, limited coordination across stakeholders and lack of standardized procedures for resilience assessment undermine the effectiveness of extreme temperature mitigation and adaptation strategies across the building life cycle. This review examines the current literature on resilience metrics to address thermal stress and risk due to extreme indoor environments. Stakeholders of thermal resilience include architects and engineers, occupants, property owners, real estate developers, urban planners, and policymakers. Additionally, motivations for measuring thermal resilience are emphasized, such as safeguarding occupant health and survivability, protecting property, and ensuring business continuity during extreme weather events. This review provides actionable insights and identifies future research needs for enhancing resilience through tailored metrics for stakeholders during the planning, design, construction, operation, and retrofitting phases of buildings and communities.

building life cycle↗

DOE OSTI2020

Quantized Constant-Q Gabor Atoms for Sparse Binary Representations of Cyber-Physical Signatures

Increased data acquisition by uncalibrated, heterogeneous digital sensor systems such as smartphones present new challenges. Binary metrics are proposed for the quantification of cyber-physical signal characteristics and features, and a standardized constant-Q variation of the Gabor atom is developed for use with wavelet transforms. Two different continuous wavelet transform (CWT) reconstruction formulas are presented and tested under different signal to noise ratio (SNR) conditions. A sparse superposition of Nth order Gabor atoms worked well against a synthetic blast transient using the wavelet entropy and an entropy-like parametrization of the SNR as the CWT coefficient-weighting functions. The proposed methods should be well suited for sparse feature extraction and dictionary-based machine learning across multiple sensor modalities.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

DOE OSTI2026

Methods development towards automated, physics-informed, quantitative quality control of TRISO-SiC

Tristructural-isotropic (TRISO) fuel particles have been developed as a high-performance fuel for use in high-temperature gas-cooled reactor (HTGR) systems due to their high efficiency and stability under both normal and off-normal conditions. Broader deployment of this technology in advanced nuclear applications may benefit from quantitative quality assurance and quality control (QA/QC) methods that directly link TRISO properties to downstream performance. A key TRISO property is the SiC layer microstructure, which influences fission product retention during irradiation. However, existing QA/QC for the TRISO-SiC microstructure comprises only a qualitative visual inspection; therefore, there is a clear opportunity for the development of quantitative methods for TRISO QA/QC. Here, to this end, previous work has demonstrated an image processing approach to grain boundary (GB) identification and subsequent extraction of microstructural metrics; however, extensive twinning within the SiC layer complicates such analyses because twin GBs significantly influence microstructural metrics but are not expected to contribute to fission product transport. This study presents the initial development, training, and testing of an ML-based image segmentation algorithm designed to identify and remove twin GBs from standard backscattered electron micrographs, providing an industrially applicable, quantitative, and physically meaningful QA/QC approach for the TRISO-SiC microstructure. Although pixel-wise performance metrics for the twin predictions are low, the change in grain area and the number of GB pixels after twin removal predicted by the ML workflow are within 1% of the true values calculated using crystallographic data. This suggests that the model is well capable of predicting overall twin boundary structures and grain morphology, and continued advancement of this approach could enable automated, scalable, and physics-informed QA/QC for TRISO-SiC microstructures, supporting the reliable qualification of coated particle fuels for next-generation reactor systems.

Computer vision↗

NASA NTRS2011

Standardization of a Volumetric Displacement Measurement for Two-Body Abrasion Scratch Test Data Analysis

A limitation has been identified in the existing test standards used for making controlled, two-body abrasion scratch measurements based solely on the width of the resultant score on the surface of the material. A new, more robust method is proposed for analyzing a surface scratch that takes into account the full three-dimensional profile of the displaced material. To accomplish this, a set of four volume- displacement metrics was systematically defined by normalizing the overall surface profile to denote statistically the area of relevance, termed the Zone of Interaction. From this baseline, depth of the trough and height of the plowed material are factored into the overall deformation assessment. Proof-of-concept data were collected and analyzed to demonstrate the performance of this proposed methodology. This technique takes advantage of advanced imaging capabilities that allow resolution of the scratched surface to be quantified in greater detail than was previously achievable. When reviewing existing data analysis techniques for conducting two-body abrasive scratch tests, it was found that the ASTM International Standard G 171 specified a generic metric based only on visually determined scratch width as a way to compare abraded materials. A limitation to this method was identified in that the scratch width is based on optical surface measurements, manually defined by approximating the boundaries, but does not consider the three-dimensional volume of material that was displaced. With large, potentially irregular deformations occurring on softer materials, it becomes unclear where to systematically determine the scratch width. Specifically, surface scratches on different samples may look the same from a top view, resulting in an identical scratch width measurement, but may vary in actual penetration depth and/or plowing deformation. Therefore, two different scratch profiles would be measured as having identical abrasion properties, although they differ significantly.

Street, K. W. Jr.↗

DOE OSTI2023

Know Your Space: Inlier and Outlier Construction for Calibrating Medical OOD Detectors

This software offers methods and functions for training calibrated out-of-distribution detectors for medical image classification tasks. It includes functionalities for training, synthesizing data augmentations, calibration, and out-of-distribution detection. Developed using PyTorch, this software is compatible with standard neural network architectures used for imaging data. Additionally, it provides capabilities to compute evaluation metrics for assessing the performance and quality of the detectors.

Narayanaswamy, VivekSivaraman↗