Search NASA⌕ Search

SEARCH · Search NASA

Results for “metric categorization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2020

Potential of GPM IMERG Precipitation Estimates to Monitor Natural Disaster Triggers in Urban Areas: the Case of Rio deJaneiro, Brazil

Extreme rainfall can be a catastrophic trigger for natural disaster events at urban scales. However, there remains large uncertainties as to how satellite precipitation can identify these triggers at a city scale. The objective of this study is to evaluate the potential of satellite-based rainfall estimates to monitor natural disaster triggers in urban areas. Rainfall estimates from the Global Precipitation Measurement (GPM) mission are evaluated over the city of Rio de Janeiro, Brazil, where urban floods and landslides occur periodically as a result of extreme rainfall events. Two rainfall products derived from the Integrated Multi-satellite Retrievals for GPM (IMERG), the IMERG Early and IMERG Final products, are integrated into the Noah Multi-Parameterization (Noah-MP) land surface model in order to simulate the spatial and temporal dynamics of two key hydrometeorological disaster triggers across the city over the wet seasons during 2001-2019. Here, total runoff (TR) and rootzone soil moisture (RZSM) are considered as flood and landslide triggers, respectively. Ground-based observations at 33 pluviometric stations are interpolated, and the resulting rainfall fields are used in an in-situ precipitation-based simulation, considered as the reference for evaluating the IMERG-driven simulations. The evaluation is performed during the wet seasons (November-April), when average rainfall over the city is 4.4mm/day. Results show that IMERG products show low spatial variability at the city scale, generally overestimate rainfall rates by 12-35%, and impacts on TR and RZSM vary spatially mostly as a function of land cover and soil types. Results based on statistical and categorical metrics show that IMERG skill in detecting extreme events is moderate, with IMERG Final performing slightly better for most metrics. By analyzing two recent storms, we observe that IMERG detects mostly hourly extreme events, but underestimates rainfall rates, resulting in underestimated TR and RZSM. An evaluation of normalized time series using percentiles shows that both satellite products have significantly improved skill in detecting extreme events when compared to the evaluation using absolute values, indicating that IMERG precipitation could be potentially used as a predictor for natural disasters in urban areas.

IMERG↗
NASA NTRS2022

Validation of IMERG Oceanic Precipitation over Kwajalein

The integrated Multi-satellitE Retrievals for GPM (IMERG) Version V05B and V06B precipitation products from the Global Precipitation Measurement (GPM) mission are validated against ground-based observations from the Kwajalein Polarimetric S-band Weather Radar (KPOL) deployed at Kwajalein Atoll in the central Pacific Ocean. Such a validation is particularly important as comprehensive surface measurements over the oceans are practically infeasible, which hampers the identification of possible errors, and improvement of future versions of IMERG and other satellitebased retrieval algorithms. The V05B and V06B IMERG products are validated at their native 0.1°, 30 min resolution from 2014 to 2018 based on both volumetric and categorical metrics. This validation study indicates that precipitation rates from both IMERG V05B and V06B are underestimated with respect to radar surface estimates, but the underestimation is much reduced from V05B IMERG V06B outperforms V05B with reduced systematic bias and improved precipitation detectability. The IMERG performance is further traced back to its individual sensors and morphing-based algorithms. The overall underestimation in V05B is mainly driven by the negative relative biases from morphing-based algorithms which are largely corrected in V06B. Imagers perform generally better than sounders because of the usage of low-frequency channels in imagers which can better detect emission signals by the hydrometeors. Among imagers, the GPM Microwave Imager (GMI) and Advanced Microwave Scanning Radiometer Version 2 (AMSR2) are the best, followed by Special Sensor Microwave Imager/Sounder (SSMIS). Among sounders, the Microwave Humidity Sounder (MHS) is the best, followed by Advanced Technology Microwave Sounder (ATMS) and the Sounder for Atmospheric Profiling of Humidity in the Intertropics by Radiometry (SAPHIR) for V06B. Among all categories, morph-only and IR+morph only perform better than SAPHIR. SAPHIR shows the worst performance among all categories, likely due to its limited channel selection. It is envisaged that these results will improve our understanding of IMERG performance over oceans and aid in the improvement of future versions of IMERG.

KPOL↗
DOE OSTI2022

Power System Resilience Evaluation Framework and Metric Review

Power system resilience has been an emerging hot topic in recent years to investigate the increasing threats of extreme events, such as natural disasters, severe weather, and cyberattacks. Although much research has been done to define, model, and quantify resilience from different aspects, the lack of universally accepted evaluation methods and resilience metrics makes it difficult to assess and compare resilience across different power systems, such as what is typically done in power system reliability studies. In this paper, first, we review the definitions of resilience, and we summarize two core concepts shared by most of the literature. Then, we develop a new framework to assess power system resilience from two perspectives - i.e., pre-event estimation and post-event evaluation - to capture system resilience performance in both general and specific fashions. We conduct a thorough review of existing resilience metrics and categorize them using the proposed framework, where recommendations are also proposed to capture core concepts of resilience.

power system resilience↗
NASA NTRS2021

Validation of Satellite-Based Precipitation Products from TRMM to GPM

The global precipitation measurement mission (GPM) has been in operation for seven years and continues to provide a vast quantity of global precipitation data at finer temporospatial resolutions with improved accuracy and coverage. GPM’s signature algorithm, the integrated multisatellite retrievals for GPM (IMERG) is a next-generation of precipitation product expected for wide variety of research and operational applications. This study evaluates the latest version (V06B) of IMERG and its predecessor, the tropical rainfall measuring mission (TRMM) multisatellite precipitation (TMPA) 3B42 (V7) using ground-based and gauge-corrected multiradar multisensor system (MRMS) precipitation products over the conterminous United States (CONUS). The spatial distributions of all products are analyzed. The error characteristics are further examined for 3B42 and IMERG in winter and summer by an error decomposition approach, which partitions total bias into hit bias, biases due to missed precipitation and false precipitation. The volumetric and categorical statistical metrics are used to quantitatively evaluate the performance of the two satellite-based products. All products show a similar precipitation climatology with some regional differences. The two satellite-based products perform better in the eastern CONUS than in the mountainous Western CONUS. The evaluation demonstrates the clear improvement in IMERG precipitation product in comparison with its predecessor 3B42, especially in reducing missed precipitation in winter and summer, and hit bias in winter, resulting in better performance in capturing lighter and heavier precipitation.

MRMS↗
NASA NTRS2024

Assessing the Convective Environment over Irrigated and Non-Irrigated Land Use with Land-Atmosphere Coupling Metrics: Results from GRAINEX

Land use land cover change affects weather and climate. This paper quantifies land-atmosphere interactions over irrigated and non-irrigated land uses during the Great Plains Irrigation Experiment (GRAINEX). Three coupling metrics were used to quantify some land-atmosphere interactions as it relates to convection. They include: the Convective Triggering Potential (CTP) and Low-Level Humidity Index (HI low ), and the Lifting Condensation Level (LCL) Deficit. These metrics were calculated from the rawinsonde data obtained from the Integrated Sounding Systems (ISS) for Rogers Farm and York Airport along with soundings launched from the Doppler on Wheels (DOW) sites. Each metric was categorized by Intensive Observation Period (IOP), cloud cover, and time of day.

Daniel Whitesel↗
DOE OSTI2021

A Statistical Evaluation of Combining Human Productivity Metrics in the Indoor Environment

The potential of improving human productivity by providing healthy indoor environments has been a consistent interest in the building field for decades. This research field's long-standing challenge is to measure human productivity given the complex nature of office work. Previous studies have diversified productivity metrics, allowing greater flexibility in collecting human data; however, this diversity complicates the ability to combine productivity metrics from disparate studies within a meta-analysis. This study aims to categorize existing productivity metrics and statistically assess which categories show similar behavior when used to measure the impacts of indoor environmental quality. The 106 productivity metrics compiled were grouped into six productivity metric categories: neurobehavioral speed, accuracy, neurobehavioral response time, call handling time, self-reported productivity, and performance score. Then, this study set neurobehavioral speed as the baseline category given its fitness to the efficiency-based definition of productivity (i.e., output versus input) and conducted three statistical analyses with the other categories to evaluate their similarity. As results, the categories of neurobehavioral response time, self-reported productivity, and call handling time were found to have statistical similarity with neurobehavioral speed. This study contributes to creating a constructive research environment for future meta-analyses to understand which human productivity metrics can be combined with each other.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS2010

Assessment of Scheduling and Plan Execution of Apollo 14 Lunar Surface Operations

Although over forty years have passed since first landing on the Moon, there is not yet a comprehensive, quantitative assessment of Apollo extravehicular activities (EVAs). Quantitatively evaluating lunar EVAs will provide a better understanding of the challenges involved with surface operations. This first evaluation of a surface EVA centers on comparing the planned and the as-ran timeline, specifically collecting data on discrepancies between durations that were estimated versus executed. Differences were summarized by task categories in order to gain insight as to the type of surface operation activities that were most challenging. One Apollo 14 EVA was assessed utilizing the described methodology. Selected metrics and task categorizations were effective, and limitations to this process were identified.

Marquez, Jessica J.↗
NASA NTRS2015

Are We There Yet? Determining the Adequacy of Formalized Requirements and Test Suites

Structural coverage metrics have traditionally categorized code as either covered or uncovered. Recent work presents a stronger notion of coverage, checked coverage, which counts only statements whose execution contributes to an outcome checked by an oracle. While this notion of coverage addresses the adequacy of the oracle, for Model-Based Development of safety critical systems, it is still not enough; we are also interested in how much of the oracle is covered, and whether the values of program variables are masked when the oracle is evaluated. Such information can help system engineers identify missing requirements as well as missing test cases. In this work, we add to the idea of checked coverage an analysis of requirements coverage to help provide insight to engineers as to whether the requirements or the test suite need to be improved. We implement our approach based on a dynamic backward slicing technique and evaluate it on several systems developed in Simulink. The results of our preliminary study show that even for systems with comprehensive test suites and good sets of requirements, our approach can identify cases where more tests or more requirements are needed to improve coverage numbers.

Dynamic Slicing↗
DOE OSTI2022

Power System Resilience Evaluation Framework and Metric Review: Preprint

Power system resilience is an emerging hot topic in recent years to study the increasing threats of extreme events such as natural disasters, severe weather, and cyberattacks. Although many research works have been done to define, model, and quantify resilience from different aspects, the lack of universally accepted resilience metrics and evaluation methods makes it difficult to assess and compare resilience across different power systems like what is typically done in power system reliability studies. In this paper, we first review the definitions of resilience and summarized two core concepts shared by most literature. On top of that, we conduct a thorough review of resilience metrics and develop a new framework to assess power system resilience from two perspectives, i.e., pre-event estimation and post-event evaluation, to capture system resilience performance in both general and specific fashions. Existing resilience metrics are summarized and categorized using the proposed framework, where recommendations are also proposed to capture core concepts of resilience.

power system resilience↗
DOE OSTI2023

Deep Reinforcement Learning for Resilient Power and Energy Systems: Progress, Prospects, and Future Avenues

In recent years, deep reinforcement learning (DRL) has garnered substantial attention in the context of enhancing resilience in power and energy systems. Resilience, characterized by the ability to withstand, absorb, and quickly recover from natural disasters and human-induced disruptions, has become paramount in ensuring the stability and dependability of critical infrastructure. This comprehensive review delves into the latest advancements and applications of DRL in enhancing the resilience of power and energy systems, highlighting significant contributions and key insights. The exploration commences with a concise elucidation of the fundamental principles of DRL, highlighting the intricate interplay among reinforcement learning (RL), deep learning, and the emergence of DRL. Furthermore, it categorizes and describes various DRL algorithms, laying a robust foundation for comprehending the applicability of DRL. The linkage between DRL and power system resilience is forged through a systematic classification of DRL applications into five pivotal dimensions: dynamic response, recovery and restoration, energy management and control, communications and cybersecurity, and resilience planning and metrics development. This structured categorization facilitates a methodical exploration of how DRL methodologies can effectively tackle critical challenges within the domain of power and energy system resilience. The review meticulously examines the inherent challenges and limitations entailed in integrating DRL into power and energy system resilience, shedding light on practical challenges and potential pitfalls. Additionally, it offers insights into promising avenues for future research, with the aim of inspiring innovative solutions and further progress in this vital domain.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Planning for Seattle at the Convergence of Resilience and Energy

Grid reliability metrics obscure important temporal, spatial, and categorical considerations for increasing energy resilience. Systemwide or feeder-level outage metrics do not identify which kinds of services are affected by outages, where, and for how long. These outage metrics indicate the impacts of outages but cannot measure the consequences to customers that could result from those outages. The consequences of power outages for surrounding community members are caused by disruptions to electricity-dependent critical services, rather than to electricity itself. Power outages can decrease a community's access to healthcare, fuel, safe indoor temperatures, and provisions like food and water. This project developed critical service access, a new consequence-focused resilience metric that quantifies the relative access to critical services provided to households by distribution infrastructure during normal conditions and major disruptions. We use a spatially granular grid analysis that facilitates targeted resilience interventions; dividing feeders into isolatable sections and combining those sections with the critical service access metric allows us to identify where energy improvements like solar-plus-storage microgrids could create the most benefits for community members by protecting access to food, fuel, health, shelter, and public safety services. We identify locations in a South Seattle study area that could be high priorities for resilience investment and summarize their potential neighborhood-scale resilience benefits. This analysis was complemented by direct feedback from study area residents collect through a survey and focus groups. Results can help utilities understand how and where long power outages can create real consequences for customers, set strategic targets based on that understanding, and measure the potential benefits of energy resilience upgrades for more informed decisions.

14 SOLAR ENERGY↗
NASA NTRS2013

Vehicle Integrated Prognostic Reasoner (VIPR) Metric Report

This document outlines a set of metrics for evaluating the diagnostic and prognostic schemes developed for the Vehicle Integrated Prognostic Reasoner (VIPR), a system-level reasoner that encompasses the multiple levels of large, complex systems such as those for aircraft and spacecraft. VIPR health managers are organized hierarchically and operate together to derive diagnostic and prognostic inferences from symptoms and conditions reported by a set of diagnostic and prognostic monitors. For layered reasoners such as VIPR, the overall performance cannot be evaluated by metrics solely directed toward timely detection and accuracy of estimation of the faults in individual components. Among other factors, overall vehicle reasoner performance is governed by the effectiveness of the communication schemes between monitors and reasoners in the architecture, and the ability to propagate and fuse relevant information to make accurate, consistent, and timely predictions at different levels of the reasoner hierarchy. We outline an extended set of diagnostic and prognostics metrics that can be broadly categorized as evaluation measures for diagnostic coverage, prognostic coverage, accuracy of inferences, latency in making inferences, computational cost, and sensitivity to different fault and degradation conditions. We report metrics from Monte Carlo experiments using two variations of an aircraft reference model that supported both flat and hierarchical reasoning.

Cornhill, Dennis↗
DOE OSTI2021

Power System Resilience Metrics Augmentation for Critical Load Prioritization

One of the major goals of new grid operation regimes, such as transactive energy systems (TESs), is to make the power grid more resilient to withstand natural or man-made disasters and potential reliability events, and to continue to serve the maximum number of its customers. But it is a well-known fact to system operators that not all customers are the same. This implies that any discussion of TESs’ impacts on the resilience of the power system should consider the needs of its critical customers (such as the power system operation centers, fire and police stations, and hospitals) over those of other customers. When evaluating the resilience of the system, bonus points must be awarded to any system that could maintain its power supply to critical customers during a disturbance that may cause an outage. This report discusses critical infrastructure (CI) as found in the literature and then categorizes it based on the field to which the operations belong (such as human life/safety-related, operations management, necessary city operation, industrial customers, etc.). Each of these CI categories is further divided into types of critical customers (e.g., the human life/safety-related category has different types of customers like hospitals, fire and police stations, etc.). The entire demand of each of the critical customer types is not categorized as critical load (CL); instead, only a portion of the total load of these critical customers is characterized as critical load. This is done based on the categories of equipment, the function of which is crucial in the operation of the overall facility. CL categorization is performed to provide the ratio of the critical load portion to the overall load , so that it can serve as a parameter in the resilience evaluation of the grid through a metrics-based approach. Such categorization is important as it helps to augment the existing quantifiable resilience metrics with CL categorization. The metrics for a power system need to not only consider how well a system performed during a disturbance event, but also how it reduced strain and supplied power to its CLs. The first step in this process is characterize CLs in the system. After CL characterization, the next step is the inclusion of these loads in the resilience metrics. To that end, in this report weight-based augmentation of resilience metrics is proposed, where certain customers (the ones that are categorized as critical) are assigned higher weights than others. Though an overview of assigning weights to customers is discussed, there is no one-size-fits-all approach for every power system. The decisions made about assigning such weights to customers vary greatly from one operator to another, based on their unique systems and the current and predicted states of critical customers. This decision-making can include the type of disturbance event, which might only affect certain parts of the system. In general, analyzing critical customers before an event helps understand system vulnerabilities. It also helps in planning and conducting operations during the event, evaluating system performance after the event, and supporting better planning for future events. An alternative to the current practices of managing the grid for outages is an innovative TES, which has the potential to provide a platform for including distributed energy resources for managing CLs. This report also describes how TES qualities can help (1) to maintain power supply to critical customers for uninterrupted operations and (2) to restore lost power supply to the critical customers rapidly.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

A review of energy storage for power system resilience: Functions, metrics, and applications

Aging infrastructure, increasing operational complexity, and surging electricity demand from artificial intelligence and electrification are straining the grid and heightening the risks of disruptions, making resilience a critical priority. Energy storage is increasingly deployed to provide critical power supply, fast grid support, and rapid restoration. However, current practice lacks consistent metrics and systematic methodologies to rigorously quantify the resilience benefits of storage. This paper provides a comprehensive review of energy storage in resilience enhancement, focusing on functional roles, quantification metrics, and integration strategies. A structured resilience metrics library is compiled and categorized to encompass both technical and economic performance aspects. Existing methodologies for resilience-oriented storage planning and operations are critically examined. Key technical and practical challenges are identified, and future research directions are outlined to strengthen storage contributions to grid resilience.

Benefit quantification↗
NASA NTRS2013

A Statistical Theory of Bidirectionality

Original concepts related to the quantification and assessment of bidirectionality in strain-gage balances were introduced by Ulbrich in 2012. These concepts are extended here in three ways: 1) the metric originally proposed by Ulbrich is normalized, 2) a categorical variable is introduced in the regression analysis to account for load polarity, and 3) the uncertainty in both normalized and non-normalized bidirectionality metrics is quantified. These extensions are applied to four representative balances to assess the bidirectionality characteristics of each. The paper is tutorial in nature, featuring reviews of certain elements of regression and formal inference. Principal findings are that bidirectionality appears to be a common characteristic of most balance outputs and that unless it is taken into account, it is likely to consume the entire error budget of a typical balance calibration experiment. Data volume and correlation among calibration loads are shown to have a significant impact on the precision with which bidirectionality metrics can be assessed.

DeLoach, Richard↗
DOE OSTI2022

Performance of New Near-Real-Time PERSIANN Product (PDIR-Now) for Atmospheric River Events over the Russian River Basin, California

Most heavy precipitation events and extreme flooding over the U.S. Pacific coast can be linked to prevalent atmospheric river (AR) conditions. Thus, reliable quantitative precipitation estimation with a rich spatiotemporal resolution is vital for water management and early warning systems of flooding and landslides over these regions. At the same time, high-quality near-real-time measurements of AR precipitation remain challenging due to the complex topographic features of land surface and meteorological conditions of the region: specifically, orographic features occlude radar measurements while infrared-based algorithms face challenges, differentiating between both cold brightband (BB) precipitation and the warmer nonbrightband (NBB) precipitation. It should be noted that the latter precipitation is characterized by greater orographic enhancement. In this study, we evaluate the performance of a recently developed near-real-time satellite precipitation algorithm: Precipitation Estimation from Remotely Sensed Information Using Artificial Neural Networks (PERSIANN) Dynamic Infrared–Rain Rate-Now (PDIR-Now). This model is primarily dependent on infrared information from geostationary satellites as input; consequently, PDIR-Now has the advantage of short data latency, 15–60-min delay between observation to precipitation product delivery. The performance of PDIR-Now is analyzed with a focus on AR-related events for cases dominated by NBB and BB precipitation over the Russian River basin. In our investigations, we utilize S-band (3-GHz) precipitation profilers with Joss/Parsivel disdrometer measurements at the Middletown and Santa Rosa stations to classify BB and NBB precipitation events. In general, our analysis shows that PDIR-Now is more skillful in retrieving precipitation rates over both BB and NBB events across the topologically complex study area as compared to PERSIANN-Cloud Classification System (CCS). Also, we discuss the performance of well-known operational near-real-time precipitation products from 2017 to 2019. Conventional categorical and volumetric categorical indices, as well as continuous statistical metrics, are used to show the differences between various high-resolution precipitation products such as Multi-Radar Multi-Sensor (MRMS).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Frequency Event Categorization in Power Distribution Systems Using Micro PMU Measurements

Frequency is an important metric for power stability. To enhance the situational awareness in power distribution systems, this article proposes a data-driven approach that utilizes the data from micro phasor measurement units (μPMU) to categorize frequency events observed in distribution feeders. The proposed approach has three layers, each of which analyzes if a frequency event is propagated from the transmission system, formed inside a distribution feeder or falsely produced by instantaneous frequency (IF) estimation algorithms, respectively. In the first layer, the Granger causality is utilized to compare the causal relations from measurements across different locations to decide if an event is propagated from the transmission side. In the second layer, a trained sparse coding dictionary is utilized to unmix the physical causes of a frequency event. In the third layer, a moving z-score based event-pair detector is applied to identify if a frequency event is algorithm-induced. The proposed approach is tested using the μPMU measurements collected from Lawrence Berkeley National Laboratory (LBNL) and Riverside Public Utility (RPU).

24 POWER TRANSMISSION AND DISTRIBUTION↗