Search NASA⌕ Search

SEARCH · Search NASA

Results for “METRICS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

An Alternative Time Metric to Modified Tau for Unmanned Aircraft System Detect And Avoid

A new horizontal time metric, Time to Protected Zone, is proposed for use in the Detect and Avoid (DAA) Systems equipped by unmanned aircraft systems (UAS). This time metric has three advantages over the currently adopted time metric, modified tau: it corresponds to a physical event, it is linear with time, and it can be directly used to prioritize intruding aircraft. The protected zone defines an area around the UAS that can be a function of each intruding aircraft's surveillance measurement errors. Even with its advantages, the Time to Protected Zone depends explicitly on encounter geometry and may be more sensitive to surveillance sensor errors than modified tau. To quantify its sensitivity, simulation of 972 encounters using realistic sensor models and a proprietary fusion tracker is performed. Two sensitivity metrics, the probability of time reversal and the average absolute time error, are computed for both the Time to Protected Zone and modified tau. Results show that the sensitivity of the Time to Protected Zone is comparable to that of modified tau if the dimensions of the protected zone are adequately defined.

UAS↗

Real Time Metrics and Analysis of Integrated Arrival, Departure, and Surface Operations

A real time dashboard was developed in order to inform and present users notifications and integrated information regarding airport surface operations. The dashboard is a supplement to capabilities and tools that incorporate arrival, departure, and surface air-traffic operations concepts in a NextGen environment. As trajectory-based departure scheduling and collaborative decision making tools are introduced in order to reduce delays and uncertainties in taxi and climb operations across the National Airspace System, users across a number of roles benefit from a real time system that enables common situational awareness. In addition to shared situational awareness the dashboard offers the ability to compute real time metrics and analysis to inform users about capacity, predictability, and efficiency of the system as a whole. This paper describes the architecture of the real time dashboard as well as an initial set of metrics computed on operational data. The potential impact of the real time dashboard is studied at the site identified for initial deployment and demonstration in 2017; Charlotte-Douglas International Airport. Analysis and metrics computed in real time illustrate the opportunity to provide common situational awareness and inform users of metrics across delay, throughput, taxi time, and airport capacity. In addition, common awareness of delays and the impact of takeoff and departure restrictions stemming from traffic flow management initiatives are explored. The potential of the real time tool to inform the predictability and efficiency of using a trajectory-based departure scheduling system is also discussed.

integrated arrival departure surface operations↗

A New Paradigm for Quality Metrics

SMA metrics have been traditionally represented as either leading and lagging indicators. Traditional ways of viewing these metrics and trending the data is via graphs which reflect one attribute in each graph. The KSC Independent Assessment Team developed a non-traditional method for expressing variation as a ratio (the deviation between the Expected and Actual). This method allows different measures to be plotted on the same graph for trending and comparison to provide a holistic view across a particular theme or discipline. Since all measurements are a ratio of variation and dimensionless, this variation-based metrics approach can be used a new analytical tool which is complimentary to existing value-added metrics tools.

Dimensionless↗

Literature Review of Cumulative Noise Metrics Relevant to X-59 Supersonic Overflights

Upcoming studies with the X-59 aircraft will collect dose-response data to understand community response to en-route supersonic noise. This data collection effort will inform regulators in their efforts to potentially update the ban on commercial supersonic flight with acceptable noise standards. Part of the dataset will consist of end-of-day responses to the noise from multiple supersonic overflights. This document provides rationale from relevant literature surrounding which cumulative noise metric to pair with end-of-day survey responses for upcoming community studies with the X-59 aircraft. Despite its deficiencies, day-night average sound level (DNL) summation of candidate single-event metrics remains the most likely choice for a cumulative noise metric for multiple supersonic overflights because 1) it is widely used for other transportation noise sources and 2) its relevance for infrequent events is somewhat plausible, unlike some recent alternative metrics.

sonic boom↗

Towards Efficient Supercomputing: Searching for the Right Efficiency Metric

The efficiency of supercomputing has traditionally been in the execution time. In early 2000 s, the concept of total cost of ownership was re-introduced, with the introduction of efficiency measure to include aspects such as energy and space. Yet the supercomputing community has never agreed upon a metric that can cover these aspects altogether and also provide a fair basis for comparison. This paper exam- ines the metrics that have been proposed in the past decade, and proposes a vector-valued metric for efficient supercom- puting. Using this metric, the paper presents a study of where the supercomputing industry has been and how it stands today with respect to efficient supercomputing.

99 GENERAL AND MISCELLANEOUS↗

Resilient Control Systems Practical Metrics Basis for Defining Mission Impact

"Resilience” describes how systems operate at an acceptable level of normalcy despite disturbances or threats. In this paper we first consider the cognitive, cyber-physical interdependencies inherent in critical infrastructure systems and how resilience differs from reliability to mitigate these risks. Terminology and metrics basis are provided to integrate the cognitive, cyber-physical aspects that should be considered when defining solutions for resilience. A practical approach is taken to roll this metrics basis up to system integrity and business case metrics that establish “proper operation” and “impact.” A notional chemical processing plant is the use case for demonstrating how the system integrity metrics can be applied to establish performance, and

42 ENGINEERING↗

Making Energy Savings Easier: Usability Metrics for Thermostats

U.S. residential thermostats control approximately 9% of the nation’s energy use. Many building codes now require programmable thermostats (PTs) because of their assumed energy savings. However, several recent field studies have shown no significant savings or even higher energy use in households using PTs compared to those using non-PTs. These studies point to usability problems that lead to incorrect use and wasted energy. However, the lack of clear, consistent metrics has hampered the acceptance of usability concerns by thermostat manufacturers. Thus there is a need for metrics specific to PTs that manufacturers can use to evaluate their products. Here, we report on the results of a usability study conducted on five commercially available PTs and the development of four new metrics suitable for use in evaluating thermostat usability. Our study confirmed usability deficits in the current generation of PTs and showed the metrics are correlated with each other as well as agreeing with the qualitative results of the study.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Resilience Metrics for Building-Level Electrical Distribution Systems with Energy Storage: Preprint

The energy system infrastructure that delivers power to a building's loads needs to be resilient, such that it can withstand and recover from extreme outages (e.g., grid faults that leave millions of people without power during severe weather events). Building-level electrical distribution systems (BEDSs) distribute power from a building's energy sources - including the grid, solar photovoltaic (PV) panels, and batteries - to its loads, including lighting, HVAC, and plug loads. BEDS with storage can provide resilience by distributing local electricity supply to critical loads during an outage. Quantitative metrics are needed to assess the resilience improvements associated with new BEDS and storage system technologies. In this paper, we apply an existing metric, the probability of outage survival curve (POSC), to BEDS with storage and propose a set of novel metrics that improve upon POSC. Through a simulation-based case study, we demonstrate how these metrics are impacted by the BEDS design and how they can be used to design a resilient system.

buildings↗

A Unified Metric for Fast Frequency Response in Low-Inertia Power Systems: Preprint

Future power system with more inverter-based resources (IBRs) is vulnerable to the frequency-decline contingency. Fast frequency response (FFR) provided by IBRs is a good candidate to arrest the frequency excursion. Diverse types of FFRs have been integrated into the power system. Without a unified quantification of FFRs, it is hard for the grid operators to fully leverage the FFR capabilities of IBRs. This work introduces potential unified metrics of prevailing FFRs. We utilized the metric-to-frequency (M2F) mapping to validate the accuracy of the metrics. The results show the proposed metric to be simple yet accurate.

effective inertia↗

Metrics and Benchmarks for Energy Efficiency in Laboratories

A wide spectrum of laboratory owners, ranging from universities to federal agencies, have explicit goals for energy efficiency in their facilities. For example, the Energy Policy Act of 2005 (EPACT 2005) requires all new federal buildings to exceed ASHRAE 90.1-2004 [1] by at least 30%. A new laboratory is much more likely to meet energy efficiency goals if quantitative metrics and targets are specified in programming documents and tracked during the course of the delivery process. If not, any additional capital costs or design time associated with attaining higher efficiencies can be difficult to justify. This article describes key energy efficiency metrics and benchmarks for laboratories, which have been developed and applied to several laboratory buildings--both for design and operation. In addition to traditional whole building energy use metrics (e.g. BTU/ft{sup 2}.yr, kWh/m{sup 2}.yr), the article describes HVAC system metrics (e.g. ventilation W/cfm, W/L.s{sup -1}), which can be used to identify the presence or absence of energy features and opportunities during design and operation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Understanding ERE and iVOC Metrics for Graded CdSeTe Absorbers

PL-based external radiative efficiency (ERE) and implied open-circuit voltage (iVOC) metrics were introduced for thin-film solar absorbers to better understand the voltage deficit and diagnose losses in solar cells. Traditionally, elevated ERE and iVOC measurements are associated with diminished recombination within the solar device, a rationale heavily reliant on the assumption of a uniform bandgap and high carrier mobilities in the absorber. Recently, very low mobilities in CdSeTe absorbers (< 1 cm2/(V.s)) were measured using the light-induced transient grading technique. In this study, we use a detailed numerical model of iVOC to investigate the possible reasons of elevated iVOC in realistic CdSeTe absorbers with a graded Se profile. In particular, we examine how the bandgap nonuniformity and the reduced hole mobility in graded CdSeTe absorbers affect iVOC measurements. We show that high iVOC may result from inflated quasi-Fermi level splitting in the high-Se region in the front part of a CdSeTe absorber with slow hole transport. We reproduce the experimentally reported 360 mV increase in iVOC-VOC gap with reduced doping using a model with sub-1 cm2/(V.s) hole mobility in the high-Se region. Based on our results, we conclude that the iVOC metric (or ERE metric) should not be used as a sole metric of CdSeTe absorber quality. We discuss possible ways to extract useful information from the iVOC-VOC gap by supplementing the front-side illumination measurements with back-side illumination measurements.

14 SOLAR ENERGY↗

Explainable artificial intelligence relates perovskite luminescence images to current-voltage metrics

As the demand for low-cost, high-efficiency solar energy technologies grows, metal halide perovskite (MHP) solar cells have emerged as a promising candidate for next-generation photovoltaics due to their high power conversion efficiencies. However, their poor durability and issues with manufacturing consistency remain significant barriers to commercialization. In this work, we develop deep learning models to support materials characterization and provide insight into features and processes influencing performance. The models are trained using transfer learning of a pretrained model to predict relevant current-voltage (IV) metrics based on different combinations of input electroluminescence (EL) and photoluminescence (PL) images of MHP devices. We examine which image types are most informative in accurately predicting different IV metrics. Additionally, we use explainable artificial intelligence (XAI) techniques to provide insights into specific spatial features in the devices that drive differences in performance. We find that stabilized luminescence images (e.g. those collected after biasing the devices for at least 1 min) are better for predicting metrics of open-circuit voltage (by PL) and short-circuit current (by PL with EL), but that predicting fill factor and overall power output may use the time-evolution of EL images. Based on attribution masks generated by integrated gradients for each device performance metric, we further suggest different loss mechanisms associated with categories of large and small spatial defects. Overall, this case study highlights the potential applicability of XAI methodology for streamlining MHP device analysis and accelerating detailed understanding of the relationships between spatial defects and impacts on performance.

14 SOLAR ENERGY↗

Deep-Learning-Derived Evaluation Metrics Enable Effective Benchmarking of Computational Tools for Phosphopeptide Identification

Tandem mass spectrometry (MS/MS)-based phosphoproteomics is a powerful technology for global phosphorylation analysis. However, applying four computational pipelines to a typical mass spectrometry (MS)-based phosphoproteomic dataset from a human cancer study, we observed a large discrepancy among the reported phosphopeptide identification and phosphosite localization results, underscoring a critical need for benchmarking. While efforts have been made to compare performance of computational pipelines using data from synthetic phosphopeptides, evaluations involving real application data have been largely limited to comparing the numbers of phosphopeptide identifications due to the lack of appropriate evaluation metrics. We investigated three deep learning-derived features as potential evaluation metrics: phosphosite probability, Delta RT and spectral similarity. Predicted phosphosite probability is computed by MusiteDeep, which provides high accuracy as previously reported; Delta RT is defined as the absolute retention time (RT) difference between RTs observed and predicted by AutoRT; and spectral similarity is defined as the Pearson’s correlation coefficient between spectra observed and predicted by pDeep2. Using a synthetic peptide dataset, we found that both Delta RT and spectral similarity provided excellent discrimination between correct and incorrect peptide-spectrum matches (PSMs) both when incorrect PSMs involved wrong peptide sequences and even when incorrect PSMs were caused by only incorrect phosphosite localization. Based on these results, we used all the three deep learning-derived features as evaluation metrics to compare different computational pipelines on diverse set of phosphoproteomic datasets and showed their utility in benchmarking performance of the pipelines. The benchmark metrics demonstrated in this study will enable users to select computational pipelines and parameters for routine analysis of phosphoproteomics data and will offer guidance for developers to improve computational methods.

59 BASIC BIOLOGICAL SCIENCES↗

Review and categorization of existing studies on the estimation of probabilistic failure metrics for Reactor Coolant Pressure Boundary piping and steam generator tubes in Nuclear Power Plants

This article presents the first output of the International Atomic Energy Agency (IAEA) Coordinated Research Project (CRP), titled Methodology for Assessing Pipe Failure Rates in Advanced Water-Cooled Reactors (AWCRs), launched in 2018. This IAEA CRP is aimed at developing a good-practices document for estimating the probabilistic failure metrics of piping in AWCRs. The reliability of piping that comprise the Reactor Coolant Pressure Boundary (RCPB) is important for maintaining safe and stable operations of Nuclear Power Plants (NPPs) because failure of those piping components could lead to undesirable consequences, such as plant shutdown, costly repair, the occurrence of Loss-of-Coolant Accidents (LOCAs) and, possibly, subsequent core damage or large release events. Probabilistic failure metrics (e.g., failure rate, failure frequency, or failure probability) of RCPB components are the key inputs to the Probabilistic Safety/Risk Assessment (PSA/PRA) and risk management of NPPs. The estimation of probabilistic failure metrics, however, is challenging, especially for AWCRs, due to the lack of operating experience. Therefore, as the first step of the IAEA CRP activities, this paper is developed to provide a literature review of the existing studies (from 2000 to April 2019) on the estimation of probabilistic failure metrics for RCPB piping and Steam Generator (SG) tubes of NPPs and to categorize them based on four criteria: (1) explicitness of incorporation of physical failure mechanisms; (2) types of failure characterization; (3) types of physical models for degradation; and (4) explicitness of consideration of maintenance. The existing studies are also analyzed from the viewpoint of the following key aspects: (i) uncertainty analysis, (ii) sensitivity analysis, (iii) validation strategies, and (iv) the areas of applications.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Methods and Challenges in the Determination of Molecular Weight Metrics of Bio-oils

The analyses of thermochemically-derived bio-oil properties and composition are challenging due to the diversity of compounds present and the reactivity of the oils. There are currently a variety of techniques used and no standard method established for the analysis of the molecular weight distribution, weight average molecular weight (Mw) and other molecular weight metrics of bio-oils. This review focuses on the challenges and variation in methodologies employed for the analysis of bio-oils on the basis of molecular weight, particularly by gel permeation chromatography (GPC). GPC is the most practical means for determination of molecular weight metrics of bio-oils but needs to be refined using appropriate standards and/or detectors to ensure consistency and accurate quantification of molecular weight metrics. Future method development for a robust technique with accurate and comparable molecular weight data should focus on GPC with multiple detection methodology on whole bio-oils, verified relative to another technique such as mass spectrometry (MS). MS techniques, such as Fourier transform-ion cyclotron resonance (FT-ICR MS), have also been utilized for the determination of molecular weight distribution of bio-oils and are briefly addressed in this review. Many MS methods can provide extensive characterization and structural speciation of components in bio-oils, and while accurate molecular weight metrics can be obtained with the appropriate use of ionization techniques and optimized parameters to ensure appropriate range of m/z and signals representative of abundance, MS is not a robust or an economically practical method for routine molecular weight analyses. Physical separation techniques such as preparative scale GPC, distillation, and liquid-liquid extraction methods are also briefly addressed in this review in the context of molecular weight analyses.

09 BIOMASS FUELS↗

Earth Mover’s Distance as a Metric to Evaluate the Extent of Charge Transfer in Excitations Using Discretized Real-Space Densities

This paper presents a novel theoretical measure, μ EMD , based on the earth mover's distance (EMD), for quantifying the density shift caused by electronic excitations in molecules. As input, the EMD metric uses only the discretized ground- and excited-state electron densities in real space, rendering it compatible with almost all electronic structure methods used to calculate excited states. The EMD metric is compared against other popular theoretical metrics for describing the extent of electron-hole separation in a wide range of excited states (valence, Rydberg, charge transfer, etc.). Further, the results showcase the EMD metric's effectiveness across all excitation types and suggest that it is useful as an additional tool to characterize electronic excitations. The study also reveals that μ EMD can function as a promising diagnostic tool for predicting the failure of pure exchange-correlation functionals. Specifically, we show statistical relationships among the functional-driven errors, the exact exchange content within the functional, and the magnitude of μ EMD values.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Assessing Radiative Feedbacks and Their Contribution to the Arctic Amplification Measured by Various Metrics

Arctic amplification (AA), characterized by a more rapid surface air temperature (SAT) warming in the Arctic than the global average, is a major feature of global climate warming. Various metrics have been used to quantify AA based on SAT anomalies, trends, or variability, and they can yield quite different conclusions regarding the magnitude and temporal patterns of AA. This study examines and compares various AA metrics for their temporal consistency in the region north of 70°N from the early twentieth to the early 21st century using observational data and reanalysis products. We also quantify contributions of different radiative feedback mechanisms to AA based on short-term climate variability in reanalysis and model data using the Kernel-Gregory approach. Albedo and lapse rate feedbacks are positive and comparable, with albedo feedback being the leading contributor for all AA metrics. The net cloud feedback, which has large uncertainties, depends strongly on the data sets and AA metrics used. By quantifying the influence of internal variability on AA and related feedbacks based on global climate model ensemble simulations, we find that water vapor and cloud feedbacks are most heavily affected by internal variability.

54 ENVIRONMENTAL SCIENCES↗

The efficacy of Lewis affinity scale metrics to represent solvent interactions with reagent salts in all-inorganic metal halide perovskite solutions

Solvents employed in the solution processing of metal halide perovskites are known to play a key role in defining the morphology and properties of the resulting thin film, and thus the performance of perovskite solar cell devices. Accurate metrics are needed that are capable of differentiating among candidates, finding solvents that adequately solubilize the various precursor species in solution and facilitate the nucleation and growth of these materials. Existing metrics such as the unsaturated Mayer bond order (UMBO) and the Gutmann donor number (DN) have been tested for lead iodide perovskite systems; but there has yet to be a comprehensive study on their transferability to lead-free perovskite solutions. Here, we use ab initio methods (density functional theory) and regression analysis tools to study the usefulness of DN and BF 3 affinity scales in this regard. We compared the relative effectiveness of these scales to describe interactions between solvents and BXn perovskite salts of lead (Pb 2+ ), tin (Sn 2+ and Sn 4+ ), germanium (Ge 2+ ), bismuth (Bi 3+ ), and antimony (Sb 3+ and Sb 5+ ). The DN proved to be a better representation than the BF 3 of such interactions, reflecting the closer similarity of these species to the “parent” SbCl 5 Lewis acid than to BF 3 . In addition, we have uncovered the usefulness of the lithium cation affinity metric (LCA) to describe the strength of interactions between solvents and A-site cations (e.g. Na + , K + , Rb + and Cs + ) in all-inorganic metal halide perovskite solutions. We find that the coordination strengths of solvents towards species in all-inorganic metal halide perovskite solutions are best described by two different metrics with distinct modes of action: DN differentiates among BX n salt complexes, and LCA among A-site cation species. This revelation can help guide the choice of solvent to optimize processing conditions. It also emphasizes the importance of selecting solvents whose DN and LCA optimize coordination to key Lewis acid species in all-inorganic perovskite solutions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗