SEARCH · Search NASA

Results for “performance metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

All sources NASA NTRS DOE OSTI

NASA NTRS2009

On Applying the Prognostic Performance Metrics

Prognostics performance evaluation has gained significant attention in the past few years. As prognostics technology matures and more sophisticated methods for prognostic uncertainty management are developed, a standardized methodology for performance evaluation becomes extremely important to guide improvement efforts in a constructive manner. This paper is in continuation of previous efforts where several new evaluation metrics tailored for prognostics were introduced and were shown to effectively evaluate various algorithms as compared to other conventional metrics. Specifically, this paper presents a detailed discussion on how these metrics should be interpreted and used. Several shortcomings identified, while applying these metrics to a variety of real applications, are also summarized along with discussions that attempt to alleviate these problems. Further, these metrics have been enhanced to include the capability of incorporating probability distribution information from prognostic algorithms as opposed to evaluation based on point estimates only. Several methods have been suggested and guidelines have been provided to help choose one method over another based on probability distribution characteristics. These approaches also offer a convenient and intuitive visualization of algorithm performance with respect to some of these new metrics like prognostic horizon and alpha-lambda performance, and also quantify the corresponding performance while incorporating the uncertainty information.

Saxena, Abhinav↗

NASA NTRS2005

Safety and Mission Assurance Performance Metric

The safety and mission assurance (S&MA) performance metric is a method that provides a process through which the managers of a large, complex program can readily understand and assess the accepted risk, the problems, and the associated reliability of the program. Conceived for original use in helping to assure the safety and success of the International Space Station (ISS) program, the S&MA performance metric also can be applied to other large and complex programs and projects. The S&MA-performance-metric data products comprise one or more tables (possibly also one or more graphs) that succinctly display all of the information relevant (and no information that is irrelevant) to management decisions that must be made to assure the safety and success of a program or project, thereby facilitating such decisions.

Holsomback, Jerry↗

DOE OSTI2025

Refining seasonal performance metrics for room air-conditioning in emerging markets: Integrating building simulations with real-world equipment performance data

Buildings significantly impact worldwide energy consumption, emphasizing the need to reduce the cooling energy demand, especially in warm climates. Minimum energy performance standards (MEPS) and seasonal performance metrics such as the Cooling Seasonal Performance Factor (CSPF) are crucial for improving room air conditioning (RAC) efficiency. However, challenges remain, particularly in emerging markets like Brazil, where seasonal performance metrics have recently been introduced. This study assesses the factors influencing country-level seasonal efficiency metrics and proposes a framework to refine these calculations by considering local climates and expected RAC usage in real-world households via building simulations. Key considerations include outdoor air temperature binning for different climates, RAC usage patterns (i.e., daytime and nighttime usages), envelope thermal performance of households, and urban heat island (UHI) effects. The results reveal that CSPF values can vary significantly based on climate conditions, with observed CSPF ranging from 4.10 to 11.59 Wh/Wh across 577 Brazilian climates. The inclusion of UHI effects led to a reduction in CSPF values by up to 29% during nighttime operations in hot urban areas. Additionally, building envelope efficiency showed contrasting impacts on RAC performance, with CSPFs reaching up to 15.35 Wh/Wh under specific optimized conditions. These findings highlight the need for transparent policymaking in RAC performance databases, facilitating the application of approaches like those proposed in this study and supporting diverse stakeholders in decision-making.

Bavaresco, Mateus↗

DOE OSTI2026

Inferring performance metrics for laser direct drive experiments on OMEGA

Quantifying performance improvements on the OMEGA laser facility requires robust inference of established no-alpha performance metrics, which requires, at minimum, a model to infer the shocked fuel mass and pressure of the confined fusion plasma. In this work, we describe the methodology used to infer performance metrics on OMEGA and present the current state-of-the art model used to infer these metrics from OMEGA experiments. In particular, since neutron images of cryogenic implosions are not available on OMEGA at present, we present how x-ray sizes are determined on OMEGA using a Gaussian Process regression model and how the neutron production region's size is inferred from them. As a result, we end by benchmarking the model using synthetic data and 1-D LILAC simulations and test its experimental self-consistency across available x-ray diagnostic channels.

Gopalaswamy, V. [Laboratory for Laser Energetics, ↗

NASA NTRS2006

Orbit design and optimization based on global telecommunication performance metrics

The orbit selection of telecommunications orbiters is one of the critical design processes and should be guided by global telecom performance metrics and mission-specific constraints. In order to aid the orbit selection, we have coupled the Telecom Orbit Analysis and Simulation Tool (TOAST) with genetic optimization algorithms. As a demonstration, we have applied the developed tool to select an optimal orbit for general Mars telecommunications orbiters with the constraint of being a frozen orbit. While a typical optimization goal is to minimize tele-communications down time, several relevant performance metrics are examined: 1) area-weighted average gap time, 2) global maximum of local maximum gap time, 3) global maximum of local minimum gap time. Optimal solutions are found with each of the metrics. Common and different features among the optimal solutions as well as the advantage and disadvantage of each metric are presented. The optimal solutions are compared with several candidate orbits that were considered during the development of Mars Telecommunications Orbiter.

genetic algorithms↗

NASA NTRSDate not supplied

Candidate Performance Metrics for Generalized Control for Autonomous Flight

Contingency management is the most challenging aspect of autonomous flight. In order to accommodate the most flexible response to unpredicted events and unexpected circumstances, i.e. contingencies, a new integrated path planning, trajectory following, flight control architecture is required that would maximize the safe operating envelope. For this highly integrated generalized control architecture, a new set of performance metrics that extends beyond traditional stability and performance is required. This paper proposes a candidate set of new performance metrics relevant to urban air mobility mission scenarios.

Control metrics↗

NASA NTRSDate not supplied

Candidate Performance Metrics for Generalized Control for Autonomous Flight

Control metrics↗

NASA NTRS2011

An Evaluation of Performance Metrics for High Efficiency Tube-and-Wing Aircraft Entering Service in 2030 to 2035

An analysis of basic vehicle characteristics required to meet the Fundamental Aeronautics Program s 70 percent energy consumption reduction goal for commercial airliners in the 2030 to 2035 timeframe was conducted. A total of 29 combinations of vehicle parasitic drag coefficient, vehicle induced drag coefficient, vehicle empty weight and engine Specific Fuel Consumption were used to create sized tube-and-wing vehicle models. The mission fuel burn for each of these sized vehicles was then compared to a baseline current technology vehicle. A response surface equation was generated of fuel burn reduction as a function of the four basic vehicle performance metrics, so that any values of the performance metrics up to a 50 percent reduction could be used to estimate fuel burn reduction of tube-and-wing aircraft for future studies.

Perkins, H. Douglas↗

NASA NTRS1995

Determining GPS average performance metrics

Analytic and semi-analytic methods are used to show that users of the GPS constellation can expect performance variations based on their location. Specifically, performance is shown to be a function of both altitude and latitude. These results stem from the fact that the GPS constellation is itself non-uniform. For example, GPS satellites are over four times as likely to be directly over Tierra del Fuego than over Hawaii or Singapore. Inevitable performance variations due to user location occur for ground, sea, air and space GPS users. These performance variations can be studied in an average relative sense. A semi-analytic tool which symmetrically allocates GPS satellite latitude belt dwell times among longitude points is used to compute average performance metrics. These metrics include average number of GPS vehicles visible, relative average accuracies in the radial, intrack and crosstrack (or radial, north/south, east/west) directions, and relative average PDOP or GDOP. The tool can be quickly changed to incorporate various user antenna obscuration models and various GPS constellation designs. Among other applications, tool results can be used in studies to: predict locations and geometries of best/worst case performance, design GPS constellations, determine optimal user antenna location and understand performance trends among various users.

Moore, G. V.↗

NASA NTRS2003

Approaches to Cycle Analysis and Performance Metrics

The following notes were prepared as part of an American Institute of Aeronautics and Astronautics (AIAA) sponsored short course entitled Air Breathing Pulse Detonation Engine (PDE) Technology. The course was presented in January of 2003, and again in July of 2004 at two different AIAA meetings. It was taught by seven instructors, each of whom provided information on particular areas of PDE research. These notes cover two areas. The first is titled Approaches to Cycle Analysis and Performance Metrics. Here, the various methods of cycle analysis are introduced. These range from algebraic, thermodynamic equations, to single and multi-dimensional Computational Fluid Dynamic (CFD) solutions. Also discussed are the various means by which performance is measured, and how these are applied in a device which is fundamentally unsteady. The second topic covered is titled PDE Hybrid Applications. Here the concept of coupling a PDE to a conventional turbomachinery based engine is explored. Motivation for such a configuration is provided in the form of potential thermodynamic benefits. This is accompanied by a discussion of challenges to the technology.

Parson, Daniel E.↗

NASA NTRS2014

Long Term Performance Metrics of the GD SDR on the SCaN Testbed: The First Year on the ISS

The General Dynamics (GD) S-Band software defined radio (SDR) in the Space Communications and Navigation (SCaN) Testbed on the International Space Station (ISS) provides experimenters an opportunity to develop and demonstrate experimental waveforms in space. The SCaN Testbed was installed on the ISS in August of 2012. After installation, the initial checkout and commissioning phases were completed and experimental operations commenced. One goal of the SCaN Testbed is to collect long term performance metrics for SDRs operating in space in order to demonstrate long term reliability. These metrics include the time the SDR powered on, the time the power amplifier (PA) is powered on, temperature trends, error detection and correction (EDAC) behavior, and waveform operational usage time. This paper describes the performance of the GD SDR over the first year of operations on the ISS.

radio telemetry↗

NASA NTRS2016

Development of an Objective Space Suit Mobility Performance Metric Using Metabolic Cost and Functional Tasks

Existing methods for evaluating EVA suit performance and mobility have historically concentrated on isolated joint range of motion and torque. However, these techniques do little to evaluate how well a suited crewmember can actually perform during an EVA. An alternative method of characterizing suited mobility through measurement of metabolic cost to the wearer has been evaluated at Johnson Space Center over the past several years. The most recent study involved six test subjects completing multiple trials of various functional tasks in each of three different space suits; the results indicated it was often possible to discern between different suit designs on the basis of metabolic cost alone. However, other variables may have an effect on real-world suited performance; namely, completion time of the task, the gravity field in which the task is completed, etc. While previous results have analyzed completion time, metabolic cost, and metabolic cost normalized to system mass individually, it is desirable to develop a single metric comprising these (and potentially other) performance metrics. This paper outlines the background upon which this single-score metric is determined to be feasible, and initial efforts to develop such a metric. Forward work includes variable coefficient determination and verification of the metric through repeated testing.

Norcross, J. R.↗

NASA NTRS2016

Development of an Objective Space Suit Mobility Performance Metric Using Metabolic Cost and Functional Tasks

McFarland, Shane M.↗

NASA NTRS2016

Performance Metrics, Error Modeling, and Uncertainty Quantification

A common set of statistical metrics has been used to summarize the performance of models or measurements- the most widely used ones being bias, mean square error, and linear correlation coefficient. They assume linear, additive, Gaussian errors, and they are interdependent, incomplete, and incapable of directly quantifying uncertainty. The authors demonstrate that these metrics can be directly derived from the parameters of the simple linear error model. Since a correct error model captures the full error information, it is argued that the specification of a parametric error model should be an alternative to the metrics-based approach. The error-modeling methodology is applicable to both linear and nonlinear errors, while the metrics are only meaningful for linear errors. In addition, the error model expresses the error structure more naturally, and directly quantifies uncertainty. This argument is further explained by highlighting the intrinsic connections between the performance metrics, the error model, and the joint distribution between the data and the reference.

Quantification↗

NASA NTRS2023

Benchmark Performance Metrics of a Vane Propellant Management Device for a 0.15 m3 Liquid Hydrogen Tank

The use of cryogenic propellants has and will continue to play an integral role in manned-space exploration due the high specific impulses offered and its ubiquity through in-situ resource utilization. But guaranteeing vapor-free transfer of such low-surface tension liquids is difficult for traditional capillary-action propellant management devices (PMDs). Screen-channel liquid acquisition devices and compliant origami bladders are potential solutions, but to quantify the benefits these technologies offer, this paper present a cast study analyzing the performance metrics of an orthodox vane PMD as a benchmark for comparison. A 0.15 m3 liquid hydrogen tank at 20.3 K and 103 kPa was selected for study. Then assuming no body forces and no heat transfer (for simplicity), a steady-state 1-D differential equation was numerically solved in tandem with four possible wetted area configurations to yield an expulsion efficiency for a theoretically maximum inputted expulsion flow rate. Maximization of the flow rate was constrained by the onset of choked flow. Additional inputs, including vane height and vane number, were parametrically varied between 0.1 – 10 cm and 4 – 28 vanes, respectively.

Liquid Acquisition Device↗

NASA NTRS2006

Characterization of Days Based On Analysis of National Airspace System Performance Metrics

Days of operations in the National Airspace System can be described in term of traffic demand, runway conditions, equipment outages, and surface and enroute weather conditions. These causes manifest themselves in terms of departure delays, arrival delays, enroute delays and traffic flow management delays, Traffic flow management initiatives such as, ground stops, ground delay programs, miles-in-trail restrictions, rerouting and airborne holding are imposed to balance the air traffic demand with respect to the available capacity, In order to maintain operational efficiency of the National Airspace System, the Federal Aviation Administration (FAA) maintains delay sad other statistics in the Air Traffic Operations Network (OPSNET) and the Aviation System Performance Metrics (ASPM) databases. OPSNET data includes reportable delays of fifteen minutes ox more experienced by Instrument Flight Rule (IFR) flights. Numbers of aircraft affected by departure delays, enroute delays, arrival delays and traffic flow delays are recorded in the OPSNET data. ASPM data consist of number of actual departures, number of canceled departures, percentage of on time departures, percentage of on time gate arrivals, taxi-out delays. taxi-in delays, gate delays, arrival delays and block delays. Surface conditions at the major U.S. airports are classified in terms of Instrument Meteorological Condition (IMC) and Visual Meteorological Condition (VMC) as a function of the time of the day in the ASPM data. The main objective of this paper is to use OPSNET and ASPM data to classify the days in the datasets into few distinct groups, where each group is separated from the other groups in terms of a distance metric. The motivations for classifying the days are two-fold, 1) to enable selection of days of traffic with particular operational characteristics for concept evaluation using system-wide simulation systems such as the National Aeronautics and Space Administration's Airspace Concepts Evaluation Tool (ACES) and 2) to enable evaluation of a given day with respect to the characteristics of the classified groups. The first part of the paper is devoted to the analysis of major trends seen in the OPSNET and ASPM data. The second part of the paper is devoted to describing features or measures derived from the OPSNET and ASPM data that are suitable for characterizing days, and the classification algorithm used for grouping the days. Finally, the method for evaluating the characteristics of a given day with respect to the properties of the groups is described.

Chatterji, Gano B.↗

NASA NTRS2018

Comparison of Several Global Mixing Performance Metrics for High-Speed Fuel Injectors

To experimentally assess and compare the mixing performance of high-speed fuel injectors for scramjet engines, quantitative global metrics are needed. The one-dimensional metric most commonly used to assess the degree of mixing completeness at a given downstream station is the mixing efficiency parameter. The experimental determination of the mixing efficiency parameter requires measurement of the spatial distributions of both the fuel mass fraction and the mass flux. Standard in-stream gas sampling techniques can be used to measure the fuel mass fraction distribution, however the mass flux distribution is not easily determined experimentally because it requires the measurement of three independent aerothermodynamic variables in addition to the mixture composition. For this reason, several metrics that can be calculated from the fuel distribution alone are commonly used to assess mixing performance. Because these other metrics do not provide a mass flux-weighted measure of the local degree of mixing completeness, they may not correlate well with the mixing efficiency parameter. Therefore, if the substitute metrics are to be used to compare the mixing performance of candidate fuel injector concepts, it is important to understand their relationships to the mixing efficiency parameter in a representative scramjet combustor flowfield. This work investigates the relationships between the mixing efficiency parameter and several substitute metrics that are able to be measured with the current experimental setup of the Enhanced Injection and Mixing Project at the NASA Langley Research Center for baseline strut and ramp injectors. The results of these comparisons have revealed that it is possible to glean different (i.e., incorrect) conclusions about which injector is the better mixer when the substitute mixing performance metrics are used instead of the mixing efficiency parameter, thereby highlighting the importance of mass flux-weighted mixing performance metrics.

Ground, Cody R.↗

NASA NTRSDate not supplied

Analytical and Experimental Demonstration of an Alternate Mixing Performance Metric for High-Speed Fuel Mixing Studies

To experimentally assess the fuel/air mixing performance of high-speed fuel injectors, one-dimensional metrics that quantify the degree of mixing completeness downstream of the fuel injection location are required. The most accurate assessment of mixing performance is achieved with the mixing efficiency parameter. In order to experimentally determine the mixing efficiency parameter, the spatial distributions of both mass flux and fuel mass fraction must be measured. In-stream gas sampling techniques are commonly used to measure the fuel mass fraction distribution; however, the mass flux distribution is not easily determined because it requires the measurement of three independent aerothermodynamic variables in addition to the gas composition. Therefore, to experimentally determine the mixing efficiency parameter, the spatial distributions of four independent properties must be measured, with each property generally requiring its own unique probe. Because of this difficulty, it is commonly assumed that alternate metrics, which rely solely on the fuel distribution, are good indicators of mixing performance. However, since these alternate metrics do not provide a mass flux-weighted measure of mixing completeness, they can lead to incorrect conclusions being drawn about the mixing performance of the studied fuel injector configuration. Recognizing this shortcoming, this work proposes two new alternate mixing performance metrics that are easier to obtain than the mixing efficiency parameter. The analytical development of the new metrics, as well as their application to relevant CFD and experimental data of high-speed fuel injector configurations, is presented in this work. For two different experiments, the new metrics are shown to provide an excellent representation of the true mass flux-weighted mixing performance, unlike the traditionally-used alternatives. The results presented herein suggest that the new metrics can serve as accurate surrogates for mixing efficiency in future high-speed fuel/air mixing studies.

Cody R Ground↗