Informing Performance Metrics of Advanced I&C Systems for Liquid Fueled Fast Molten Salt Reactors
Not provided.
Nuclear Science & Technology↗
SEARCH · Search NASA
Results for “performance metrics”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
On Applying the Prognostic Performance Metrics
Prognostics performance evaluation has gained significant attention in the past few years. As prognostics technology matures and more sophisticated methods for prognostic uncertainty management are developed, a standardized methodology for performance evaluation becomes extremely important to guide improvement efforts in a constructive manner. This paper is in continuation of previous efforts where several new evaluation metrics tailored for prognostics were introduced and were shown to effectively evaluate various algorithms as compared to other conventional metrics. Specifically, this paper presents a detailed discussion on how these metrics should be interpreted and used. Several shortcomings identified, while applying these metrics to a variety of real applications, are also summarized along with discussions that attempt to alleviate these problems. Further, these metrics have been enhanced to include the capability of incorporating probability distribution information from prognostic algorithms as opposed to evaluation based on point estimates only. Several methods have been suggested and guidelines have been provided to help choose one method over another based on probability distribution characteristics. These approaches also offer a convenient and intuitive visualization of algorithm performance with respect to some of these new metrics like prognostic horizon and alpha-lambda performance, and also quantify the corresponding performance while incorporating the uncertainty information.
Saxena, Abhinav↗
Safety and Mission Assurance Performance Metric
The safety and mission assurance (S&MA) performance metric is a method that provides a process through which the managers of a large, complex program can readily understand and assess the accepted risk, the problems, and the associated reliability of the program. Conceived for original use in helping to assure the safety and success of the International Space Station (ISS) program, the S&MA performance metric also can be applied to other large and complex programs and projects. The S&MA-performance-metric data products comprise one or more tables (possibly also one or more graphs) that succinctly display all of the information relevant (and no information that is irrelevant) to management decisions that must be made to assure the safety and success of a program or project, thereby facilitating such decisions.
Holsomback, Jerry↗
Refining seasonal performance metrics for room air-conditioning in emerging markets: Integrating building simulations with real-world equipment performance data
Buildings significantly impact worldwide energy consumption, emphasizing the need to reduce the cooling energy demand, especially in warm climates. Minimum energy performance standards (MEPS) and seasonal performance metrics such as the Cooling Seasonal Performance Factor (CSPF) are crucial for improving room air conditioning (RAC) efficiency. However, challenges remain, particularly in emerging markets like Brazil, where seasonal performance metrics have recently been introduced. This study assesses the factors influencing country-level seasonal efficiency metrics and proposes a framework to refine these calculations by considering local climates and expected RAC usage in real-world households via building simulations. Key considerations include outdoor air temperature binning for different climates, RAC usage patterns (i.e., daytime and nighttime usages), envelope thermal performance of households, and urban heat island (UHI) effects. The results reveal that CSPF values can vary significantly based on climate conditions, with observed CSPF ranging from 4.10 to 11.59 Wh/Wh across 577 Brazilian climates. The inclusion of UHI effects led to a reduction in CSPF values by up to 29% during nighttime operations in hot urban areas. Additionally, building envelope efficiency showed contrasting impacts on RAC performance, with CSPFs reaching up to 15.35 Wh/Wh under specific optimized conditions. These findings highlight the need for transparent policymaking in RAC performance databases, facilitating the application of approaches like those proposed in this study and supporting diverse stakeholders in decision-making.
Bavaresco, Mateus↗
Inferring performance metrics for laser direct drive experiments on OMEGA
Quantifying performance improvements on the OMEGA laser facility requires robust inference of established no-alpha performance metrics, which requires, at minimum, a model to infer the shocked fuel mass and pressure of the confined fusion plasma. In this work, we describe the methodology used to infer performance metrics on OMEGA and present the current state-of-the art model used to infer these metrics from OMEGA experiments. In particular, since neutron images of cryogenic implosions are not available on OMEGA at present, we present how x-ray sizes are determined on OMEGA using a Gaussian Process regression model and how the neutron production region's size is inferred from them. As a result, we end by benchmarking the model using synthetic data and 1-D LILAC simulations and test its experimental self-consistency across available x-ray diagnostic channels.
Gopalaswamy, V. [Laboratory for Laser Energetics, ↗
The Locus Algorithm IV: Performance metrics of a grid computing system used to create catalogues of optimised pointings
This paper discusses the requirements for and performance metrics of the the Grid Computing system used to implement the Locus Algorithm to identify optimum pointings for differential photometry of 61,662,376 stars and 23,779 quasars. Initial operational tests indicated a need for a software system to analyse the data and a High Performance Computing system to run that software in a scalable manner. Practical assessments of the performance of the software in a serial computing environment were used to provide a benchmark against which the performance metrics of the HPC solution could be compared, as well as to indicate any bottlenecks in performance. These performance metrics indicated a distinct split in the performance dictated more by differences in the input data than by differences in the design of the systems used. This indicates a need for experimental analysis of system performance, and suggests that algorithmic complexity analyses may lead to incorrect or naive conclusions, especially in systems with high data I/O overhead such as grid computing. Further, it implies that systems which reduce or eliminate this bottleneck such as in-memory processing could lead to a substantial increase in performance.
Creaner, Oisín↗
Advanced Performance Metrics and their Application to the Sensitivity Analysis for Model Validation and Calibration
High-quality generator dynamic models are critical to reliable and accurate power systems studies and planning. With the availability of PMUs, measurement-based approach for model validation has gained significant prominence. In this approach, the quality of a model is analyzed by visually comparing measured generator response with the model-based simulated response for large system disturbances. This paper proposes a new set of performance metrics to assess the model validation results to facilitate automation of the model validation process. In the proposed methodology, first, the slow governor response and comparatively faster oscillatory response are separated, and then a separate set of performance metrics is calculated for each of these two components. These proposed metrics quantify the mismatch between the actual and model-based response in a comprehensive manner without missing any information enabling automation of the process. Furthermore, in this paper, we are also proposing that the sensitivity analysis for model calibration be performed with respect to the proposed metrics for the systematic identification of key parameters. In this work, results obtained using both simulated and real-world case-studies validate the effectiveness of the proposed performance metrics for model validation and their application to the sensitivity analysis for model calibration.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Solvent based dissolution–precipitation of waste polyethylene terephthalate: economic and environmental performance metrics
Evaluating six economic and two environmental performance metrics for recycling of waste PET via solvent-based dissolution–precipitation processes.
54 ENVIRONMENTAL SCIENCES↗
FY2020 Fourth Quarter Performance Metric: Evaluate Improvement in Simulations of Mesoscale Convective Systems from New Parameterization Developments in E3SM
Mesoscale convective systems (MCSs) consist of an assembly of cumulonimbus clouds on scales of 100 km or more and produce mesoscale circulations (Houze, 2004, 2018). As the largest form of deep convective storms, MCSs contribute to 30% – 70% of annual and warm season rainfall in the U.S. and in the global tropics (Houze 2018; Stevenson & Schumacher, 2014; Feng et al., 2019; Haberlie & Ashley, 2019). Since MCSs contribute importantly to mean and extreme precipitation in the U.S. and many other regions around the world, understanding how well they are simulated by E3SM may guide future development towards more skillful modeling of convective storms and associated hydrologic impacts. The FY2020 Second Quarter Performance Metric Report documented comparisons of MCSs in the central and eastern U.S. in a high-resolution simulation produced by E3SM v1 at 25 km resolution (Caldwell et al. 2019) with observations. MCSs in the simulation occur less frequently and produce less intense precipitation, resulting in large underestimation of MCS volumetric rain-rate compared to observations. The first and third quarter performance metric report indicated that these model biases in simulating MCSs can be attributed to model limitations in parameterizing convection, clouds, and other related processes, as well as model biases in simulating the MCS large-scale environment. In the current FY2020 Fourth Quarter Performance Metric Report, we evaluate MCSs simulated in E3SM with several new developments in convection parameterizations that are being developed for its next generation. The goal is to summarize what have been improved with the new developments and highlight what need more work in the future.
54 ENVIRONMENTAL SCIENCES↗
Orbit design and optimization based on global telecommunication performance metrics
The orbit selection of telecommunications orbiters is one of the critical design processes and should be guided by global telecom performance metrics and mission-specific constraints. In order to aid the orbit selection, we have coupled the Telecom Orbit Analysis and Simulation Tool (TOAST) with genetic optimization algorithms. As a demonstration, we have applied the developed tool to select an optimal orbit for general Mars telecommunications orbiters with the constraint of being a frozen orbit. While a typical optimization goal is to minimize tele-communications down time, several relevant performance metrics are examined: 1) area-weighted average gap time, 2) global maximum of local maximum gap time, 3) global maximum of local minimum gap time. Optimal solutions are found with each of the metrics. Common and different features among the optimal solutions as well as the advantage and disadvantage of each metric are presented. The optimal solutions are compared with several candidate orbits that were considered during the development of Mars Telecommunications Orbiter.
genetic algorithms↗
Candidate Performance Metrics for Generalized Control for Autonomous Flight
Contingency management is the most challenging aspect of autonomous flight. In order to accommodate the most flexible response to unpredicted events and unexpected circumstances, i.e. contingencies, a new integrated path planning, trajectory following, flight control architecture is required that would maximize the safe operating envelope. For this highly integrated generalized control architecture, a new set of performance metrics that extends beyond traditional stability and performance is required. This paper proposes a candidate set of new performance metrics relevant to urban air mobility mission scenarios.
Control metrics↗
Candidate Performance Metrics for Generalized Control for Autonomous Flight
Contingency management is the most challenging aspect of autonomous flight. In order to accommodate the most flexible response to unpredicted events and unexpected circumstances, i.e. contingencies, a new integrated path planning, trajectory following, flight control architecture is required that would maximize the safe operating envelope. For this highly integrated generalized control architecture, a new set of performance metrics that extends beyond traditional stability and performance is required. This paper proposes a candidate set of new performance metrics relevant to urban air mobility mission scenarios.
Control metrics↗
Human metrics exploration (HCTPM: Human Centered Transportation Performance Metrics)
This is a set of notebooks to support exploring human centered metrics. You can explore the metrics interactively using the Interactive_Metrics juypter notebook.
Weigl, Dustin↗
An Evaluation of Performance Metrics for High Efficiency Tube-and-Wing Aircraft Entering Service in 2030 to 2035
An analysis of basic vehicle characteristics required to meet the Fundamental Aeronautics Program s 70 percent energy consumption reduction goal for commercial airliners in the 2030 to 2035 timeframe was conducted. A total of 29 combinations of vehicle parasitic drag coefficient, vehicle induced drag coefficient, vehicle empty weight and engine Specific Fuel Consumption were used to create sized tube-and-wing vehicle models. The mission fuel burn for each of these sized vehicles was then compared to a baseline current technology vehicle. A response surface equation was generated of fuel burn reduction as a function of the four basic vehicle performance metrics, so that any values of the performance metrics up to a 50 percent reduction could be used to estimate fuel burn reduction of tube-and-wing aircraft for future studies.
Perkins, H. Douglas↗
Performance Metrics to Evaluate Utility Resilience Investments
In 2019, Sandia National Laboratories (Sandia) contracted Synapse Energy Economics (Synapse) to research the integration of community and electric grid resilience investment planning as part of the Designing Resilient Communities (DRC): A Consequence-Based Approach for Grid Investment project. Synapse produced a series of reports to explore the challenges and opportunities in several key areas, including benefit-cost analysis (BCA), performance metrics, microgrids, and regulatory mechanisms. This report focuses on BCA. BCA is an approach that electric utilities, electric utility regulators, and communities can use to evaluate the costs and benefits of a wide range of grid resilience investments in a comprehensive and consistent way. While BCA is regularly applied to some types of grid investments, application of BCA to grid resilience investments is in the early stages of development. Though resilience is increasingly cited in connection with grid investment proposals and plans, the resilience- related costs and benefits of grid resilience investments are typically not fully identified, infrequently quantified, and almost never monetized. Without complete assessments of costs and benefits, regulators can be hesitant to approve some types of grid resilience investments. This report provides the first application of the framework developed in the 2020 National Standard Practice Manual for Benefit-Cost Analysis of Distributed Energy Resources (NSPM for DERs) to grid resilience investments. We provide guidance on next steps for implementation to enable grid resilience investments to receive due consideration. We suggest developing BCA principles and standards for jurisdiction-specific BCA tests. We also recommend identifying the resilience impacts of the investments and quantification of these impacts by establishing utility performance metrics for resilience. Proactive integration of grid resilience investments into existing regulatory processes and practices can increase the capacity of jurisdictions to respond to and recover from the consequences of extreme events. 1 National Energy Screening Project. 2020. National Standard Practice Manual for Benefit-Cost Analysis of Distributed Energy Resources.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Determining GPS average performance metrics
Analytic and semi-analytic methods are used to show that users of the GPS constellation can expect performance variations based on their location. Specifically, performance is shown to be a function of both altitude and latitude. These results stem from the fact that the GPS constellation is itself non-uniform. For example, GPS satellites are over four times as likely to be directly over Tierra del Fuego than over Hawaii or Singapore. Inevitable performance variations due to user location occur for ground, sea, air and space GPS users. These performance variations can be studied in an average relative sense. A semi-analytic tool which symmetrically allocates GPS satellite latitude belt dwell times among longitude points is used to compute average performance metrics. These metrics include average number of GPS vehicles visible, relative average accuracies in the radial, intrack and crosstrack (or radial, north/south, east/west) directions, and relative average PDOP or GDOP. The tool can be quickly changed to incorporate various user antenna obscuration models and various GPS constellation designs. Among other applications, tool results can be used in studies to: predict locations and geometries of best/worst case performance, design GPS constellations, determine optimal user antenna location and understand performance trends among various users.
Moore, G. V.↗
Optimization of key energy and performance metrics for drug product manufacturing
During the development of pharmaceutical manufacturing processes, detailed systems-based analysis and optimization are required to control and regulate critical quality attributes within specific ranges, to maintain product performance. As discussions on carbon footprint, sustainability, and energy efficiency are gaining prominence, the development and utilization of these concepts in pharmaceutical manufacturing are seldom reported, which limits the potential of pharmaceutical industry in maximizing key energy and performance metrics. Based on an integrated modeling and techno-economic analysis framework previously developed by the authors, this study presents the development of a combined sensitivity analysis and optimization approach to minimize energy consumption while maintaining product quality and meeting operational constraints in a pharmaceutical process. The optimal input process conditions identified were validated against experiments and good agreement resulted between simulated and experimental data. Here, the results also allowed for a comparison of the capital and operational costs for batch and continuous manufacturing schemes under nominal and optimized conditions. Using the nominal batch operations as a basis, the optimized batch operation results in a 71.7% reduction of energy consumption, whereas the optimized continuous case results in an energy saving of 83.3%.
59 BASIC BIOLOGICAL SCIENCES↗
Improving energy performance metrics to maximize the benefits of disruptive technologies
Advances in appliance and equipment systems' technologies also cause changes in their technical characteristics that can affect energy consumption and associated greenhouse gas emissions. Energy performance evaluation methods that use testing and metrics can evolve to account for energy consumption contributed from new technological characteristics. However, there is no systematic effort to enable the advancement of test procedures and performance metrics to maximize the energy, climate, and financial benefits of disruptive technologies. Therefore, it is important for countries to regularly update their energy-efficiency policy programs, such as standards and labels, by improving test procedures and metrics to reflect the innovation in emerging technologies as well as to mitigate the risk of deploying obsolete technology. This paper shows how energy performance metrics have been improving in selected appliances and equipment and provides insights to design a systematic effort to improve metrics and test procedures at the speed of ongoing changes in technologies and markets.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗