Search NASA⌕ Search

SEARCH · Search NASA

Results for “metric standardization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

A Guide for Improved Resource Adequacy Assessments in Evolving Power Systems: Institutional and Technical Dimensions

This paper identifies and evaluates issues in traditional resource adequacy (RA) assessment practices, and how adjusting these practices may affect and depend on existing institutional arrangements for planning and procurement. The paper proposes a technical-institutional roadmap that would allow regulators in vertically-integrated jurisdictions and system planners and operators in restructured jurisdictions to revise RA practices across a range of components. First, we compile a critical review of current RA assessment practices based on (1) interviews with RA practitioners and (2) a review of recent technical literature. We find that (i) RA may need to expand beyond capacity adequacy to ensure energy adequacy – relevant for energy-limited resources such as storage – and potentially some form of ancillary service adequacy (e.g. enough ramping-up and ramping-down capability in the system); (ii) chronological hourly simulations for all hours in the year are the current best practice; (iii) metrics and models used do not reflect economic criteria in system operation and loss of load; and (iv) there is a need to improve representation of weather dependencies and weather data. Second, we review planning and RA reports for several private and public entities that plan generation and/or transmission infrastructure in the continental U.S. to look for existing practices involving resilience assessments. We find no systematic treatment of the costs of extreme weather and other hazards, the benefits of resilience, and resilience metrics in planning analyses and no systematic treatment of resilience metrics, methods, and outcomes for resource adequacy purposes. Third, we create a technical framework for probabilistic RA assessment and use it to study how key choices about how to model power system operations affect the values that are obtained for RA metrics. We find that (i) non-economic dispatch schemes that ignore economic objectives can lead to accurate RA assessments when coordinated with detailed operational strategies; (ii) multi-year data is critical to capture a wide variety of system conditions; (iii) not incorporating transmission limits into RA assessment could lead to substantial underestimation of traditional “expected value” RA metrics; and (iv) new RA metrics that capture event-specific shortfall characteristics should be used as supplements to traditional metrics. Finally, we examine RA assessments and use this information to propose a guide of evolving industry standards for resource adequacy assessments in resource planning and transmission planning. We report minimum, best, and frontier practices for temporal resolution of assessments, metrics and targets, weather data, load forecasting, characterization of variable renewable resources, characterization of transmission and market transactions, RA modeling and integration with planning processes, and capacity accreditation.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Multiphysics FISPACT-II and TENDL-2019 simulation: neutron-induced damage metrics

Nuclear interactions can be the source of atomic displacement, irradiation-induced defects and transmutation in structural materials. Such quantities are derived from, or can be correlated to, nuclear kinematic simulations of primary atomic energy distributions spectra and the quantification of the numbers of secondary defects produced per primary as a function of the available recoils, residual and emitted, energies. Recoil kinematics of neutral, residual, gas, proton, alpha particle emissions are now more rigorously treated based on recent, complete and enhanced nuclear data parsed in state-of-the-art processing tools. Defect production metrics are the starting point in the complex problem of correlating and simulating the behaviour of materials under irradiation, as experimental information is rare or scattered. Detailed, segregated primary knock-on-atom metrics are now becoming available as the starting point of further simulation processes of isolated and clustered defects in material lattices. This allows more materials, lattices, neutron incident energy ranges, and irradiation conditions to be explored with sufficient data to adequately cover both standard and novel applications and materials: the broader reactor applications landscape. The damage metrics of of materials are systematically explored under typical but different reactor's type environment. The inventory code FISPACT-II combined with the enhanced nuclear data forms of the TENDL-2019 libraries allow one to not only calculate dpa from mostly scattering events but to also properly predict gas production, nuclear heating and transmutation under the same conditions.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Persistent Classification: Understanding Adversarial Attacks by Studying Decision Boundary Dynamics

ABSTRACT There are a number of hypotheses underlying the existence of adversarial examples for classification problems. These include the high‐dimensionality of the data, the high codimension in the ambient space of the data manifolds of interest, and that the structure of machine learning models may encourage classifiers to develop decision boundaries close to data points. This article proposes a new framework for studying adversarial examples that does not depend directly on the distance to the decision boundary. Similarly to the smoothed classifier literature, we define a (natural or adversarial) data point to be ( γ , σ)‐stable if the probability of the same classification is at least for points sampled in a Gaussian neighborhood of the point with a given standard deviation . We focus on studying the differences between persistence metrics along interpolants of natural and adversarial points. We show that adversarial examples have significantly lower persistence than natural examples for large neural networks in the context of the MNIST and ImageNet datasets. We connect this lack of persistence with decision boundary geometry by measuring angles of interpolants with respect to decision boundaries. Finally, we connect this approach with robustness by developing a manifold alignment gradient metric and demonstrating the increase in robustness that can be achieved when training with the addition of this metric.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multilevel Graph Partitioning for Three-Dimensional Discrete Fracture Network Flow Simulations

We present a topology-based method for mesh-partitioning in three-dimensional discrete fracture network (DFN) simulations that takes advantage of the intrinsic multi-level nature of a DFN. DFN models are used to simulate flow and transport through low-permeability fractured media in the subsurface by explicitly representing fractures as discrete entities. The governing equations for flow and transport are numerically integrated on computational meshes generated on the interconnected fracture networks. Modern high-fidelity DFN simulations require high-performance computing on multiple processors where performance and scalability depends partially on obtaining a high-quality partition of the mesh to balance work-loads and minimize communication across all processors. The discrete structure of a DFN naturally lends itself to various graph representations, which can be thought of as coarse-scale representations of the computational mesh. Using this concept, we develop two applications of the multilevel graph partitioning algorithm to partition the mesh of a DFN. In the first, we project a partition of the graph based on the DFN topology onto the mesh of the DFN and in the second, this DFN-based projection is used as the initial condition for further partitioning refinement of the mesh. We compare the performance of these methods with standard multi-level graph partitioning using graph-based metrics (cut, imbalance, partitioning time), computational-based metrics (FLOPS, iterations, solver time), and total run time. The DFN-based and the mesh-based partitioning methods are comparable in terms of the graph-based metrics, but the time required to obtain the partition is several orders of magnitude faster using the DFN-based partitions. The computation-based metrics show comparable performance between both methods so, in combination, the DFN-based partitions are several orders of magnitude faster than the mesh-based partition. Furthermore, the method which uses the DFN-partition solution as the initial condition of the mesh partition provided cut and imbalance values that were close to the mesh-based partition but in a fraction of the time. In turn, this hybrid method outperformed both of the other methods in terms of the total run time.

58 GEOSCIENCES↗

Trade can buffer climate-induced risks and volatilities in crop supply

Climate change is intensifying the frequency and severity of extreme events, posing challenges to food security. Corn, a staple crop for billions, is particularly vulnerable to heat stress, a primary driver of yield variability. While many studies have examined climate impact on average corn yields, little attention has been given to the climate impact on production volatility. This study investigates the future volatility and risks associated with global corn supply under climate change, evaluating the potential benefits of two key adaptation strategies: irrigation and market integration. A statistical model is employed to estimate corn yield response to heat stress and utilize NEX-GDDP-CMIP6 climate data to project future production volatility and risks of substantial yield losses. Three metrics are introduced to quantify these risks: Sigma (σ), the standard deviation of year-on-year yield change, which reflects overall yield volatility; Rho (ρ), the risk of substantial loss, defined as the probability of yield falling below a critical threshold; and Beta (β), a relative risk coefficient that captures the volatility of a region's corn production compared to the globally integrated market. The analysis reveals a concerning trend of increasing year-on-year yield volatility (σ) across most regions and climate models. This volatility increase is significant for key corn-producing regions like Brazil and the United States. While irrigated corn production exhibits a smaller rise in volatility, suggesting irrigation as a potential buffer against climate change impacts, it is not a sustainable option as it can cause groundwater depletion. On the other hand, global market integration reduces overall volatility and market risks significantly with less sustainability concerns. Furthermore, these findings highlight the importance of a multidimensional approach to adaptation in the food sector. While irrigation can benefit individual farmers, promoting global market integration offers a broader solution for fostering resilience and sustainability across the entire food system.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

JetNet: A Python package for accessing open datasets and benchmarking machine learning methods in high energy physics

JetNet is a Python package that aims to increase accessibility and reproducibility for machinelearning (ML) research in high energy physics (HEP), primarily related to particle jets. Basedon the popular PyTorch ML framework, it provides easy-to-access and standardized interfacesfor multiple heterogeneous HEP datasets and implementations of evaluation metrics, lossfunctions, and more general utilities relevant to HEP.

97 MATHEMATICS AND COMPUTING↗

5G-TSN Architecture Capable of Providing Real-time Situational Awareness to Fossil-Energy (FE) Generation Systems (Final Technical Report)

This final report highlights the comprehensive achievements of the project focused on developing and validating a 5G-Time Sensitive Networking (TSN) architecture tailored for real-time operational awareness in fossil energy systems. The initiative successfully advanced through a series of technical milestones, including the integration of EMI-aware network models, deployment of advanced simulation frameworks, and real-world performance characterization at key sites such as UTEP and Fabens. Through the strategic use of NetSim® software, the team created and validated network configurations for wired and wireless environments, tested under varying congestion conditions, and verified network slicing implementations for URLLC-specific applications. Major accomplishments include the migration of simulation tools to the latest NetSim® version to support accurate modeling of TSN and network slicing, extensive EMI measurement campaigns, and the development of a robust simulation model for end-to-end SCADA system integration. Simulations compared both TDD and FDD duplexing modes, revealing insights into their performance under congested conditions. The wireless network was benchmarked for throughput, jitter, and delay metrics, aligning with 3GPP Release 15/16 and IEEE 802.1-TSN standards. A peer-reviewed conference paper was accepted and published, contributing to the broader academic and industrial discourse on 5G-TSN integration in energy systems, in addition to a journal article. Despite minor delays due to software limitations, the project achieved its objectives and delivered validated architecture ready for deployment in advanced energy network environments.

01 COAL, LIGNITE, AND PEAT↗

Spanwise loading distribution and wake velocity surveys of a semi-span wing

The spanwise distribution of bound circulation on a semi-span wing and the flow velocities in its wake were measured in a wind tunnel. Particular attention was given to documenting the flow velocities in and around the development tip vortex. A two-component laser velocimeter was used to make the velocity measurements. The spanwise distribution of bound circulation, three components of the time-averaged velocities throughout the near wake their standard deviations, and the integrated forces and moments on a metric tip as measured by an internal strain gage balance are presented without discussion.

Felker, F. F., III↗

Performance analysis of LAN bridges and routers

Bridges and routers are used to interconnect Local Area Networks (LANs). The performance of these devices is important since they can become bottlenecks in large multi-segment networks. Performance metrics and test methodology for bridges and routers were not standardized. Performance data reported by vendors is not applicable to the actual scenarios encountered in an operational network. However, vendor-provided data can be used to calibrate models of bridges and routers that, along with other models, yield performance data for a network. Several tools are available for modeling bridges and routers - Network II.5 was used. The results of the analysis of some bridges and routers are presented.

Hajare, Ankur R.↗

2024 Standard Scenarios: A U.S. Electricity Sector Outlook

This data corresponds to the 2024 Standard Scenarios report, which contains a suite of forward-looking scenarios of the possible evolution of the U.S. electricity sector through 2050. These files contain modeled projections of the future. Although we strive to capture relevant phenomena as comprehensively as possible, the models used to create this data are unavoidably imperfect, and the future is highly uncertain. Consequentially, this data should not be the sole basis for making decisions. In addition to drawing from multiple scenarios within this set, we encourage analysts to also draw on projections from other sources, to benefit from diverse analytical frameworks and perspectives when forming their conclusions about the future of the power sector. For further discussions about the limitations of the models underlying this data, see section 1.4 of the "ReEDS Documentation" linked below. For scenario descriptions, input assumptions, and metric definitions for the data in these files, see the "2024 Standard Scenarios Report" linked below.

2050↗

BOPTest As a Platform for Building Controls and Grid-Interactive Buildings Workforce Training

Building automation and controls are becoming increasingly complex with the emergence of Grid Integrated Efficient Buildings (GEBs) as well as new highly efficient sequences of operation and data-driven control schemes. However, there remains a significant gap in hands-on training opportunities for building operators and technicians to gain practical experience with advanced control systems in a low-risk environment. This paper presents BOPTEST (Building Optimization Performance Test) as a suitable platform for workforce training in building controls and GEB technologies. BOPTEST provides a suite of standardized building simulation test cases with a REST API, real-time control interfaces through BACnet, semantic models connecting users to building data, and built-in calculation of control metrics and performance indicators. The platform enables trainees to interact with virtual buildings using industry-standard protocols while learning how to implement and innovate control strategies. The training platform is designed to offer a structured and interactive learning experience for building engineers, helping them effectively develop, learn, and retain skills in fault identification, troubleshooting, and correction. The workflow is divided into three main phases: 1) Setup, 2) Exercise, and 3) Review, each comprising specific activities performed by either the instructor or the student. Initial pilot training sessions have yielded positive feedback from instructors and participants and demonstrates that BOPTEST effectively fills an industry need for a low-risk training resource via simulation of real building control systems, allowing trainees to gain practical experience before working in the field. The platform's ability to provide immediate performance feedback while maintaining familiar industry interfaces makes it particularly suitable for workforce development programs. This work provides a replicable model for leveraging building simulation in control education and training.

Paul, Lazlo↗

BOPTEST as a Platform for Building Controls and Grid-Interactive Buildings Workforce Training

Building automation and controls are becoming increasingly complex with the emergence of Grid Integrated Efficient Buildings (GEBs) as well as new highly efficient sequences of operation and data-driven control schemes. However, there remains a significant gap in hands-on training opportunities for building operators and technicians to gain practical experience with advanced control systems in a low-risk environment. This paper presents BOPTEST (Building Optimization Performance Test) as a suitable platform for workforce training in building controls and GEB technologies. BOPTEST provides a suite of standardized building simulation test cases with a REST API, real-time control interfaces through BACnet, semantic models connecting users to building data, and built-in calculation of control metrics and performance indicators. The platform enables trainees to interact with virtual buildings using industry-standard protocols while learning how to implement and innovate control strategies. The training platform is designed to offer a structured and interactive learning experience for building engineers, helping them effectively develop, learn, and retain skills in fault identification, troubleshooting, and correction. The workflow is divided into three main phases: 1) Setup, 2) Exercise, and 3) Review, each comprising specific activities performed by either the instructor or the student. Initial pilot training sessions have yielded positive feedback from instructors and participants and demonstrates that BOPTEST effectively fills an industry need for a low-risk training resource via simulation of real building control systems, allowing trainees to gain practical experience before working in the field. The platform's ability to provide immediate performance feedback while maintaining familiar industry interfaces makes it particularly suitable for workforce development programs. This work provides a replicable model for leveraging building simulation in control education and training.

Paul, Lazlo↗

Molecular Weight Distribution Analysis of Pyrolysis Oils by Gel Permeation Chromatography

Comprehensive analysis of the molecular weight distribution of raw and catalytic fast pyrolysis oils derived from biomass remains a key technical hurdle to understanding oil quality as it relates to downstream use and multiple methods may be necessary to accurately represent all components present. Here, we report the molecular weight distribution metrics of fast pyrolysis (FP) and catalytic fast pyrolysis (CFP) oils as determined by gel permeation chromatography (GPC) combined with UV-diode array (UV), differential refractive index (RI), and multi-angle laser light scattering (MALS) detection. The measured molar mass distributions revealed that FP oil consisted of a higher proportion of larger products relative to the low molecular weight products contained in the CFP oil. GPC/RI and UV methods showed FP oil to have higher weight-average molecular weight (Mw) and number-average molecular weight (Mn) than CFP oil based on elution time. However, GPC/MALS, determined the two oils to have similar overall molecular weight distribution metrics (Mw and Mn) and yielded values significantly higher than those determined by RI and UV detectors relative to external standards. Overall, the use of a multiple detection GPC method could enable a more accurate comparison and determination of true molecular weight metrics of bio-oils.

BIOMASS FUELS↗

Improving Climate Projections Using "Intelligent" Ensembles

Recent changes in the climate system have led to growing concern, especially in communities which are highly vulnerable to resource shortages and weather extremes. There is an urgent need for better climate information to develop solutions and strategies for adapting to a changing climate. Climate models provide excellent tools for studying the current state of climate and making future projections. However, these models are subject to biases created by structural uncertainties. Performance metrics-or the systematic determination of model biases-succinctly quantify aspects of climate model behavior. Efforts to standardize climate model experiments and collect simulation data-such as the Coupled Model Intercomparison Project (CMIP)-provide the means to directly compare and assess model performance. Performance metrics have been used to show that some models reproduce present-day climate better than others. Simulation data from multiple models are often used to add value to projections by creating a consensus projection from the model ensemble, in which each model is given an equal weight. It has been shown that the ensemble mean generally outperforms any single model. It is possible to use unequal weights to produce ensemble means, in which models are weighted based on performance (called "intelligent" ensembles). Can performance metrics be used to improve climate projections? Previous work introduced a framework for comparing the utility of model performance metrics, showing that the best metrics are related to the variance of top-of-atmosphere outgoing longwave radiation. These metrics improve present-day climate simulations of Earth's energy budget using the "intelligent" ensemble method. The current project identifies several approaches for testing whether performance metrics can be applied to future simulations to create "intelligent" ensemble-mean climate projections. It is shown that certain performance metrics test key climate processes in the models, and that these metrics can be used to evaluate model quality in both current and future climate states. This information will be used to produce new consensus projections and provide communities with improved climate projections for urgent decision-making.

Baker, Noel C.↗

Improving Climate Projections Using "Intelligent" Ensembles

Recent changes in the climate system have led to growing concern, especially in communities which are highly vulnerable to resource shortages and weather extremes. There is an urgent need for better climate information to develop solutions and strategies for adapting to a changing climate. Climate models provide excellent tools for studying the current state of climate and making future projections. However, these models are subject to biases created by structural uncertainties. Performance metrics-or the systematic determination of model biases-succinctly quantify aspects of climate model behavior. Efforts to standardize climate model experiments and collect simulation data-such as the Coupled Model Intercomparison Project (CMIP)-provide the means to directly compare and assess model performance. Performance metrics have been used to show that some models reproduce present-day climate better than others. Simulation data from multiple models are often used to add value to projections by creating a consensus projection from the model ensemble, in which each model is given an equal weight. It has been shown that the ensemble mean generally outperforms any single model. It is possible to use unequal weights to produce ensemble means, in which models are weighted based on performance (called "intelligent" ensembles). Can performance metrics be used to improve climate projections? Previous work introduced a framework for comparing the utility of model performance metrics, showing that the best metrics are related to the variance of top-of-atmosphere outgoing longwave radiation. These metrics improve present-day climate simulations of Earth's energy budget using the "intelligent" ensemble method. The current project identifies several approaches for testing whether performance metrics can be applied to future simulations to create "intelligent" ensemble-mean climate projections. It is shown that certain performance metrics test key climate processes in the models, and that these metrics can be used to evaluate model quality in both current and future climate states. This information will be used to produce new consensus projections and provide communities with improved climate projections for urgent decision-making.

Baker, Noel C.↗

Quantifying Quantum Chaos through Microcanonical Distributions of Entanglement

A characteristic feature of “quantum chaotic” systems is that their eigenspectra and eigenstates display universal statistical properties described by random matrix theory (RMT). However, eigenstates of local systems also encode structure beyond RMT. To capture this feature, we introduce a framework that allows us to compare the properties of eigenstates in local systems with those of pure random states. In particular, our framework defines a notion of distance between quantum state ensembles that utilizes the Kullback-Leibler divergence to compare the microcanonical distribution of entanglement entropy (EE) of eigenstates with a reference RMT distribution generated by pure random states (with appropriate constraints). This notion gives rise to a quantitative metric for quantum chaos that not only accounts for averages of the distributions but also higher moments. The differences in moments are compared on a highly resolved scale set by the standard deviation of the RMT distribution, which is exponentially small in system size. As a result, the metric can distinguish between chaotic and integrable behaviors and, in addition, quantify and compare the of chaos (in terms of proximity to RMT behavior) between two systems that are assumed to be chaotic. We implement our framework in local, minimally structured, Floquet random circuits, as well as a canonical family of many-body Hamiltonians, the mixed-field Ising model (MFIM). Importantly, for Hamiltonian systems, we find that the reference random distribution must be appropriately constrained to incorporate the effect of energy conservation in order to describe the ensemble properties of midspectrum eigenstates. The metric captures deviations from RMT across all models and parameters, including those that have been previously identified as strongly chaotic, and for which other diagnostics of chaos such as level spacing statistics look strongly thermal. In Floquet circuits, the dominant source of deviations is the second moment of the distribution, and this persists for all system sizes. For the MFIM, we find significant variation of the KL divergence in parameter space. Notably, we find a small region where deviations from RMT are minimized, suggesting that “maximally chaotic” Hamiltonians may exist in fine-tuned pockets of parameter space. Published by the American Physical Society 2024

Physics↗

Characterizing peak electricity demand for U.S. households: an assessment of end-use loads and demand factors

Understanding household peak electricity demand is critical to evaluate the technical need for electrical infrastructure upgrades. This study characterizes peak loads for existing and new equipment using metered data from a convenience sample of 11,940 U.S. dwellings from four sources, including 911 from two sources with end-use metering. After standardized data cleaning and labeling, we derived descriptive statistics for key metrics, such as maximum demand and demand factors, and developed predictive models relating 60- to 15-min demand for the National Electrical Code (NEC). Mean 15-min maximum demand was 9.7 kW (median 9.0 kW; IQR 7.0–11.5 kW, 95% CI 9.6–9.8 kW), indicating spare capacity in 98% of homes with hypothetical 100 A panels. Maximum demand increased with floor area and number of high-demand loads. Dwelling maximum demand was driven by higher-power, longer-duration heating appliances and vehicle charging, while most user-operated appliances contributed little. Demand factors are used to account for how most devices contribute less than their rated power to maximum demand. Existing load mean demand factors (28%; median 10%; IQR 0–58%; CI 28–29%) were higher than those for new loads (21%; median 7%; IQR 0–35%; CI 20–21%), because new loads changed the timing and magnitude of maximum demand. New high-demand loads had higher than average demand factors (40–60%). Whole dwelling demand factors support the NEC's 40% assumption, but they challenge its conservative 100% treatment of new HVAC. We propose a data-driven 50% demand factor for new equipment, which would align with metered data, improve affordability, and modernize electrical codes.

Appliances↗

NASA Occupant Protection Standards Development

Current National Aeronautics and Space Administration (NASA) occupant protection standards and requirements are based on extrapolations of biodynamic models, which were based on human tests performed under pre-Space Shuttle human flight programs where the occupants were in different suit and seat configurations than is expected for the Multi Purpose Crew Vehicle (MPCV) and Commercial Crew programs. As a result, there is limited statistical validity to the occupant protection standards. Furthermore, the current standards and requirements have not been validated in relevant spaceflight suit, seat configurations or loading conditions. The objectives of this study were to develop new standards and requirements for occupant protection and rigorously validate these new standards with sub-injurious human testing. To accomplish these objectives we began by determining which critical injuries NASA would like to protect for. We then defined the anthropomorphic test device (ATD) and the associated injury metrics of interest. Finally, we conducted a literature review of available data for the Test Device for Human Occupant Restraint New Technology (THOR-NT) ATD to determine injury assessment reference values (IARV) to serve as a baseline for further development. To better understand NASA s environment, we propose conducting sub-injurious human testing in spaceflight seat and suit configurations with spaceflight dynamic loads, with a sufficiently high number of subjects to validate no injury during nominal landing loads. In addition to validate nominal loads, the THOR-NT ATD will be tested in the same conditions as the human volunteers, allowing correlation between human and ATD responses covering the Orion nominal landing environment and commercial vehicle expected nominal environments. All testing will be conducted without the suit and with the suit to ascertain the contribution of the suit to human and ATD responses. In addition to the testing campaign proposed, additional data analysis is proposed to mine existing human injury and response data from other sources, including military volunteer testing, automotive Crash Injury Research Engineering Network (CIREN), and IndyCar impact and injury data. These data sources can allow a better extrapolation of the ATD responses to off-nominal conditions above the nominal range that can safely be tested. These elements will be used to develop injury risk functions for each of the injury metrics measured from the ATD. These risk functions would serve as the basis for the NASA standards. Finally, we propose defining standard test methodology for evaluating future spacecraft designs against the IARVs, including developing a star-rating system to allow crew safety comparisons between vehicles.

Somers, Jeffrey T.↗