Search NASA⌕ Search

SEARCH · Search NASA

Results for “metric standardization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Prioritizing Off-gas Metrics

Off-gas research within the Material Recovery and Waste Form Development (MRWFD) team is dispersed among four national laboratories and multiple universities and small businesses. Ensuring research is conducted consistently and in a manner conducive to direct comparison is a nontrivial task. The team assembled to realign goals and expectations by identifying distinct R&D phases, prioritizing crucial metrics, and outlining standardized tests specifically associated with Kr, Xe, and I capture.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

The Inspectability Metric: A Formalized System Of Measurement Enabling The Design For Inspection Framework

Nondestructive evaluation (NDE) engineers are often confronted with structural design choices that present challenges to meeting inspection requirements. These challenges, at best, increase the resources needed to design an inspection solution and, at worst, require resource intensive redesign of the structure. If the inspectability of the structure can be determined early in the design cycle, these challenging inspection scenarios can be avoided. The emergence of additive manufacturing has further compounded this problem by enabling the creation of highly optimized structures with no regard to inspection constraints. Design for inspection (DFI) offers a framework to integrate nondestructive evaluation (NDE) into the design process to alleviate the mechanisms that produce uninspectable designs. DFI is the concept of including inspectability in a multi-objective optimization framework so that it can be considered in parallel to other metrics such as mass and manufacturability. This allows rapid evaluation of the trade-off between design metrics to find solutions that meet the inspection needs of a particular material system, structural concept, or vehicle program. To enable DFI, there must be a system by which the inspectability of a structure can be measured. This system must be agile to produce results quickly, it must be versatile to work with the type of incomplete information one would encounter early in the design process (such as lack of inspection requirements), and it must be delivered in a form that is easily understood by designers. To meet this need, this presentation introduces the novel inspectability metric as a system to measure inspectability. The inspectability metric is a standardized, automation friendly procedure that uses simulations to determine inspectability. Along with guidelines to properly process designs and integrate with existing workflows, the inspectability metric provides a suite of simulation tests to interrogate the ability to find defects and the sensitivity to variability. The testing rubric is designed to maximize the coverage of the parameter space while minimizing the number of simulations needed. The inspectability metric has been in development in collaboration with industry partners to ensure compatibility with modern simulation tools and aerospace design workflows. In this study, we will demonstrate how the inspectability metric is able to determine the inspectability of multiple types of structures, including aerospace composites and additively manufactured parts. We will then show how the inspectability score can be plugged into existing design optimization tasks, such as structural sizing algorithms or design for manufacturing (DFM) frameworks.

Design for inspection↗

Bowles-Tatnall Wake Vortex Encounter Hazard Metric

Wake vortex spacing standards constrict the terminal area throughput and impose severe constraints on the overall capacity and efficiency of the National Airspace System. For more than two decades starting in the early 1990s, the National Aeronautics and Space Administration conducted extensive research on characterizing the formation and evolution of aircraft wakes. This multidisciplinary work included comprehensive field experiments (Pruis et al. 2016), flight tests (Vicroy et al. 1998), and wind tunnel tests (Rossow 1994; Chow et al. 1997). Parametric studies using large eddy simulations (Proctor 1998; Proctor et al. 2006) were conducted in order to develop fast-time models for the prediction of wake transport and decay (Ahmad et al. 2016). Substantial effort was spent on the formulation of acceptable vortex hazard metrics (Tatnall 1995; Hinton and Tatnall 1997). Several wake encounter severity metrics have been suggested in the past, which include the wake circulation strength, vortex-induced rolling moment coefficient (Clv), bank angle, and the roll control ratio (Tatnall 1995; Hinton and Tatnall 1997; Van der Geest 2012). The vortex-induced rolling moment coefficient introduced by Bowles and Tatnall (Tatnall 1995; Gloudemans et al. 2016) has been used extensively for risk and safety analysis of newly proposed air traffic management concepts and procedures. The original method of Bowles and Tatnall assumed a constant wing loading (the wing lift-curve slope, CL is constant), which resulted in an overestimation of the vortexinduced rolling moment coefficient. Bowles (2014) suggested a correction to the original method that provides more accurate values of Clv and which is also consistent with the underlying physics of the problem. The overestimation of Clv in the original method can be corrected by assuming an elliptical lift distribution. Figure 1.1 illustrates the correction in Clv achieved by the modified method.

Joel Malissa↗

Analyzing System on A Chip Single Event Upset Responses using Single Event Upset Data, Classical Reliability Models, and Space Environment Data

We are investigating the application of classical reliability performance metrics combined with standard single event upset (SEU) analysis data. We expect to relate SEU behavior to system performance requirements. Our proposed methodology will provide better prediction of SEU responses in harsh radiation environments with confidence metrics. single event upset (SEU), single event effect (SEE), field programmable gate array devises (FPGAs)

single event effect (SEE)↗

A comparative survey of current and proposed tropospheric refraction-delay models for DSN radio metric data calibration

The standard tropospheric calibration model implemented in the operational Orbit Determination Program is the seasonal model developed by C. C. Chao in the early 1970's. The seasonal model has seen only slight modification since its release, particularly in the format and content of the zenith delay calibrations. Chao's most recent standard mapping tables, which are used to project the zenith delay calibrations along the station-to-spacecraft line of sight, have not been modified since they were first published in late 1972. This report focuses principally on proposed upgrades to the zenith delay mapping process, although modeling improvements to the zenith delay calibration process are also discussed. A number of candidate approximation models for the tropospheric mapping are evaluated, including the semi-analytic mapping function of Lanyi, and the semi-empirical mapping functions of Davis, et. al.('CfA-2.2'), of Ifadis (global solution model), of Herring ('MTT'), and of Niell ('NMF'). All of the candidate mapping functions are superior to the Chao standard mapping tables and approximation formulas when evaluated against the current Deep Space Network Mark 3 intercontinental very long baselines interferometry database.

Estefan, J. A.↗

Bootstrapping Process Improvement Metrics: CMMI Level 4 Process Improvement Metrics in a Level 3 World

The measurement techniques for organizations which have achieved the Software Engineering Institutes CMMI Maturity Levels 4 and 5 are well documented. On the other hand, how to effectively measure when an organization is Maturity Level 3 is less well understood, especially when there is no consistency in tool use and there is extensive tailoring of the organizational software processes. Most organizations fail in their attempts to generate, collect, and analyze standard process improvement metrics under these conditions. But at JPL, NASA's prime center for deep space robotic exploration, we have a long history of proving there is always a solution: It just may not be what you expected. In this paper we describe the wide variety of qualitative and quantitative techniques we have been implementing over the last few years, including the various approaches used to communicate the results to both software technical managers and senior managers.

Hihn, Jairus↗

Design for Inspection: A Formalized Approach to Evaluating the Inspectability of Aerospace Structures Early in the Design Process

NDE engineers are often confronted with structural design choices that present challenges to meeting inspection requirements. These challenges at best increase the resources needed to design an inspection solution and, at worst, require resource intensive redesign of the structure. If the inspectability of structure can be determined early in the design cycle, these challenging inspection scenarios can be avoided. Therefore, there exists a need for a resource friendly formalized approach to gauge the inspectability of a structure. This paper proposes the use of a novel inspectability metric to meet this need. The inspectability metric is a standardized, automation friendly procedure that uses simulations to determine inspectability. It provides a suite of simulation tests to interrogate the ability to find defects and the sensitivity to variability. The testing rubric is designed to maximize the coverage of the parameter space while minimizing the number of simulations needed. In this preliminary study, we will demonstrate how the inspectability metric is able to determine the inspectability of a structure as a function of changes in the structure’s design.

Peter Juarez↗

Integrating Formal Methods and Testing 2002

Traditionally, qualitative program verification methodologies and program testing are studied in separate research communities. None of them alone is powerful and practical enough to provide sufficient confidence in ultra-high reliability assessment when used exclusively. Significant advances can be made by accounting not only tho formal verification and program testing. but also the impact of many other standard V&V techniques, in a unified software reliability assessment framework. The first year of this research resulted in the statistical framework that, given the assumptions on the success of the qualitative V&V and QA procedures, significantly reduces the amount of testing needed to confidently assess reliability at so-called high and ultra-high levels (10-4 or higher). The coming years shall address the methodologies to realistically estimate the impacts of various V&V techniques to system reliability and include the impact of operational risk to reliability assessment. Combine formal correctness verification, process and product metrics, and other standard qualitative software assurance methods with statistical testing with the aim of gaining higher confidence in software reliability assessment for high-assurance applications. B) Quantify the impact of these methods on software reliability. C) Demonstrate that accounting for the effectiveness of these methods reduces the number of tests needed to attain certain confidence level. D) Quantify and justify the reliability estimate for systems developed using various methods.

Cukic, Bojan↗

Flux Seasonality Metrics Database: A companion dataset for FLUXNET annual product

This dataset include standardized phenological transition dates, and derived season lengths of active, dormant and transition seasons of ecosystem carbon and energy fluxes, as reported in FLUXNET. Such metrics are unique in that they characterize the seasonal dynamics of these fluxes in their own terms rather than in reference to traditional phenology indicators that mostly relate to vegetation structural characteristics. The Flux Seasonality Metrics Database (FSMD) generated 17 standardized seasonality metrics for 4 different fluxes including gross primary productivity (GPP), ecosystem respiration (RE), latent heat (LE) and sensible heat (H) reported in FLUXNET2015 Dataset for about 200 sites and 1500 site-years of data globally. Each metric is reported as an estimate and a confidence interval, which is a function of data coverage and flux variability. We anticipate that the FSMD will facilitate new model validation exercises, and stimulate new research in global change and Earth science disciplines where land-atmosphere exchange dynamics play a central role.

54 ENVIRONMENTAL SCIENCES↗

Assessing thermal resilience of an assisted living facility during heat waves and cold snaps with power outages

Extreme hot and cold weather events are becoming more frequent, intense, and longer due to climate change. When these events occur coincidentally with power outages, the resulting extreme indoor temperatures pose a severe health hazard for occupants. This study conducted a holistic modeling and analysis of an assisted living facility, where senior residents live, to assess its thermal resilience performance under a six-day heat wave in 2015 and a three-day cold snap in 2021 with power outages. Impacts of 13 energy efficiency measures on thermal resilience and backup power capacity of the facility were evaluated. Three thermal resilience metrics: the SET (standard effective temperature) degree-hours, the Heat Index, and the Hours of Safety, were used and calculated from the EnergyPlus simulation models. Furthermore, major findings are: (1) the facility would suffer from extreme temperatures during the cold and hot events without a power supply, not meeting the passive survivability requirements; (2) most passive envelope measures improve thermal resilience for both hot and cold events, but making the building envelope airtight results in conflicting performance between the hot and cold events; (3) natural ventilation is an effective measure to mitigate summer indoor overheating; and (4) the energy efficiency package can reduce backup power capacity by 19% for the three-day cold snap. It is recommended that building technologies and design strategies be evaluated to consider co-benefits of energy use, thermal resilience, and backup power needs through building energy codes or policies for existing and new buildings, which are transitioning for decarbonization and climate resilience.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Progress on continuum modeling of lithium–sulfur batteries

While lithium–sulfur batteries are a promising next-generation chemistry devices due to their high theoretical energy density, commercialization has been slow due to low coulombic efficiency and poor cycle life. This review explores the ways in which continuum modeling contributes to the understanding of lithium–sulfur (LiS) battery mechanisms and cell-level performance through the lens of micro- and macroscale phenomena. We examine different approaches to modeling important physical phenomena such as reaction mechanisms, cathode microstructure, shuttling, nucleation and precipitation, and transport limitations. This paper also emphasizes the significance and challenge of connecting typical modeling parameters and assumptions to systems-level metrics of a standard state-of-art high performing lithium–sulfur cell. Particularly important, the considerations for high energy density cells and the areas where continuum models can facilitate better collaboration are discussed. Here, we also summarize a few selected works to highlight experimentally-driven modeling, use of electroanalytical techniques, and parameter identification approaches to enable model-based design and advanced battery management systems.

25 ENERGY STORAGE↗

Integrated assessment model diagnostics: key indicators and model evolution

Integrated assessment models (IAMs) form a prime tool in informing climate mitigation strategies. Diagnostic indicators that allow to compare these models can help to describe and explain differences in model projections. This also increases transparency and comparability. Earlier, the IAM community has developed an approach to diagnose models (Kriegler et al., 2015). Here we build on this, by proposing a selected set of well-defined indicators as a community standard, similar to metrics used for other modeling communities such as climate models. These indicators are the relative abatement index (RAI), emission reduction type index (ERT), inertia timescale (IT), fossil fuel reduction (FFR), transformation index (TI) and cost per abatement value (CAV). We apply the approach to 17 IAMs, including both older version as well as their latest versions, as applied in the IPCC 6th Assessment Report (AR6). The study shows that the approach can be easily applied and allows for comparison of model versions in time. The indicators and their trends can often be explained in terms of model characteristics and changes. We show that together, the set of six indicators can provide an useful indication of the main traits of the model and can roughly indicate the general model behavior. The results also show that there is often a considerable spread across the models. Interestingly, the diagnostic values often change for different model versions, but there does not seem to be a distinct trend across the different models.

54 ENVIRONMENTAL SCIENCES↗

A Novel Framework to Quantify Power Grid Resilience

The quantification of an operating power grid’s resilience is highly significant today, given its criticality as an enabler of other infrastructures, complexity, and the threat it faces due to a wide range of detrimental events, from extreme climate to cyber attacks. Currently, there exist no standardized definitions and metrics for measuring the resilience of an operating grid. In this paper, we introduce a novel resilience quantification framework and demonstrate a method to measure the flexibility towards topological/structural changes due to potential failures in the power grid to assess operational resilience. We start with the state estimation data from a large utility and use the graph analysis methods and power flow simulation tools to compute the identified resilience parameters.

Yoginath, Srikanth↗

Trust Model System for the Energy Grid of Things Network Communications

Network communication is crucial in the Energy Grid of Things (EGoT). Without a network connection, the energy grid becomes just a power grid where the energy resources are available to the customer uni-directionally. A mechanism to analyze and optimize the energy usage of the grid can only happen through a medium, a communications network, that enables information exchange between the grid participants and the service provider. Security implementers of EGoT network communication take extraordinary measures to ensure the safety of the energy grid, a critical infrastructure, as well as the safety and privacy of the grid participants. With the dynamic nature of network communication of the EGoT, the information provided by the customer or the service provider can be falsified by a malicious attacker. Therefore, a trust model is necessary to monitor any abnormal activities. This paper describes a distributed trust model system that meets the need of the EGoT. This paper describes methods for evaluating and improving the distributed trust model using standard hypothesis testing metrics such as true positive, false positive, true negative, false negative, equal error rate, and F1 score. Example calculations are shown based on generated sample data.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Time Disciplined Non-PLL Active Synchronization for Grid Forming Inverters

Two major issues facing grid-forming inverters are synchronism and phase reference inaccuracies. Prior literature has addressed these problems with solutions such as disciplining the phase reference using GPS and active synchronization modes but these methods have not yet been integrated together. This paper serves to unite solutions and develop a means for an inverter to remain synchronized and grid-forming without phase reference inaccuracies through a novel time-disciplined active synchronization phase reference. Further, this work expands upon prior literature on active synchronization to include black-start capabilities. Finally, the time disciplined phase reference is evaluated in Simulink as a grid-forming inverter capable of any synchronization circumstance and assessed by key metrics from modern standards.

blackstart↗

Open Call LDRD: Physically Informed Autoencoders for Galactic Redshift Regression

Physical constraints have been suggested to make neural network models more generalizable, act scientifically plausible, and be more data-efficient over unconstrained baselines. In this report, we present preliminary work on evaluating the effects of adding soft physical constraints to computer vision neural networks trained to estimate the conditional density of redshift on input galaxy images for the Sloan Digital Sky Survey. We introduce physically motivated soft constraint terms that are not implemented with differential or integral operators. We frame this work as a simple ablation study where the effect of including soft physical constraints is compared to an unconstrained baseline. We compare networks using standard point estimate metrics for photometric redshift estimation, as well as metrics to evaluate how faithful our conditional density estimate represents the probability over the ensemble of our test dataset. We find no evidence that the implemented soft physical constraints are more effective regularizers than augmentation.

97 MATHEMATICS AND COMPUTING↗

Resilience Metrics for Solar Photovoltaics

This workshop presentation proposes the development of solar photovoltaic (PV) system resilience metrics and a methodology and framework for evaluation of PV resilience metrics. PV resilience metrics are needed to establish a consistent basis for reporting, evaluation, and data collection by industry, evaluate performance of PV systems that have been subject to natural hazards, correlating resilience to system attributes, and predicting resilience for any PV system. PV resilience metrics can guide improved system design, standards, and insurance coverage. Establishing consistent metrics can foster data collection on impacts of natural hazards on PV systems.

14 SOLAR ENERGY↗

Integrating Carbon Capture, Utilization, & Sequestration into Chemical Pulp Mills

The U.S. pulp and paper industry presents a unique and largely untapped opportunity for large- scale carbon dioxide removal (CDR). Unlike most industrial sectors, pulp mills rely heavily on biomass, meaning that much of their carbon emissions originate from atmospheric CO₂ that was recently captured by plants. If this biogenic CO₂ can be captured and permanently stored, pulp mills can be transformed from carbon emitters into net carbon removal facilities. This project was motivated by that opportunity and aimed to develop and evaluate integrated, low-cost strategies for capturing, utilizing, and sequestering CO₂ within existing chemical pulping operations. The scope of this work focused on four complementary innovations designed to integrate seamlessly into kraft pulp mill infrastructure: (1) in situ CO₂ capture within the recovery cycle, (2) oxy-fuel retrofitting of the rotary lime kiln to produce a high-purity CO₂ stream, (3) ex situ CO₂ capture and mineralization using pulp mill residues (dregs, grits, and lime mud), and (4) beneficial reuse of these residues as mineral carbonate fertilizers. The project combined process modeling, laboratory experimentation, life cycle assessment (LCA), and field trials to evaluate the technical feasibility, economic viability, and environmental impact of these approaches. The results demonstrate that pulp mills can serve as effective platforms for carbon removal when equipped with integrated carbon capture systems. Process modeling showed that combining sodium spiking with oxy-fuel calcination significantly enhances CO₂ capture efficiency while reducing costs by up to 31% compared to conventional configurations. Experimental work further revealed that calcination behavior in high-CO₂ environments differs substantially from traditional systems, leading to the development of a new kinetic model that predicts reaction rates under these conditions. This model provides essential design guidance for next-generation decarbonized lime kilns. In parallel, the project demonstrated that alkaline mineral residues generated during pulping operations can be repurposed as a sustainable alternative to agricultural lime. Across a wide range of soils in the southeastern United States, these materials performed equivalently to commercial lime in adjusting soil pH while offering lower greenhouse gas emissions and reduced cost. Field and greenhouse studies confirmed that crop and tree growth responses were comparable, supporting their viability as a drop-in replacement. This co-product pathway provides a practical utilization strategy that offsets costs and improves overall system economics. A major contribution of this project is the first comprehensive life cycle assessment of carbon removal in pulp and paper systems across multiple system boundaries. Results show that retrofitted mills can achieve carbon removal efficiencies ranging from 12% to 92%, depending on how the system is defined. This finding highlights a critical issue in carbon accounting: reported performance is highly sensitive to methodological choices. By explicitly quantifying these differences, this work provides valuable guidance for policymakers, carbon registries, and project developers working to standardize carbon removal metrics. From a commercialization perspective, the technologies investigated in this project are well- aligned with existing industrial infrastructure, minimizing the need for entirely new facilities. 3 DE-EE0009413 Industry engagement throughout the project—including collaboration with pulp and paper companies, equipment manufacturers, and carbon removal developers—has accelerated the transition from research to deployment. Notably, a commercial developer is actively pursuing carbon capture projects at pulp mills in the southeastern United States and has cited this research as a contributing foundation. The emergence of voluntary carbon markets and long-term offtake agreements further strengthens the business case for implementation. The broader public benefits of this work are significant. By enabling large-scale carbon removal using existing industrial systems, this approach offers a near-term pathway to reduce atmospheric CO₂ concentrations while supporting domestic manufacturing and rural economies. The reuse of industrial residues as fertilizers reduces reliance on mined materials, lowers costs for farmers, and decreases environmental impacts associated with conventional lime production. In addition, the project has supported workforce development by training graduate students and researchers in carbon capture technologies, helping to build capacity in a critical area of national interest. In conclusion, this project demonstrates that integrated carbon capture, utilization, and sequestration in pulp mills is both technically feasible and economically promising. By combining process innovation, experimental validation, and systems-level analysis, the work advances the understanding of how biomass-based industries can contribute to climate mitigation. The findings provide a strong foundation for commercial deployment and offer a scalable solution for transforming a major U.S. industry into a source of durable carbon removal.

09 BIOMASS FUELS↗