Search NASA⌕ Search

SEARCH · Search NASA

Results for “Testing metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS1980

Development of a metric half-span model for interference free testing

A metric half-span model has been developed which allows measurement of aerodynamic forces and moments without support interference or model distortion. This is accomplished by combining the best features of the conventional sting/balance and half-span splitter plate supports, For example, forces and moments are measured on one-half of a symmetrical model which is mechanically supported by a sting on the nonmetric half. Tests were performed in the Langley Unitary Plan wind tunnel over a Mach range of 1.60 to 2.70 and an angle-of-attack range of 04 deg to 20 deg. Preliminary results on concept evaluation, and effect of fuselage modification to house a conventional balance and sting are presented.

Corlett, W. A.↗
DOE OSTI2025

Recrystallization driven softening and heating rate dependencies of FeCrAl nuclear fuel cladding during accident transients

A refined understanding of FeCrAl cladding behavior during rapid transients is critical for its potential deployment in light-water reactors. Current assessments focus on transient burst testing metrics such as balloon geometry, burst temperature, and hoop stress, often used as proxies for simpler conventional tensile properties. However, directly correlating isothermal tensile and creep data with accident transient scenarios remains a challenge, although it is essential for high fidelity model development. Recent modeling based on tensile tests up to 800 °C, conducted with both immediate loading and a 10-minute soak, showed that immediate loading better predicts experimental burst temperatures, indicating a thermal softening effect. Building upon this observation, the current study connects transient performance, microstructural evolution, and high-temperature tensile properties by leveraging results from C26M claddings burst tests performed at heating rates of 1–50 °C/s and hoop stresses from 25 to 100 MPa. At 25 MPa, rupture temperatures varied by only 6 °C, but at 100 MPa, the difference reached 116 °C, with faster heating yielding higher burst temperatures. Microstructural analysis identified recrystallization as the primary cause of heating rate-dependent softening, eliminating prior cold-working. In-situ thermomechanical data linked ballooning onset to localized instabilities, similar to ultimate tensile strength behavior in conventional tensile tests. High heating rates correlated with immediate loading tensile data, while lower rates matched soaked data. Furthermore, by linking burst performance to microstructural evolution and tensile properties, this work provides a foundation for more accurate modeling of FeCrAl claddings and potentially other Fe-based materials under accident conditions.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
NASA NTRS1997

Spacecraft Tests of General Relativity

Current spacecraft tests of general relativity depend on coherent radio tracking referred to atomic frequency standards at the ground stations. This paper addresses the possibility of improved tests using essentially the current system, but with the added possibility of a space-borne atomic clock. Outside of the obvious measurement of the gravitational frequency shift of the spacecraft clock, a successor to the suborbital flight of a Scout D rocket in 1976 (GP-A Project), other metric tests would benefit most directly by a possible improved sensitivity for the reduced coherent data. For purposes of illustration, two possible missions are discussed. The first is a highly eccentric Earth orbiter, and the second a solar-conjunction experiment to measure the Shapiro time delay using coherent Doppler data instead of the conventional ranging modulation.

Anderson, John D.↗
DOE OSTI2022

Detecting impacts of surface development near weather stations since 1895 in the San Joaquin Valley of California

Abstract Temperature readings observed at surface weather stations have been used for detecting changes in climate due to their long period of observations. The most common temperature metrics recorded are the daily maximum (TMax) and minimum (TMin) extremes. Unfortunately, influences besides background climate variations impact these measurements such as changes in (1) instruments, (2) location, (3) time of observation, and (4) the surrounding artifacts of human civilization (buildings, farms, streets, etc.) Quantifying (4) is difficult because the surrounding infrastructure, unique to each site, often changes slowly and variably and is thus resistant to general algorithms for adjustment. We explore a direct method of detecting this impact by comparing a single station that experienced significant development from 1895 to 2019, and especially since 1970, relative to several other stations with lesser degrees of such development (after adjustments for the (1) to (3) are applied). The target station is Fresno, California (metro population ~ 15,000 in 1900 and ~ 1 million in 2019) situated on the eastern side of the broad, flat San Joaquin Valley in which several other stations reside. A unique component of this study is the use of pentad (5-day averages) as the test metric. Results indicate that Fresno experienced + 0.4 °C decade −1 more nighttime warming (TMin) since 1970 than its neighbors—a time when population grew almost 300%. There was little difference seen in TMax trends between Fresno and non-Fresno stations since 1895 with TMax trends being near zero. A case is made for the use of TMax as the preferred climate metric relative to TMin for a variety of physical reasons. Additionally, temperatures measured at systematic times of the day (i.e., hourly) show promise as climate indicators as compared with TMax and especially TMin (and thus TAvg) due to several complicating factors involved with daily high and low measurements.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

A comparison of surrogate constitutive models for viscoplastic creep simulation of HT-9 steel

Mechanistic microstructure-informed constitutive models for the mechanical response of polycrystals are a cornerstone of computational materials science. However, as these models become increasingly more complex – often involving coupled differential equations describing the effect of specific deformation modes – their associated computational costs can become prohibitive, particularly in optimization or uncertainty quantification tasks that require numerous model evaluations. To address this challenge, surrogate constitutive models that balance accuracy and computational efficiency are highly desirable. Data-driven surrogate models, that learn the constitutive relation directly from data, have emerged as a promising solution. In this work, we develop two local surrogate models for the viscoplastic response of a steel: a piecewise response surface method and a mixture of experts model. These surrogates are designed to adapt to complex material behavior, which may vary with material parameters or operating conditions. The surrogate constitutive models are applied to creep simulations of HT-9 steel, an alloy of considerable interest to the nuclear energy sector due to its high tolerance to radiation damage, using training data generated from viscoplastic self-consistent (VPSC) simulations. In conclusion, we define a set of test metrics to numerically assess the accuracy of our surrogate models for predicting viscoplastic material behavior, and show that the mixture of experts model outperforms the piecewise response surface method in terms of accuracy.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Neural network-based classification and regression of magnetohydrodynamic modes in tokamaks

We present a machine learning-based magnetohydrodynamic (MHD) classifier and regressor that utilizes real or complex-valued 3D magnetic sensor array data to determine neoclassical tearing mode (NTM) onset times in tokamaks with millisecond accuracy. The input dataset consists of poloidal profiles of complex Fourier amplitudes with an n = 1 toroidal mode number from 144 human-labeled ITER Baseline Scenario discharges in the DIII-D tokamak, spanning both tearing-dominated and sawtooth-dominated regimes. Since m, n = 2,1 NTMs frequently emerge alongside sawteeth at the same frequency in this scenario, the focus is on isolating the m = 1 and m = 2 components of the n = 1 MHD mode near the tearing onset. To improve model regularization and prediction stability, singular value decomposition was applied to balance the sawtooth and tearing datasets. The enriched datasets facilitated training neural networks that learn the key distinguishing features of sawtooth and tearing modes in the poloidal profiles of their magnetic amplitude and phase. When the modes occur independently, the networks achieve perfect classification due to the modes’ distinct characteristics and low measurement noise. In the more experimentally relevant case where both modes coexist, the networks maintain exceptional performance across key metrics. Tests on synthetic data with known ground truth demonstrate the superior accuracy of the neural network trained on complex-valued input compared to models using real amplitude, phase, or pseudo-complex data, achieving both a mean time delay and standard deviation below 1 ms. Notably, standard linear regression methods fitting the dominant singular modes to the data closely match the neural network’s performance. Applying these methods across a broad range of H-mode scenarios will enable future studies to systematically identify dominant NTM triggers as scenario-specific variables, paving the way for more effective tearing mode avoidance strategies in future fusion reactor designs.

machine learning↗
DOE OSTI2023

Trust Model System for the Energy Grid of Things Network Communications

Network communication is crucial in the Energy Grid of Things (EGoT). Without a network connection, the energy grid becomes just a power grid where the energy resources are available to the customer uni-directionally. A mechanism to analyze and optimize the energy usage of the grid can only happen through a medium, a communications network, that enables information exchange between the grid participants and the service provider. Security implementers of EGoT network communication take extraordinary measures to ensure the safety of the energy grid, a critical infrastructure, as well as the safety and privacy of the grid participants. With the dynamic nature of network communication of the EGoT, the information provided by the customer or the service provider can be falsified by a malicious attacker. Therefore, a trust model is necessary to monitor any abnormal activities. This paper describes a distributed trust model system that meets the need of the EGoT. This paper describes methods for evaluating and improving the distributed trust model using standard hypothesis testing metrics such as true positive, false positive, true negative, false negative, equal error rate, and F1 score. Example calculations are shown based on generated sample data.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Data-Driven Protection Software to classify fault locations by protective zone in distribution systems with high PV penetration

The software contains (a) the source codes to generate Point-on-Wave (PoW) transient data for any feeder model in Alternative Transient Program (ATP) format. Codes provide options to change different steady state settings, including the loading condition and PV capacity and transient state setting like faults type, location and initiation time (b) data post-processing source code to converted data from native format to COMTRADE, csv, HDF5 (c) Docker container to train CNN to classify fault locations by protective zone. The container takes dataset and other training parameters (sampling rate, training epochs, batch size etc) as input to train CNN. The container writes back the trained CNN model, training and testing metrics and plots to the local workstation

Ramesh, Meghana↗
DOE OSTI2021

A hierarchical evaluation framework for assessing climate simulations relevant to the energy-water-land nexus (Final Report)

The overarching goal was to construct a hierarchy of new and well-tested metrics and analysis tools that support both fundamental and use-inspired research. Motivating this goal was a convergence of needs from climate scientists and stakeholders alike for a systematic, robust framework of model evaluation and diagnosis to provide scientific insights, inform model development, support best practices for the use of climate model outputs, and facilitate communication of climate information in the evolving landscapes of multi-model, multi-resolution, and large ensemble simulations that generate terabytes of data for any single climate run. Steps toward attaining these goals benefited from expertise and established capability of the project team, which included leadership of the North American Regional Climate Change Assessment Program (NARCCAP) and the Coordinated Regional Downscaling Experiment (CORDEX), development of hierarchical model evaluation approaches, and successful research in the analysis and diagnosis of climate model skill, as well as the understanding and modeling of regional climate processes in North America. As part of the overarching goal, the project worked to disseminate a suite of methodologies, algorithms, and software components that the wider community can employ to advance climate science and applications. With rigorous demonstration, the evaluation framework and the mix of standard and high risk / high reward approaches helped form the basis for future development of a computationally enabled user-friendly system for community use.

17 WIND ENERGY↗
DOE OSTI2025

REDESIGNING A PERFORMANCE MONITORING SOFTWARE FOR SUPERCOMPUTERS

The objective of this project was to improve upon the existing Watchr software that charts performance test metrics from the Trilinos project run on supercomputers at Sandia and elsewhere across the DOE complex. Software was iteratively designed and developed using Python Pandas and Dash data visualization to improve the extensibility and user experience of Watchr. Documentation is being maintained for future developers who want to extend the application.

Camacho, Dane Joseph [Sandia National Laboratories↗
NASA NTRS2013

Test and Evaluation Metrics of Crew Decision-Making And Aircraft Attitude and Energy State Awareness

NASA has established a technical challenge, under the Aviation Safety Program, Vehicle Systems Safety Technologies project, to improve crew decision-making and response in complex situations. The specific objective of this challenge is to develop data and technologies which may increase a pilot's (crew's) ability to avoid, detect, and recover from adverse events that could otherwise result in accidents/incidents. Within this technical challenge, a cooperative industry-government research program has been established to develop innovative flight deck-based counter-measures that can improve the crew's ability to avoid, detect, mitigate, and recover from unsafe loss-of-aircraft state awareness - specifically, the loss of attitude awareness (i.e., Spatial Disorientation, SD) or the loss-of-energy state awareness (LESA). A critical component of this research is to develop specific and quantifiable metrics which identify decision-making and the decision-making influences during simulation and flight testing. This paper reviews existing metrics and methods for SD testing and criteria for establishing visual dominance. The development of Crew State Monitoring technologies - eye tracking and other psychophysiological - are also discussed as well as emerging new metrics for identifying channelized attention and excessive pilot workload, both of which have been shown to contribute to SD/LESA accidents or incidents.

Bailey, Randall E.↗
NASA NTRS1998

Testing, Requirements, and Metrics

The criticality of correct, complete, testable requirements is a fundamental tenet of software engineering. Also critical is complete requirements based testing of the final product. Modern tools for managing requirements allow new metrics to be used in support of both of these critical processes. Using these tools, potential problems with the quality of the requirements and the test plan can be identified early in the life cycle. Some of these quality factors include: ambiguous or incomplete requirements, poorly designed requirements databases, excessive or insufficient test cases, and incomplete linkage of tests to requirements. This paper discusses how metrics can be used to evaluate the quality of the requirements and test to avoid problems later. Requirements management and requirements based testing have always been critical in the implementation of high quality software systems. Recently, automated tools have become available to support requirements management. At NASA's Goddard Space Flight Center (GSFC), automated requirements management tools are being used on several large projects. The use of these tools opens the door to innovative uses of metrics in characterizing test plan quality and assessing overall testing risks. In support of these projects, the Software Assurance Technology Center (SATC) is working to develop and apply a metrics program that utilizes the information now available through the application of requirements management tools. Metrics based on this information provides real-time insight into the testing of requirements and these metrics assist the Project Quality Office in its testing oversight role. This paper discusses three facets of the SATC's efforts to evaluate the quality of the requirements and test plan early in the life cycle, thus preventing costly errors and time delays later.

Rosenberg, Linda↗
NASA NTRS2016

Kepler Planet Detection Metrics: Statistical Bootstrap Test

This document describes the data produced by the Statistical Bootstrap Test over the final three Threshold Crossing Event (TCE) deliveries to NExScI: SOC 9.1 (Q1Q16)1 (Tenenbaum et al. 2014), SOC 9.2 (Q1Q17) aka DR242 (Seader et al. 2015), and SOC 9.3 (Q1Q17) aka DR253 (Twicken et al. 2016). The last few years have seen significant improvements in the SOC science data processing pipeline, leading to higher quality light curves and more sensitive transit searches. The statistical bootstrap analysis results presented here and the numerical results archived at NASAs Exoplanet Science Institute (NExScI) bear witness to these software improvements. This document attempts to introduce and describe the main features and differences between these three data sets as a consequence of the software changes.

Bootstrap↗
NASA NTRS1972

Testing of the Apollo 15 Metric Camera System.

Description of tests conducted (1) to assess the quality of Apollo 15 Metric Camera System data and (2) to develop production procedures for total block reduction. Three strips of metric photography over the Hadley Rille area were selected for the tests. These photographs were utilized in a series of evaluation tests culminating in an orbitally constrained block triangulation solution. Results show that film deformations up to 25 and 5 microns are present in the mapping and stellar materials, respectively. Stellar reductions can provide mapping camera orientations with an accuracy that is consistent with the accuracies of other parameters in the triangulation solutions. Pointing accuracies of 4 to 10 microns can be expected for the mapping camera materials, depending on variations in resolution caused by changing sun angle conditions.

Helmering, R. J.↗
DOE OSTI2023

Ultimate FY23 Vacuum Creep Testing Facility Operation Report

This facility operation report covers the refurbishment and initial testing of a vacuum creep frame used to conduct 1300°C tensile and creep tests on Mo- and Nb-based alloys. The report details the refurbishment of the frame and initial operation including 100 h creep experiments compared to similar tests in argon. Unlike the 25 mm dogbone specimens tested in argon, the vacuum load train requires 76 mm dog bone specimens. Testing in vacuum has eliminated concern of O embrittlement in argon and Nb alloy CB103 showed >120% tensile elongation at 1300°C and 1450°C. Also, a window in the vacuum chamber allows the use of digital image correlation (DIC) to measure strain rather than the load train displacement used in the argon frames. Comparison of the displacement and DIC results in the vacuum frame showed significant variation in primary creep deformation, likely due to the machine compliance, but similar secondary creep rates. Recently, ULTIMATE teams have submitted specimens for testing in vacuum. With the relatively low volume of creep testing, the facility performance metric of testing within 4 weeks of receiving specimens has been met.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Review of Wave Energy Converter Power Take-Off Systems, Testing Practices, and Evaluation Metrics: Preprint

While the field of wave energy has been the subject of numerical simulation, scale model testing, and precommercial project testing for decades, wave energy technologies remain in the early stages of development and must continuing proving themselves as a promising modern renewable energy field. One of the difficulties that wave energy systems have been struggling to overcome is the design of highly efficient energy conversion systems that can convert the mechanical power, derived from the oscillation of wave activated bodies, into another useful product. Often the power take-off (PTO) is defined as the single unit responsible for converting mechanical power into another usable form such as electricity, pressurized fluid, compressed air, and others. The PTO, and the entire power conversion chain (PCC), is of great importance as it affects not only how efficient wave power is converted into electricity, but also contributes to the mass, size, structural dynamics, and levelized cost of energy (LCOE) of the wave energy converter (WEC). Unlike wind and solar, there is no industrial standard device, or devices, for wave energy conversion and this diversity is transferred to the PTO system. The majority of current WEC PTO systems incorporate a mechanical or hydraulic drive train, power generator, and an electrical control system. The challenge of WEC PTO designs is designing a mechanical-to-electrical component that can efficiently convert irregular, bi-directional, low frequency and low alternating velocity wave motions. While gross average power levels can be predicted in advance, the variable wave elevation input has to be converted into smooth electrical output and hence usually necessitates some type of energy storage system, such as battery storage, accumulator super capacitors, etc., or other means of compensation such as an array of devices. One of the primary challenges for wave energy converter systems is the fluctuating nature of wave resources, which require WEC components to be designed to handle loads (i.e. torques, forces, and powers) that are many times greater than the average load. This approach requires a much greater PTO capacity than the average power output and indicates a higher cost. In addition, supporting mechanical coupling and or gearing can be added to the PCC to help alleviate the difficulties with transmission and control of fluctuating large loads with low frequencies (indicative of wave forcing) into smaller loads at higher frequencies (optimum for conventional electrical machine design) can quickly increase the complexity of the PCC which could result in a greater number of failure modes and increased maintenance costs. All of the previous points demonstrate how the PTO influences WEC dynamics, reliability, performance and cost which are critical design factors. This paper further explores these topics by providing a review of the state-of-the-art PTO systems currently under development, how these novel PTO systems are tested and derisked prior to precommercial deployment, and the evaluation metrics historically used to differentiate between PTO designs and how they can be improved to support control co-design focused development of wave energy systems.

laboratory testing↗