Search NASA⌕ Search

SEARCH · Search NASA

Results for “Testing metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Wave Energy Prize - 1/20th Testing - Sea Potential DUO Point Absorber

Data from the 1/20th scale testing data completed on the Wave Energy Prize for the Sea Potential team, including the 1/20th scale test plan, raw test data, video, photos, and data analysis results. The top level objective of the 1/20th scale device testing is to obtain the necessary measurements required for determining Average Climate Capture Width per Characteristic Capital Expenditure (ACE) and the Hydrodynamic Performance Quality (HPQ), key metrics for determining the Wave Energy Prize (WEP) winners.

1/20th scale↗

Wave Energy Prize - 1/20th Testing - Waveswing America Submerged Pressure Differential WEC

Data from the 1/20th scale testing data completed on the Wave Energy Prize for the Waveswing America team, including the 1/20th scale test plan, raw test data, video, photos, and data analysis results. The top level objective of the 1/20th scale device testing is to obtain the necessary measurements required for determining Average Climate Capture Width per Characteristic Capital Expenditure (ACE) and the Hydrodynamic Performance Quality (HPQ), key metrics for determining the Wave Energy Prize (WEP) winners.

1/20th scale↗

Wave Energy Prize - 1/20th Testing - RTI Wave Power Oscillating Wave Surge Converter

Data from the 1/20th scale testing data completed on the Wave Energy Prize for the RTI Wave Power team, including the 1/20th Test Plan, raw test data, video, photos, and data analysis results. The top level objective of the 1/20th scale device testing is to obtain the necessary measurements required for determining Average Climate Capture Width per Characteristic Capital Expenditure (ACE) and the Hydrodynamic Performance Quality (HPQ), key metrics for determining the Wave Energy Prize (WEP) winners.

1/20th scale↗

Progress Report: Continued Development and Advanced Testing of DPC Filler Cements

Commercial generation of energy by nuclear power plants in the United States (U.S.) has produced thousands of metric tons of spent nuclear fuel (SNF), the disposal of which is the responsibility of the U.S. Department of Energy (DOE). Utilities typically utilize the practice of storing this SNF in dual-purpose canisters (DPCs). DPCs were designed, licensed, and loaded to meet Nuclear Regulatory Commission (NRC) requirements that preclude the possibility of a criticality event during SNF storage and transport, but were not designed or loaded to preclude the possibility of a criticality event during the regulated post-closure period following disposal, which could be up to 1,000,000 years (Price, 2019).

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Measuring linac photon beam energy through EPID image analysis of physically wedged fields

Purpose: Electronic portal imaging devices (EPIDs) have proven to be useful tools for measuring several parameters of interest in linac quality assurance (QA). However, a method for measuring linac photon beam energy using EPIDs has not previously been reported. In this report, such a method is devised and tested, based on fitting a second order polynomial to the profiles of physically wedged beams, where the metric of interest is the second order coefficientα. The relationship between α and the beam quality index [percentage depth dose at 10 cm depth (PDD{sub 10})] is examined to produce a suitable calibration curve between these two parameters. Methods: Measurements were taken in a water-tank for beams with a range of energies representative of the local QA tolerances about the nominal value 6 MV. In each case, the beam quality was found in terms of PDD{sub 10} for 100 × 100 mm{sup 2} square fields. EPID images of 200 × 200 mm{sup 2} wedged fields were then taken for each beam and the wedge profile was fitted in MATLAB 2010b (The MathWorks, Inc., Natick, MA). α was then plotted against PDD{sub 10} and fitted with a linear relation to produce the calibration curve. The uncertainty in α was evaluated by taking five repeat EPID images of the wedged field for a beam of 6 MV nominal energy. The consistency of measuring α was found by taking repeat measurements on a single linac over a three month period. The method was also tested at 10 MV by repeating the water-tank crosscalibration for a range of energies centered approximately about a 10 MV nominal value. Finally, the calibration curve from the test linac and that from a separate clinical machine were compared to test consistency of the method across machines in a matched fleet. Results: The relationship betweenα and PDD{sub 10} was found to be strongly linear (R{sup 2} = 0.979) while the uncertainty in α was found to be negligible compared to that associated with measuring PDD{sub 10} in the water-tank (±0.3%). The repeat measurements over a three month period showed the method to be reasonably consistent (i.e., well within the limits defined by local QA tolerances). The measurements were repeated on a matched machine and the same linear relationship between α and PDD{sub 10} was observed. The results for both machines were found to be indistinguishable across the energy range of interest (i.e., across and close to the thresholds defined by local QA tolerances), hence a single relation could be established across a matched fleet. Finally, the experiment was repeated on both linacs at 10 MV, where the linear relationship between α and PDD{sub 10} was again observed. Conclusions: The authors conclude that EPID image analysis of physically wedged beam profiles can be used to measure linac photon beam energy. The uncertainty in such a measurement is dominated by that associated with measuring PDD{sub 10} in the water-tank; hence, the accuracies of these two methods are directly comparable. This method provides a useful technique for quickly performing energy constancy measurements while saving significant clinical downtime for QA.

61 RADIATION PROTECTION AND DOSIMETRY↗

Ultrasonic Characterization of Lithium Ion Thermal Runaway Conditions for Real-time Ultrasonic Enabled BMS Integration

The demand for energy storage is growing, and lithium-ion batteries are a promising technology to meet this need due to their high power/energy density, high round-trip efficiency, rapid response time, and portability. However, recent catastrophic events caused by thermal runaway have slowed their adoption, highlighting the need for an early warning system for battery failure. In this work, ultrasound is used to detect physical changes in 950 mAh batteries by identifying material property changes independent of voltage and current. [Ultrasound signal features (e.g., time of flight, maximum frequency component) were extracted as the batteries were cycled and subjected to both constant current and constant voltage overcharge and were used to develop two metrics identifying failure: a warning to detect the start of overcharge and an emergency stop (E-stop) to immediately take the battery out of service. The identification method involved locating magnitude differences of several ultrasound features compared to baseline operation considering different currents and temperatures, and the warning/stopping metrics were consistent across all experiments. For an average overcharge time of 140 minutes, the average warning was issued 124 minutes before the failure and the average E-stop was triggered 94 minutes before failure. As a test of using ultrasound for early warning detection, a battery was forced into overcharge and returned to normal cycling conditions based on the previously determined warning metric. Both the voltage profile and the ultrasound measurements returned to their baseline behavior, indicating that ultrasonic detection can not only identify battery failure before a catastrophic event, but can also provide early enough warnings such that overcharges can be detected and corrected quickly enough so the battery does not need to be decommissioned.]

25 ENERGY STORAGE↗

CT head-scan dosimetry in an anthropomorphic phantom and associated measurement of ACR accreditation-phantom imaging metrics under clinically representative scan conditions

Purpose: To measure radiation absorbed dose and its distribution in an anthropomorphic head phantom under clinically representative scan conditions in three widely used computed tomography (CT) scanners, and to relate those dose values to metrics such as high-contrast resolution, noise, and contrast-to-noise ratio (CNR) in the American College of Radiology CT accreditation phantom.Methods: By inserting optically stimulated luminescence dosimeters (OSLDs) in the head of an anthropomorphic phantom specially developed for CT dosimetry (University of Florida, Gainesville), we measured dose with three commonly used scanners (GE Discovery CT750 HD, Siemens Definition, Philips Brilliance 64) at two different clinical sites (Walter Reed National Military Medical Center, National Institutes of Health). The scanners were set to operate with the same data-acquisition and image-reconstruction protocols as used clinically for typical head scans, respective of the practices of each facility for each scanner. We also analyzed images of the ACR CT accreditation phantom with the corresponding protocols. While the Siemens Definition and the Philips Brilliance protocols utilized only conventional, filtered back-projection (FBP) image-reconstruction methods, the GE Discovery also employed its particular version of an adaptive statistical iterative reconstruction (ASIR) algorithm that can be blended in desired proportions with the FBP algorithm. We did an objective image-metrics analysis evaluating the modulation transfer function (MTF), noise power spectrum (NPS), and CNR for images reconstructed with FBP. For images reconstructed with ASIR, we only analyzed the CNR, since MTF and NPS results are expected to depend on the object for iterative reconstruction algorithms.Results: The OSLD measurements showed that the Siemens Definition and the Philips Brilliance scanners (located at two different clinical facilities) yield average absorbed doses in tissue of 42.6 and 43.1 mGy, respectively. The GE Discovery delivers about the same amount of dose (43.7 mGy) when run under similar operating and image-reconstruction conditions, i.e., without tube current modulation and ASIR. The image-metrics analysis likewise showed that the MTF, NPS, and CNR associated with the reconstructed images are mutually comparable when the three scanners are run with similar settings, and differences can be attributed to different edge-enhancement properties of the applied reconstruction filters. Moreover, when the GE scanner was operated with the facility's scanner settings for routine head exams, which apply 50% ASIR and use only approximately half of the 100%-FBP dose, the CNR of the images showed no significant change. Even though the CNR alone is not sufficient to characterize the image quality and justify any dose reduction claims, it can be useful as a constancy test metric.Conclusions: This work presents a straightforward method to connect direct measurements of CT dose with objective image metrics such as high-contrast resolution, noise, and CNR. It demonstrates that OSLD measurements in an anthropomorphic head phantom allow a realistic and locally precise estimation of magnitude and spatial distribution of dose in tissue delivered during a typical CT head scan. Additional objective analysis of the images of the ACR accreditation phantom can be used to relate the measured doses to high contrast resolution, noise, and CNR.

61 RADIATION PROTECTION AND DOSIMETRY↗

A Statistical Method Analyzing LED Lumen Depreciation and Projecting LED Life

There is a strong need for a method to represent the potential life of LED products as a critical part of design decisions including cost-effectiveness analysis. The IES LM-80 test method is in place to collect lumen depreciation data but it does not provide for estimation of future long term depreciation. Separate estimation methods are being considered (TM-21) and this paper describes the analysis of a series of LED degradation models and subsequent development of an estimation method. The work involves analysis of a set of engineering models to determine their applicability and define a structure for their use in LED lumen output life based on a lumen output level such as the L70 metric. The analysis has provided valuable information on methods effectively estimating LED life time, and impacts of measurement uncertainties, test duration, interval and other test conditions on selecting degradation models and LED life time projection. A set of guidelines are recommended to estimate LED life from data obtained using the current LM-80 test method.

36 MATERIALS SCIENCE↗

Wave Energy Prize - 1/20th Testing - AquaHarmonics Point Absorber

Data from the 1/20th scale testing data completed on the Wave Energy Prize for the AquaHarmonics team, including the 1/20th scale test plan, raw test data, video, photos, and data analysis results. The top level objective of the 1/20th scale device testing is to obtain the necessary measurements required for determining Average Climate Capture Width per Characteristic Capital Expenditure (ACE) and the Hydrodynamic Performance Quality (HPQ), key metrics for determining the Wave Energy Prize (WEP) winners.

1/20th scale↗

Development of Bonded Joint Technology for a Rigidizable-Inflatable Deployable Truss

Microwave and Synthetic Aperture Radar antenna systems have been developed as instrument systems using truss structures as their primary support and deployment mechanism for over a decade. NASA Langley Research Center has been investigating fabrication, modular assembly, and deployment methods of lightweight rigidizable/inflatable linear truss structures during that time for large spacecraft systems. The primary goal of the research at Langley Research Center is to advance these existing state-of-the-art joining and deployment concepts to achieve prototype system performance in a relevant space environment. During 2005, the development, fabrication, and testing of a 6.7 meter multi-bay, deployable linear truss was conducted at Langley Research Center to demonstrate functional and precision metrics of a rigidizable/inflatable truss structure. The present paper is intended to summarize aspects of bonded joint technology developed for the 6.7 meter deployable linear truss structure while providing a brief overview of the entire truss fabrication, assembly, and deployment methodology. A description of the basic joint design, surface preparation investigations, and experimental joint testing of component joint test articles will be described. Specifically, the performance of two room temperature adhesives were investigated to obtain qualitative data related to tube folding testing and quantitative data related to tensile shear strength testing. It was determined from the testing that a polyurethane-based adhesive best met the rigidizable/inflatable truss project requirements.

Smeltzer, Stanley S., III↗

Urban Traveler - Changes and Impacts: Mobility Energy Productivity (MEP) Metric

For nearly a century, the automobile has been the primary mode of personal transportation in American life. This remains true today as millions of people rely heavily on cars to connect suburbs with cities or to travel long distances—often out of routine or convenience. However, advances in technology are fueling an era of transportation transformation, with the potential to transform a system that has remained virtually unchanged for decades. Aspiring smart cities are wrestling with questions such as: How does mobility impact a person’s quality of life? Would people make different travel choices if they were presented with better information about their mobility options? The ability to quantify the mobility potential of a given location is the first step toward answering these questions. In response, an interdisciplinary team at the National Renewable Energy Laboratory (NREL) has developed the Mobility-Energy Productivity (MEP) metric. The MEP metric provides an avenue to not only measure the mobility potential at a specific location in its current configuration, but also to test how various technological advances (e.g., connected and automated vehicles, plug-in electric vehicles, shared mobility) and infrastructure investments (e.g., building an additional highway lane, constructing a new shopping mall, implementing a transit-oriented development) impact the mobility of that location over time. This presentation details the FY19 progress on the MEP metric project funded through DOE VTO's SMART Mobility Consortium.

47 OTHER INSTRUMENTATION↗

Generation-based Evolutionary Tool for the Optimization of Constellations (GenETOC)

With the rapid growth in the capabilities of smaller satellites, satellite architectures that replace a single, extremely capable spacecraft with multiple, cheaper ones are gaining in popularity. Unfortunately, the orbit design process for constellations can be significantly more involved, especiallywhen the relative placement of the individual spacecraft within the constellation is not constrained by mission and/or science objectives. Optimizing a satellite constellation in the presence of multiple, competing objectives is a highly complex problem to which many traditional mathematical optimization methods cannot be applied and few tools exist to help mission designers search for promising candidate mission designs. The Generation-based Evolutionary Tool for the Optimization of Constellations (GenETOC) has been created to search for near-optimal constellation design options. GenETOC combines a modified version of the Non-dominated Sorting Genetic Algorithm II (NSGA II) with STK Components libraries (a 3rdparty .NET package created by Analytical Graphics Inc.) to create a framework that enables a mission designer to generate a simulation that models the design problem and obtain a family of potential, near-optimal solutions that can be investigated more in detail. GenETOC was developed in C# using the .NET framework with Windows Presentation Foundation (WPF) serving as the framework from which to create the graphical user interface (GUI). GenETOC user inputs can be categorized into three major data components: definition of the problem (areas of interest, satellite decision parameters, and sensor configurations), definition of performance objectives, and specification of the genetic algorithm (GA) parameters. In the problem definition component, the user is prompted to define the areas of interest against which the performance metrics will be computed, define the sensor parameters and attach them to specific spacecraft, select which satellite orbital parameters will be added to the decision space of the GA, and specify the range of desired values for each optimization parameter. For performance objectives, the user is presented with a list of available coverage and revisit performance based calculation options from which two metrics are chosen to serve as the objective functions that the GA will use to evaluate solutions during the optimization process. Finally, the definition of the GA parameters provides user control over the number of generations (number of optimization iterations), the population size (number of candidate constellations created in each generation), and the adaptive mutation and crossover threshold values (control parameters for how frequently each process occurs during the optimization). GenETOC has been extensively tested to verify the individual components of the optimization process. The GA has been tested against a suite of GA test problems to confirm convergence to the known two and three-dimensional Pareto fronts. The coverage and revisit performance metrics obtained in GenETOC are compared with STK desktop scenarios, confirming the constellations are being appropriately modeled within GenETOC simulations. A walkthrough of a simple, example problem is provided to illustrate the workings of GenETOC and to demonstrate the output available to the mission designer.

mission design↗

A Combination of Traditional and Novel Methods Used to Evaluate the Impact of an EVA Glove on Hand Performance

The gloved hand is an astronaut s primary means of interacting with the environment, so performance on an EVA is strongly impacted by any restrictions imposed by the glove. As a result, these restrictions have been the subject of study for decades. However, previous studies have generally been unsuccessful in quantifying glove mobility and tactility. Instead, studies have tended to focus on the dexterity, strength and functional performance of the gloved hand. Therefore, it has been difficult to judge the impact of each type of restriction on the glove s overall capability. The lack of basic information on glove mobility in particular, is related to the difficulty in instrumenting a gloved hand to allow an accurate evaluation. However, the current study aims at developing novel technological capabilities to provide metrics for mobility and tactility that can be used to assess the performance of a glove in a way that could enable designers and engineers to improve upon their current designs. A series of evaluations were performed in ungloved, unpressurized and pressurized (4.3 psi) conditions, to allow a comparison across pressures and to the baseline barehanded condition. In addition, a subset of the testing was also performed with the Thermal Micrometeoroid Garment (TMG) removed. This test case in particular provided some interesting insight into how much of an impact the TMG has on gloved mobility -- in some cases, as much as pressurization of the glove. Previous rule-of-thumb estimates had assumed that the TMG would have a much lower impact on mobility, while these results suggest that an improvement in the TMG could actually have a significant impact on glove performance. Similarly, tactility testing illustrated the impact of glove pressurization on tactility and provided insight on the design of interfaces to the glove. The metrics described in this paper have been used to benchmark the Phase VI EVA glove and to develop requirements for the next generation glove for the Constellation program.

Rajulu, Sudhakar↗

Metrics and Benchmarks for Visualization

What is a "good" visualization? How can the quality of a visualization be measured? How can one tell whether one visualization is "better" than another? I claim that the true quality of a visualization can only be measured in the context of a particular purpose. The same image generated from the same data may be excellent for one purpose and abysmal for another. A good measure of visualization quality will correspond to the performance of users in accomplishing the intended purpose, so the "gold standard" is user testing. As a user of visualization software (or at least a consultant to such users) I don't expect visualization software to have been tested in this way for every possible use. In fact, scientific visualization (as distinct from more "production oriented" uses of visualization) will continually encounter new data, new questions and new purposes; user testing can never keep up. User need software they can trust, and advice on appropriate visualizations of particular purposes. Considering the following four processes, and their impact on visualization trustworthiness, reveals important work needed to create worthwhile metrics and benchmarks for visualization. These four processes are (1) complete system testing (user-in-loop), (2) software testing, (3) software design and (4) information dissemination. Additional information is contained in the original extended abstract.

Uselton, Samuel P.↗

Short-Term Test Results: Multifamily Home Energy Efficiency Retrofit

Multifamily deep energy retrofits (DERs) represent great potential for energy savings, while also providing valuable insights on research-generated efficiency measures, cost-effectiveness metrics, and risk factor strategies for the multifamily housing industry. This report describes the Bay Ridge project, a base scope retrofit with a goal of achieving 30% savings (relative to pre-retrofit), and a DER scope with a goal of 50% savings (relative to pre-retrofit). Findings from the short-term testing at Bay Ridge include air infiltration reductions of greater than 60% in the DER building; a hybrid heat pump system with a Savings to Investment Ratio (SIR) > 1 (relative to a high efficiency furnace) which also provides the resident with added incentive for energy savings; and duct leakage reductions of > 60% using an aerosolized duct sealing approach.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Wave Energy Prize - 1/20th Testing - CalWave Submerged Pressure Differential WEC

Data from the 1/20th scale testing data completed on the Wave Energy Prize for the CalWave Power Technologies team, including the 1/20th scale test plan, raw test data, video, photos, and data analysis results. The top level objective of the 1/20th scale device testing is to obtain the necessary measurements required for determining Average Climate Capture Width per Characteristic Capital Expenditure (ACE) and the Hydrodynamic Performance Quality (HPQ), key metrics for determining the Wave Energy Prize (WEP) winners.

1/20th scale↗

Wave Energy Prize - 1/20th Testing - Oscilla Power Triton Point Absorber

Data from the 1/20th scale testing data completed on the Wave Energy Prize for the Oscilla Power team, including the 1/20th Test Plan, raw test data, video, photos, and data analysis results. The top level objective of the 1/20th scale device testing is to obtain the necessary measurements required for determining Average Climate Capture Width per Characteristic Capital Expenditure (ACE) and the Hydrodynamic Performance Quality (HPQ), key metrics for determining the WEPrize winners.

1/20th scale↗

Testing unimodular gravity

We consider models of gravitation that are based on unimodular general coordinate transformations (GCT). These transformations include only those which do not change the determinant of the metric. We treat the determinant as a separate field which transforms as a scalar under unimodular GCT. We consider a class of such theories. In general, these theories do not transform covariantly under the full GCT. We characterize the violation of general coordinate invariance by introducing a new parameter. We show that the theory is consistent with observations for a wide range of this parameter. This parameter may serve as a test for possible violations of general coordinate invariance. We also consider the cosmic evolution within the framework of these models. We show that in general we do not obtain consistent cosmological solutions if we assume the standard cosmological constant or the standard form of non-relativistic matter. We propose a suitable generalization which is consistent with cosmology. We fit the resulting model to the high redshift supernova data. We find that we can obtain a good fit to this data even if include only a single component, either cosmological constant or non-relativistic matter.

79 ASTRONOMY AND ASTROPHYSICS↗