Search NASA⌕ Search

SEARCH · Search NASA

Results for “Testing metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

Software Simulates Sight: Flat Panel Mura Detection

In the increasingly sophisticated world of high-definition flat screen monitors and television screens, image clarity and the elimination of distortion are paramount concerns. As the devices that reproduce images become more and more sophisticated, so do the technologies that verify their accuracy. By simulating the manner in which a human eye perceives and interprets a visual stimulus, NASA scientists have found ways to automatically and accurately test new monitors and displays. The Spatial Standard Observer (SSO) software metric, developed by Dr. Andrew B. Watson at Ames Research Center, measures visibility and defects in screens, displays, and interfaces. In the design of such a software tool, a central challenge is determining which aspects of visual function to include while accuracy and generality are important, relative simplicity of the software module is also a key virtue. Based on data collected in ModelFest, a large cooperative multi-lab project hosted by the Optical Society of America, the SSO simulates a simplified model of human spatial vision, operating on a pair of images that are viewed at a specific viewing distance with pixels having a known relation to luminance. The SSO measures the visibility of foveal spatial patterns, or the discriminability of two patterns, by incorporating only a few essential components of vision. These components include local contrast transformation, a contrast sensitivity function, local masking, and local pooling. By this construction, the SSO provides output in units of "just noticeable differences" (JND) a unit of measure based on the assumed smallest difference of sensory input detectable by a human being. Herein is the truly amazing ability of the SSO, while conventional methods can manipulate images, the SSO models human perception. This set of equations actually defines a mathematical way of working with an image that accurately reflects the way in which the human eye and mind behold a stimulus. The SSO is intended for a wide variety of applications, such as evaluating vision from unmanned aerial vehicles, measuring visibility of damage to aircraft and to the space shuttles, predicting outcomes of corrective laser eye surgery, inspecting displays during the manufacturing process, estimating the quality of compressed digital video, evaluating legibility of text, and predicting discriminability of icons or symbols in a graphical user interface.

Source record↗

Comparison of Computational Predictions of the Mach 0.80 Transonic Truss-Braced Wing Configuration with Experimental Data

The NASA Langley and Ames Research Centers have teamed together for comparisons of computational predictions of the Boeing Mach 0.80Transonic Truss-Braced Wing (TTBW) configuration with a high-speed experimental dataset. The Mach 0.80 TTBW vehicle is a high wing, high aspect ratio configuration, designed for a high lift-to-drag ratio. System studies have predicted significant fuel burn and emissions benefits with the TTBW technology moving toward meeting NASA Subsonic Transport Systems-Level-Metrics. A 4.5% scale Mach 0.80 design TTBW model was recently tested at the NASA Ames Research Center 11-by 11-Foot Transonic Wind Tunnel(11-Ft TWT),providing a valuable dataset to validate computational tools and investigate best practices as risk reduction efforts continue for the development of the advanced TTBW vehicle. The NASA Computational Fluid Dynamics (CFD) team has computed free-air flow solutions on the Mach 0.80 design flight configuration and two wind tunnel configuration variants using the USM3D and LAVA flow solvers. Accurate modeling of the configuration tested in the wind tunnel environment is critical to validating the CFD tools, thus the team has included the internal cavity region and sting in their modeling of the configuration, similar to that tested in the 11-Ft TWT. Overall, the CFD simulations compared well and show similar trends as the corrected experimental data for lift and drag polars. The CFD predicted lift curve is shifted in angle of attack from what was observed in the experiment. The shift in lift also was seen in the pitching moment comparison plots. CFD solutions were computed at constant CL test point values and showed overall very good agreement when comparing constant spanwise cuts of pressure coefficient data on the wing and strut with experimental data. CFD cavity corrections were also investigated using the 11-Ft TWT cavity correction method, similar to that used to correct the wind tunnel data. Results showed some improvement in pitching moment coefficient predictions, and an increase in drag, shifting the data to the right in drag polars, further from the experimental data at lower lift conditions, good agreement near the design CL, and slight improvement at the higher lift conditions.

Transonic Truss-Braced Wing↗

Building Lunar Maps for Terrain Relative Navigation and Hazard Detection Applications

Terrain Relative Navigation (TRN) systems localize a spacecraft with respect to a map of the surface by comparing descent imagery to that reference map. The spacecraft position estimates can only be as accurate as the reference map itself. Accurate map products that are based on orbital reconnaissance data must be validated for navigation applications to ensure that all relevant error sources are minimized. Currently available map products have been generated for scientific applications, so the need for accurate TRN maps remains a gap to be filled for upcoming lunar lander missions, in particular missions to the South Pole region. Additionally, representative high-resolution maps that contain lander-scale features are needed for successful development and testing of Hazard Detection (HD) systems. This paper describes one of NASA’s current efforts to develop benchmark data sets that can be used for developing and testing TRN and HD algorithms as well as suggested processes and metrics for generating and validating lunar maps that can be used for navigation and hazard detection.

Lunar Maps↗

Building Lunar Maps for Terrain Relative Navigation and Hazard Detection Applications

Terrain Relative Navigation (TRN) systems that localize a spacecraft with respect to a map of the surface by comparing descent imagery to that reference map can only be as accurate as the reference map itself. Accurate map products that are based on orbital reconnaissance data must be validated for navigation applications to ensure that all relevant error sources are minimized. Currently available map products have been generated for scientific applications, so the need for accurate TRN maps remains a gap to be filled for upcoming lunar lander missions, in particular missions to the South Pole region. Additionally, representative high-resolution maps that contain lander-scale features are needed for successful development and testing of Hazard Detection (HD) systems. This paper describes one of NASA’s current efforts to develop benchmark data sets that can be used for developing and testing TRN and HD algorithms as well as suggested processes and metrics for generating and validating lunar maps that can be used for navigation and hazard detection.

Beyer, Ross A.↗

Qualification and Performance of a High-Efficiency Laser Transmitter for Deep-Space Optical Communications

A high-power Laser Transmitter Assembly (LTA) was developed to support the Deep Space Optical Communications (DSOC) technology demonstration being developed by the Jet Propulsion Laboratory. NASA’s Psyche Mission plans to host the DSOC flight subsystem for testing space-to-ground high-bandwidth laser communications en route to the 16 Psyche asteroid. We review the design, performance, and qualification of the LTA Engineering Model and Flight Model (EM and FM) delivered to JPL. The LTA uses a master-oscillator power amplifier (MOPA) design and delivers up to 4.5 W at 1550 nm, with a highly efficient, cladding-pumped, polarization-maintaining erbium-ytterbium fiber amplifier. The master oscillator generates a range of pulse widths and repetition rates to support modulation formats from 16- to 128-PPM for optical data transmission at >100 Mbps. The LTA was designed for high reliability and radiation hardness, and includes redundant signal and pumping paths to reduce single points of failure, hardware interlocks to ensure safe operation and protection against damage, closed-loop control of optical power, and detailed health and status via telemetry. The LTA EM and FM were subjected to unit-appropriate space qualification testing. We describe the performance testing of the EM and FM, for the characterization of key metrics such as wavelength stability, signal linewidth, optical pulse width, jitter, and extinction ratio, and polarization extinction ratio. The management of optical nonlinearities (self-phase modulation, Brillouin scattering, or pulse-to-pulse energy variation), which could result in an optical link penalty or damage to the LTA, is also detailed, and factors affecting the power efficiency are discussed.

Jaques, J.↗

Thermal Desktop Modeling of the RRM3 On-Orbit Cryogenic Methane Storage and Active Cooling Experiment

The storing of cryogenic propellants is an enabling technology for NASA as it moves to expand future missions into low Earth orbit (LEO) and beyond. The Robotic Refueling Mission–3 (RRM3) experiment launched in 2018 and was designed to demonstrate tank self-pressurization during storage and active cooling of liquid methane in microgravity. Creating accurate models using existing datasets from flight experiments such as RRM3 is a vital step toward developing appropriate modeling tools to form pre-test predictions for future flight systems. The goal of this work was to create a working model in Thermal Desktop of the RRM3 source Dewar during the microgravity self-pressurization experiment. The pressure rise, temperature distribution of the fluid inside the tank, and the wall temperatures were all tracked and compared with test data. Initial results show good agreement between each of these metrics and the experimental results. This work is ongoing and will yield further insights into the thermal behavior of cryogens in microgravity.

Tank self-pressurization↗

Crew Health and Performance Integrated Data Architecture (CHP-IDA) Project

BACKGROUND: Future Human Exploration missions introduce a new paradigm as crews move further from the resupply and near real-time ground support typical of Low Earth Orbit missions today. Without immediate support from ground-based personnel, exploration crews will be more reliant on inflight data and technology to respond to emergencies and anomalies. A data architecture to support a new generation of technologies, employing advanced analytical and predictive modeling techniques, is needed to enable crew autonomy. OVERVIEW: The Crew Health and Performance Integrated Data Architecture (CHP-IDA) project funded by NASA’s Exploration Medical Integrated Product Team (XMIPT) is laying a foundation for future in-flight informatics by providing a back-end architecture for collecting, storing, and integrating multiple sources of data generated by and around the crew. CHP-IDA provides a platform for common data models and Application Programming Interfaces to access, integrate, process, and display CHP data (e.g., environmental, exercise, medical, sleep, performance, etc.). This will facilitate the increased situation awareness and decision support required by the crew and remote support of exploration missions. This presentation will describe the currently ongoing effort to develop and evaluate a path-to-flight concept of the CHP-IDA software and its core capabilities. Current integrations will be discussed, including analytics for Extravehicular Activity metabolic rate and data ingestion from a multi-functional integrated medical device. The presentation will also provide examples of scenarios used to demonstrate the CHP-IDA through human-in-the-loop test bed activities as well as examples of appropriate system performance metrics. DISCUSSION: Today, in-flight data is often siloed, unsynchronized, and largely inaccessible in real time. Many data sets require manual entry and/or data transfer between vehicles and the ground. These issues contribute to risks in supporting exploration medical capabilities. The CHP-IDA is a back-end data system providing core capabilities needed for timely and meaningful data insights across CHP domains to crew and remote personnel to enable increased crew autonomy. Future work includes collaboration with additional CHP domains, new technology integrations, and further demonstrations of the IDA within different vehicle and communication latency contexts. LEARNING OBJECTIVES 1. The audience will understand that the CHP-IDA is a back-end system, providing a platform to facilitate access, promote decision tools, and provide meaningful insights to crew and to remote stakeholders during exploration missions. 2. The audience will gain insight into human-centered research and activities used to discover CHP domain data needs and pain points and how this information is used to guide development of the IDA.

Exploration↗

Grid Frequency Extreme Event Analysis and Modeling: Preprint

Sudden losses of generation or load can lead to instantaneous changes in electric grid frequency and voltage. Extreme frequency events pose a major threat to grid stability. As renewable energy sources supply power to grids in increasing proportions, it becomes increasingly important to examine when and why extreme events occur to prevent destabilization of the grid. To better understand frequency events, including extrema, historic data were analyzed to fit probability distribution functions to various frequency metrics. Results showed that a standard Cauchy distribution fit the difference between the frequency nadir and prefault frequency (f_(C-A)) metric well, a standard Cauchy distribution fit the settling frequency (f_B) metric well, and a standard normal distribution fit the difference between the settling frequency and frequency nadir (f_(B-C)) metric very well. Results were inconclusive for the frequency nadir (f_C) metric, meaning it likely has a more complex distribution than those tested. This probabilistic modeling should facilitate more realistic modeling of grid faults.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Detailed Vibration Analysis of Pinion Gear with Time-Frequency Methods

In this paper, the authors show a detailed analysis of the vibration signal from the destructive testing of a spiral bevel gear and pinion pair containing seeded faults. The vibration signal is analyzed in the time domain, frequency domain and with four time-frequency transforms: the Short Time Frequency Transform (STFT), the Wigner-Ville Distribution with the Choi-Williams kernel (WV-CW), the Continuous Wavelet' Transform (CWT) and the Discrete Wavelet Transform (DWT). Vibration data of bevel gear tooth fatigue cracks, under a variety of operating load levels and damage conditions, are analyzed using these methods. A new metric for automatic anomaly detection is developed and can be produced from any systematic numerical representation of the vibration signals. This new metric reveals indications of gear damage with all of the time-frequency transforms, as well as time and frequency representations, on this data set. Analysis with the CWT detects changes in the signal at low torque levels not found with the other transforms. The WV-CW and CWT use considerably more resources than the STFT and the DWT. More testing of the new metric is needed to determine its value for automatic anomaly detection and to develop fault detection methods for the metric.

Mosher, Marianne↗

High-throughput cancer hypothesis testing with an integrated PhysiCell-EMEWS workflow

BackgroundCancer is a complex, multiscale dynamical system, with interactions between tumor cells and non-cancerous host systems. Therapies act on this combined cancer-host system, sometimes with unexpected results. Systematic investigation of mechanistic computational models can augment traditional laboratory and clinical studies, helping identify the factors driving a treatment's success or failure. However, given the uncertainties regarding the underlying biology, these multiscale computational models can take many potential forms, in addition to encompassing high-dimensional parameter spaces. Therefore, the exploration of these models is computationally challenging. We propose that integrating two existing technologiesone to aid the construction of multiscale agent-based models, the other developed to enhance model exploration and optimizationcan provide a computational means for high-throughput hypothesis testing, and eventually, optimization.ResultsIn this paper, we introduce a high throughput computing (HTC) framework that integrates a mechanistic 3-D multicellular simulator (PhysiCell) with an extreme-scale model exploration platform (EMEWS) to investigate high-dimensional parameter spaces. We show early results in applying PhysiCell-EMEWS to 3-D cancer immunotherapy and show insights on therapeutic failure. We describe a generalized PhysiCell-EMEWS workflow for high-throughput cancer hypothesis testing, where hundreds or thousands of mechanistic simulations are compared against data-driven error metrics to perform hypothesis optimization.ConclusionsWhile key notational and computational challenges remain, mechanistic agent-based models and high-throughput model exploration environments can be combined to systematically and rapidly explore key problems in cancer. These high-throughput computational experiments can improve our understanding of the underlying biology, drive future experiments, and ultimately inform clinical practice.

Agent-based model↗

WSEAT Shock Testing Margin Assessment Using Energy Spectra Final Report

Several programs at Sandia National Laboratories have adopted energy spectra as a metric to relate the severity of mechanical insults to structural capacity. The purpose being to gain insight into the system's capability, reliability, and to quantify the ultimate margin between the normal operating envelope and the likely system failure point -- a system margin assessment. The fundamental concern with the use of energy metrics was that the applicability domain and implementation details were not completely defined for many problems of interest. The goal of this WSEAT project was to examine that domain of applicability and work out the necessary implementation details. The goal of this project was to provide experimental validation for the energy spectra based methods in the context of margin assessment as they relate to shock environments. The extensive test results concluded that failure predictions using energy methods did not agree with failure predictions using S-N data. As a result, a modification to the energy methods was developed following the form of Basquin's equation to incorporate the power law exponent for fatigue damage. This update to the energy-based framework brings the energy based metrics into agreement with experimental data and historical S-N data.

47 OTHER INSTRUMENTATION↗

Retrospective evaluation of dosimetric quality for prostate carcinomas treated with 3D conformal, intensity modulated and volumetric modulated arc radiotherapy

This study examines and compares the dosimetric quality of radiotherapy treatment plans for prostate carcinoma across a cohort of 163 patients treated across five centres: 83 treated with three-dimensional conformal radiotherapy (3DCRT), 33 treated with intensity modulated radiotherapy (IMRT) and 47 treated with volumetric modulated arc therapy (VMAT). Treatment plan quality was evaluated in terms of target dose homogeneity and organs at risk (OAR), through the use of a set of dose metrics. These included the mean, maximum and minimum doses; the homogeneity and conformity indices for the target volumes; and a selection of dose coverage values that were relevant to each OAR. Statistical significance was evaluated using two-tailed Welch's T-tests. The Monte Carlo DICOM ToolKit software was adapted to permit the evaluation of dose metrics from DICOM data exported from a commercial radiotherapy treatment planning system. The 3DCRT treatment plans offered greater planning target volume dose homogeneity than the other two treatment modalities. The IMRT and VMAT plans offered greater dose reduction in the OAR: with increased compliance with recommended OAR dose constraints, compared to conventional 3DCRT treatments. When compared to each other, IMRT and VMAT did not provide significantly different treatment plan quality for like-sized tumour volumes. This study indicates that IMRT and VMAT have provided similar dosimetric quality, which is superior to the dosimetric quality achieved with 3DCRT.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Method for obtaining aerodynamic data on hypersonic configurations with scramjet exhaust flow simulation

A hypersonic wind tunnel test method for obtaining credible aerodynamic data on a complete hypersonic vehicle (generic X-24c) with scramjet exhaust flow simulation is described. The general problems of simulating the scramjet exhaust as well as accounting for scramjet inlet flow and vehicle forces are analyzed, and candidate test methods are described and compared. The method selected as most useful makes use of a thrust-minus-drag flow-through balance with a completely metric model. Inlet flow is diverted by a fairing. The incremental effect of the fairing is determined in the testing of two reference models. The net thrust of the scramjet module is an input to be determined in large-scale module tests with scramjet combustion. Force accounting is described, and examples of force component levels are predicted. Compatibility of the test method with candidate wind tunnel facilities is described, and a preliminary model mechanical arrangement drawing is presented. The balance design and performance requirements are described in a detailed specification. Calibration procedures, model instrumentation, and a test plan for the model are outlined.

Hartill, W. R.↗

Laboratory testing methods to evaluate the reliability of occupancy sensors for commercial building applications

The energy performance of commercial buildings is greatly influenced by occupants which are highly variable and among the most unpredictable components of a building's operation. While most building control systems use fixed, predetermined occupancy schedules, these fixed occupancy levels can be quite different from actual occupancy. This can cause unnecessary energy consumption, particularly from heating, ventilation, and air conditioning (HVAC) and lighting systems which are responsible for approximately 60% of commercial buildings' energy use. The use of occupancy counting sensor systems integrated with building management system controls is one method that can be used to improve the energy-consuming performance of buildings. However, there is no standardized universal methodology and metrics to evaluate their reliability. The aim of this research is to develop a uniform evaluation methodology to assess the reliability of occupancy counting sensor systems in a controlled laboratory environment. The developed testing methodology includes both “typical” scenarios representing the occupancy scenarios of a typical commercial building, and “failure” testing scenarios which represent a range of potential scenarios that may impact a sensor system's reliability. These methods were then implemented in a case study to evaluate the performance of two novel occupancy counting sensor systems (i.e., door-centric, and camera-based). Results suggest that typical testing results can be used to compare the overall performance of the occupancy counting sensor systems; however, failure testing is also important to understand the weaknesses of the sensor system in order to select the suitable one for the intended use of the commercial building. In addition, the proposed methodology includes a modified confusion matrix which enables the ability to identify if failures are caused by over or under counting occupants and to what extent this occurs over the testing period.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Monitoring cognitive function and need with the automated neuropsychological assessment metrics in Decompression Sickness (DCS) research

Hypobaric decompression sickness (DCS) research presents the medical monitor with the difficult task of assessing the onset and progression of DCS largely on the basis of subjective symptoms. Even with the introduction of precordial Doppler ultrasound techniques for the detection of venous gas emboli (VGE), correct prediction of DCS can be made only about 65 percent of the time according to data from the Armstrong Laboratory's (AL's) hypobaric DCS database. An AL research protocol concerned with exercise and its effects on denitrogenation efficiency includes implementation of a performance assessment test battery to evaluate cognitive functioning during a 4-h simulated 30,000 ft (9144 m) exposure. Information gained from such a test battery may assist the medical monitor in identifying early signs of DCS and subtle neurologic dysfunction related to cases of asymptomatic, but advanced, DCS. This presentation concerns the selection and integration of a test battery and the timely graphic display of subject test results for the principal investigator and medical monitor. A subset of the Automated Neuropsychological Assessment Metrics (ANAM) developed through the Office of Military Performance Assessment Technology (OMPAT) was selected. The ANAM software provides a library of simple tests designed for precise measurement of processing efficiency in a variety of cognitive domains. For our application and time constraints, two tests requiring high levels of cognitive processing and memory were chosen along with one test requiring fine psychomotor performance. Accuracy, speed, and processing throughout variables as well as RMS error were collected. An automated mood survey provided 'state' information on six scales including anger, happiness, fear, depression, activity, and fatigue. An integrated and interactive LOTUS 1-2-3 macro was developed to import and display past and present task performance and mood-change information.

Nesthus, Thomas E.↗

IBPSA Project 2 BOPTEST: An update on the test cases available in the framework for testing advanced control strategies in buildings

Project 2 develops software infrastructure, test cases, and extensions for the Building Optimization Testing Framework (BOPTEST) to address the expanding needs of building and urban energy system controls through open international collaboration. This paper provides an overview of the new test cases available as of BOPTEST version 0.7.1. Each test case is developed using open-source Modelica libraries and Spawn of EnergyPlus, enabling the creation of high-fidelity building models that incorporate envelope dynamics, Heating Ventilation and Air Conditioning (HVAC) systems, and explicit control representations. Currently, eight test cases are available, with five additional cases under development. These test cases cover a wide range of climates, building types, and HVAC systems. This paper compiles and summarizes test case descriptions, cites original manuscripts that developed them for a more detailed description, and reports baseline control performance metrics. Furthermore, two example applications are presented: one illustrating different levels of control, from supervisory to low-level, and another demonstrating how Model Predictive Control (MPC) solutions must be adapted from continuous to integer to control some building actuators.

Zanetti, Ettore↗

The virial theorem and the dark matter problem in hybrid metric-Palatini gravity

Hybrid metric-Palatini gravity is a recently proposed theory, consisting of the superposition of the metric Einstein-Hilbert Lagrangian with an f(R) term constructed à la Palatini. The theory predicts the existence of a long-range scalar field, which passes the Solar System observational constraints, even if the scalar field is very light, and modifies the cosmological and galactic dynamics. Thus, the theory opens new possibilities to approach, in the same theoretical framework, the problems of both dark energy and dark matter. In this work, we consider the generalized virial theorem in the scalar-tensor representation of the hybrid metric-Palatini gravity. More specifically, taking into account the relativistic collisionless Boltzmann equation, we show that the supplementary geometric terms in the gravitational field equations provide an effective contribution to the gravitational potential energy. We show that the total virial mass is proportional to the effective mass associated with the new terms generated by the effective scalar field, and the baryonic mass. In addition to this, we also consider astrophysical applications of the model and show that the model predicts that the mass associated to the scalar field and its effects extend beyond the virial radius of the clusters of galaxies. In the context of the galaxy cluster velocity dispersion profiles predicted by the hybrid metric-Palatini model, the generalized virial theorem can be an efficient tool in observationally testing the viability of this class of generalized gravity models.

79 ASTRONOMY AND ASTROPHYSICS↗

Streamline integration as a method for two-dimensional elliptic grid generation

We propose a new numerical algorithm to construct a structured numerical elliptic grid of a doubly connected domain. Our method is applicable to domains with boundaries defined by two contour lines of a two-dimensional function. Furthermore, we can adapt any analytically given boundary aligned structured grid, which specifically includes polar and Cartesian grids. The resulting coordinate lines are orthogonal to the boundary. Grid points as well as the elements of the Jacobian matrix can be computed efficiently and up to machine precision. In the simplest case we construct conformal grids, yet with the help of weight functions and monitor metrics we can control the distribution of cells across the domain. Our algorithm is parallelizable and easy to implement with elementary numerical methods. We assess the quality of grids by considering both the distribution of cell sizes and the accuracy of the solution to elliptic problems. Among the tested grids these key properties are best fulfilled by the grid constructed with the monitor metric approach. - Graphical abstract: - Highlights: • Construct structured, elliptic numerical grids with elementary numerical methods. • Align coordinate lines with or make them orthogonal to the domain boundary. • Compute grid points and metric elements up to machine precision. • Control cell distribution by adaption functions or monitor metrics.

97 MATHEMATICS AND COMPUTING↗