Search NASA⌕ Search

SEARCH · Search NASA

Results for “Testing metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

TPSAS-NF1676L-35855-DND

UAM Noise Exploratory Meeting (April ’18): there is positive interest in forming a focused working group to define and address noise goals for UAM vehicles. Participants should include stakeholders across industry, government agencies, academia, and community groups; focus efforts on reducing or eliminating the barriers associated with community noise. Key topics of interest include: Tools & Technologies Ground & Flight Testing Human Response & Metrics Regulation & Community Outreach

Stephen A Rizzi↗
NASA NTRS2004

Mars Exploration Rover (MER) project environmental assurance program

This paper presents a comprehensive summary of the environmental assurance program for the MER project. A series of test and analysis metrics are generated. Selections of the numerous lessons that have been learned from implementation of the MER environmental assurance program are documented in this paper. They include both technical and programmatic lessons that would be helpful in improving implementation of the environmental program for future projects.

Hoffman, Alan R↗
NASA NTRSDate not supplied

Commercial Supersonic Fan Noise Modeling

This presentation describes the development of an empirical noise model for a two-stage fan designed for a supersonic commercial aircraft. The existing fan noise models are reviewed and compared with noise data from a wind tunnel experiment where a model scale two-stage fan was tested. An error metric was developed to quantify how well the measurements and empirical model match. This error metric was then used to determine new coefficients and parameters for a version of the fan model that is a good match for the experimental data.

supersonics, acoustics, turbofan↗
NASA NTRSDate not supplied

The International Space Station, Optical Communications, and Delay Tolerant Networking: Towards A Solar System Internet Architecture

As Delay Tolerant Networking (DTN) matures as a software product its use cases have extended to infrastructural and architectural studies, bringing DTN closer to a widespread, operational technology. While it is known that a DTN can be configured, given complete information about a system of nodes, to provision a system with a complete network capability, what remains is to tackle practical considerations such as scalability, networking best practices, and how to establish service providers. In this paper, we document progress towards a scalable DTN architecture that was tested across multiple organizational and project boundaries; our approach was tested across nodes flying on the International Space Station (ISS) connected to a ground network. The network consists of four main network areas: the ISS, the White Sands Complex (WSC), the Mission Cloud Platform (MCP), and NASA’s Huntsville Operations Support Center (HOSC). The connections on the ground (WSC, MCP, and HOSC) are straightforward technically, but represent administrative and non-technical challenges that had to be overcome. The connection from the ISS to WSC was realized through a hybrid optical/RF means. In particular, NASA’s Integrated Laser Communications Relay Demonstration (LCRD) can form a relay from lowEarth-orbit (LEO) to the Earth, and was used in conjunction with the LCRD LEO User Modem and Amplifier Terminal (ILLUMA-T) on the ISS to form a link to one of three geographically diverse ground stations. A major goal was to achieve communications while keeping the ISS nodes unaware of ground station choices and scheduling. These disparate links were networked using High-rate DTN (HDTN), which enabled the desired architecture. The network architecture, tests, HDTN performance metrics, and general observations made are all discussed in detail, including a discussion on the successful utilization of the DTN security standard known as DTN Bundle Protocol Security (BPSec). We conclude with suggestions for next steps, and in particular focus on extending this architecture to the Near Space Network (NSN) and the upcoming LunaNet.

Alan Hylton↗
NASA NTRSDate not supplied

Rapid Aero Modeling for Urban Air Mobility Aircraft in Computational Experiments

Rapid Aero Modeling (RAM) applied to computational testing, RAM-C, is an approach to efficiently and automatically obtain aerodynamic models during computational investigations. RAM-C is designed to estimate models appropriate for flight dynamics studies and simulations. The approach responds to a demand for experimental efficiency and model fidelity that has increased with growing aircraft complexity and aerodynamic nonlinearities associated with hybrid and electric vertical takeoff and landing (eVTOL) aircraft. In an Urban Air Mobility (UAM) transportation system, it is expected that aircraft will embrace many features from both airplanes and rotorcraft. These vehicles present many more factors than conventional aircraft which can lead to increased computational costs and missed key factor interactions when applying traditional testing and modeling methods. RAM-C provides feedback loops around computational codes to rapidly guide testing toward aerodynamic models meeting user-defined fidelity goals. It combines and extends concepts from design of experiment theory and aircraft system identification theory that allow the user the freedom to choose, in advance of the test, a specific level of fidelity in terms of prediction error. RAM-C only collects enough data required to meet the user-specified prediction error requirements thus saving computational time and resources. The overall achievable fidelity of the final model also depends on the accuracy of the test facility, or in this case, the computational modeling approach. Previous studies to support development of the RAM-T process were conducted in wind tunnel tests to assess potential metrics, algorithms, and procedures. This paper presents results from the next steps taken and tests conducted for the development of RAM-C technology and highlights some of the unique features of RAM applied eVTOL configurations in a computational study.

Aerodynamics↗
NASA NTRS1985

Preliminary evaluation of a micro-based repeated measures testing system

A need exists for an automated performance test system to study the effects of various treatments which are of interest to the aerospace medical community, i.e., the effects of drugs and environmental stress. The ethics and pragmatics of such assessment demand that repeated measures in small groups of subjects be the customary research paradigm. Test stability, reliability-efficiency and factor structure take on extreme significance; in a program of study by the U.S. Navy, 80 percent of 150 tests failed to meet minimum metric requirements. The best is being programmed on a portable microprocessor and administered along with tests in their original formats in order to examine their metric properties in the computerized mode. Twenty subjects have been tested over four replications on a 6.0 minute computerized battery (six tests) and which compared with five paper and pencil marker tests. All tests achieved stability within the four test sessions, reliability-efficiencies were high (r greater than .707 for three minutes testing), and the computerized tests were largely comparable to the paper and pencil version from which they were derived. This computerized performance test system is portable, inexpensive and rugged.

Kennedy, Robert S.↗
DOE OSTI2020

Developing Flexible, Networked Lighting Control Systems That Reliably Save Energy in California Buildings

An important strategy to meet California's ambitious energy efficiency goals is to use innovative wireless communications, embedded sensors, data analytics and controls to significantly reduce lighting energy use in commercial buildings. This project developed a suite of networked lighting solutions to further this goal. The technologies include a platform for low-cost sensing, distributed intelligence and communications, the “PermaMote,” which is a self-powered sensor and controller for lighting applications. The project team also developed a task ambient daylighting system that integrates sensors with data-driven daylighting control using an open communication interface, called the “Readings-At-Desk” (RAD) system. To address the problem of building occupants being confused about how to operate traditional lighting control systems, the research team created content that could be the basis for a user interface standard for lighting controls. Finally, to address the difficulty of ensuring that advanced lighting control systems actually deliver their promised energy savings, the project team developed a new method for evaluating and specifying lighting systems’ performance. The research team validated these technologies in the laboratory, showing significant lighting energy savings, up to 73% for the PermaMote sensor system from occupancy control and daylight dimming features, compared to the same light source (LED replacement lamps) operated via simple on/off scheduling. The project team also developed a proposed standard lighting data model and user interface elements, which were contributed to the ANSI Lighting Systems Committee (C137) for standardization. Existing data models are incomplete and inconsistent, whereas the lighting-specific data model developed here is clear and comprehensive, to serve as a starting point for creating common, universally agreed upon semantic definitions of key lighting parameters, to promote interoperability. For the task on verifiable performance of lighting systems, the project team developed a more effective metric for capturing the actual energy impact of a lighting system over time — the energy usage intensity (kWh/ft2/year). Three commercial lighting systems were tested in FLEXLAB® using this new metric, and the tests show a wide range in the accuracy of the self-reported energy-use metric, from 0.5% to 28% error compared to direct measurement of lighting energy using dedicated submeters. Overall, the project team estimates that these advanced technologies can reduce California office lighting energy use by 20% (above and beyond normal advanced lighting controls mandated by Title 24), resulting in about 1,600 GWh/year in savings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2019

Performance Metric for Cementitious Waste Form Inventory Release in the Integrated Disposal Facility

This report describes work supporting Phase 1 of the 2018 Department of Energy (DOE) Office of River Protection’s (ORP) Grand Challenge recipient proposal “Cementitious Immobilization of Treated LAW and Ancillary Benefits to Risk Reduction in Cross Site Transfer”. Phase 1 was to establish a performance metric for grout leachability against which laboratory leach data (as observed diffusivities) can be assed, followed by a comparison of historical test data against this metric. Historically, advancements in the cementitious (grout) waste form performance have been made over the last 40 years, with the majority of progress achieved within the past 8 years as part of the Washington River Protection Solutions, LLC testing program. This report presents a summary of that effort relevant to the Hanford Site.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS2017

Kepler Planet Detection Metrics: Per-Target Flux-Level Transit Injection Tests of TPS for Data Release 25

Quantifying the ability of a transiting planet survey to recover transit signals has commonly been accomplished through Monte-Carlo injection of transit signals into the observed data and subsequent running of the signal search algorithm (Gilliland et al., 2000; Weldrake et al., 2005; Burke et al., 2006). In order to characterize the performance of the Kepler pipeline (Twicken et al., 2016; Jenkins et al., 2017) on a sample of over 200,000 stars, two complementary injection and recovery tests are utilized:1. Injection of a single transit signal per target into the image or pixel-level data, hereafter referred to as pixel-level transit injection (PLTI), with subsequent processing through the Photometric Analysis (PA), Presearch Data Conditioning (PDC), Transiting Planet Search (TPS), and Data Validation (DV) modules of the Kepler pipeline. The PLTI quantification of the Kepler pipeline's completeness has been described previously by Christiansen et al. (2015, 2016); the completeness of the final SOC 9.3 Kepler pipeline acting on the Data Release 25 (DR25) light curves is described by Christiansen (2017).2. Injection of multiple transit signals per target into the normalized flux time series data with a subsequent transit search using a stream-lined version of the Transiting Planet Search (TPS) module. This test, hereafter referred to as flux-level transit injection (FLTI), is the subject of this document. By running a heavily modified version of TPS, FLTI is able to perform many injections on selected targets and determine in some detail which injected signals are recoverable. Significant numerical efficiency gains are enabled by precomputing the data conditioning steps at the onset of TPS and limiting the search parameter space (i.e., orbital period, transit duration, and ephemeris zero-point) to a small region around each injected transit signal.The PLTI test has the advantage that it follows transit signals through all processing steps of the Kepler pipeline, and the recovered signals can be further classified as planet candidates or false positives in the exact same manner as detections from the nominal (i.e., observed) pipeline run (Twicken et al., 2016, Thompson et al., in preparation). To date, the PLTI test has been the standard means of measuring pipeline completeness averaged over large samples of targets (Christiansen et al., 2015, 2016; Christiansen, 2017). However, since the PLTI test uses only one injection per target, it does not elucidate individual-target variations in pipeline completeness due to differences in stellar properties or astrophysical variability. Thus, we developed the FLTI test to provide a numerically efficient way to fully map individual targets and explore the performance of the pipeline in greater detail. The FLTI tests thereby allow a thorough validation of the pipeline completeness models (such as window function (Burke and Catanzarite, 2017a), detection efficiency (Burke Catanzarite, 2017b), etc.) across the spectrum of Kepler targets (i.e., various astrophysical phenomena and differences in instrumental noise). Tests during development of the FLTI capability revealed that there are significant target-to-target variations in the detection efficiency.

DR25↗
NASA NTRSDate not supplied

High-Altitude ADS-B/GPS LPV Flight Tests on a NASA ER-2 Research Airplane

The research presented in this paper describes the conceptual design of a system architecture that integrates Automatic Dependent Surveillance-Broadcast (ADS-B) and Global Positioning System (GPS) Localizer Performance Vertical (LPV) guidance technology onto a unique high-altitude research airplane: a United States Air Force (USAF) / Lockheed Martin (Bethesda, Maryland) Aeronautics U-2S airplane. The design features modern display capabilities to provide air-to-air surveillance and precision navigation, to adhere to Federal Aviation Administration (FAA) certification standards for operations in upper Class E airspace. The National Aeronautics and Space Administration (NASA) variant of the U-2S, now called the Earth Resources (ER-2) airplane, remains unrivaled in the art of sustained high-altitude flight for scientific expeditions. Capable of routinely cruising above flight level (FL) 650 that had been considered, at inception, the domain of only the most elite experimental research aircraft types. Nicknamed the Dragon Lady, this U-2S research testbed is still one of the most advanced aircraft in the world. The exceptional military design of the vehicle, security guidelines, and the performance envelope of the ER-2 posed unique challenges to the integration of modern civilian avionics. ADS-B epitomizes the next generation of surveillance technology, incorporating both air and ground aspects. ADS-B provides air traffic control (ATC) with a more accurate picture of the three-dimensional positioning of aircraft in various phases of flight, including en route, terminal, approach, and ground operations. The airborne surveillance system broadcasts its identification, position, altitude, velocity, and other information. GPS LPV represents a significant advancement in aviation technology, emphasizing the pivotal role that GPS and Performance-Based Navigation concepts will play in the foreseeable future. This technology represents a shift from sensor-based navigation to performance-based navigation, allowing for more flexible and efficient use of airspace. This research described herein is structured as follows: Section II, “Systems Background,” provides a systems background and description of an ADS-B and GPS LPV system equipped on the high-altitude ER-2 research airplane to satisfy the FAA airworthiness requirements for high-altitude flight operations. Section III, “Flight Test System,” describes the flight-test airplane systems. Section IV, “Analysis of GPS SBAS, Safety, and Ground Tests,” provides an overview of the GPS Satellite-Based Augmentation System (SBAS) and an analysis of the GPS LPV metrics, safety, and ground tests. Section V, “High-Altitude Flight Tests,” describes the high-altitude flight tests, including 3 flight-test results, analysis, human factors, and lessons learned. Section VI, the conclusion, draws insights from the lessons learned, discusses the design challenges associated with ADS-B and GPS LPV, and showcases the paramount significance of these pivotal technologies in aircraft surveillance and navigation.

Ricardo A. Arteaga↗
NASA NTRS1995

Rotorcraft flight control design using quantitative feedback theory and dynamic crossfeeds

A multi-input, multi-output controls design with robust crossfeeds is presented for a rotorcraft in near-hovering flight using quantitative feedback theory (QFT). Decoupling criteria are developed for dynamic crossfeed design and implementation. Frequency dependent performance metrics focusing on piloted flight are developed and tested on 23 flight configurations. The metrics show that the resulting design is superior to alternative control system designs using conventional fixed-gain crossfeeds and to feedback-only designs which rely on high gains to suppress undesired off-axis responses. The use of dynamic, robust crossfeeds prior to the QFT design reduces the magnitude of required feedback gain and results in performance that meets current handling qualities specifications relative to the decoupling of off-axis responses. The combined effect of the QFT feedback design following the implementation of low-order, dynamic crossfeed compensator successfully decouples ten of twelve off-axis channels. For the other two channels it was not possible to find a single, low-order crossfeed that was effective.

Cheng, Rendy P.↗
NASA NTRS2001

The Application of Time-Frequency Methods to HUMS

This paper reports the study of four time-frequency transforms applied to vibration signals and presents a new metric for comparing them for fault detection. The four methods to be described and compared are the Short Time Frequency Transform (STFT), the Choi-Williams Distribution (WV-CW), the Continuous Wavelet Transform (CWT) and the Discrete Wavelet Transform (DWT). Vibration data of bevel gear tooth fatigue cracks, under a variety of operating load levels, are analyzed using these methods. The new metric for automatic fault detection is developed and can be produced from any systematic numerical representation of the vibration signals. This new metric reveals indications of gear damage with all of the methods on this data set. Analysis with the CWT detects mechanical problems with the test rig not found with the other transforms. The WV-CW and CWT use considerably more resources than the STFT and the DWT. More testing of the new metric is needed to determine its value for automatic fault detection and to develop methods of setting the threshold for the metric.

Pryor, Anna H.↗
DOE OSTI2021

Selecting and Implementing Resilience Metrics in Existing Energy Sector Models [Slides]

Resilience is a topic receiving much attention in relation to energy systems, with particular attention being paid to the supply of electricity. As a result of the growing interest in energy sector resilience, research communities have proposed a plethora of candidate resilience indicators and metrics, most of which remain immature at different scales and segments within the energy system. A necessary focus of the research community lies in implementing, testing, and validating resilience metrics and analysis approaches in energy sector models, which will be invaluable for informing resilience planning and investment decisions. Recognizing these challenges that need to be addressed, we explore how to effectively integrate resilience considerations into energy sector models and tools. The overarching goal of the effort was to evaluate the data needs, methodologies, and outcomes - including consequences and/or changes in investment or operational decisions due to avoided consequences - based on resilience analysis in a range of existing tools. In particular, we selected five models originally built at NREL to explore non-resilience energy research questions to implement and exercise resilience metrics and analysis approaches. To demonstrate the importance of perspective, we selected models that represent different segments of the energy sector, geographic scales, and modeling approaches. A second important aspect of our effort was the development of generalized power interruption scenarios. These scenarios were intended to help establish a framework for simulating the effects of real-world threats in terms of their impacts on system components and, in turn, power interruption.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Adapting Existing Energy Models for Resilience Analysis

Resilience is a topic receiving much attention in relation to energy systems, with particular attention being paid to the supply of electricity. As a result of the growing interest in energy sector resilience, research communities have proposed a plethora of candidate resilience indicators and metrics, most of which remain immature at different scales and segments within the energy system. A necessary focus of the research community lies in implementing, testing, and validating resilience metrics and analysis approaches in energy sector models, which will be invaluable for informing resilience planning and investment decisions. Recognizing these challenges that need to be addressed, we explore how to effectively integrate resilience considerations into energy sector models and tools. The overarching goal of the effort was to evaluate the data needs, methodologies, and outcomes—including consequences and/or changes in investment or operational decisions due to avoided consequences—based on resilience analysis in a range of existing tools. In particular, we selected five models originally built at NREL to explore non-resilience energy research questions to implement and exercise resilience metrics and analysis approaches. To demonstrate the importance of perspective, we selected models that represent different segments of the energy sector, geographic scales, and modeling approaches. A second important aspect of our effort was the development of generalized power interruption scenarios. These scenarios were intended to help establish a framework for simulating the effects of real-world threats in terms of their impacts on system components and, in turn, power interruption.

ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS2020

Urban Air Mobility Noise: Current Practice, Gaps, and Recommendations

In 2018, NASA formed an Urban Air Mobility Noise Working Group to assemble noise experts from industry, universities and government agencies to identify, discuss, and address urban air mobility (UAM) noise issues. This paper presents a set of high-level goals intended to address barriers associated with UAM noise that may hamper their entry into service. It summarizes the current practice, identifies gaps in the current practice, and makes recommendations to address the gaps to achieve the high-level goals in four areas of interest: Tools and Technologies, Ground and Flight Testing, Human Response and Metrics, and Regulation and Policy.

urban air mobility↗
DOE OSTI2025

HFIR High Power HEU Neutronics Analyses

Department of Energy National Nuclear Security Administration Office of Material Management and Minimization’s mission includes the conversion of civilian research reactors from highly enriched uranium (HEU) to low-enriched uranium (LEU) fuel. Analyses have shown that the Oak Ridge National Laboratory High Flux Isotope Reactor (HFIR) will need to operate at 95 MW for the LEU silicide dispersion fuel designs to match key performance metrics obtained with HEU fuel at 85 MW. To prove safe operation of HFIR after installation of plant modifications to increase power, a high power HEU test cycle was proposed. Neutronics model updates and reactor physics analyses are performed to support the development of safety design reports for the high power (HP) HEU test cycle. Reactor physics metrics evaluated herein include fuel depletion, actinide production, cycle length, fission rate density distributions, axial power peaking factors, and reactor kinetic parameters. These reactor physics analyses support the development of future LEU safety design reports by providing key input for future HP HEU HFIR thermal hydraulics and reactor transient safety analyses.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
NASA NTRS2004

Optical design for the Laser Astrometric Test of Relativity

This paper discusses the Laser Astrometric Test of Relativity (LATOR) mission. LATOR is a Michelson-Morley-type experiment designed to test the pure tensor metric nature of gravitation the fundamental postulate of Einstein's theory of general relativity. With its focus on gravity's action on light propagation it complements other tests which rely on the gravitational dynamics of bodies.

Laser Astrometric Test of Relativity (LATOR)↗