Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation of test systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Counter Unmanned Aerial Systems Testing: Evaluation of VIS SWIR MWIR and LWIR passive imagers.

This report contains analysis of unmanned aerial systems as imaged by visible, short-wave infrared, mid-wave infrared, and long-wave infrared passive devices. Testing was conducted at the Nevada National Security Site (NNSS) during the week of August 15, 2016. Target images in all spectral bands are shown and contrast versus background is reported. Calculations are performed to determine estimated pixels-on-target for detection and assessment levels, and the number of pixels needed to cover a hemisphere for detection or assessment at defined distances. Background clutter challenges are qualitatively discussed for different spectral bands, and low contrast scenarios are highlighted for long-wave infrared imagers.

47 OTHER INSTRUMENTATION↗

Helium Leak Test Data for System Evaluation

The test data in the flowing pages below has been created to ensure the maintenance conducted on the current MSHLD systems is satisfactory per ASNT Level III review. This is diagnostic test data only and it is intended to be used as a reference document.

36 MATERIALS SCIENCE↗

Lifecycle Management of Nuclear Security Radiation Detection Systems: Testing and Evaluation

The lifecycle of radiation detection systems functioning within a State’s Nuclear Security Detection Architecture encompasses all activities associated with acquisition, deployment, and eventual disposal. Throughout a system’s lifecycle, testing and evaluation activities are needed to ensure requirements are continually met, as underscored by recent experiences.This paper provides:1.A discussion of reasons why testing should be part of the radiation detection equipment lifecycle before, during, and after acquisition.2.A general process for determining applicable evaluation methods.3.A discussion of issues related to integrating testing and evaluation into procurement and operational processes and mitigation strategies.

Harris, Tyrone↗

Using an Advanced Distribution Management System Test Bed to Evaluate the Impact of Model Quality on Volt/VAR Optimization: Preprint

In this paper, we present a test bed for evaluating existing and future advanced distribution management system (ADMS) applications in a realistic laboratory setting, including other utility management systems and field equipment. We present an example of using it to evaluate the impact of the ADMS network model quality on a Volt/VAR optimization (VVO) application. The test bed integrates a commercial ADMS with a real-time simulation model of a utility distribution feeder. Representative power and controller hardware are integrated through hardware-in-the-loop (HIL) techniques. The performance of the ADMS VVO application is also evaluated for different levels of measurement density. Initial results indicate that a higher model quality achieves the highest possible energy savings while avoiding voltage violations, whereas a lower model quality results in increased energy savings but at the expense of more voltage violations.

ADMS↗

Review of Wave Energy Converter Power Take-Off Systems, Testing Practices, and Evaluation Metrics: Preprint

While the field of wave energy has been the subject of numerical simulation, scale model testing, and precommercial project testing for decades, wave energy technologies remain in the early stages of development and must continuing proving themselves as a promising modern renewable energy field. One of the difficulties that wave energy systems have been struggling to overcome is the design of highly efficient energy conversion systems that can convert the mechanical power, derived from the oscillation of wave activated bodies, into another useful product. Often the power take-off (PTO) is defined as the single unit responsible for converting mechanical power into another usable form such as electricity, pressurized fluid, compressed air, and others. The PTO, and the entire power conversion chain (PCC), is of great importance as it affects not only how efficient wave power is converted into electricity, but also contributes to the mass, size, structural dynamics, and levelized cost of energy (LCOE) of the wave energy converter (WEC). Unlike wind and solar, there is no industrial standard device, or devices, for wave energy conversion and this diversity is transferred to the PTO system. The majority of current WEC PTO systems incorporate a mechanical or hydraulic drive train, power generator, and an electrical control system. The challenge of WEC PTO designs is designing a mechanical-to-electrical component that can efficiently convert irregular, bi-directional, low frequency and low alternating velocity wave motions. While gross average power levels can be predicted in advance, the variable wave elevation input has to be converted into smooth electrical output and hence usually necessitates some type of energy storage system, such as battery storage, accumulator super capacitors, etc., or other means of compensation such as an array of devices. One of the primary challenges for wave energy converter systems is the fluctuating nature of wave resources, which require WEC components to be designed to handle loads (i.e. torques, forces, and powers) that are many times greater than the average load. This approach requires a much greater PTO capacity than the average power output and indicates a higher cost. In addition, supporting mechanical coupling and or gearing can be added to the PCC to help alleviate the difficulties with transmission and control of fluctuating large loads with low frequencies (indicative of wave forcing) into smaller loads at higher frequencies (optimum for conventional electrical machine design) can quickly increase the complexity of the PCC which could result in a greater number of failure modes and increased maintenance costs. All of the previous points demonstrate how the PTO influences WEC dynamics, reliability, performance and cost which are critical design factors. This paper further explores these topics by providing a review of the state-of-the-art PTO systems currently under development, how these novel PTO systems are tested and derisked prior to precommercial deployment, and the evaluation metrics historically used to differentiate between PTO designs and how they can be improved to support control co-design focused development of wave energy systems.

laboratory testing↗

A NOVEL TOOL FOR IMPROVING THE DATA COLLECTION PROCESS DURING CONTROL ROOM MODERNIZATION HUMAN-SYSTEM INTERFACE TESTING AND EVALUATION ACTIVITIES

The U.S. Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program is developing a scientific basis to extend the existing U.S. nuclear power plant (NPP) operating life beyond the current 60-year licensing period and to ensure NPP long-term reliability, productivity, safety, and security. Under the Advanced Instrumentation, Information, and Control (II&C) Systems Technologies pathway, the LWRS Program conducts targeted research and development to address long-term aging and obsolescence of existing instrumentation and control technologies, as well as to implement and test new digital II&C technology that enables broad innovation and business improvement in the NPP operating model. To this end, the role of human factors engineering (HFE) is important as part of ensuring that the control room modernization (CRM) activities account for the operator’s cognitive and physiological characteristics. Part of the HFE process for CRM entails conducting tests and evaluations (T&Es) that will inform the design of new human-system interface (HSI) technologies. Qualitative data that captures operator feedback and important human-system interactions are an important part of T&E. However, the analyzing this qualitative data in order to provide actionable design recommendations can be time-consuming and error prone. This paper presents an early version of a tool that can be used to analyze this qualitative data to (1) sift through freeform text for improved design issue identification, (2) maintain consistency in theme coding conventions, and (3) readily provide actionable design guidance that can be traceable to state-of-the-art HFE guidelines such as NUREG-0700. A description of this tool is discussed next.

99 GENERAL AND MISCELLANEOUS↗

A novel tool for improving the data collection process during control room modernization human-system interface testing and evaluation activities - 271

The U.S. Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program is developing a scientific basis to extend the existing U.S. nuclear power plant (NPP) operating life beyond the current 60-year licensing period and to ensure NPP long-term reliability, productivity, safety, and security. Under the Advanced Instrumentation, Information, and Control (II and C) Systems Technologies pathway, the LWRS Program conducts targeted research and development to address long-term aging and obsolescence of existing instrumentation and control technologies, as well as to implement and test new digital II and C technology that enables broad innovation and business improvement in the NPP operating model. To this end, the role of human factors engineering (HFE) is important as part of ensuring that the control room modernization (CRM) activities account for the operator's cognitive and physiological characteristics. Part of the HFE process for CRM entails conducting tests and evaluations (T and Es) that will inform the design of new human-system interface (HSI) technologies. Qualitative data that captures operator feedback and important human-system interactions are an important part of T and E. However, the analyzing this qualitative data in order to provide actionable design recommendations can be time-consuming and error prone. This paper presents an early version of a tool, which uses a combination of natural language processing and supervised machine learning to support the analysis of qualitative data. The objectives of this tool is to improve the process of (1) sifting through freeform text for improved design issue identification, (2) maintaining consistency in theme coding conventions, and (3) readily providing actionable design guidance that can be traceable to state-of-the-art HFE guidelines such as NUREG-0700. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Test and Evaluation of Systems with Embedded Machine Learning Components

As Machine Learning (ML) continues to advance, it is being integrated into more systems. Often, the ML component represents a significant portion of the system that reduces the burden on the end user or significantly improves task performance. However, the ML component represents an unknown complex phenomenon that is learned from collected data without the need to be explicitly programmed. Despite the improvement in task performance, the models are often black boxes. Evaluating the credibility and the vulnerabilities of ML models poses a gap in current test and evaluation practice. For high consequence applications, the lack of testing and evaluation procedures represents a significant source of uncertainty and risk. To help reduce that risk, here we present considerations to evaluate systems embedded with an ML component within a red-teaming inspired methodology. We focus on (1) cyber vulnerabilities to an ML model, (2) evaluating performance gaps, and (3) adversarial ML vulnerabilities.

97 MATHEMATICS AND COMPUTING↗

A Test Bed to Evaluate Advanced Distribution Management Systems for Modern Power Systems

This paper presents a test bed that utilities, vendors, and researchers can use to evaluate the performance of existing and emerging advanced distribution management systems (ADMS) or specific applications of such systems. The test bed provides a realistic laboratory test setting, including detailed modeling of the power system, controller and/or power hardware, and industry-standard communication protocols. The test bed can further represent the current state of a specific utility's distribution system or the anticipated state with increased penetrations of distributed energy resources, such as rooftop photovoltaic systems, residential battery energy storage systems, electric vehicles, and loads with smart controls. The paper describes the design and implementation of the test bed. We present two use cases of the test bed and preliminary results for these two use cases. We also discuss upcoming and potential future use cases. Results from test bed experiments are intended to accelerate industry deployment of ADMS technologies and advance development of ADMS capabilities.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A Test Bed to Evaluate Advanced Distribution Management Systems for Modern Power Systems: Preprint

This paper presents a test bed that utilities, vendors, and researchers can use to evaluate the performance of existing and emerging advanced distribution management systems (ADMS) or specific applications of such systems. The test bed provides a realistic laboratory test setting, including detailed modeling of the power system, controller and/or power hardware, and industry-standard communication protocols. The test bed can further represent the current state of a specific utility's distribution system or the anticipated state with increased penetrations of distributed energy resources, such as rooftop photovoltaic systems, residential battery energy storage systems, electric vehicles, and loads with smart controls. The paper describes the design and implementation of the test bed. We present two use cases of the test bed and preliminary results for these two use cases. We also discuss upcoming and potential future use cases. Results from test bed experiments can be used to accelerate industry deployment of ADMS technologies and advance development of ADMS capabilities.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Automating High-Precision X-Ray and Neutron Imaging Applications with Robotics

Los Alamos National Laboratory and the University of Texas at Austin recently implemented a robotically controlled nondestructive testing (NDT) system for X-ray and neutron imaging. This system is intended to address the need for accurate measurements for a variety of parts and, be able to track measurement geometry at every imaging location, and is designed for high-throughput applications. This system was deployed in a beam port at a nuclear research reactor and in an operational inspection X-ray bay. The nuclear research reactor system consisted of a precision industrial seven-axis robot, 1.1-MW TRIGA research reactor, and a scintillator-mirror-camera-based imaging system. The X-ray bay system incorporated the same robot, a 225-keV microfocus X-ray source, and a custom flat panel digital detector. The robotic positioning arm is programmable and allows imaging in multiple configurations, including planar, cylindrical, as well as other user defined geometries that provide enhanced engineering evaluation capability. The imaging acquisition device is coupled with the robot for automated image acquisition. The robot can achieve target positional repeatability within 17 μm in the 3-D space. Flexible automation with nondestructive imaging saves costs, reduces dosage, adds imaging techniques, and achieves better quality results in less time. Specifics regarding the robotic system and imaging acquisition and evaluation processes are presented. In conclusion, this paper reviews the comprehensive testing and system evaluation to affirm the feasibility of robotic NDT, presents the system configuration, and reviews results for both X-ray and neutron radiography imaging applications.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗