Search NASA⌕ Search

SEARCH · Search NASA

Results for “test effectiveness”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Test effectiveness study report: An analytical study of system test effectiveness and reliability growth of three commercial spacecraft programs

Failure data from 16 commercial spacecraft were analyzed to evaluate failure trends, reliability growth, and effectiveness of tests. It was shown that the test programs were highly effective in ensuring a high level of in-orbit reliability. There was only a single catastrophic problem in 44 years of in-orbit operation on 12 spacecraft. The results also indicate that in-orbit failure rates are highly correlated with unit and systems test failure rates. The data suggest that test effectiveness estimates can be used to guide the content of a test program to ensure that in-orbit reliability goals are achieved.

Feldstein, J. F.↗

Testing effects of invasive fire ants and disturbance on ant communities of the longleaf pine ecosystem

Invasive species and habitat disturbance are among the most important drivers of biodiversity loss and ecological change. Their individual effects, however, are difficult to disentangle because invasion and disturbance are often intimately linked. Here we test alternative hypotheses to determine if the invasive red imported fire ant, Solenopsis invicta, is a ‘driver’ or simply a ‘passenger’ of ecological change in a longleaf pine ecosystem. We randomly assigned treatments of (1) unmanipulated, (2) soil disturbance, (3) fire ant removal and (4) soil disturbance + fire ant removal to experimental blocks and measured how ant communities changed over 2 years in thirty-six 15-m 2 plots. Additionally, fire ant abundance in removal plots averaged 42% lower in pitfall traps and 95% lower on baits compared to unmanipulated, control plots. Species richness of co-occurring ants also decreased 42% in removal plots, with significant changes in community composition. Soil disturbance alone did not affect ant communities. Fire ant diet breadth—measured using carbon and nitrogen stable isotopes—increased up to 4.7-fold in soil disturbance + removal plots (i.e. 0.84‰ 2 to 3.94‰ 2 ). While non-target impacts of the fire ant removal treatment complicate interpretation, our results suggest fire ants follow an alternative ‘interacting drivers’ model in which partial recovery of some species occurs when populations of an invasive species are reduced. Further recovery of native ants may be limited by persisting, landscape-level effects of fire ants suppressing co-occurring ants below historical levels.

60 APPLIED LIFE SCIENCES↗

Environmental Test Effectiveness

Environmental testing of spacecraft is described, with charts and examples from Voyager and Galileo testing at JPL. Types of environmental tests used include vacuum, vibration, and dynamic.

environmental testing spacecraft testing vacuum te↗

Is the testing effect ready to be put to work? Evidence from the laboratory to the classroom.

The testing effect refers to the benefits to retention that result from structuring learning activities in the form of a test. As educators consider implementing test-enhanced learning paradigms in real classroom environments, we think it is critical to consider how an array of factors affecting test-enhanced learning in laboratory studies bear on test-enhanced learning in real-world classroom environments. As such, this review discusses the degree to which test feedback, test format (of formative tests), number of tests, level of the test questions, timing of tests (relative to initial learning), and retention duration have import for testing effects in ecologically valid contexts (e.g., classroom studies). Attention is also devoted to characteristics of much laboratory testing-effect research that may limit translation to classroom environments, such as the complexity of the material being learned, the value of the testing effect relative to other generative learning activities in classrooms, an educational orientation that favors criterial tests focused on transfer of learning, and online instructional modalities. We consider how student-centric variables present in the classroom (e.g., cognitive abilities, motivation) may have bearing on the effects of testing-effect techniques implemented in the classroom. We conclude that the testing effect is a robust phenomenon that benefits a wide variety of learners in a broad array of learning domains. Still, studies are needed to compare the benefit of testing to other learning strategies, to further characterize how individual differences relate to testing benefits, and to examine whether testing benefits learners at advanced levels.

60 APPLIED LIFE SCIENCES↗

Using Cost-Effectiveness Tests to Design CHP Incentive Programs

This paper examines the structure of cost-effectiveness tests to illustrate how they can accurately reflect the costs and benefits of CHP systems. This paper begins with a general background discussion on cost-effectiveness analysis of DER and then describes how cost-effectiveness tests can be applied to CHP. Cost-effectiveness results are then calculated and analyzed for CHP projects in five states: Arkansas, Colorado, Iowa, Maryland, and North Carolina. Based on the results obtained for these five states, this paper offers four considerations to inform regulators in the application of cost-effectiveness tests in developing CHP programs.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Integral and Separate Effects Test Facilities To Support Water Cooled Small Modular Reactors: A Review

This study reviews previous experimental facilities and test programs relevant to water-cooled reactor system design and analysis to meet regulatory compliances. This study aims to find the best solution for designing the required experiments, obtaining necessary test data, and verifying the developed computer code/models to support the new reactor design and development while minimizing cost and time while leveraging experiences from previous facilities to minimize. Nuclear reactor licensing requires supportive design, analysis, and experimental results to ensure the safety of the full-scale prototype reactor in regular operation, as well as during postulated accident scenarios. These reactor design analyses are generally performed using system codes and other associated simulation tools that require assessment, verification and validation using an appropriate experimental dataset. Experimental facilities used for reactor system safety analysis and system code assessments are categorized into integral effects test (IET) and separate effects test (SET) facilities. Further, these IET and SET experiments and studies use geometrically scaled systems to reproduce the prototype system behavior at a reasonable cost, albeit with some scaling-related distortions. The design challenge of these model facilities is to identify and minimize scaling distortions while reproducing the most important operational phenomena in steady-state operation and in postulated accident scenarios. Lessons learned from previous experimental facilities, models, and correlations can support the development of new multipurpose, scaled, hybrid, integrated, and modular experimental facilities for advanced light water-cooled small modular reactors (SMRs). Successful operation of these facilities can significantly reduce upfront reactor development and demonstration costs and time to deployment.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Integral and Separate Effects Tests for Thermal Hydraulics Code Validation for Liquid-Salt Cooled Nuclear Reactors

The objective of the 3-year project was to collect integral effects test (IET) data to validate the RELAP5-3D code and other thermal hydraulics codes for use in predicting the transient thermal hydraulics response of liquid salt cooled reactor systems, including integral transient response for forced and natural circulation operation. The reference system for the project is a modular, 900-MWth Pebble Bed Advanced High Temperature Reactor (PB-AHTR), a specific type of Fluoride salt-cooled High temperature Reactor (FHR). Two experimental facilities were developed for thermal-hydraulic integral effects tests (IETs) and separate effects tests (SETs). The facilities use simulant fluids for the liquid fluoride salts, with very little distortion to the heat transfer and fluid dynamics behavior. The CIET Test Bay facility was designed, built, and operated. IET data for steady state and transient natural circulation was collected. SET data for convective heat transfer in pebble beds and straight channel geometries was collected. The facility continues to be operational and will be used for future experiments, and for component development. The CIET 2 facility is larger in scope, and its construction and operation has a longer timeline than the duration of this grant. The design for the CIET 2 facility has drawn heavily on the experience and data collected on the CIET Test Bay, and it was completed in parallel with operation of the CIET Test Bay. CIET 2 will demonstrate start-up and shut-down transients and control logic, in addition to LOFC and LOHS transients, and buoyant shut down rod operation during transients. Design of the CIET 2 Facility is complete, and engineering drawings have been submitted to an external vendor for outsourced quality controlled construction. CIET 2 construction and operation continue under another NEUP grant. IET data from both CIET facilities is to be used for validation of system codes used for FHR modeling, such as RELAP5-3D. A set of numerical models were developed in parallel to the experimental work. RELAP5-3D models were developed for the salt-cooled PB-AHTR, and for the simulat fluid CIET natural circulation experimental loop. These models are to be validated by the data collected from CIET. COMSOL finite element models were used to predict the temperature and fluid flow distribution in the annular pebble bed core; they were instrumental for design of SETs, and they can be used for code-to-code comparisons with RELAP5-3D. A number of other small SETs, and numerical models were constructed, as needed, in support of this work. The experiments were designed, constructed and performed to meet CAES quality assurance requirements for test planning, implementation, and documentation; equipment calibration and documentation, procurement document control; training and personnel qualification; analysis/modeling software verification and validation; data acquisition/collection and analysis; and peer review.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The NASA atomic oxygen effects test program

The NASA Atomic Oxygen Effects Test Program was established to compare the low earth orbital simulation characteristics of existing atomic oxygen test facilities and utilize the collective data from a multitude of simulation facilities to promote understanding of mechanisms and erosion yield dependence upon energy, flux, metastables, charge, and environmental species. Four materials chosen for this evaluation include Kapton HN polyimide, FEP Teflon, polyethylene, and graphite single crystals. The conditions and results of atomic oxygen exposure of these materials is reported by the participating organizations and then assembled to identify degrees of dependency of erosion yields that may not be observable from any single atomic oxygen low earth orbital simulation facility. To date, the program includes 30 test facilities. Characteristics of the participating test facilities and results to date are reported.

Banks, Bruce A.↗

Accelerating nuclear fuel development and qualification: Modeling and simulation integrated with separate-effects testing

In this work, an approach to transform and accelerate nuclear fuel development and qualification is outlined. The approach exploits advanced modeling and simulation at the outset to inform constituent and system selection and to enable integral fuel performance analyses. Analyses using these tools identify and prioritize the most important fuel performance parameters and phenomena for subsequent targeted characterization with separate-effects tests. Separate-effects testing spans out-of-pile and in-pile tests and is meant to iterate with and inform engineering-scale integral fuel performance analyses throughout the development process. Exercising this cycle in an agile fashion will increase confidence in the integral fuel performance predictions while reducing uncertainties. This process sets the stage for executing a much more limited set of well-defined integral irradiation tests designed to validate engineering-scale fuel performance codes and to confirm the performance and safety of the fuel system under prototypic conditions. This approach will reduce the time for development and qualification of a new fuel system, and it will also reduce associated costs.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

NDE Technology Development Program for Non-Visual Volumetric Inspection Technology; Sensor Effectiveness Testing Report

The Pacific Northwest National Laboratory (PNNL) located in Richland, Washington, hosted and administered Sensor Effectiveness Testing that allowed four different participants to demonstrate the NDE volumetric inspection technologies that were previously demonstrated during the Technology Screening session. This document provides a Sensor Effectiveness Testing report for the final part of Phase I of a three-phase NDE Technology Development Program designed to identify and mature a system or set of non-visual volumetric NDE technologies for Hanford DST primary liner bottom inspection. Phase I of the program will baseline the performance of current or emerging non-visual volumetric NDE technologies for their ability to detect and characterize primary liner bottom flaws, and identify candidate technologies for adaptation and maturation for Phase II of the program.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

SAM Code Validation using the Compact Integral Effects Test (CIET) Experimental Data

The primary objective of this study is to validate the system analysis code, SAM, using experimental data from the Compact Integral Effects Test (CIET) facility. The System Analysis Module (SAM) is an advanced and modern system analysis tool being developed at Argonne National Laboratory under the U.S. DOE Office of Nuclear Energy’s Nuclear Energy Advanced Modeling and Simulation (NEAMS) program. Originally aiming at supporting sodium fast reactor (SFR) design, it is now extended to cover other non-light water reactor (non-LWR) concepts, such as high-temperature gas-cooled reactor (HTGR) designs, molten salt-fueled, and molten salt-cooled reactor designs. To support SAM code development for the wide range of non-LWR applications, it is of paramount importance to validate the code against experiments relevant to these reactor concepts. The Compact Integral Effects Test (CIET) facility, which was designed to reproduce the thermal-hydraulics response of fluoride salt-cooled high-temperature reactors (FHR) under both forced- and natural-circulation conditions, has been identified and selected as one of benchmark test facilities for SAM code validation. Among available CIET experiments, three sets of them with distinctive characteristics were selected for SAM code validation purpose. The three sets experiments are: 1) Power step change transient tests; 2) DHX-DRACS natural circulation tests; and 3) heater frequency response tests. For all tests, steady-state or transient, SAM-predicted results show very good agreement with experimental data. The successful validation of SAM against these selected CIET experiments demonstrates that the computer code is well suited for thermal-hydraulics analysis of FHR designs.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Separate-Effects Tests for Studying Temperature-Gradient-Driven Cracking in UO 2 Pellets

We report a variety of normal operation and accident scenarios can generate thermal stresses large enough to cause cracking in light-water reactor (LWR) fuel pellets. Cracking of fuel pellets can lead to reduced heat removal, higher centerline temperatures, and localized stress in cladding, all of which impact fuel performance. It is important to experimentally characterize the thermal and mechanical behavior in the pellet before and after cracking to improve cracking models in fuel performance codes. However, in-reactor observation and measurement of cracking is very challenging due to the harsh environment and logistics. Recently, an experimental pellet cracking test stand was developed for separate effects testing of normal operations and accident temperature conditions, using thermal imaging to capture the pellet surface temperature for evaluation of thermal stresses and optical imaging to capture the evolution of cracking in real time. Experiments were performed using depleted uranium dioxide (UO 2 ) pellets, which are useful for collecting data valuable for development and validation of cracking models. A combination of induction and resistance heating was used to create an average temperature gradient of 236°C/cm and 193°C/cm before and after cracking respectively. Characterization of the pellets were done before as well as after cracking. The cracking patterns are somewhat different than those expected in a typical reactor because of the differences in thermal conditions and pellet microstructure. However, if the actual conditions of these experiments are reproduced in computational models, these out-of-pile tests on UO 2 pellets provide relevant data for modeling purposes.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A FREQUENCY RESPONSE APPROACH TO MODEL VALIDATION FOR THE COMPACT INTEGRAL EFFECTS TEST FACILITY IN TRANSFORM

One of the key challenges to licensing new reactor designs is validating the integral transient response models of a novel system. This work used a frequency response approach for model validation of the Compact Integral Effects Test (CIET) facility at the University of California, Berkeley. This facility was built as a scaled integral effects test for verifying transient modeling tools for fluoride-salt-cooled hightemperature reactors using Dowtherm A as a simulant fluid for molten salt. The dynamic system model of CIET was created using the Modelica-based TRANSFORM tool developed by Oak Ridge National Laboratory (ORNL). Analysis of the model’s performance as compared with experimental results indicates good agreement under both steady-state and transient conditions. This paper describes the Modelica model creation process using TRANSFORM and the modeling assumptions and methods for matching dynamic behavior with frequency response data. Results, analysis, and a discussion of future work are also presented.

De wet, Dane↗

Scaling and Design Analysis of a Sub-Scale, Reduced Temperature Stratified Flow Separate Effects Test Facility for the Experimental Investigation of Air Ingress in a High Temperature Reactor System

High temperature gas reactors (HTGR) are poised to spearhead the next generation of nuclear reactors, due to their passive safety characteristics and their applications flexibility. Able to provide base load power or process heat for industrial applications, HGTRs may be a critical component to reducing greenhouse gas emissions in the United States and abroad. However, increased interest and development has also highlighted areas requiring further investigation, one of which being the air-ingress accident. Air ingress may occur following a break in the coaxial cross duct and pressure vessel depressurization. The initial mode of ingress is hypothesized to be density driven cross flow as the cold air enters the lower plenum, at which point molecular diffusion and/or local buoyancy phenomena will dominate until a global natural circulation current is established. While computational simulations support this progression, little or no experimental data exists to validate and support this phenomenology. Therefore, it is necessary to generate such data; this research seeks to do so through the use of a sub-scale separate effects test facility - the Stratified Flow Separate Effects Test Facility (SFSETF). The goal of this facility is more specifically to focus on the transition to global natural circulation starting from air ingress after a double-ended guillotine break (DEGB) while neglecting depressurization. This paper will provide analyses performed in the design of this facility, including the geometric and hydraulic scaling analyses, safety analysis and instrumentation selection. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗