Search NASA⌕ Search

SEARCH · Search NASA

Results for “test and evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Background Radiation Survey of the Radiological/Nuclear Countermeasures Test and Evaluation Center

In preparation for operations at the Radiological/Nuclear Countermeasures Test and Evaluation Complex (Rad/NucCTEC), the Department of Homeland Security Domestic Nuclear Detection Office (DHS/DNDO) requested that personnel from the Remote Sensing Laboratory (RSL) conduct a survey of the present radiological conditions at the facility. The measurements consist of the exposure rate from a high-pressure ion chamber (HPIC), high-resolution spectra from a high-purity germanium (HPGe) system in an in situ configuration, and low-resolution spectra from a sodium iodide (NaI) detector in a radiation detection backpack. Measurements with these systems were collected at discrete locations within the facility. Measurements were also collected by carrying the VECTOR backpack throughout the complex to generate a map of the entire area. The area was also to be surveyed with the Kiwi (an array of eight-2-inch x 4-inch x 16-inch NaI detectors) from the Aerial Measuring Systems; however, conflicts with test preparation activities at the site prevented this from being accomplished.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

The Need for Precise and Well-documented Experimental Data on Prompt Fission Neutron Spectra from Neutron-induced Fission of {sup 239}Pu

The spectrum of neutrons emitted promptly after {sup 239}Pu(n,f)—a so-called prompt fission neutron spectrum (PFNS)—is a quantity of high interest, for instance, for reactor physics and global security. However, there are only few experimental data sets available that are suitable for evaluations. In addition, some of those data sets differ by more than their 1-σ uncertainty boundaries. We present the results of MCNP studies indicating that these differences are partly caused by underestimated multiple scattering contributions, over-corrected background, and inconsistent deconvolution methods. A detailed uncertainty quantification for suitable experimental data was undertaken including these effects, and test-evaluations were performed with the improved uncertainty information. The test-evaluations illustrate that the inadequately estimated effects and detailed uncertainty quantification have an impact on the evaluated PFNS and associated uncertainties as well as the neutron multiplicity of selected critical assemblies. A summary of data and documentation needs to improve the quality of the experimental database is provided based on the results of simulations and test-evaluations. Given the possibly substantial distortion of the PFNS by multiple scattering and background effects, special care should be taken to reduce these effects in future measurements, e.g., by measuring the {sup 239}Pu PFNS as a ratio to either the {sup 235}U or {sup 252}Cf PFNS.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Test and Evaluation of Systems with Embedded Machine Learning Components

As Machine Learning (ML) continues to advance, it is being integrated into more systems. Often, the ML component represents a significant portion of the system that reduces the burden on the end user or significantly improves task performance. However, the ML component represents an unknown complex phenomenon that is learned from collected data without the need to be explicitly programmed. Despite the improvement in task performance, the models are often black boxes. Evaluating the credibility and the vulnerabilities of ML models poses a gap in current test and evaluation practice. For high consequence applications, the lack of testing and evaluation procedures represents a significant source of uncertainty and risk. To help reduce that risk, here we present considerations to evaluate systems embedded with an ML component within a red-teaming inspired methodology. We focus on (1) cyber vulnerabilities to an ML model, (2) evaluating performance gaps, and (3) adversarial ML vulnerabilities.

97 MATHEMATICS AND COMPUTING↗

Timescale Correlation between Marine Atmospheric Exposure and Accelerated Corrosion Testing

Evaluation of metal-based structures has long relied on atmospheric exposure test sites to determine corrosion resistance in marine environments. Traditional accelerated corrosion testing relies on mimicking the exposure conditions, often incorporating salt spray and ultraviolet (UV) radiation, and exposing the metal to continuous or cyclic conditions of the corrosive environment. Their success for correlation to atmospheric exposure is often a concern when determining the timescale to which the accelerated tests can be related. Accelerated laboratory testing, which often focuses on the electrochemical reactions that occur during corrosion conditions, has yet to be universally accepted as a useful tool in predicting the long term service life of a metal despite its ability to rapidly induce corrosion. Although visual and mass loss methods of evaluating corrosion are the standard and their use is imperative, a method that correlates timescales from atmospheric exposure to accelerated testing would be very valuable. This work uses surface chemistry to interpret the chemical changes occurring on low carbon steel during atmospheric and accelerated corrosion conditions with the objective of finding a correlation between its accelerated and long-term corrosion performance. The current results of correlating data from marine atmospheric exposure conditions at the Kennedy Space Center beachside corrosion test site, alternating seawater spray, and immersion in typical electrochemical laboratory conditions, will be presented. Key words: atmospheric exposure, accelerated corrosion testing, alternating seawater spray, marine, correlation, seawater, carbon steel, long-term corrosion performance prediction, X-ray photoelectron spectroscopy.

Montgomery, Eliza L.↗

Second Line of Defense Megaports Initiative Operational Testing and Evaluation Plan Colon Container Terminal (CCT) Panama

Report on the Operational Testing and Evaluation to validate and baseline an operable system that meets the Second Line of Defense (SLD) mission requirements. An SLD system is defined as the detection technology and associated equipment, the system operators from the host country, the standard operating procedures (SOPs), and other elements such as training and maintenance which support long-term system sustainment. To this end, the activities conducted during the OT&E phase must demonstrate that the Megaports System can be operated effectively in real-time by Panama Direccion General de Aduanas (DGA Panama Customs) personnel to the standards of the U.S. Department of Energy/National Nuclear Security Administration (DOE/NNSA).

99 GENERAL AND MISCELLANEOUS↗

Ship Motion Testing Needs Evaluation

The American Bureau of Shipping performed an evaluation of national maritime nuclear testing capabilities and determined there currently is an inability to test maritime nuclear power plants in a ship motion environment. A Ship Motion Test Facility (SMTF) is proposed to fill this gap. To inform design of this facility, this report documents an evaluation performed by a panel of technical experts that identifies key physical phenomena associated with maritime nuclear power plant operation that are important to safety and reliability and have a low state of knowledge. This evaluation concluded that all of the major test needs to understand a nuclear plant's behavior in a ship motion environment are for thermal-hydraulics related phenomena. Based on this finding, the evaluation panel concluded that the SMTF would not be required to use nuclear fuel to provide a heat source for the fluids. This would significantly decrease the cost, timeline, and complexity for this test facility to enable the advancement of maritime nuclear technology.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Strain gage system evaluation program

A program was conducted to determine the reliability of various strain gage systems when applied to rotating compressor blades in an aircraft gas turbine engine. A survey of current technology strain gage systems was conducted to provide a basis for selecting candidate systems for evaluation. Testing and evaluation was conducted in an F 100 engine. Sixty strain gage systems of seven different designs were installed on the first and third stages of an F 100 engine fan. Nineteen strain gage failures occurred during 62 hours of engine operation, for a survival rate of 68 percent. Of the failures, 16 occurred at blade-to-disk leadwire jumps (84 percent), two at a leadwire splice (11 percent), and one at a gage splice (5 percent). Effects of erosion, temperature, G-loading, and stress levels are discussed. Results of a post-test analysis of the individual components of each strain gage system are presented.

Dolleris, G. W.↗

Testing for Software Safety

This research focuses on testing whether or not the hazardous conditions identified by design-level fault tree analysis will occur in the target implementation. Part 1: Integrate fault tree models into functional specifications so as to identify testable interactions between intended behaviors and hazardous conditions. Part 2: Develop a test generator that produces not only functional tests but also safety tests for a target implementation in a cost-effective way. Part 3: Develop a testing environment for executing generated functional and safety tests and evaluating test results against expected behaviors or hazardous conditions. It includes a test harness as well as an environment simulation of external events and conditions.

Chen, Ken↗

The 2010 Desert Rats Science Operations Test: Outcomes and Lessons Learned

The Desert RATS 2010 Team tested a variety of science operations management techniques, applying experience gained during the manned Apollo missions and the robotic Mars missions. This test assessed integrated science operations management of human planetary exploration using real-time, tactical science operations to oversee daily crew science activities, and a night shift strategic science operations team to conduct strategic level assessment of science data and daily traverse results. In addition, an attempt was made to collect numerical metric data on the outcome of the science operations to assist test evaluation. The two most important outcomes were 1) the production of significant (almost overwhelming) volume of data produced during daily traverse operations with two rovers, advanced imaging systems and well trained, scientifically proficient crew-members, and 2) the degree to which the tactical team s interaction with the surface crew enhanced science return. This interaction depended on continuous real-time voice and data communications, and the quality of science return from any human planetary exploration mission will be based strongly on the aggregate interaction between a well trained surface crew and a dedicated science operations support team using voice and imaging data from a planet s surface. In addition, the scientific insight developed by both the science operations team and the crews could not be measurable by simple numerical quantities, and its value will be missed by a purely metric-based evaluation of test outcome. In particular, failure to recognize the critical importance of this qualitative type interaction may result in mission architecture choices that will reduce science return.

Eppler, D. B.↗

Wavefront error simulator for evaluating optical testing instrumentation

A wavefront error simulator has been designed and fabricated to evaluate experimentally test instrumentation for the Large Space Telescope (LST) program. The principal operating part of the simulator is an aberration generator that introduces low-order aberrations of several waves magnitude with an incremented adjustment capability of lambda/100. Each aberration type can be introduced independently with any desired spatial orientation.

Golden, L. J.↗