Search NASA⌕ Search

SEARCH · Search NASA

Results for “program verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,081 records · Page 60

Optimization of human factors methods within the design cycle - 178

Amec Foster Wheeler developed and implemented the Human Factors Engineering program to analyze the design of a large-scale electrical component readying for installation in a nuclear facility. The HFE program applied the program elements from NUREG-0711 throughout the detailed design phase of the project. This paper provides: (1) a review of the Human Factors Engineering (HFE) program methodology that was implemented, and (2) a summary of the integrated approach to the design, verification, and validation of the Human-Machine Interface (HMI) display and mimic panel. In general, it was found that a collaborative approach between the design team, equipment vendor, HFE, and the end-users of the component created a more streamlined approach to the design and allowed for user feedback to be implemented throughout the progression of the design. However, the trade-off to this approach is that an integrated validation is likely required once all design aspects are complete, to ensure the modification is acceptable in the context of the overall system. (authors)

42 ENGINEERING↗

Evaluation of the concrete shield compositions from the 2010 criticality accident alarm system Benchmark experiments at the CEA VALDUC silene facility - 14454

In October 2010, a series of benchmark experiments were conducted at the French Commissariat a l'energie Atomique et aux energies Alternatives (CEA) Valduc SILENE facility. These experiments were a joint effort between the United States Department of Energy Nuclear Criticality Safety Program and the CEA. The purpose of these experiments was to create three benchmarks for the verification and validation of radiation transport codes and evaluated nuclear data used in the analysis of criticality accident alarm systems. This series of experiments consisted of three single-pulsed experiments with the SILENE reactor. For the first experiment, the reactor was bare (unshielded), whereas in the second and third experiments, it was shielded by lead and polyethylene, respectively. The polyethylene shield of the third experiment had a cadmium liner on its internal and external surfaces, which vertically was located near the fuel region of SILENE. During each experiment, several neutron activation foils and thermoluminescent dosimeters (TLDs) were placed around the reactor. Nearly half of the foils and TLDs had additional high-density magnetite concrete, high-density barite concrete, standard concrete, and/or BoroBond shields. CEA Saclay provided all the concrete, and the US Y-12 National Security Complex provided the BoroBond. Measurement data from the experiments were published at the 2011 International Conference on Nuclear Criticality (ICNC 2011) and the 2013 Nuclear Criticality Safety Division (NCSD 2013) topical meeting. Preliminary computational results for the first experiment were presented in the ICNC 2011 paper, which showed poor agreement between the computational results and the measured values of the foils shielded by concrete. Recently the hydrogen content, boron content, and density of these concrete shields were further investigated within the constraints of the previously available data. New computational results for the first experiment are now available that show much better agreement with the measured values. (authors)

42 ENGINEERING↗

Using Process Load Cell Information for IAEA Safeguards at Enrichment Plants

Uranium enrichment service providers are expanding existing enrichment plants and constructing new facilities to meet demands resulting from the shutdown of gaseous diffusion plants, the completion of the U.S.-Russia highly enriched uranium downblending program, and the projected global renaissance in nuclear power. The International Atomic Energy Agency (IAEA) conducts verification inspections at safeguarded facilities to provide assurance that signatory States comply with their treaty obligations to use nuclear materials only for peaceful purposes. Continuous, unattended monitoring of load cells in UF{sub 6} feed/withdrawal stations can provide safeguards-relevant process information to make existing safeguards approaches more efficient and effective and enable novel safeguards concepts such as information-driven inspections. The IAEA has indicated that process load cell monitoring will play a central role in future safeguards approaches for large-scale gas centrifuge enrichment plants. This presentation will discuss previous work and future plans related to continuous load cell monitoring, including: (1) algorithms for automated analysis of load cell data, including filtering methods to determine significant weights and eliminate irrelevant impulses; (2) development of metrics for declaration verification and off-normal operation detection ('cylinder counting,' near-real-time mass balancing, F/P/T ratios, etc.); (3) requirements to specify what potentially sensitive data is safeguards relevant, at what point the IAEA gains on-site custody of the data, and what portion of that data can be transmitted off-site; (4) authentication, secure on-site storage, and secure transmission of load cell data; (5) data processing and remote monitoring schemes to control access to sensitive and proprietary information; (6) integration of process load cell data in a layered safeguards approach with cross-check verification; (7) process mock-ups constructed to provide simulated load cell data; (8) hardware and software implementation for process load cell data collection; (9) costs associated with unattended monitoring of load cells (for both operator and inspector) weighed against the potential benefits of having access to such data; (10) results from field tests of load cell data collection systems in operating facilities; and (11) use of unattended load cell data to increase efficiency of on-site inspection schedules and activities.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Verification and Validation of EnergyPlus Phase Change Material Model for Opaque Wall Assemblies

Phase change materials (PCMs) represent a technology that may reduce peak loads and HVAC energy consumption in buildings. A few building energy simulation programs have the capability to simulate PCMs, but their accuracy has not been completely tested. This study shows the procedure used to verify and validate the PCM model in EnergyPlus using a similar approach as dictated by ASHRAE Standard 140, which consists of analytical verification, comparative testing, and empirical validation. This process was valuable, as two bugs were identified and fixed in the PCM model, and version 7.1 of EnergyPlus will have a validated PCM model. Preliminary results using whole-building energy analysis show that careful analysis should be done when designing PCMs in homes, as their thermal performance depends on several variables such as PCM properties and location in the building envelope.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

User's guide to the Mission Analysis Evaluation and Space Trajectory Operations program (MAESTRO)

The MAESTRO system is a mission analysis tool designed to present to the user information necessary to make the various decisions required in the design and execution of a spaceflight mission. The system was designed so that it can be used in both the pre-launch mission planning phase of a mission and during the flight as an in-flight decision making tool. A description of each of the following modes is presented: (1) trajectory propagation mode; (2) retro-fire determination mode; (3) midcourse analysis determination mode; (4) Monte Carlo mode; (5) verification mode; (6) orbit stability mode; and (7) post injection trim mode. A description of the inputs necessary to run the program mode is given along with a sample case.

Lutzky, D.↗

Diode step stress program, JANTX1N981B

Power/temperature step stress was applied to the Zener diode JANTX1N981B. Reliability of the device was determined. Control units were maintained for verification of the electrical parametric testing. Results are reported.

Source record↗

Verification of Ares I Liftoff Acoustic Environments via the Ares I Scale Model Acoustic Test

The Ares I Scale Model Acoustic Test (ASMAT) program was implemented to verify the predicted Ares I liftoff acoustic environments and to determine the acoustic reduction gained by using an above deck water sound suppression system. The test article included a 5% scale Ares I vehicle model and Mobile Launcher with tower. Acoustic and pressure data were measured by over 200 instruments. The ASMAT results are compared to Ares I-X flight data.

Counter, Douglas↗

Using a Large Language Model as a Building Block to Generate Usable Validation and Verification Suite for OpenMP

In the HPC area, both hardware and software move quickly. Often new hardware is developed and deployed, the corresponding software stack, including compilers and other tools, are under active development while leading edge software developers are working to port and tune their applications, all at the same time. While the software ecosystem is in flux, one of the key challenges for users is obtaining insight into the state of implementation of key features in the programming languages and models their applications are using – whether they have been implemented, and whether the implementation conforms to the specification, especially for newly implemented features (less tested by widespread use). OpenMP is one of the most prominent shared memory programming models used for on-node programming in HPC. With the shift towards accelerators (such as GPUs and FPGAs) and heterogeneous programming OpenMP features are getting more complex. It is natural to ask whether generative AI approaches, and large language models (LLMs) in particular, can help in producing validation and verification test suites to allow users better and faster insights into the availability and correctness of OpenMP features of interest. In this work, we explore the use of ChatGPT-4 to generate a suite of tests for OpenMP features. We have chosen a set of directives and clauses, a total of 78 combinations, which first appeared in OpenMP 3.0 (released in May 2008) but are also relevant for accelerators. We prompted ChatGPT to generate tests in the C and Fortran languages, for both host (CPU) and device (accelerator). On the Summit super-computer using the GNU implementation, we found that, of the 78 generated tests 67 C tests and 43 Fortran tests compiled successfully and fewer than those executed to completion. On further analysis we show that not all generated tests are valid. We document the process, results, and provide detailed analysis regarding the quality of tests generated. With the aim of providing input to a production quality validation and verification suite, we manually implement the corrections required to make the tests valid according to the current OpenMP specification. We quantify this effort as small, medium, or large, and record the lines of code changed to correct the invalid tests. With the corrected tests we validate recent implementations from HPE, AMD, and GNU on the Frontier supercomputer. Our experiment and subsequent analysis show that although LLMs are capable of producing HPC specific codes, they are limited by their understanding of the deeper semantics and restrictions of programming models such as OpenMP. Unsurprisingly more commonly used features have better support, while some OpenMP 3.0 directives such as sections and tasking are not universally supported on accelerators. We demonstrate that successful compilation and execution to completion are inadequate metrics for evaluating generated code and that, at this time, commodity LLMs require expert intervention for code verification. This points to gaps in the training data that is currently available for HPC. We demonstrate that with "small" effort 37% of generated invalid C tests and 63% of generated invalid Fortran tests could be corrected. This improves productivity of test generation as we circumvent writing from scratch and the common programming errors associated with it.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗

RCCS Testing with the Water-based NSTF: Year-1 Single-Phase Results

Under support from the Department of Energy (DOE) and the Office of Advanced Reactor Technologies (ART), a large scale test facility has been constructed to generate validation data for passive decay heat removal systems of advanced reactors. Located at Argonne National Laboratory, the Natural convection Shutdown heat removal Test Facility (NSTF) reflects key features of a ½ scale, water-based, Reactor Cavity Cooling System (RCCS). This report serves as a summary of the single-phase testing results obtained during the programs first year of matrix testing. An introduction to the high-level program objectives is first presented, followed by a brief summary of facility design, instrumentation, and control systems. Details of the NQA-1 driven test method are included, which govern the programs quality assurance requirements and provide a background for the testing strategy and procedures. Checkout activities, including verification of gross system mass and energy balances, heat loss quantification, and isothermal facility characterization, were performed early in the first year and results presented in this report. These tests have identified relevant facility characteristics such as K-factors, frictional pressure losses, parasitic heat loss rates, and transient heating response. Results are then presented from four accepted matrix tests where the facility established a steady-state, single-phase mode of flow operation. All matrix tests were performed with an identical top-level procedure: first initiating a heater power ramp to target levels, and then holding power levels constant until the facilities structural members and network piping reached thermal equilibrium. Upon obtaining stable thermal and hydraulic conditions, active cooling was initiated off of the bulk storage tank to maintain constant riser inlet temperatures of 30°C. This steady-state period was then held for a minimum required duration, at which point the heaters were ramped down and test concluded. The two baseline tests completed reflect conditions prototypic to the full scale plant at both normal operation, and design basis Depressurized Loss of Forced Cooling (DLOFC) conditions. These parameters are defined by full RCCS decay heat loads of 1.4 MWt and 2.1 MWt, which translate to NSTF scale thermal power levels of 34.4 kWt and 51.6 kWt, respectively. Two additional tests were also conducted, which repeated baseline cases but included modification by single parameter variations in decay heat load, or heater power, at 700 kWt, and 2.8 MWt. Finally, a scoping test was performed to demonstrate the facilities ability to operate in a two-phase mode of operation. The facility successfully operated for a 3-hour period at this mode, reaching peak inventory temperatures of 105°C and condensing approximately 50 gallons of boil-off inventory. The testing parameters for this demonstration were based off the design basis DLOFC condition, and will be the reference for new baseline cases as the program moves forward with two-phase matrix testing.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The NASA Lewis large wind turbine program

The program is directed toward development of the technology for safe, reliable, environmentally acceptable large wind turbines that have the potential to generate a significant amount of electricity at costs competitive with conventional electric generation systems. In addition, these large wind turbines must be fully compatible with electric utility operations and interface requirements. Advances are made by gaining a better understanding of the system design drivers, improvements in the analytical design tools, verification of design methods with operating field data, and the incorporation of new technology and innovative designs. An overview of the program activities is presented and includes results from the first and second generation field machines (Mod-OA, -1, and -2), the design phase of the third generation wind turbine (Mod-5) and the advanced technology projects. Also included is the status of the Department of Interior WTS-4 machine.

Thomas, R. L.↗

REBUS-PC v1.5 Verification Test Summary

Motivated in part by its usage for analysis of the University of Missouri Research Reactor (MURR), the verification of the REBUS-PC software for θ-R-Z geometries is discussed and displayed in this manuscript. Of particular importance is to show that the eigenvalue, flux, power, and burnup outputs of the software given a user problem is correct. REBUS-PC contains many features and MURR only makes use of some of those aspects. As an example, the use of region specific cross section sets, interpolation of the cross section data with respect to burnup, and automatic movement of control rods during the fuel cycle is discussed and displayed. To demonstrate the accuracy, 22 verification tests based upon 7 physical geometries are discussed. Geometry descriptions are provided in Section 2 and the REBUS-PC results for each verification test are discussed in Section 3. These verification tests consist of both analytic problems with known solutions and a more complicated input consistent with usage of REBUS-PC on the MURR reactor itself called STRZ. In this verification test summary report, the REBUS-PC software is repeatedly demonstrated to reproduce, or closely match, the eigenvalue, flux, and power distributions from analytic test problem solutions, demonstrating that the implemented finite difference approximation in θ-R-Z is working as intended. Several additional REBUS-PC features are tested, such as control rod movement by detailed comparisons of the results against reference solutions obtained using an auxiliary implemented MatLab program. As expected, the REBUS-PC software produces results that are 100% consistent with the stated capabilities and thus the verification exercise is completed. These verification tests should be executed with each re-compilation of the REBUS-PC source and after any source code changes. All output results from any such new work should be rigorously compared against the stored output of the 22 verification tests cited in this report that forms the basis of the verification process.

97 MATHEMATICS AND COMPUTING↗

Submission of FeCrAl Feedstock for Support of AFC ATR-2 Irradiations

The Advanced Test Reactor (ATR) is currently being used to test accident tolerant fuel (ATF) forms destined for commercial nuclear power plant deployment. One irradiation program using the ATR for ATF concepts, Accident Tolerant Fuel-2 (ATF-2), is a water loop irradiation test using miniaturized fuel pins as test articles. This complicated testing configuration requires a series of pre-test experiments and verification including a flowing loop autoclave test and a sensor qualification test (SQT) prior to full test train deployment within the ATR. In support of the ATF-2 irradiation program, Oak Ridge National Laboratory (ORNL) has supplied two different Generation II FeCrAl alloys in rod stock form to Idaho National Laboratory (INL). These rods will be machined into dummy pins for deployment in the autoclave test and SQT. Post-test analysis of the dummy pins will provide initial insight into the performance of Generation II FeCrAl alloys in the ATF-2 irradiation experiment as well as within a commercial nuclear reactor.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Development of a Low Cost 10kW Tubular SOFC Power System

The DOE program funded from 2003 through early 2013 has brought the Acumentrics SOFC program from an early stage R&D program to an entry level commercial product offering. The development work started as one of the main core teams under the DOE Solid State Energy Conversion Alliance (SECA) program administered by the National Energy Technology Laboratory (NETL) of the DOE. During the first phase of the program, lasting approximately 3-4 years, a 5kW machine was designed, manufactured and tested against the specification developed by NETL. This unit was also shipped to NETL for independent verification testing which validated all of the results achieved while in the laboratory at Acumentrics. The Acumentrics unit passed all criteria established from operational stability, efficiency, and cost projections. Passing of the SECA Phase I test allowed the program to move into Phase II of the program. During this phase, the overall objective was to further refine the unit meeting a higher level of performance stability as well as further cost reductions. During the first year of this new phase, the NETL SECA program was refocused towards larger size units and operation on coal gasification due to the severe rise in natural gas prices and refocus on the US supply of indigenous coal. At this point, the program was shifted to the U.S. DOE’s Energy Efficiency and Renewable Energy (EERE) division located in Golden, Colorado. With this shift, the focus remained on smaller power units operational on gaseous fuels for a variety of applications including micro combined heat and power (mCHP). To achieve this goal, further enhancements in power, life expectancy and reductions in cost were necessary. The past 5 years have achieved these goals with machines that can now achieve over 40% electrical efficiency and field units that have now operated for close to a year and a half with minimal maintenance. The following report details not only the first phase while under the SECA program and the key achievements but also the results while under EERE’s leadership and the transition to an early commercial product offering.

10 SYNTHETIC FUELS↗

Software for Checking Statecharts

HiVy is a software tool set that enables verification through model checking of designs represented as finite-state machines or statecharts. HiVy provides automated translation of (1) statecharts created by use of the MathWorks Stateflow program to (2) Promela, the input language of the Spin model checker, which can then be used to verify, or trace logical errors in, distributed software systems. HiVy can operate directly on Stateflow models, or its abstract syntax of hierarchical sequential automata (HSA) can be used independently as an intermediate format for translation to Promela. In a typical design application, HiVy parses and reformats Stateflow model file data using the programs SfParse and sf2hsa, respectively. If the parsing effort is successful, an abstract syntax tree is delivered into a file named with the extension .hsa. If the design comprises several model files, they may be merged into one .hsa file before translation into Promela. Stateflow scope is preserved, and name clashes are avoided in the merge process. The HiVy program hsa2pr translates the model from the intermediate HSA format into Promela. Additionally, HiVy provides through translation a list of all statechart model propositions that are the means for formalizing linear temporal logic (LTL) properties about the model for Spin verification.

Pingree, Paula↗

EPID-based verification of the MLC performance for dynamic IMRT and VMAT

Purpose: In advanced radiotherapy treatments such as intensity modulated radiation therapy (IMRT) and volumetric modulated arc therapy (VMAT), verification of the performance of the multileaf collimator (MLC) is an essential part of the linac QA program. The purpose of this study is to use the existing measurement methods for geometric QA of the MLCs and extend them to more comprehensive evaluation techniques, and to develop dedicated robust algorithms to quantitatively investigate the MLC performance in a fast, accurate, and efficient manner. Methods: The behavior of leaves was investigated in the step-and-shoot mode by the analysis of integrated electronic portal imaging device (EPID) images acquired during picket fence tests at fixed gantry angles and arc delivery. The MLC was also studied in dynamic mode by the analysis of cine EPID images of a sliding gap pattern delivered in a variety of conditions including different leaf speeds, deliveries at fixed gantry angles or in arc mode, and changing the direction of leaf motion. The accuracy of the method was tested by detection of the intentionally inserted errors in the delivery patterns. Results: The algorithm developed for the picket fence analysis was able to find each individual leaf position, gap width, and leaf bank skewness in addition to the deviations from expected leaf positions with respect to the beam central axis with sub-pixel accuracy. For the three tested linacs over a period of 5 months, the maximum change in the gap width was 0.5 mm, the maximum deviation from the expected leaf positions was 0.1 mm and the MLC skewness was up to 0.2 Degree-Sign . The algorithm developed for the sliding gap analysis could determine the velocity and acceleration/deceleration of each individual leaf as well as the gap width. There was a slight decrease in the accuracy of leaf performance with increasing leaf speeds. The analysis results were presented through several graphs. The accuracy of the method was assessed as 0.01 mm for both the gap size and peak position determination. Conclusions: This study provides fast, easy, and accurate test methods for routine QA of the MLC performance and helps in faster troubleshooting of MLC problems in both IMRT and VMAT treatments.

60 APPLIED LIFE SCIENCES↗

Verification of the Multi-Axial, Temperature and Time Dependent (MATT) Failure Criterion

An extensive test and analytical effort has been completed by the Space Shuttle's Reusable Solid Rocket Motor (KSKM) nozzle program to characterize the failure behavior of two epoxy adhesives (TIGA 321 and EA946). As part of this effort, a general failure model, the "Multi-Axial, Temperature, and Time Dependent" or MATT failure criterion was developed. In the initial development of this failure criterion, tests were conducted to provide validation of the theory under a wide range of test conditions. The purpose of this paper is to present additional verification of the MATT failure criterion, under new loading conditions for the adhesives TIGA 321 and EA946. In many cases, the loading conditions involve an extrapolation from the conditions under which the material models were originally developed. Testing was conducted using three loading conditions: multi-axial tension, torsional shear, and non-uniform tension in a bondline condition. Tests were conducted at constant and cyclic loading rates ranging over four orders of magnitude. Tests were conducted under environmental conditions of primary interest to the RSRM program. The temperature range was not extreme, but the loading ranges were extreme (varying by four orders of magnitude). It should be noted that the testing was conducted at temperatures below the glass transition temperature of the TIGA 321 adhesive. However for the EA946, the testing was conducted at temperatures that bracketed the glass transition temperature.

Richardson, David E.↗

Model checking

Automatic formal verification methods for finite-state systems, also known as model-checking, successfully reduce labor costs since they are mostly automatic. Model checkers explicitly or implicitly enumerate the reachable state space of a system, whose behavior is described implicitly, perhaps by a program or a collection of finite automata. Simple properties, such as mutual exclusion or absence of deadlock, can be checked by inspecting individual states. More complex properties, such as lack of starvation, require search for cycles in the state graph with particular properties. Specifications to be checked may consist of built-in properties, such as deadlock or 'unspecified receptions' of messages, another program or implicit description, to be compared with a simulation, bisimulation, or language inclusion relation, or an assertion in one of several temporal logics. Finite-state verification tools are beginning to have a significant impact in commercial designs. There are many success stories of verification tools finding bugs in protocols or hardware controllers. In some cases, these tools have been incorporated into design methodology. Research in finite-state verification has been advancing rapidly, and is showing no signs of slowing down. Recent results include probabilistic algorithms for verification, exploitation of symmetry and independent events, and the use symbolic representations for Boolean functions and systems of linear inequalities. One of the most exciting areas for further research is the combination of model-checking with theorem-proving methods.

Dill, David L.↗

A brief overview of computational structures technology related activities at NASA Lewis Research Center

The presentation gives a partial overview of research and development underway in the Structures Division of LeRC, which collectively is referred to as the Computational Structures Technology Program. The activities in the program are diverse and encompass four major categories: (1) composite materials and structures; (2) probabilistic analysis and reliability; (3) design optimization and expert systems; and (4) computational methods and simulation. The approach of the program is comprehensive and entails exploration of fundamental theories of structural mechanics to accurately represent the complex physics governing engine structural performance, formulation, and implementation of computational techniques and integrated simulation strategies to provide accurate and efficient solutions of the governing theoretical models by exploiting the emerging advances in computer technology, and validation and verification through numerical and experimental tests to establish confidence and define the qualities and limitations of the resulting theoretical models and computational solutions. The program comprises both in-house and sponsored research activities. The remainder of the presentation provides a sample of activities to illustrate the breadth and depth of the program and to demonstrate the accomplishments and benefits that have resulted.

Hopkins, Dale A.↗