Search NASA⌕ Search

SEARCH · Search NASA

Results for “program verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Acoustic Techniques for Density and Mass Flow in Enrichment Plants

In recent years, the IAEA has pursued innovative techniques and an integrated suite of safeguards measures to address the verification challenges posed by advanced centrifuge technologies and the growth in capacity at gaseous centrifuge enrichment plants (GCEPs) [1; 2]. A prominent theme in the development of a new generation of safeguards measures for GCEPs is the use of permanently installed, unattended instruments that can provide continuous monitoring of facility activities, while also reducing the need for on-site inspections [3]. For example, the U.S. Support Program to the IAEA leads the development of an On-Line Enrichment Monitor (OLEM) [4; 5] and an Unattended Cylinder Verification Station (UCVS) [6]. OLEM units will provide continuous enrichment measurement for 100% of the declared gas flowing through unit header pipes, thereby improving the IAEA’s capabilities to verify operator declarations of enrichment. The OLEM concept requires an accurate determination of gas density in order to produce accurate enrichment calculations (Fig. 1). The current OLEM design assumes that this gas density is derived from a pressure transducer signal shared with the operator. The IAEA has expressed the desire for a technology that can independently and noninvasively measures gas density, in support of a next-generation OLEM design.

IAEA, Enrichment Plants, Acoustic Techniques, OLEM↗

Dakota-NAERM Integration

This report presents the results of a collaborative effort under the Verification, Validation, and Uncertainty Quantification (VVUQ) thrust area of the North American Energy Resilience Model (NAERM) program. The goal of the effort described in this report was to integrate the Dakota software with the NAERM software framework to demonstrate sensitivity analysis of a co-simulation for NAERM.

97 MATHEMATICS AND COMPUTING↗

Sensitivity and Uncertainty Analysis of Generator Failures under Extreme Temperature Scenarios in Power Systems

This report summarizes work done under the Verification, Validation, and Uncertainty Quantification (VVUQ) thrust area of the North American Energy Resilience Model (NAERM) Program. The specific task of interest described in this report is focused on sensitivity analysis of scenarios involving failures of both wind turbines and thermal generators under extreme cold-weather temperature conditions as would be observed in a Polar Vortex event.

17 WIND ENERGY↗

Evaluation of the concrete shield compositions from the 2010 criticality accident alarm system benchmark experiments at the CEA Valduc SILENE facility

In October 2010, a series of benchmark experiments were conducted at the French Commissariat a l'Energie Atomique et aux Energies Alternatives (CEA) Valduc SILENE facility. These experiments were a joint effort between the United States Department of Energy Nuclear Criticality Safety Program and the CEA. The purpose of these experiments was to create three benchmarks for the verification and validation of radiation transport codes and evaluated nuclear data used in the analysis of criticality accident alarm systems. This series of experiments consisted of three single-pulsed experiments with the SILENE reactor. For the first experiment, the reactor was bare (unshielded), whereas in the second and third experiments, it was shielded by lead and polyethylene, respectively. The polyethylene shield of the third experiment had a cadmium liner on its internal and external surfaces, which vertically was located near the fuel region of SILENE. During each experiment, several neutron activation foils and thermoluminescent dosimeters (TLDs) were placed around the reactor. Nearly half of the foils and TLDs had additional high-density magnetite concrete, high-density barite concrete, standard concrete, and/or BoroBond shields. CEA Saclay provided all the concrete, and the US Y-12 National Security Complex provided the BoroBond. Measurement data from the experiments were published at the 2011 International Conference on Nuclear Criticality (ICNC 2011) and the 2013 Nuclear Criticality Safety Division (NCSD 2013) topical meeting. Preliminary computational results for the first experiment were presented in the ICNC 2011 paper, which showed poor agreement between the computational results and the measured values of the foils shielded by concrete. Recently the hydrogen content, boron content, and density of these concrete shields were further investigated within the constraints of the previously available data. New computational results for the first experiment are now available that show much better agreement with the measured values.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

OES Task 10 WEC Heaving Sphere Performance Modelling Verification

OES Task 10 Modelling, Verification and Validation of Wave Energy Converters (WECs) is a task under the IEA Technology Collaboration Program for Ocean Energy Systems (OES). The long-term goals are to assess the accuracy of, and establish confidence in, the use of numerical WEC models. to determine a range of validity of existing computational modelling tools, to identify uncertainty related to simulation methodologies and finally to define future research. To some extent, this project builds on the experience from a similar effort carried out to verify modelling of wind turbines as part of the IEA Wind Task 30 on wind OC3-OC5.

16 TIDAL AND WAVE POWER↗

Integrated sampling and data flow for Hanford vitrification - 15337

The Hanford Tank Waste Treatment and Immobilization Plant (WTP) is a one-of-a-kind nuclear facility being designed, built, and commissioned for the U.S. Department of Energy (DOE) by Bechtel National, Inc. and its subcontractor URS Corporation. The WTP facilities are under construction to complete the design and construction, as well as planning to support the startup, commissioning, and operation for vitrifying the radioactive waste stored in aging underground tanks at the Hanford Site. The work progress includes development of waste feed acceptance and qualification program, including methodologies for processing feed batches. Qualification data from staged feed samples will support the verification that waste acceptance criteria (WAC) and processability requirements are met. This verification is required to ensure safe operation of WTP processes for vitrifying the waste, while establishing specific campaign and batch sheets to comply with glass form acceptance requirements. Sampling and data integration are critical for process control and monitoring of the feed through unit operations. Data collection begins with process knowledge of staged feed for determining the required WAC analyses and testing for unit operations. The waste feed qualification data form the baseline information for WTP operation. The qualification data will be tracked and compared with sample analyses at different steps in vitrification operation. All aspects of data life cycle will be managed by the WTP Plant Engineering organization. The data management approach is established in this manner to allow maintaining campaign traceability through glass production records, while safely processing the corresponding feed campaigns and complying with permitting requirements. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Optimization of human factors methods within the design cycle - 178

Amec Foster Wheeler developed and implemented the Human Factors Engineering program to analyze the design of a large-scale electrical component readying for installation in a nuclear facility. The HFE program applied the program elements from NUREG-0711 throughout the detailed design phase of the project. This paper provides: (1) a review of the Human Factors Engineering (HFE) program methodology that was implemented, and (2) a summary of the integrated approach to the design, verification, and validation of the Human-Machine Interface (HMI) display and mimic panel. In general, it was found that a collaborative approach between the design team, equipment vendor, HFE, and the end-users of the component created a more streamlined approach to the design and allowed for user feedback to be implemented throughout the progression of the design. However, the trade-off to this approach is that an integrated validation is likely required once all design aspects are complete, to ensure the modification is acceptable in the context of the overall system. (authors)

42 ENGINEERING↗

Evaluation of the concrete shield compositions from the 2010 criticality accident alarm system Benchmark experiments at the CEA VALDUC silene facility - 14454

In October 2010, a series of benchmark experiments were conducted at the French Commissariat a l'energie Atomique et aux energies Alternatives (CEA) Valduc SILENE facility. These experiments were a joint effort between the United States Department of Energy Nuclear Criticality Safety Program and the CEA. The purpose of these experiments was to create three benchmarks for the verification and validation of radiation transport codes and evaluated nuclear data used in the analysis of criticality accident alarm systems. This series of experiments consisted of three single-pulsed experiments with the SILENE reactor. For the first experiment, the reactor was bare (unshielded), whereas in the second and third experiments, it was shielded by lead and polyethylene, respectively. The polyethylene shield of the third experiment had a cadmium liner on its internal and external surfaces, which vertically was located near the fuel region of SILENE. During each experiment, several neutron activation foils and thermoluminescent dosimeters (TLDs) were placed around the reactor. Nearly half of the foils and TLDs had additional high-density magnetite concrete, high-density barite concrete, standard concrete, and/or BoroBond shields. CEA Saclay provided all the concrete, and the US Y-12 National Security Complex provided the BoroBond. Measurement data from the experiments were published at the 2011 International Conference on Nuclear Criticality (ICNC 2011) and the 2013 Nuclear Criticality Safety Division (NCSD 2013) topical meeting. Preliminary computational results for the first experiment were presented in the ICNC 2011 paper, which showed poor agreement between the computational results and the measured values of the foils shielded by concrete. Recently the hydrogen content, boron content, and density of these concrete shields were further investigated within the constraints of the previously available data. New computational results for the first experiment are now available that show much better agreement with the measured values. (authors)

42 ENGINEERING↗

Using Process Load Cell Information for IAEA Safeguards at Enrichment Plants

Uranium enrichment service providers are expanding existing enrichment plants and constructing new facilities to meet demands resulting from the shutdown of gaseous diffusion plants, the completion of the U.S.-Russia highly enriched uranium downblending program, and the projected global renaissance in nuclear power. The International Atomic Energy Agency (IAEA) conducts verification inspections at safeguarded facilities to provide assurance that signatory States comply with their treaty obligations to use nuclear materials only for peaceful purposes. Continuous, unattended monitoring of load cells in UF{sub 6} feed/withdrawal stations can provide safeguards-relevant process information to make existing safeguards approaches more efficient and effective and enable novel safeguards concepts such as information-driven inspections. The IAEA has indicated that process load cell monitoring will play a central role in future safeguards approaches for large-scale gas centrifuge enrichment plants. This presentation will discuss previous work and future plans related to continuous load cell monitoring, including: (1) algorithms for automated analysis of load cell data, including filtering methods to determine significant weights and eliminate irrelevant impulses; (2) development of metrics for declaration verification and off-normal operation detection ('cylinder counting,' near-real-time mass balancing, F/P/T ratios, etc.); (3) requirements to specify what potentially sensitive data is safeguards relevant, at what point the IAEA gains on-site custody of the data, and what portion of that data can be transmitted off-site; (4) authentication, secure on-site storage, and secure transmission of load cell data; (5) data processing and remote monitoring schemes to control access to sensitive and proprietary information; (6) integration of process load cell data in a layered safeguards approach with cross-check verification; (7) process mock-ups constructed to provide simulated load cell data; (8) hardware and software implementation for process load cell data collection; (9) costs associated with unattended monitoring of load cells (for both operator and inspector) weighed against the potential benefits of having access to such data; (10) results from field tests of load cell data collection systems in operating facilities; and (11) use of unattended load cell data to increase efficiency of on-site inspection schedules and activities.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Verification and Validation of EnergyPlus Phase Change Material Model for Opaque Wall Assemblies

Phase change materials (PCMs) represent a technology that may reduce peak loads and HVAC energy consumption in buildings. A few building energy simulation programs have the capability to simulate PCMs, but their accuracy has not been completely tested. This study shows the procedure used to verify and validate the PCM model in EnergyPlus using a similar approach as dictated by ASHRAE Standard 140, which consists of analytical verification, comparative testing, and empirical validation. This process was valuable, as two bugs were identified and fixed in the PCM model, and version 7.1 of EnergyPlus will have a validated PCM model. Preliminary results using whole-building energy analysis show that careful analysis should be done when designing PCMs in homes, as their thermal performance depends on several variables such as PCM properties and location in the building envelope.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Using a Large Language Model as a Building Block to Generate Usable Validation and Verification Suite for OpenMP

In the HPC area, both hardware and software move quickly. Often new hardware is developed and deployed, the corresponding software stack, including compilers and other tools, are under active development while leading edge software developers are working to port and tune their applications, all at the same time. While the software ecosystem is in flux, one of the key challenges for users is obtaining insight into the state of implementation of key features in the programming languages and models their applications are using – whether they have been implemented, and whether the implementation conforms to the specification, especially for newly implemented features (less tested by widespread use). OpenMP is one of the most prominent shared memory programming models used for on-node programming in HPC. With the shift towards accelerators (such as GPUs and FPGAs) and heterogeneous programming OpenMP features are getting more complex. It is natural to ask whether generative AI approaches, and large language models (LLMs) in particular, can help in producing validation and verification test suites to allow users better and faster insights into the availability and correctness of OpenMP features of interest. In this work, we explore the use of ChatGPT-4 to generate a suite of tests for OpenMP features. We have chosen a set of directives and clauses, a total of 78 combinations, which first appeared in OpenMP 3.0 (released in May 2008) but are also relevant for accelerators. We prompted ChatGPT to generate tests in the C and Fortran languages, for both host (CPU) and device (accelerator). On the Summit super-computer using the GNU implementation, we found that, of the 78 generated tests 67 C tests and 43 Fortran tests compiled successfully and fewer than those executed to completion. On further analysis we show that not all generated tests are valid. We document the process, results, and provide detailed analysis regarding the quality of tests generated. With the aim of providing input to a production quality validation and verification suite, we manually implement the corrections required to make the tests valid according to the current OpenMP specification. We quantify this effort as small, medium, or large, and record the lines of code changed to correct the invalid tests. With the corrected tests we validate recent implementations from HPE, AMD, and GNU on the Frontier supercomputer. Our experiment and subsequent analysis show that although LLMs are capable of producing HPC specific codes, they are limited by their understanding of the deeper semantics and restrictions of programming models such as OpenMP. Unsurprisingly more commonly used features have better support, while some OpenMP 3.0 directives such as sections and tasking are not universally supported on accelerators. We demonstrate that successful compilation and execution to completion are inadequate metrics for evaluating generated code and that, at this time, commodity LLMs require expert intervention for code verification. This points to gaps in the training data that is currently available for HPC. We demonstrate that with "small" effort 37% of generated invalid C tests and 63% of generated invalid Fortran tests could be corrected. This improves productivity of test generation as we circumvent writing from scratch and the common programming errors associated with it.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗

RCCS Testing with the Water-based NSTF: Year-1 Single-Phase Results

Under support from the Department of Energy (DOE) and the Office of Advanced Reactor Technologies (ART), a large scale test facility has been constructed to generate validation data for passive decay heat removal systems of advanced reactors. Located at Argonne National Laboratory, the Natural convection Shutdown heat removal Test Facility (NSTF) reflects key features of a ½ scale, water-based, Reactor Cavity Cooling System (RCCS). This report serves as a summary of the single-phase testing results obtained during the programs first year of matrix testing. An introduction to the high-level program objectives is first presented, followed by a brief summary of facility design, instrumentation, and control systems. Details of the NQA-1 driven test method are included, which govern the programs quality assurance requirements and provide a background for the testing strategy and procedures. Checkout activities, including verification of gross system mass and energy balances, heat loss quantification, and isothermal facility characterization, were performed early in the first year and results presented in this report. These tests have identified relevant facility characteristics such as K-factors, frictional pressure losses, parasitic heat loss rates, and transient heating response. Results are then presented from four accepted matrix tests where the facility established a steady-state, single-phase mode of flow operation. All matrix tests were performed with an identical top-level procedure: first initiating a heater power ramp to target levels, and then holding power levels constant until the facilities structural members and network piping reached thermal equilibrium. Upon obtaining stable thermal and hydraulic conditions, active cooling was initiated off of the bulk storage tank to maintain constant riser inlet temperatures of 30°C. This steady-state period was then held for a minimum required duration, at which point the heaters were ramped down and test concluded. The two baseline tests completed reflect conditions prototypic to the full scale plant at both normal operation, and design basis Depressurized Loss of Forced Cooling (DLOFC) conditions. These parameters are defined by full RCCS decay heat loads of 1.4 MWt and 2.1 MWt, which translate to NSTF scale thermal power levels of 34.4 kWt and 51.6 kWt, respectively. Two additional tests were also conducted, which repeated baseline cases but included modification by single parameter variations in decay heat load, or heater power, at 700 kWt, and 2.8 MWt. Finally, a scoping test was performed to demonstrate the facilities ability to operate in a two-phase mode of operation. The facility successfully operated for a 3-hour period at this mode, reaching peak inventory temperatures of 105°C and condensing approximately 50 gallons of boil-off inventory. The testing parameters for this demonstration were based off the design basis DLOFC condition, and will be the reference for new baseline cases as the program moves forward with two-phase matrix testing.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

REBUS-PC v1.5 Verification Test Summary

Motivated in part by its usage for analysis of the University of Missouri Research Reactor (MURR), the verification of the REBUS-PC software for θ-R-Z geometries is discussed and displayed in this manuscript. Of particular importance is to show that the eigenvalue, flux, power, and burnup outputs of the software given a user problem is correct. REBUS-PC contains many features and MURR only makes use of some of those aspects. As an example, the use of region specific cross section sets, interpolation of the cross section data with respect to burnup, and automatic movement of control rods during the fuel cycle is discussed and displayed. To demonstrate the accuracy, 22 verification tests based upon 7 physical geometries are discussed. Geometry descriptions are provided in Section 2 and the REBUS-PC results for each verification test are discussed in Section 3. These verification tests consist of both analytic problems with known solutions and a more complicated input consistent with usage of REBUS-PC on the MURR reactor itself called STRZ. In this verification test summary report, the REBUS-PC software is repeatedly demonstrated to reproduce, or closely match, the eigenvalue, flux, and power distributions from analytic test problem solutions, demonstrating that the implemented finite difference approximation in θ-R-Z is working as intended. Several additional REBUS-PC features are tested, such as control rod movement by detailed comparisons of the results against reference solutions obtained using an auxiliary implemented MatLab program. As expected, the REBUS-PC software produces results that are 100% consistent with the stated capabilities and thus the verification exercise is completed. These verification tests should be executed with each re-compilation of the REBUS-PC source and after any source code changes. All output results from any such new work should be rigorously compared against the stored output of the 22 verification tests cited in this report that forms the basis of the verification process.

97 MATHEMATICS AND COMPUTING↗

Submission of FeCrAl Feedstock for Support of AFC ATR-2 Irradiations

The Advanced Test Reactor (ATR) is currently being used to test accident tolerant fuel (ATF) forms destined for commercial nuclear power plant deployment. One irradiation program using the ATR for ATF concepts, Accident Tolerant Fuel-2 (ATF-2), is a water loop irradiation test using miniaturized fuel pins as test articles. This complicated testing configuration requires a series of pre-test experiments and verification including a flowing loop autoclave test and a sensor qualification test (SQT) prior to full test train deployment within the ATR. In support of the ATF-2 irradiation program, Oak Ridge National Laboratory (ORNL) has supplied two different Generation II FeCrAl alloys in rod stock form to Idaho National Laboratory (INL). These rods will be machined into dummy pins for deployment in the autoclave test and SQT. Post-test analysis of the dummy pins will provide initial insight into the performance of Generation II FeCrAl alloys in the ATF-2 irradiation experiment as well as within a commercial nuclear reactor.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Development of a Low Cost 10kW Tubular SOFC Power System

The DOE program funded from 2003 through early 2013 has brought the Acumentrics SOFC program from an early stage R&D program to an entry level commercial product offering. The development work started as one of the main core teams under the DOE Solid State Energy Conversion Alliance (SECA) program administered by the National Energy Technology Laboratory (NETL) of the DOE. During the first phase of the program, lasting approximately 3-4 years, a 5kW machine was designed, manufactured and tested against the specification developed by NETL. This unit was also shipped to NETL for independent verification testing which validated all of the results achieved while in the laboratory at Acumentrics. The Acumentrics unit passed all criteria established from operational stability, efficiency, and cost projections. Passing of the SECA Phase I test allowed the program to move into Phase II of the program. During this phase, the overall objective was to further refine the unit meeting a higher level of performance stability as well as further cost reductions. During the first year of this new phase, the NETL SECA program was refocused towards larger size units and operation on coal gasification due to the severe rise in natural gas prices and refocus on the US supply of indigenous coal. At this point, the program was shifted to the U.S. DOE’s Energy Efficiency and Renewable Energy (EERE) division located in Golden, Colorado. With this shift, the focus remained on smaller power units operational on gaseous fuels for a variety of applications including micro combined heat and power (mCHP). To achieve this goal, further enhancements in power, life expectancy and reductions in cost were necessary. The past 5 years have achieved these goals with machines that can now achieve over 40% electrical efficiency and field units that have now operated for close to a year and a half with minimal maintenance. The following report details not only the first phase while under the SECA program and the key achievements but also the results while under EERE’s leadership and the transition to an early commercial product offering.

10 SYNTHETIC FUELS↗

EPID-based verification of the MLC performance for dynamic IMRT and VMAT

Purpose: In advanced radiotherapy treatments such as intensity modulated radiation therapy (IMRT) and volumetric modulated arc therapy (VMAT), verification of the performance of the multileaf collimator (MLC) is an essential part of the linac QA program. The purpose of this study is to use the existing measurement methods for geometric QA of the MLCs and extend them to more comprehensive evaluation techniques, and to develop dedicated robust algorithms to quantitatively investigate the MLC performance in a fast, accurate, and efficient manner. Methods: The behavior of leaves was investigated in the step-and-shoot mode by the analysis of integrated electronic portal imaging device (EPID) images acquired during picket fence tests at fixed gantry angles and arc delivery. The MLC was also studied in dynamic mode by the analysis of cine EPID images of a sliding gap pattern delivered in a variety of conditions including different leaf speeds, deliveries at fixed gantry angles or in arc mode, and changing the direction of leaf motion. The accuracy of the method was tested by detection of the intentionally inserted errors in the delivery patterns. Results: The algorithm developed for the picket fence analysis was able to find each individual leaf position, gap width, and leaf bank skewness in addition to the deviations from expected leaf positions with respect to the beam central axis with sub-pixel accuracy. For the three tested linacs over a period of 5 months, the maximum change in the gap width was 0.5 mm, the maximum deviation from the expected leaf positions was 0.1 mm and the MLC skewness was up to 0.2 Degree-Sign . The algorithm developed for the sliding gap analysis could determine the velocity and acceleration/deceleration of each individual leaf as well as the gap width. There was a slight decrease in the accuracy of leaf performance with increasing leaf speeds. The analysis results were presented through several graphs. The accuracy of the method was assessed as 0.01 mm for both the gap size and peak position determination. Conclusions: This study provides fast, easy, and accurate test methods for routine QA of the MLC performance and helps in faster troubleshooting of MLC problems in both IMRT and VMAT treatments.

60 APPLIED LIFE SCIENCES↗

Commercial Building Partnerships Replication and Diffusion

This study presents findings from survey and interview data investigating replication efforts of Commercial Building Partnership (CBP) partners that worked directly with the Pacific Northwest National Laboratory (PNNL). PNNL partnered directly with 12 organizations on new and retrofit construction projects, which represented approximately 28 percent of the entire U.S. Department of Energy (DOE) CBP program. Through a feedback survey mechanism, along with personal interviews, PNNL gathered quantitative and qualitative data relating to replication efforts by each organization. These data were analyzed to provide insight into two primary research areas: 1) CBP partners’ replication efforts of technologies and approaches used in the CBP project to the rest of the organization’s building portfolio (including replication verification), and, 2) the market potential for technology diffusion into the total U.S. commercial building stock, as a direct result of the CBP program. The first area of this research focused specifically on replication efforts underway or planned by each CBP program participant. Factors that impact replication include motivation, organizational structure and objectives firms have for implementation of energy efficient technologies. Comparing these factors between different CBP partners revealed patterns in motivation for constructing energy efficient buildings, along with better insight into market trends for green building practices. The second area of this research develops a diffusion of innovations model to analyze potential broad market impacts of the CBP program on the commercial building industry in the United States.

Commercial Building Partnerships↗