Search NASA⌕ Search

SEARCH · Search NASA

Results for “code verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,585 records · Page 88

SAPHIRE 8 Software Independent Verification and Validation Plan

SAPHIRE 8 is being developed with a phased or cyclic iterative rapid application development methodology. Due to this approach, a similar approach is being taken for the IV&V activities on each vital software object. The IV&V plan is structured around NUREG/BR-0167, “Software Quality Assurance Program and Guidelines,” February 1993. The Nuclear Regulatory Research Office Instruction No.: PRM-12, “Software Quality Assurance for RES Sponsored Codes,” March 26, 2007 specifies that RES-sponsored software is to be evaluated against NUREG/BR-0167. Per the guidance in NUREG/BR-0167, SAPHIRE is classified as “Level 1.” Level 1 software corresponds to technical application software used in a safety decision.

99 GENERAL AND MISCELLANEOUS↗

SU-E-T-384: Experimental Verification of a Monte Carlo Linear Accelerator Model Using a Radiochromic Film Stack Dosimeter

Purpose: To experimentally verify a Monte Carlo (MC) linear accelerator model for the simulation of intensity-modulated radiation therapy (IMRT) treatments of moving targets. Methods: A Varian Clinac™ 21EX linear accelerator was modeled using the EGSnrc user code BEAMnrc. The mean energy, radial-intensity distribution, and divergence of the electron beam incident on the bremsstrahlung target were adjusted to achieve agreement between simulated and measured percentage-depth-dose and transverse field profiles for a 6 MV beam. A seven-field step-and-shoot IMRT lung procedure was prepared using Varian Eclipse™ treatment planning software. The plan was delivered using a Clinac™ 21EX linear accelerator and measured with a Gafchromic™ EBT2 film stack dosimeter (FSD) in two separate static geometries: within a cylindrical water-equivalent-plastic phantom and within an anthropomorphic chest phantom. Two measurements were completed in each setup. The dose distribution for each geometry was simulated using the EGSnrc user code DOSXYZnrc. MC geometries of the treatment couch, cylindrical phantom, and chest phantom were developed by thresholding CT data sets using MATLAB™. The FSD was modeled as water. The measured and simulated dose distributions were normalized to the median dose within the FSD. Results: Using an electron beam with a mean energy of 6.05 MeV, a Gaussian radial-intensity distribution with a full width at half maximum of 1.5 mm, and a divergence of 0°, the measured and simulated dose profiles agree within 1.75% and 1 mm. Measured and simulated dose distributions within both the cylindrical and chest phantoms agree within 3% over 94% of the FSD volume. The overall uncertainty in the FSD measurements is 3.1% (k=1). Conclusion: MC simulations agree with FSD measurements within measurement uncertainty, thereby verifying the accuracy of the linear accelerator model for the simulation of IMRT treatments of static geometries. The experimental verification will be extended to treatments of targets undergoing three-dimensional motion.

60 APPLIED LIFE SCIENCES↗

An algorithm to calculate a collapsed arc dose matrix in volumetric modulated arc therapy

Purpose: The delivery of volumetric modulated arc therapy (VMAT) is more complex than other conformal radiotherapy techniques. In this work, the authors present the feasibility of performing routine verification of VMAT delivery using a dose matrix measured by a gantry mounted 2D ion chamber array and corresponding dose matrix calculated by an inhouse developed algorithm.Methods: Pinnacle, v9.0, treatment planning system (TPS) was used in this study to generate VMAT plans for a 6 MV photon beam from an Elekta-Synergy linear accelerator. An algorithm was developed and implemented with inhouse computer code to calculate the dose matrix resulting from a VMAT arc in a plane perpendicular to the beam at isocenter. The algorithm was validated using measurement of standard patterns and clinical VMAT plans with a 2D ion chamber array. The clinical VMAT plans were also validated using ArcCHECK measurements. The measured and calculated dose matrices were compared using gamma ({gamma}) analysis with 3%/3 mm criteria and {gamma} tolerance of 1.Results: The dose matrix comparison of standard patterns has shown excellent agreement with the mean {gamma} pass rate 97.7 ({sigma}= 0.4)%. The validation of clinical VMAT plans using the dose matrix predicted by the algorithm and the corresponding measured dose matrices also showed good agreement with the mean {gamma} pass rate of 97.6 ({sigma}= 1.6)%. The validation of clinical VMAT plans using ArcCHECK measurements showed a mean pass rate of 95.6 ({sigma}= 1.8)%.Conclusions: The developed algorithm was shown to accurately predict the dose matrix, in a plane perpendicular to the beam, by considering all possible leaf trajectories in a VMAT delivery. This enables the verification of VMAT delivery using a 2D array detector mounted on a treatment head.

61 RADIATION PROTECTION AND DOSIMETRY↗

Nuclear Energy Knowledge and Validation Center (NEKVaC) Needs Workshop Summary Report

The Department of Energy (DOE) has made significant progress developing simulation tools to predict the behavior of nuclear systems with greater accuracy and of increasing our capability to predict the behavior of these systems outside of the standard range of applications. These analytical tools require a more complex array of validation tests to accurately simulate the physics and multiple length and time scales. Results from modern simulations will allow experiment designers to narrow the range of conditions needed to bound system behavior and to optimize the deployment of instrumentation to limit the breadth and cost of the campaign. Modern validation, verification and uncertainty quantification (VVUQ) techniques enable analysts to extract information from experiments in a systematic manner and provide the users with a quantified uncertainty estimate. Unfortunately, the capability to perform experiments that would enable taking full advantage of the formalisms of these modern codes has progressed relatively little (with some notable exceptions in fuels and thermal-hydraulics); the majority of the experimental data available today is the "historic" data accumulated over the last decades of nuclear systems R&D. A validated code-model is a tool for users. An unvalidated code-model is useful for code developers to gain understanding, publish research results, attract funding, etc. As nuclear analysis codes have become more sophisticated, so have the measurement and validation methods and the challenges that confront them. A successful yet cost-effective validation effort requires expertise possessed only by a few, resources possessed only by the well-capitalized (or a willing collective), and a clear, well-defined objective (validating a code that is developed to satisfy the need(s) of an actual user). To that end, the Idaho National Laboratory established the Nuclear Energy Knowledge and Validation Center to address the challenges of modern code validation and to manage the knowledge from past, current, and future experimental campaigns. By pulling together the best minds involved in code development, experiment design, and validation to establish and disseminate best practices and new techniques, the Nuclear Energy Knowledge and Validation Center (NEKVaC or the ‘Center’) will be a resource for industry, DOE Programs, and academia validation efforts.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Verification and Validation in a Rapid Software Development Process

The high cost of software production is driving development organizations to adopt more automated design and analysis methods such as rapid prototyping, computer-aided software engineering (CASE) tools, and high-level code generators. Even developers of safety-critical software system have adopted many of these new methods while striving to achieve high levels Of quality and reliability. While these new methods may enhance productivity and quality in many cases, we examine some of the risks involved in the use of new methods in safety-critical contexts. We examine a case study involving the use of a CASE tool that automatically generates code from high-level system designs. We show that while high-level testing on the system structure is highly desirable, significant risks exist in the automatically generated code and in re-validating releases of the generated code after subsequent design changes. We identify these risks and suggest process improvements that retain the advantages of rapid, automated development methods within the quality and reliability contexts of safety-critical projects.

Callahan, John R.↗

Dosimetric characterization and output verification for conical brachytherapy surface applicators. Part II. High dose rate {sup 192}Ir sources

Purpose: Historically, treatment of malignant surface lesions has been achieved with linear accelerator based electron beams or superficial x-ray beams. Recent developments in the field of brachytherapy now allow for the treatment of surface lesions with specialized conical applicators placed directly on the lesion. Applicators are available for use with high dose rate (HDR){sup 192}Ir sources, as well as electronic brachytherapy sources. Part I of this paper discussed the applicators used with electronic brachytherapy sources. Part II will discuss those used with HDR {sup 192}Ir sources. Although the use of these applicators has gained in popularity, the dosimetric characteristics have not been independently verified. Additionally, there is no recognized method of output verification for quality assurance procedures with applicators like these. Methods: This work aims to create a cohesive method of output verification that can be used to determine the dose at the treatment surface as part of a quality assurance/commissioning process for surface applicators used with HDR electronic brachytherapy sources (Part I) and{sup 192}Ir sources (Part II). Air-kerma rate measurements for the {sup 192}Ir sources were completed with several models of small-volume ionization chambers to obtain an air-kerma rate at the treatment surface for each applicator. Correction factors were calculated using MCNP5 and EGSnrc Monte Carlo codes in order to determine an applicator-specific absorbed dose to water at the treatment surface from the measured air-kerma rate. Additionally, relative dose measurements of the surface dose distributions and characteristic depth dose curves were completed in-phantom. Results: Theoretical dose distributions and depth dose curves were generated for each applicator and agreed well with the measured values. A method of output verification was created that allows users to determine the applicator-specific dose to water at the treatment surface based on a measured air-kerma rate. Conclusions: The novel output verification methods described in this work will reduce uncertainties in dose delivery for treatments with these kinds of surface applicators, ultimately improving patient care.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

SAPHIRE 8 Software Independent Verification and Validation Plan

SAPHIRE 8 is being developed with a phased or cyclic iterative rapid application development methodology. Due to this approach, a similar approach is being taken for the IV&V activities on each vital software object. The IV&V plan is structured around NUREG/BR-0167, “Software Quality Assurance Program and Guidelines,” February 1993. The Nuclear Regulatory Research Office Instruction No.: PRM-12, “Software Quality Assurance for RES Sponsored Codes,” March 26, 2007 specifies that RES-sponsored software is to be evaluated against NUREG/BR-0167. Per the guidance in NUREG/BR-0167, SAPHIRE is classified as “Level 1.” Level 1 software corresponds to technical application software used in a safety decision.

99 GENERAL AND MISCELLANEOUS↗

Production and Testing of the VITAMIN-B7 Fine-Group and BUGLE-B7 Broad-Group Coupled Neutron/Gamma Cross-Section Libraries Derived from ENDF/B-VII.0 Nuclear Data

New coupled neutron-gamma cross-section libraries have been developed for use in light water reactor (LWR) shielding applications, including pressure vessel dosimetry calculations. The libraries, which were generated using Evaluated Nuclear Data File/B Version VII Release 0 (ENDF/B-VII.0), use the same fine-group and broad-group energy structures as the VITAMIN-B6 and BUGLE-96 libraries. The processing methodology used to generate both libraries is based on the methods used to develop VITAMIN-B6 and BUGLE-96 and is consistent with ANSI/ANS 6.1.2. The ENDF data were first processed into the fine-group pseudo-problem-independent VITAMIN-B7 library and then collapsed into the broad-group BUGLE-B7 library. The VITAMIN-B7 library contains data for 391 nuclides. This represents a significant increase compared to the VITAMIN-B6 library, which contained data for 120 nuclides. The BUGLE-B7 library contains data for the same nuclides as BUGLE-96, and maintains the same numeric IDs for those nuclides. The broad-group data includes nuclides which are infinitely dilute and group collapsed using a concrete weighting spectrum, as well as nuclides which are self-shielded and group collapsed using weighting spectra representative of important regions of LWRs. The verification and validation of the new libraries includes a set of critical benchmark experiments, a set of regression tests that are used to evaluate multigroup crosssection libraries in the SCALE code system, and three pressure vessel dosimetry benchmarks. Results of these tests confirm that the new libraries are appropriate for use in LWR shielding analyses and meet the requirements of Regulatory Guide 1.190.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Using Verified Lifting to Optimize Legacy Stencil Codes (Final Project Report)

This project investigated new techniques for compiling stencil and stencil-like computations. Stencils computations are commonly found in applications such as image processing, physical simulations, image processing, and machine learning. In recent years, many high-performance domain-specific languages (DSLs) have been proposed to optimize stencil computations. To leverage such DSLs, however, existing codes often need to be rewritten. Such rewriting is manual, labor intensive, and error-prone. To alleviate such issues, this project investigated the application of program synthesis and artificial learning techniques to enable stencil computations to automatically leverage new high-performance DSLs. Rather than constructing syntax driven rules, verified lifting uses program synthesis to search for a target code fragment to compile the given input code into. In addition, it also searches for a proof that validates how the found target code fragment preserves the semantics of the original input. Thus, the target code fragment is guaranteed to be semantically equivalent to the input.

97 MATHEMATICS AND COMPUTING↗

Validation of NEAMS Tools Using MSRE Data

This report documents the benchmarks developed and performed for the tools and codes developed under the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program utilizing the MSRE experiment data. There are three focus areas explored in this work: fuel evolution, CFD, and system transient analyses. Fuel depletion is important for MSR reactor physics and fuel cycle analysis. Fuel depletion capability is currently being developed in the Griffin reactor physics code. To support this, a benchmark problem is developed using the MSRE data and an existing depletion code with flowing fuel analysis functionality (ADDER) to validate this new capability in Griffin. The ADDER calculation is compared with the TRITON-MSR results as well as the MSRE experimental data. This benchmark can be directly used to verify and validate the Griffin fuel depletion capability in future years. For CFD simulation, the MSRE CAD model is obtained from the Copenhagen Atomics and a mesh is generated for the MSRE inlet plenum. The Nek5000 code will be employed to find the flow distribution in the MSRE inlet plenum based on the mesh generated. For system analysis, a simple benchmark problem for three types of MSR system transients is developed. The SAM and SPECTRA codes are used to solve the simple problem, and the results from the two codes agree well. The SAM code is also employed to obtain the frequency response of the MSRE system at the 5 and 8 MWt power levels. The results agree well with the experiment measurements. These verification and validation efforts gives SAM users more confidence in MSR system transient simulations using SAM. Lastly, the SAM-Griffin Multiphysics coupling work is initiated. A simple one-way coupling of evaluating the precursor drift effect on the MSRE k-eff is demonstrated. This preliminary coupling work serves as the basis for future more complex Multiphysics simulation and modelling.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

OC6 Phase Ia: CFD Simulations of the Free-Decay Motion of the DeepCwind Semisubmersible

Currently, the design of floating offshore wind systems is primarily based on mid-fidelity models with empirical drag forces. The tuning of the model coefficients requires data from either experiments or high-fidelity simulations. As part of the OC6 (Offshore Code Comparison Collaboration, Continued, with Correlation, and unCertainty (OC6) is a project under the International Energy Agency Wind Task 30 framework) project, the present investigation explores the latter option. A verification and validation study of computational fluid dynamics (CFD) models of the DeepCwind semisubmersible undergoing free-decay motion is performed. Several institutions provided CFD results for validation against the OC6 experimental campaign. The objective is to evaluate whether the CFD setups of the participants can provide valid estimates of the hydrodynamic damping coefficients needed by mid-fidelity models. The linear and quadratic damping coefficients and the equivalent damping ratio are chosen as metrics for validation. Large numerical uncertainties are estimated for the linear and quadratic damping coefficients; however, the equivalent damping ratios are more consistently predicted with lower uncertainty. Some difference is observed between the experimental and CFD surge-decay motion, which is caused by mechanical damping not considered in the simulations that likely originated from the mooring setup, including a Coulomb-friction-type force. Overall, the simulations and the experiment show reasonable agreement, thus demonstrating the feasibility of using CFD simulations to tune mid-fidelity models.

17 WIND ENERGY↗

Software and Human-Machine Interface Development for Environmental Controls Subsystem Support

The Space Launch System (SLS) is the next premier launch vehicle for NASA. It is the next stage of manned space exploration from American soil, and will be the platform in which we push further beyond Earth orbit. In preparation of the SLS maiden voyage on Exploration Mission 1 (EM-1), the existing ground support architecture at Kennedy Space Center required significant overhaul and updating. A comprehensive upgrade of controls systems was necessary, including programmable logic controller software, as well as Launch Control Center (LCC) firing room and local launch pad displays for technician use. Environmental control acts as an integral component in these systems, being the foremost system for conditioning the pad and extremely sensitive launch vehicle until T-0. The Environmental Controls Subsystem (ECS) required testing and modification to meet the requirements of the designed system, as well as the human factors requirements of NASA software for Validation and Verification (V&V). This term saw significant strides in the progress and functionality of the human-machine interfaces used at the launch pad, and improved integration with the controller code.

Dobson, Matthew↗

NASA Engineering and Safety Center Technical Bulletin No. 21-05: Industry Recommendations from Arecibo Observatory Zinc Spelter Socket Joint Failure Analysis

A structural analysis and forensic investigation concluded that the Arecibo Observatory M4N socket joint failure in August 2020 was primarily due to cumulative damage caused by initially low structural design margins and a high percentage of sustained load, resulting in zinc creep deformation, progressive internal socket wire damage, and eventual loss of joint capacity. Open spelter sockets of this type are used throughout industry in stay cables. Recommendations are proposed to prevent failures of similar socket joints, including verification of positive stress margins in socket joint wires for all failure modes, periodic visual inspections with pass/fail criteria for zinc extrusion that are tied to structural qualification, and revisiting codes/ industry standards to capture lessons learned.

Arecibo Observatory↗

SAM Two-Phase Flow Model Development and Applications for Operational Transients in Advanced Reactors

As advanced nuclear technologies continue to develop, the need for the flexible operation and generation of these advanced reactors becomes necessary to maximize economic potential. As large-scale experiments are not always feasible, modeling and simulations of advanced reactors play a crucial role in design optimization and analysis. The SAM (System Analysis Module) code developed at Argonne National Laboratory is a state-of-the-art system-level thermal-hydraulic code aimed at simulating advanced reactor systems. Recent code developments have implemented two-phase flow modeling using the homogeneous equilibrium model, and a new steam generator component has been developed to utilize the two-phase flow implementation. In addition to verification tests, a load-following simulation was performed to model a realistic load-following transient in a proposed integrated system consisting of a conceptual advanced reactor known as the Advanced Burner Test Reactor (ABTR) and thermal energy storage (TES) tanks. The integrated system model uses two large TES tanks designed for sodium and a model helical coil steam generator to simulate the operational load-following transient. The flow rates of the feedwater and secondary loops are regulated to meet a prescribed steam generator load consistent with the electricity demand over a 24-h period. In conclusion, the results found the ABTR system was able to maintain stable reactor conditions and primary- and secondary-side characteristics over the course of the load-following transient.

Advanced Burner Test Reactor (ABTR)↗

SU-E-T-815: In Vivo Dosimetry and Daily Arc Junction Verification Using EBT3 Gafchromic Film for Pediatric Cranio-Spinal Irradiation

Purpose: Perform dosimetric comparison between planned and delivered dose in the junction area, measure daily dose variation in the arc junction area for pediatric patients treated for medulloblastoma using Craniospinal axis irradiation(CSI) Material and methods Dose comparison in the junction area, daily dose variation in the arc junction area for a Rando Phantom and 5 pediatric patients treated using CSI technique were analyzed. Plans were created using the Eclipse treatment planning system. Two arcs for cranium and 1 arc for spine region were used. Planar dose matrix was created by projecting phantom and patient plan into the ArcCheck phantom. EBT3 film was placed in the middle of ArcCheck plug to measure dose distribution in the junction areaDuring patient treatment, strip of EBT3 film was placed daily at each junction area for verification. EBT3 films were scanned using a flatbed scanner, Epson Expression 10000 XL. Film QA pro software was used to analyze film. Scanning and analysis was performed according to vendor recommendations and AAPM TG-55 report. Films were scanned and analyzed daily after each treatment and at the end of treatment course. Planar dose distributions from films were compared with planar dose distribution from treatment planning system. Results: Comparison of planned vs. measured dose distributions for patients have passing rates of 90%–100% with 3% and 3 mm gamma analysis. In some of the treatment fractions, daily setup film showed variation in dose distribution in the junction area. Conclusion: It is critical to measure dose distribution in the arc junction area and use additional quality assurance measures to verify daily setup for CSI patient where one or more junctions are present. EBT3 film prove to be a good tool to achieve this task considering flexibility associated with the film such as symmetry, self-developing and ease of use.

60 APPLIED LIFE SCIENCES↗

Mobile Pit verification system design based on passive special nuclear material verification in weapons storage facilities

A mobile 'drive by' passive radiation detection system to be applied in special nuclear materials (SNM) storage facilities for validation and compliance purposes has been designed through the use of computational modeling and new radiation detection methods. This project was the result of work over a 1 year period to create optimal design specifications to include creation of 3D models using both Monte Carlo and deterministic codes to characterize the gamma and neutron leakage out each surface of SNM-bearing canisters. Results were compared and agreement was demonstrated between both models. Container leakages were then used to determine the expected reaction rates using transport theory in the detectors when placed at varying distances from the can. A 'typical' background signature was incorporated to determine the minimum signatures versus the probability of detection to evaluate moving source protocols with collimation. This established the criteria for verification of source presence and time gating at a given vehicle speed. New methods for the passive detection of SNM were employed and shown to give reliable identification of age and material for highly enriched uranium (HEU) and weapons grade plutonium (WGPu). The finalized 'Mobile Pit Verification System' (MPVS) design demonstrated that a 'drive-by' detection system, collimated and operating at nominally 2 mph, is capable of rapidly verifying each and every weapon pit stored in regularly spaced, shelved storage containers, using completely passive gamma and neutron signatures for HEU and WGPu. This system is ready for real evaluation to demonstrate passive total material accountability in storage facilities. (authors)

97 MATHEMATICS AND COMPUTING↗

Verification Test of the SURF and SURFplus Models in xRage: Part II

The previous study used an underdriven detonation wave (steady ZND reaction zone profile followed by a scale invariant rarefaction wave) for PBX 9502 as a validation test of the implementation of the SURF and SURFplus models in the xRage code. Even with a fairly fine uniform mesh (12,800 cells for 100mm) the detonation wave profile had limited resolution due to the thin reaction zone width (0.18mm) for the fast SURF burn rate. Here we study the effect of finer resolution by comparing results of simulations with cell sizes of 8, 2 and 1 μm, which corresponds to 25, 100 and 200 points within the reaction zone. With finer resolution the lead shock pressure is closer to the von Neumann spike pressure, and there is less noise in the rarefaction wave due to fluctuations within the reaction zone. As a result the average error decreases. The pointwise error is still dominated by the smearing the pressure kink in the vicinity of the sonic point which occurs at the end of the reaction zone.

97 MATHEMATICS AND COMPUTING↗

Verification of a Depletion Method in SCALE for the Advanced High Temperature Reactor

This study describes a new method utilizing the Dancoff factor to model a non-standard TRISO fuel form characteristic of the AHTR reactor design concept for depletion analysis using the TRITON sequence of SCALE and the validation of this method by code-to-code comparisons. The fuel used in AHTR has the TRISO particles concentrated along the edges of a slab fuel element. This particular geometry prevented the use of a standard DOUBLEHET treatment, previously developed in SCALE to handle NGNP-designed fuel. The new method permits fuel depletion on complicated geometries that traditionally can be handled only by continuous energy based depletion code systems. The method was initially tested on a fuel design typical of the NGNP, where the DOUBLEHET treatment is available. A more comprehensive study was performed using the VESTA code that uses the continuous energy MCNP5 code as a transport solver and ORIGEN2.2 code for depletion calculations. Comparisons of the results indicate good agreement of whole core characteristics, such as the multiplication factor, and the isotopics, including their spatial distribution. Key isotopes analyzed included 235U, 239Pu, 240Pu and 241Pu. The results from this study indicate that the Dancoff factor method can generate estimates of core characteristics with reasonable precision for scoping studies of configurations where the DOUBLEHET treatment is unavailable.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗