Search NASA⌕ Search

SEARCH · Search NASA

Results for “code validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,423 records · Page 79

LANL-SNL Collaboration on NCS Validation

During 2016, nuclear criticality safety (NCS) practitioners from SNL and code developers from LANL collaborated in several areas of interest to the DOE/NNSA Nuclear Criticality Safety Program (NCSP). This collaboration involved: - Testing of the preliminary release of the MCNP6- Whisper methodology, with feedback to the developers, - Sharing of the benchmark catalogs (the collection of MCNP input files and benchmark results), with 1101 cases from LANL and 866 cases from SNL, - Comparison and analysis of 357 benchmarks common to both catalogs, - Investigation of the impact of the different benchmark catalogs on sensitivity-uncertainty based NCS validation results from MCNP6-Whisper, - Investigation of the impact of randomized selections from the benchmark catalog on sensitivity-uncertainty based validation results from MCNP6-Whisper. - Investigation of the use of MCNP6-Whisper in selecting benchmarks for use in NCS validation for unique, nonstandard, legacy fuel applications. This paper summarizes the collaboration work and initial results. It must be noted that the results described herein are preliminary and need further research and detailed analysis. However, the initial results are very interesting, and it is important to share them with the NCSP community.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Differences in Health Care, Family, and Community Factors Associated with Mental, Behavioral, and Developmental Disorders Among Children Aged 2–8 Years in Rural and Urban Areas — United States, 2011–2012

Problem/Condition: Mental, behavioral, and developmental disorders (MBDDs) begin in early childhood and often affect lifelong health and well-being. Persons who live in rural areas report more health-related disparities than those in urban areas, including poorer health, more health risk behaviors, and less access to health resources. Reporting Period: 2011–2012. Description of System: The National Survey of Children’s Health (NSCH) is a cross-sectional, random-digit–dial telephone survey of parents or guardians that collects information on noninstitutionalized children aged <18 years in the United States. Interviews included indicators of health and well-being, health care access, and family and community characteristics. Using data from the 2011–2012 NSCH, this report examines variations in health care, family, and community factors among children aged 2–8 years with and without MBDDs in rural and urban settings. Restricting the data to U.S. children aged 2–8 years with valid responses for child age and sex, each MBDD, and zip code resulted in an analytic sample of 34,535 children; MBDD diagnosis was determined by parent report and was not validated with health care providers or medical records. Results: A higher percentage of all children in small rural and large rural areas compared with all children in urban areas had parents who reported experiencing financial difficulties (i.e., difficulties meeting basic needs such as food and housing). Children in all rural areas more often lacked amenities and lived in a neighborhood in poor condition. However, a lower percentage of children in small rural and isolated areas had parents who reported living in an unsafe neighborhood, and children in isolated areas less often lived in a neighborhood lacking social support, less often lacked a medical home, and less often had a parent with fair or poor mental health. Across rural subtypes, approximately one in six young children had a parent-reported MBDD diagnosis. A higher prevalence was found among children in small rural areas (18.6%) than in urban areas (15.2%). In urban and the majority of rural subtypes, children with an MBDD more often lacked a medical home, had a parent with poor mental health, lived in families with financial difficulties, and lived in a neighborhood lacking physical and social resources than children without an MBDD within each of those community types. Only in urban areas did a higher percentage of children with MBDDs lack health insurance than children without MBDDs. After adjusting for race/ethnicity and poverty among children with MBDDs, those in rural areas more often had a parent with poor mental health and lived in resource-low neighborhoods than those in urban areas. Interpretation: Certain health care, family, and community disparities were more often reported among children with MBDDS than among children without MBDDs in rural and urban areas. Public Health Action: Collaboration involving health care, family, and community services and systems can be used to address fragmented services and supports for children with MBDDs, regardless of whether they live in urban or rural areas. However, addressing differences in health care, family, and community factors and leveraging community strengths among children who live in rural areas present opportunities to promote health among children in rural communities.

60 APPLIED LIFE SCIENCES↗

Using a Large Language Model as a Building Block to Generate Usable Validation and Verification Suite for OpenMP

In the HPC area, both hardware and software move quickly. Often new hardware is developed and deployed, the corresponding software stack, including compilers and other tools, are under active development while leading edge software developers are working to port and tune their applications, all at the same time. While the software ecosystem is in flux, one of the key challenges for users is obtaining insight into the state of implementation of key features in the programming languages and models their applications are using – whether they have been implemented, and whether the implementation conforms to the specification, especially for newly implemented features (less tested by widespread use). OpenMP is one of the most prominent shared memory programming models used for on-node programming in HPC. With the shift towards accelerators (such as GPUs and FPGAs) and heterogeneous programming OpenMP features are getting more complex. It is natural to ask whether generative AI approaches, and large language models (LLMs) in particular, can help in producing validation and verification test suites to allow users better and faster insights into the availability and correctness of OpenMP features of interest. In this work, we explore the use of ChatGPT-4 to generate a suite of tests for OpenMP features. We have chosen a set of directives and clauses, a total of 78 combinations, which first appeared in OpenMP 3.0 (released in May 2008) but are also relevant for accelerators. We prompted ChatGPT to generate tests in the C and Fortran languages, for both host (CPU) and device (accelerator). On the Summit super-computer using the GNU implementation, we found that, of the 78 generated tests 67 C tests and 43 Fortran tests compiled successfully and fewer than those executed to completion. On further analysis we show that not all generated tests are valid. We document the process, results, and provide detailed analysis regarding the quality of tests generated. With the aim of providing input to a production quality validation and verification suite, we manually implement the corrections required to make the tests valid according to the current OpenMP specification. We quantify this effort as small, medium, or large, and record the lines of code changed to correct the invalid tests. With the corrected tests we validate recent implementations from HPE, AMD, and GNU on the Frontier supercomputer. Our experiment and subsequent analysis show that although LLMs are capable of producing HPC specific codes, they are limited by their understanding of the deeper semantics and restrictions of programming models such as OpenMP. Unsurprisingly more commonly used features have better support, while some OpenMP 3.0 directives such as sections and tasking are not universally supported on accelerators. We demonstrate that successful compilation and execution to completion are inadequate metrics for evaluating generated code and that, at this time, commodity LLMs require expert intervention for code verification. This points to gaps in the training data that is currently available for HPC. We demonstrate that with "small" effort 37% of generated invalid C tests and 63% of generated invalid Fortran tests could be corrected. This improves productivity of test generation as we circumvent writing from scratch and the common programming errors associated with it.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗

SAPHIRE 8 Quality Assurance Software Metrics Report

The purpose of this review of software metrics is to examine the quality of the metrics gathered in the 2010 IV&V and to set an outline for results of updated metrics runs to be performed. We find from the review that the maintenance of accepted quality standards presented in the SAPHIRE 8 initial Independent Verification and Validation (IV&V) of April, 2010 is most easily achieved by continuing to utilize the tools used in that effort while adding a metric of bug tracking and resolution. Recommendations from the final IV&V were to continue periodic measurable metrics such as McCabe's complexity measure to ensure quality is maintained. The four software tools used to measure quality in the IV&V were CodeHealer, Coverage Validator, Memory Validator, Performance Validator, and Thread Validator. These are evaluated based on their capabilities. We attempted to run their latest revisions with the newer Delphi 2010 based SAPHIRE 8 code that has been developed and was successful with all of the Validator series of tools on small tests. Another recommendation from the IV&V was to incorporate a bug tracking and resolution metric. To improve our capability of producing this metric, we integrated our current web reporting system with the SpiraTest test management software purchased earlier this year to track requirements traceability.

97 MATHEMATICS AND COMPUTING↗

Memory Scalability and Efficiency Analysis of Parallel Codes

Memory scalability is an enduring problem and bottleneck that plagues many parallel codes. Parallel codes designed for High Performance Systems are typically designed over the span of several, and in some instances 10+, years. As a result, optimization practices which were appropriate for earlier systems may no longer be valid and thus require careful optimization consideration. Specifically, parallel codes whose memory footprint is a function of their scalability must be carefully considered for future exa-scale systems. In this paper we present a methodology and tool to study the memory scalability of parallel codes. Using our methodology we evaluate an application s memory footprint as a function of scalability, which we coined memory efficiency, and describe our results. In particular, using our in-house tools we can pinpoint the specific application components which contribute to the application s overall memory foot-print (application data- structures, libraries, etc.).

Janjusic, Tommy↗

Buffer-IPyC separation process in TRISO fuel particles simulated with Bison code

During High Temperature Gas-cooled Reactor (HTGR) operation, tristructural isotropic (TRISO) coated-particle fuel undergoes irradiation-induced changes in morphology and thermomechanical properties. Experimental results from the Advanced Gas Reactor (AGR) Fuel Development and Qualification Program show, among other things, the mechanism of gap formation between the buffer and inner pyrolytic carbon (IPyC) layers, which could be explored further via computational simulations using the Bison code. Two simulation models were developed, the debonding restricted model, where no gap formation between buffer and IPyC layers is permitted, and the debonding enabled model, where the gap between those layers is created. The inputs of the simulated models are based on the irradiation conditions from the AGR-1 experiment. The research included simulations on spherical and aspherical fuel types. Under the specific temperatures and fluences of the AGR-1 irradiation experiment, and the Bison simulations, it was concluded that the most common scenario is a gap formation along the buffer-IPyC interface, while the least possible scenario is the situation where there is no gap formation at the buffer-IPyC junction. The computational results confirmed that the sphericity of the fuel influences the thickness of the gap that occurs at the buffer-IPyC junction, in a way that with increasing aspect ratio the gap thickness increases. The results obtained for spherical and aspherical fuel are nearly identical. Finally, performed simulations match conclusions observed from the AGR-1 experiment, which as such shows that the Bison code is a good computational method for simulating the TRISO fuel. Future simulations will include the validation of performed research and comparison of the results between Bison and PARFUME codes.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A thermodynamics-based damage model for the non-linear mechanical behavior of SiC/SiC ceramic matrix composites in irradiation and thermal environments

A damage model is developed and validated with experimental data for the non-linear mechanical behavior of SiC/SiC composite materials in nuclear applications. Cyclic thermal and mechanical loading associated with neutron irradiation effects of these composites leads to wide-spread and progressive micro-cracking that leads to loss of thermal conductivity and further enhancement of thermo-mechanical damage. A physics-based model of wide-spread micro-cracking is developed within the thermodynamic framework of continuum damage mechanics. Evolution equations for damage parameters that describe the growth of continuum damage are developed, where the material variables are obtained from experiments. The model novelty is in coupling mechanical, thermal, and irradiation damage through a consistent thermodynamic framework, including loss of thermal conductivity due to the evolution of mechanically induced micro-cracks. A number of thermo-mechanical experiments were conducted to confirm model assumptions. The model is shown to be validated with out-of-pile experiments, and then implemented using commercial finite element code COMSOL to the fuel cladding problem with normal and high radiation dose cases.

Materials Science↗

Addition of tabulated equation of state and neutrino leakage support to illinoisgrmhd

Here we have added support for realistic, microphysical, finite-temperature equations of state (EOS) and neutrino physics via a leakage scheme to illinoisgrmhd, an open-source GRMHD code for dynamical spacetimes in the einstein toolkit. These new features are provided by two new, nrpy+-based codes: nrpyeos, which performs highly efficient EOS table lookups and interpolations, and nrpyleakage, which implements a new, adaptive mesh refinement (AMR)-capable neutrino leakage scheme in the einstein toolkit. We have performed a series of strenuous validation tests that demonstrate the robustness of these new codes, particularly on the Cartesian AMR grids provided by carpet. Furthermore, we show results from fully dynamical GRMHD simulations of single unmagnetized neutron stars, and magnetized binary neutron star mergers. This new version of illinoisgrmhd, as well as nrpyeos and nrpyleakage, is pedagogically documented in jupyter notebooks and fully open source. The codes will be proposed for inclusion in an upcoming version of the einstein toolkit.

79 ASTRONOMY AND ASTROPHYSICS↗

Validation of columnar CsI x-ray detector responses obtained with hybridMANTIS, a CPU-GPU Monte Carlo code for coupled x-ray, electron, and optical transport

Purpose: hybridMANTIS is a Monte Carlo package for modeling indirect x-ray imagers using columnar geometry based on a hybrid concept that maximizes the utilization of available CPU and graphics processing unit processors in a workstation. Methods: The authors compare hybridMANTIS x-ray response simulations to previously published MANTIS and experimental data for four cesium iodide scintillator screens. These screens have a variety of reflective and absorptive surfaces with different thicknesses. The authors analyze hybridMANTIS results in terms of modulation transfer function and calculate the root mean square difference and Swank factors from simulated and experimental results. Results: The comparison suggests that hybridMANTIS better matches the experimental data as compared to MANTIS, especially at high spatial frequencies and for the thicker screens. hybridMANTIS simulations are much faster than MANTIS with speed-ups up to 5260. Conclusions: hybridMANTIS is a useful tool for improved description and optimization of image acquisition stages in medical imaging systems and for modeling the forward problem in iterative reconstruction algorithms.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Verification and Validation of Open-Source Computational Fluid Dynamics Capabilities in MOOSE

The Multiphysics Object Oriented Simulation Environment (MOOSE) advances predictive modeling in nuclear research by simplifying the application design process and making modeling more efficient and accessible to researchers and the broader community. Because of MOOSE’s critical role in the scientific computation field, verification and validation are important to evaluate the reliability and credibility of MOOSE’s code, simulations, and models. To assess MOOSE’s Navier Stokes module and turbulence models, the following verification and validation University of Manchester ERCOFTAC cases were simulated in MOOSE, and the results were compared: Case 032 Turbulent Flow in a 2D Channel Case 079 Natural Convection in an Enclosed Cavity

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

BISON fuel performance modeling optimization for experiment X447 and X447A using axial swelling and cladding strain measurements

With the recent need to qualify new reactor designs such as the Versatile Test Reactor (VTR), fuel performance calculations need to be performed to determine safety criteria of the proposed designs. In order to validate the fuel performance results obtained by a fuel performance code, BISON, for new reactor designs, legacy fuel from EBR-II and FFTF MFF with Post -Irradiation Examination (PIE) data need to be used as validation cases to benchmark models. Here in this work, BISON has been paired with the Fuels Irradiation & Physics Database (FIPD) and IFR Materials Information System (IMIS) to supply PIE data for comparison with simulations of EBR-II experiments X447/X447A. X447/X447A were assessed by implementing models for Fuel Cladding Chemical Interaction (FCCI) within BISON and optimizing the friction coefficient between the fuel surface and the cladding, the anisotropic swelling factor, and the HT9 first thermal creep scalar (which scales the first term in the HT9 creep equation) to best match the PIE axial fuel swelling height and cladding profilometry for all pins in X447/X447A. The optimal values were found using a generic algorithm developed to select different values for the three parameters until end criteria was met and error couldn’t be reduced further. The BISON-simulated cladding profilometry was evaluated using Standard Error of the Estimate (SEE) to account for the profile shape of the cladding profilometry. Optimal values for the friction coefficient, anisotropic fuel swelling factor, and HT9 first thermal creep scalar were found to best fit the BISON simulation results to the PIE measurements found in IMIS and FIPD. Improvements to current models are suggested to account for the underprediction of fuel swelling at low burnups and the overprediction of fuel swelling at higher burnups observed for the axial fuel swelling height. Although two pins in EBR-II X447/X447A (DP70 and DP75) were known to fail due to FCCI, none of the pins simulated in BISON reached a cumulative damage fraction (CDF) above 0.008 with FCCI correlations coupled in the BISON simulations. The error estimate generated for all pins in X447/X447A using optimal values was 209 µm, which is deemed acceptable.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

High-fidelity wind farm simulation methodology with experimental validation

The complexity and associated uncertainties involved with atmospheric-turbine-wake interactions produce challenges for accurate wind farm predictions of generator power and other important quantities of interest (QoIs), even with state-of-the-art high-fidelity atmospheric and turbine models. A comprehensive computational study was undertaken with consideration of simulation methodology, parameter selection, and mesh refinement on atmospheric, turbine, and wake QoIs to identify capability gaps in the validation process. For neutral atmospheric boundary layer conditions, the massively parallel large eddy simulation (LES) code Nalu-Wind was used to produce high-fidelity computations for experimental validation using high-quality meteorological, turbine, and wake measurement data collected at the Department of Energy/Sandia National Laboratories Scaled Wind Farm Technology (SWiFT) facility located at Texas Tech University’s National Wind Institute. The wake analysis showed the simulated lidar model implemented in Nalu-Wind was successful at capturing wake profile trends observed in the experimental lidar data.

17 WIND ENERGY↗

Heat Pipe Cooled Microreactors

Microreactor technologies are required to provide reliable carbon-free power generation in remote applications. The heat pipe cooled microreactor concept in particular offers notable advantages due to the passive operation of heat pipes enabling increased reliability and simplicity in a more compact form factor. There is a significant need for experimental work to aid and expedite the deployment of heat pipe microreactors due to their unique technological characteristics. Thus, there has been increased interest in heat pipe experiments by numerous institutions in order to support these efforts. The present work is a comprehensive review of heat pipe experiments, describing instrumentation, methods, phenomena of interest, and recent developments. In addition, legacy work on the operation of high-temperature heat pipes under irradiation is reviewed and discussed. Furthermore, the verification and validation efforts for the flagship heat pipe simulation code Sockeye are reviewed and requirements for future experiments are outlined. Lastly, future directions are proposed for heat pipe experimentation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Sensitivity-Uncertainty Based Nuclear Criticality Safety Validation

These are slides from a seminar given to the University of Mexico Nuclear Engineering Department. Whisper is a statistical analysis package developed to support nuclear criticality safety validation. It uses the sensitivity profile data for an application as computed by MCNP6 along with covariance files for the nuclear data to determine a baseline upper-subcritical-limit for the application. Whisper and its associated benchmark files are developed and maintained as part of MCNP6, and will be distributed with all future releases of MCNP6. Although sensitivity-uncertainty methods for NCS validation have been under development for 20 years, continuous-energy Monte Carlo codes such as MCNP could not determine the required adjoint-weighted tallies for sensitivity profiles. The recent introduction of the iterated fission probability method into MCNP led to the rapid development of sensitivity analysis capabilities for MCNP6 and the development of Whisper. Sensitivity-uncertainty based methods represent the future for NCS validation – making full use of today’s computer power to codify past approaches based largely on expert judgment. Validation results are defensible, auditable, and repeatable as needed with different assumptions and process models. The new methods can supplement, support, and extend traditional validation approaches.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Introduction to SINBAD - Tutorial - 25448

With the reduction of experimental activities in several countries accompanied by closing of many experimental facilities, the need to preserve the valuable information on the performed radiation shielding benchmarks became increasingly crucial. Since the early 1990's the Organization for Economic Cooperation and Development's Nuclear Energy Agency Data Bank (OECD/NEADB) and the Radiation Safety Information Computational Center (RSICC) are working together on the Shielding Integral Benchmark Archive and Database (SINBAD) project to preserve and make available the information on the past shielding benchmark experiments. The OECD NEA Working Party on Scientific Issues of Reactor Systems (WPRS) Expert Group on Radiation Transport and Shielding (EGRTS) was started in 2011 with the mandate among others, to monitor, steer and support the continued development of the SINBAD database. The database comprises now 102 shielding benchmarks, divided into three categories, covering both low and inter-mediate energy particles applications: fission reactor shielding (48 benchmarks), fusion blanket neutronics (31), and accelerator shielding (23) benchmarks. They are fundamental to ensure that modelling tools meet the requirements of nuclear industry and licensing needs. Validation of nuclear cross-section data, nuclear codes and models as well as nuclear design components are few examples of the use of the database. (authors)

61 RADIATION PROTECTION AND DOSIMETRY↗

U-10Mo Conversion Burnup Benchmarking Activities for Full-Size LEU Fuel Plates

Validation benchmark experiments for low-enriched uranium (LEU) U-Mo fuel systems are currently being developed from existing experiments irradiated in the Advanced Test Reactor. (ATR) and ATR Critical Facility (ATRC). The experiments chosen include the ATR Full size plate In center Flux trap Position (AFIP-7) experiment and the Ki-Jang Research Reactor Lead Test Assembly (KJRR-LTA) located in the Northeast Flux Trap. Each experiment was modeled using a high-fidelity three-dimensional Monte Carlo code with depletion capabilities. A description of the validation experiments will be provided as well as comparison to post irradiation examination results for the AFIP-7 experiment. The PIE results for the AFIP-7 experiment have demonstrated good agreement with analytical models. Due to the complex nature in of the ATR, modeling simplifications to support benchmark activities using lower fidelity reactor physics software. A discussion of the analytical bias associated with modeling simplifications will also be provided.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Software Verification and Validation Procedure

This Software Verification and Validation procedure provides the action steps for the Tank Waste Information Network System (TWINS) testing process. The primary objective of the testing process is to provide assurance that the software functions as intended, and meets the requirements specified by the client. Verification and validation establish the primary basis for TWINS software product acceptance.

99 GENERAL AND MISCELLANEOUS↗

ParaDyn Implementation in the US Navy's DYSMAS Simulation System: FY08 Progress Report

The goal of this project is to increase the computational efficiency and capacity of the Navy's DYSMAS simulation system for full ship shock response to underwater explosion. Specifically, this project initiates migration to a parallel processing capability for the structural portion of the overall fluid-structure interaction model. The capstone objective for the first phase is to demonstrate operation of the DYSMAS simulation engine with a production model on a Naval Surface Warfare Center (IHD) parallel platform using the ParaDyn code for parallel processing of the structural dynamics. This year saw a successful launch to integrate ParaDyn, the high-parallel structural dynamics code from Lawrence Livermore National Laboratory (LLNL), into the DYSMAS system for simulating the response of ship structures to underwater explosion (UNDEX). The current LLNL version of DYNA3D, representing ten years of general development beyond the source branch used to initiate DYNA-N customization for DYSMAS, was first connected to the GEMINI flow code through DYSMAS Standard Coupler Interface (SCI). This permitted an early 'sanity check' by Naval Surface Warfare Center, Indian Head Division (NSWC-IHD) personnel that equivalent results were generated for their standard UNDEX test problems, thus ensuring the Verification & Validation pedigree they have developed remains intact. The ParaDyn code was then joined to the SCI in a manner requiring no changes to GEMINI. Three NSWC-IHD engineers were twice hosted at LLNL to become familiar with LLNL computer systems, the execution of the prototype software system, and to begin assessment of its accuracy and performance. Scaling data for the flow solver GEMINI was attained up to a one billion cell, 1000 processor run. The NSWC-IHD engineers were granted privileges to continue their evaluations through remote connections to LLNL's Open Computing Facility. Finally, the prototype changes were integrated into the mainline ParaDyn source repository and issued as part of its Version 8.1 beta release. This source was transmitted to NSWC-IHD and in collaboration with LLNL personnel the entire ParaDyn software suite successfully installed and demonstrated on its new SGI Altix machine. The ability of even minor numbers of processors for the structural dynamics to impact overall time-to-solution for DYSMAS has been demonstrated. Assessments of combined parallel efficiencies are beginning to highlight areas for further DYSMAS optimizations.

42 ENGINEERING↗