Search NASA⌕ Search

SEARCH · Search NASA

Results for “code assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

LLM Benchmarking with LLaMA2: Evaluating Code Development Performance Across Multiple Programming Languages

The rapid evolution of large language models (LLMs) has opened new possibilities for automating various tasks in software development. This paper evaluates the capabilities of the LLaMA 2-70B model in automating these tasks for scientific applications written in commonly used programming languages. Using representative test problems, we assess the model's capacity to generate code, documentation, and unit tests, as well as its ability to translate existing code between commonly used programming languages. Our comprehensive analysis evaluates the compilation, runtime behavior, and correctness of the generated and translated code. Additionally, we assess the quality of automatically generated code, documentation, and unit tests. Here, our results indicate that while LLaMA 2-70B frequently generates syntactically correct and functional code for simpler numerical tasks, it encounters substantial difficulties with more complex, parallelized, or distributed computations, requiring considerable manual corrections. We identify key limitations and suggest areas for future improvements to better leverage AI-driven automation in scientific computing workflows.

97 MATHEMATICS AND COMPUTING↗

A framework for assessment of predictive capability maturity and its application in nuclear thermal hydraulics

Here this work presents a formalized and computerized framework for the assessment of decision regarding the adequacy of a simulation tool for a nuclear reactor application. The decision regarding a code’s adequacy for an application is dependent on the assessment of different attributes that govern verification, validation, and uncertainty quantification of the code. In this work, the focus is on code validation. Therefore, the framework is developed and illustrated from the perspective of decision regarding the validation assessment of a code. Code validation assessment is performed based on the validation test results, data applicability, and process quality assurance factors. The process quality assurance factors warrant the trustworthiness of the evidence and help in checking people and process compliance with respect to the standard requirements. The proposed framework is developed using an argument modeling technique called Goal Structuring Notation (GSN). Goal structuring notation facilitates structural knowledge representation, information abstraction, evidence incorporation, and provides a skeletal structure for quantitative maturity assessment. The decision schema for the development of the decision model is based on the Predictive Capability Maturity Model (PCMM) and Analytic Hierarchy Process (AHP) and formalized using Goal structuring notation. Each decision attribute is formulated as a claim, where the degree of validity of the claim (attribute’s assessment) is expressed using different maturity levels. The GSN representation of the decision model is transformed into a confidence network to provide evidence-based quantitative maturity assessment using the Bayesian network. A metric based on the expected utility of maturity levels, called expected distance metric, is proposed to measure the distance between target maturity and achieved maturity on a scale of zero to one. Expected distance metric helps in comparing the assessment of different attributes and identification of major areas of concern in terms of modeling capability, data needs, and quality of assessment process. The practical application of the framework is demonstrated by a case study on validation assessment of a thermal-hydraulic code for a challenge problem called Departure from Nucleate Boiling (DNB).

42 ENGINEERING↗

Energy Savings Analysis of the Proposed Revision of the Washington D.C. Non-Residential Energy Code

This report presents the results of an assessment of savings for the proposed Washington D.C. energy code relative to ASHRAE Standard 90.1-2010. It includes annual and life cycle savings for site energy, source energy, energy cost, and carbon dioxide emissions that would result from adoption and enforcement of the proposed code for newly constructed buildings in Washington D.C. over a five year period.

Commercial Energy Code↗

RELAP5-3D Modeling of High Temperature Test Facility (HTTF) Test PG-26

The High Temperature Test Facility (HTTF) at Oregon State University (OSU) is a scaled integral effects experiment designed to investigate transient behavior in high-temperature gas-cooled nuclear reactors with prismatic fuel and reflector blocks. Several tests have been completed, and more are still planned to at the HTTF, including depressurized conduction cooldown (DCC) and pressurized conduction cooldown (PCC) transients. This report analyses test PG-26, a progression of the Double Ended Inlet-Outlet Crossover Duct Break transient that is referred to as a DCC. PG-26 has been performed at the HTTF between May 30 and June 30, 2019. Core initial conditions (i.e., before the DCC started) have been met using low power (<100 kW) and two of ten available electric heaters. The DCC transient was initiated during the 50 th hour of the test. The break valves were opened, and hot helium from the core and cold helium from the reactor cavity simulation tank (RCST) started mixing. The gases flowed in a countercurrent fashion, where the top half of the hot duct contained hot helium that flowed in one direction and cold helium that flowed in the other direction in the bottom half of the duct. After the pressure and density reached equilibrium, the event entered a diffusion mode. The onset of a reverse natural circulation was not observed during the DCC period of the test. Version 4.4.2ie of the RELAP5-3D computer code has been used to model the HTTF PG-26 test, and results have been compared to available high-quality measured data. The model used in this study is the quality-controlled HTTF RELAP5-3D model (HTTF base 2018-04-19 QA), originally developed by P. Bayless. The report includes RELAP5-3D results of the “base calculations” as well as some sensitivities to important uncertain model inputs, such as primary helium mass flow rate, core ceramic thermal properties, as well as heat evacuation and loop friction models. Using the base RELAP5-3D model predicts a countercurrent helium flow in the hot duct observed at the beginning of the DCC, but instead of going into a molecular diffusion mode, the model predicts the onset of natural convection. Increasing friction in the core and hot duct prevents the natural convection from happening in some of the simulations. Although some temperatures are well predicted (and even overpredicted), the general tendency is to underpredict the ceramic and helium temperatures and heat removal rates during the DCC, resulting in many of the assessment findings being in minimal or insufficient agreement with the data. It is worth noting that the described discrepancies between measured data and RELAP5-3D predictions are not RELAP5-3D code limitations. More so, they reflect limitations in boundary condition and thermal property knowledge. While the RELAP5-3D calculations of the test provide some insights into what happens during the transient, and point to missing or potentially uncertain data to which the experimenters can direct their attention, the principal conclusion is that the PG-26 test data are insufficient for a system code assessment.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Measurement and modeling of proton-induced reactions on arsenic from 35 to 200 MeV

72 As is a promising positron emitter for diagnostic imaging that can be employed locally using a 72 Se generator. However, current reaction pathways to 72 Se have insufficient nuclear data for efficient production using regional 100–200 MeV high-intensity proton accelerators. In order to address this deficiency, stacked-target irradiations were performed at LBNL, LANL, and BNL to measure the production of the 72 Se/ 72 As positron emission tomography (PET) generator system via 75 As (p, x) between 35 and 200 MeV. This work provides the most well-characterized excitation function for 75 As ( p , 4 n ) 72 Se starting from threshold. Additional focus was given to report the first measurements of 75 As (p, x) 68 Ge and bolster an already robust production capability for the highly valuable 68 Ge/ 68 Ga PET generator. Thick target yield comparisons with prior established formation routes to both generators are made. In total, high-energy proton-induced cross sections are reported for 55 measured residual products from 75 As, nat Cu , and nat Ti targets, where the latter two materials were present as monitor foils. These results were compared with literature data as well as the default theoretical calculations of the nuclear model codes TALYS, COH, EMPIRE, and ALICE. Reaction modeling at these energies is typically unsatisfactory due to few prior published data and many interacting physics models. Therefore, a detailed assessment of the talys code was performed with simultaneous parameter adjustments applied according to a standardized procedure. Particular attention was paid to the formulation of the two-component exciton model in the transition between the compound and preequilibrium regions, with a linked investigation of level density models for nuclei off of stability and their impact on modeling predictive power. This paper merges experimental work and evaluation techniques for high-energy charged-particle isotope production in an extension to an earlier study of this kind.

43 PARTICLE ACCELERATORS↗

SAPHIRE 8 Software Quality Assurance Plan

This Quality Assurance (QA) Plan documents the QA activities that will be managed by the INL related to JCN N6423. The NRC developed the SAPHIRE computer code for performing probabilistic risk assessments (PRAs) using a personal computer (PC) at the Idaho National Laboratory (INL) under Job Code Number (JCN) L1429. SAPHIRE started out as a feasibility study for a PRA code to be run on a desktop personal PC and evolved through several phases into a state-of-the-art PRA code. The developmental activity of SAPHIRE was the result of two concurrent important events: The tremendous expansion of PC software and hardware capability of the 90s and the onset of a risk-informed regulation era.

99 GENERAL AND MISCELLANEOUS↗

Use of simplified PSA studies in support of the ASTRID design process

In the framework of the French Act of 28 June 2006 about nuclear materials and waste management, a GEN IV and actinides incineration demonstration prototype is to be commissioned in the 2020 decade. In this objective a prototype called ASTRID (Advanced Sodium Technological Reactor for Industrial Demonstration) is proposed to demonstrate the progress made in SFR technology at an industrial scale by qualifying innovative options, some of which still remain open in the areas requiring improvements, especially safety and operability. More specifically, we aim for a level of safety that is at least equivalent to that of the EPR (third generation), with improvements made in SFR-specific fields. The integration of safety issues in the early phase of the design of ASTRID is necessarily expected. For this purpose, CEA and its partners AREVA and EDF have planned to perform a level-1 PSA to support and orientate the preliminary design of ASTRID reactor. This paper presents the PSA approach and current studies for the assessment of safety systems and the future work to be done for the 2012-2014 period. The preliminary preparation of PSA studies is presented: objectives and scope of the early design phase PSA, definition of core damage states, selection and grouping of initiating events, assessment of safety functions and related systems. Work under progress is also presented: modelling of event trees, construction of fault trees of safety systems, transient calculations of accident sequences with the CATHARE2 code and reliability data assessment. Main objectives of a level-1 PSA performed at conceptual design stage are an early assessment of the safety architecture of the reactor and findings about the most effective areas for improvement, but also the identification of dominant accident sequences and comparison with alternative designs. After the elaboration of a simplified level-1 PSA model for nominal state and main internal initiators, various design alternatives will be evaluated from the viewpoint of PSA in order to support the design choices of the ASTRID reactor. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Staged Z-Pinch Modeling with Hydra and Chicago Codes (CRADA Final Report)

This was a collaborative effort between Lawrence Livermore National Security, LLC (“Contractor”), as manager and operator of Lawrence Livermore National Laboratory (“LLNL”) and Magneto Inertial Fusion Technologies, Inc. ("MIFTI" or "Participant"), to develop staged Z-pinch (SZP) modeling with HYDRA and CHICAGO codes. The contractor performed numerical simulations of the SZP to reproduce and validate Participant’s MACH2 simulations. Contractor used the state-of-the-art, radiation-magneto-hydrodynamic code HYDRA, as well as the hybrid particle-in-cell code CHICAGO. This work helped assess the physical and numerical uncertainties associated with the simulations and the overall fusion scheme. HYDRA is a well-established and validated code. This work has helped to independently assess the SZP concept to give confidence to the Participant and to the broader fusion community.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Investigate Strategies to Increase Residential Energy Code Compliance Rates and Measure Results in North Carolina: Final Report

The proposed project implemented and tested methods to assess compliance with the energy code, developed educational programs and resources targeted at key compliance issues, conducted a statewide outreach and training campaign, taught building and inspection professionals about key issues of compliance with the energy code, and conducted a follow-up study to see how compliance rates changed.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Cluster Dynamics Modeling Needs for the Advanced Materials and Manufacturing Technologies Program

This milestone report aims to identify and assess the cluster dynamics (CD) modeling requirements within the Department of Energy's Office of Nuclear Energy (DOE-NE) Advanced Materials and Manufacturing Technologies (AMMT) program and to communicate these needs to the DOE-NE Nuclear Energy Advanced Modeling and Simulation (NEAMS) program. The goal is to ensure NEAMS is well-informed about the CD modeling requirements to support AMMT's mission of accelerating the development, qualification, demonstration, and deployment of advanced structural materials and manufacturing for nuclear energy applications. CD modeling is an essential tool for predicting the degradation of structural materials under irradiation, which is a key component of AMMT's accelerated qualification process. The AMMT program focuses on both additively manufactured and wrought structural alloys, such as laser powder-bed fusion 316H austenitic stainless steel, alloy 709, Haynes 244, and alloy 617. These materials require a generalized CD modeling framework to facilitate rapid model development and computational simulation. A flexible, generalized CD software, similar to the Multiphysics Object-Oriented Simulation Environment (MOOSE) finite element framework, would enable modeling of various cluster types, including defect clusters, defect-solute clusters, and multicomponent clusters, incorporating thermodynamics and kinetics parameters. Radiation effects, microstructural feature evolution, and multi-dimensional modeling are critical considerations for the CD model. The usability of the CD code should allow for easy modification and coupling with MOOSE-based simulations. Additionally, the software should adhere to Nuclear Quality Assurance-1 standards, include a testing suite for verification and validation, and be version-controlled within a national laboratory-managed Git repository. Benchmark problems are needed to assess code predictions and performance.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

RELAP5/MOD2 Overview and Developmental. Assessment Results from TMl-1 Plant Transient Analysis

RELAP5/MOD2 is a new version of the RELAP5 thermal-hydraulic computer code containing improved modeling features that provide a generic capability for pressurized water reactor transient simulation. The objective of this paper is to provide code users with an overview of the code and to report developmental assessment results obtained from a Three Mile Island Unit One plant transient analysis. The assessment shows that the injection of highly sub-cooled water into a high-pressure primary coolant system does not cause unphysical results or pose a problem for RELAP5/MOD2. (author)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Hydrogen Quantitative Risk Assessment

DOE has identified consistent safety, codes, and standards as a critical need for the deployment of hydrogen technologies, with key barriers related to the availability and implementation of technical information in the development of regulations, codes, and standards. Advances in codes and standards have been enabled by risk-informed approaches to create and implement revisions to codes, such as National Fire Protection Association (NFPA) 2, NFPA 55, and International Organization for Standardization (ISO) Technical Specification (TS)-19880-1. This project provides the technical basis for these revisions, enabling the assessment of the safety of hydrogen fuel cell systems and infrastructure using QRA and physics-based models of hydrogen behavior. The risk and behavior tools that are developed in this project are motivated by, shared directly with, and used by the committees revising relevant codes and standards, thus forming the scientific basis to ensure that code requirements are consistent, logical, and defensible.

08 HYDROGEN↗

MELCOR 1.8.5 modeling aspects of fission product release, transport and deposition an assessment with recommendations.

The Phebus and VERCORS data have played an important role in contemporary understanding and modeling of fission product release and transport from damaged light water reactor fuel. The data from these test programs have allowed improvement of MELCOR modeling of release and transport processes for both low enrichment uranium fuel as well as high burnup and mixed oxide (MOX) fuels. This paper discusses the synthesis of these findings in the MELCOR severe accident code. Based on recent assessments of MELCOR 1.8.5 fission product release modeling against the Phebus FPT-1 test and on observations from the ISP-46 exercise, modifications to the default MELCOR 1.8.5 release models are recommended. The assessments identified an alternative set of Booth diffusion parameters recommended by ORNL (ORNL-Booth), which produced significantly improved release predictions for cesium and other fission product groups. Some adjustments to the scaling factors in the ORNL-Booth model were made for selected fission product groups, including UO{sub 2}, Mo and Ru in order to obtain better comparisons with the FPT-1 data. The adjusted model, referred to as 'Modified ORNL-Booth,' was subsequently compared to original ORNL VI fission product release experiments and to more recently performed French VERCORS tests, and the comparisons was as favorable or better than the original CORSOR-M MELCOR default release model. These modified ORNL-Booth parameters, input to MELCOR 1.8.5 as 'sensitivity coefficients' (i.e. user input that over-rides the code defaults) are recommended for the interim period until improved release models can be implemented into MELCOR. For the case of ruthenium release in air-oxidizing conditions, some additional modifications to the Ru class vapor pressure are recommended based on estimates of the RuO{sub 2} vapor pressure over mildly hyperstoichiometric UO{sub 2}. The increased vapor pressure for this class significantly increases the net transport of Ru from the fuel to the gas stream. A formal model is needed. Deposition patterns in the Phebus FPT-1 circuit were also significantly improved by using the modified ORNL-Booth parameters, where retention of lower volatile Cs{sub 2}MoO{sub 4} is now predicted in the heated exit regions of the FPT-1 test, bringing down depositions in the FPT-1 steam generator tube to be in closer alignment with the experimental data. This improvement in 'RCS' deposition behavior preserves the overall correct release of cesium to the containment that was observed even with the default CORSOR-M model. Not correctly treated however is the release and transport of Ag to the FPT-1 containment. A model for Ag release from control rods is presently not available in MELCOR. Lack of this model is thought to be responsible for the underprediction by a factor of two of the total aerosol mass to the FPT-1 containment. It is suggested that this underprediction of airborne mass led to an underprediction of the aerosol agglomeration rate. Underprediction of the agglomeration rate leads to low predictions of the aerosol particle size in comparison to experimentally measured ones. Small particle size leads low predictions of the gravitational settling rate relative to the experimental data. This error, however, is a conservative one in that too-low settling rate would result in a larger source term to the environment. Implementation of an interim Ag release model is currently under study. In the course of this assessment, a review of MELCOR release models was performed and led to the identification of several areas for future improvements to MELCOR. These include upgrading the Booth release model to account for changes in local oxidizing/reducing conditions and including a fuel oxidation model to accommodate effects of fuel stoichiometry. Models such as implemented in the French ELSA code and described by Lewis are considered appropriate for MELCOR. A model for ruthenium release under air oxidizing conditions is also needed and should be included as part of a fuel oxidation model since fuel stoichiometry is a fundamental parameter in determining the vapor pressure of ruthenium oxides over the fuel. There is also a need to expand the MELCOR architecture for tracking fission product classes to allow for more speciation of fission products. An example is the formation of CsI and Cs{sub 2}MoO{sub 4} and potentially CsOH if all Mo is combined with Cs such that excess Cs exists in the fuel. Presently, MELCOR can track only one class combination (CsI) accurately, where excess Cs is assumed to be CsOH. Our recommended interim modifications map the CsOH (MELCOR Radionuclide Class 2) and Mo (Class 7) vapor pressure properties to Cs{sub 2}MoO{sub 4}, which approximates the desired formal class combination of Cs and Mo. Other extensions to handle properly iodine speciation from pool/gas chemistry are also needed.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Code Verification and Solution Verification framework in pin-resolved neutron transport code MPACT

Program verification in scientific computing encompasses the application of formal and mathematical techniques to a scientific computing code for its credibility, accuracy, and validity. Code Verification identifies bugs and performance issues in the software development stage. Solution Verification assesses the applicability of the code and the accuracy of the solution to problems of interest. Both activities utilize application cases and quantify the error against prescribed acceptance criteria. However, simply executing more application cases does not guarantee stronger or more comprehensive credibility. Here, we establish a verification framework that involves Code Verification and Solution Verification, both of which work together such that the overarching goal of “converge to the correct answer for the intended application” can be reasonably inferred. The application of such a verification framework is demonstrated using the pin-resolved neutron transport code MPACT, where standard unit tests and regression tests are covered, and where the Method of Exact Solutions and the Method of Manufactured Solutions are successfully used. Additionally, the applicability of Method of Manufactured Solutions is extended to the OECD/NEA C5G7 benchmark problems of practical material and geometric configurations. Solution Verification activities are demonstrated on a practical hierarchy of application models of increasing complexity ranging from 2D pin cell problems to 3D assembly problems. The convergence behavior and rate of convergence with respect to each individual variable are studied and provided. This framework can be adapted broadly to other fields involving scientific computing codes.

97 MATHEMATICS AND COMPUTING↗

Statistical uncertainty analysis applied to the DRAGONv4 code lattice calculations and based on JENDL-4 covariance data

In this paper, multi-group microscopic cross-section uncertainty is propagated through the DRAGON (Version 4) lattice code, in order to perform uncertainty analysis on k{infinity} and 2-group homogenized macroscopic cross-sections predictions. A statistical methodology is employed for such purposes, where cross-sections of certain isotopes of various elements belonging to the 172 groups DRAGLIB library format, are considered as normal random variables. This library is based on JENDL-4 data, because JENDL-4 contains the largest amount of isotopic covariance matrixes among the different major nuclear data libraries. The aim is to propagate multi-group nuclide uncertainty by running the DRAGONv4 code 500 times, and to assess the output uncertainty of a test case corresponding to a 17 x 17 PWR fuel assembly segment without poison. The chosen sampling strategy for the current study is Latin Hypercube Sampling (LHS). The quasi-random LHS allows a much better coverage of the input uncertainties than simple random sampling (SRS) because it densely stratifies across the range of each input probability distribution. Output uncertainty assessment is based on the tolerance limits concept, where the sample formed by the code calculations infers to cover 95% of the output population with at least a 95% of confidence. This analysis is the first attempt to propagate parameter uncertainties of modern multi-group libraries, which are used to feed advanced lattice codes that perform state of the art resonant self-shielding calculations such as DRAGONv4. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Impacts of Model Building Energy Codes

Pacific Northwest National Laboratory, funded by DOE, conducted an assessment of the prospective impacts of national model building energy codes from 2010 through 2040. A previous PNNL study evaluated the impact of the Building Energy Codes Program; this study looked more broadly at overall code impacts. This report describes the methodology used for the assessment and presents the impacts in terms of energy savings, consumer cost savings, and reduced CO 2 emissions at the state level and at aggregated levels.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Effects of grain size and porosity on cladding failure in high-burnup UO 2 : A sensitivity and uncertainty study

Isotopic taggants are being studied to aid in the provenance assessment of nuclear materials. However, these taggants must be selected such that they do not adversely affect fuel performance during normal operation or accident scenarios. Taggants are known to affect the fuel’s grain size and porosity. In the work described in this paper, the BISON fuel performance code was used to assess the potential effects of taggants (i.e., grain size and porosity) on fuel rod behavior and cladding failure during a high-burnup, large-break loss-of-coolant accident. Here, 281 individual fuel rods from the same reactor core were modeled for a sensitivity study, a parametric study, and uncertainty quantification. The cladding failure predictions often exhibited stochastic behavior. After additional study, it was found that the cladding failure model is highly sensitive to residual error inherent to numerical approximation solvers. Some strategies to mitigate this sensitivity are discussed. The study found no relationship between known taggant effects and cladding failure status. However, taggants were found to affect the time and location of failure in certain rods. In conclusion, future work to continue investigating and validating these findings is briefly discussed.

Doped UO 2↗