Search NASA⌕ Search

SEARCH · Search NASA

Results for “performance verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Verification of RESRAD-OFFSITE Code (V.4)

This report documents the verification of RESRAD-OFFSITE Version 4.0 and describes, where necessary, the verification of the following: • The data comprising the standard dose and risk coefficient libraries in the RESRAD database files Master_dcf_ICRP07.mdb and Master_dcf_2k.mdb. • The extraction and transfer of the data from the selected database file to the computational code by the RESRAD-OFFSITE 4.0 interface, ResOWin.exe. • The different processes that are modeled by the main computational code in RESRAD OFFSITE 4.0, ResOMain.exe. • The data displayed in the graphical and text reports. Many verifications were performed as part of the quality assurance quality control program associated with the development and release of RESRAD-OFFSITE 4.0, namely: • developer testing, • internal independent testing, and • release testing. Some were also performed in response to questions from users regarding the performance of the code. The main text of the report focuses on summarizing a subset of those tests, both independent and developer tests that verified the computations performed by the code. The verifications included in this report served as the basis for the development of the release tests of the computational executables and provided the quantitative results to be compared with the code output. The input and output interfaces and the data transfers between the various executables of the code were tested while performing the verification testing. They were tested intentionally during release testing. This report also provides some basic information to help in understanding the activities that were verified. The report: • outlines the components of RESRAD-OFFSITE 4.0 and the interconnections between these components, • outlines the processes modeled by the computational code, • provides summary figures and tables to offer confirmation of the verification of the computational components of the code, • reproduces the verifiers’ reports, if available, in individual appendices, • refers to the previous verification report (Yu et al. 2011) for more details about some of the verifications, and • reproduces the test cases and the testers’ reports from the release testing in individual appendices, when possible.

54 ENVIRONMENTAL SCIENCES↗

VALIDATION, VERIFICATION, AND CALIBRATION THROUGH A CAUSAL LENS

This paper presents an alternative method based on causal inference to perform validation, verification, and calibration of simulation models. While classical validation and verification approaches focus on the identification of the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on the identification of causal relationships between data elements. Statistical and machine learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between datasets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, then the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles it is known as a directed acyclic graph (DAG). A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and from experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts have a means to identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.

97 MATHEMATICS AND COMPUTING↗

Progress on Advancing the Robotic Air-slot Volumetric Inspection System (RAVIS) for Hanford Under-tank Inspection - 20519

The 27 in-service double-shell tank (DST) systems at Hanford provide interim storage for nearly 56 million gallons of nuclear and hazardous chemical legacy waste. The safe and reliable storage of the waste is critical to the site's extended cleanup mission. While in service, the leak integrity of the DSTs must be demonstrated to satisfy the Washington Administrative Code, inform decisions on tank management, and gauge fitness for continued service beyond originally intended design lives. The carbon steel plates and welds that comprise DST primary tank sidewalls and lower knuckles are routinely 'sampled' for volumetric non-destructive testing using ultrasonic inspection technology to determine whether corrosion pitting, cracking, or general corrosion are occurring that could compromise tank leak integrity. However, the carbon steel plates and welds that comprise the bottoms of primary tanks have not been thoroughly inspected since the DSTs were constructed (i.e., since 1968-1986) due to limited physical access to the exterior tank bottoms. The Robotic Air-slot Volumetric Inspection System, or 'RAVIS,' is being engineered to overcome the challenge of tank bottom in-service inspection. The system will be deployed under primary tanks within the small cooling channels/air-slots in the refractory pads upon which the tanks rest and will use ultrasonic guided wave inspection technology to volumetrically inspect physically inaccessible regions that make up ∼90% of a tank bottom, as well as regions that are physically accessible from the air-slots but comprise only ∼10% of a tank bottom. This paper describes the air-slot sensor and robotic deployment system and focuses on the testing approach and methods that are being applied to support (1) design feedback and performance acceptance (requirement verification) and (2) performance repeatability/reliability assessments (qualification) to ensure the RAVIS is prepared for successful inservice inspections of primary tank bottoms. Test progress made against the test plan, the results of 2019 testing, and the future outlook are included. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

An immersed interface method for microstructure-scale electrochemical battery models: numerical formulation and performance portable implementation

We present the numerical formulation, verification, and performance portable implementation of an immersed interface method for microstructure scale electrochemical modeling of batteries. The innovation in this approach is the resolution of chemical species and electrostatic potential discontinuities at active interfaces without the use of interface conforming unstructured grids. A unified formulation on Cartesian grids for all domains (electrodes and electrolyte) is used with interfacial flux conditions applied using volume fraction or “color” function gradients. We have developed one dimensional and two dimensional test cases with analytic solutions for electrochemical modeling using which we verified the consistency and accuracy of our scheme. Our solver is also validated against solutions from a macroscale model and an unstructured multi-subdomain solver for a full lithium ion cell. We then demonstrated the utility of our solver on an image-based complex battery electrode microstructure at high charging rate. Our technique also exhibits good scalability on distributed memory architectures using central processing units (CPU), with problem sizes up to 1.8 billion degrees of freedom and with 5400 ranks. Initial performance studies of our open-source performance portable solver showed about 70 times speed up using a graphics processing unit (GPU) compared to single compute core for a problem with 4 million cells.

25 ENERGY STORAGE↗

Performance Results on CPU/GPU Exascale Architectures for OMEGA: The Ocean Model for E3SM Global Applications

The US Department of Energy (DOE) conducts climate simulations on some of the world’s largest supercomputers. These exascale machines use heterogeneous architectures with both CPUs and GPUs, and scientific codes must adapt to make full use of this computing power. Los Alamos National Lab is developing Omega: The Ocean Model for E3SM Global Applications, which is specifically designed for modern exascale computers. It uses external libraries that have been optimized for a variety of architectures to run on different supercomputers. Omega is an unstructured-mesh ocean model based on TRiSK numerical methods. It will be the new ocean component of the DOE’s Energy Exascale Earth System Model (E3SM). The algorithms in Omega follow those of the current ocean component, MPAS-Ocean, but it will be written in C++ rather than Fortran to take advantage of the Kokkos performance portability library. Omega spatial operators are written as Kokkos kernels to run efficiently on both CPUs and GPUs. Work on Omega began in 2023 with a new C++ framework for unstructured mesh partitioning, halo exchanges, parallel IO, and Kokkos interfaces. The current version, Omega-0, is being developed to solve the shallow water equations and at present includes all of the tendency terms but not time stepping. Here we share the results of Omega-0 verification and performance testing. Verification includes unit tests implemented with CTest as well as convergence tests in Polaris, an in-house python package with a large suite of test problems. Performance tests compare simulations conducted on CPUs versus GPUs and across different architectures: tests are run on Frontier, which has AMD “Optimized 3rd Gen EPYC” CPUs and AMD MI250X GPUs, as well as Perlmutter, which is composed of AMD EPYC 7763 CPUs and NVIDIA A100 GPUs.

58 GEOSCIENCES↗

Verification and Validation of Performance with Dissemination of Best Practices in District Energy and CHP for Enhanced Resiliency, Energy Efficiency, and Cybersecurity

This report contains the results of the International District Energy Association’s work to analyze, validate, and verify performance data of existing district energy systems and identify industy best practices for the purpose of improving system reliability, resiliency, and efficiency, and to accellerate decarbonization. In addition to a technical evaluation of the surveyed systems and identification of a series of technical performance metrics, the report illustrates the accompanying operations and financial best practices employed by surveyed systems to fully serve their customer base. Additionally, the third chapter of the report describes the current landscape of cybersecurity threats and counteracting measures, and recommends a series of steps for effectively guarding highly networked district energy systems against cybersecurity attacks.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Identify and Assess Technical Challenges in Safeguards Measurements of Spent Advanced Reactor Fuels

Advanced reactor (AR) designs use various nuclear fuel types that can be significantly different than conventional light-water reactor (LWR) fuels, including differences in sizes, compositions, and chemical forms (e.g., oxide, carbide, metal). Nearly all the proposed AR fuels use high-assay low-enriched uranium (HALEU), which will have higher enrichments (5–20 wt% 235 U) than LWR fuels (currently limited to <5 wt% 235 U). In advance of the wide use of these new fuel types around the world, international safeguards organizations such as the International Atomic Energy Agency (IAEA]) are working with some of the AR vendors to formulate safeguards approaches for these AR fuel cycles. As part of the overall safeguards approach, it is important to identify the potential technical challenges in performing safeguards verification measurements of these AR fuels (both fresh and spent fuels) in advance of the widespread adoption of these new fuel types, because new safeguards technologies can take several years to develop, test, and approve for use. This report documents work performed in fiscal year 2024 based on modeling and simulation to assess the performance of the existing safeguards measurement technologies for irradiated or spent AR fuel elements or items. This work is a continuation of the work performed in fiscal year 2023 that focused on fresh AR fuels. Spent AR fuels have a distinct difference from their LWR counterparts: unlike the spent LWR fuels typically stored in a water-filled pool, some spent AR fuels—such as tristructural-isotropic (TRISO)-based fuels—will most likely be stored in air-filled hot cells. Because most safeguards measurements on spent fuel performed to date have been conducted under water, the air-filled hot cell environment could present unique challenges to safeguards measurements. Fork detector (FDET) and Cerenkov viewing device (CVD) systems have been the two primary instruments used by the IAEA for several decades to measure spent LWR fuel assemblies stored in pools for safeguards verification purposes. Because the lower refractive index of air causes Cerenkov light to be of lower intensity in air than in water, existing CVDs are likely unable to perform safeguards verification measurements for spent fuel stored in an air-filled hot cell, as is the case for the TRISO-based spent fuel elements (e.g., pebbles, graphite fuel blocks). Unlike FDET measurements, CVD measurements do not require fuel be moved, so they are a simpler and faster to take than FDET measurements. The inability to perform CVD measurements on the TRISO-based AR fuel types presents a major technical challenge in the effort to use existing technology to perform safeguards measurements on spent AR fuels. This study was mainly conducted through the modeling and simulation of an FDET or an FDET-like system on five spent AR fuel types, including one metallic fuel type and four TRISO-based fuel types in both pebble and graphite block forms in their respective storage configurations and environments. Because the various AR fuel types have significantly different dimensions, FDET systems must be adapted to accommodate them. Partial defect tests were also simulated in this study to assess the FDET’s ability to detect potential fuel diversions. The FDET measures the fuel’s total passive neutron and gamma emissions. The simulated FDET results from spent AR fuel items are compared against results from a typical spent pressurized water reactor (PWR) assembly. High-purity germanium (HPGe) gamma detector measurements were also simulated for the spent AR fuel types and the PWR assembly because the signature photopeaks have been used in LWR safeguards verifications, although HPGe is usually not used to detect diversions because of the fuel’s self-attenuation effects on those photopeaks. The results indicate that these detectors have significant challenges in performing safeguards measurements of the spent AR fuel items, including incompatibilities between AR fuel items and existing FDETs, lower neutron count rates, lower sensitivities to fuel diversions in certain AR fuel items, and significantly higher interference from a neighboring fuel item when the measurement is performed in air. These results suggest that an alternative technology or significant and timely technology development is needed to perform adequate safeguards measurements of some of these AR fuel items.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Development of a Performance Portable Non-Equilibrium Plasma Fluid Solver on Adaptive Grids

This presentation will describe the numerical techniques, programming paradigms, verification, and performance of a non-equilibrium plasma fluid solver that can effectively utilize current and upcoming central processing and graphics processing unit (CPU+GPU) architectures. Our plasma fluid model solves the conservation equations for self-consistent electrostatic Poisson, electron and heavy species transport, and electron temperature on adaptive Cartesian grids. Our solver is written using performance portable adaptive mesh management library, AMReX (Zhang et al., JOSS, 4 (37) 1370, 2019), and can be built and run on widely available vendor specific GPU architectures (NVIDIA/AMD/Intel). We utilize a non-subcycled second order semi-implicit time-stepping method where all adaptive mesh refinement (AMR) levels are advanced with the same time step. The composite multi-level multigrid solver from within AMReX is used for each of the governing equations that are cast into a Helmholtz equation form. We have also developed a python based chemical mechanism parser framework that uses a similar format as CANTERA (Goodwin et al., Zenodo, 2018) yaml files as input. Our custom parser reads the yaml file and provides C++ files with transport and production rate functions that can be executed on both host (CPU) and device (GPU). We present verification of our solver using method of manufactured solutions that indicate formal second order accuracy with central diffusion and fifth order weighted-essentially-non-oscillatory (WENO) advection scheme. We also verify our solver with published literature on low-pressure capacitive and high-pressure streamer discharges. Our initial performance studies indicate 10X speed-up using 20 NVIDIA GPUs versus 200 CPUs for an atmospheric streamer discharge problem solved on a 512 x 1024 x 512 grid.

graphics processing units↗

Code and Solution Verification Assessment of the CTF Thermal Hydraulic Subchannel Code

CTF is a thermal-hydraulics subchannel code jointly developed by Oak Ridge National Laboratory and North Carolina State University. Over the past seven years, the Consortium for Advanced Simulation of Light Water Reactors (CASL) has made a significant investment in developing CTF so it can be used to model light water reactors, including nominal operating conditions, departure from nucleate boiling analysis, and transients ranging from loss of flow to reactivity insertion accidents. In addition to implementing new modeling capabilities and developing the user input and output interface, extensive work has been performed to improve the code’s quality assurance program, resulting in a development process that conforms with NQA-1 requirements. The CASL program follows the Predictive Capability Maturity Model (PCMM) approach for assessing code quality, which emphasizes performing code verification(ensuring the code converges to the correct answer) and solution verification (ensuring the code converges for the intended application). Code and solution verification are used to identify uncertainty errors introduced by numerical approximations in the code and are important for demonstrating that the model is coded without error, which is an important aspect of the Best Estimate plus Uncertainty method. This paper presents a comprehensive overview of the code and solution verification testing that has been performed on CTF. A top-down approach is taken in which the intended CTF applications are presented, followed by the code features required for their modeling. These features are then linked to the applicable code and solution verification tests that demonstrate proper functioning. Past testing efforts are summarized, and new tests are added to help close gaps in the presented test matrix. Rather than performing “one-off” exercises, these tests are added to the automated CTF regression test suite to ensure continual code quality.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

An Experimental Investigation of Multilayer Flow in a Slide Die Coating Process

Roll-to-roll coating technology has been actively applied not only for conventional film production but also for emerging energy devices such as organic solar cells, organic light emitting diodes, batteries, smart windows, and fuel cells. The devices are multilayer structures requiring several coating and drying steps when implemented in a serial fashion, which increases capital costs and energy consumption. Simultaneous multilayer (ML) coating technologies present an opportunity for cost reductions and improved process efficiency by reducing equipment footprint and the number of process steps. In this talk, we experimentally investigate ML slide die coating flow for the manufacturing of fuel cell membrane electrode assemblies (MEAs). For ML slide coating, understanding fluid properties such as density, surface tension, and viscosity are necessary for stable flows and limiting intermixing of the miscible layers. Here, we utilize a design-of-experiment methodology - Box-Behnken design (BBD) - to correlate ink formulation parameters to fluid properties. Using the ink properties obtained from the BBD, we performed numerical flow simulations to obtain a proper process conditions to guide experimental coating trials. Finally, experimental verification is performed on a ML slide die and a degree of miscibility was observed for various ink formulation conditions.

28 EE - Advanced Manufacturing Office (EE-5A)↗

Vidyut3d: A Gpu Accelerated Fluid Solver for Non-Equilibrium Plasmas on Adaptive Grids

We present the numerical methods, programming methodology, verification, and performance assessment of a non-equilibrium plasma fluid solver that can effectively utilize current and upcoming central processing and graphics processing unit (CPU+GPU) architectures, in this work. Our plasma fluid model solves the coupled conservation equations for species transport, electrostatic Poisson and electron temperature on adaptive Cartesian grids. Our solver is written using performance portable adaptive-grid/particle management library, AMReX, and is portable over widely available vendor specific GPU architectures. We present verification of our solver using method of manufactured solutions that indicate formal second order accuracy with central diffusion and fifth-order weighted-essentially-non-oscillatory (WENO) advection scheme. We also verify our solver with published literature on capacitive discharges and atmospheric pressure streamer propagation. We demonstrate the use of our solver on two 3D simulation cases: an atmospheric streamer propagation in Ar-H2 mixtures and a low pressure twin electrode radio frequency reactor. Our performance studies on three different CPU+GPU architectures indicate approximately 150-400X speed-up using AMD and NVIDIA GPUs per time step compared to a single CPU core for a 4 million cell simulation with 15 species.

Sitaraman, Hariswaran↗

Vidyut3d: A GPU accelerated fluid solver for non-equilibrium plasmas on adaptive grids

We present the numerical methods, programming methodology, verification, and performance assessment of a non-equilibrium plasma fluid solver that can effectively utilize current and upcoming central processing and graphics processing unit (CPU+GPU) architectures, in this work. Our plasma fluid model solves the coupled conservation equations for species transport, electrostatic Poisson and electron temperature on adaptive Cartesian grids. Our solver is written using performance portable adaptive-grid/particle management library, AMReX, and is portable over widely available vendor specific GPU architectures. We present verification of our solver using method of manufactured solutions that indicate formal second order accuracy with central diffusion and fifth-order weighted-essentially-non-oscillatory (WENO) advection scheme. We also verify our solver with published literature on capacitive discharges and atmospheric pressure streamer propagation. We demonstrate the use of our solver on two 3D simulation cases: an atmospheric streamer propagation in Ar-H2 mixtures and a low pressure three-electrode radio frequency reactor. Our performance studies on three different CPU+GPU architectures indicate ~ 150-400X speed-up using AMD and NVIDIA GPUs per time step compared to a single CPU core for a 4 million cell simulation with 15 species.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Robust verification of stochastic simulation codes

We introduce a robust verification tool for computational codes, which we call Stochastic Robust Extrapolation based Error Quantification (StREEQ). Unlike the prevalent Grid Convergence Index (GCI) [1] method, our approach is suitable for both stochastic and deterministic computational codes and is generalizable to any number of discretization variables. Building on ideas introduced in the Robust Verification [2] approach, we estimate the converged solution and orders of convergence with uncertainty using multiple fits of a discretization error model. In contrast to Robust Verification, we perform these fits to many bootstrap samples yielding a larger set of predictions with smoother statistics. Here, bootstrap resampling is performed on the lack-of-fit errors for deterministic code responses, and directly on the noisy data set for stochastic responses. This approach lends a degree of robustness to the overall results, capable of yielding precise verification results for sufficiently resolved data sets, and appropriately expanding the uncertainty when the data set does not support a precise result. For stochastic responses, a credibility assessment is also performed to give the analyst an indication of the trustworthiness of the results. Furthermore, this approach is suitable for both code and solution verification, and is particularly useful for solution verification of high-consequence simulations..

97 MATHEMATICS AND COMPUTING↗

Optimized allocation method of the VSC-MTDC system for frequency regulation reserves considering the cost

In recent years, the interconnection of asynchronous power grids through the VSC-MTDC system has been proposed and extensively studied in light of the potential benefits of economical bulk power exchanges and frequency regulation reserves sharing. This paper proposed an optimized allocation method for sharing frequency regulation reserves among the interconnected power systems and the corresponding frequency regulation control of the VSC-MTDC system under emergency frequency deviation events. Firstly, the frequency regulation reserve classification is proposed. In the classification, the available frequency response capacity reserves of each interconnection are divided into commercial reserves and regular reserves. While the commercial reserves are procured through long-term contracts, the regular reserves are purchased based on market prices of frequency regulation services. Secondly, based on the proposed frequency regulation reserve classification, a novel frequency regulation control is then introduced for the VSC-MTDC system. This control method could minimize the costs of the disturbed power grid for the needed frequency response supports from the other power grids. Simulation verifications are performed on a modified IEEE 39 bus system and a highly reduced power system model representing the North American grids. The simulation verification indicates that the developed frequency regulation control significantly reduced ancillary service costs of the disturbed power grid.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Verification and Validation Activities for the Multi-Fidelity Toolkit

The Multi-Fidelity Toolkit (MFTK) is a simulation tool being developed at Sandia National Laboratories for aerodynamic predictions of compressible flows over a range of physics fidelities and computational speeds. These models include the Reynolds-Averaged-Navier-Stokes (RANS) equations, the Euler equations, and modified Newtonian aerodynamics (MNA) equations, and they can be invoked independently or coupled with hierarchical Kriging to interpolate between high-fidelity simulations using lower-fidelity data. However, as with any new simulation capability, verification and validation are necessary to gather credibility evidence. This work describes formal code- and solution-verification activities as well as model validation with uncertainty considerations. Code verification is performed on the MNA model by comparing with an analytical solution for flat-plate and inclined-plate geometries. Solution-verification activities include grid-refinement studies of HIFiRE-1 wind tunnel measurements, which are used for validation, for all model fidelities. A thorough treatment of the validation comparison with prediction error and validation uncertainty is also presented.

42 ENGINEERING↗

Assessment of the 3430 Building Filtered Exhaust Stack Sampling Probe Location: Stack Verification Following Fan and Air Blender Additions

The velocity uniformity and flow angle results from the 3430 stack verification tests, performed in April 2023, demonstrated that the CFD model results may be used to support the qualification of the stack sampling location. The measured velocity uniformity verification test result was 2.1 %COV. This value is well within the uniformity criterion, which is that the velocity uniformity be =20 %COV. Additionally, this value is well within the criterion that the actual stack measurement must be within 5% of the surrogate stack (i.e., CFD modeled stack); in this case the CFD modeled average result of 2.85 %COV for the nominal operating range of 22,800 cfm to 62,400 cfm. Additionally, the measured average flow angle at the 3430 stack monitor location was 5.6 degrees. The result is =20 degrees, so the criterion is met.

3430 Building↗