Search NASA⌕ Search

SEARCH · Search NASA

Results for “Verification and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Flow instabilities in helical-coil steam generators for small modular reactors: A review

Here, this study covers the research and discoveries in two-phase flow-boiling instabilities available in the literature—specifically for a helical-coil steam generator (HCSG), including experimental findings, theoretical research, computational models, and system code analyses—supporting research and development of representative small modular reactors (SMRs). Like other new and advanced reactor systems, water-cooled SMRs require experimental data from both integral and separate thermal-hydraulics test facilities for the verification and validation (V&V) of the computational models and computer codes in order to design and obtain regulatory approval. The complex dynamics of two-phase flow-boiling instabilities includes flow regimes physics phenomena, flow-channel geometries, heat-transfer behavior, and interactions among the solid–liquid-gas within the system boundary, all of which are pivotal for understanding the design and operational challenges of SMRs. This study focuses on identifying the relevant knowledge gaps on boiling instabilities—specifically for a HCSG—and provides insights about future research direction optimizing the transport of thermal energy, mass-flow rates, and boundary conditions that ensure the adequate heat-transfer performance, operational stability, and safety associated with SMR systems.

20 FOSSIL-FUELED POWER PLANTS↗

Numerical implementation of the MOOSE subchannel module (SCM) algorithm

The subchannel module of moose (SCM), previously referred to as Pronghorn-SC, is a subchannel code designed to resolve single-phase flow fields and calculate the relevant flow variables, in nuclear reactor fuel-pin assemblies. The assemblies it models are: water-cooled, with bare fuel-pins in a square ducted, quadrilateral lattice and liquid-metal/water-cooled, with bare/wire-wrapped fuel pins in a hexagonal ducted, triangular lattice. Previous publications have presented the development, validation and verification of SCM. This work presents an comparative overview of the different solvers implemented within SCM. This includes the solver algorithm description, and a performance comparison. The two test cases chosen to demonstrate the solver performance were taken from the PSBT enthalpy mixing benchmark and the ORNL-19 pin benchmark.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Quantitative Encapsulation and Homogeneity Assessment of Sol–Gel Based Nuclear Explosive Debris Simulants

Nuclear explosive debris simulants are an important material in training and validating aspects of post-detonation nuclear forensic processes. Realistic simulants should replicate several aspects of nuclear explosive debris such as the size, shape, color, density, and chemical and radiological properties. Silica particles produced via sol-gel synthesis have recently been found to successfully reproduce many of these parameters including the controllable incorporation of radionuclide content. However, to be useful as a benchmarking material for validation and verification of laboratory methodologies, radionuclide content from batch-to-batch must be reproducible. Here, in this work, we explore the variance in radionuclide distribution incorporated into sol-gel benchmarking materials with respect to sample subdivision. Results will help inform the sample sizes required to minimize variance between samples.

36 - MATERIALS SCIENCE↗

Systematic Benchmarking of Climate Models: Methodologies, Applications, and New Directions

As climate models become increasingly complex, there is a growing need to comprehensively and systematically assess model performance with respect to observations. Given the increasing number and diversity of climate model simulations in use, the community has moved beyond simple model intercomparison and toward developing methods capable of benchmarking a large number of simulations against a suite of climate metrics. Here, we present a detailed review of evaluation and benchmarking methods and approaches developed in the last decade, focusing primarily on scientific implications for Coupled Model Intercomparison Project (CMIP) simulations and CMIP6 results that contributed to the Intergovernmental Panel on Climate Change (IPCC) Sixth Assessment Report (AR6). Based on this review, we explain the resulting contemporary philosophy of model benchmarking, and provide clear distinctions and definitions of the terms model verification, process validation, evaluation, and benchmarking. While significant progress has been made in model development based on systematic evaluation and benchmarking efforts, some climate system biases still remain. The development of open‐source community software packages has played a fundamental role in identifying areas of significant model improvement and bias reduction. We review the key features of several software packages that have been commonly used over the past decade to evaluate and benchmark global and regional climate models. Additionally, we discuss best practices for the selection of evaluation and benchmarking metrics and for interpreting the obtained results, the importance of selecting suitable sources of reference data and accurate uncertainty quantification.

Environmental sciences↗

Posterior comparison of model dynamics in several hybrid turbulence model forms

Hybrid turbulence models that can accurately reproduce unsteady three-dimensional flow physics across the entire range of grid scales and turbulence dynamics from Reynolds-averaged Navier–Stokes (RANS), through large-eddy simulation (LES), down to direct numerical simulations (DNS) are of increasing interest to the turbulence modeling community. However, despite decades of research and development, the basic tasks of eliminating poor-performing hybrid RANS-LES models and accelerating adoption of superior models through well-designed validation and verification have yet to occur. As a step in this direction, in this work we evaluate thirteen different hybrid RANS-LES models via systematic grid refinement of decaying homogeneous isotropic turbulence. We further derive a novel mathematical framework for assessing the energy partitioning dynamics of each Hybrid RANS-LES model, wherein model-to-model variations in energy partitioning can be interpreted as different feedback mechanisms operating on a low-dimensional nonlinear dynamical system. We found that model forms similar to the flow simulation methodology—also often termed very-large eddy simulation—are dynamically inconsistent with DNS at all resolutions. Additionally, we found a strong dynamical similarity in the feedback mechanisms of all models related to detached eddy simulation and partially averaged Navier–Stokes that is inherent to their general model forms.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Numerical demonstration of Biermann-generated magnetic fields in a laser-driven cylindrical implosion platform

We present two-dimensional radiation-magnetohydrodynamics FLASH simulations studying Biermann battery generated magnetic fields in a convergent geometry based on modifying an existing laser direct drive cylindrical implosion platform at Los Alamos National Laboratory. During the laser driven implosion, instabilities can arise as the target converges, and in a plasma, such instabilities can generate magnetic fields via the Biermann battery. After significant redesign (lowering the inner foam fill density, deceasing the ablator mass, and modifying the laser pulse), we demonstrate that magnetic fields reach strengths of many hundred kilogauss and persist over a nanosecond time scale. Such results pave the way for an experimental campaign for further code verification and validation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Multimode turbulent flow measurements using magnetic resonance imaging- and laser-based techniques and computational fluid dynamics simulations

We studied the flow field characteristics of a turbulent flow over a regularized cube array with a perpendicular injection flow through the floor between the second and third cubical elements, representing the complex flow interactions of a 3D jet and the wake flows behind cubical obstacles. Four different experimental measurements were performed: two magnetic resonance imaging-based measurements for three-dimensional three-component velocity (MRV) and concentration (MRC) and two laser-based techniques, particle image velocimetry (PIV) and planar laser-induced fluorescence (PLIF), for two-dimensional two-component velocity and concentration measurement, respectively. The mainstream Reynolds number is Re = 15 000⁠, based on the primary inlet velocity U m and channel height D H ⁠, whereas the injector Reynolds number is Re j = 3400⁠, based on the injector velocity U j and the injector's exit width D j ⁠. Numerical simulations were performed for the studied flow configuration of turbulent flow over a regularized cube array using Reynolds-averaged Navier–Stokes (RANS) and large-eddy simulation (LES) approaches. Results obtained from experimental measurements—including MRV, MRC, PIV, and PLIF—as well as RANS and LES simulations are discussed and compared along several horizontal and vertical planes of the studied configuration. In addition, 3D turbulent flow structures, such as leading-edge vortex, horseshoe vortex, and jet shear-layer vortex, and the isosurfaces of scalar concentration successfully revealed by MRV and MRC techniques were found to be in very good agreement with those 3D features extracted from RANS and LES simulations. In conclusion, the high-resolution experimental and numerical database obtained from this study could be useful for validation and verification of numerical codes.

Computational fluid dynamics↗

SAM: A Modern System Code for Advanced Non-LWR Safety Analysis

The System Analysis Module (SAM), developed at Argonne National Laboratory and by collaborators at other organizations, is for advanced non–light water reactor safety analysis. SAM aims to provide fast-running, modest-fidelity, whole-plant transient analysis capabilities that are essential for fast-turnaround design scoping and engineering analyses of advanced reactor concepts. To facilitate code development, SAM utilizes the MOOSE object-oriented application framework, its underlying finite element library, and linear and nonlinear solvers to leverage modern advanced software environments and numerical methods. SAM aims to solve tightly coupled physical phenomena, including fission reaction, heat transfer, fluid dynamics, and thermal-mechanical responses in advanced reactor structures, systems, and components with high accuracy and efficiency. Finally, this paper gives an overview of the SAM code development, including goals and functional requirements, physical models, current capabilities, verification and validation, software quality assurance, and examples of simulations for advanced nuclear reactor applications.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

An Evaluation and Qualification of U.S.-Based Research Reactors for Irradiation Capabilities Supporting Advanced Nuclear Systems

Irradiation experiments are a prerequisite for evaluating nuclear reactor system designs, analyzing the performance of these systems, and obtaining licenses. Likewise, irradiation facilities are necessary for producing the radioisotopes used in industrial and medical applications. Recent developments in modeling and simulation capabilities and advancements in computational resources have further enabled the design of irradiation experiments for evaluating radiation-induced phenomena and determining nuclear fuel, material, and system design and safety criteria pertaining to both normal and accident scenarios. These computational tools and models require comprehensive experimental datasets acquired under prototypic radiation conditions—for exploring material and system performance under the uniquely harsh environments found in nuclear reactors—to enable verification and validation for qualification and licensing purposes. However, qualification of irradiation experimental facilities, primarily research and test reactors (RTRs), necessitates that their performance be evaluated based on the irradiation environment (e.g. flux, power, testing capabilities) using an appropriate scoring matrix. Although many university campus RTRs are available for research and development (R&D) activities and initiatives, this study focuses on evaluating and qualifying the irradiation facilities (mostly RTRs) within the United States that are suitable for advanced nuclear fuel, material, and system irradiation experiments aimed at establishing operational-performance limits and informing component and fuel designs so as to improve operational efficiencies and mitigate proliferation vulnerabilities, as well as for radioisotope production aimed at multipurpose applications. As a result, the findings of the present study support the acceleration of nuclear fuel and material qualifications, thus hastening new and advanced nuclear energy system demonstrations and radioisotope production efforts by using extended R&D.

irradiation experiment↗

Development of MOSCATO: A CFD-Level Electrochemistry and Corrosion Simulator for Molten Salt Systems

For both coolant and fueled variants of molten salt reactors (MSRs), the corrosion of structural materials is a significant challenge. The corrosion stems from chemical and electrochemical reactions initiated by fissile material, fission products, and impurities in the salt. Lower-fidelity models rely on empirical correlations for mass transfer, simplified lumped temperature profiles, and similar assumptions. They do not capture detailed spatial variations in complex geometries, creating the need for high-fidelity modeling to bridge this gap.As we approach the demonstration and possible deployment of MSRs in this decade, the development of a high-fidelity, high-performance simulator becomes imperative. To simulate the complex electrochemical environment and corrosion within molten salt systems, we have developed the Molten Salt Chemistry And TranspOrt (MOSCATO) code. This endeavor is comprised of three essential components. First, mass transfer equations are coupled with the Navier-Stokes equations in order to account for the transport of species in the salt. Second, the diffusion of alloy constituents, such as Cr, Fe, Ni, etc. is simulated within the structural metals. Third, the alloy and salt domains are coupled to account for the heterogeneous chemical and electrochemical reactions that occur at the salt-alloy interface.MOSCATO manages all three components within the framework of the highly scalable, open-source spectral element method computational fluid dynamics code Nek5000/NekRS. This integration enables MOSCATO to harness the immense computational power of modern high-performance computing resources, ensuring both high fidelity and computational speed.In addition to code development, we have initiated a comprehensive verification and validation campaign, utilizing data from diverse sources. First, MOSCATO's electrochemical solver was verified with reference numerical data. Then validation occurred against experiments: one of a thermal galvanic cell and the other for corrosion in flowing molten salt of FLiNaK (LiF-NaF-KF). This campaign verified and validated MOSCATO as a reliable tool for simulating electrochemical environments and corrosion in molten salt systems.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Practical Introduction to Benchmarking and Characterization of Quantum Computers

Rapid progress in quantum technology has transformed quantum computing and quantum information science from theoretical possibilities into tangible engineering challenges. Breakthroughs in quantum algorithms, quantum simulations, and quantum error correction are bringing useful quantum computation closer to fruition. These remarkable achievements have been facilitated by advances in quantum characterization, verification, and validation (QCVV). QCVV methods and protocols enable scientists and engineers to scrutinize, understand, and enhance the performance of quantum information-processing devices. In this tutorial, we review the fundamental principles underpinning QCVV, and introduce a diverse array of QCVV tools used by quantum researchers. We define and explain QCVV’s core models and concepts—quantum states, measurements, and processes—and illustrate how these building blocks are leveraged to examine a target system or operation. We survey and introduce protocols ranging from simple qubit characterization to advanced benchmarking methods. Along the way, we provide illustrated examples and detailed descriptions of the protocols, highlight the advantages and disadvantages of each, and discuss their potential scalability to future large-scale quantum computers. This tutorial serves as a guidebook for researchers unfamiliar with the benchmarking and characterization of quantum computers, and also as a detailed reference for experienced practitioners.

open quantum systems & decoherence↗

Use of Grid-Forming Medium-Voltage Power Electronics Hub in a Microgrid Setting

This paper presents the application of a new design of a multiport, modular, medium-voltage power electronics hub (M3PE-HUB) in a microgrid setting. The M3PE-HUB system was modeled in a digital real-time simulator (DRTS) and integrated into the Banshee microgrid test system. This paper presents the preliminary DRTS simulation-based results of the M3PE-HUB system connected in a test microgrid system. Verification and validation of the M3PE-HUB architecture and controls in the test microgrid setting are the primary contributions of this work. The results of the operation during the islanding and resynchronization process indicate the feasibility of the proposed architecture in a microgrid setting. This paper also presents results for a system reconfiguration use case where the M3PE-HUB was used to reconfigure the system under a fault condition.

grid forming↗

A Digital Twin Framework for Liquid-cooled Supercomputers as Demonstrated at Exascale

We present ExaDigiT, an open-source framework for developing comprehensive digital twins of liquid-cooled supercomputers. It integrates three main modules: (1) a resource allocator and power simulator, (2) a transient thermo-fluidic cooling model, and (3) an augmented reality model of the supercomputer and central energy plant. The framework enables the study of "what-if" scenarios, system optimizations, and virtual prototyping of future systems. Using Frontier as a case study, we demonstrate the framework's capabilities by replaying six months of system telemetry for systematic verification and validation. Such a comprehensive analysis of a liquid-cooled exascale supercomputer is the first of its kind. ExaDigiT elucidates complex transient cooling system dynamics, runs synthetic or real workloads, and predicts energy losses due to rectification and voltage conversion. Throughout our paper, we present lessons learned to benefit HPC practitioners developing similar digital twins. We envision the digital twin will be a key enabler for sustainable, energy-efficient supercomputing.

Brewer, Wes↗

PRAQTICE

PRAQTICE (Python Repository for Advanced QCVV Tutorials and Interesting Characterization Experiments) is a software package containing advanced demonstrations of the implementation of quantum characterization, verification and validation protocols.

Ostrove, Corey [Sandia National Lab. (SNL-NM), Alb↗

An open-access simulated earthquake ground-motion database for an M7 Hayward Fault earthquake in the San Francisco Bay Region

Comprehensive understanding of earthquake ground motions, particularly in the near-fault region of large-magnitude events, is limited by gaps in strong-motion data. This challenge is prominent in areas with high seismic hazard but infrequent large earthquakes where data is sparse and difficult to interpret. These data limitations lead to uncertainties in the development of site-specific ground motions, which are crucial for engineering risk assessments. To address these challenges, physics-based regional-scale ground-motion simulations have been developed. With the emergence of exaflop-scale computing ecosystems, it is now possible to simulate regional earthquake processes at unprecedented fidelity and generate the large number of fault rupture realizations necessary to characterize both intra- and inter-event ground-motion variability. This article introduces a new database of simulated earthquake ground motions, created for applications in earthquake engineering, earthquake planning, and emergency response. The inaugural version of the database features simulated ground motions for a magnitude 7 Hayward Fault earthquake in the San Francisco Bay Region (SFBR), using the EarthQuake SIMulation (EQSIM) simulation framework and the Graves–Pitarka kinematic rupture model. The aim is to provide high-fidelity, spatially dense, three-component motions generated on the Department of Energy’s (DOE) newest generation of graphics processing unit (GPU)-accelerated supercomputers. These motions are being made openly available to the engineering, scientific, and disaster planning communities. In addition, this work develops protocols for the efficient dissemination of these large data sets and emphasizes community engagement to build confidence in their application. This article discusses the methodology behind the data, underlying software verification and validation, scalable data management, and a user interface for data access. The goal is to facilitate widespread use and elicit expert feedback to maximize the utility and exploitation of simulated motions. While the initial focus is on the San Francisco Region, simulations for additional regions will be added as the DOE program progresses.

Simulated ground-motion database↗

High-Order Hybrid RANS-LES Study of NACA0012 Wing Sections

We develop hybrid RANS-LES strategies within Nek5000 for application to airfoil sections at small flight configurations. We present a validation and verification study of $k \space – \space \tau$ SST applied to a NACA 0012 wing section in a pure RANS and in a hybrid RANS-LES setup. The study shows good corroboration with existing experimental and numerical datasets. We also analyze some of the observed discrepancies with the experiments by evaluating the side wall “blocking” effect. We demonstrate that for the hybrid turbulence modeling approach a high-order spectral- element discretization converges faster (i.e., with less resolution) than a representative low-order finite-volume-based approach.

42 ENGINEERING↗

Capability Enhancements for System-level thermal Hydraulic Modeling of Lead Fast Reactors

This project has focused on the use, assessment, and development of the SAS4A/SASSYS-1 (SAS) safety analysis software. Although SAS was originally intended as a safety analysis tool for Liquid Metal cooled Fast Reactors (LMFRs), which includes both Sodium Fast Reactors (SFRs) and Lead Fast Reactors (LFRs), the vast majority of its recent development and customization has been tailored to SFRs. In general, enhancements that are made to the software for SFRs are applicable to LFRs, however, the fuel composition and corrosive nature of lead requires careful consideration when performing safety analysis of an LFR. In this project an emphasis was placed on closing gaps that are associated with modeling LFRs using SAS. The principal objective of the project was to enhance the ability of SAS as a licensing tool for LFRs. This objective was to be accomplished through three tasks: 1) Enhance the ability of SAS to couple with external software; 2) Improve the underlying physics models in SAS, with priority given to models that are highly relevant to LFRs; 3) Extend the Verification and Validation (V&V) basis of the software

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Digital Twin + AI: Control Room of the Future [Slides]

The control room functions as the central brain of the grid, essential for balancing supply and demand and ensuring moment-to-moment grid reliability. Like the human brain, which processes sensory data to make decisions, control room operators analyze operational data from power generation, transmission, and distribution to make informed decisions. Currently, decision-making primarily rests with operators due to hardware and software limitations. However, with technological advancements, Digital Twins and AI are becoming high interest points in the control room's decision-making pilot programs. NREL is developing a comprehensive decision-making platform that integrates Digital Twins, AI, and advanced visualization techniques. As this integration progresses, the role of Digital Twins will evolve from conducting automated simulations to serving as a Trustworthy AI enabler, offering verification and validation of AI-generated response for power systems or providing physics-aware synthetic data of AI pre-training.

24 POWER TRANSMISSION AND DISTRIBUTION↗