Search NASA⌕ Search

SEARCH · Search NASA

Results for “Verification and Validation methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Turbulence Modeling with Nek5000/RS, SOD2D and Alya

We present Validation and Verification (V & V) study of two high-order spectral element method (SEM) based Computational Fluid Dyanimcs (CFD) codes that we will utilize for work on turbulence modeling: Nek5000 and SOD2D. While the former solves the incompressible form of Navier-Stokes equation, the latter works with compressible set of equations and uses an entropy-viscosity formulation to account for the discontinuities for high Mach number flows. We demonstrate the accuracy of these codes for two benchmark sub-sonic turbulent flows: periodic channel and pipe flow, by carrying out first and second order statistical analysis, grid convergence and turbulent structure analysis using wall-resolved large eddy simulations (WRLES). Later, we report on the implementation and testing of various wall-modeling strategies for large eddy simulation of turbulent flows in Nek5000. These include both classical log-law based and decision-tree based machine-learning models. Accuracy of these closure strategies are analyzed and necessary future work is outlined.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Verification, Validation, and Uncertainty Quantification in Thermal Hydraulics, Freeman Scholar Lecture (2019)

Engineering problems are generally solved by analytical models or computer codes. These models, in addition to conservation equations, also include many empirical relationships and approximate numerical methods. Each of these components contributes to the uncertainty in the prediction. A systematic approach to judge the applicability of the code to the intended application is needed. It starts from verification of implementation of formulation in the code, identification of important phenomena, finding relevant tests with quantified uncertainty for these phenomena, and validation of the code by comparing predictions with the relevant test data. The relevant tests must address phenomena as expected in the intended application. In case of small size or limited condition tests, the scaling analyses are needed to assess the relevancy of the tests. Finally, a statement of uncertainty in the prediction is needed. Systematic approaches are described to aggregate uncertainties from different components of the code for intended application. Here, verification, validation, and uncertainty quantifications (VVUQs) are briefly described.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Involute Working Group – FSI Analysis of Fuel Plates Using Finite Volume and Finite Element Methods

The three involute plate research reactors RHF, HFIR, and FRM II have expressed an interest in using computational software to carry their steady-state safety analysis. Since these tools represent a significant departure from the methods used currently (one-dimensional), the acceptability of the new approach by regulators requires thorough verification and validation of these tools. Therefore, Argonne National Laboratory and the three involute-plate reactors formed an informal group called the Involute Working Group aiming at qualifying computational tools to perform steady-state safety analysis. The present report focuses on a comparison of finite volume and finite element methods to model solids in fluid-structure interaction problems with the goal to estimate the coolant flow-induced fuel plate deflections obtained with the two methods. The finite volume method will be obsoleted in STARCCM+ by the end of 2021, nevertheless, this evaluation is important because the method was used by ANL researchers to model the response of the fuel plates, despite its drawbacks, which are discussed in the report. It was essential to check how those estimates compare to the results obtained with the finite element method that is considered superior for structural analysis. Various geometries, i.e., flat, cylindrical and circle-involute fuel plates, as well as coolant flow speed, were considered. The comparison shows that, independently of the plate geometry, the finite volume method significantly underestimates the deflection as compared to finite element method for coarser meshes. When the discretization is developed as a result of a mesh sensitivity study using finite element method, the result obtained using finite volume method can be a few times smaller than the corresponding finite element method solution. A code-to-code comparison , between STAR-CCM+ and LS-DYNA was included in the analysis. Within the LS-DYNA models, two types of finite element formulations were used: solid and shell finite elements. Mesh sensitivity study showed that both approaches converge to a similar value that was obtained with STAR-CCM+ finite element solver. The evaluation of the computational solvers was extended by adding two benchmark cases from the STAR-CCM+ Verification Suite and presented in the Appendix A. The selected cases are: (1) bending of a cantilever beam under external load, and (2) cylindrical shell deformation analysis, known in the literature as ‘Scordelis-Lo roof’. The problems were solved with finite volume, and finite element methods, and the results confirmed the previously discussed findings. The analysis shows that the finite element solver is superior to the finite volume solver in terms of representation of model geometry and estimating the structural behavior of fuel plates. Depending on the ratio of the load to the flexibility of the plate, the finite volume solver can greatly under- or overestimate the structural response if a very carefully selected mesh is not used.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Assessment of Survey Results from Advanced Reactor Industry Domain Experts on Nonlinear Soil-Structure Interaction Analysis Software Verification and Validation

The seismic load case has a significant impact on the design and cost of nuclear power plants. Given the need to substantially reduce cost, advanced reactor designers are looking to leverage numerical tools that enable seismic analysis of an integrated vessel/support/structure/soil system. Modern nonlinear analysis tools provide a solution, capturing dynamic coupling between components (including soil-structure interaction (SSI)) concurrent with nonlinear behavior in one or more parts of the system. Although these methods have a rich history of technical development and implementation, software quality assurance (SQA) following nuclear industry standards remains a significant burden for those wishing to adopt such methods for advanced reactor design and licensing. To reduce the SQA burden, this project will develop the guidance for SQA verification and validation (V&V) of coupled nonlinear SSI analysis tools, to include a test matrix of software features and test problems to support commercial grade dedication (CGD). The guidance is intended to be technology-neutral: supporting designers of all advanced reactors. To maximize the value of the project to reactor designers, the project team performed focused surveys of and interviews with advanced reactor designers. Additionally, the project surveyed members of the broader industry involved in reactor design and licensing. The aggregated industry feedback consists of written survey responses, live polling responses, focused interviews, and informal feedback provided after outreach presentations, collectively referred to as “survey results”. Herein, the survey results are reported, reviewed, and assessed to inform follow-on project activities. The survey results confirmed the familiarity of the industry with the coupled nonlinear SSI analysis. They also affirm the project need based upon the expressed intent to (1) incorporate nonlinear features and (2) pursue the coupled nonlinear SSI analysis to reduce seismic demands and construction costs. All reactor designers indicated their intent to incorporate two or more nonlinear features, and all reactor designer respondents opined that the coupled nonlinear SSI analysis would allow for the optimization of the reactor design and construction. However, the programmatic challenges, whether real or perceived, present a significant barrier to reactor designers. The barrier most commonly identified by the reactor designer population was regulatory risk, with 70% citing this as a reason not to pursue the approach. The perceived regulatory risk identified by the reactor designers underscores the importance of regulator engagement and dialogue in this project. Additionally, half of the reactor designers identified cost and lack of guidance as a deterrent. The survey results also provide insights to tailor specific aspects of the guidance document and test matrix. The project plans to prepare both a formal referenceable guidance document and a collaborative, web-based test matrix and problem set. The project will focus on more complete test problem definitions for the prioritized nonlinear features over shallower problem descriptions for a larger set of features. The nonlinearities prioritized as high based upon survey feedback include fluid-structure interaction and seismic isolation and energy dissipation devices. The nonlinearities prioritized as intermediate include nonlinear geomaterials, nonlinear concrete, nonlinear steel, and interface/contact nonlinearity. Deep embedment and the associated nonlinear phenomena are assigned the lowest priority based upon survey feedback.

42 ENGINEERING↗
DOE OSTI2022

Verification of MCNP Critical Benchmark Model of U233-COMP-THERM-004

Los Alamos National Laboratory (LANL) has been working on creating a new centralized repository for MCNP models of critical benchmark experiments. The initial model of U233-COMP-THERM-004 was derived from the Whisper Suite provided with MCNP6.2, and was compared against the ICSBEP handbook chapter for the benchmark. Many notable errors were found in the initial model and were revised accordingly. Comparing the computational model of the old and new models confirmed that any Whisper results that relied upon the old model are still valid.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Heat Pipe Cooled Microreactors

Microreactor technologies are required to provide reliable carbon-free power generation in remote applications. The heat pipe cooled microreactor concept in particular offers notable advantages due to the passive operation of heat pipes enabling increased reliability and simplicity in a more compact form factor. There is a significant need for experimental work to aid and expedite the deployment of heat pipe microreactors due to their unique technological characteristics. Thus, there has been increased interest in heat pipe experiments by numerous institutions in order to support these efforts. The present work is a comprehensive review of heat pipe experiments, describing instrumentation, methods, phenomena of interest, and recent developments. In addition, legacy work on the operation of high-temperature heat pipes under irradiation is reviewed and discussed. Furthermore, the verification and validation efforts for the flagship heat pipe simulation code Sockeye are reviewed and requirements for future experiments are outlined. Lastly, future directions are proposed for heat pipe experimentation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Summary Report of the FY24 DOE Contributions to the GIF VHTR CMVB

The Generation-IV Forum (GIF) Very-High-Temperature Reactor-Computational Methods Validation and Benchmark (VHTR-CMVB) initiative, involving organizations from Korea Atomic Energy Research Institute (KAERI) (South Korea), Institute of Nuclear and New Energy Technology of Tsinghua University (INET) (China), U.S. Department of Energy (DOE) (U.S.), Joint Research Centre (JRC) (Europe), and Japan Atomic Energy Agency (JAEA) (Japan), is dedicated to the verification and validation of tools for High-Temperature Gas-Cooled Reactors (HTGRs) analysis, using data shared by Computational Methods Validation and Benchmark (CMVB) signatories. For FY24, the US DOE CMVB has committed to several critical activities. Under WP1, led by the US, the integration of the High Temperature Gas Cooled Reactor - Pebble-Bed Module (HTR-PM) Phenomena Identification and Ranking Table (PIRT) into the comparative PIRT is progressing, with a new draft of the comparison tables issued earlier this year and currently being utilized by INET for their contribution. Neutronic validation efforts under WP3 include the preparation of the burnup analysis benchmark, preliminary calculations, and the development of reference models and results. In WP2, a validation exercise for hot gas mixing in the lower plenum of HTR-PM is in progress, using experimental data from INET (China) to validate modeling approaches. A model of the experimental facility has been developed using StarCCM+, with initial calculations slated for presentation at the GIF CMVB meeting this fall. Another WP2 activity focuses on validating numerical models for air-cooled Reactor Cavity Cooling System (RCCS) with experimental data from the Wisconsin Madison RCCS facility. A high-fidelity model, developed using NEK-RS, is currently being validated with available data from a low power forced convection test. These efforts are aimed at enhancing and confirming the accuracy of HTGR analysis tools, ensuring their alignment with experimental data and regulatory requirements.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Fission Product Transport in TRISO Particles and Pebbles

This document demonstrates completion of the goals described in the technical narrative of the FOA project titled: ”Modeling and Simulation Development Pathways to Accelerating KP-FHR Licensing” regarding fission product transport in the Kairos-proposed fuel pebble by INL and Kairos Power. Showcased in this report are code developments and simulations in BISON that extend the state of the art in computation and understanding of fission product transport in a TRISO fuel particle and pebble. These enhancements lay the foundation for making predictions of fission product transport that can be used as input in the fuel licensing process. This was achieved by installing existing fuel material models originally used in PARFUME, developing a new failure probability method that is efficient and multi-dimensional, employing material homogenization, and expanding verification and validation simulations to demonstrate the efficacy of the work. All this work is leveraged to spotlight the main deliverable; a three-dimensional model and corresponding demonstration simulation of a pebble, which will serve as the starting point for models used to predict fission product release.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Fission Product Transport in TRISO Particles and Pebbles

This document demonstrates completion of the goals described in the technical narrative of the FOA project titled: ”Modeling and Simulation Development Pathways to Accelerating KP-FHR Licensing” regarding fission product transport in the Kairos-proposed fuel pebble by INL and Kairos Power. Showcased in this report are code developments and simulations in BISON that extend the state of the art in computation and understanding of fission product transport in a TRISO fuel particle and pebble. These enhancements lay the foundation for making predictions of fission product transport that can be used as input in the fuel licensing process. This was achieved by installing existing fuel material models originally used in PARFUME, developing a new failure probability method that is efficient and multi-dimensional, employing material homogenization, and expanding verification and validation simulations to demonstrate the efficacy of the work. All this work is leveraged to spotlight the main deliverable; a three-dimensional model and corresponding demonstration simulation of a pebble, which will serve as the starting point for models used to predict fission product release.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

MCNP ® Code V.6.3.0 Release Notes

The Monte Carlo N-Particle ® (MCNP ® ) code is a general-purpose, continuous-energy, generalized geometry, time-dependent, radiation transport code developed by the MCNP development team. The MCNP calculations provide predictive capabilities that can replace expensive or impossible-to perform experiments. Specific application problems include simulations of experimental diagnostics, intrinsic radiation, radiation detection and measurement, criticality safety, nuclear threat reduction and response, radiation health protection, nuclear weapons effects, and nuclear forensics. This MCNP code, version 6.3.0, follows the MCNP6.2.0 version. Since the release of MCNP6.2.0, many changes have been made to the MCNP code. These changes include new or improved features, a new build system, code enhancement and modernization, and bug fixes. The MCNP code, version 6.3.0, theory and user input information is documented in MCNP ® Code Version 6.3.0 Theory & User Manual, the build guidance for various platforms is documented in MCNP ® Code Version 6.3.0 Build Guide, and the verification and validation testing for various application benchmark test suites is documented in MCNP ® Code Version 6.3.0 Verification & Validation Testing.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Quantum-enhanced detection of viral cDNA via luminescence resonance energy transfer using upconversion and gold nanoparticles

Abstract The COVID-19 pandemic has profoundly impacted global economies and healthcare systems, revealing critical vulnerabilities in both. In response, our study introduces a sensitive and highly specific detection method for cDNA, leveraging Luminescence Resonance Energy Transfer (LRET) between upconversion nanoparticles (UCNPs) and gold nanoparticles (AuNPs), and achieves a detection limit of 242 fM for SARS-CoV-2 cDNA. This innovative sensing platform utilizes UCNPs conjugated with one primer and AuNPs with another, targeting the 5′ and 3′ ends of the SARS-CoV-2 cDNA, respectively, enabling precise differentiation of mismatched cDNA sequences and significantly improving detection specificity. Through rigorous experimental analysis, we established a quenching efficiency range from 10.4 % to 73.6 %, with an optimal midpoint of 42 %, thereby demonstrating the superior sensitivity of our method. Our work uses SARS-CoV-2 cDNA as a model system to demonstrate the potential of our LRET-based detection method. This proof-of-concept study highlights the adaptability of our platform for future diagnostic applications. Instrumental validation confirms the synthesis and formation of AuNPs, addressing the need for experimental verification of the preparation of nanomaterial. Our comparative analysis with existing SARS-CoV-2 detection methods revealed that our approach provides a low detection limit and high specificity for target cDNA sequences, underscoring its potential for targeted COVID-19 diagnostics. This study demonstrates the superior sensitivity and adaptability of using UCNPs and AuNPs for cDNA detection, offering significant advances in rapid, accessible diagnostic technologies. Our method, characterized by its low detection limit and high precision, represents a critical step forward in developing next-generation biosensors for managing current and future viral outbreaks. By adjusting primer sequences, this platform can be tailored to detect other pathogens, contributing to the enhancement of global healthcare responsiveness and infectious disease control.

Esmaeili, Shahriar [Institute for Quantum Science ↗
DOE OSTI2024

Verification and validation of detonation-shock-dynamics relations for explosives described by general equation of state and chemical reaction models

Detonation shock dynamics is a powerful method to model the behaviour of High Explosives (HE). However in order to use this method, the underlying relationship between the local radius of curvature and the detonation speed must be known. Previous work has developed methods to calculate this effect using simple, single-step Arrhenius and polytropic gas, models for the chemical reaction and the equation of state, respectively. In recent years, more complex models for both reaction rates and equations of state have been developed which show better agreement with experimental data than these simple models, especially when considering condensed phase explosives.. This work presents the governing equations for solving these problems in a way that is generalised to use arbitrary equations of state as well as reaction models which may have more than a single step and multiple product species. This implementation is verified against exact solutions, demonstrating that the equations were implemented properly. The verified algorithm is then validated against experimental data and high fidelity simulations, showing that it is able to make accurate predictions in a regime where the underlying assumptions of the governing equations are valid. Importantly, this approach has many applications: from creating equivalent detonation shock dynamics models for existing reactive burn calibrations for HE; to developing new functional forms and calibrations of reactive burn models for condensed phase high explosives.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Simulation Center for Runaway Electron Avoidance and Mitigation (SCREAM SciDAC) (Technical Final Report)

Runaway electrons can severely damage the plasma facing components on ITER during a major disruption and pose a major risk for tokamak fusion. It has been recognized that an adequate disruption mitigation system (DMS) is essential for the safe operation of ITER. The United States is responsible for the design and implementation of the disruption mitigation system on ITER, and in July 2016 the Simulation Center for Runaway Electron Avoidance and Mitigation (SCREAM) was launched by DOE, in a joint Fusion Energy Sciences (FES) and Advanced Scientific Computing Research (ASCR) collaboration. SCREAM was a comprehensive theory and simulation SciDAC center that provided physics guidance in the avoidance and mitigation of runaway electrons, and in tandem with domestic and international experiments, helped establish the qualitative and quantitative bases for safe operational scenarios and viable mitigation techniques. The SCREAM center assembled a national team of experts in runaway electron physics, tokamak disruptions, magnetohydrodynamic (MHD) simulation, and advanced algorithms and computing. The team combined advanced simulation and analysis capability facilitated by direct participation of ASCR SciDAC institutes with theoretical models and code development by FES scientists to focus on the runaway risk for ITER and tokamaks in general. The research scope was focussed on integrated simulations of kinetic runaway electrons, including MHD and fluid models of impurity transport, within a research plan guided by theory. The specific research tasks were (1) establish the fundamental physics of runaway generation, saturation, and dynamical evolution in a tokamak; (2) examine the critical path toward runaway avoidance; and (3) investigate the viability and effectiveness of the leading candidate schemes for runaway mitigation. In all three areas, members of the team carried out scoping studies that established the readiness for rapid and critical advances, especially in the deployment and further development of large-to extreme-scale simulation tools. Our multi-pronged computational approach included (1) relativistic Fokker-Planck solvers with discretization in phase space, (2) self-consistent particle-in-cell techniques, (3) particle-based Monte-Carlo, and (4) MHD-particle hybrid simulations. Cross-check between these different methods provided an additional means for verification and further bolstered the fidelity of our physics prediction. Validation against experimental results brings confidence to the predictive capability for ITER and frequently leads to new ideas for understanding and mitigating the thermal quench driven runaway electron phenomenon.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Vexcel Imaging's Suitability for Automatic Verification

Accurate, independently verified geospatial data is essential for automated calibration, validation, and operational decision-making. This study evaluated the positional accuracy of Vexcel Imaging™’s UltraCam® Osprey imagery (7.5 cm GSD) using globally distributed Continuously Operating Reference Stations (CORS) as independent control. Despite manufacturer claims of 15 cm horizontal accuracy, residual errors were consistently one to two orders of magnitude larger, with no subset of imagery meeting precision thresholds. These discrepancies cannot be explained by normal photogrammetric or environmental factors and raise concerns about the reliability of the imagery for high-precision tasks. The results demonstrate that Vexcel imagery, in its current form, is unsuitable for workflows requiring rigorous spatial accuracy or automated verification. At the same time, the reproducible validation framework developed in this study establishes a scalable method for assessing commercial imagery, ensuring that future products can be independently and objectively verified before operational adoption.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Safe Physics-Informed Machine Learning for Dynamics and Control

This tutorial paper focuses on safe physics-informed machine learning in the context of dynamics and control, providing a comprehensive overview of how to integrate physical models and safety guarantees. As machine learning techniques enhance the modeling and control of complex dynamical systems, ensuring safety and stability remains a critical challenge, especially in safety-critical applications like autonomous vehicles, robotics, medical decision-making, and energy systems. We explore various approaches for embedding and ensuring safety constraints, including structural priors, Lyapunov and Control Barrier Functions, predictive control, projections, and robust optimization techniques. Additionally, we delve into methods for uncertainty quantification and safety verification, including reachability analysis and neural network verification tools, which help validate that control policies remain within safe operating bounds even in uncertain environments. The paper includes illustrative examples demonstrating the implementation aspects of safe learning frameworks that combine the strengths of data-driven approaches with the rigor of physical principles, offering a path toward the safe control of complex dynamical systems.

Drgona, Jan↗
DOE OSTI2023

Model-Free Approach for Profiling of Polydisperse Soft Matter Using Small Angle Scattering

A strategy for determining the size polydispersity of systems from their small angle coherent scattering is outlined. Here, using the method of moment expansion, we show that the various central moments representing the average particle size, variance of particle size, and skewness of size distribution function (SDF) for polydisperse systems can be extracted from spectral analysis without bias. When the degree of polydispersity is moderate, SDF can be further reconstructed based on the maximum entropy principle. Numerical benchmarking of a model study over a wide range of size nonuniformity demonstrates the validity of this analytical approach for quantifying the size distribution of general soft matter systems in a model-free manner. Furthermore, the efficacy of this method was validated by successfully applying it to the fitting of small-angle neutron scattering data obtained from L64 Pluronic micelles using various form factor models. The numerical and experimental verification underscores the reliability and versatility of this method in accurately characterizing the size distribution of complex soft matter systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

AMR-Wind: A Performance-Portable, High-Fidelity Flow Solver for Wind Farm Simulations

We present AMR-Wind, a verified and validated high-fidelity computational-fluid-dynamics code for wind farm flows. AMR-Wind is a block-structured, adaptive-mesh, incompressible-flow solver that enables predictive simulations of the atmospheric boundary layer and wind plants. It is a highly scalable code designed for parallel high-performance computing with a specific focus on performance portability for current and future computing architectures, including graphical processing units (GPUs). In this paper, we detail the governing equations, the numerical methods, and the turbine models. Establishing a foundation for the correctness of the code, we present the results of formal verification and validation. The verification studies, which include a novel actuator line test case, indicate that AMR-Wind is spatially and temporally second-order accurate. The validation studies demonstrate that the key physics capabilities implemented in the code, including actuator disk models, actuator line models, turbulence models, and large eddy simulation (LES) models for atmospheric boundary layers, perform well in comparison to reference data from established computational tools and theory. We conclude with a demonstration simulation of a 12-turbine wind farm operating in a turbulent atmospheric boundary layer, detailing computational performance and realistic wake interactions.

17 WIND ENERGY↗