Search NASA⌕ Search

SEARCH · Search NASA

Results for “Code Validation Plan”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Development of risk mitigation guidance for sensor placement inside mechanically ventilated enclosures – Phase 1

Guidance on Sensor Placement was identified as the top research priority for hydrogen sensors at the 2018 HySafe Research Priority Workshop on hydrogen safety in the category Mitigation, Sensors, Hazard Prevention, and Risk Reduction. This paper discusses the initial steps (Phase 1) to develop such guidance for mechanically ventilated enclosures. This work was initiated as an international collaborative effort to respond to emerging market needs related to the design and deployment equipment for hydrogen infrastructure that is often installed in individual equipment cabinets or ventilated enclosures. The ultimate objective of this effort is to develop guidance for an optimal sensor placement such that, when integrated into a facility design and operation, will allow earlier detection at lower levels of incipient leaks, leading to significant hazard reduction. Reliable and consistent early warning of hydrogen leaks will allow for the risk mitigation by reducing or even eliminating the probability of escalation of small leaks into large and uncontrolled events. To address this issue, a study of a real-world mechanically ventilated enclosure containing GH2 equipment was conducted, where CFD modeling of the hydrogen dispersion (performed by AVT and UQTR, and independently by the JRC) was validated by the NREL Sensor laboratory using a Hydrogen Wide Area Monitor (HyWAM) consisting of a 10-point gas and temperature measurement analyzer. In the release test, helium was used as a hydrogen surrogate. Expansion of indoor releases to other larger facilities (including parking structures, vehicle maintenance facilities and potentially tunnels) and incorporation into QRA tools, such as HyRAM is planned for Phase 2. It is anticipated that results of this work will be used to inform national and international standards such as NFPA 2 Hydrogen Technologies Code, Canadian Hydrogen Installation Code (CHIC) and relevant ISO/TC 197 and CEN documents.

08 HYDROGEN↗
DOE OSTI2017

Gas Gun Model and Comparison to Experimental Performance of Pipe Guns Operating with Light Propellant Gases and Large Cryogenic Pellets

Injection of multiple large (~10 to 30 mm diameter) shattered pellets into ITER plasmas is presently part of the scheme planned to mitigate the deleterious effects of disruptions on the vessel components. To help in the design and optimize performance of the pellet injectors for this application, a model referred to as “the gas gun simulator” has been developed and benchmarked against experimental data. The computer code simulator is a Java program that models the gas-dynamics characteristics of a single-stage gas gun. Following a stepwise approach, the code utilizes a variety of input parameters to incrementally simulate and analyze the dynamics of the gun as the projectile is launched down the barrel. Using input data, the model can calculate gun performance based on physical characteristics, such as propellant-gas and fast-valve properties, barrel geometry, and pellet mass. Although the model is fundamentally generic, the present version is configured to accommodate cryogenic pellets composed of H2, D2, Ne, Ar, and mixtures of them and light propellant gases (H2, D2, and He). The pellets are solidified in situ in pipe guns that consist of stainless steel tubes and fast-acting valves that provide the propellant gas for pellet acceleration (to speeds ~200 to 700 m/s). The pellet speed is the key parameter in determining the response time of a shattered pellet system to a plasma disruption event. The calculated speeds from the code simulations of experiments were typically in excellent agreement with the measured values. With the gas gun simulator validated for many test shots and over a wide range of physical and operating parameters, it is a valuable tool for optimization of the injector design, including the fast valve design (orifice size and volume) for any operating pressure (~40 bar expected for the ITER application) and barrel length for any pellet size (mass, diameter, and length). Key design parameters and proposed values for the pellet injectors for the ITER disruption mitigation systems are discussed.

Combs, Stephen Kirk↗
DOE OSTI2021

Development of phenomena identification and ranking table for Westinghouse lead fast reactor’s safety

The Westinghouse Lead-cooled Fast Reactor (LFR) is a medium-size, passively safe, economic, Gen-IV nuclear reactor. An important effort within the Westinghouse LFR program is the development of the safety analysis methodology, which comprises computer code development, model development, and experimental testing. A key initial task associated with the development of the safety analysis methodology is the identification of processes and phenomena that affect the plant's capability to meet selected safety performance indicators. This is accomplished through the development of a Phenomena Identification and Ranking Table (PIRT) for selected accident scenarios which, for this specific PIRT effort, included selected postulated design basis accidents and hypothetical beyond design basis accidents in LFRs. This paper describes the role of PIRT in the development of the Westinghouse LFR safety analysis methodology and the process used in the PIRT development. Specifically, the Westinghouse LFR PIRT assessed importance of pertinent phenomena and identified gaps in their knowledge-base by evaluating current modeling capabilities and data available for validation. The ultimate goal was to provide guidance on computer code development and validation efforts and to prioritize testing to support LFR design and licensing. The key phenomena and processes that are deemed highly important for the safety performance indicators, but for which the state of knowledge is low, are presented. The testing program and analyses development are planned to address significant phenomena in the PIRT.

Lead fast reactor↗
DOE OSTI2017

Review of Transient Testing of Fast Reactor Fuels in the Transient REActor Test Facility (TREAT)

The restart of the Transient REActor Test (TREAT) facility provides a unique opportunity to engage the fast reactor fuels community to reinitiate in-pile experimental safety studies. Historically, the TREAT facility played a critical role in characterizing the behavior of both metal and oxide fast reactor fuels under off-normal conditions, irradiating hundreds of fuel pins to support fast reactor fuel development programs. The resulting test data has provided validation for a multitude of fuel performance and severe accident analysis computer codes. This paper will provide a review of the historical database of TREAT experiments including experiment design, instrumentation, test objectives, and salient findings. Additionally, the paper will provide an introduction to the current and future experiment plans of the U.S. transient testing program at TREAT.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2017

Volume of Lytic Vertebral Body Metastatic Disease Quantified Using Computed Tomography–Based Image Segmentation Predicts Fracture Risk After Spine Stereotactic Body Radiation Therapy

Purpose: To determine a threshold of vertebral body (VB) osteolytic or osteoblastic tumor involvement that would predict vertebral compression fracture (VCF) risk after stereotactic body radiation therapy (SBRT), using volumetric image-segmentation software. Methods and Materials: A computational semiautomated skeletal metastasis segmentation process refined in our laboratory was applied to the pretreatment planning CT scan of 100 vertebral segments in 55 patients treated with spine SBRT. Each VB was segmented and the percentage of lytic and/or blastic disease by volume determined. Results: The cumulative incidence of VCF at 3 and 12 months was 14.1% and 17.3%, respectively. The median follow-up was 7.3 months (range, 0.6-67.6 months). In all, 56% of segments were determined lytic, 23% blastic, and 21% mixed, according to clinical radiologic determination. Within these 3 clinical cohorts, the segmentation-determined mean percentages of lytic and blastic tumor were 8.9% and 6.0%, 0.2% and 26.9%, and 3.4% and 15.8% by volume, respectively. On the basis of the entire cohort (n=100), a significant association was observed for the osteolytic percentage measures and the occurrence of VCF (P<.001) but not for the osteoblastic measures. The most significant lytic disease threshold was observed at ≥11.6% (odds ratio 37.4, 95% confidence interval 9.4-148.9). On multivariable analysis, ≥11.6% lytic disease (P<.001), baseline VCF (P<.001), and SBRT with ≥20 Gy per fraction (P=.014) were predictive. Conclusions: Pretreatment lytic VB disease volumetric measures, independent of the blastic component, predict for SBRT-induced VCF. Larger-scale trials evaluating our software are planned to validate the results.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2022

Design and execution of a verification, validation, and uncertainty quantification plan for a numerical model of left ventricular flow after LVAD implantation

Left ventricular assist devices (LVADs) are implantable pumps that act as a life support therapy for patients with severe heart failure. Despite improving the survival rate, LVAD therapy can carry major complications. Particularly, the flow distortion introduced by the LVAD in the left ventricle (LV) may induce thrombus formation. While previous works have used numerical models to study the impact of multiple variables in the intra-LV stagnation regions, a comprehensive validation analysis has never been executed. The main goal of this work is to present a model of the LV-LVAD system and to design and follow a verification, validation and uncertainty quantification (VVUQ) plan based on the ASME V&V40 and V&V20 standards to ensure credible predictions. The experiment used to validate the simulation is the SDSU cardiac simulator, a bench mock-up of the cardiovascular system that allows mimicking multiple operation conditions for the heart-LVAD system. The numerical model is based on Alya, the BSC’s in-house platform for numerical modelling. Alya solves the Navier-Stokes equation with an Arbitrary Lagrangian-Eulerian (ALE) formulation in a deformable ventricle and includes pressure-driven valves, a 0D Windkessel model for the arterial output and a LVAD boundary condition modeled through a dynamic pressure-flow performance curve. The designed VVUQ plan involves: (a) a risk analysis and the associated credibility goals; (b) a verification stage to ensure correctness in the numerical solution procedure; (c) a sensitivity analysis to quantify the impact of the inputs on the four quantities of interest (QoIs) (average aortic root flow $Q^{avg}_{Ao}$, maximum aortic root flow $Q^{max}_{Ao}$, average LVAD flow $Q^{avg}_{VAD}$, and maximum LVAD flow $Q^{max}_{VAD}$; (d) an uncertainty quantification using six validation experiments that include extreme operating conditions. Numerical code verification tests ensured correctness of the solution procedure and numerical calculation verification showed a grid convergence index (GCI)95% <3.3%. The total Sobol indices obtained during the sensitivity analysis demonstrated that the ejection fraction, the heart rate, and the pump performance curve coefficients are the most impactful inputs for the analysed QoIs. The Minkowski norm is used as validation metric for the uncertainty quantification. It shows that the midpoint cases have more accurate results when compared to the extreme cases. The total computational cost of the simulations was above 100 [core-years] executed in around three weeks time span in Marenostrum IV supercomputer. This work details a novel numerical model for the LV-LVAD system, that is supported by the design and execution of a VVUQ plan created following recognised international standards. We present a methodology demonstrating that stringent VVUQ according to ASME standards is feasible but computationally expensive.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Development of Transmission Measurements Capability at VISION Spectrometer [Slides]

This presentation covers the development of transmission measurements capability at VISION Spectrometer. Main takeaways include that INS and transmission measurements are and should be the most significant part of TSL validation, as they are the fundamental quantities used by Monte Carlo neutronics codes. Additionally, the development of transmission capability at VISION instrument has commenced. Promising first results have been obtained with a big impact by the use of the collimators. Finally, Areas of improvement have been identified and new measurements are planned for June.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

MPACT Verification and Validation Manual (V.4.3)

As the VERA SQA plan requires, it is the responsibility of the University of Michigan (UM) and Oak Ridge National Laboratory (ORNL), as co-owners of MPACT, to ensure that verification and validation activities are performed and documented in a V&V manual with supporting publications and CASL technical reports which can be provided for reference and distribution within VERA. This document provides the current revision of the MPACT verification and validation (V&V) manual and describes the current state of MPACT V&V and updates the plans for future MPACT V&V activities. The following sections provide an overview of the V&V process used in MPACT, as well as a summary of the status of each component of V&V in the code.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

MPACT Verification and Validation Manual Version 4.4

As the VERA SQA plan requires, it is the responsibility of the University of Michigan (UM) and Oak Ridge National Laboratory (ORNL), as co-owners of MPACT, to ensure that verification and validation activities are performed and documented in a V&V manual with supporting publications and CASL technical reports which can be provided for reference and distribution within VERA. This document provides the current revision of the MPACT verification and validation (V&V) manual and describes the current state of MPACT V&V and updates the plans for future MPACT V&V activities. The following sections provide an overview of the V&V process used in MPACT, as well as a summary of the status of each component of V&V in the code.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

End-to-end differentiable digital twin for the IOTA/FAST facility

As the design complexity of modern accelerators grows, there is more interest in using controllable-fidelity simulations that have fast execution time or can yield additional insights about accelerator state. One notable example of additional information are gradients of physical observables with respect to design parameters produced by differentiable simulations. The IOTA/FAST facility has recently begun a program to implement and experimentally validate an end-to-end digital twin to serve as a virtual accelerator test stand, allowing for rapid prototyping of new software and experiments with minimal beam time costs. In this contribution we will discuss our plans and progress. Specifically, we will cover the selection and benchmarking of both physics and ML codes for linac and ring simulation, the development of generic interfaces between surrogate and physics-based sections, and presenting the control interface as either a deterministic event loop or a fully asynchronous EPICS soft input/output controller. We will also discuss challenges in model calibration and uncertainty quantification, as well as future plans to implement larger proton accelerators like PIPII and Booster.

Kuklev, N. [Fermilab]↗
DOE OSTI2017

Water NSTF Design, Instrumentation, and Test Planning

The following report serves as a formal introduction to the water-based Natural convection Shutdown heat removal Test Facility (NSTF) program at Argonne. Since 2005, this US Department of Energy (DOE) sponsored program has conducted large scale experimental testing to generate high-quality and traceable validation data for guiding design decisions of the Reactor Cavity Cooling System (RCCS) concept for advanced reactor designs. The most recent facility iteration, and focus of this report, is the operation of a 1/2 scale model of a water-RCCS concept. Several features of the NSTF prototype align with the conceptual design that has been publicly released for the AREVA 625 MWt SC-HTGR. The design of the NSTF also retains all aspects common to a fundamental boiling water thermosiphon, and thus is well poised to provide necessary experimental data to advance basic understanding of natural circulation phenomena and contribute to computer code validation. Overall, the NSTF program operates to support the DOE vision of aiding US vendors in design choices of future reactor concepts, advancing the maturity of codes for licensing, and ultimately developing safe and reliable reactor technologies. In this report, the top-level program objectives, testing requirements, and unique considerations for the water cooled test assembly are discussed, and presented in sufficient depth to support defining the program’s overall scope and purpose. A discussion of the proposed 6-year testing program is then introduced, which outlines the specific strategy and testing plan for facility operations. The proposed testing plan has been developed to meet the toplevel objective of conducting high-quality test operations that span across a broad range of single- and two-phase operating conditions. Details of characterization, baseline test cases, accident scenario, and parametric variations are provided, including discussions of later-stage test cases that examine the influence of geometric variations and off-normal configurations. The facility design follows, including as-built dimensions and specifications of the various mechanical and liquid systems, design choices for the test section, water storage tank, and network piping. Specifications of the instrumentation suite are then presented, along with specific information on performance windows, measurement uncertainties, and installation locations. Finally, descriptions of the control systems and heat removal networks are provided, which have been engineered to support precise quantification of energy balances and facilitate well-controlled test operations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Unified differentiable digital twin for the IOTA/FAST facility

As the design complexity of modern accelerators grows, there is more interest in using advanced simulations that have fast execution time or produce insights about accelerator state. One notable example of additional information are gradients of physical observables with respect to design parameters produced by differentiable simulations. The IOTA/FAST facility has recently begun a program to implement and experimentally validate a unified start-to-end differentiable digital twin to serve as a virtual accelerator test stand, allowing for rapid prototyping of new software and experiments with minimal beam time costs. In this contribution we will discuss our plans and progress. Specifically, we will cover the selection and benchmarking of both physics and ML codes, the development of generic interfaces between device models and surrogate or physics-based sections, and the export of the parameters through either a deterministic event loop or a fully asynchronous EPICS soft input/output controller. We will also discuss challenges in model calibration and uncertainty quantification, as well as future plans to support larger proton accelerators like PIPII and Booster.

Kuklev, Nikita [Fermilab]↗
DOE OSTI2026

Agentic Diagrammatica: Towards Autonomous Symbolic Computation in High Energy Physics

We present Diagrammatica, a symbolic computation extension to the HEPTAPOD agentic framework, which enables LLM agents to plan and execute multi-step theoretical calculations. Symbolic computation poses a distinctive reliability challenge for LLM agents, as correctness is governed by implicit mathematical conventions that are not encoded in a form that can be easily checked in the computational backend. We identify two complementary remedies, tool-constrained computation and targeted knowledge grounding, and pursue the first as the primary architecture. Concretely, we concentrate the agent's action distribution onto tool calls with convention-fixing semantics, in which the agent specifies a compact, human-auditable diagram specification and a trusted backend performs the symbolic or numerical manipulations exactly. The toolkit provides two complementary calculation paths consuming a shared diagram specification: Naive Dimensional Analysis (NDA) for order-of-magnitude rate estimates and Exact Diagrammatic Analysis (EDA) for tree-level symbolic calculations via automatic FeynCalc code generation, both supplemented by automatic Feynman diagram enumeration and a navigable theory knowledge base. The architecture is validated on two benchmarks: (1) an exhaustive catalog of all tree-level, single-vertex $1\to 2$ partial decay widths across scalar, fermion, and vector parents, with complete massless and threshold limits and Standard Model validation; and (2) an NDA sensitivity study of the muon decay multiplicity $μ^+ \to ν_μ\barν_e + n(e^+e^-) + e^-$, determining the maximum observable $n$ at current and planned muon experiments.

Menzo, Tony [Alabama U.; Fermilab] (ORCID:00000002↗
DOE OSTI2016

Recovery Act. Development and Validation of an Advanced Stimulation Prediction Model for Enhanced Geothermal System

The research project aims to develop and validate an advanced computer model that can be used in the planning and design of stimulation techniques to create engineered reservoirs for Enhanced Geothermal Systems. The specific objectives of the proposal are to: 1) Develop a true three-dimensional hydro-thermal fracturing simulator that is particularly suited for EGS reservoir creation. 2) Perform laboratory scale model tests of hydraulic fracturing and proppant flow/transport using a polyaxial loading device, and use the laboratory results to test and validate the 3D simulator. 3) Perform discrete element/particulate modeling of proppant transport in hydraulic fractures, and use the results to improve understand of proppant flow and transport. 4) Test and validate the 3D hydro-thermal fracturing simulator against case histories of EGS energy production. 5) Develop a plan to commercialize the 3D fracturing and proppant flow/transport simulator. The project is expected to yield several specific results and benefits. Major technical products from the proposal include: 1) A true-3D hydro-thermal fracturing computer code that is particularly suited to EGS, 2) Documented results of scale model tests on hydro-thermal fracturing and fracture propping in an analogue crystalline rock, 3) Documented procedures and results of discrete element/particulate modeling of flow and transport of proppants for EGS applications, and 4) Database of monitoring data, with focus of Acoustic Emissions (AE) from lab scale modeling and field case histories of EGS reservoir creation.

15 GEOTHERMAL ENERGY↗
DOE OSTI2021

Design and physics basis for the upcoming DIII-D SAS-VW campaign to quantify tungsten leakage and transport in a new slot divertor geometry

A set of experiments are planned to exploit the high SOL collisionality enabled by a tightly baffled slot divertor geometry to suppress tungsten leakage in DIII-D. A toroidal row of graphite tiles from the Small Angle Slot (SAS) divertor is being coated with 10–15 μ m of tungsten. New spectroscopic viewing chords with in-vacuo optics will measure the W gross erosion source from the divertor surface with high spatial and temporal resolution. In parallel, the bottom of the SAS divertor is changed from a flat to a ‘V’ shape. New SOLPS-ITER/DIVIMP simulations conducted with drifts using the planned ‘V’ shape predict a substantial reduction in W sourcing and SOL accumulation in either B × ∇B direction relative to either the old SAS divertor shape or the open, lower divertor. Dedicated studies are planned to carefully characterize the level of W sourcing, leakage, and scrape-off-layer (SOL) accumulation in DIII-D over a wide range of plasma scenarios. Various actuators will be assessed for their efficacy in further reducing high-Z impurity sources and leakage from the slot divertor geometry. Finally, this coupled code-experiment validation effort will be used to stress-test physics models and build confidence in extrapolations to advanced, high-Z divertor geometries for next-step devices.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Going Forward with the Nancy Grace Roman Space Telescope Transient Survey: Validation of Precision Forward-modeling Photometry for Undersampled Imaging

The Nancy Grace Roman Space Telescope (Roman) is an observatory for both wide-field observations and coronagraphy that is scheduled for launch in the mid-2020s. Part of the planned survey is a deep, cadenced field or fields that enable cosmological measurements with type Ia supernovae (SNe Ia). With a pixel scale of 0$_.^"$11, the Wide Field Instrument will be undersampled, presenting a difficulty for precisely subtracting the galaxy light underneath the SNe. We use simulated data to validate the ability of a forward-model code (such codes are frequently also called “scene-modeling” codes) to perform precision supernova photometry for the Roman SN survey. Our simulation includes over 760,000 image cutouts around SNe Ia or host galaxies (~10% of a full-scale survey). To have a realistic 2D distribution of underlying galaxy light, we use the VELA simulated high-resolution images of galaxies. We run each set of cutouts through our forward-modeling code which automatically measures time-dependent SN fluxes. Given our assumed inputs of a perfect model of the instrument point-spread functions and calibration, we find biases at the millimagnitude level from this method in four red filters (Y106, J129, H158, and F184), easily meeting the 0.5% Roman inter-filter calibration requirement for a cutting-edge measurement of cosmological parameters using SNe Ia. Simulated data in the bluer Z087 filter shows larger ~ 2–3 mmg biases, also meeting this requirement, but with more room for improvement. Our forward-model code has been released on Zenodo.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Exploring Causes of Beam Loss at CEBAF

At Jefferson Lab, the Continuous Electron Beam Accelerator (CEBAF) features a unique design with two linear accelerators and two arc sections allowing for multiple turns of the electron beam, as well as four experimental end stations. This topology leads to increased beam losses, especially in the spreader and recombiner regions connecting the arcs to the linacs and in the extraction regions connecting the experimental end stations to the accelerator. These losses result in equipment activation and operational interruptions. Recent upgrades to the facility’s diagnostic systems, including the addition of xenon ion chambers, have provided higher-resolution data regarding these loss events. Building on this improved observational capability, we are developing a simulation framework using optics codes and the Geant4-based BDSIM to model beam extinction and halo formation in these regions. This work aims to correlate simulation results with experimental data to isolate the causes of beam loss and inform future machine tuning strategies. We present a summary of conclusions drawn from recent operational studies and outline a plan to model the beam loss and validate the simulations.

Matthews, C. [Old Dominion Univ., Norfolk, VA (Uni↗
DOE OSTI2018

Parallelized and Vectorized Tracking Using Kalman Filters with CMS Detector Geometry and Events

The High-Luminosity Large Hadron Collider at CERN will be characterized by greater pileup of events and higher occupancy, making the track reconstruction even more computationally demanding. Existing algorithms at the LHC are based on Kalman filter techniques with proven excellent physics performance under a variety of conditions. Starting in 2014, we have been developing Kalman-filter-based methods for track finding and fitting adapted for many-core SIMD processors that are becoming dominant in high-performance systems. This paper summarizes the latest extensions to our software that allow it to run on the realistic CMS-2017 tracker geometry using CMSSW-generated events, including pileup. The reconstructed tracks can be validated against either the CMSSW simulation that generated the hits, or the CMSSW reconstruction of the tracks. In general, the code's computational performance has continued to improve while the above capabilities were being added. We demonstrate that the present Kalman filter implementation is able to reconstruct events with comparable physics performance to CMSSW, while providing generally better computational performance. Further plans for advancing the software are discussed.

Cerati, Giuseppe↗