Search NASA⌕ Search

SEARCH · Search NASA

Results for “Simulation Credibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

A Data-driven approach to Determining the Fidelity in the Hardware-in-the-loop Systems using Subspace Identification Method

One of the major questions in any Hardware-in-the-loop (HiL) simulation is to understand the fidelity of the HiL simulation itself which is most often indicated qualitatively as either high or low instead of quantifying it. Being cognizant of the level of fidelity forms the crux to assess the validity and credibility of the HiL simulation. In this work, we address this issue by developing a systematic, data-driven approach to assess the fidelity of any HiL simulation, and more specifically, the fidelity of the interface between the simulator and hardware in an HiL simulation. Applying a subspace identification method, a linear system representing the interface is obtained from the time-series data captured between the hardware and simulator in the HiL simulation. Finally, the fidelity is defined based on this linear system properties. The proposed data-driven fidelity quantification framework is illustrated on the IEEE 123 node feeder system running on HYPERSIM and interacting with virtual protection relays.

97 MATHEMATICS AND COMPUTING↗

Toward the credibility of Northeast United States summer precipitation projections in CMIP5 and NARCCAP simulations

Abstract Precipitation projections for the northeast United States and nearby Canada (Northeast) are examined for 15 Fifth Phase of the Coupled Model Intercomparison Project (CMIP5) models. A process‐based evaluation of atmospheric circulation features associated with wet Northeast summers is performed to examine whether credibility can be differentiated within the multimodel ensemble. Based on these evaluations, and an analysis of the interannual statistical properties of area‐averaged precipitation, model subsets were formed. Multimodel precipitation projections from each subset were compared to the multimodel projection from all of the models. Higher‐resolution North American Regional Climate Change Assessment Program (NARCCAP) regional climate models (RCMs) were subjected to a similar evaluation, grouping into subsets, and examination of future projections. CMIP5 models adequately simulate most large‐scale circulation features associated with wet Northeast summers, though all have errors in simulating observed sea level pressure and moisture divergence anomalies in the western tropical Atlantic/Gulf of Mexico. Relevant large‐scale processes simulated by the RCMs resemble those of their driving global climate models (GCMs), which are not always realistic. Future RCM studies could benefit from a process analysis of potential driving GCMs prior to dynamical downscaling. No CMIP5 or NARCCAP models were identified as clearly more credible, but six GCMs and four RCMs performed consistently better. Among the “Better” models, there is no consistency in the direction of future summer precipitation change. CMIP5 projections suggest that the Northeast precipitation response depends on the dynamics of the North Atlantic anticyclone and associated circulation and moisture convergence patterns, which vary among “Better” models. Even when model credibility cannot be clearly differentiated, examination of simulated processes provides important insights into their evolution under greenhouse warming.

Thibeault, Jeanne M.↗

Persisting cold extremes under 21st-century warming scenarios

Analyses of climate model simulations and observations reveal that extreme cold events are likely to persist across each land-continent even under 21st-century warming scenarios. The grid-based intensity, duration and frequency of cold extreme events are calculated annually through three indices: the coldest annual consecutive three-day average of daily maximum temperature, the annual maximum of consecutive frost days, and the total number of frost days. Nine global climate models forced with a moderate greenhouse-gas emissions scenario compares the indices over 2091 2100 versus 1991 2000. The credibility of model-simulated cold extremes is evaluated through both bias scores relative to reanalysis data in the past and multi-model agreement in the future. The number of times the value of each annual index in 2091 2100 exceeds the decadal average of the corresponding index in 1991 2000 is counted. The results indicate that intensity and duration of grid-based cold extremes, when viewed as a global total, will often be as severe as current typical conditions in many regions, but the corresponding frequency does not show this persistence. While the models agree on the projected persistence of cold extremes in terms of global counts, regionally, inter-model variability and disparity in model performance tends to dominate. Our findings suggest that, despite a general warming trend, regional preparedness for extreme cold events cannot be compromised even towards the end of the century.

54 ENVIRONMENTAL SCIENCES↗

Solar assisted heat pump on air collectors: A simulation tool

The heating system of the bioclimatic building of the Greek National Centre for Renewable Energy Sources (CRES) comprises two heating plants: the first one includes an air source heat pump, Solar Air Collectors (SACs) and a heat distribution system (comprising a fan coil unit network); the second one is, mainly, a geothermal heat pump unit to cover the ground floor thermal needs. The SAC configuration as well as the fraction of the building heating load covered by the heating plant are assessed in two operation modes; the direct (hot air from the collectors is supplied directly to the heated space) and the indirect mode (warm air from the SAC or its mixture with ambient air is not supplied directly to the heated space but indirectly into the evaporator of the air source heat pump). The technique of the indirect mode of heating aims at maximizing the efficiency of the SAC, saving electrical power consumed by the compressor of the heat pump, and therefore, at optimizing the coefficient of performance (COP) of the heat pump due to the increased intake of ambient thermal energy by means of the SAC. Results are given for three research objectives: assessment of the heat pump efficiency whether in direct or indirect heating mode; Assessment of the overall heating plant efficiency on a daily or hourly basis; Assessment of the credibility of the suggested simulation model TSAGAIR by comparing its results with the TRNSYS ones. (author)

14 SOLAR ENERGY↗

Data Assimilation Tools for CO2 Reservoir Model Development – A Review of Key Data Types, Analyses, and Selected Software

Pacific Northwest National Laboratory (PNNL) has embarked on an initiative to develop world-class capabilities for performing experimental and computational analyses associated with geologic sequestration of carbon dioxide. The ultimate goal of this initiative is to provide science-based solutions for helping to mitigate the adverse effects of greenhouse gas emissions. This Laboratory-Directed Research and Development (LDRD) initiative currently has two primary focus areas—advanced experimental methods and computational analysis. The experimental methods focus area involves the development of new experimental capabilities, supported in part by the U.S. Department of Energy’s (DOE) Environmental Molecular Science Laboratory (EMSL) housed at PNNL, for quantifying mineral reaction kinetics with CO2 under high temperature and pressure (supercritical) conditions. The computational analysis focus area involves numerical simulation of coupled, multi-scale processes associated with CO2 sequestration in geologic media, and the development of software to facilitate building and parameterizing conceptual and numerical models of subsurface reservoirs that represent geologic repositories for injected CO2. This report describes work in support of the computational analysis focus area. The computational analysis focus area currently consists of several collaborative research projects. These are all geared towards the development and application of conceptual and numerical models for geologic sequestration of CO2. The software being developed for this focus area is referred to as the Geologic Sequestration Software Suite or GS3. A wiki-based software framework is being developed to support GS3. This report summarizes work performed in FY09 on one of the LDRD projects in the computational analysis focus area. The title of this project is Data Assimilation Tools for CO2 Reservoir Model Development. Some key objectives of this project in FY09 were to assess the current state-of-the-art in reservoir model development, the data types and analyses that need to be performed in order to develop and parameterize credible and robust reservoir simulation models, and to review existing software that is applicable to these analyses. This report describes this effort and highlights areas in which additional software development, wiki application extensions, or related GS3 infrastructure development may be warranted.

54 ENVIRONMENTAL SCIENCES↗

Simulation of Deuterium Oxidation in a Room with a Fire

A series of experiments where deuterium was released in trace amounts into a room with a fire were performed at Sandia National Laboratories. This report describes the corresponding effort to model the test series using SIERRA/FUEGO. The objective of this modeling effort was to produce a simulation test matrix that can be utilized to help interpret the corresponding experiments and be used to assess the credibility of using the SIERRA/FUEGO simulations as a surrogate for real tritium reaction data for mock fire and release studies. The simulations assessed multiple configurations of fire size and location and overall found that there was low conversion of deuterium to oxidized deuterium. There are some notable differences between the simulation predictions and the experimental results, such as the simulations generally predicting higher amounts of deuterium conversion compared to the experiment. A strategy to address modeling uncertainties and unknowns is also given in this report.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Tritium Fires: Simulation and Safety Assessment

This is the Sandia report from a joint NSRD project between Sandia National Labs and Savannah River National Labs. The project involved development of simulation tools and data intended to be useful for tritium operations safety assessment. Tritium is a synthetic isotope of hydrogen that has a limited lifetime, and it is found at many tritium facilities in the form of elemental gas (T 2 ). The most serious risk of reasonable probability in an accident scenario is when the tritium is released and reacts with oxygen to form a water molecule, which is subsequently absorbed into the human body. This tritium oxide is more readily absorbed by the body and therefore represents a limiting factor for safety analysis. The abnormal condition of a fire may result in conversion of the safer T 2 inventory to the more hazardous oxidized form. It is this risk that tends to govern the safety protocols. Tritium fire datasets do not exist, so prescriptive safety guidance is largely conservative and reliant on means other than testing to formulate guidelines. This can have a consequence in terms of expensive and/or unnecessary mitigation design, handling protocols, and operational activities. This issue can be addressed through added studies on the behavior of tritium under representative conditions. Due to the hazards associated with the tests, this is being approached mainly from a modeling and simulation standpoint and surrogate testing. This study largely establishes the capability to generate simulation predictions with sufficiently credible characteristics to be accepted for safety guidelines as a surrogate for actual data through a variety of testing and modeling activities.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Physical Review Journal Club: Structural uncertainty assessment for fire-engulfed objects in crosswind: Establishing credibility for a multiphysics wall-modeled large-eddy simulation paradigm

This is an invited presentation for APS's monthly Journal Club where important papers that have recently been accepted for publication are highlighted in a seminar-like setting. The presentation will be "live" (May 1, 2025) and streamed across the world (including an archived recording).

Domino, Stefan Paul [Sandia National Laboratories ↗

Results from Tight and Loose Coupled Multiphysics in Nuclear Fuels Performance Simulations using BISON

The behavior of nuclear fuel in the reactor environment is affected by multiple physics, most notably heat conduction and solid mechanics, which can have a strong influence on each other. To provide credible solutions, a fuel performance simulation code must have the ability to obtain solutions for each of the physics, including coupling between them. Solution strategies for solving systems of coupled equations can be categorized as loosely-coupled, where the individual physics are solved separately, keeping the solutions for the other physics fixed at each iteration, or tightly coupled, where the nonlinear solver simultaneously drives down the residual for each physics, taking into account the coupling between the physics in each nonlinear iteration. In this paper, we compare the performance of loosely and tightly coupled solution algorithms for thermomechanical problems involving coupled thermal and mechanical contact, which is a primary source of interdependence between thermal and mechanical solutions in fuel performance models. The results indicate that loosely-coupled simulations require significantly more nonlinear iterations, and may lead to convergence trouble when the thermal conductivity of the gap is too small. We also apply the tightly coupled solution strategy to a nuclear fuel simulation of an experiment in a test reactor. Studying the results from these simulations indicates that perhaps convergence for either approach may be problem dependent, i.e., there may be problems for which a loose coupled approach converges, where tightly coupled won’t converge and vice versa.

97 MATHEMATICS AND COMPUTING↗

Results from tight and loose coupled multiphysics in nuclear fuels performance simulations using BISON

The behavior of nuclear fuel in the reactor environment is affected by multiple physics, most notably heat conduction and solid mechanics, which can have a strong influence on each other. To provide credible solutions, a fuel performance simulation code must have the ability to obtain solutions for each of the physics, including coupling between them. Solution strategies for solving systems of coupled equations can be categorized as loosely-coupled, where the individual physics are solved separately, keeping the solutions for the other physics fixed at each iteration, or tightly coupled, where the nonlinear solver simultaneously drives down the residual for each physics, taking into account the coupling between the physics in each nonlinear iteration. In this paper, we compare the performance of loosely and tightly coupled solution algorithms for thermomechanical problems involving coupled thermal and mechanical contact, which is a primary source of interdependence between thermal and mechanical solutions in fuel performance models. The results indicate that loosely-coupled simulations require significantly more nonlinear iterations, and may lead to convergence trouble when the thermal conductivity of the gap is too small. We also apply the tightly coupled solution strategy to a nuclear fuel simulation of an experiment in a test reactor. Studying the results from these simulations indicates that perhaps convergence for either approach may be problem dependent, i.e., there may be problems for which a loose coupled approach converges, where tightly coupled won't converge and vice versa. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A Surrogate-based Adaptive Sampling Approach for History Matching and Uncertainty Quantification

A critical procedure in reservoir simulations is history matching (or data assimilation in a broader sense), which calibrates model parameters such that the simulation results are consistent with field measurements, and hence improves the credibility of the predictions given by the simulations. Often there exist non-unique combinations of parameter values that all yield the simulation results matching the measurements. For such ill-posed history matching problems, Bayesian theorem provides a theoretical foundation to represent different solutions and to quantify the uncertainty with the posterior PDF. Lacking an analytical solution in most situations, the posterior PDF may be characterized with a sample of realizations, each representing a possible scenario. A novel sampling algorithm is presented here for the Bayesian solutions to history matching problems. We aim to deal with two commonly encountered issues: 1) as a result of the nonlinear input-output relationship in a reservoir model, the posterior distribution could be in a complex form, such as multimodal, which violates the Gaussian assumption required by most of the commonly used data assimilation approaches; 2) a typical sampling method requires intensive model evaluations and hence may cause unaffordable computational cost. In the developed algorithm, we use a Gaussian mixture model as the proposal distribution in the sampling process, which is simple but also flexible to approximate non-Gaussian distributions and is particularly efficient when the posterior is multimodal. Also, a Gaussian process is utilized as a surrogate model to speed up the sampling process. Furthermore, an iterative scheme of adaptive surrogate refinement and re-sampling ensures sampling accuracy while keeping the computational cost at a minimum level. The developed approach is demonstrated with an illustrative example and shows its capability in handling the above-mentioned issues. Multimodal posterior of the history matching problem is captured and are used to give a reliable production prediction with uncertainty quantification. The new algorithm reveals a great improvement in terms of computational efficiency comparing previously studied approaches for the sample problem.

Li, Weixuan↗

Data Driven Smart Proxy for CFD Application of Big Data Analytics & Machine Learning in Computational Fluid Dynamics, Report Two: Model Building at the Cell Level

To ensure the usefulness of simulation technologies in practice, their credibility needs to be established with Uncertainty Quantification (UQ) methods. In this project, smart proxy is introduced to significantly reduce the computational cost of conducting large number of multiphase CFD simulations, which is typically required for non-intrusive UQ analysis. Smart proxy for CFD models are developed using pattern recognition capabilities of Artificial Intelligence (AI) and Data Mining (DM) technologies. Several CFD simulation runs with different inlet air velocities for a rectangular fluidized bed are used to create a smart CFD proxy that is capable of replicating the CFD results for the entire geometry and inlet velocity range. The smart CFD proxy is validated with blind CFD runs (CFD runs that have not played any role during the development of the smart CFD proxy). The developed and validated smart CFD proxy generates its results in seconds with reasonable error (less than 10%). Upon completion of this project, UQ studies that rely on hundreds or thousands of smart CFD proxy runs can be accomplished in minutes. Following figure demonstrates a validation example (blind CFD run) showing the results from the MFiX simulation and the smart CFD proxy for pressure distribution across a fluidized bed at a given time-step (the layer number corresponds to the vertical location in the bed).

97 MATHEMATICS AND COMPUTING↗

Data Driven Smart Proxy for CFD Application of Big Data Analytics & Machine Learning in Computational Fluid Dynamics, Part Three: Model Building at the Layer Level

To ensure the usefulness of simulation technologies in practice, their credibility needs to be established with Uncertainty Quantification (UQ) methods. In this project smart proxy is introduced to significantly reduce the computational cost of conducting large number of multiphase CFD simulations. Smart proxy for CFD models are developed using pattern recognition capabilities of Artificial Intelligence (AI), Machine Learning (LM) and Data Mining (DM) technologies. Several CFD simulation runs with different inlet air velocities for a rectangular fluidized bed are used to create a smart CFD proxy that is capable of replicating the CFD results for a wide variety of inlet velocities. The smart CFD proxy is validated with blind CFD runs (CFD runs that have not played any role during the development [training, calibration and validation] of the smart CFD proxy). In our earlier work, CFD data was used to train ANN at the cell level. That is an ANN was trained for each computational cell used in the CFD simulations. In the present work, the ANN is constructed and trained based on cross sectional area average of each variable, such as pressure, velocities and volume fraction (Layer Level). This leads to improvements in the training time at the expense of less spatial resolution. The resulting trained ANN provides spatially average value of parameters of interest, along the length of the fluidized bed. Upon completion of this project, UQ studies that rely on hundreds or thousands of smart CFD proxy runs can be accomplished in minutes. Following figure demonstrates a validation example (blind CFD run) showing the results from the MFiX and the smart CFD proxy for pressure drop across a fluidized bed at time-step of 1400 (the layer number corresponds to the vertical location in the bed).

97 MATHEMATICS AND COMPUTING↗

Verification and Validation of Open-Source Computational Fluid Dynamics Capabilities in MOOSE

The Multiphysics Object Oriented Simulation Environment (MOOSE) advances predictive modeling in nuclear research by simplifying the application design process and making modeling more efficient and accessible to researchers and the broader community. Because of MOOSE’s critical role in the scientific computation field, verification and validation are important to evaluate the reliability and credibility of MOOSE’s code, simulations, and models. To assess MOOSE’s Navier Stokes module and turbulence models, the following verification and validation University of Manchester ERCOFTAC cases were simulated in MOOSE, and the results were compared: Case 032 Turbulent Flow in a 2D Channel Case 079 Natural Convection in an Enclosed Cavity

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Advanced Simulation and Computing Business Plan

To maintain a credible nuclear weapons program, the National Nuclear Security Administration’s (NNSA’s) Office of Defense Programs (DP) needs to make certain that the capabilities, tools, and expert staff are in place and are able to deliver validated assessments. This requires a complete and robust simulation environment backed by an experimental program to test ASC Program models. This ASC Business Plan document encapsulates a complex set of elements, each of which is essential to the success of the simulation component of the Nuclear Security Enterprise. The ASC Business Plan addresses the hiring, mentoring, and retaining of programmatic technical staff responsible for building the simulation tools of the nuclear security complex. The ASC Business Plan describes how the ASC Program engages with industry partners—partners upon whom the ASC Program relies on for today’s and tomorrow’s high performance architectures. Each piece in this chain is essential to assure policymakers, who must make decisions based on the results of simulations, that they are receiving all the actionable information they need.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Using Modeling and Simulation to Complement Testing for Increased Understanding of Weapon Subassembly Response.

As part of Sandia’s nuclear deterrence mission, the B61-12 Life Extension Program (LEP) aims to modernize the aging weapon system. Modernization requires requalification and Sandia is using high performance computing to perform advanced computational simulations to better understand, evaluate, and verify weapon system performance in conjunction with limited physical testing. The Nose Bomb Subassembly (NBSA) of the B61-12 is responsible for producing a fuzing signal upon ground impact. The fuzing signal is dependent upon electromechanical impact sensors producing valid electrical fuzing signals at impact. Computer generated models were used to assess the timing between the impact sensor’s response to the deceleration of impact and damage to major components and system subassemblies. The modeling and simulation team worked alongside the physical test team to design a large-scale reverse ballistic test to not only assess system performance, but to also validate their computational models. The reverse ballistic test conducted at Sandia’s sled test facility sent a rocket sled with a representative target into a stationary B61-12 (NBSA) to characterize the nose crush and functional response of NBSA components. Data obtained from data recorders and high-speed photometrics were integrated with previously generated computer models in order to refine and validate the model’s ability to reliably simulate real-world effects. Large-scale tests are impractical to conduct for every single impact scenario. By creating reliable computer models, we can perform simulations that identify trends and produce estimates of outcomes over the entire range of required impact conditions. Sandia’s HPCs enable geometric resolution that was unachievable before, allowing for more fidelity and detail, and creating simulations that can provide insight to support evaluation of requirements and performance margins. As computing resources continue to improve, researchers at Sandia are hoping to improve these simulations so they provide increasingly credible analysis of the system response and performance over the full range of conditions.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗