Search NASA⌕ Search

SEARCH · Search NASA

Results for “Simulation Credibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Improved Compaction Experiments and Modeling of Waste Isolation Pilot Plant Standard, Non-degraded, Waste Containers

A credible simulation of disposal room porosity at the Waste Isolation Pilot Plant (WIPP) requires a tenable compaction model for the 55-gallon waste containers within the room. A review of the legacy waste material model, however, revealed several out-of-date and untested assumptions that could affect the model’s compaction behavior. For example, the legacy model predicted non-physical tensile out-of-plane stresses under plane strain compression. (Plane strain compression is similar to waste compaction in the middle of a long drift.) Consequently, a suite of new compaction experiments were performed on containers filled with surrogate, non-degraded, waste. The new experiments involved uniaxial, triaxial, and hydrostatic compaction tests on quarter-scale and full-scale containers. Special effort was made to measure the volume strain during uniaxial and triaxial tests, so that the lateral strain could be inferred from the axial and volume strain. These experimental measurements were then used to calibrate a pressure dependent, viscoplastic, constitutive model for the homogenized compaction behavior of the waste containers. This new waste material model’s predictions agreed far better with the experimental measurements than the legacy model’s predictions, especially under triaxial and hydrostatic conditions. Under plane strain compression, the new model predicted reasonable compressive out-of-plane stresses, instead of tensile stresses. Moreover, the new model’s plane strain behavior was substantially weaker for the same strain, yet substantially stronger for the same porosity, than the legacy model’s behavior. Although room for improvement exists, the new model appears ready for prudent engineering use.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Code Verification of the HIGRAD Computational Fluid Dynamics Solver

The purpose of this report is to outline code and solution verification activities applied to HIGRAD, a Computational Fluid Dynamics (CFD) solver of the compressible Navier-Stokes equations developed at the Los Alamos National Laboratory, and used to simulate various phenomena such as the propagation of wildfires and atmospheric hydrodynamics. Code verification efforts, as described in this report, are an important first step to establish the credibility of numerical simulations. They provide evidence that the mathematical formulation is properly implemented without significant mistakes that would adversely impact the application of interest. Highly accurate analytical solutions are derived for four code verification test problems that exercise different aspects of the code. These test problems are referred to as: (i) the quiet start, (ii) the passive advection, (iii) the passive diffusion, and (iv) the piston-like problem. These problems are simulated using HIGRAD with different levels of mesh discretization and the numerical solutions are compared to their analytical counterparts. In addition, the rates of convergence are estimated to verify the numerical performance of the solver. The first three test problems produce numerical approximations as expected. The fourth test problem (piston-like) indicates the extent to which the code is able to simulate a 'mild' discontinuity, which is a condition that would typically be better handled by a Lagrangian formulation. The current investigation concludes that the numerical implementation of the solver performs as expected. The quality of solutions is sufficient to provide credible simulations of fluid flows around wind turbines. The main caveat associated to these findings is the low coverage provided by these four problems, and somewhat limited verification activities. A more comprehensive evaluation of HIGRAD may be beneficial for future studies.

17 WIND ENERGY↗

From models to reality: a systematic review on simulated and measured residential heat pump energy savings

High-performance HVAC solutions are central to residential energy management. A substantial share of these are electric, reversible-cycle systems, with heat pumps representing the largest portion of current and near-term adoption. This review synthesizes peer-reviewed and grey literature on residential space heating and cooling heat pumps. The academic literature is dominated by modeling (73.8%), with limited field measurement (13.1%). Grey literature from United States serve as a supplemental resource providing measured savings. Conversions from electric-resistance heating consistently show the largest site energy reductions, while oil/propane baselines yield moderate savings, and gas baseline scenario often deliver small and region-dependent savings. This study cross-checks the grey literature measured data with simulation data filtered from the ResStock dataset. The comparison indicates a discrepancy between simulations and measured data: simulated site EUIs are typically lower than measured EUIs, but percentage energy savings fall in similar ranges, implying simulations capture directional effects while underestimating energy use. Factors associated with variability and model–measurement differences include system characterization and control representation (e.g., backup heat engagement, thermostat/setpoint strategies, commissioning/installation quality), occupant behavior, weather normalization, metering scope, and envelope characterization. This paper also outlines the proposed methodology for comparing simulation and measured data for heat pumps. It emphasizes the metrics used for comparison and units harmonization, building characteristics matching, and compact metadata are needed for simulations to match measured data. The proposed methodology is expected to improve the credibility of simulated savings as measured evidence grows.

Yu, Lili↗

Dynamics of Arctic and Sub-Arctic Climate and Atmospheric Circulation: Diagnosis of Mechanisms and Biases Using Data Assimilation

This is the final report for DOE grant DE-FG02-07ER64434 to Eric DeWeaver at the University of Wisconsin-Madison. The overall goal of work performed under this grant is to enhance understanding of simulations of present-day climate and greenhouse gas-induced climate change. Enhanced understanding is desirable 1) as a prerequisite for improving simulations; 2) for assessing the credibility of model simulations and their usefulness as tools for decision support; and 3) as a means to identify robust behaviors which commonly occur over a wide range of models, and may yield insights regarding the dominant physical mechanisms which determine mean climate and produce climate change. A furthe objective is to investigate the use of data assimilation as a means for examining and correcting model biases. Our primary focus is on the Arctic, but the scope of the work was expanded to include the global climate system to the extent that research targets of opportunity present themselves. Research performed under the grant falls into five main research areas: 1) a study of data assimilation using an ensemble filter with the atmospheric circulation model of the National Center for Atmospheric Research, in which both conventional observations and observations of the refraction of radio waves from GPS satellites were used to constrain the atmospheric state of the model; 2) research on the likely future status of polar bears, in which climate model simluations were used to assess the effectiveness of climate change mitigation efforts in preserving the habitat of polar bears, now considered a threatened species under global warming; 3) as assessment of the credibility of Arctic sea ice thickness simulations from climate models; 4) An examination of the persistence and reemergence of Northern Hemisphere sea ice area anomalies in climate model simulations and in observations; 5) An examination of the roles played by changes in net radiation and surface relative humidity in determine the response of the hydrological cycle to global warming.

58 GEOSCIENCES↗

Comparing simulated demand flexibility against actual performance in commercial office buildings

Commercial building energy benchmarking has been used as a mechanism to evaluate energy use of a single building over time, relative to other similar buildings, or to simulations of a reference building conforming to various energy standards. Lack of empirical demand flexibility data and consistent flexibility metrics has limited the ability to compare demand flexibility performance with estimated demand flexibility in buildings. In this study, we collected demand response performance data for a total of 831 demand response events from 192 sites as a first step to build such a building demand flexibility dataset, and propose a standard core data schema to consolidate field data from different sources. We also performed parametric simulations of a control strategy called “global temperature adjustment” using commercial office prototype building models. We then compared the simulated demand flexibility performance against the actual data for offices with global temperature adjustment strategy implemented. During demand response events with an average outside air temperature of 34 °C (range 23 °C–42 °C), the measured demand decrease intensity of the demand flexibility metrics were 6.1 watts per square meter (W/m 2 ), 10.0 W/m 2 , 11.1 W/m 2 , 7.1 W/m 2 , and 4.7 W/m 2 for small, small–medium, medium, medium–large, and large office buildings, respectively. Compared to the measured data in medium- and large-size buildings, the simulated demand decrease intensity was 0.7 W/m 2 (17%) lower on average. The discrepancy between simulated and measured peak demand intensities fell within one standard deviation of the mean measured data. Here, the comparison results validate the credibility of simulations in capturing real building data for assessing the technical potential of building demand flexibility.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Dynamics of Arctic and Sub-Arctic Climate and Atmospheric Circulation: Diagnosis of Mechanisms and Biases Using Data Assimilation

The overall goal of work performed under this grant is to enhance understanding of simulations of present-day climate and greenhouse gas-induced climate change. The examination of present-day climate also includes diagnostic intercomparison of model simulations and observed mean climate and climate variability using reanalysis and satellite datasets. Enhanced understanding is desirable 1) as a prerequisite for improving simulations; 2) for assessing the credibility of model simulations and their usefulness as tools for decision support; and 3) as a means to identify robust behaviors which commonly occur over a wide range of models, and may yield insights regarding the dominant physical mechanisms which determine mean climate and produce climate change. A further objective is to investigate the use of data assimilation as a means for examining and correcting model biases. Our primary focus is on the Arctic, but the scope of the work was expanded to include the global climate system.

58 GEOSCIENCES↗

Coupled Euler-Lagrange Simulation of the Jolt HE Event and Relevance to the Shock Physics Experiments

The goal of the Shock Physics Experiments is to increase our understanding of the shock phenomenology from an explosive event to aid in modeling these events. A more accurate understanding of the effects of near source geology on that phenomenology is critical. We demonstrated the use of the multi physics Abaqus ® fully coupled Euler-Lagrange code to model the DTRA JOLT experiment. Abaqus/CEL was able to compute the high-deformation explosive loading, the complex rock response with damage, and the large general contact domain. Comparison of results to test data reveals that the simulation performed credibly. These results provide insight into propagati0n of explosive-caused shock in jointed media. This exercise provides evidence that the shock front is not perturbed by the joints. While it is possible that later time, lower amplitude portions of the waveform can exhibit behavior caused by joints, we conclude that the main shock events from the SPE events is not effected by the local jointing.

58 GEOSCIENCES↗

Uncertainty quantification of machine learning models to improve streamflow prediction under changing climate and environmental conditions

Machine learning (ML) models, and Long Short-Term Memory (LSTM) networks in particular, have demonstrated remarkable performance in streamflow prediction and are increasingly being used by the hydrological research community. However, most of these applications do not include uncertainty quantification (UQ). ML models are data driven and can suffer from large extrapolation errors when applied to changing climate/environmental conditions. UQ is required to quantify the influence of data noises on model predictions and avoid overconfident projections in extrapolation. In this work, we integrate a novel UQ method, called PI3NN, with LSTM networks for streamflow prediction. PI3NN calculates Prediction Intervals by training 3 Neural Networks. It can precisely quantify the predictive uncertainty caused by the data noise and identify out-of-distribution (OOD) data in a non-stationary condition to avoid overconfident predictions. We apply the PI3NN-LSTM method in the snow-dominant East River Watershed in the western US and in the rain-driven Walker Branch Watershed in the southeastern US. Results indicate that for the prediction data which have similar features as the training data, PI3NN precisely quantifies the predictive uncertainty with the desired confidence level; and for the OOD data where the LSTM network fails to make accurate predictions, PI3NN produces a reasonably large uncertainty indicating that the results are not trustworthy and should avoid overconfidence. PI3NN is computationally efficient, robust in performance, and generalizable to various network structures and data with no distributional assumptions. It can be broadly applied in ML-based hydrological simulations for credible prediction.

54 ENVIRONMENTAL SCIENCES↗

Interrelationship between Lab, Space, Astrophysical, Magnetic Fusion, and Inertial Fusion Plasma Experiments

The objectives of this review are to articulate geospace, heliospheric, and astrophysical plasma physics issues that are addressable by laboratory experiments, to convey the wide range of laboratory experiments involved in this interdisciplinary alliance, and to illustrate how lab experiments on the centimeter or meter scale can develop, through the intermediary of a computer simulation, physically credible scaling of physical processes taking place in a distant part of the universe over enormous length scales. The space physics motivation of laboratory investigations and the scaling of laboratory plasma parameters to space plasma conditions, having expanded to magnetic fusion and inertial fusion experiments, are discussed. Examples demonstrating how laboratory experiments develop physical insight, validate or invalidate theoretical models, discover unexpected behavior, and establish observational signatures for the space community are presented. The various device configurations found in space-related laboratory investigations are outlined.

Koepke, Mark E.↗

Nonintrusive manufactured solutions for ablation

The study of heat transfer and ablation plays an important role in many problems of scientific and engineering interest. As with the computational simulation of any physical phenomenon, the first step toward establishing credibility in ablation simulations involves code verification. Code verification is typically performed using exact and manufactured solutions. However, manufactured solutions generally require the invasive introduction of an artificial forcing term within the source code such that the code solves a modified problem for which the solution is known. In this paper, we present a nonintrusive method for manufacturing solutions for a non-decomposing ablation code, which does not require the addition of a source term.

42 ENGINEERING↗

Uncertainties in greenhouse gas emission factors: A comprehensive analysis of switchgrass‐based biofuel production

Abstract This study investigates uncertainties in greenhouse gas (GHG) emission factors related to switchgrass‐based biofuel production in Michigan. Using three life cycle assessment (LCA) databases—US lifecycle inventory (USLCI) database, GREET, and Ecoinvent—each with multiple versions, we recalculated the global warming intensity (GWI) and GHG mitigation potential in a static calculation. Employing Monte Carlo simulations along with local and global sensitivity analyses, we assess uncertainties and pinpoint key parameters influencing GWI. The convergence of results across our previous study, static calculations, and Monte Carlo simulations enhances the credibility of estimated GWI values. Static calculations, validated by Monte Carlo simulations, offer reasonable central tendencies, providing a robust foundation for policy considerations. However, the wider range observed in Monte Carlo simulations underscores the importance of potential variations and uncertainties in real‐world applications. Sensitivity analyses identify biofuel yield, GHG emissions of electricity, and soil organic carbon (SOC) change as pivotal parameters influencing GWI. Decreasing uncertainties in GWI may be achieved by making greater efforts to acquire more precise data on these parameters. Our study emphasizes the significance of considering diverse GHG factors and databases in GWI assessments and stresses the need for accurate electricity fuel mixes, crucial information for refining GWI assessments and informing strategies for sustainable biofuel production.

Kim, Seungdo↗

Verifying and Validating Simulation Models

This presentation is a high-level discussion of the Verification and Validation (V&V) of computational models. Definitions of V&V are given to emphasize that “validation” is never performed in a vacuum; it accounts, instead, for the current state-of-knowledge in the discipline considered. In particular comparisons between physical measurements and numerical predictions should account for their respective sources of uncertainty. The differences between error (bias), aleatoric uncertainty (randomness) and epistemic uncertainty (ignorance, lack-of- knowledge) are briefly discussed. Four types of uncertainty in physics and engineering are discussed: 1) experimental variability, 2) variability and randomness, 3) numerical uncertainty and 4) model-form uncertainty. Statistical sampling methods are available to propagate, and analyze, variability and randomness. Numerical uncertainty originates from the truncation error introduced by the discretization of partial differential equations in time and space. Model-form uncertainty is introduced by assumptions often formulated to render a complex problem more tractable and amenable to modeling and simulation. The discussion concludes with high-level guidance to assess the “credibility” of numerical simulations, which stems from the level of rigor with which these various sources of uncertainty are assessed and quantified.

Mathematics & Computing(97)↗

Enhancement of risk informed validation framework for external hazard scenario

In recent years, the U.S. Nuclear Regulatory Commission (USNRC) and the International Atomic Energy Agency (IAEA) have developed methodologies to assess the vulnerabilities of nuclear plants against site specific extreme hazards. In many cases, advanced simulation tools are being considered to simulate multi-physics, multi-scale phenomena and to evaluate vulnerability of nuclear facilities. The credibility of advanced simulation tools is assessed based on a formal verification, validation, and uncertainty quantification procedure. One of the key limitations in validation is the lack of relevant experimental data at system-level. This limitation leads to a decrease in the confidence of system-level risk predictions. Therefore, a robust validation framework is needed to formalize the confidence in predictive capability of advanced simulation results. Additionally, this study enhances the existing risk informed validation methodology, originally proposed by Kwag et al. [1] and Bodda et al. [2], by developing additional attributes and a new set of validation indicies for a complete and wider applicability of the framework. In this manuscript, the methodology to identify the critical path that leads to the system-level failure is illustrated. The overall validation is checked for completeness and consistency by comparing the critical path for both the system-level simulation and experimental models. The applicability of the code for an intended application is represented in terms of various maturity levels and helps in the process of decision making.

42 ENGINEERING↗

On the applicability of surrogate-based Markov chain Monte Carlo-Bayesian inversion to the Community Land Model: Case studies at flux tower sites: SURROGATE-BASED MCMC FOR CLM

The Community Land Model (CLM) has been widely used in climate and Earth system modeling. Accurate estimation of model parameters is needed for reliable model simulations and predictions under current and future conditions, respectively. In our previous work, a subset of hydrological parameters has been identified to have significant impact on surface energy fluxes at selected flux tower sites based on parameter screening and sensitivity analysis, which indicate that the parameters could potentially be estimated from surface flux observations at the towers. To date, such estimates do not exist. In this paper, we assess the feasibility of applying a Bayesian model calibration technique to estimate CLM parameters at selected flux tower sites under various site conditions. The parameters are estimated as a joint probability density function (PDF) that provides estimates of uncertainty of the parameters being inverted, conditional on climatologically-average latent heat fluxes derived from observations. We find that the simulated mean latent heat fluxes from CLM using the calibrated parameters are generally improved at all sites when compared to those obtained with CLM simulations using default parameter sets. Further, our calibration method also results in credibility bounds around the simulated mean fluxes which bracket the measured data. The modes (or maximum a posteriori values) and 95% credibility intervals of the site-specific posterior PDFs are tabulated as suggested parameter values for each site. Analysis of relationships between the posterior PDFs and site conditions suggests that the parameter values are likely correlated with the plant functional type, which needs to be confirmed in future studies by extending the approach to more sites.

Huang, Maoyi↗

Could a future “Grand Solar Minimum” like the Maunder Minimum stop global warming?

A future Maunder Minimum type grand solar minimum, with total solar irradiance reduced by 0.25% over a 50 year period from 2020 to 2070, is imposed in a future climate change scenario experiment (RCP4.5) using, for the first time, a global coupled climate model that includes ozone chemistry and resolved stratospheric dynamics (Whole Atmosphere Community Climate Model). This model has been shown to simulate two amplifying mechanisms that produce regional signals of decadal climate variability comparable to observations, and thus is considered a credible tool to simulate the Sun's effects on Earth's climate. After the initial decrease of solar radiation in 2020, globally averaged surface air temperature cools relative to the reference simulation by up to several tenths of a degree Centigrade. By the end of the grand solar minimum in 2070, the warming nearly catches up to the reference simulation. Thus, a future grand solar minimum could slow down but not stop global warming.

54 ENVIRONMENTAL SCIENCES↗