Search NASA⌕ Search

SEARCH · Search NASA

Results for “model comparison”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Comparing net zero pathways across the Atlantic A model inter-comparison exercise between the Energy Modeling Forum 37 and the European Climate and Energy Modeling Forum

Europe and North America account for 32 % of current carbon emissions. Due to distinct legacy systems, energy infrastructure, socioeconomic development, and energy resource endowment, both regions have different policy and technological pathways to reach net zero by the mid-century. Against this background, our paper examines the results from the net zero emission scenarios for Europe and North America that emerged from the collaboration of the European and American Energy Modeling Forums. Here, in our analysis, we perform an inter-comparison of various integrated assessments and bottom-up energy system models. A clear qualitative consensus emerges on five main points. First, Europe and the United States reach net zero targets with electrification, demand-side reductions, and carbon capture and sequestration technologies. Second, the use of carbon capture and sequestration is more predominant in the United States due to a steeper decarbonization schedule. Third, the buildings sector is the easiest to electrify in both regions. Fourth, the industrial sector is the hardest to electrify in the United States and transportation in Europe. Fifth, in both regions, the transition in the energy mix is driven by the substitution of coal and natural gas with solar and wind, but to a different extent.

100 % renewables↗

Decoding diffraction and spectroscopy data with machine learning: A tutorial

This Tutorial provides a step-by-step guide on how to apply supervised machine-learning techniques to analyze diffraction and spectroscopy data. This Tutorial details four models—a reconstruction-focused model, a regression-focused model, a hybrid reconstruction/regression model, and a multimodal model—that use x-ray diffraction profiles and vibrational density of states spectra to predict various microstructural descriptors. In this Tutorial, we cover data pre-processing steps, constructions of the models via dimensionality reduction and regression, training, and analysis of these models. Comparisons of the model’s performance are provided, highlighting the strength and weakness of the various approaches utilized.

36 MATERIALS SCIENCE↗

Light-induced electron dynamics of molecules in cavities: comparison of model Hamiltonians

The rapidly expanding field of polaritonic chemistry requires accurate theoretical simulations to understand new phenomena at the atomic scale. Computing the optoelectronic properties of molecules using established electronic structure methods is a careful balance of accuracy and computational expense, and expanding these methods to quantum electrodynamics to describe coupled cavity-molecule systems is an active topic of development. Key to these methods are the Hamiltonian operators representing the photon cavity modes. The recently introduced quantum electrodynamics time-dependent configuration interaction (QED-TDCI) method allows for the combination of electron dynamics simulations with quantum electrodynamics, enabling the simulation of time-dependent optoelectronic properties of cavity-molecule systems. Using this method, a comparison of two many-state QED Hamiltonians—the Pauli-Fierz and quantum Rabi model Hamiltonians—is presented, with a particular focus on time-dependent properties in applied electric fields.

Peyton, Benjamin G. (ORCID:0000000163190751)↗

Health and air pollutant emission impacts of net zero CO2 by 2050 scenarios from the energy modeling forum 37 study

Carbon dioxide and non-greenhouse gas air pollutants are emitted from many of the same sources. Decarbonization actions thus typically yield air pollutant emission reductions, resulting in significant air quality benefits. Although several studies have highlighted this connection, including in the context of net zero carbon emission targets, substantial uncertainty remains regarding how alternative technological pathways to this goal will affect the spatial distribution and magnitude of air pollutants. Comprehensive multi-model and multi-scenario analyzes are needed to explore the relative impacts of alternative pathways. Here, our study begins to address this gap by leveraging the results from the recent Energy Modeling Forum 37 inter-model comparison exercise on U.S. decarbonization pathways. Comparing the results of the six teams who submitted air pollutant emissions suggests that strategies that target net zero U.S. carbon emissions would yield significant reductions in many air pollutants, and that this finding is generally robust across pathways. However, some energy sources, such as biomass and fossil fuels with carbon capture, will emit air pollutants and can potentially influence the magnitude, spatial distribution, and even sign of localized air pollutant emission changes. In the second part of this analysis, a simplified air quality and health impacts screening model is used to evaluate the air quality impacts in 2035 of sectoral emission changes from the three models that provided sectoral detail. Relative to a reference scenario, a net zero pathway is estimated to reduce fine particulate matter concentrations across the contiguous U.S., with health benefits from reduced mortality ranging from $\$$65 billion to $\$$250 billion in 2035 alone (2023$\$$s). These benefits would be expected to grow over time as the net zero trajectory becomes more stringent. Both the magnitude of potential benefits and the substantial variation of the projections across models underscore the need for an EMF-like inter-model comparison exercise focused on air quality.

Air pollutants↗

Physics-based hybrid machine learning for critical heat flux prediction with uncertainty quantification

Critical heat flux (CHF) is a key quantity in nuclear system modeling due to its impact on heat transfer, safety margins, and reactor performance. This study develops and validates an uncertainty-aware hybrid modeling approach that combines machine learning with physics-based models to predict CHF in cases of dryout. The Biasi and Bowring empirical correlations were paired with three ML uncertainty quantification (UQ) techniques: deep neural network (DNN) ensembles, Bayesian neural networks (BNNs), and deep Gaussian processes (DGPs). A pure ML model without a base model was evaluated for comparison. Model performance was assessed under plentiful (7,350 points) and limited (9 points) training data scenarios using parity, uncertainty distributions, and calibration curves. Results show that the Biasi hybrid DNN ensemble achieved the best overall performance, with a mean absolute relative error of 1.846%, and well-calibrated uncertainty estimates. The BNN-based hybrids showed slightly higher error (2.14%) but superior uncertainty calibration. DGP models underperformed, with over 6% error and poor uncertainty calibration. All hybrid models outperformed pure machine learning configurations, demonstrating resistance against data scarcity. These findings indicate that hybrid modeling significantly improves predictive accuracy, interpretability, and resilience to data scarcity. The integration of uncertainty awareness provides actionable confidence in CHF predictions, which is vital for safety-critical decisions in nuclear applications. This hybrid approach offers a viable pathway for deploying ML models in reactor analysis tools while preserving domain knowledge and physical consistency.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A parametric study of slow dynamic nonlinear elasticity with comparisons to models

Several phenomenological models that aspire to quantitative description of anomalous nonlinear mesoscopic elasticity are reviewed and compared with laboratory measurements. This class of nonlinearity, best known perhaps for slow dynamics and aging, is seen widely in imperfectly consolidated granular solids but is not well understood. Typical slow dynamic tests show that a modest conditioning oscillatory "pump" strain depresses material stiffness, which then recovers like the logarithm of time after conditioning ceases. Several phenomenological models based on physical arguments have been proposed that predict the material stiffness response to arbitrary pump strain histories during conditioning and recovery. Approximate closed form and numerical solutions to the models are presented that predict the quantitative influence of three key pump parameters: the pump's strain amplitude, the pump's strain rate, and the pump’s duration. Laboratory measurements on Berea sandstone, concrete and a confined single aluminum bead find that slow dynamic responses are linear in pump strain and independent of pump frequency. Measurements also show that, after pump-off, stiffness recovers over times far longer than the pump duration. These observations and others are compared to model predictions. One of the considered models, based on a picture of fast brittle damage and slow healing, successfully matches all these behaviors.

36 MATERIALS SCIENCE↗

Posterior comparison of model dynamics in several hybrid turbulence model forms

Hybrid turbulence models that can accurately reproduce unsteady three-dimensional flow physics across the entire range of grid scales and turbulence dynamics from Reynolds-averaged Navier–Stokes (RANS), through large-eddy simulation (LES), down to direct numerical simulations (DNS) are of increasing interest to the turbulence modeling community. However, despite decades of research and development, the basic tasks of eliminating poor-performing hybrid RANS-LES models and accelerating adoption of superior models through well-designed validation and verification have yet to occur. As a step in this direction, in this work we evaluate thirteen different hybrid RANS-LES models via systematic grid refinement of decaying homogeneous isotropic turbulence. We further derive a novel mathematical framework for assessing the energy partitioning dynamics of each Hybrid RANS-LES model, wherein model-to-model variations in energy partitioning can be interpreted as different feedback mechanisms operating on a low-dimensional nonlinear dynamical system. We found that model forms similar to the flow simulation methodology—also often termed very-large eddy simulation—are dynamically inconsistent with DNS at all resolutions. Additionally, we found a strong dynamical similarity in the feedback mechanisms of all models related to detached eddy simulation and partially averaged Navier–Stokes that is inherent to their general model forms.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DECOVALEX-2023: Task C Final Report

The Full-scale Emplacement (FE) heater experiment at the Mont Terri Underground Rock Laboratory (URL) was designed and conducted by Nagra to replicate an emplacement tunnel of Nagra’s reference repository design at 1:1 scale. Alongside testing the technical feasibility of constructing disposal tunnels, emplacing waste containers in the tunnels and then backfilling them, the main goals of the FE experiment are (1) to obtain a better understanding of the coupled effects of induced thermo-hydro-mechanical (THM) processes that may occur and (2) to validate existing coupled THM models (Müller et al., 2017). A key aspect of ensuring safety for repositories located in low-permeability rock involves minimizing any damage to the rock itself, thereby preserving its integrity and promoting a stable environment Amongst a number of processes that could damage the rock is the increase in pore pressure due to thermal loading caused by heat emitted from the waste. To reduce the potential damage of the rock, it is important to analyse the evolution of heat over time due to the heat load of the containers and assess possible consequences by coupled THM models. The aim of Task C of DECOVALEX-2023 was to build 3D numerical models of the FE experiment, focussing in particular on the heating induced pore pressure change in the Opalinus Clay. Data from a large number of sensors were available from the FE experiment for model comparison. These sensors measured temperature and relative humidity in the bentonite around the heaters, and temperature, pressure and displacement/strain in the surrounding Opalinus clay. Data were available from the start of excavation (April 2012) up to August 2020 for most sensors (more than 5 years from the start of heating in December 2014). To fulfil the overall aim of the task, the work was broken down into a number of steps, starting with simpler models to build confidence in each team’s approach and then moving to more complex models that better represent the FE experiment. Step 0 consisted of 2D benchmark models, gradually increasing the number of processes that are represented from thermal (T) only models in Step 0a, to coupled thermal hydraulic (TH) models in Step 0b with a representation of changing porosity, to coupled thermo-hydro-mechanical (THM) models in Step 0c, where porosity changes are calculated by the mechanical model. A detailed specification of processes, parameters, initial and boundary conditions was provided for this step, with the ambition that all teams would work towards close agreement in their model results, thus building confidence in the model implementations. vi It was not straightforward to achieve agreement between the teams, so additional steps (Step 0b2, 0b3, 0c2, 0c3) were added along with derivation of some analytical solutions against which the models could be compared. The reasons for the differences between teams were investigated and found to be caused primarily by different conceptual model assumptions (including temperature dependence of the thermal expansion of water), different model formulations (including porosity evolution) and differences in modelled domain sizes, boundary conditions and grid discretisation. This demonstrates that comparisons between multiple modelling teams and/or comparison with analytical results and experimental data are highly beneficial in providing an indication of uncertainty in model predictions. At the conclusion of Step 0, almost all teams had achieved a close agreement in model results and those that had not achieved an agreement knew the reason for this. Step 1 moved from 2D models to 3D models of the FE experiment without adding technical features like shotcrete or EDZ, and only considering the heating phase. Initially the 3D model was tightly specified to continue to build confidence in the model implementations (Step 1a). The results of Step 1a were compared to the data from the FE-experiment without the teams seeing the data. The teams were then provided with a sub-set of the data from the FE-experiment and invited to consider how best to use the large dataset for model comparison (Step 1b). Teams were then asked to use the data provided to calibrate their models, only changing material property values rather than adding features or processes to their models (Step 1c). In Step 1, teams were asked to only model the heating phase of the experiment, so pressure in the Opalinus Clay was reported as change in pressure since the initial conditions were specified rather than modelled. The change from 2D to 3D models was accompanied by an increase in the dispersion of results between the teams. Some of this was resolved during the task, but some remained and is potentially due to model discretisation. Calibration of parameters was useful in improving the fit of the models to the data but the remaining differences indicated that the models were missing features or processes. In Step 2, the teams were asked to update their models with additional features and processes as well as calibrating parameters to try and improve the fit of the models to the data. Teams were encouraged to represent ventilation of the open FE tunnel prior to backfilling with heaters and bentonite and in Step 2, the absolute pressure in the Opalinus Clay was compared between the teams. Teams took different approaches, but there was consideration of adding shotcrete and an EDZ into the model, representing stress change during excavation and different approaches to modelling ventilation of the FE tunnel. Overall, the documented results showed a very good agreement for temperature. The results for porewater pressure evolution showed a significant improvement for most teams compared to Step 1c with a good agreement to the measurements for several teams whereas some teams overpredicted the pressure increase and others overpredicted the drainage effect especially for the sensors close to the heater. Step 3 was an opportunity for teams to use the models developed in Step 1 and Step 2 to make predictions about the temperature and pressure changes that will be expected at the FE experiment over the next few years in light of the planned changes in thermal output of the heaters.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Policy implications of net-zero emissions: A multi-model analysis of United States emissions and energy system impacts

Many countries, subnational jurisdictions, and companies are setting net-zero emissions goals; however, questions remain about strategies to reach these targets, policy measures, technology gaps, and economic impacts. Here, we investigate the potential policy implications of reaching economy-wide net-zero CO 2 emissions across the United States by 2050 using results from a multi-model comparison with 14 energy-economic models. Model results suggest that achieving net-zero CO 2 targets depends on policies that accelerate deployment of zero- and low-emitting technologies that have seen rapid cost reductions in recent years (including wind, solar, battery storage, and electric vehicles) as well as relatively nascent options (including carbon capture and storage, advanced biofuels, low-carbon hydrogen, advanced nuclear, and long-duration energy storage). While net-zero policies are likely to lower fossil fuel consumption, including considerable coal and petroleum reductions, achieving net-zero emissions does not necessarily mean phasing out all fossil fuels. Model results indicate that the Inflation Reduction Act’s energy and climate provisions amplify near-term decarbonization but that net-zero policies have larger impacts on long-run outcomes. Stringent climate policy can have large fiscal impacts on tax revenue and government spending—revenues from carbon pricing and subsidies for carbon removal range from 0.1 % to 3.7 % of GDP in 2050 across models. Each dollar per metric ton carbon price leads to a 0.06 % to 0.31 % reduction in economy-wide CO 2 emissions relative to a reference scenario with current policies. Spending on energy across the economy decreases relative to today for many models under reference and net-zero policies, especially as a share of GDP, due primarily to end-use electrification and energy efficiency.

54 ENVIRONMENTAL SCIENCES↗

Modeling the formation of Sedan Crater using the FLAG and HOSS codes

Numerical modeling of explosion crater formation requires accounting for complex physical processes. Numerical validation of explosion cratering is an important step in modeling and requires experimental data for comparison. Models using discrete elements and continuum models have both benefits and drawbacks to their approaches. In this work, we consider both an arbitrary Lagrangian–Eulerian (ALE) hydrocode and a finite discrete element method (FDEM) approach to modeling the formation of the Sedan crater, the largest human-made crater in the United States. The Sedan crater formed from an underground nuclear detonation in the Nevada desert as part of Project Plowshare. Our models show that the continuum approach of the hydrocode matched well compared to early test time prior to the mound rupture and subsequent fireball venting, when most of the alluvium exhibited fluid behavior. Our FDEM approach matched the final crater dimensions well, after material had settled back into the crater, when material strength and solid mechanics play key roles. Our work shows how leveraging the benefits of multiple numerical approaches can lead to better understanding of complex physical problems, especially problems with limited experimental data. By using a continuum approach to early-time hydrodynamics and an FDEM approach to later-time solid mechanics, we can better understand the different physical regimes of explosion crater formation.

36 MATERIALS SCIENCE↗

A magnetic diagnostic suite for the Pegasus-III experiment

Pegasus-III is an ultralow aspect ratio spherical tokamak providing a dedicated US experiment for comparative solenoid-free startup studies. A new magnetic diagnostic suite for equilibrium and low frequency (<200 kHz) magnetohydrodynamic mode analysis has been installed. These new diagnostics address the significant challenges of measuring magnetic field in a high noise environment with the majority constrained to fit in an 8 mm diagnostic gap on the high field side. Electrostatic switching noise generated by the 16 independent current feedback-controlled power supplies produces dV cm /dt ~ 1 kV/μs and volt level common mode noise on the magnetics. Immunity to this switching noise is accomplished through differential signal runs and signal processing, along with end-to-end electromagnetic interference shielding. The magnetic measurements are simultaneously digitized at 1 MHz and conditioned by precision 8 pole Butterworth filters with a corner frequency of 200 kHz to prevent aliasing down to the 16-bit level over the full passband. Ex-vessel calibrations of the B p coils were completed with a typical uncertainty of <0.5%. Stray toroidal field pickup from coil misalignment or positioning errors is corrected using a physics-based model. Comparisons of the corrected measurements to modeling agree to within 1.3% on average. This is within the 1.5% measurement uncertainty that a sensitivity analysis determined is needed for accurate fast boundary and equilibrium reconstruction.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Improving neutrino-nuclei interaction models: Recommendations and case studies on Peelle’s Pertinent Puzzle

Improving the modeling of neutrino-nuclei interactions using data-driven methods is crucial for high-precision neutrino oscillation experiments. This paper investigates Peelle’s Pertinent Puzzle (PPP) in the context of neutrino measurements, a longstanding challenge to fitting theoretical models to experimental data. Inconsistencies in data-model comparisons hinder efforts to enhance the accuracy and reliability of model predictions. We analyze various sources contributing to these inconsistencies and propose strategies to address them, supported by practical case studies. We advocate for incorporating model fitting exercises as a standard practice in cross section publications to enhance the robustness of results. We use a common analysis framework to explore PPP-related challenges with MicroBooNE and T2K data in an unified manner. Our findings offer valuable insights for improving the accuracy and reliability of neutrino-nuclei interaction models, particularly by systematically tuning models using data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Assessment of Climate Change Impacts on Renewable Energy Resources in Western North America

We examine a 25 km resolution climate model dataset to evaluate how regional climate change impacts solar and wind energy under a high-emission scenario. Our study considers the Western Electricity Coordinating Council (WECC) region, which covers the western United States and southwestern Canada, focusing specifically on locations with existing solar and wind infrastructure. First, we conduct a historical model comparison of solar and wind energy capacity factors to highlight model uncertainties across the study area. Using future climate projections, we then assess the seasonal patterns of solar and wind capacity factors for three timeframes: historical, mid-century, and end of century. Additionally, we estimate the frequency of solar and wind resource droughts during these periods for the entire WECC and its five operational subregions, finding that certain subregions are more susceptible to energy droughts due to limited renewable resources. Finally, we present day-ahead capacity factor forecasts to support energy storage planning and provide estimates of offshore wind energy capacity within the WECC. Our results indicate that offshore wind capacity factors are nearly twice as high as onshore values, with less seasonal variation, which suggests that offshore wind could offer a more consistent renewable energy supply in the future.

climate change↗

Value of abstraction in performance assessment – When is a higher level of detail necessary?

In this study, different approaches in performance assessment (PA) of the long-term safety of a repository for radioactive waste were examined. This investigation was carried out as part of the DECOVALEX-2023 project, an international collaborative effort for research and model comparison. One specific task of the DECOVALEX-2023 project was the Salt Performance Assessment Modelling task (Salt PA), which aimed at comparing various models and methods employed in the performance assessment of deep geological repositories in salt. In the context of the Salt PA task, three distinct teams from SNL (United States), Quintessa Ltd (United Kingdom), and GRS (Germany) examined the consequences of employing different levels of abstractions when modelling the repository's geometry and implementing various features and processes, using the example of a simple hypothetical repository structure in domal salt. Each team applied their own tools: PFLOTRAN (SNL), QPAC (Quintessa) and LOPOS (GRS). These differ essentially regarding numerical concept and degree of detail in the representation of the underlying physical processes. The discussion focused on when simplifications can be appropriately applied and what consequences result from them. Furthermore, it was explored when and if a higher level of fidelity in geometry or physical processes is required.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Realistic Precipitation Diurnal Cycle in Global Convection-Permitting Models by Resolving Mesoscale Convective Systems

Accurately representing the precipitation diurnal cycle has long been a challenge for global climate models (GCMs). Here we evaluate the precipitation diurnal cycle in the DYAMOND global convection-permitting models (CPMs) and CMIP6 HighResMIP models. Comparison of the high- (25–50 km) and low-resolution (100–250 km) models with parameterized convection in HighResMIP shows that simply increasing model resolution does not noticeably improve the precipitation diurnal cycle. In contrast, CPMs can better capture the observed amplitude and timing of precipitation diurnal cycle. However, the simulated spatial variation of timing in CPMs is smaller than observed, leading to an exaggeration of the spatially averaged diurnal amplitude. The better-simulated precipitation diurnal cycle in the CPMs is tied to mesoscale convective systems (MCSs), which contribute about half of the total precipitation. The observed life cycle of MCSs, including initiation and mature stages, is well captured in the CPMs, leading to a more realistic precipitation diurnal cycle.

54 ENVIRONMENTAL SCIENCES↗

Persistent Sampling: Enhancing the Efficiency of Sequential Monte Carlo

Sequential Monte Carlo (SMC) samplers are powerful tools for Bayesian inference but suffer from high computational costs due to their reliance on large particle ensembles for accurate estimates. We introduce persistent sampling (PS), an extension of SMC that systematically retains and reuses particles from all prior iterations to construct a growing, weighted ensemble. By leveraging multiple importance sampling and resampling from a mixture of historical distributions, PS mitigates the need for excessively large particle counts, directly addressing key limitations of SMC such as particle impoverishment and mode collapse. Crucially, PS achieves this without additional likelihood evaluations-weights for persistent particles are computed using cached likelihood values. This framework not only yields more accurate posterior approximations but also produces marginal likelihood estimates with significantly lower variance, enhancing reliability in model comparison. Furthermore, the persistent ensemble enables efficient adaptation of transition kernels by leveraging a larger, decorrelated particle pool. Experiments on high-dimensional Gaussian mixtures, hierarchical models, and non-convex targets demonstrate that PS consistently outperforms standard SMC and related variants, including recycled and waste-free SMC, achieving substantial reductions in mean squared error for posterior expectations and evidence estimates, all at reduced computational cost. PS thus establishes itself as a robust, scalable, and efficient alternative for complex Bayesian inference tasks.

Karamanis, Minas↗