Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model comparison”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Exploring gauge-fixing conditions with gradient-based optimization

Lattice gauge fixing is required to compute gauge-variant quantities, for example those used in RI-MOM renormalization schemes or as objects of comparison for model calculations. Recently, gauge-variant quantities have also been found to be more amenable to signal-to-noise optimization using contour deformations. These applications motivate systematic parameterization and exploration of gauge-fixing schemes. This work introduces a differentiable parameterization of gauge fixing which is broad enough to cover Landau gauge, Coulomb gauge, and maximal tree gauges. The adjoint state method allows gradient-based optimization to select gauge-fixing schemes that minimize an arbitrary target loss function.

Detmold, William↗

Probabilistic Inference of Low-Surface-Brightness Galaxy Morphological Parameters Using Simulation-Based Inference

Low-surface-brightness galaxies (LSBGs) are diffuse, often dark-matter-dominated systems whose faintness makes their structural parameters difficult to measure reliably in wide-field imaging surveys. Robust parameter inference, including uncertainty quantification, is important for population studies and for comparisons with models of galaxy formation, as future surveys are expected to produce increasingly large samples of diffuse galaxies. In practice, LSBG profile modeling is sensitive to sky- background errors, masking choices, contaminating background sources, and the computational cost of obtaining posterior-level uncertainties for large samples. Motivated by these questions, we develop a simulation-based inference (SBI) framework for estimating posterior distributions of LSBG morphological parameters from simulated galaxy images. Using PyImfit, we generate DES-like single-Sersic profile LSBG images with known position angle, ellipticity, Sersic index, effective surface brightness, and effective radius. We then train a normalizing-flow-based neural posterior estimator using the sbi package to infer these parameters from the simulated images. For isolated simulated galaxies, the SBI posterior recovers the true input parameters, produces posterior predictive residuals consistent with the assumed noise model, and shows good empirical calibration in a DES-motivated test regime. We also compare SBI with PyImfit-based MCMC inference and find broadly comparable posterior constraints, while SBI enables substantially faster posterior sampling after training. Finally, we test robustness to compact background contaminants. A model trained only on isolated galaxies produces undercovered posteriors on contaminated images, whereas training on simulations with variable contaminant positions and fluxes improves calibration across contaminated test sets. These results demonstrate the promise of SBI for scalable, uncertainty-aware LSBG morphology inference, while emphasizing that posterior reliability strongly depends on whether training simulations include relevant observational complications.

Batbayar, Bilguun [U. Chicago (main)]↗

Modeling receiver flux of commercial power tower concentrating solar power plants using ray tracing: a round-robin comparison of SolTrace, Solstice, and TieSOL

This study presents a multi-stage, cross-validation comparison of three software packages for Monte Carlo ray tracing (MCRT) applied to central tower concentrating solar power (CSP) systems. The three packages evaluated are: (1) SolTrace, an open-source tool developed by the National Renewable Energy Laboratory (NREL); (2) Solstice, an open-source program created by CNRS-PROMES and Meso-Star, with enhancements for CSP applications (called solsticepy) from the Australian National University; and (3) TieSOL, a commercial software developed by Tietronix. This investigation extends previous ray tracing comparisons by incorporating models of multi-facet heliostats within a commercial-scale solar field, taking into account zoned focal lengths and canting configurations. Receiver flux distributions were compared across the tools using a series of case studies, including single-heliostat scenarios, isolated blocking situations, and comprehensive full-field simulations. The case studies were designed to diagnose differences across the models at varying levels of complexity, and to identify and resolve discrepancies as additional parameters were introduced. Key factors examined in the analysis include sun positions, heliostat location, facet and canting focus, and aimpoint strategies. The comparison aims to improve the accuracy and reliability of these tools while providing benchmark cases for validating future optical modeling tools.

14 SOLAR ENERGY↗

Validation of a Hybrid Domain Overlapping Coupling Between SAM and CFD Against the TALL-3D Transients

The System Thermal Hydraulics (STH) code SAM has been coupled to the Computational Fluid Dynamics (CFD) code Simcenter STAR-CCM+ utilizing a hybrid domain overlapping method with an explicit coupling in time. The coupling aims to extend the STH code’s applicability to scenarios where local momentum and energy transfers are important yet difficult for STH codes to capture, such as three-dimensional (3D) mixing. The coupling method’s numerical stability was verified in the past against two closed-loop configurations, and it was validated against a double T-junction experiment with 3D scalar mixing. In the present work, the coupling method is validated against the TALL-3D STH/CFD coupling benchmark facility. TALL-3D is a three-legged, liquid-metal facility with a large, pool-type enclosure (test section) that exhibits 3D flow effects to be modeled by a CFD code. The rest of the system exhibits approximately 1D behavior well-predicted by an STH code. First, the present STAR-CCM+ CFD model of the 3D test section is validated against experimental data. Then, the SAM-STARCCM+ coupled model is validated against six different TALL-3D steady states, including SAM standalone model results for comparison. Lastly, the SAM-STARCCM+ coupled model is validated against two TALL-3D transients, one exhibiting flow reversal in the test section and one exhibiting nonlinear, Limit Cycle Oscillations (LCO). For the first transient, the SAM-STARCCM+ coupled model properly predicts an increase in the test section’s inlet temperature during flow reversal, and this is not predicted by the SAM standalone model. Following flow reversal, the SAM-STARCCM+ coupled model better-predicts the initial flow recovery and following oscillations as the system approaches a final natural circulation state. For the second transient, no true final steady state is observed due to LCO. Neither the SAM-STARCCM+ coupled model nor the SAM standalone model can perfectly capture the experiment’s changing oscillation frequency during the transient. However, the SAM-STARCCM+ coupled model does reproduce the oscillatory feedback observed in the system. This is a significant achievement as the SAM-STARCCM+ coupled model only uses an explicit coupling in time, as opposed to a semi-implicit coupling. In comparison, previous STH/CFD coupling efforts of the TALL-3D facility required semi-implicit coupling to obtain similar results.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Benchmarking State-of-the-Art Theory and Empirical Models of Pionless Neutrino-Argon Scattering in GENIE

Neutrino event generators require a delicate balance between theory and empirically-driven models to achieve reliable simulations. GENIE is the most commonly used generator, bridging theory and experiment in modern neutrino physics. Its flexible framework makes it ideal for comparing different models across all aspects of neutrino interactions—from the nuclear ground state and primary vertex to final-state interactions. Recently, GENIE has incorporated several state-of-the-art, theory-driven models, including spectral-function descriptions of the nuclear ground state, axial form factors from first-principles lattice QCD calculations, and the Liège intranuclear cascade model for simulating final-state interactions. Compared to the previous baseline models in GENIE—such as the local Fermi gas, dipole-like axial form factor, and hA final-state interaction model—the new implementations are more physically realistic and incorporate more complete physics, including nuclear de-excitation. This poster presents the implementation of new models in GENIE and their performance in comparisons among these models against recent MicroBooNE cross-section measurements.

Liu, Liang [Fermilab] (ORCID:000000026753925X)↗

Benchmarking State-of-the-Art Theory and Empirical Models of Pionless Neutrino-Argon Scattering in GENIE

Neutrino event generators require a delicate balance between theory and empirically-driven models to achieve reliable simulations. GENIE is the most commonly used generator, bridging theory and experiment in modern neutrino physics. Its flexible framework makes it ideal for comparing different models across all aspects of neutrino interactions—from the nuclear ground state and primary vertex to final-state interactions. Recently, GENIE has incorporated several state-of-the-art, theory-driven models, including spectral-function descriptions of the nuclear ground state, axial form factors from first-principles lattice QCD calculations, and the Liège intranuclear cascade model for simulating final-state interactions. Compared to the previous baseline models in GENIE—such as the local Fermi gas, dipole-like axial form factor, and hA final-state interaction model—the new implementations are more physically realistic and incorporate more complete physics, including nuclear de-excitation. This poster presents the implementation of new models in GENIE and their performance in comparisons among these models against recent MicroBooNE cross-section measurements.

Liu, Liang [Fermilab] (ORCID:000000026753925X)↗

Investigation of Benchmark $k$ eff Sensitivity and Uncertainty for 239 Pu fission in Specific Energy Ranges

Nuclear data at intermediate energies (from 1 to 100s of keV) are evaluated based on scarce differential data and theory unable to capture physics’ expected structure. There is also a lack of integral data. This is a known deficiency and is challenging to address. Calculated effective multiplication factor, k eff , values for intermediate energy experiments are ~25× further from experiment than for fast energies and are often well outside the experimental uncertainties. The goal of the PARADIGM (PARallel Approach of Differential and InteGral Measurements) project is to significantly re duce the uncertainties of intermediate energy nuclear data for 239 Pu. To this end, PARADIGM simultaneously optimizes experiments at both the Los Alamos Neutron Science Center (LANSCE) and National Criticality Experiments Research Center (NCERC). The combined set of data will inform new intermediate-energy nuclear data. By execution of differential and integral experiments, establishment of new theory, and undertaking nuclear data evaluation in parallel, the timeline to deliver improved nuclear data to users will be reduced significantly that is to three years. For the PARADIGM project, it was decided to optimize an integral experiment for two neutron energy ranges, within the full intermediate energy range. The low energy range goes from 1 to 30 keV, while the higher energy range goes from 30 to 600 keV. This work focuses on nuclear data sensitivities and uncertainties for 239 Pu fission for existing experiments in the International Criticality Safety Benchmark Evaluation Project (ICSBEP). When designing new experiments, it is important to understand what benchmarks currently exist. For a more traditional experiment design (in which a specific application model(s) exists), comparisons would be made between the application model(s) and existing benchmarks. For PARADIGM, there is no specific application model, but instead the specific nuclear data reaction and energy ranges of interest can be explored for existing benchmarks.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Inverse model based error detection in beamline optics

Optics tuning in transfer lines and LINACs can be challenging due to the fact that multiple combinations of machine settings can lead to the same diagnostic output. Moreover, the lack of a periodic solution can limit the ability to infer optics in the same way as rings from BPM signals. Model based approaches are often used to assist with the optics tuning in combination with optimization or parameter estimation. Here we have developed a novel approach using machine learning inverse models trained on a known configuration to detect variations in quadrupole settings without explicitly including them in the model. This paper shows a comparison of neural network models and linear models on both a simulation based study and experimental studies conducted at the AGS to RHIC transfer line at Brookhaven National Lab.

43 PARTICLE ACCELERATORS↗

Comparison of steady-state analytical wake models implemented in wind farm analysis software

A common set of mathematical wind turbine wake models are implemented in a few, well-adopted computational tools for wind farm wake modelling. Although the referenced mathematical formulations are common, implementation details may lead to differences in results. This study presents a systematic comparison of the implementation of mathematical wake models in open source, Python-based wind turbine wake modelling software, and a set of the models are directly compared. Despite aligning only the mathematical model parameters and retaining the default computational model parameters, good agreement is found across most of the model implementations, and additional agreement is expected upon further parameters alignment.

17 WIND ENERGY↗

Transfer Tube Material Properties Obtained from Test Data

A series of tension and compression tests were performed on typical transfer tubes made of 304L corrosion-resistant steel. The results were compiled and converted to true stress and true plastic strain for comparison to numerical models. The parameters of a Johnson-Cook constitutive model and fracture criterion were calibrated to mimic the test data. Comparisons were made between the converted data and the empirical formulas in the Johnson-Cook model. Simulations were performed to evaluate the implementation of the formula in finite element analysis, and the parameters were adjusted to improve the correlation.

36 MATERIALS SCIENCE↗

Comparison of ML-Based Proxy Modeling Strategies: Lessons Learned from the SMART Initiative

Teams of researchers on Task 5 of the SMART project have developed a variety of modeling architectures to predict subsurface behavior during carbon injection and post-injection periods. One important part of this task was to compare the candidate approaches in terms of accuracy, reliability, speed, and memory use, all using a common set of metrics and visualizations for an “apples to apples” comparison. Dr. Jared Schuetter will share the details of this task, the results that were obtained, and the lessons learned.

Schuetter, Jared↗

MESA Isochrones and Stellar Tracks (MIST). III. The White Dwarf Cooling Sequence

We present a substantial update to the MESA Isochrones and Stellar Tracks (MIST) library, extending the MIST model grids and isochrones down the white dwarf (WD) cooling sequence with realistic physics for WD cooling timescales. This work provides a large grid of MESA models for carbon–oxygen core WDs with hydrogen atmospheres (spectral type DA/DC), descended from full prior stellar evolution calculations. The model tracks, isochrones, and WD cooling timescale contours are available on the MIST project website and at doi:10.5281/zenodo.15242047. Our WD models provide a very large, publicly available grid with detailed physics for WD cooling timescales: realistic interior and envelope compositions, with element diffusion and heavy-element sedimentation, nuclear burning at the base of the WD hydrogen envelope, core crystallization, and C/O phase separation. As a large grid of open-source stellar evolution models, these WD models provide both out-of-the-box model tracks for comparison with observations and a framework for building further WD models to investigate variations in WD physics.

Astronomy and AstroPhysics↗

Intercomparison of Deep Learning Model Architectures for Atmospheric River Prediction

With a rapid surge in the application of machine learning (ML) for a diverse range of tasks in climate science, the present study addresses a challenge for climate scientists when selecting the optimal ML or deep learning (DL) architecture for a given application. In particular, a DL intercomparison study was performed with a focus on forecasting the position of atmospheric rivers (ARs) on short-range time scales (up to 5-day lead times). AR predictions from multiple DL architectures, including various types of convolutional autoencoders and a vision transformer (ViT), were compared against ECMWF ERA5 reanalysis and hindcasts from a global climate model. DL models with similar trainable parameters were trained on ERA5 reanalysis data and AR positions derived from a thresholding algorithm to ensure a fair comparison among the DL models. Each model’s performance and accuracy in forecasting AR location and key input fields within a 5-day window were assessed using metrics of root-mean-square error, anomaly correlation, and mean intersection over union. The ViT architecture outperformed other autoencoder models in most of the metrics. Incorporating additional meteorological fields only yielded slight improvements in forecasting certain fields at longer lead times. The results also suggest that a smaller number of input time steps or smaller number of autoregressive steps can achieve better prediction skills, while also improving the overall computational efficiency. This research offers valuable insights into the strengths and weaknesses of different DL techniques for AR forecasting, hopefully guiding the development of improved models for forecasting this phenomenon.

54 ENVIRONMENTAL SCIENCES↗

Constitutive model development of aluminum alloy 1100 for elevated temperature forming process

Commercially pure aluminum alloy, AA1100, presents good electrical and thermal conductivity, high formability, and low cost. Those favorable characteristics have the potential to enable bipolar plates with improved economics and enhanced performance compared to current stainless steel bipolar plates for proton exchange membrane fuel cells. An accurate constitutive model is essential to develop and optimize processing parameters and effectively control the forming process. Here, the objective of this work is to develop a constitutive model of AA1100 that is able to simulate stress-strain relation, formed geometry, and predict the onset of fracture strain to avoid forming failure. Initially, a set of tensile tests at temperature between 300 and 500°C and strain rate between 0.005 and 1.0/s were conducted to examine the deformation behavior. Then, a set of damage-based unified visco-plastic constitutive equations is proposed and calibrated based on the results of stress-strain data. A genetic algorithm optimization method is applied to search for best fitting material constants in constitutive equations. The proposed model shows good predictability of both the stress-strain relation and fracture strain at low strain rate and high temperature conditions. The accuracy of proposed model is also evaluated statistically. A comparison of the proposed model with three popular models (Arrhenius-type mode, Johnson-Cook model and Zerilli-Armstrong model) was made. The proposed model shows the best experimental agreement with correlation coefficient of 0.96 in contrast to 0.25, 0.38 and 0.75 for the popular models, respectively. The proposed model can help to optimize the elevated temperature forming process and guide die design to enable optimal geometric features in the formed components.

08 HYDROGEN↗

A model for trapping and re-solution regarding intra-granular bubbles in UO 2 , linked to atomic-scale simulations

In the literature, a clear definition of the irradiation re-solution frequency of gas from bubbles in the UO 2 fuel is absent. Moreover, for intra-granular bubbles, a detailed calculation of the cumulated displaced gas quantities in function of the distance from the radius of the bubble after a re-solution event has never been published. The assessment of these two elements is very useful if we want to increase the adherence of fission gas release codes to our present knowledge of the behavior of fission gases. Hence, we suggest to link the definition of the re-solution frequency to atomic-scale simulations. Furthermore, we present the cumulated displaced gas quantities obtained from Molecular Dynamics calculations, from which we have derived a re-solution profile that can be exploited to better consider the irradiation re-solution phenomenon inside Fission Gas Release codes. On top of that, we have built a new trapping/re-solution model for intra-granular bubbles linked to Molecular Dynamics simulations that can be easily incorporated into Fission Gas Release codes. In conclusion, we also check that the model is properly built through the comparison of the new model against a reference.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Development and assessment of hierarchical multi-reward reinforcement learning based potential for silicene with state-of-the-art models

We develop a new interatomic force field for Silicene, a 2D material with a buckled hexagonal lattice structure with high polymorphism. We introduce new parameterizations of a Tersoff model using a hierarchical multi-reward reinforcement learning (RL) methodology coupled with a continuous Monte Carlo Tree Search optimization. Our model significantly outperforms existing methods by enhancing the accuracy of predictions for the structural and thermodynamic properties of seven silicene polymorphs-including structure, energy, equation of state, elasticity, and phonon dispersion-when compared to established models. We further make a comprehensive comparison of the various models in predicting the mechanical and thermal properties of silicene. We trace the origin of the improved performance to the description of the angular dependence in the bond-order term, suggesting that modifying the angular terms in short-range models is essential to capture the structural diversity in low dimensional systems.

2D materials↗