Search NASA⌕ Search

SEARCH · Search NASA

Results for “model benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Assessment of Sodium Thermal Stratification Models Utilizing the TSTF Benchmark

As a result of certain transient scenarios, a thermally stratified layer of liquid sodium can develop in the bulk coolant volumes of a sodium-cooled fast reactor (SFR). In addition to the effects a stratification layer has on the temperature of the heat transport system, a stratification layer can also influence the transition to and establishment of natural circulation flow, which plays an important role in passive cooling and the inherent safety of a pool-type SFR. Therefore, the ability to accurately capture thermal stratification phenomena is important when demonstrating the safety basis of a pool-type SFR during transient sequences. The present work assesses various computational models with different fidelities in their ability to predict thermal stratification in the upper plenum of an SFR. Each computational model will be assessed using the data generated at the Thermal Stratification Test Facility (TSTF) located at the University of Wisconsin-Madison. Using measured flow rate and inlet temperature data, the measured temperature distributions of the tests are compared to the predictions of the lumped volume-based models in SAS4A/SASSYS-1, a 1D-based model in SAM, and a 3-D computational fluid dynamics (CFD) model using STAR-CCM+. The relative performance of the various computational methods is assessed with respect to key metrics such as bulk coolant temperature distribution and plenum exit temperature. A total of eight tests are analyzed, covering different combinations of flow rates (3 and 10 GPM) and upper internal structure (UIS) configurations (none, solid, porous, and open) The perfect mixing model of SAS4A/SASSYS-1 provides the highest accuracy when the flow rate is high and there is no UIS in the test vessel, as high flow rate injection promotes thermal mixing of the sodium in the test vessel. For most of the analyzed tests, the stratified volume model of SAS4A/SASSYS-1 is able to predict the delay in the outlet temperature drop and temperature distribution in the test vessel by a small number of layers to represent thermal stratification. However, the stratified volume model can only simulate a maximum of three temperature layers within a volume and when a layer approaches the elevation of the outlet, the predicted outlet temperature can demonstrate rapid, non-physical changes. The 1-D axial mixing model of SAM provides results that agree reasonably well with the measured data in the prediction of the temporal evolution of the outlet temperature with the exception of the case with a high flow rate and no UIS. The SAM 1-D model has a similar level of accuracy to CFD results when it comes to predicting the outlet temperature. CFD shows overall good agreement in predicting the temperature distribution in the test vessel and outlet temperature. As CFD can model the test vessel geometry in detail, it performs well in the cases of complex geometries such as tests that included a UIS and internal flow through the UIS resulting in active mixing of the coolant in the test vessel. Each of the models discussed in the present work has the potential to be useful during the various stages of reactor design, analysis, and licensing. The lumped-volume approach can be applied for fast turnaround safety calculations to obtain overall reactor behavior during transients. The 1-D models provide improved accuracy when stratification is expected for a relatively low increase in the computational cost. The CFD model can be utilized for confirmatory analysis of the 1-D model, when experimental measurements are not available.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Resolving femtosecond photoinduced energy flow: capture of nonadiabatic reaction pathway topography and wavepacket dynamics from photoexcitation through the conical intersection seam (Final Technical Report)

The dynamics that take place within just tens to hundreds of femtoseconds following the absorption of light by a molecule can play a critical role in how the absorbed energy is directed, allowing it to be used for a specific function or dissipated harmlessly. The form of chemical change that occurs rapidly in these molecules is called a “nonadiabatic electronic transition.” Such transitions are known to mediate energy flow in natural biological systems such as the ultraviolet photoprotection mechanism of DNA and the first step of the human vision response. Understanding how these mechanisms work precisely may help scientists achieve controlled manipulation of solar energy or optical control of a wide range of energy management functions in artificial systems. Experimental methods, however, have not yet allowed a precisely resolved and complete measurement of nonadiabatic electronic transitions. This constitutes a major obstacle to progress in the field. For progress to occur that would inform a wide body of research aiming to efficiently harness the energy of light for practical purposes, it is especially important to benchmark computational models of the molecules undergoing these rapid changes with experimental measurements, in order to learn which models are accurate. With Dept. of Energy funding, we have made strong progress towards establishing a new optical method for experimentally detecting the full nonadiabatic electronic transition. This requires having coordinated pulses of light covering the visible through the mid-infrared range of the electromagnetic spectrum that last only ten femtoseconds. We have developed a new, relatively simple approach for generating such pulses of laser light, and have incorporated them into a time-resolved spectrometer for measuring rapid changes in molecules. These tools can provide the greater precision and new types of data that are needed to benchmark computational models of molecular change and thus to make progress in the field. Our tools were tested on graphene, an excellent solid-state sample for verifying the capabilities and limitations of our instrumentation. The investment made in these tools by the Dept. of Energy Office of Science will allow new fundamental scientific understanding of energy dynamics in molecules in future studies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRSDate not supplied

FluxSat: Long-term Earth Science Data Record (ESDR) for Terrestrial Gross Primary Production (GPP) based on satellite data calibrated with eddy covariance data

Gross primary production (GPP), the amount of carbon dioxide (CO 2 ) assimilated by plants through photosynthesis, is one of the most variable and uncertain components of the global carbon cycle. Global GPP has been estimated with a number of process-based models, data-driven, and hybrid approaches. Dynamic global vegetation models (DGVMs), driven by observed environmental changes, are used for global carbon budget assessments and long-term (climate) prediction. Benchmarking these and other models globally with data-driven GPP estimates is critical for understanding the land sink and ensuring accurate forecasts of the carbon cycle. In addition, global data-driven GPP estimates are crucial for studies of interannual variability, including trends that are linked to mechanisms with large uncertainties, such as the indirect CO 2 fertilization effect related to greening. In response to a community need for a GPP data set that well captures spatio-temporal variability, we developed FluxSat, a data-driven approach that optimizes the use of satellite reflectance data from the NASA MODerate-resolution Imaging Spectroradiometer (MODIS) on the Terra and Aqua satellites, calibrated using ground-based eddy covariance (EC) data. We are enhancing (spatially, higher resolution) and extending FluxSat (in time, with additional sensors) to create a high quality long term GPP Earth System Data Record (ESDR) for use in model benchmarking, carbon cycle modeling, and studies of trends and interannual variability. Our team’s objectives are to: 1. Update and document the current MODIS FluxSat GPP (daily, 0.05o and 0.5o resolutions) products with latest available MODIS and EC data sets; 2. Extend FluxSat GPP record forward in time with the Visible Infrared Imaging Radiometer Suite (VIIRS) on operational weather satellites going forward; 3. Extend FluxSat GPP record backward in time using the Advanced Very High Resolution Radiometer (AVHRR) on weather satellites dating back to 1981; 4. Provide higher spatial resolution MODIS and VIIRS GPP (0.0083o). 5. Thoroughly evaluate all FluxSat products with independent data; and 6. Create a homogenized long-term GPP record spanning 40+ years. We will discuss plans for this long-term data set that is supported through the NASA Making Earth System Data Records for Use in Research Environments (MEaSUREs) program.

gross Primary Production↗
DOE OSTI2025

A Practical Probabilistic Benchmark for AI Weather Models

Since the weather is chaotic, it is necessary to forecast an ensemble of future states. Recently, multiple AI weather models have emerged claiming breakthroughs in deterministic skill. Unfortunately, it is hard to fairly compare ensembles of AI forecasts because variations in ensembling methodology become confounding and the baseline data volume is immense. We address this by scoring lagged initial condition ensembles—whereby an ensemble can be constructed from a library of deterministic hindcasts. This allows the first parameter‐free intercomparison of leading AI weather models' probabilistic skill against an operational baseline. Lagged ensembles of the two leading AI weather models, GraphCast and Pangu, perform similarly even though the former outperforms the latter in deterministic scoring. These results are elaborated upon by sensitivity tests showing that commonly used multiple time‐step loss functions damage ensemble calibration.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Machine learning framework for predicting uranium enrichments from M400 CZT gamma spectra

A machine learning framework was developed for predicting uranium enrichments from M400 CZT gamma spectra. This framework leverages the availability of a large amount of measured M400 gamma spectra and uses a recently updated version of Gamma Detector Response and Analysis Software (GADRAS) for gamma spectrum analysis and generation. It also leverages the existing machine learning modules in Python for gamma spectrum data processing, curation, model training, benchmarking, and optimization of the deep machine learning models. The framework is used to develop a deep learning model to analyze gamma spectra from a set of U 3 O 8 samples with enrichments ranging from 0.31 to 93.17% and UF 6 cylinders with enrichments ranging from 0.2 to 4.95%, and the model performance is tested using a set of measured spectra and the respective declared enrichment values. Results show that the model can correctly classify 99.35% of the U 3 O 8 sample enrichments, and can predict the samples’ enrichments within an average absolute error of 0.099% (in percentage points of enrichment). For the UF 6 cylinders, the average absolute error was approximately 0.03%, with an accuracy of 98% in classifying discrete enrichment values of UF 6 samples. Finally, the results also show that the model has performed significantly better in terms of predicting enrichments in UF 6 cylinders based on measured gamma spectra than the GEM code, with a standard deviation (of the relative errors) of 2.23% (compared with the 11.51% value for the GEM code) based on results from a set of test data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Advancing our understanding of instabilities in high-energy-density systems through the study of benchmark datasets with advanced modeling tools

Numerous types of pulsed power driven inertial confinement fusion (ICF) and high energy density (HED) systems rely on implosion stability to achieve desired temperatures, pressures, and densities. Sandia National Laboratories Pulsed Power Sciences Center’s main ICF platform, Magnetized Liner Inertial Fusion (MagLIF), suffers from implosion instabilities which limit attainable fuel conditions and can compromise fuel confinement. This Truman Fellowship research primarily focused on computationally exploring (a) methods for improving our understanding of hydrodynamic and magnetohydrodynamic instabilities that form during cylindrical liner implosions, (b) methods for mitigating implosion instabilities, particularly those that degrade performance of MagLIF targets, and (c) novel MagLIF target designs intended to improve target performance primarily via enhanced implosion stability. Several multi-dimensional computational tools were used, including the magnetohydrodynamics code ALEGRA, the radiation-magnetohydrodynamics code HYDRA, and the magnetohydrodynamics code KRAKEN. This research succeeded in executing and analyzing simulations of automagnetizing liner implosions, shockless MagLIF implosions, dynamic screw pinch driven cylindrical liner implosions, and cylindrically convergent HED instability studies. The methods and tools explored and developed in this Truman Fellowship research have been published in several peer-reviewed journal articles and will serve as useful contributions to the fields of pulsed power science and engineering, particularly pertaining to pulsed power ICF and HED science.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Net Load Forecasting With Disaggregated Behind-the-Meter PV Generation

As worldwide use of residential photovoltaic (PV) systems grows, system operators and utilities will need to transition from forecasting pure demand to forecasting net load with behind-the-meter (BTM) PV generation. However, PV generation can be difficult to predict and the measurements of PV generation from BTM residential systems are often invisible behind a measurement of the net load, making net load forecasting challenging. This paper proposes a novel two-stage framework for net load forecasting in areas with limited observability and high BTM PV generation. First, the profiles of observable customers are used to disaggregate the net load measurements into the pure load and PV generation. Then, separate models are used to forecast the PV generation and pure load individually, and the results are combined for a net load forecast. Further, this paper also proposes a compensator for correcting the error of the net load forecast, using historical forecast errors of the PV generation, pure load, and net load. The proposed framework is tested through two case studies for areas with high BTM PV penetration and less than 10% observable customers. The two-stage forecasting model is compared to two benchmark methods - a time series forecasting model, and a model that forecasts the net load directly using historical net load measurements. Results show that the proposed disaggregation-forecasting framework reduces the error of the net load forecast compared to both benchmark models. In addition, when the net load forecast error is periodic, the compensator can correct the error to improve the forecast accuracy.

14 SOLAR ENERGY↗
DOE OSTI2022

Updated Godiva-IV Benchmark Preview

A note of errata prepended to the Godiva-IV delayed-critical benchmark (HEU-MET-FAST- 086) identifies two corrections to be made to the model: The glory hole in the spindle should be made larger, and the height of the safety block should be made smaller (and therefore its density made larger). In addition, the safety block at its full-in position is closer to the inner subassembly plate than was modeled in the benchmark. These changes have been made to HEU-MET-FAST-086 Case 4 in order to estimate the effect on $\kappa$ eff and on the neutron flux spectrum. Using smaller separation, a smaller safety block, and a larger glory hole caused keff to increase by 453 ± 1 pcm from the benchmark. The latest nuclear data, ENDF/B-VIII.0, have also been used, causing $\kappa$ eff to increase another 37 ± 1 pcm. Flux spectra were compared in a modeled fission foil (near the center of Godiva-IV in the glory hole) and at three external (point) detectors. Within the fission foil, using ENDF/B-VIII.0 induced changes in the flux spectrum similar in size to the changes due to using smaller separation, a smaller safety block, and a larger glory hole. At the detectors, using ENDF/B- VIII.0 induced changes in the flux spectrum much larger than those due to changing the model. In other words, the corrections to the benchmark model cause a large increase in $\kappa$ eff , but the changes to the neutron flux spectrum are small compared to those caused by using the latest nuclear data. This study presents a preview of results expected during the reevaluation of the Godiva IV benchmark, but it is not a substitute for the full reevaluation.A note of errata prepended to the Godiva-IV delayed-critical benchmark (HEU-MET-FAST- 086) identifies two corrections to be made to the model: The glory hole in the spindle should be made larger, and the height of the safety block should be made smaller (and therefore its density made larger). In addition, the safety block at its full-in position is closer to the inner subassembly plate than was modeled in the benchmark. These changes have been made to HEU-MET-FAST-086 Case 4 in order to estimate the effect on $\kappa$ eff and on the neutron flux spectrum. Using smaller separation, a smaller safety block, and a larger glory hole caused $\kappa$ eff to increase by 453 ± 1 pcm from the benchmark. The latest nuclear data, ENDF/B-VIII.0, have also been used, causing $\kappa$ eff to increase another 37 ± 1 pcm. Flux spectra were compared in a modeled fission foil (near the center of Godiva-IV in the glory hole) and at three external (point) detectors. Within the fission foil, using ENDF/B-VIII.0 induced changes in the flux spectrum similar in size to the changes due to using smaller separation, a smaller safety block, and a larger glory hole. At the detectors, using ENDF/B- VIII.0 induced changes in the flux spectrum much larger than those due to changing the model. In other words, the corrections to the benchmark model cause a large increase in $\kappa$ eff , but the changes to the neutron flux spectrum are small compared to those caused by using the latest nuclear data. This study presents a preview of results expected during the reevaluation of the Godiva IV benchmark, but it is not a substitute for the full reevaluation.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Evaluating Climate Models’ Cloud Feedbacks Against Expert Judgment

Abstract The persistent and growing spread in effective climate sensitivity (ECS) across global climate models necessitates rigorous evaluation of their cloud feedbacks. Here we evaluate several cloud feedback components simulated in 19 climate models against benchmark values determined via an expert synthesis of observational, theoretical, and high‐resolution modeling studies. We find that models with smallest feedback errors relative to these benchmark values generally have moderate total cloud feedbacks (0.4–0.6 W m −2 K −1 ) and ECS (3–4 K). Those with largest errors generally have total cloud feedback and ECS values that are too large or too small. Models tend to achieve large positive total cloud feedbacks by having several cloud feedback components that are systematically biased high rather than by having a single anomalously large component, and vice versa. In general, better simulation of mean‐state cloud properties leads to stronger but not necessarily better cloud feedbacks. The Python code base provided herein could be applied to developmental versions of models to assess cloud feedbacks and cloud errors and place them in the context of other models and of expert judgment in real‐time during model development.

58 GEOSCIENCES↗
DOE OSTI2022

Evolution of shape and collectivity along the Ge isotopic chain: The case of 80 Ge

In this work, the shape and collectivity of 80 Ge were investigated via a sub-barrier-energy Coulomb excitation measurement using the JANUS setup at the NSCL ReA3 facility. The 80 Ge spectroscopic quadrupole moment $Q_{s}(2^{+}_{1})$ of the $2^{+}_{1}$ state was measured for the first time, and the precision of the 80 Ge $B(E2; 0^{+}_{1}$ → $2^{+}_{1}$) transition strength was increased. The experimental $Q_{s}(2^{+}_{1})$ value indicates a large, prolate deformation for 80 Ge, which is consistent with large-scale shell-model calculations performed for comparison. These results provide important benchmarks for models that try to describe nuclear shape in neutron-rich nuclei near the magic number N=50.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS1993

Assessment and development of second order turbulence models

Second order turbulence models describe the effect of mean flow and external agencies (such as buoyancy) on the evolution of turbulence. Therefore, in principle, these models give a more accurate description of complicated flow fields (e.g. flows with large anisotropy in turbulence, such as near the leading edge of a turbine blade) than the two equation models. The objectives of this document are to assess the performance of the various second order turbulence models in benchmark flows and to seek improvements where necessary in models for the pressure correlation term in the scalar flux equation and for the scalar dissipation equation.

Shabbir, Aamir↗
DOE OSTI2022

The SDSS-HET Survey of Kepler Eclipsing Binaries. A Sample of Four Benchmark Binaries

The purpose of this work is to extend a sample of accurately modeled, benchmark-grade eclipsing binaries (EBs) with accurately determined masses and radii. We select four "well-behaved" Kepler binaries, KIC 2306740, KIC 4076952, KIC 5193386 and KIC 5288543, each with at least eight double-lined spectra from the Apache Point Observatory Galactic Evolution Experiment instrument that is part of the Sloan Digital Sky Surveys III and IV, and from the Hobby–Eberly High Resolution Spectrograph. We obtain masses and radii with uncertainties of 2.5% or less for all four systems. Three of these systems have orbital periods longer than 9 days, and thus populate an undersampled region of the parameter space for extremely well-characterized detached EBs. We compare the derived masses and radii against MESA MIST isochrones to determine the ages of the systems. All systems were found to be coeval, showing that the results are consistent across MESA MIST and PHOEBE .

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

pH dependent reactivity of boehmite surfaces from first principles molecular dynamics

pH dependent interfacial chemistry depends upon the distribution and respective pKa values of different surface active sites. This is highly relevant to the chemistry of nanoparticle morphologies that expose faces with varying surface termination. Recent synthetic advances for nanoparticles of various minerals, including AlO(OH) (boehmite), present an excellent opportunity to compare and contrast predicted surface pKa on low Miller index planes so as to reinterpret reported interfacial properties (i.e., point of zero charge – PZC) and reactivity. This work employs ab initio molecular dynamics and empirical models to predict site-specific pKa values of accurate (benchmarked) surface models of boehmite. Using the different surface site populations, the PZC is determined and the influence this has upon reported interfacial chemistry is described.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗