Search NASA⌕ Search

SEARCH · Search NASA

Results for “model bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

A Vertically Resolved Canopy Improves Chemical Transport Model Predictions of Ozone Deposition to North Temperate Forests

Abstract Dry deposition is the second largest tropospheric ozone (O 3 ) sink and occurs through stomatal and nonstomatal pathways. Current O 3 uptake predictions are limited by the simplistic big‐leaf schemes commonly used in chemical transport models (CTMs) to parameterize deposition. Such schemes fail to reproduce observed O 3 fluxes over terrestrial ecosystems, highlighting the need for more realistic treatment of surface‐atmosphere exchange in CTMs. We address this need by linking a resolved canopy model (1D Multi‐Layer Canopy CHemistry and Exchange Model, MLC‐CHEM) to the GEOS‐Chem CTM and use this new framework to simulate O 3 fluxes over three north temperate forests. We compare results with in situ measurements from four field studies and with standalone, observationally constrained MLC‐CHEM runs to test current knowledge of O 3 deposition and its drivers. We show that GEOS‐Chem overpredicts observed O 3 fluxes across all four studies by up to 2×, whereas the resolved‐canopy models capture observed diel profiles of O 3 deposition and in‐canopy concentrations to within 10%. Relative humidity and solar irradiance are strong O 3 flux drivers over these forests, and uncertainties in those fields provide the largest remaining source of model deposition biases. Flux partitioning analysis shows that: (a) nonstomatal loss accounts for 60% of O 3 deposition on average; (b) in‐canopy chemistry makes only a small contribution to total O 3 fluxes; and (c) the CTM big‐leaf treatment overestimates O 3 ‐driven stomatal loss and plant phytotoxicity in these temperate forests by up to 7×. Results motivate the application of fully online vertically explicit canopy schemes in CTMs for improved O 3 predictions.

Vermeuel, Michael P. [Department of Soil, Water, a↗

Exploring cryo-electron microscopy with molecular dynamics

Single particle analysis cryo-electron microscopy (EM) and molecular dynamics (MD) have been complimentary methods since cryo-EM was first applied to the field of structural biology. The relationship started by biasing structural models to fit low-resolution cryo-EM maps of large macromolecular complexes not amenable to crystallization. The connection between cryo-EM and MD evolved as cryo-EM maps improved in resolution, allowing advanced sampling algorithms to simultaneously refine backbone and sidechains. Moving beyond a single static snapshot, modern inferencing approaches integrate cryo-EM and MD to generate structural ensembles from cryo-EM map data or directly from the particle images themselves. We summarize the recent history of MD innovations in the area of cryo-EM modeling. The merits for the myriad of MD based cryo-EM modeling methods are discussed, as well as, the discoveries that were made possible by the integration of molecular modeling with cryo-EM. Lastly, current challenges and potential opportunities are reviewed.

Biochemistry & Molecular Biology↗

Machine Learning Assisted HPC Workload Trace Generation for Leadership Scale Storage Systems

Monitoring and analyzing a wide range of I/O activities in an HPC cluster is important in maintaining mission-critical performance in a large-scale, multi-user, parallel storage system. Center-wide I/O traces can provide high-level information and fine-grained activities per application or per user running in the system. Studying such large-scale traces can provide helpful insights into the system. It can be used to develop predictive methods for making predictive decisions, adjusting scheduling policies, or providing decisions for the design of next-generation systems. However, sharing real-world I/O traces to expedite such research efforts leaves a few concerns; i) the cost of sharing the large traces is expensive due to this large size, and ii) privacy concern is an issue.We address such issues by building an end-to-end machine learn- ing (ML) workflow that can generate I/O traces for large-scale HPC applications. We leverage ML based feature selection and gener- ative models for I/O trace generation. The generative models are trained on I/O traces collected by the darshan I/O characterization tool over a period of one year. We present a two-step generation process consisting of two deep-learning models, called the feature generator and the trace generator. The combination of two-step generative models provides robustness by reducing the bias of the model and accounting for the stochastic nature of the I/O traces across different runs of an application. We evaluate the performance of the generative models and show that the two-step model can generate time-series I/O traces with less than 20% root mean square error.

Paul, Arnab↗

Assessment of the Pan-Arctic Accelerated Rate of Sea Ice Decline in CMIP6 Historical Simulations

Abstract Arctic sea ice loss in response to a warming climate is assessed in 42 models participating in phase 6 of the Coupled Model Intercomparison Project (CMIP6). Sea ice observations show a significant acceleration in the rate of decline commencing near the turn of the twenty-first century. It is our assertion that state-of-the-art climate models should qualitatively reflect this accelerated trend within the limitations of internal variability and observational uncertainty. Our analysis shows that individual CMIP6 simulations of sea ice depict a wide range of model spread on biases and anomaly trends both across models and among their ensemble members. While the CMIP6 multimodel mean captures the observed sea ice area (SIA) decline relatively well, an individual model’s ability to represent the acceleration in sea ice decline remains a challenge. Seventeen (40%) out of 42 CMIP6 models and 37 (13%) out of the total 286 ensemble members reasonably capture the observed trends and acceleration in SIA decline. In addition, a larger ensemble size appears to increase the odds for a model to include at least one ensemble member skillfully representing the accelerated SIA trends. Simulations of sea ice volume (SIV) show much larger spread and uncertainty than SIA; however, due to limited availability of sea ice thickness data, these are not as well constrained by observations. Finally, we find that models with more ocean heat transport simulate larger sea ice declines, which suggests an emergent constraint in CMIP6 ensembles. This relationship points to the need for better understanding and modeling of ice–ocean interactions, especially with respect to frazil ice growth.

54 ENVIRONMENTAL SCIENCES↗

Multigroup Examination of Nickel-Reflected HEU System

Critical configurations of HEU-MET-FAST-003 (HMF-003) from the International Criticality Safety Benchmark Evaluation Project Handbook were modeled for addition into the Verified, Archived Library of Inputs and Data maintained at Oak Ridge National Laboratory. HMF-003 contains models of a highly enriched uranium sphere with a spherical metal reflector of natural uranium, tungsten carbide, or nickel. For these simple models, good agreement is expected between the k eff calculated with continuous-energy (CE) and multigroup (MG) transport. However, using the CSAS5 sequence of the SCALE 6.2.4 package, the 8 in. thick nickel reflector model resulted in a difference of around 1.2 % Δ k . Results presented a clear indication of poor performance for the SCALE 252-group based on ENDF/B-VII.1 cross section library for this model. The bias was investigated over a range of nickel thickness and then compared with other MG libraries available in SCALE 6.2.4. As the nickel thickness increases, the MG k eff deviates from the CE result, confirming a performance issue with the MG calculation. Additionally, the reactions were compared between the two libraries to help determine the cause of k eff bias. Finally, additional MG libraries within SCALE 6.3 and based on ENDF/B-VII.1 and ENDF/B-VIII were reviewed. The 302-group and 1597-group result in significant improvements compared with the 252-group library. Nickel cross sections were modified from ENDF/B-VII.1 to ENDF/B-VIII. For the ENDF/B-VIII library, the deviation between the CE libraries and MG libraries is less pronounced than for ENDF/VII.1, except for the 1597-group. This examination clearly indicates the importance of validating calculations with applicable benchmark experiments and caution when using MG libraries.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Biomass burning aerosol radiative effects in the Southeast Atlantic depend strongly on meteorological forcing method

Biomass burning aerosols (BBAs) from African fires may strongly impact Earth’s radiation budget in the southeast Atlantic (SEA), but the sign and magnitude of the overall radiative effect (RE) remain uncertain. Aerosol–climate models are needed to separately quantify direct, indirect, and semi-direct REs. Here, we evaluate improved simulations with the UK Met Office's Unified Model and explore REs resulting from various methods used to match observed meteorology (nudging or running forecasts reinitialized at different frequencies). REs are calculated as differences in radiative fluxes between simulations with and without smoke emissions and with and without aerosol absorption. All model setups agree on net warming for the SEA dominated by the direct effect. Simulated smoke, clouds, and the direct effect agree better with observations than previous studies using the same model, though biases in aerosol extinction and liquid water path remain. Changes in cloud droplet number concentration due to BBA self-lofting influence how cleanly we can separate cloud effects into semi-direct and indirect effects. Total RE, which remains unaffected, ranges from +3.0 to +7.9 W m −2 . The 4.9 W m −2 spread arises mainly from simulated semi-direct effects. Forecasts three days long or less probably do not allow time for plausible differences in boundary layer properties due to semi-direct effects to accumulate. Free running simulations with and without smoke accumulate differences in meteorology that are likely spurious “butterfly effects”. We recommend future research quantifying BBA REs over weeks to months to use meteorological forcing techniques that allow aerosol absorption to affect the boundary layer.

Giuffrida, Eric [Carnegie Mellon University, Pitts↗

CONUS-wide Projected Flood Frequency and Uncertainty Estimates, Version 1.0

This dataset presents a large-ensemble of CONUS-wide projected flood frequency and uncertainty estimates across ~2.7 million NHDPlusV2 river reaches over the CONUS. The framework producing this dataset leverages a multi-model, uncertainty-aware modeling framework that allows evaluating shifts in flood frequences at the stream reach level across the CONUS. CONUS-wide ensemble streamflow projections generated from hydrologic simulations driven by downscaled and bias-corrected Coupled Model Intercomparison Project Phase 6 (CMIP6) outputs are used to derive these flood frequency and uncertainty estimates over the period 1980 - 2099. A spatially consistent regional L-moment algorithm is applied across clusters defined by the US Hydrologic Unit Code Subregions (HUC4s and HUC8s) and NHDPlusV2 stream orders to estimate flood frequencies. The dataset also includes at-site based flood estimates that allow for the comparison between local and regional approach-based estimates, assess projected changes, and characterize their uncertainties. For more reliable estimation of rare flood frequencies such as 500 and 1000-year return periods, super-ensemble based estimates are also included in the dataset. This dataset is derived to support the "Impact-Informed Dam Safety Risk Assessment for Securing Hydropower Assests" project for the US Department of Energy (DOE) Hydropower and Hydrokinetic Office (H2O). For further details, refer to Kao et al. (2022), Ghimire et al. (2023), Ghimire et al. (2025), and Hosking and Wallis (1997).

Ghimire, Ganesh [ORNL] (ORCID:0000000242843941)↗

Deep Learning Reconstruction of Daily Soil CO 2 Efflux Reveals Biogeochemical Insights and Reduces Annual Estimate Uncertainty Despite Limited Daily Predictability

Soil CO 2 efflux is commonly measured monthly or seasonally, leaving daily dynamics poorly resolved and contributing to global estimation uncertainty. We trained a single Long Short-Term Memory (LSTM) model to predict daily soil CO 2 efflux across 82 globally distributed sites in COSORE, with 0.2%–46.9% daily data coverage from 2003 to 2020. Despite using far fewer sites than are typically used to train a single deep learning model, with observations biased toward temperate mesic sites, the LSTM model performed well at approximately one-third of sites, reconstructed nearly 2 decades of daily efflux, and outperformed commonly used approaches for estimating daily efflux when applied to the same data set. Performance was weakest at pronounced peaks and troughs and at non-temperate sites with <1.5 years of observations and irregular data patterns. Nevertheless, annual efflux from reconstructed daily data had <40% error even at underperforming sites, substantially improving estimates derived from monthly and seasonal sampling (maximum errors of 95% and 136%, respectively). Temperature sensitivity (Q 10 ) estimated from reconstructed daily predictions closely matched estimates from daily observations, whereas Q 10 values derived from monthly or seasonal observations deviated substantially, suggesting that coarse temporal sampling may contribute to uncertainty in reported Q 10 values. Consistent daily reconstructions further enabled trend analyses for well-performing, predominantly temperate sites and showed increasing soil CO 2 efflux at most sites from 2003 to 2020, with more variable summer trends. Despite limitations, these results demonstrate the potential of LSTM models to reconstruct daily soil CO 2 efflux and reduce estimation uncertainties from sparse observations.

Smykalov, Valerie [Pennsylvania State University, ↗

Seasonal representation of extreme precipitation indices over the United States in CMIP6 present-day simulations

Realistically representing the present-day characteristics of extreme precipitation has been a challenge for global climate models, which is due in part to deficiencies in model resolution and physics, but is also due to a lack of consistency in gridded observations. In this study, we use three observation datasets, including gridded rain gauge and satellite data, to assess historical simulations from sixteen Coupled Model Intercomparison Project Phase 6 (CMIP6) models. We separately evaluate summer and winter precipitation over the United States (US) with a comprehensive set of extreme precipitation indices, including an assessment of precipitation frequency, intensity and spatial structure. The observations exhibit significant differences in their estimates of area-average intensity distributions and spatial patterns of the mean and extremes of precipitation over the US. In general, the CMIP6 multi-model mean performs better than most individual models at capturing daily precipitation distributions and extreme precipitation indices, particularly in comparison to gauge-based data. Also, the representation of the extreme precipitation indices by the CMIP6 models is better in the summer than winter. Although the ‘standard’ horizontal-resolution can vary significantly across CMIP6 models, from ~0.7° to ~2.8°, we find that resolution is not a good indicator of model performance. Overall, our results highlight common biases in CMIP6 models and demonstrate that no single model is consistently the most reliable across all indices.

54 ENVIRONMENTAL SCIENCES↗

Perspectives on the Calibration of CNN Energy Reconstruction in Highly Granular Calorimeters

We present a study which shows encouraging stability of the response linearity for a simulated high granularity calorimeter module reconstructed by a CNN model to miscalibration, bias, and noise effects. Our results also show an intuitive, quantifiable relationship between these factors and the calibration parameters. We trained a CNN model to reconstruct energy in the calorimeter module using simulated single-pion events; we then observed the response of the model under various miscalibration, bias, and noise conditions that affected the model input. From these data, we estimated linear response models to calibrate the CNN. We also quantified the relationship between these factors and the calibration parameters by regression analysis.

Akchurin, Nural↗

Convective Biases in the US DOE Global Storm‐Resolving Model: Insights From Regionally Refined Simulations During the CACTI Campaign

Accurately simulating convective processes in complex terrain remains a critical challenge for global storm-resolving models (GSRMs). This study systematically evaluates moist convective biases in the Regionally Refined Mesh configuration of the U.S. Department of Energy Simple Cloud-Resolving E3SM Atmosphere Model (RRM-SCREAM) using comprehensive observations and large-eddy simulations from the Cloud, Aerosol, and Complex Terrain Interactions (CACTI) campaign in the mountainous area of central Argentina. Comparisons of simulations with high-resolution observations and reanalysis data indicate that RRM-SCREAM effectively captures large-scale meteorological patterns, including regional atmospheric gradients and diurnal variability. However, RRM-SCREAM disproportionately produces smaller precipitation clusters referred to as “popcorn convection,” and exaggerated rainfall intensities compared to observations and reference models. Detailed examination of a representative orographic shallow-to-deep convective transition case shows that RRM-SCREAM delays initial shallow convection growth due to lower-tropospheric dryness and sustained convective inhibition, but once triggered, deep convection becomes overly vigorous with excessively strong vertical velocities and elevated cloud ice content, linked to a thermodynamic structure characterized by suppressed low-level moistening and excessive upper-level moisture retention. Our results highlight specific deficiencies in the model representation of convective vertical velocity, cloud microphysical processes, and convective precipitation organization within RRM-SCREAM. Addressing these biases is essential for improving the predictions of convective clouds and precipitation in the global high-resolution atmospheric models.

Su, Tianning [Lawrence Livermore National Laborato↗

Future Projections of the El Niño—Southern Oscillation and Tropical Pacific Mean State in CMIP6

Abstract The El Niño—Southern Oscillation (ENSO) is an important mode of tropical Pacific atmosphere‐ocean variability that drives teleconnections with weather and climate globally. However, prior studies using state‐of‐the‐art climate models lack consensus regarding future ENSO projections and are often impacted by tropical Pacific sea‐surface temperature (SST) biases. We used 173 simulations from 29 climate models participating in the Coupled Model Intercomparison Project, version 6 (CMIP6) to analyze model biases and future ENSO projections. We analyzed two ENSO indices, namely the ENSO Longitude Index (ELI), which measures zonal shifts in tropical Pacific deep convection and accounts for changes in background SST, and the Niño 3.4 index, which measures SST anomalies in the central‐eastern equatorial Pacific. We found that the warm eastern tropical‐subtropical Pacific SST bias typical of previous generations of climate models persists into many of the CMIP6 models. Future projections of ENSO shift toward more El Niño‐like conditions based on ELI in 48% of simulations and 55% of models, in association with a future weakening of the zonal equatorial Pacific SST gradient. On the other hand, none of the models project a significant shift toward La Niña‐like conditions. The standard deviation of the Niño 3.4 index indicates a lack of consensus on whether an increase or decrease in ENSO variability is expected in the future. Finally, we found a possible relationship between historical SST and low‐level cloud cover biases in the ENSO region and future changes in ELI; however, this result may be impacted by limitations in data availability.

54 ENVIRONMENTAL SCIENCES↗

Projected Future Changes in Tropical Cyclones Using the CMIP6 HighResMIP Multimodel Ensemble

Future changes in tropical cyclone properties are an important component of climate change impacts and risk for many tropical and midlatitude countries. In this study we assess the performance of a multimodel ensemble of climate models, at resolutions ranging from 250 to 25 km. We use a common experimental design including both atmosphere-only and coupled simulations run over the period 1950–2050, with two tracking algorithms applied uniformly across the models. There are overall improvements in tropical cyclone frequency, spatial distribution, and intensity in models at 25 km resolution, with several of them able to represent very intense storms. Projected tropical cyclone activity by 2050 generally declines in the South Indian Ocean, while changes in other ocean basins are more uncertain and sensitive to both tracking algorithm and imposed forcings. Coupled models with smaller biases suggest a slight increase in average TC 10 m wind speeds by 2050.

54 ENVIRONMENTAL SCIENCES↗

Challenges of standard halo models in constraining galaxy properties from cosmic infrared background anisotropies

The halo model, combined with halo occupation distribution (HOD) prescriptions, is widely used to interpret cosmic infrared background (CIB) anisotropies and extract physical information about star-forming galaxies and their connection to large-scale structures. Recent CIB-specific implementations of the halo model have adopted more physical parameterizations. However, the extent to which these models can reliably recover meaningful physical parameters remains uncertain. We assessed whether the current parameterization of CIB halo models is sufficient to recover astrophysical quantities, such as star formation efficiency, η(M h , z), and halo mass at which the peak of star formation efficiency occurs, M max , when fit to mock data. We also assessed whether discrepancies arise from assumptions about galaxy emission (the HOD ingredients) or from more fundamental components in the halo model, such as bias and matter clustering. We fit the M21 CIB HOD model, implemented within the halo model framework, to mock CIB power spectra and star formation rate density (SFRD) data generated from the SIDES-Uchuu simulation, and compared the best-fit parameters to the known simulation inputs. We then repeated the analysis using a simplified version of the simulation (SSU), explicitly designed to match the HOD assumptions. A detailed comparison of model and simulation outputs was carried out to trace the origin of observed discrepancies. While the M21 HOD model provides a good fit to the mock data, it failed to recover the intrinsic parameters accurately, particularly the halo mass at which star formation efficiency peaks. This mismatch persists even when fitting data generated with the same model assumptions. We find strong agreement (within 5%) in the emission-related components (SFRD, emissivity), but observe a scale- and redshift-dependent offset exceeding 20% in the two-halo term of the CIB power spectrum. This likely arises from limitations in the treatment of halo bias and matter clustering within the linear approximation. Additionally, incorporating scatter in the SFR–halo mass relation and the spectral energy distribution (SED) templates significantly affects the shot noise (∼50%), but has only a modest impact (less than 10%) on the clustered component. These results suggest that recovering physical parameters from CIB clustering requires improvements to the cosmological ingredients of the halo model framework, such as adopting scale-dependent halo bias and nonlinear matter power spectra in addition to careful modeling of emission physics.

cosmic background radiation↗

AIF for Vis (Active Inference for simulating human interpretation of data visualization) [SWR-26-084]

AIF for Vis contains the Active Inference models and analysis scripts used to study a simple visualization-interpretation task: estimating the average value of two bars in a bar chart. The work is a proof of concept for translating hypothesized cognitive strategies into executable, inspectable process models. We implement two idealized strategies inspired by dual-process accounts of visualization-aided decision making: *Fast model: a compressed, heuristic strategy that estimates the visual midpoint of the two bars and maintains a single belief over their average. *Slow model: a sequential, analytic strategy that estimates the two bar heights separately and maintains them in working memory before computing an average. Both models use a common Active-Inference-inspired framework for sequential perception, belief updating, action selection, and reporting. Their different internal representations produce distinct predicted vulnerabilities: *the Fast model is more susceptible to tick-salience bias; *the Slow model is more susceptible to working-memory decay. The repository includes the model implementations, scripts used for the experiments reported in the paper, precomputed trial-level results, and plotting scripts.

Goldwyn, Harrison [National Laboratory of the Rock↗

Improved Understanding of Coupled Water and Carbon Cycle Processes through Machine Learning Approaches

Focal Area(s): This white paper addresses how explainable machine learning (ML) algorithms can improve insights gained from complex data (Focal Area 3). We will also address how ML approaches related to sensor compression and low energy AI hardware can be used for efficient data acquisition (Focal Area 1). Science Challenge: We will focus on the coupled water cycle and carbon cycle processes in terrestrial ecosystems and terrestrial-aquatic interfaces. Thus, our approaches will be centered around several data-model integration challenges indicated in EESD strategic plans for two science focus areas: Terrestrial Ecosystem Science and Hydrobiogeochemistry. We can use AI to correct systematic model errors due to biases in either data or model structure/processes. Error patterns in model predictions usually vary by region, model, season etc. But there are systematic patterns in them. e.g., soil moisture tends to be overestimated in the arid western continental United States underestimated in wetter eastern USA; some land surface models tend to underestimate moisture in wet seasons and overestimate in dry seasons. Moreover, the consequences of extreme events (e.g., drought, extreme flooding, storm surges associated with tropical storms, hurricanes) on carbon cycle processes are not well represented in ecosystem and Earth system models. Redox-sensitive processes (e.g., rapid oxidation/reduction of iron and other redox-sensitive elements in soil microsites subjected to fluctuated hydrology) in terrestrial-aquatic interfaces further challenge model predictions of hot-spots (and hot-moments) due to poor understanding of underlying mechanisms. Thus, AI/ML approaches can be used to learn patterns in the data and model errors and use them to build model equations and correct process-based model errors.

54 ENVIRONMENTAL SCIENCES↗