Search NASA⌕ Search

SEARCH · Search NASA

Results for “model bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

A More La Niña–Like Response to Radiative Forcing after Flux Adjustment in CESM2

Abstract In response to greenhouse gas forcing, most coupled global climate models project the tropical Pacific SST trend toward an “El Niño–like” state, with a reduced zonal SST gradient and a weakened Walker circulation. However, observations over the last five decades reveal a trend toward a more “La Niña–like” state with a strengthening zonal SST gradient. Recent research indicates that the identified trend differences are unlikely to be entirely due to internal variability and probably result, at least in part, from systematic model biases. In this study, Community Earth System Model, version 2 (CESM2), is used to explore how mean-state biases within the model may influence its forced response to radiative forcing in the tropical Pacific. The results show that using flux adjustment to reduce the mean-state bias in CESM2 over the tropical regions results in a more La Niña–like trend pattern in the tropical Pacific, with a strengthening of the tropical Pacific zonal SST gradient and a relatively enhanced Walker circulation, as hypothesized to occur if the ocean thermostat mechanism is stronger than the atmospheric mechanisms which by themselves would weaken the Walker circulation. We also find that the historical strengthening of the tropical Pacific zonal gradient is transient but persists into the near term in a high-emissions future warming scenario. These results suggest the potential of flux adjustment as a method for developing alternative projections that represent a wider range of possible future tropical Pacific warming scenarios, especially for a better understanding of regional patterns of climate risk in the near term.

Zhuo, Jing-Yi [Lamont-Doherty Earth Observatory, C↗
DOE OSTI2024

Droughts in Wind and Solar Power: Assessing Climate Model Simulations for a Net‐Zero Energy Future

Abstract Understanding and predicting “droughts” in wind and solar power availability can help the electric grid operator planning and operation toward deep renewable penetration. We assess climate models' ability to simulate these droughts at different horizontal resolutions, ∼100 and ∼25 km, over Western North America and Texas. We find that these power droughts are associated with the high/low pressure systems. The simulated wind and solar power variabilities and their corresponding droughts during historical periods are more sensitive to the model bias than to the model resolution. Future climate simulations reveal varied future change of these droughts across different regions. Although model resolution does not affect the simulation of historical droughts, it does impact the simulated future changes. This suggests that regional response to future warming can vary considerably in high‐ and low‐resolution models. These insights have important implications for adapting power system planning and operations to the changing climate.

Liu, Xue [Department of Oceanography Texas A&amp,M↗
DOE OSTI2026

Results of the second Ice Shelf–Ocean Model Intercomparison Project (ISOMIP+)

Ocean-driven basal melting of Antarctic ice shelves plays an important role in the mass loss of the Antarctic Ice Sheet. Ice shelf cavity-resolving ocean models are a valuable tool for understanding ice shelf-ocean interactions and for simulating projections of ice shelf and ocean states under future climate. Designed to assess the current state of ice shelf–ocean modelling, the second Ice Shelf–Ocean Model Intercomparison Project, ISOMIP+, consists of 12 ocean model configurations submitted with a common, idealised experimental setup. Here, we focus on the experiments Ocean0–2 (Asay-Davis et al., 2016), which are ocean models with idealised, static ice shelf geometries, but where the ocean reaches a balance with prescribed far-field ocean conditions. Different thermal transfer coefficient values (ranging from 0.011 to 0.2) are used for each model in the melting parameterisation to achieve a common, tuned melt rate since the models cover a range of types of vertical coordinates, ice–ocean boundary layer treatments, and numerical schemes. These model differences lead to spread in the resultant ocean properties, circulation, boundary-layer structure and spatial distribution of melting. We also highlight similarities between models, such as a shared linear relationship across most models between melt rate and overturning and barotropic streamfunctions during the spin-up and spin-down, demonstrating a robust relationship between melt and circulation across models and forcing conditions. The ISOMIP+ results provide a systematic comparison of ice shelf cavity-capable ocean models. However, we also demonstrate the need for realistic ice shelf–ocean model intercomparison projects (some already underway) to assess model biases and inter-model variation against sparse observations. Further research is needed to understand the differences between models and further improve our modelled representations of the ice–ocean boundary layer and ice shelf cavity circulation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Joint analysis of Dark Energy Survey Year 3 data and CMB lensing from SPT and P l a n c k . II. Cross-correlation measurements and cosmological constraints

Cross-correlations of galaxy positions and galaxy shears with maps of gravitational lensing of the cosmic microwave background (CMB) are sensitive to the distribution of large-scale structure in the Universe. Such cross-correlations are also expected to be immune to some of the systematic effects that complicate correlation measurements internal to galaxy surveys. We present measurements and modeling of the cross-correlations between galaxy positions and galaxy lensing measured in the first three years of data from the Dark Energy Survey with CMB lensing maps derived from a combination of data from the 2500 deg 2 SPT-SZ survey conducted with the South Pole Telescope and full-sky data from the Planck satellite. The CMB lensing maps used in this analysis have been constructed in a way that minimizes biases from the thermal Sunyaev Zel’dovich effect, making them well suited for cross-correlation studies. The total signal-to-noise of the cross-correlation measurements is 23.9 (25.7) when using a choice of angular scales optimized for a linear (nonlinear) galaxy bias model. Here we use the cross-correlation measurements to obtain constraints on cosmological parameters. For our fiducial galaxy sample, which consist of four bins of magnitude-selected galaxies, we find constraints of Ω m =0.272$^{+0.032}_{-0.052}$ and S 8 ≡σ8$\sqrt{Ω_m/0.3}$=0.736$^{+0.032}_{-0.028}$ (Ω m =0.245$^{+0.026}_{-0.044}$ and S 8 =0.734$^{+0.035}_{-0.028}$) when assuming linear (nonlinear) galaxy bias in our modeling. Considering only the cross-correlation of galaxy shear with CMB lensing, we find Ω m =0.270$^{+0.043}_{-0.061}$ and S 8 =0.740$^{+0.034}_{-0.029}$. Our constraints on S8 are consistent with recent cosmic shear measurements, but lower than the values preferred by primary CMB measurements from Planck.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Collaborative Research: Understanding air‐sea feedbacks to the MJO through process evaluation of observations and E3SM experiments (Final Technical Report)

This project explored the role of tropical oceans in regulating cloud populations within the Madden-Julian oscillation (MJO)–a large-scale tropical weather disturbance that influences extreme weather events across the globe by affecting the position of the jet stream and patterns of moisture transport. Our project sought to 1) document ocean feedback strength to the MJO in climate models, 2) understand how air-sea interactions affect the intensity, organization, and propagation of MJO convection, 3) utilize existing observations to identify sources of model bias for tropical air-sea interactions, and 4) better understand the effects of slow and fast ocean variability on MJO cloudiness. We found that transfers of heat and moisture across the air-sea interface (i.e., surface fluxes) in most climate models are over-supportive in maintaining MJO convection and under-supportive in propagating MJO convection. This can lead to misrepresentations in the frequency of extreme weather events across the globe through erroneous MJO feedbacks to jet stream position and moisture transport. Furthermore, using observations collected by ocean moorings across the tropical oceans, we showed that most models greatly overestimate surface evaporation in the subtropics, and that this bias is likely one contributor to a pervasive bias among climate models in their ability to simulate the mean state of rainfall over the tropical oceans (i.e., the “double ITCZ bias”). Replacing the default surface flux algorithm in two climate models with a state-of-the-art surface flux algorithm modestly reduced the double ITCZ bias in those models. Our work produced two model diagnostics packages that are now publicly available through DOE and NOAA model diagnostics archives. The first, the Analysis of Scales of Precipitation (ASoP) diagnoses scales of precipitation variability across space and time, with temporal resolution as fine as the model integration timestep. The second, the air-sea flux diagnostic diagnoses model surface fluxes and allows direct comparison of model fluxes to observations without having to recompute fluxes using model output and a state-of-the-art flux algorithm. These diagnostics, which were developed using climate models, can be readily applied to regional and global forecast model output to improve forecasts for the benefit of society.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Characterizing model uncertainties in simulated coast-to-offshore wind over the northeast U.S. using multi-platform measurements from the TCAP field campaign

Numerical weather prediction (NWP) models, such as the Weather Research and Forecasting (WRF) model, are widely used to provide estimates of the offshore wind energy resource owing to their large spatial coverage compared to available observations. Nevertheless, spatiotemporal distribution of model biases is highly dependent on factors including model configuration, location, and the interplay of multi-scale physical processes. Here, in this study, we focus on the characterization of model uncertainties in simulated coast-to-offshore winds over the northeast U.S., by varying sea surface temperature (SST) forcings, surface layer (SL) and planetary boundary layer (PBL) parameterizations, as well as identifying biases that may be directly passed from initial and boundary conditions. Multiple measurements, including aircraft data collected during the U.S. Department of Energy's Two-Column Aerosol Project (TCAP) experiment, are used to constrain the model results and facilitate quantitative comparisons. Our analysis indicates while SST forcing has notable impacts on simulated air temperature and moisture within PBL, the modeled winds are in general more sensitive to the choices of SL and PBL physics than to SST. The model’s forcing data not only controls the vertical dependence of wind speed errors, but also alters regional variability in wind speed’s spatial correlation. Bias comparisons between ERA5 reanalysis and ensemble simulations revealed significant similarity, particularly in wind speed biases during winter, underscoring their dependency on initial and boundary conditions. Coastal and offshore near-surface wind speed biases tend to exhibit much higher similarity in winter than in summer due to the presence of much stronger and more persistent synoptic wind conditions. This study highlights the importance of accurate atmospheric forcing and parameterization choices in improving wind forecasts and suggests the potential for extrapolating coastal wind biases to offshore locations, aiding wind energy forecasting and informing the Wind Forecast Improvement Project-3 (WFIP3).

17 WIND ENERGY↗
DOE OSTI2022

Suppressing simulation bias in multi-modal data using transfer learning

Abstract Many problems in science and engineering require making predictions based on few observations. To build a robust predictive model, these sparse data may need to be augmented with simulated data, especially when the design space is multi-dimensional. Simulations, however, often suffer from an inherent bias. Estimation of this bias may be poorly constrained not only because of data sparsity, but also because traditional predictive models fit only one type of observed outputs, such as scalars or images, instead of all available output data modalities, which might have been acquired and simulated at great cost. To break this limitation and open up the path for multi-modal calibration, we propose to combine a novel, transfer learning technique for suppressing the bias with recent developments in deep learning, which allow building predictive models with multi-modal outputs. First, we train an initial neural network model on simulated data to learn important correlations between different output modalities and between simulation inputs and outputs. Then, the model is partially retrained, or transfer learned, to fit the experiments; a method that has never been implemented in this type of architecture. Using fewer than 10 inertial confinement fusion experiments for training, transfer learning systematically improves the simulation predictions while a simple output calibration, which we design as a baseline, makes the predictions worse. We also offer extensive cross-validation with real and carefully designed synthetic data. The method described in this paper can be applied to a wide range of problems that require transferring knowledge from simulations to the domain of experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Collaborative Research: Advancing Arctic Climate Projection Capability at Seasonal to Decadal Scales (Final Technical Report)

The Regional Arctic System Model (RASM) at process resolving configurations has been used to (i) advance understanding of physical processes and feedbacks involved in Arctic amplification and (ii) understand and potentially reduce uncertainty in prediction of arctic climate change at seasonal to decadal scales. RASM consists the atmosphere (Weather and Research Forecasting model, WRF), ocean (Parallel Ocean Program, POP), sea ice (CICE), land hydrology (Variable Infiltration Capacity model, VIC), river routing scheme (RVIC), marine biogeochemistry components and the coupling framework (CPL7). Its domain is pan-Arctic, with the atmosphere and land components configured on a 50-km or 25-km grid and four configurations of the ocean and sea ice components: 1/12°(~9.3km) or 1/48°(~2.4km) and 45 or 60 vertical layers. These RASM configurations have been motivated by the emerging exascale capability for high performance computing to improve model fidelity. The dynamical downscaling of reanalysis allows comparison of RASM results with observations in place and time to: (i) advance system level understanding of physical processes and coupling involved in an event, (ii) optimize model parameter space, (iii) diagnose and reduce model biases and (iv) produce realistic and consistent across all the components initial conditions for predictions and predictability studies, which are all unique capabilities not available in global Earth System Models (ESMs). An evaluation of RASM 1.0 (Cassano et al. 2017) revealed that it had a cold bias over the oceans and a warm bias over land areas due largely to cloud and radiation biases in the model, with too little cloud cover simulated over land and too much cloud cover simulated over sub-polar oceans. This study has motivated an upgrade to WRF version 3.7.1 in RASM and allowed for the inclusion of the radiative impact of convective clouds. A variety of atmospheric physics parameterizations were evaluated against observations (e.g. data from the Arctic Clouds in Summer Experiment (ACSE); Sedlar et al. 2020) to identify an optimal suite of WRF physics options in RASM. The RASM with the optimized WRF physics were used to study the impact of strong mesoscale winds over the ocean around the southern tip of Greenland (DuVivier and Cassano 2016) and their impact on oceanic convection (DuVivier et al. 2017a). Data from the PolarWinds field campaign were used to evaluate WRF boundary layer physics and resolution impacts on the simulation of a Greenland barrier wind event (DuVivier et al. 2017b). The RVIC streamflow routing model has been implemented in RASM to realistically represent high-resolution streamflow processes (Hamman et al. 2017) and to couple the land buoyancy fluxes to the ocean. The RASM-RVIC high-resolution data set of all coastal freshwater fluxes for the Arctic drainage basin and surrounding areas for 1979-2014 was published as a separate product (https://doi.org/10.5281/zenodo.293037). The fidelity of atmospheric momentum transfer to and the response of polar marine Ekman layer in RASM and Community Earth System Model (CESM) was investigated by Roberts et al. (2015). The increased frequency of oceanic flux exchange in CESM, following the RASM guidance, caused a considerable increase in the median inertial ice speed across the Southern Ocean and parts of the Arctic. A comprehensive evaluation of the RASM1.0 atmosphere-ocean-sea ice-land interface was completed by Brunke et al. (2018). RASM was also demonstrated for its capability to simulate extreme events in agreement with observations in space and time (Lee et al. submitted). In particular, the development of three open water events, known as polynyas, have been simulated north of Greenland in February of 2011, 2017 and 2018, in agreement with satellite observations for the past four decades. The optimized RASM sea ice results have been favorably evaluated against satellite observations and a subset of eleven CMIP6 models (Watts et al. submitted). In a complementary project, Jin et al. (2018) have shown that RASM with higher-resolution and new sea-ice processes contributed to lower model errors in sea-ice conditions, concentrations of nutrients and ice algae, in comparison to results from the coarse-resolution (1°) CESM. In two other complementary studies, RASM results were used (i) to explain areas of concentrated use by bowhead whales, the seasonal progression in the use, and the physical environment within those areas (Citta et al. 2015) and (ii) for a synthesis of fall bowhead whales distribution and migration in the Bering-Chukchi-Beaufort (BCB) Sea to investigate whale movements and feeding to the local ocean hydrography and currents (Citta et al. 2018). However, the multi-decadal output from the CESM Large Ensemble yielded unrealistic forcing. Instead, the shorter NCEP CFSv2 9-month forecasts were successfully tested and afforded an increased ensemble size (~30) to demonstrate gains of dynamical downscaling at sub-seasonal to intra-annual time scales. The improved model physics and coupling among RASM model components have yielded more realistic representation of the sea ice cover and consistent across all model components initial conditions. Consequently, RASM demonstrates significant gains compared to simulation of sea ice in the NCEP reanalysis. In addition, RASM 6-month ensemble forecasts yield very realistic sea ice distribution, which demonstrates both significant gains of dynamical downscaling and the continued impact of the initial conditions on forecasts out to 6 months (https://nps.edu/web/rasm/predictions). A follow up study using RASM for dynamical downscaling of the more realistic CESM initialized Decadal Prediction Large Ensemble output is currently ongoing as part of the DOE RGMA HiLAT-RASM project.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

A database of hourly wind speed and modeled generation for US wind plants based on three meteorological models

Abstract In 2022, wind generation accounted for ~10% of total electricity generation in the United States. As wind energy accounts for a greater portion of total energy, understanding geographic and temporal variation in wind generation is key to many planning, operational, and research questions. However, in-situ observations of wind speed are expensive to make and rarely shared publicly. Meteorological models are commonly used to estimate wind speeds, but vary in quality and are often challenging to access and interpret. The Plant-Level US multi-model WIND and generation (PLUSWIND) data repository helps to address these challenges. PLUSWIND provides wind speeds and estimated generation on an hourly basis at almost all wind plants across the contiguous United States from 2018–2021. The repository contains wind speeds and generation based on three different meteorological models: ERA5, MERRA2, and HRRR. Data are publicly accessible in simple csv files. Modeled generation is compared to regional and plant records, which highlights model biases and errors and how they differ by model, across regions, and across time frames.

17 WIND ENERGY↗
DOE OSTI2020

Flux Balancing Control of Ungapped Nanocrystalline Core-Based Transformer in Dual Active Bridge Converters

Transformer flux dc bias is a critical issue, impacting the reliable operation of dual active bridge (DAB) converters especially when ungapped high permeability nanocrystalline core is used. Steady state current dc bias can easily saturate ungapped nanocrystalline transformers, and it is even more dangerous in transient conditions. A dc bias model is proposed to analyze steady state dc bias in different load conditions. The magnetizing current detection is necessary for closed-loop control of dc bias; conductors' position is shown to impact sensor noise, and it is analyzed in detail. To deal with both steady state and transient dc bias, a unified flux balancing control (UFBC) is proposed introducing a predictive bias suppression (PBS) method with closed-loop flux balancing control (CFBC). With the proposed PBS, both primary/secondary current balance and flux balance can be achieved within one switching cycle using UFBC. Power characteristics and interaction between power control and flux balancing control of DAB converters are analyzed, and the CFBC needs to work in a low bandwidth due to sensor bandwidth limitation and interaction between power control and flux balancing control. Lastly, the UFBC is verified on a 300-kW cascaded DAB converter prototype.

42 ENGINEERING↗
DOE OSTI2021

Random Close Packing as a Dynamical Phase Transition

Sphere packing is an ancient problem. The densest packing is known to be a face-centered cubic (FCC) crystal, with space-filling fraction Φ FCC = π / √ 18 ≈ 0.74 . The densest “random packing,” random close packing (RCP), is yet ill defined, although many experiments and simulations agree on a value Φ RCP ≈ 0.64 . We introduce a simple absorbing-state model, biased random organization (BRO), which exhibits a Manna class dynamical phase transition between absorbing and active states that has as its densest critical point Φ cmax ≈ 0.64 ≈ Φ RCP and, like other Manna class models, is hyperuniform at criticality. The configurations we obtain from BRO appear to be structurally identical to RCP configurations from other protocols. This leads us to conjecture that the highest-density absorbing state for an isotropic biased random organization model produces an ensemble of configurations that characterizes the state conventionally known as RCP.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Modeling neutrino-induced scale-dependent galaxy clustering for photometric galaxy surveys

Abstract The increasing statistical precision of photometric redshift surveys requires improved accuracy of theoretical predictions for large-scale structure observables to obtain unbiased cosmological constraints. In ΛCDM cosmologies, massive neutrinos stream freely at small cosmological scales, suppressing the small-scale power spectrum. In massive neutrino cosmologies, galaxy bias modeling needs to accurately relate the scale-dependent growth of the underlying matter field to observed galaxy clustering statistics. In this work, we implement a computationally efficient approximation of the neutrino-induced scale-dependent bias (NISDB). Through simulated likelihood analyses of Dark Energy Survey Year 3 (DESY3) and Legacy Survey of Space and Time Year 1 (LSSTY1) synthetic data that contain an appreciable NISDB, we examine the impact of linear galaxy bias and neutrino mass modeling choices on cosmological parameter inference. We find model misspecification of the NISDB approximation and neutrino mass models to decrease the constraining power of photometric galaxy surveys and cause parameter biases in the cosmological interpretation of future surveys. We quantify these biases and devise mitigation strategies.

Astronomy & Astrophysics↗
DOE OSTI2024

Estimating Uncertainty in Simulated ENSO Statistics

Abstract Large ensembles of model simulations are frequently used to reduce the impact of internal variability when evaluating climate models and assessing climate change induced trends. However, the optimal number of ensemble members required to distinguish model biases and climate change signals from internal variability varies across models and metrics. Here we analyze the mean, variance and skewness of precipitation and sea surface temperature in the eastern equatorial Pacific region often used to describe the El Niño–Southern Oscillation (ENSO), obtained from large ensembles of Coupled model intercomparison project phase 6 climate simulations. Leveraging established statistical theory, we develop and assess equations to estimate, a priori, the ensemble size or simulation length required to limit sampling‐based uncertainties in ENSO statistics to within a desired tolerance. Our results confirm that the uncertainty of these statistics decreases with the square root of the time series length and/or ensemble size. Moreover, we demonstrate that uncertainties of these statistics are generally comparable when computed using either pre‐industrial control or historical runs. This suggests that pre‐industrial runs can sometimes be used to estimate the expected uncertainty of statistics computed from an existing historical member or ensemble, and the number of simulation years (run duration and/or ensemble size) required to adequately characterize the statistic. This advance allows us to use existing simulations (e.g., control runs that are performed during model development) to design ensembles that can sufficiently limit diagnostic uncertainties arising from simulated internal variability. These results may well be applicable to variables and regions beyond ENSO.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Examining future changes in coastal low-level jet properties offshore California through dynamical downscaling

The coastal low-level jet, or coastal low-level jet (CLLJ), is a synoptically-forced meteorological feature frequently present offshore the western United States (U.S.). Characterized by a wind speed maximum that resides at the top of the marine boundary layer, the CLLJ is largely controlled by the location and strength of the North Pacific High (NPH) as well as the coastal geometry. Considering the rich wind resource available in this offshore region, the Bureau of Ocean Energy Management identified wind energy lease areas offshore California and supported the deployment of two U.S. Department of Energy wind lidar buoys near Morro Bay and Humboldt. Despite our relatively good understanding of the fundamental mechanisms responsible for large-scale CLLJ properties offshore the western U.S., future changes in CLLJ characteristics are less clear. To address this research challenge, and ultimately to better inform future wind turbine deployments, we use simulations driven by three global climate models (GCMs). We apply self-organizing maps to the model outputs for a historical and two future climate periods to show the range of NPH regimes that support CLLJ conditions during the warm seasons, as well as the subtle contribution from land-falling cyclones approaching the mainland during the cold seasons. Compared to the historical period, the three GCM-driven simulations agree that CLLJ conditions will become more (less) prevalent from central California northward (southward). They agree less with respect to future changes in maximum CLLJ wind speeds and CLLJ heights. However, after considering model biases present during the historical period, wind speeds between the models are actually more similar during the 2070–2095 period than during the historical period. The potential combination of more frequent CLLJ conditions characterized by relatively consistent wind speeds occurring at lower heights across northern California suggests that the Humboldt lease area may be ideal for a long-term wind turbine deployment.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

An underestimated negative cloud feedback from cloud lifetime changes

As the atmosphere warms, part of the cloud population shifts from ice and mixed phase (“cold”) to liquid (“warm”) clouds. Because warm clouds are more reflective and longerlived, this phase change reduces the solar flux absorbed by Earth and constitutes a negative radiative feedback. This cooling feedback is weaker in CMIP6 than in CMIP5, contributing to greater greenhouse warming. While this change is often attributed to improvements in simulated cloud phase, another model bias persists: warm clouds precipitate too readily, potentially leading to underestimated negative lifetime feedbacks. In this work, we modify a climate model to better simulate warm rain probability and find it exhibits a cloud lifetime feedback nearly three times larger than the default model. This suggests model errors in cloud-precipitation processes may bias cloud feedbacks as much as CMIP5–CMIP6 climate sensitivity differences. Reliable climate model projections therefore require improved cloud process realism guided by process-oriented observations and observational constraints.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

New framework for benchmarking decadal predictions leveraging the PCMDI Metric Package with interactive visualization

Reliable climate predictions across multiple timescales are increasingly critical as climate-related risks continue to rise. With the growing number and diversity of climate prediction systems, systematic intercomparison has become essential. Here, we present a comprehensive evaluation framework based on the PCMDI Metric Package to assess the performance of multiple decadal climate prediction systems. Unlike uninitialized simulations, initialized predictions exhibit bias and predictive skill that evolve with forecast lead time. To address this, we introduce (1) model-by-lead-time portrait plots, which efficiently summarize metrics of global temperature, precipitation, and Arctic/Antarctic sea-ice extent, and (2) an HTML-based interactive visualization platform that provides detailed regional and seasonal diagnostics of model bias, skill scores, and ensemble spread for each model and lead time. Comparisons with uninitialized simulations further quantify the relative impacts of initialization and external forcing on prediction skill. The proposed framework provides a scalable and transparent approach for multi-model climate prediction assessments and can be readily extended to a wide range of operational and research forecasting systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

When less is more: How increasing the complexity of machine learning strategies for geothermal energy assessments may not lead toward better estimates

Previous moderate- and high-temperature geothermal resource assessments of the western United States utilized data-driven methods and expert decisions to estimate resource favorability. Although expert decisions can add confidence to the modeling process by ensuring reasonable models are employed, expert decisions also introduce human and, thereby, model bias. This bias can present a source of error that reduces the predictive performance of the models and confidence in the resulting resource estimates. Our study aims to develop robust data-driven methods with the goals of reducing bias and improving predictive ability. We present and compare nine favorability maps for geothermal resources in the western United States using data from the U.S. Geological Survey's 2008 geothermal resource assessment. Two favorability maps are created using the expert decision-dependent methods from the 2008 assessment (i.e., weight-of-evidence and logistic regression). With the same data, we then create six different favorability maps using logistic regression (without underlying expert decisions), XGBoost, and support-vector machines paired with two training strategies. The training strategies are customized to address the inherent challenges of applying machine learning to the geothermal training data, which have no negative examples and severe class imbalance. We also create another favorability map using an artificial neural network. We demonstrate that modern machine learning approaches can improve upon systems built with expert decisions. We also find that XGBoost, a non-linear algorithm, produces greater agreement with the 2008 results than linear logistic regression without expert decisions, because the expert decisions in the 2008 assessment rendered the otherwise linear approaches non-linear despite the fact that the 2008 assessment used only linear methods. The F1 scores for all approaches appear low (F1 score < 0.10), do not improve with increasing model complexity, and, therefore, indicate the fundamental limitations of the input features (i.e., training data). Until improved feature data are incorporated into the assessment process, simple non-linear algorithms (e.g., XGBoost) perform equally well or better than more complex methods (e.g., artificial neural networks) and remain easier to interpret.

15 GEOTHERMAL ENERGY↗
DOE OSTI2022

Analysis of Integrated Vapor Transport Biases

Abstract High-fidelity analyses and forecasts of integrated vapor transport (VT) are central to the study of Earth’s hydrological cycle as well as high-impact phenomena such as monsoons and atmospheric rivers. The impact of the in-line analysis correction-based additive inflation (ACAI) on IVT biases and forecast errors is examined within the Navy Earth System Prediction Capability (Navy ESPC) global coupled system. The ACAI technique uses atmospheric analysis corrections from the data assimilation system to approximate model bias and as a representation of stochastic model error to simultaneously reduce systematic and random errors and improve ensemble performance. ACAI reduces the global average magnitude of the 7- and 14-day IVT bias by 16%–17% during Northern Hemisphere summer, reaching 70% reductions in some tropical regions. The global average IVT bias reduction is similar to the bias reduction for low-level wind speed bias and considerably smaller than the bias reduction in total precipitable water. The localized regions where ACAI increases IVT bias occur where the control IVT biases change sign and structure with increasing forecast lead time, such as the South Asian monsoon region. Substituting analyzed wind or moisture fields for the forecast fields when calculating the forecast IVT confirms that, on average, wind errors dominate the IVT error calculation in the tropics, although wind and moisture error contributions are comparable in the extratropics. The existence of regions where using either analyzed winds or analyzed moisture increases IVT bias or mean absolute error reveals areas with compensating errors.

Reynolds, Carolyn A.↗