Search NASA⌕ Search

SEARCH · Search NASA

Results for “model bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Evaluating Precipitation Features and Rainfall Characteristics in a Multi‐Scale Modeling Framework

Cloud and precipitation systems are simulated with a multi‐scale modeling framework (MMF) and compared over the Tropics and Subtropics against the Tropical Rainfall Measuring Mission (TRMM) Radar‐defined Precipitation Features (RPFs) product. A methodology, in close analogy to the TRMM RPFs, is developed to produce simulated precipitation features (PFs) from the output of the embedded two‐dimensional (2D) cloud‐resolving models (CRMs) within an MMF. Despite the limitations of 2D CRMs, the simulated population distribution, horizontal and vertical structure of PFs, and the geographical location and local rainfall contribution of mesoscale convective systems (MCSs) are in good agreement with the TRMM observations. However, some model discrepancies are found and can be identified and quantified within the PF distributions. Using model biases in relative population and rainfall contributions, PFs can be characterized into four size categories: small, medium to large, very large, and extremely large. Four different major mechanisms might account for the model biases in each different category: (1) the two‐dimensionality of the CRMs, (2) a positive convection‐wind‐evaporation feedback loop, (3) an artificial dynamic constraint in a bounded CRM domain with cyclic boundaries, and (4) the limited CRM domain size. The second and fourth mechanisms tend to contribute to the excessive tropical precipitation biases commonly found in most MMFs, whereas the other mechanisms reduce rainfall contributions from small and very large PFs. MMF sensitivity experiments with various CRM domain sizes and grid spacings showed that larger domains (higher resolutions) tend to shift PF populations toward larger (smaller) sizes.

Jiun-Dar Chern↗

Tropical Cyclones in the GEOS-S2S-2 Subseasonal Forecasts

This paper analyzes the climatology, prediction skill, and predictability of tropical cyclones (TCs) in NASA’s Global Earth Observing System Subseasonal to Seasonal (GEOS-S2S) forecast system version 2. GEOS reasonably simulates the number and spatial distribution of TCs compared to observations except in the Atlantic where the model simulates too few TCs due to low genesis rates in the Caribbean Sea and Gulf of Mexico. The environmental conditions, diagnosed through a genesis potential index, do not clearly explain model biases in the genesis rates, especially in the Atlantic. At the storm-scale, GEOS reforecasts replicate several key aspects of the thermodynamic and dynamic structure of observed TCs, such as a warm core and the secondary circulation. The model, however, fails to simulate an off-center eyewall when evaluating vertical velocity, precipitation and moisture. The analysis of prediction skill of TC genesis and occurrence shows that GEOS has comparable skill to other global models in WMO S2S archive and that its skill could be further improved by increasing the ensemble size. After calibration, GEOS forecasts are skillful in the Western North Pacific and Southern Indian Ocean up to 20 days in advance. A model-based predictability analysis demonstrates the importance of the Madden-Julian Oscillation (MJO) as a source of predictability of TC occurrence beyond the 14 day lead-time. Forecasts initialized under strong MJO conditions show evidence of predictability beyond week 3. However, due to model biases in the forecast distribution there are notable gaps between MJO-related prediction skill and predictability which require further study.

Jorge L. Garcia-Franco↗

Modeling the smoky troposphere of the southeast Atlantic: a comparison to ORACLES airborne observations from September of 2016

The southeast Atlantic is home to well-defined smoke outflow from Africa coinciding vertically with extensive marine boundary-layer cloud decks, both reaching their climatological maxima in spatial extent around September. A framework is put forth for evaluating the performance of a range of global and regional aerosol models against observations made during the NASA ORACLES (ObseRvations of Aerosols above CLouds and their intEractionS) airborne mission in September 2016. The sparse airborne observations are first aggregated into 2o grid boxes and into three vertical layers: the cloud-topped marine boundary layer (MBL), the layer from cloud top to 3 km, and the 3-6 km layer. Aerosol extensive properties simulated for the entire study region for all September suggest that the 2016 ORACLES observations are reasonably representative of the regional monthly average, with systematic deviations of 30% or less. All six models typically place the bottom of the smoke layer at lower altitudes than do the airborne lidar observations by 300-1400 m, whereas model aerosol top heights are within 0-500 m of the observations. All but one of the models that report carbonaceous aerosol masses underestimate the ratio of particulate extinction to the masses, a proxy for mass extinction efficiency, in 3-6 km. Notable findings on individual models include that WRF-CAM5 predicts the mass of black carbon and organic aerosols with minor (~10% or less) biases. GEOS-5 overestimates the carbonaceous particle masses in the MBL by a factor of 3-6. Extinction coefficients in the free troposphere (FT) and above-cloud aerosol optical depth (ACAOD) are 10-30% lower in WRF-CAM5, 30-50% lower in GEOS-5, 10-40% higher in GEOS-Chem, 10-20% higher in EAM-E3SM except for the practically unbiased 3-6 km extinction, and 20-70% lower in the Unified Model, than the airborne in situ, lidar and sunphotometer measurements. ALADIN-Climate also underestimates the ACAOD, by 30%. GEOS-5 and GEOS-Chem predict carbon monoxide in the MBL with small (10% or less) negative biases, despite their overestimates of carbonaceous aerosol masses. Overall, this study highlights a new approach to utilizing airborne aerosol measurements for model diagnosis.

Shinozuka, Yohei↗

Evaluating the Impact of Chemical Complexity and Horizontal Resolution on Tropospheric Ozone Over the Conterminous US With a Global Variable Resolution Chemistry Model

A new configuration of the Community Earth System Model (CESM)/Community Atmosphere Model with full chemistry (CAM-chem) supporting the capability of horizontal mesh refinement through the use of the spectral element (SE) dynamical core is developed and called CESM/CAM-chem-SE. Horizontal mesh refinement in CESM/CAM-chem-SE is unique and novel in that pollutants such as ozone are accurately represented at human exposure relevant scales while also directly including global feedbacks. CESM/CAM-chem-SE with mesh refinement down to ∼14 km over the conterminous US (CONUS) is the beginning of the Multi-Scale Infrastructure for Chemistry and Aerosols (MUSICAv0). Here MUSICAv0 is evaluated and used to better understand how horizontal resolution and chemical complexity impact ozone and ozone precursors over CONUS as compared to measurements from five aircraft campaigns, which occurred in 2013. This field campaign analysis demonstrates the importance of using finer horizontal resolution to accurately simulate ozone precursors such as nitrogen oxides and carbon monoxide. In general, the impact of using more complex chemistry on ozone and other oxidation products is more pronounced when using finer horizontal resolution where a larger number of chemical regimes are resolved. Large model biases for ozone near the surface remain in the Southeast US as compared to the aircraft observations even with updated chemistry and finer horizontal resolution. This suggests a need for adding the capability of replacing sections of global emission inventories with regional inventories, increasing the vertical resolution in the planetary boundary layer, and reducing model biases in meteorological variables such as temperature and clouds.

MUSICA↗

Reanalyses and Essential Climate Variables

Reanalyses are a potentially powerful climate data collection driven by observations but also subjected to model bias. Additionally, reanalyses can produce and use essential climate variables in a consistent method. For example, snow cover and soil moisture (among other variables) will eventually be assimilated into the reanalyses, but also provide crucial validation data. Sea surface temperature can be prescribed or assimilated in a coupled reanalysis. The strength of reanalysis lies in the ancillary data that is produced from the modeling components but not routinely observed thereby providing more complete Earth system information. The weakness in this concept is that the model derived data can be affected by model bias and may also change relative to the available observing system. Here, we will review the status of existing reanalyses and the ECVs being considered for the workshop. Purpose of Michael Bosilovich's contribution to the workshop: Michael Bosilovich will represent US reanalysis community in this international discussion of Essential Climate Variables (ECVs) and the relative nature of reanalyses to ECVs.

Bosilovich, Michael↗

Multi-Scale Three-Dimensional Variational Data Assimilation System for Coastal Ocean Prediction

A multi-scale three-dimensional variational data assimilation system (MS-3DVAR) has been formulated and the associated software system has been developed for improving high-resolution coastal ocean prediction. This system helps improve coastal ocean prediction skill, and has been used in support of operational coastal ocean forecasting systems and field experiments. The system has been developed to improve the capability of data assimilation for assimilating, simultaneously and effectively, sparse vertical profiles and high-resolution remote sensing surface measurements into coastal ocean models, as well as constraining model biases. In this system, the cost function is decomposed into two separate units for the large- and small-scale components, respectively. As such, data assimilation is implemented sequentially from large to small scales, the background error covariance is constructed to be scale-dependent, and a scale-dependent dynamic balance is incorporated. This scheme then allows effective constraining large scales and model bias through assimilating sparse vertical profiles, and small scales through assimilating high-resolution surface measurements. This MS-3DVAR enhances the capability of the traditional 3DVAR for assimilating highly heterogeneously distributed observations, such as along-track satellite altimetry data, and particularly maximizing the extraction of information from limited numbers of vertical profile observations.

Li, Zhijin↗

Explaining Globally Inhomogeneous Future Changes in Monsoons Using Simple Moist Energy Diagnostics

Here, this study examines the annual cycle of monsoon precipitation simulated by models from phase 6 of the Coupled Model Intercomparison Project (CMIP6), then uses moist energy diagnostics to explain globally inhomogeneous projected future changes. Rainy season characteristics are quantified using a consistent method across the globe. Model bias is shown to include rainy season onsets tens of days later than observed in some monsoon regions (India, Australia, and North America) and overly large summer precipitation in others (North America, South America, and southern Africa). Projected next-century changes include rainy season lengthening in the two largest Northern Hemisphere monsoon regions (South Asia and central Sahel) and shortening in the two largest Southern Hemisphere regions (South America and southern Africa). Changes in the North American and Australian monsoons are less coherent across models. To understand these changes, relative moist static energy (MSE) is defined as the difference between local and tropical-mean surface air MSE. Future changes in relative MSE in each region correlate well with onset and demise date changes. Furthermore, Southern Hemisphere regions projected to undergo rainy season shortening are spanned by an increasing equator-to-pole MSE gradient, suggesting their rainfall will be increasingly inhibited by fluxes of dry extratropical air; Northern Hemisphere regions with projected lengthening of rainy seasons undergo little change in equator-to-pole MSE gradient. Thus, although model biases raise questions as to the reliability of some projections, these results suggest that globally inhomogeneous future changes in monsoon timing may be understood through simple measures of surface air MSE.

54 ENVIRONMENTAL SCIENCES↗

Diagnosing Bias in Modeled Soil Moisture/runoff Coefficient Correlation Using the SMAP Level 4 Soil Moisture Product

The physical parameterization of key processes in land surface models (LSMs) remains uncertain, and new techniques are required to evaluate LSM accuracy over coarse spatial scales. Given the role of soil moisture in the partitioning of surface water fluxes (between infiltration, runoff and evapotranspiration), surface soil moisture (SSM) estimates represent an important observational benchmark for such evaluations. Here, we apply SSM estimates from the NASA Soil Moisture Active Passive Level 4 product (SMAP_L4) to diagnose bias in the coupling between SSM and surface runoff for multiple Noah-Multiple Physics (Noah-MP) LSM parameterization cases. Results demonstrate that Noah-MP surface runoff parameterizations often underestimate the coupling strength between pre-storm SSM and the event-scale runoff coefficient (RC; defined as the ratio between event-scale streamflow and precipitation volumes). This bias squanders RC information contained in pre-storm SSM and reduces RC estimation skill. Such bias can be quantified against an observational benchmark calculated using streamflow observations and SMAP_L4 SSM and applied to explain a substantial fraction of the observed basin-to-basin (and case-to-case) variability in the skill of event-scale Noah-MP RC estimates. Based on this concept, a novel case selection strategy for ungauged basins is introduced and demonstrated to successfully identify poorly performing Noah-MP parameterization cases.

SSM↗

Convective Momentum Transport and Its Impact on the Madden‐Julian Oscillation in E3SM‐MMF

Abstract Convective momentum transport (CMT) is the process of vertical redistribution of horizontal momentum by small‐scale turbulent flows from moist convection. Traditional general circulation models (GCMs) and their multiscale modeling framework (MMF) versions poorly represent CMT due to insufficient information of subgrid‐scale flows at each GCM grid. Here the explicit scalar momentum transport (ESMT) scheme for representing CMT is implemented in the Energy Exascale Earth System Model‐Multiscale Modeling Framework (E3SM‐MMF) with embedded 2‐D cloud‐resolving models (CRMs), and verified against E3SM‐MMF simulations with 3‐D CRMs and observations. The results show that representing CMT by ESMT helps reduce climatological mean precipitation model bias over the western Pacific and the ITCZ regions, which is attributed to the weakened mean easterlies over the Pacific. Also, CMT from simulations with 2‐D and 3‐D CRMs impose a similar impact on Kelvin waves by reducing their variability and slowing down their phase speed, but opposite impacts on the Madden‐Julian Oscillation (MJO) variability. The ESMT scheme readily captures the climatological mean spatial patterns of the zonal and meridional components of CMT and their variability across multiple time scales, but shows some differences in estimating its magnitude. CMT mainly affects the MJO by decelerating its winds in the free troposphere, but accelerates its near‐surface winds. This study serves as a prototype for implementing CMT scheme in the MMF simulations, highlighting its crucial role in reducing model bias in mean state and spatiotemporal variability.

54 ENVIRONMENTAL SCIENCES↗

A More La Niña–Like Response to Radiative Forcing after Flux Adjustment in CESM2

Abstract In response to greenhouse gas forcing, most coupled global climate models project the tropical Pacific SST trend toward an “El Niño–like” state, with a reduced zonal SST gradient and a weakened Walker circulation. However, observations over the last five decades reveal a trend toward a more “La Niña–like” state with a strengthening zonal SST gradient. Recent research indicates that the identified trend differences are unlikely to be entirely due to internal variability and probably result, at least in part, from systematic model biases. In this study, Community Earth System Model, version 2 (CESM2), is used to explore how mean-state biases within the model may influence its forced response to radiative forcing in the tropical Pacific. The results show that using flux adjustment to reduce the mean-state bias in CESM2 over the tropical regions results in a more La Niña–like trend pattern in the tropical Pacific, with a strengthening of the tropical Pacific zonal SST gradient and a relatively enhanced Walker circulation, as hypothesized to occur if the ocean thermostat mechanism is stronger than the atmospheric mechanisms which by themselves would weaken the Walker circulation. We also find that the historical strengthening of the tropical Pacific zonal gradient is transient but persists into the near term in a high-emissions future warming scenario. These results suggest the potential of flux adjustment as a method for developing alternative projections that represent a wider range of possible future tropical Pacific warming scenarios, especially for a better understanding of regional patterns of climate risk in the near term.

Zhuo, Jing-Yi [Lamont-Doherty Earth Observatory, C↗

Droughts in Wind and Solar Power: Assessing Climate Model Simulations for a Net‐Zero Energy Future

Abstract Understanding and predicting “droughts” in wind and solar power availability can help the electric grid operator planning and operation toward deep renewable penetration. We assess climate models' ability to simulate these droughts at different horizontal resolutions, ∼100 and ∼25 km, over Western North America and Texas. We find that these power droughts are associated with the high/low pressure systems. The simulated wind and solar power variabilities and their corresponding droughts during historical periods are more sensitive to the model bias than to the model resolution. Future climate simulations reveal varied future change of these droughts across different regions. Although model resolution does not affect the simulation of historical droughts, it does impact the simulated future changes. This suggests that regional response to future warming can vary considerably in high‐ and low‐resolution models. These insights have important implications for adapting power system planning and operations to the changing climate.

Liu, Xue [Department of Oceanography Texas A&amp,M↗

Results of the second Ice Shelf–Ocean Model Intercomparison Project (ISOMIP+)

Ocean-driven basal melting of Antarctic ice shelves plays an important role in the mass loss of the Antarctic Ice Sheet. Ice shelf cavity-resolving ocean models are a valuable tool for understanding ice shelf-ocean interactions and for simulating projections of ice shelf and ocean states under future climate. Designed to assess the current state of ice shelf–ocean modelling, the second Ice Shelf–Ocean Model Intercomparison Project, ISOMIP+, consists of 12 ocean model configurations submitted with a common, idealised experimental setup. Here, we focus on the experiments Ocean0–2 (Asay-Davis et al., 2016), which are ocean models with idealised, static ice shelf geometries, but where the ocean reaches a balance with prescribed far-field ocean conditions. Different thermal transfer coefficient values (ranging from 0.011 to 0.2) are used for each model in the melting parameterisation to achieve a common, tuned melt rate since the models cover a range of types of vertical coordinates, ice–ocean boundary layer treatments, and numerical schemes. These model differences lead to spread in the resultant ocean properties, circulation, boundary-layer structure and spatial distribution of melting. We also highlight similarities between models, such as a shared linear relationship across most models between melt rate and overturning and barotropic streamfunctions during the spin-up and spin-down, demonstrating a robust relationship between melt and circulation across models and forcing conditions. The ISOMIP+ results provide a systematic comparison of ice shelf cavity-capable ocean models. However, we also demonstrate the need for realistic ice shelf–ocean model intercomparison projects (some already underway) to assess model biases and inter-model variation against sparse observations. Further research is needed to understand the differences between models and further improve our modelled representations of the ice–ocean boundary layer and ice shelf cavity circulation.

54 ENVIRONMENTAL SCIENCES↗

Incorporating affective bias in models of human decision making

Research on human decision making has traditionally focused on how people actually make decisions, how good their decisions are, and how their decisions can be improved. Recent research suggests that this model is inadequate. Affective as well as cognitive components drive the way information about relevant outcomes and events is perceived, integrated, and used in the decision making process. The affective components include how the individual frames outcomes as good or bad, whether the individual anticipates regret in a decision situation, the affective mood state of the individual, and the psychological stress level anticipated or experienced in the decision situation. A focus of the current work has been to propose empirical studies that will attempt to examine in more detail the relationships between the latter two critical affective influences (mood state and stress) on decision making behavior.

Nygren, Thomas E.↗

TPSAS-NF1676L-31979-DND

The rapid, and in many cases, unprecedented changes in the Arctic climate system observed since 1979 are having devastating impacts on both natural and human systems. These changes are marked by warming Arctic temperatures, rapid declines in sea ice and snow cover, permafrost thaw, mountain glacier melt, and Greenland Ice Sheet mass loss. A common thread through each of these changes is the impact on the surface energy budget. However, our understanding of the controls on and variability of the Arctic surface energy budget is incomplete and this contributes to the significant biases in the climate models. To better understand the controls on the variability of the Arctic surface energy budget and CMIP5 model biases, we use an atmospheric regime-based perspective of the Arctic surface energy budget decomposing variability by atmospheric dynamic and thermodynamic properties.

Patrick C. Taylor↗

Modeling the smoky troposphere of the southeast Atlantic: a comparison to ORACLES airborne observations from September of 2016

In the southeast Atlantic, well-defined smoke plumes from Africa advect over marine boundary layer cloud decks; both are most extensive around September, when most of the smoke resides in the free troposphere. A framework is put forth for evaluating the performance of a range of global and regional atmospheric composition models against observations made during the NASA ORACLES (ObseRvations of Aerosols above CLouds and their intEractionS) airborne mission in September 2016. A strength of the comparison is a focus on the spatial distribution of a wider range of aerosol composition and optical properties than has been done previously. The sparse airborne observations are aggregated into approximately 2° grid boxes and into three vertical layers: 3–6 km, the layer from cloud top to 3 km, and the cloud-topped marine boundary layer. Simulated aerosol extensive properties suggest that the flight-day observations are reasonably representative of the regional monthly average, with systematic deviations of 30 % or less. Evaluation against observations indicates that all models have strengths and weaknesses, and there is no single model that is superior to all the others in all metrics evaluated. Whereas all six models typically place the top of the smoke layer within 0–500 m of the airborne lidar observations, the models tend to place the smoke layer bottom 300–1400 m lower than the observations. A spatial pattern emerges, in which most models underestimate the mean of most smoke quantities (black carbon, extinction, carbon monoxide) on the diagonal corridor between 16° S, 6° E, and 10° S, 0° E, in the 3–6 km layer, and overestimate them further south, closer to the coast, where less aerosol is present. Model representations of the above-cloud aerosol optical depth differ more widely. Most models overestimate the organic aerosol mass concentrations relative to those of black carbon, and with less skill, indicating model uncertainties in secondary organic aerosol processes. Regional-mean free-tropospheric model ambient single scattering albedos vary widely, between 0.83 and 0.93 compared with in situ dry measurements centered at 0.86, despite minimal impact of humidification on particulate scattering. The modeled ratios of the particulate extinction to the sum of the black carbon and organic aerosol mass concentrations (a mass extinction efficiency proxy) are typically too low and vary too little spatially, with significant inter-model differences. Most models overestimate the carbonaceous mass within the offshore boundary layer. Overall, the diversity in the model biases suggests that different model processes are responsible. The wide range of model optical properties requires further scrutiny because of their importance for radiative effect estimates.

Yohei Shinozuka↗

Atmospheric Composition Forecast Model Evaluation Using Ozone Measurements Collected by the Langley Mobile Ozone Lidar

The Langley Mobile Ozone Lidar (LMOL) is a mobile ground based lidar system based at NASA Langley in Hampton, Virginia. Between 2022 and 2024, LMOL collected over 2500 hours of ozone measurements for a range of different atmospheric conditions, including calm days, stratospheric intrusions, surface frontal passages, and long-range transported wildfire smoke plumes. Here, the data is used to evaluate the forecast accuracy of NASA’s Global GEOS Composition Forecasting (GEOS-CF) model. GEOS-CF makes daily three-dimensional forecasts of trace gases and aerosol species. Overall, for calm periods, the forecast model predicts lower tropospheric ozone at NASA Langley with reasonable accuracy (within 20%). The model best predicts the timing and extent of stratospheric intrusions but often vary in the magnitude of the ozone mixing ratio. Among the other types of atmospheric conditions, there is more variability in the model forecasts. Based on this analysis, model forecasts are utilized to determine future data acquisition opportunities with the goal of providing feedback to the modeling teams, thereby enabling them to better understand the model biases and improve the model forecasts of ozone during these different atmospheric conditions.

Daniel B Phoenix↗

Joint analysis of Dark Energy Survey Year 3 data and CMB lensing from SPT and P l a n c k . II. Cross-correlation measurements and cosmological constraints

Cross-correlations of galaxy positions and galaxy shears with maps of gravitational lensing of the cosmic microwave background (CMB) are sensitive to the distribution of large-scale structure in the Universe. Such cross-correlations are also expected to be immune to some of the systematic effects that complicate correlation measurements internal to galaxy surveys. We present measurements and modeling of the cross-correlations between galaxy positions and galaxy lensing measured in the first three years of data from the Dark Energy Survey with CMB lensing maps derived from a combination of data from the 2500 deg 2 SPT-SZ survey conducted with the South Pole Telescope and full-sky data from the Planck satellite. The CMB lensing maps used in this analysis have been constructed in a way that minimizes biases from the thermal Sunyaev Zel’dovich effect, making them well suited for cross-correlation studies. The total signal-to-noise of the cross-correlation measurements is 23.9 (25.7) when using a choice of angular scales optimized for a linear (nonlinear) galaxy bias model. Here we use the cross-correlation measurements to obtain constraints on cosmological parameters. For our fiducial galaxy sample, which consist of four bins of magnitude-selected galaxies, we find constraints of Ω m =0.272$^{+0.032}_{-0.052}$ and S 8 ≡σ8$\sqrt{Ω_m/0.3}$=0.736$^{+0.032}_{-0.028}$ (Ω m =0.245$^{+0.026}_{-0.044}$ and S 8 =0.734$^{+0.035}_{-0.028}$) when assuming linear (nonlinear) galaxy bias in our modeling. Considering only the cross-correlation of galaxy shear with CMB lensing, we find Ω m =0.270$^{+0.043}_{-0.061}$ and S 8 =0.740$^{+0.034}_{-0.029}$. Our constraints on S8 are consistent with recent cosmic shear measurements, but lower than the values preferred by primary CMB measurements from Planck.

79 ASTRONOMY AND ASTROPHYSICS↗