Search NASA⌕ Search

SEARCH · Search NASA

Results for “model bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Diurnal cycle of precipitation over the tropics and central United States: intercomparison of general circulation models

Diurnal precipitation is a fundamental mode of variability that climate models have difficulty in accurately simulating. Here, in this work, the diurnal cycle of precipitation (DCP) in participating climate models from the Global Energy and Water Exchanges' DCP project is evaluated over the tropics and central United States. Common model biases such as excessive precipitation over the tropics, too frequent light-to-moderate rain, and the failure to capture propagating convection in the central United States still exist. Over the central United States, the issues of too weak rainfall intensity in climate runs is well improved in their hindcast runs with initial conditions from numerical weather prediction analyses. But the improvement is minimal over the central Amazon. Incorporating the role of the large-scale environment in convective triggering processes helps resolve the phase-locking issue in many models where precipitation often incorrectly peaks near noon due to maximum insolation over land. Allowing air parcels to be lifted above the boundary layer improves the simulation of nocturnal precipitation which is often associated with the propagation of mesoscale systems. Including convective memory in cumulus parameterizations acts to suppress light-to-moderate rain and promote intense rainfall; however, it also weakens the diurnal variability. Simply increasing model resolution (with cumulus parameterizations still used) cannot fully resolve the biases of low-resolution climate models in DCP. The hierarchy modeling framework from this study is useful for identifying the missing physics in models and testing new development of model convective processes over different convective regimes.

58 GEOSCIENCES↗

Assessing Clouds in GFDL's AM4.0 With Different Microphysical Parameterizations Using the Satellite Simulator Package COSP

We evaluate cloud simulations using satellite simulators against multiple observational data sets. These simulators have been run within the Geophysical Fluid Dynamics Laboratory's Atmosphere Model version 4.0 (AM4.0), as well as an alternative configuration where a fully two‐moment Morrison‐Gettelman cloud microphysical parameterization with prognostic precipitation (MG2) is applied, denoted as AM4‐MG2. The modeled cloud spatial distributions, vertical profiles, phase partitioning, cloud‐to‐precipitation transitions, and radiative effects compare reasonably well with satellite observations. Model biases include the under‐prediction of total and low‐level clouds, especially optically thin/intermediate clouds with cloud optical depth of less than 23, but the over‐prediction of thick clouds, indicating “too few, too bright” biases. These biases counteract each other, and give rise to reasonable estimates of cloud radiative effects. The underestimate of low‐level clouds is associated with too early and too frequent drizzle/precipitation formation. The precipitation bias is improved in AM4‐MG2, where the autoconversion scheme initiates the precipitation more realistically. There also exist discrepancies between models and observations for midlevel and high‐level clouds. Additional biases include the underestimate of liquid cloud fraction and the overestimate of ice cloud fraction.

54 ENVIRONMENTAL SCIENCES↗

Convection-Permitting Simulations With the E3SM Global Atmosphere Model

This paper describes the first implementation of the Δx = 3.25 km version of the Energy Exascale Earth System Model (E3SM) global atmosphere model and its behavior in a 40-day prescribed-sea-surface-temperature simulation (January 20 through February 28, 2020). This simulation was performed as part of the DYnamics of the Atmospheric general circulation Modeled On Non-hydrostatic Domains (DYAMOND) Phase 2 model intercomparison. Effective resolution is found to be ~ 6x the horizontal dynamics grid resolution despite using a coarser grid for physical parameterizations. Despite this new model being in an immature and untuned state, moving to 3.25 km grid spacing solves several long-standing problems with the E3SM model. In particular, Amazon precipitation is much more realistic, the frequency of light and heavy precipitation is improved, agreement between the simulated and observed diurnal cycle of tropical precipitation is excellent, and the vertical structure of tropical convection and coastal stratocumulus look good. In addition, the new model is able to capture the frequency and structure of important weather events (e.g., tropical cyclones, extratropical cyclones including atmospheric rivers, and cold air outbreaks). Interestingly, this model does not get rid of the erroneous southern branch of the intertropical convergence zone nor the tendency for strongest convection to occur over the Maritime Continent rather than the West Pacific, both of which are classic climate model biases. Several other problems with the simulation are identified, underscoring the fact that this model is a work in progress.

54 ENVIRONMENTAL SCIENCES↗

The Shortwave Cloud-SST Feedback Amplifies Multi-Decadal Pacific Sea Surface Temperature Trends: Implications for Observed Cooling

Climate models struggle to produce sea surface temperature (SST) gradient trends in the tropical Pacific comparable to those seen recently in nature. Here, we find that the magnitude of the cloud-SST feedback in the subtropical Southeast Pacific is correlated across models with the magnitude of Eastern Pacific multi-decadal SST variability. A heat-budget analysis reveals coupling between cloud-radiative effects, circulation, and SST gradients in driving multi-decadal variability in the Eastern Pacific. Using this relationship and observed feedback estimates, we find that internal Eastern Pacific SST variability is underestimated in most models. Adjusting for model bias increases the likelihood of generating a cooling trend at least as large as observations in preindustrial control simulations by ~56% on average. If models underestimate climate “noise,” as our results suggest, this bias should be accounted for when attributing the relative importance of forced versus unforced changes in the climate.

58 GEOSCIENCES↗

The Convective-To-Total Precipitation Ratio and the “Drizzling” Bias in Climate Models

Overestimation of precipitation frequency and duration while underestimating intensity, that is, the “drizzling” bias, has been a long-standing problem of global climate models. Here we explore this issue from the perspective of precipitation partitioning. We found that most models in the Climate Model Intercomparison Project Phase 5 (CMIP5) have high convective-to-total precipitation (PC/PR) ratios in low latitudes. Convective precipitation has higher frequency and longer duration but lower intensity than non-convective precipitation in many models. As a result, the high PC/PR ratio contributes to the “drizzling” bias over low latitudes. The PC/PR ratio and associated “drizzling” bias increase as model resolution coarsens from 0.5° to 2.0°, but the resolution's effect weakens as the grid spacing increases from 2.0° to 3.0°. Some of the CMIP6 models show reduced “drizzling” bias associated with decreased PC/PR ratio. Thus, more reasonable precipitation partitioning, along with finer model resolution should alleviate the “drizzling” bias within current climate models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Weak Lensing Mass Calibration of the ACT DR5 Galaxy Clusters with the DES Year 3 Weak Lensing Data

We use weak gravitational lensing measurements from Year 3 Dark Energy Survey data to calibrate the masses of 443 galaxy clusters selected via the Sunyaev-Zel'dovich effect from Atacama Cosmology Telescope Data Release 5 maps of the cosmic microwave background. We incorporate redshift and SZ measurements for individual clusters into a hierarchical model for the stacked lensing signals and perform Bayesian analyses to constrain the hydrostatic mass bias of the clusters. Our treatment of systematic uncertainties includes a prescription for measuring and accounting for the weak lensing boost factor, consideration of a miscentering effect, as well as marginalization over uncertainties in the source galaxy photometric redshift distributions and shear calibration. The resultant constraints on the normalization of the mass-observable relation have a precision of approximately 7%, with the mean WL halo mass of M $_{500c}$ = 5.4 × 10$^{14}$ M $_{⊙}$. We measure the bias between the true cluster mass and the mass estimated from the SZ signal based on an X-ray-calibrated scaling relation assuming hydrostatic equilibrium, to be 1 - b = 0.74$^{+0.06}$ $_{-0.05}$ over the full sample. When splitting the clusters into high (z = 0.43-0.70) and low (z = 0.15-0.43) redshift bins, we measure 1 - b = 0.58$^{+0.06}$ $_{-0.05}$ and 0.81$^{+0.08}$ $_{-0.06}$, respectively. When introducing additional freedom in redshift and mass to the hydrostatic bias model, we find that 1 - b decreases with redshift (with the power law of -1.8$^{+0.5}$ $_{-0.6}$, 99.95% confidence), consistent with findings from other recent studies, while we do not find any significant trend in mass. We also demonstrate that our result is robust against various systematics such as a scale cut, priors on baryonic and miscentering parameters, and degree of scatter in mass-observable relation. The weak-lensing mass calibration presented in this study will be a useful tool for using the ACT clusters as probes of astrophysics, and as a step towards using their abundance as a cosmological probe.

Shin, T. [Carnegie Mellon U.] (ORCID:0000000263895↗

Quantifying the structural uncertainty of the aerosol mixing state representation in a modal model

Abstract. Aerosol mixing state is an important emergent property that affects aerosol radiative forcing and aerosol–cloud interactions, but it has not been easy to constrain this property globally. This study aims to verify the global distribution of aerosol mixing state represented by modal models. To quantify the aerosol mixing state, we used the aerosol mixing state indices for submicron aerosol based on the mixing of optically absorbing and non-absorbing species (χo), the mixing of primary carbonaceous and non-primary carbonaceous species (χc), and the mixing of hygroscopic and non-hygroscopic species (χh). To achieve a spatiotemporal comparison, we calculated the mixing state indices using output from the Community Earth System Model with the four-mode version of the Modal Aerosol Module (MAM4) and compared the results with the mixing state indices from a benchmark machine-learned model trained on high-detail particle-resolved simulations from the particle-resolved stochastic aerosol model PartMC-MOSAIC. The two methods yielded very different spatial patterns of the mixing state indices. In some regions, the yearly averaged χ value computed by the MAM4 model differed by up to 70 percentage points from the benchmark values. These errors tended to be zonally structured, with the MAM4 model predicting a more internally mixed aerosol at low latitudes and a more externally mixed aerosol at high latitudes compared to the benchmark. Our study quantifies potential model bias in simulating mixing state in different regions and provides insights into potential improvements to model process representation for a more realistic simulation of aerosols towards better quantification of radiative forcing and aerosol–cloud interactions.

54 ENVIRONMENTAL SCIENCES↗

DESI mock challenge: Halo and galaxy catalogues with the bias assignment method

We present a novel approach to the construction of mock galaxy catalogues for large-scale structure analysis based on the distribution of dark matter halos obtained with effective bias models at the field level. We aim to produce mock galaxy catalogues capable of generating accurate covariance matrices for a number of cosmological probes that are expected to be measured in current and forthcoming galaxy redshift surveys (e.g. two- and three-point statistics). The construction of the catalogues shown in this paper is part of a mock-comparison project within the Dark Energy Spectroscopic Instrument (DESI) collaboration. We use the bias assignment method ( BAM ) to model the statistics of halo distribution through a learning algorithm using a few detailed N-body simulations, and approximated gravity solvers based on Lagrangian perturbation theory. We introduce cosmic-web-dependent corrections to modelling redshift-space distortions at the N-body level – both in the halo and galaxy distributions –, as well as a multi-scale approach for accurate assignment of halo properties. Using specific models of halo occupation distributions to populate halos, we generate galaxy mocks with the expected number density and central-satellite fraction of emission-line galaxies, which are a key target of the DESI experiment. BAM generates mock catalogues with per cent accuracy in a number of summary statistics, such as the abundance, the two- and three-point statistics of halo distributions, both in real and redshift space. In particular, the mock galaxy catalogues display ~3%-10% accuracy in the multipoles of the power spectrum up to scales of k ~ 0.4 h -1 Mpc. We show that covariance matrices of two- and three-point statistics obtained with BAM display a similar structure to the reference simulation. BAM offers an efficient way to produce mock halo catalogues with accurate two- and three-point statistics and is able to generate a variety of multi-tracer catalogues with precise covariance matrices of several cosmological probes. We discuss future developments of the algorithm towards mock production in DESI and other galaxy-redshift surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Dark energy survey year 3 results: High-precision measurement and modeling of galaxy-galaxy lensing

We present and characterize the galaxy-galaxy lensing signal measured using the first three years of data from the Dark Energy Survey (DES Y3) covering 4132 deg 2 . These galaxy-galaxy measurements are used in the DES Y3 3 × 2 pt cosmological analysis, which combines weak lensing and galaxy clustering information. We use two lens samples: a magnitude-limited sample and the redmagic sample, which span the redshift range ∼ 0.2 – 1 with 10.7 and 2.6 M galaxies, respectively. For the source catalog, we use the metacalibration shape sample, consisting of ≃ 100 M galaxies separated into four tomographic bins. Our galaxy-galaxy lensing estimator is the mean tangential shear, for which we obtain a total SNR of ∼ 148 for maglim ( ∼ 120 for redmagic), and ∼ 67 ( ∼ 55 ) after applying the scale cuts of 6 Mpc / h . Thus we reach percent-level statistical precision, which requires that our modeling and systematic-error control be of comparable accuracy. The tangential shear model used in the 3 × 2 pt cosmological analysis includes lens magnification, a five-parameter intrinsic alignment model, marginalization over a point mass to remove information from small scales and a linear galaxy bias model validated with higher-order terms. We explore the impact of these choices on the tangential shear observable and study the significance of effects not included in our model, such as reduced shear, source magnification, and source clustering. We also test the robustness of our measurements to various observational and systematics effects, such as the impact of observing conditions, lens-source clustering, random-point subtraction, scale-dependent metacalibration responses, point spread function residuals, and B modes.

79 ASTRONOMY AND ASTROPHYSICS↗

RADA

The code for regularized adversarial domain adaption is provided here. The RADA methodology is developed for correcting climate model biases using an adversarial learning strategy. The code here covers the data processing, the algorithm, the baseline models, and the evaluation.

Anderson, GemmaJ.↗

Impact of Global Warming on U.S. Summertime Mesoscale Convective Systems: A Simple Lagrangian Parcel Model Perspective

Abstract Mesoscale convective systems (MCSs) are the dominant rainfall producer over the United States during the warm season, causing natural disasters and severe weather every year. Global climate models have large uncertainty in projecting precipitation changes in the future climate. Here, a simple Lagrangian parcel model is used to investigate the impact of global warming on MCS initiation and growth. The single-column parcel model projects a mean precipitation decrease over the central United States and an increase to its east, in agreement with the CMIP5 model projection. It also highlights the crucial role of current climate mean-state model bias in exaggerating the change in future mean precipitation projection by 25%. As for convective population, the model captures the decreased occurrence frequency of weak to moderate convection and increased frequency of strong convection due to the increased CAPE and CIN, in agreement with convection-permitting regional simulations. Novel parameterizations of gust-front propagation speed and subsidence strength are developed as guided by cloud-resolving simulations. The multicolumn parcel model employing those parameterizations captures readily the cold pool–induced upscale growth feature. It simulates smaller mesoscale clusters over the central United States under global warming due to gust-front slowdown and subsidence strength enhancement, which are further attributed to land aridity–induced weakening of initial accumulated precipitation and strengthening of updraft speed, respectively. That said, mesoscale clusters could become bigger under more favorable conditions in future climate, including boundary layer moistening, convection lifetime lengthening, and cold pool mechanical-lifting enhancement, which require further investigations to improve mechanistic understanding of future MCS changes.

54 ENVIRONMENTAL SCIENCES↗

Evaluating Climate Models with the CLIVAR 2020 ENSO Metrics Package

El Niño–Southern Oscillation (ENSO) is the dominant mode of interannual climate variability on the planet, with far-reaching global impacts. It is therefore key to evaluate ENSO simulations in state-of-the-art numerical models used to study past, present, and future climate. Recently, the Pacific Region Panel of the International Climate and Ocean: Variability, Predictability and Change (CLIVAR) Project, as a part of the World Climate Research Programme (WCRP), led a community-wide effort to evaluate the simulation of ENSO variability, teleconnections, and processes in climate models. The new CLIVAR 2020 ENSO metrics package enables model diagnosis, comparison, and evaluation to 1) highlight aspects that need improvement; 2) monitor progress across model generations; 3) help in selecting models that are well suited for particular analyses; 4) reveal links between various model biases, illuminating the impacts of those biases on ENSO and its sensitivity to climate change; and to 5) advance ENSO literacy. By interfacing with existing model evaluation tools, the ENSO metrics package enables rapid analysis of multipetabyte databases of simulations, such as those generated by the Coupled Model Intercomparison Project phases 5 (CMIP5) and 6 (CMIP6). The CMIP6 models are found to significantly outperform those from CMIP5 for 8 out of 24 ENSO-relevant metrics, with most CMIP6 models showing improved tropical Pacific seasonality and ENSO teleconnections. Only one ENSO metric is significantly degraded in CMIP6, namely, the coupling between the ocean surface and subsurface temperature anomalies, while the majority of metrics remain unchanged.

54 ENVIRONMENTAL SCIENCES↗

The Fall and Rise of the Global Climate Model

Abstract Global models are an essential tool for climate projections, but conventional coarse‐resolution atmospheric general circulation models suffer from errors both in their parameterized cloud physics and in their representation of climatically important circulation features. A notable recent study by Terai et al. (2020, https://doi.org/10.1029/2020ms002274) documents a global model capable of reproducing the regime‐based effect of aerosols on cloud liquid water path expected from observational evidence. This may represent a significant advance in cloud process fidelity in global models. Such models can be expected to give a better estimate of the effective radiative forcing of the climate. If this advance in cloud process representation can be matched by advances in the representation of circulation features such as monsoons, then such models may also be able to navigate the complex tangle between spatially heterogeneous aerosol–cloud interactions and regional circulation patterns. This tight link between aerosol and circulation results in anthropogenic perturbations of climate variables of societal importance, such as regional rainfall distributions. Upcoming global models with km‐scale resolution may improve the regional circulation and be able to take advantage of the Terai et al. (2020, https://doi.org/10.1029/2020ms002274) improvement in cloud physics. If so, an era of significantly improved regional climate projection capabilities may soon dawn. If not, then the improvement in cloud physics might spur intensified efforts on problems in model dynamics. Either way, based on the rapid changes in aerosol emissions in the near future, learning to make reliable projections based on biased models is a skill that will not go out of style.

54 ENVIRONMENTAL SCIENCES↗

A semiempirical transparency model for dual energy cargo radiography applications

Cargo containers passing through ports are scanned by non-intrusive inspection systems to search for concealed illicit materials. By using two photon beams with different energy spectra, dual energy inspection systems are sensitive to both the area density and the atomic number of cargo contents. Most literature on the subject assumes a simple exponential attenuation model for photon intensity in which only free streaming photons are detected. However, this approximation neglects second order effects such as scattering, leading to a biased model and thus incorrect material predictions. This work studies the accuracy of the free streaming model by comparing it to simulation outputs, finding that the model shows poor atomic number reconstruction accuracy at high- Z and suffers significantly if the source energy spectra and detector response function are not known exactly. To address these challenges, this work introduces a semiempirical transparency model which modifies the free streaming model by rescaling different components of the mass attenuation coefficient, allowing the model to capture secondary effects ignored by the free streaming model. The semiempirical model displays improvement agreement with simulated results at high- Z and shows excellent extrapolation to materials and thicknesses which were not included during the calibration step. Furthermore, this work demonstrates that the semiempirical model yields accurate atomic number predictions even when the source spectra and detector response are not known exactly. In conclusion, using the semiempirical model, manufacturers can perform a simple calibration to enable more precise Z reconstruction capabilities, which has the potential to significantly improve the performance of existing dual energy radiographic systems.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Moving beyond post hoc explainable artificial intelligence: a perspective paper on lessons learned from dynamical climate modeling

AI models are criticized as being black boxes, potentially subjecting climate science to greater uncertainty. Explainable artificial intelligence (XAI) has been proposed to probe AI models and increase trust. In this review and perspective paper, we suggest that, in addition to using XAI methods, AI researchers in climate science can learn from past successes in the development of physics-based dynamical climate models. Dynamical models are complex but have gained trust because their successes and failures can sometimes be attributed to specific components or sub-models, such as when model bias is explained by pointing to a particular parameterization. We propose three types of understanding as a basis to evaluate trust in dynamical and AI models alike: (1) instrumental understanding, which is obtained when a model has passed a functional test; (2) statistical understanding, obtained when researchers can make sense of the modeling results using statistical techniques to identify input–output relationships; and (3) component-level understanding, which refers to modelers' ability to point to specific model components or parts in the model architecture as the culprit for erratic model behaviors or as the crucial reason why the model functions well. We demonstrate how component-level understanding has been sought and achieved via climate model intercomparison projects over the past several decades. Such component-level understanding routinely leads to model improvements and may also serve as a template for thinking about AI-driven climate science. Currently, XAI methods can help explain the behaviors of AI models by focusing on the mapping between input and output, thereby increasing the statistical understanding of AI models. Yet, to further increase our understanding of AI models, we will have to build AI models that have interpretable components amenable to component-level understanding. We give recent examples from the AI climate science literature to highlight some recent, albeit limited, successes in achieving component-level understanding and thereby explaining model behavior. The merit of such interpretable AI models is that they serve as a stronger basis for trust in climate modeling and, by extension, downstream uses of climate model data.

54 ENVIRONMENTAL SCIENCES↗

A spatial evaluation of Arctic sea ice and regional limitations in CMIP6 historical simulations

The Arctic sea ice response to a warming climate is assessed in a subset of models participating in Phase 6 of the Coupled Model Intercomparison Project (CMIP6), using several metrics in comparison with satellite observations and results from the Pan-Arctic Ice Ocean Modeling and Assimilation System and the Regional Arctic System Model. Our study examines the historical representation of sea ice extent, volume, and thickness using spatial analysis metrics, such as the integrated ice-edge error, Brier score, and Spatial Probability Score. We find that the CMIP6 multi-model mean captures the mean annual cycle and 1979-2014 sea ice trends remarkably well. However, individual models experience a wide range of uncertainty in the spatial distribution of sea ice when compared against satellite measurements and reanalysis data. Our metrics expose common and individual regional model biases, which sea ice temporal analyses alone do not capture. We identify large ice edge and ice thickness errors in Arctic sub-regions, implying possible model specific limitations in or lack of representation of some key physical processes. We postulate that many of them could be related to the oceanic forcing, especially in the marginal and shelf seas, where seasonal sea ice changes are not adequately simulated. We therefore conclude that an individual model’s ability to represent the observed/reanalysis spatial distribution still remains a challenge. We propose the spatial analysis metrics as useful tools to diagnose model limitations, narrow down possible processes affecting them, and guide future model improvements critical to the representation and projections of Arctic climate change.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗