Search NASA⌕ Search

SEARCH · Search NASA

Results for “model bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS1994

Voids and constraints on nonlinear clustering of galaxies

Void statistics of the galaxy distribution in the Center for Astrophysics Redshift Survey provide strong constraints on galaxy clustering in the nonlinear regime, i.e., on scales R equal to or less than 10/h Mpc. Computation of high-order moments of the galaxy distribution requires a sample that (1) densely traces the large-scale structure and (2) covers sufficient volume to obtain good statistics. The CfA redshift survey densely samples structure on scales equal to or less than 10/h Mpc and has sufficient depth and angular coverage to approach a fair sample on these scales. In the nonlinear regime, the void probability function (VPF) for CfA samples exhibits apparent agreement with hierarchical scaling (such scaling implies that the N-point correlation functions for N greater than 2 depend only on pairwise products of the two-point function xi(r)) However, simulations of cosmological models show that this scaling in redshift space does not necessarily imply such scaling in real space, even in the nonlinear regime; peculiar velocities cause distortions which can yield erroneous agreement with hierarchical scaling. The underdensity probability measures the frequency of 'voids' with density rho less than 0.2 -/rho. This statistic reveals a paucity of very bright galaxies (L greater than L asterisk) in the 'voids.' Underdensities are equal to or greater than 2 sigma more frequent in bright galaxy samples than in samples that include fainter galaxies. Comparison of void statistics of CfA samples with simulations of a range of cosmological models favors models with Gaussian primordial fluctuations and Cold Dark Matter (CDM)-like initial power spectra. Biased models tend to produce voids that are too empty. We also compare these data with three specific models of the Cold Dark Matter cosmogony: an unbiased, open universe CDM model (omega = 0.4, h = 0.5) provides a good match to the VPF of the CfA samples. Biasing of the galaxy distribution in the 'standard' CDM model (omega = 1, b = 1.5; see below for definitions) and nonzero cosmological constant CDM model (omega = 0.4, h = 0.6 lambda(sub 0) = 0.6, b = 1.3) produce voids that are too empty. All three simulations match the observed VPF and underdensity probability for samples of very bright (M less than M asterisk = -19.2) galaxies, but produce voids that are too empty when compared with samples that include fainter galaxies.

Vogeley, Michael S.↗
DOE OSTI2024

Modeling neutrino-induced scale-dependent galaxy clustering for photometric galaxy surveys

Abstract The increasing statistical precision of photometric redshift surveys requires improved accuracy of theoretical predictions for large-scale structure observables to obtain unbiased cosmological constraints. In ΛCDM cosmologies, massive neutrinos stream freely at small cosmological scales, suppressing the small-scale power spectrum. In massive neutrino cosmologies, galaxy bias modeling needs to accurately relate the scale-dependent growth of the underlying matter field to observed galaxy clustering statistics. In this work, we implement a computationally efficient approximation of the neutrino-induced scale-dependent bias (NISDB). Through simulated likelihood analyses of Dark Energy Survey Year 3 (DESY3) and Legacy Survey of Space and Time Year 1 (LSSTY1) synthetic data that contain an appreciable NISDB, we examine the impact of linear galaxy bias and neutrino mass modeling choices on cosmological parameter inference. We find model misspecification of the NISDB approximation and neutrino mass models to decrease the constraining power of photometric galaxy surveys and cause parameter biases in the cosmological interpretation of future surveys. We quantify these biases and devise mitigation strategies.

Astronomy & Astrophysics↗
DOE OSTI2024

Estimating Uncertainty in Simulated ENSO Statistics

Abstract Large ensembles of model simulations are frequently used to reduce the impact of internal variability when evaluating climate models and assessing climate change induced trends. However, the optimal number of ensemble members required to distinguish model biases and climate change signals from internal variability varies across models and metrics. Here we analyze the mean, variance and skewness of precipitation and sea surface temperature in the eastern equatorial Pacific region often used to describe the El Niño–Southern Oscillation (ENSO), obtained from large ensembles of Coupled model intercomparison project phase 6 climate simulations. Leveraging established statistical theory, we develop and assess equations to estimate, a priori, the ensemble size or simulation length required to limit sampling‐based uncertainties in ENSO statistics to within a desired tolerance. Our results confirm that the uncertainty of these statistics decreases with the square root of the time series length and/or ensemble size. Moreover, we demonstrate that uncertainties of these statistics are generally comparable when computed using either pre‐industrial control or historical runs. This suggests that pre‐industrial runs can sometimes be used to estimate the expected uncertainty of statistics computed from an existing historical member or ensemble, and the number of simulation years (run duration and/or ensemble size) required to adequately characterize the statistic. This advance allows us to use existing simulations (e.g., control runs that are performed during model development) to design ensembles that can sufficiently limit diagnostic uncertainties arising from simulated internal variability. These results may well be applicable to variables and regions beyond ENSO.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Examining future changes in coastal low-level jet properties offshore California through dynamical downscaling

The coastal low-level jet, or coastal low-level jet (CLLJ), is a synoptically-forced meteorological feature frequently present offshore the western United States (U.S.). Characterized by a wind speed maximum that resides at the top of the marine boundary layer, the CLLJ is largely controlled by the location and strength of the North Pacific High (NPH) as well as the coastal geometry. Considering the rich wind resource available in this offshore region, the Bureau of Ocean Energy Management identified wind energy lease areas offshore California and supported the deployment of two U.S. Department of Energy wind lidar buoys near Morro Bay and Humboldt. Despite our relatively good understanding of the fundamental mechanisms responsible for large-scale CLLJ properties offshore the western U.S., future changes in CLLJ characteristics are less clear. To address this research challenge, and ultimately to better inform future wind turbine deployments, we use simulations driven by three global climate models (GCMs). We apply self-organizing maps to the model outputs for a historical and two future climate periods to show the range of NPH regimes that support CLLJ conditions during the warm seasons, as well as the subtle contribution from land-falling cyclones approaching the mainland during the cold seasons. Compared to the historical period, the three GCM-driven simulations agree that CLLJ conditions will become more (less) prevalent from central California northward (southward). They agree less with respect to future changes in maximum CLLJ wind speeds and CLLJ heights. However, after considering model biases present during the historical period, wind speeds between the models are actually more similar during the 2070–2095 period than during the historical period. The potential combination of more frequent CLLJ conditions characterized by relatively consistent wind speeds occurring at lower heights across northern California suggests that the Humboldt lease area may be ideal for a long-term wind turbine deployment.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1985

A comparison of finite volume flux vector splittings for the Euler equations

A comparison is made between the computational results of the Steger-Warming (1981) and van Leer (1982) flux splitting methods, which have been applied in generalized coordinates to quasi-one-dimensional transonic flow in a nozzle and two-dimensional subsonic, transonic, and supersonic flow over airfoils. The latter splitting method leads to higher convergence rates and a sharper representation of shocks in the transition region. The second-order accurate, one-sided-difference model is extended to a third-order, upwind-biased model with only small additional computational effort.

Anderson, W. K.↗
NASA NTRS2018

Intercomparison of Precipitation Estimates over the Arctic Ocean and Its Peripheral Seas from Reanalyses

Precipitation over the Arctic Ocean has a significant impact on the basin-scale freshwater and energy budgets but is one of the most poorly constrained variables in atmospheric reanalyses. Precipitation controls the snow cover on sea ice, which impedes the exchange of energy between the ocean and atmosphere, inhibiting sea ice growth. Thus, accurate precipitation amounts are needed to inform sea ice modeling, especially for the production of thickness estimates from satellite altimetry freeboard data. However, obtaining a quantitative estimate of the precipitation distribution in the Arctic is notoriously difficult because of a number of factors, including a lack of reliable, long-term in situ observations; difficulties in remote sensing over sea ice; and model biases in temperature and moisture fields and associated uncertainty of modeled cloud microphysical processes in the polar regions. Here, we compare precipitation estimates over the Arctic Ocean from eight widely used atmospheric reanalyses over the period 2000–16 (nominally the ‘‘new Arctic’’). We find that the magnitude, frequency, and phase of precipitation vary drastically, although interannual variability is similar. Reanalysis-derived precipitation does not increase with time as expected; however, an increasing trend of higher fractions of liquid precipitation (rainfall) is found. When compared with drifting ice mass balance buoys, three reanalyses (ERA-Interim, MERRA, and NCEP R2) produce realistic magnitudes and temporal agreement with observed precipitation events, while two products [MERRA, version 2 (MERRA-2), and CFSR] show large, implausible magnitudes in precipitation events. All the reanalyses tend to produce overly frequent Arctic precipitation. Future work needs to be undertaken to determine the specific factors in reanalyses that contribute to these discrepancies in the new Arctic.

Mcpartland, Linette N.↗
DOE OSTI2021

An underestimated negative cloud feedback from cloud lifetime changes

As the atmosphere warms, part of the cloud population shifts from ice and mixed phase (“cold”) to liquid (“warm”) clouds. Because warm clouds are more reflective and longerlived, this phase change reduces the solar flux absorbed by Earth and constitutes a negative radiative feedback. This cooling feedback is weaker in CMIP6 than in CMIP5, contributing to greater greenhouse warming. While this change is often attributed to improvements in simulated cloud phase, another model bias persists: warm clouds precipitate too readily, potentially leading to underestimated negative lifetime feedbacks. In this work, we modify a climate model to better simulate warm rain probability and find it exhibits a cloud lifetime feedback nearly three times larger than the default model. This suggests model errors in cloud-precipitation processes may bias cloud feedbacks as much as CMIP5–CMIP6 climate sensitivity differences. Reliable climate model projections therefore require improved cloud process realism guided by process-oriented observations and observational constraints.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

New framework for benchmarking decadal predictions leveraging the PCMDI Metric Package with interactive visualization

Reliable climate predictions across multiple timescales are increasingly critical as climate-related risks continue to rise. With the growing number and diversity of climate prediction systems, systematic intercomparison has become essential. Here, we present a comprehensive evaluation framework based on the PCMDI Metric Package to assess the performance of multiple decadal climate prediction systems. Unlike uninitialized simulations, initialized predictions exhibit bias and predictive skill that evolve with forecast lead time. To address this, we introduce (1) model-by-lead-time portrait plots, which efficiently summarize metrics of global temperature, precipitation, and Arctic/Antarctic sea-ice extent, and (2) an HTML-based interactive visualization platform that provides detailed regional and seasonal diagnostics of model bias, skill scores, and ensemble spread for each model and lead time. Comparisons with uninitialized simulations further quantify the relative impacts of initialization and external forcing on prediction skill. The proposed framework provides a scalable and transparent approach for multi-model climate prediction assessments and can be readily extended to a wide range of operational and research forecasting systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

When less is more: How increasing the complexity of machine learning strategies for geothermal energy assessments may not lead toward better estimates

Previous moderate- and high-temperature geothermal resource assessments of the western United States utilized data-driven methods and expert decisions to estimate resource favorability. Although expert decisions can add confidence to the modeling process by ensuring reasonable models are employed, expert decisions also introduce human and, thereby, model bias. This bias can present a source of error that reduces the predictive performance of the models and confidence in the resulting resource estimates. Our study aims to develop robust data-driven methods with the goals of reducing bias and improving predictive ability. We present and compare nine favorability maps for geothermal resources in the western United States using data from the U.S. Geological Survey's 2008 geothermal resource assessment. Two favorability maps are created using the expert decision-dependent methods from the 2008 assessment (i.e., weight-of-evidence and logistic regression). With the same data, we then create six different favorability maps using logistic regression (without underlying expert decisions), XGBoost, and support-vector machines paired with two training strategies. The training strategies are customized to address the inherent challenges of applying machine learning to the geothermal training data, which have no negative examples and severe class imbalance. We also create another favorability map using an artificial neural network. We demonstrate that modern machine learning approaches can improve upon systems built with expert decisions. We also find that XGBoost, a non-linear algorithm, produces greater agreement with the 2008 results than linear logistic regression without expert decisions, because the expert decisions in the 2008 assessment rendered the otherwise linear approaches non-linear despite the fact that the 2008 assessment used only linear methods. The F1 scores for all approaches appear low (F1 score < 0.10), do not improve with increasing model complexity, and, therefore, indicate the fundamental limitations of the input features (i.e., training data). Until improved feature data are incorporated into the assessment process, simple non-linear algorithms (e.g., XGBoost) perform equally well or better than more complex methods (e.g., artificial neural networks) and remain easier to interpret.

15 GEOTHERMAL ENERGY↗
DOE OSTI2022

Analysis of Integrated Vapor Transport Biases

Abstract High-fidelity analyses and forecasts of integrated vapor transport (VT) are central to the study of Earth’s hydrological cycle as well as high-impact phenomena such as monsoons and atmospheric rivers. The impact of the in-line analysis correction-based additive inflation (ACAI) on IVT biases and forecast errors is examined within the Navy Earth System Prediction Capability (Navy ESPC) global coupled system. The ACAI technique uses atmospheric analysis corrections from the data assimilation system to approximate model bias and as a representation of stochastic model error to simultaneously reduce systematic and random errors and improve ensemble performance. ACAI reduces the global average magnitude of the 7- and 14-day IVT bias by 16%–17% during Northern Hemisphere summer, reaching 70% reductions in some tropical regions. The global average IVT bias reduction is similar to the bias reduction for low-level wind speed bias and considerably smaller than the bias reduction in total precipitable water. The localized regions where ACAI increases IVT bias occur where the control IVT biases change sign and structure with increasing forecast lead time, such as the South Asian monsoon region. Substituting analyzed wind or moisture fields for the forecast fields when calculating the forecast IVT confirms that, on average, wind errors dominate the IVT error calculation in the tropics, although wind and moisture error contributions are comparable in the extratropics. The existence of regions where using either analyzed winds or analyzed moisture increases IVT bias or mean absolute error reveals areas with compensating errors.

Reynolds, Carolyn A.↗
DOE OSTI2023

Diurnal cycle of precipitation over the tropics and central United States: intercomparison of general circulation models

Diurnal precipitation is a fundamental mode of variability that climate models have difficulty in accurately simulating. Here, in this work, the diurnal cycle of precipitation (DCP) in participating climate models from the Global Energy and Water Exchanges' DCP project is evaluated over the tropics and central United States. Common model biases such as excessive precipitation over the tropics, too frequent light-to-moderate rain, and the failure to capture propagating convection in the central United States still exist. Over the central United States, the issues of too weak rainfall intensity in climate runs is well improved in their hindcast runs with initial conditions from numerical weather prediction analyses. But the improvement is minimal over the central Amazon. Incorporating the role of the large-scale environment in convective triggering processes helps resolve the phase-locking issue in many models where precipitation often incorrectly peaks near noon due to maximum insolation over land. Allowing air parcels to be lifted above the boundary layer improves the simulation of nocturnal precipitation which is often associated with the propagation of mesoscale systems. Including convective memory in cumulus parameterizations acts to suppress light-to-moderate rain and promote intense rainfall; however, it also weakens the diurnal variability. Simply increasing model resolution (with cumulus parameterizations still used) cannot fully resolve the biases of low-resolution climate models in DCP. The hierarchy modeling framework from this study is useful for identifying the missing physics in models and testing new development of model convective processes over different convective regimes.

58 GEOSCIENCES↗
DOE OSTI2025

Assessing Clouds in GFDL's AM4.0 With Different Microphysical Parameterizations Using the Satellite Simulator Package COSP

We evaluate cloud simulations using satellite simulators against multiple observational data sets. These simulators have been run within the Geophysical Fluid Dynamics Laboratory's Atmosphere Model version 4.0 (AM4.0), as well as an alternative configuration where a fully two‐moment Morrison‐Gettelman cloud microphysical parameterization with prognostic precipitation (MG2) is applied, denoted as AM4‐MG2. The modeled cloud spatial distributions, vertical profiles, phase partitioning, cloud‐to‐precipitation transitions, and radiative effects compare reasonably well with satellite observations. Model biases include the under‐prediction of total and low‐level clouds, especially optically thin/intermediate clouds with cloud optical depth of less than 23, but the over‐prediction of thick clouds, indicating “too few, too bright” biases. These biases counteract each other, and give rise to reasonable estimates of cloud radiative effects. The underestimate of low‐level clouds is associated with too early and too frequent drizzle/precipitation formation. The precipitation bias is improved in AM4‐MG2, where the autoconversion scheme initiates the precipitation more realistically. There also exist discrepancies between models and observations for midlevel and high‐level clouds. Additional biases include the underestimate of liquid cloud fraction and the overestimate of ice cloud fraction.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Convection-Permitting Simulations With the E3SM Global Atmosphere Model

This paper describes the first implementation of the Δx = 3.25 km version of the Energy Exascale Earth System Model (E3SM) global atmosphere model and its behavior in a 40-day prescribed-sea-surface-temperature simulation (January 20 through February 28, 2020). This simulation was performed as part of the DYnamics of the Atmospheric general circulation Modeled On Non-hydrostatic Domains (DYAMOND) Phase 2 model intercomparison. Effective resolution is found to be ~ 6x the horizontal dynamics grid resolution despite using a coarser grid for physical parameterizations. Despite this new model being in an immature and untuned state, moving to 3.25 km grid spacing solves several long-standing problems with the E3SM model. In particular, Amazon precipitation is much more realistic, the frequency of light and heavy precipitation is improved, agreement between the simulated and observed diurnal cycle of tropical precipitation is excellent, and the vertical structure of tropical convection and coastal stratocumulus look good. In addition, the new model is able to capture the frequency and structure of important weather events (e.g., tropical cyclones, extratropical cyclones including atmospheric rivers, and cold air outbreaks). Interestingly, this model does not get rid of the erroneous southern branch of the intertropical convergence zone nor the tendency for strongest convection to occur over the Maritime Continent rather than the West Pacific, both of which are classic climate model biases. Several other problems with the simulation are identified, underscoring the fact that this model is a work in progress.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

The Shortwave Cloud-SST Feedback Amplifies Multi-Decadal Pacific Sea Surface Temperature Trends: Implications for Observed Cooling

Climate models struggle to produce sea surface temperature (SST) gradient trends in the tropical Pacific comparable to those seen recently in nature. Here, we find that the magnitude of the cloud-SST feedback in the subtropical Southeast Pacific is correlated across models with the magnitude of Eastern Pacific multi-decadal SST variability. A heat-budget analysis reveals coupling between cloud-radiative effects, circulation, and SST gradients in driving multi-decadal variability in the Eastern Pacific. Using this relationship and observed feedback estimates, we find that internal Eastern Pacific SST variability is underestimated in most models. Adjusting for model bias increases the likelihood of generating a cooling trend at least as large as observations in preindustrial control simulations by ~56% on average. If models underestimate climate “noise,” as our results suggest, this bias should be accounted for when attributing the relative importance of forced versus unforced changes in the climate.

58 GEOSCIENCES↗
DOE OSTI2021

The Convective-To-Total Precipitation Ratio and the “Drizzling” Bias in Climate Models

Overestimation of precipitation frequency and duration while underestimating intensity, that is, the “drizzling” bias, has been a long-standing problem of global climate models. Here we explore this issue from the perspective of precipitation partitioning. We found that most models in the Climate Model Intercomparison Project Phase 5 (CMIP5) have high convective-to-total precipitation (PC/PR) ratios in low latitudes. Convective precipitation has higher frequency and longer duration but lower intensity than non-convective precipitation in many models. As a result, the high PC/PR ratio contributes to the “drizzling” bias over low latitudes. The PC/PR ratio and associated “drizzling” bias increase as model resolution coarsens from 0.5° to 2.0°, but the resolution's effect weakens as the grid spacing increases from 2.0° to 3.0°. Some of the CMIP6 models show reduced “drizzling” bias associated with decreased PC/PR ratio. Thus, more reasonable precipitation partitioning, along with finer model resolution should alleviate the “drizzling” bias within current climate models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Weak Lensing Mass Calibration of the ACT DR5 Galaxy Clusters with the DES Year 3 Weak Lensing Data

We use weak gravitational lensing measurements from Year 3 Dark Energy Survey data to calibrate the masses of 443 galaxy clusters selected via the Sunyaev-Zel'dovich effect from Atacama Cosmology Telescope Data Release 5 maps of the cosmic microwave background. We incorporate redshift and SZ measurements for individual clusters into a hierarchical model for the stacked lensing signals and perform Bayesian analyses to constrain the hydrostatic mass bias of the clusters. Our treatment of systematic uncertainties includes a prescription for measuring and accounting for the weak lensing boost factor, consideration of a miscentering effect, as well as marginalization over uncertainties in the source galaxy photometric redshift distributions and shear calibration. The resultant constraints on the normalization of the mass-observable relation have a precision of approximately 7%, with the mean WL halo mass of M $_{500c}$ = 5.4 × 10$^{14}$ M $_{⊙}$. We measure the bias between the true cluster mass and the mass estimated from the SZ signal based on an X-ray-calibrated scaling relation assuming hydrostatic equilibrium, to be 1 - b = 0.74$^{+0.06}$ $_{-0.05}$ over the full sample. When splitting the clusters into high (z = 0.43-0.70) and low (z = 0.15-0.43) redshift bins, we measure 1 - b = 0.58$^{+0.06}$ $_{-0.05}$ and 0.81$^{+0.08}$ $_{-0.06}$, respectively. When introducing additional freedom in redshift and mass to the hydrostatic bias model, we find that 1 - b decreases with redshift (with the power law of -1.8$^{+0.5}$ $_{-0.6}$, 99.95% confidence), consistent with findings from other recent studies, while we do not find any significant trend in mass. We also demonstrate that our result is robust against various systematics such as a scale cut, priors on baryonic and miscentering parameters, and degree of scatter in mass-observable relation. The weak-lensing mass calibration presented in this study will be a useful tool for using the ACT clusters as probes of astrophysics, and as a step towards using their abundance as a cosmological probe.

Shin, T. [Carnegie Mellon U.] (ORCID:0000000263895↗
DOE OSTI2021

Quantifying the structural uncertainty of the aerosol mixing state representation in a modal model

Abstract. Aerosol mixing state is an important emergent property that affects aerosol radiative forcing and aerosol–cloud interactions, but it has not been easy to constrain this property globally. This study aims to verify the global distribution of aerosol mixing state represented by modal models. To quantify the aerosol mixing state, we used the aerosol mixing state indices for submicron aerosol based on the mixing of optically absorbing and non-absorbing species (χo), the mixing of primary carbonaceous and non-primary carbonaceous species (χc), and the mixing of hygroscopic and non-hygroscopic species (χh). To achieve a spatiotemporal comparison, we calculated the mixing state indices using output from the Community Earth System Model with the four-mode version of the Modal Aerosol Module (MAM4) and compared the results with the mixing state indices from a benchmark machine-learned model trained on high-detail particle-resolved simulations from the particle-resolved stochastic aerosol model PartMC-MOSAIC. The two methods yielded very different spatial patterns of the mixing state indices. In some regions, the yearly averaged χ value computed by the MAM4 model differed by up to 70 percentage points from the benchmark values. These errors tended to be zonally structured, with the MAM4 model predicting a more internally mixed aerosol at low latitudes and a more externally mixed aerosol at high latitudes compared to the benchmark. Our study quantifies potential model bias in simulating mixing state in different regions and provides insights into potential improvements to model process representation for a more realistic simulation of aerosols towards better quantification of radiative forcing and aerosol–cloud interactions.

54 ENVIRONMENTAL SCIENCES↗