Search NASA⌕ Search

SEARCH · Search NASA

Results for “model bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Statistically bias-corrected and downscaled climate models underestimate the adverse effects of extreme heat on U.S. maize yields

Abstract Efforts to understand and quantify how a changing climate can impact agriculture often rely on bias-corrected and downscaled climate information, making it important to quantify potential biases of this approach. Here, we use a multi-model ensemble of statistically bias-corrected and downscaled climate models, as well as the corresponding parent models from the Coupled Model Intercomparison Project Phase 5 (CMIP5), to drive a statistical panel model of U.S. maize yields that incorporates season-wide measures of temperature and precipitation. We analyze uncertainty in annual yield hindcasts, finding that the CMIP5 models considerably overestimate historical yield variability while the bias-corrected and downscaled versions underestimate the largest weather-induced yield declines. We also find large differences in projected yields and other decision-relevant metrics throughout this century, leaving stakeholders with modeling choices that require navigating trade-offs in resolution, historical accuracy, and projection confidence.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Insights of warm-cloud biases in Community Atmospheric Model 5 and 6 from the single-column modeling framework and Aerosol and Cloud Experiments in the Eastern North Atlantic (ACE-ENA) observations

There has been a growing concern that most climate models predict precipitation that is too frequent, likely due to lack of reliable subgrid variability and vertical variations in microphysical processes in low-level warm clouds. In this study, the warm-cloud physics parameterizations in the singe-column configurations of NCAR Community Atmospheric Model version 6 and 5 (SCAM6 and SCAM5, respectively) are evaluated using ground-based and airborne observations from the Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Aerosol and Cloud Experiments in the Eastern North Atlantic (ACE-ENA) field campaign near the Azores islands during 2017–2018. The 8-month single-column model (SCM) simulations show that both SCAM6 and SCAM5 can generally reproduce marine boundary layer cloud structure, major macrophysical properties, and their transition. The improvement in warm-cloud properties from the Community Atmospheric Model 5 and 6 (CAM5 to CAM6) physics can be found through comparison with the observations. Meanwhile, both physical schemes underestimate cloud liquid water content, cloud droplet size, and rain liquid water content but overestimate surface rainfall. Modeled cloud condensation nuclei (CCN) concentrations are comparable with aircraft-observed ones in the summer but are overestimated by a factor of 2 in winter, largely due to the biases in the long-range transport of anthropogenic aerosols like sulfate. We also test the newly recalibrated autoconversion and accretion parameterizations that account for vertical variations in droplet size. Compared to the observations, more significant improvement is found in SCAM5 than in SCAM6. This result is likely explained by the introduction of subgrid variations in cloud properties in CAM6 cloud microphysics, which further suppresses the scheme's sensitivity to individual warm-rain microphysical parameters. The predicted cloud susceptibilities to CCN perturbations in CAM6 are within a reasonable range, indicating significant progress since CAM5 which produces an aerosol indirect effect that is too strong. The present study emphasizes the importance of understanding biases in cloud physics parameterizations by combining SCM with in situ observations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Evaluating Tropical Precipitation Relations in CMIP6 Models with ARM Data

Abstract A set of diagnostics based on simple, statistical relationships between precipitation and the thermodynamic environment in observations is implemented to assess phase 6 of the Coupled Model Intercomparison Project (CMIP6) model behavior with respect to precipitation. Observational data from the Atmospheric Radiation Measurement (ARM) permanent field observational sites are augmented with satellite observations of precipitation and temperature as an observational baseline. A robust relationship across observational datasets between column water vapor (CWV) and precipitation, in which conditionally averaged precipitation exhibits a sharp pickup at some critical CWV value, provides a useful convective onset diagnostic for climate model comparison. While a few models reproduce an appropriate precipitation pickup, most models begin their pickup at too low CWV and the increase in precipitation with increasing CWV is too weak. Convective transition statistics compiled in column relative humidity (CRH) partially compensate for model temperature biases—although imperfectly since the temperature dependence is more complex than that of column saturation. Significant errors remain in individual models and weak pickups are generally not improved. The conditional-average precipitation as a function of CRH can be decomposed into the product of the probability of raining and mean precipitation during raining times (conditional intensity). The pickup behavior is primarily dependent on the probability of raining near the transition and on the conditional intensity at higher CRH. Most models roughly capture the CRH dependence of these two factors. However, compensating biases often occur: model conditional intensity that is too low at a given CRH is compensated in part by excessive probability of precipitation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Modelling nearest neighbour distributions of biased tracers using hybrid effective field theory

ABSTRACT We investigate the application of hybrid effective field theory (HEFT) – which combines a Lagrangian bias expansion with subsequent particle dynamics from N-body simulations – to the modelling of k-nearest neighbour cumulative distribution functions (kNN-CDFs) of biased tracers of the cosmological matter field. The kNN-CDFs are sensitive to all higher order connected N-point functions in the data, but are computationally cheap to compute. We develop the formalism to predict the kNN-CDFs of discrete tracers of a continuous field from the statistics of the continuous field itself. Using this formalism, we demonstrate how kNN-CDF statistics of a set of biased tracers, such as haloes or galaxies, of the cosmological matter field can be modelled given a set of low-redshift HEFT component fields and bias parameter values. These are the same ingredients needed to predict the two-point clustering. For a specific sample of haloes, we show that both the two-point clustering and the kNN-CDFs can be well-fit on quasi-linear scales (≳ 20h−1Mpc) by the second-order HEFT formalism with the same values of the bias parameters, implying that joint modelling of the two is possible. Finally, using a Fisher matrix analysis, we show that including kNN-CDF measurements over the range of allowed scales in the HEFT framework can improve the constraints on σ8 by roughly a factor of 3, compared to the case where only two-point measurements are considered. Combining the statistical power of kNN measurements with the modelling power of HEFT, therefore, represents an exciting prospect for extracting greater information from small-scale cosmological clustering.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Toward Accurate Modeling of Galaxy Clustering on Small Scales: Halo Model Extensions and Lingering Tension

This paper represents an effort to provide robust constraints on the galaxy–halo connection and simultaneously test the Planck ΛCDM cosmology using a fully numerical model of small-scale galaxy clustering. We explore two extensions to the standard Halo Occupation Distribution model: assembly bias, whereby halo occupation depends on both halo mass and the larger environment, and velocity bias, whereby galaxy velocities do not perfectly trace the velocity of the dark matter within the halo. Moreover, we incorporate halo mass corrections to account for the impact of baryonic physics on the halo population. We identify an optimal set of clustering measurements to constrain this "decorated" HOD model for both low- and high-luminosity galaxies in SDSS DR7. We find that, for low-luminosity galaxies, a model with both assembly bias and velocity bias provides the best fit to the clustering measurements, with no tension remaining in the fit. In this model, we find evidence for both central and satellite galaxy assembly bias at the 99% and 95% confidence levels, respectively. In addition, we find evidence for satellite galaxy velocity bias at the 99.9% confidence level. For high-luminosity galaxies, we find no evidence for either assembly bias or velocity bias, but our model exhibits significant tension with SDSS measurements. We find that all of these conclusions still stand when we include the effects of baryonic physics on the halo mass function, suggesting that the tension we find for high-luminosity galaxies may be due to a problem with our assumed cosmological model.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Modeled and observed properties related to the direct aerosol radiative effect of biomass burning aerosol over the southeastern Atlantic

Biomass burning smoke is advected over the southeastern Atlantic Ocean between July and October of each year. This smoke plume overlies and mixes into a region of persistent low marine clouds. Model calculations of climate forcing by this plume vary significantly in both magnitude and sign. NASA EVS-2 (Earth Venture Suborbital-2) ORACLES (ObseRvations of Aerosols above CLouds and their intEractionS) had deployments for field campaigns off the west coast of Africa in 3 consecutive years (September 2016, August 2017, and October 2018) with the goal of better characterizing this plume as a function of the monthly evolution by measuring the parameters necessary to calculate the direct aerosol radiative effect. Here, this dataset and satellite retrievals of cloud properties are used to test the representation of the smoke plume and the underlying cloud layer in two regional models (WRF-CAM5 and CNRM-ALADIN) and two global models (GEOS and UM-UKCA). The focus is on the comparisons of those aerosol and cloud properties that are the primary determinants of the direct aerosol radiative effect and on the vertical distribution of the plume and its properties. The representativeness of the observations to monthly averages are tested for each field campaign, with the sampled mean aerosol light extinction generally found to be within 20 % of the monthly mean at plume altitudes. When compared to the observations, in all models, the simulated plume is too vertically diffuse and has smaller vertical gradients, and in two of the models (GEOS and UM-UKCA), the plume core is displaced lower than in the observations. Plume carbon monoxide, black carbon, and organic aerosol masses indicate underestimates in modeled plume concentrations, leading, in general, to underestimates in mid-visible aerosol extinction and optical depth. Biases in mid-visible single scatter albedo are both positive and negative across the models. Observed vertical gradients in single scatter albedo are not captured by the models, but the models do capture the coarse temporal evolution, correctly simulating higher values in October (2018) than in August (2017) and September (2016). Uncertainties in the measured absorption Ångstrom exponent were large but propagate into a negligible (<4 %) uncertainty in integrated solar absorption by the aerosol and, therefore, in the aerosol direct radiative effect. Model biases in cloud fraction, and, therefore, the scene albedo below the plume, vary significantly across the four models. The optical thickness of clouds is, on average, well simulated in the WRF-CAM5 and ALADIN models in the stratocumulus region and is underestimated in the GEOS model; UM-UKCA simulates cloud optical thickness that is significantly too high. Overall, the study demonstrates the utility of repeated, semi-random sampling across multiple years that can give insights into model biases and how these biases affect modeled climate forcing. The combined impact of these aerosol and cloud biases on the direct aerosol radiative effect (DARE) is estimated using a first-order approximation for a subset of five comparison grid boxes. A significant finding is that the observed grid box average aerosol and cloud properties yield a positive (warming) aerosol direct radiative effect for all five grid boxes, whereas DARE using the grid-box-averaged modeled properties ranges from much larger positive values to small, negative values. It is shown quantitatively how model biases can offset each other, so that model improvements that reduce biases in only one property (e.g., single scatter albedo but not cloud fraction) would lead to even greater biases in DARE. Across the models, biases in aerosol extinction and in cloud fraction and optical depth contribute the largest biases in DARE, with aerosol single scatter albedo also making a significant contribution.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Evaluation of historical CMIP6 model simulations of extreme precipitation over contiguous US regions

Simulated historical precipitation is evaluated for Coupled Model Intercomparison Project Phase 6 (CMIP6) models using precipitation indices defined by the Expert Team on Climate Change Detection and Indices. The model indices are evaluated against corresponding indices from the CPC unified gauge-based analyses of precipitation over seven geographical regions across the contiguous US (CONUS). The regions assessed match those in recent US National Climate Assessment Reports. To estimate observational uncertainty, precipitation indices for three other observational datasets (HadEx2, Livneh and PRISM) are evaluated against the CPC analyses. Both the moderate and extreme mean precipitation intensities are overestimated over the western CONUS and underestimated in the areas of the Central Great Plains (CGP) in most CMIP6 models tested. Most CMIP6 models overestimate the mean and variability of wet spell durations and underestimate the mean and variability of dry spell durations across the CONUS. Biases in interannual variability of most of the indices have similar patterns to those in corresponding mean biases. The median and interquartile model spreads in CMIP6 model biases are clearly smaller than those in CMIP5 model biases for wet spell durations. Multimodel medians of CMIP6 (CMIP6-MMM) and CMIP5 (CMIP5-MMM) have similar biases in climatology and variability but biases tend to be smaller in CMIP6-MMM. Depending on the index, extreme precipitation is slightly better in parts of the eastern half of the CONUS in CMIP6-MMM, otherwise, the biases in climatology and variability are similar to CMIP5-MMM. CMIP6-MMM performs better than individual models and even observational datasets in some cases. Differences between observational datasets for most indices are comparable to the CMIP6 interquartile model spread. The better-performing observational and model datasets are different in different parts of the CONUS.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

The Need for a New LLNL Pulsed Sphere Neutron Leakage Spectra Series

Here, it is shown that spectra measured as part of the Lawrence Livermore National Laboratory Pulsed Sphere (LPS) program offer decisive information to locate formatting or physics issues in nuclear data of key interest for fusion reactor simulations. However, experiments from this measurement series are not benchmarks. For instance, their uncertainties are incomplete. There are also many open questions—e.g., on the setup, the detector response, and whether LPS are accurately modeled—that cannot be answered anymore given the limited documentation and that many of the experimenters are no longer actively working. This limited knowledge has implications when one tries to adjust nuclear data to LPS spectra. Usually, one adjusts to benchmarks representing an application with the hope to get more precise nuclear data for the application of interest where differential data might be scarce and/or to reduce nuclear data uncertainties in the application simulations. However, it is demonstrated that adjustment with LPS spectra without accounting for missing uncertainties and modeling potential biases in the experimental data leads to adjusted data that are highly unphysical. That means adjusted data differ significantly from evaluated data based on information from differential experiments; also, application quantities predicted with the adjusted data deviate distinctly from experimental ones. While we can approximate our limited knowledge on these experiments with Gaussian processes in the adjustment process, this modeling of bias is arbitrary rather than based on a physics explanation, calling into doubt the validity of resulting adjusted data. Thus, we discuss here the need for a new measurement series, learning from the strengths and weaknesses of the LPS program, to yield decisive and well-benchmarked integral experiments to support fusion reactor research.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Addressing bias in bagging and boosting regression models

As artificial intelligence (AI) becomes widespread, there is increasing attention on investigating bias in machine learning (ML) models. Previous research concentrated on classification problems, with little emphasis on regression models. This paper presents an easy-to-apply and effective methodology for mitigating bias in bagging and boosting regression models, that is also applicable to any model trained through minimizing a differentiable loss function. Our methodology measures bias rigorously and extends the ML model's loss function with a regularization term to penalize high correlations between model errors and protected attributes. We applied our approach to three popular tree-based ensemble models: a random forest model (RF), a gradient-boosted model (GBT), and an extreme gradient boosting model (XGBoost). We implemented our methodology on a case study for predicting road-level traffic volume, where RF, GBT, and XGBoost models were shown to have high accuracy. Despite high accuracy, the ML models were shown to perform poorly on roads in minority-populated areas. Our bias mitigation approach reduced minority-related bias by over 50%.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Resolving Away Stratocumulus Biases in Modern Global Climate Models

Abstract Increased horizontal and vertical resolution in global atmospheric models can reduce a significant amount of the biases associated with subtropical marine stratocumulus. The sensitivity of offshore and coastal marine stratocumulus to different horizontal and vertical resolutions has been investigated by using Energy Exascale Earth System Model (E3SM) coupled with the novel Framework for Improvement by Vertical Enhancement which has been demonstrated as a viable tool to improve the representation of marine stratocumulus while saving computational cost. Our study shows that high vertical resolution is the key to improve marine stratocumulus simulations in E3SM. Concurrent horizontal and vertical resolution increases are needed for substantial overall reduction of stubborn marine stratocumulus biases over the coastal region but not necessarily in the offshore area.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Assessing the cloud radiative bias at Macquarie Island in the ACCESS-AM2 model

Abstract. As a long-standing problem in climate models, large positive shortwave radiation biases exist at the surface over the Southern Ocean, impacting the accurate simulation of sea surface temperature, atmospheric circulation, and precipitation. Underestimations of low-level cloud fraction and liquid water content are suggested to predominantly contribute to these radiation biases. Most model evaluations for radiation focus on summer and rely on satellite products, which have their own limitations. In this work, we use surface-based observations at Macquarie Island to provide the first long-term, seasonal evaluation of both downwelling surface shortwave and longwave radiation in the Australian Community Climate and Earth System Simulator Atmosphere-only Model version 2 (ACCESS-AM2) over the Southern Ocean. The capacity of the Clouds and the Earth’s Radiant Energy System (CERES) product to simulate radiation is also investigated. We utilize the novel lidar simulator, the Automatic Lidar and Ceilometer Framework (ALCF), and all-sky cloud camera observations of cloud fraction to investigate how radiation biases are influenced by cloud properties. Overall, we find an overestimation of +9.5±33.5 W m−2 for downwelling surface shortwave radiation fluxes and an underestimation of -2.3±13.5 W m−2 for downwelling surface longwave radiation in ACCESS-AM2 in all-sky conditions, with more pronounced shortwave biases of +25.0±48.0 W m−2 occurring in summer. CERES presents an overestimation of +8.0±18.0 W m−2 for the shortwave and an underestimation of -12.1±12.2 W m−2 for the longwave in all-sky conditions. For the cloud radiative effect (CRE) biases, there is an overestimation of +4.8±28.0 W m−2 in ACCESS-AM2 and an underestimation of -7.9±20.9 W m−2 in CERES. An overestimation of downwelling surface shortwave radiation is associated with an underestimated cloud fraction and low-level cloud occurrence. We suggest that modeled cloud phase is also having an impact on the radiation biases. Our results show that the ACCESS-AM2 model and CERES product require further development to reduce these radiation biases not just in shortwave and in all-sky conditions, but also in longwave and in clear-sky conditions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Bias correcting regional scale Earth system model projections: novel approach using empirical mode decomposition

Bias correction is a crucial step in using Earth system model outputs for assessments, as it adjusts systematic errors by comparing the model to observations. However, standard methods – ranging from mean-based linear scaling to distribution-based quantile mapping typically treat bias correction as a single-scale process, overlooking the fact that biases can manifest differently across daily, seasonal, and annual timescales. In this study, we propose a novel, timescale-aware bias-correction approach built on Empirical Mode Decomposition. By decomposing the meteorological signal into multiple oscillatory components and aggregating them to represent distinct timescales, we apply targeted corrections to each component, thereby preserving both short- and long-term structure in the data. Experimental illustrations show that the timescale-aware EMDBC framework matches the performance of conventional quantile-delta mapping (QDM) at the native daily scale and achieves progressively larger bias reductions at bi-weekly, seasonal, and annual scales. As a result, the proposed approach offers a more robust path to accurate and reliable Earth system projections, strengthening their utility for resilience and adaptation planning.

Ganguli, Arkaprabha [Argonne National Laboratory (↗
DOE OSTI2021

Impact of solar geoengineering on temperatures over the Indonesian Maritime Continent

Climate change has been projected to increase the intensity and magnitude of extreme temperature in Indonesia. Solar radiation management (SRM) has been proposed as a strategy to temporarily combat global warming, buying time for negative emissions. Though the global impacts of SRM have been extensively studied in recent years, regional impacts, especially in the tropics, have received much less attention. This paper investigates the potential stratospheric sulfate aerosol geoengineering to modify mean and extreme temperature, as well as the relative humidity and wet bulb temperature (WBT) change over Indonesian Maritime Continent (IMC) based on simulations from three different earth system models. We applied statistical downscaling and corrected the bias of model output to reproduce historical temperatures and relative humidity over IMC. We compared SRM as specified by the Geoengineering Model Intercomparison Project (GeoMIP) G4 experiment – 5 Tg of SO 2 into the lower stratosphere between 2020 and 2069 – concurrent with the RCP4.5 emissions scenario. SRM is able to significantly reduce the temperature means and extremes, and although differences in magnitude of response and spatial pattern occur, there is a generally consistent response. Additionally, the spatial response of changes forced by RCP4.5 scenario and SRM impact is notably heterogeneous in the archipelago, highlighting uncertainties that would be critical in assessing socio-economic consequences of both doing, and not doing SRM. In general, SRM has bigger impacts in reducing temperatures over land than oceans, and the southern monsoon region shows more variability. SRM is also effective at reducing the likelihood of WBT > 27OC events compared to RCP4.5 after some years of SRM deployment as well as during the post-termination period of SRM. Regional downscaling may be an effective tool in obtaining policy-relevant information about local effects of different future scenarios involving SRM.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Reducing impacts of artificial ponding in modeling salt marshes using a conductivity-formulated subgrid model

The landforms of salt marsh systems are rather complex, with meandering channel networks cutting through low-lying, extensive marsh platforms. Some small-scale topographic details are critical to flooding and draining processes but cannot be reflected in the Digital Elevation Model (DEM) due to limited measurement resolution and vegetation bias. Numerical models need a grid with high enough resolution to capture the small-scale connectivity to correctly model the small-scale flow processes, making the model computationally unaffordable. Here, in this study, we derived a subgrid model, which couples two flow components, one is the regular subgrid model for simulating the subgrid-resolved flows, and the other is a conductivity-formulated porous flow model for modeling small-scale gut flows unresolved at the subgrid level. The model validation was performed using an idealized case with a narrow slot that was unresolved in the coupled flow model. Model results were compared with a slot-resolved regular subgrid model where only surface flows are solved and suggested that, with a proper model parameterization, the coupled flow model is capable of reproducing flooding and draining processes similar to the slot-resolved subgrid model of surface flow. The model was applied to simulating flooding and draining processes in a meso-tidal salt marsh. The model results demonstrate that the coupled subgrid model can be used to reduce the impacts of artificial ponding that usually occur in numerical simulations of salt marshes with numerous narrow gullies and creeks.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Generating Mixed Patterns of Residential Segregation: An Evolutionary Approach

The Schelling model of residential segregation has demonstrated that even the slightest preference for neighbors of the same race can be amplified into community-wide segregation. However, these models are unable to simulate mixed, coexisting patterns of segregation and integration, which have been seen to exist in cities. Using evolutionary model discovery we demonstrate how including social factors beyond racial bias when modeling relocation behavior enables the emergence of strongly mixed patterns. Our results indicate that the emergence of mixed patterns is better explained by multiple factors influencing the decision to relocate; the most important being the interaction of nonlinear, rapidly diminishing racial bias with a recent, historical tendency to move. Additionally, preference for less isolated neighborhoods or preference for neighborhoods with longer residing neighbors may produce weaker mixed patterns. Finally, this work highlights the importance of exploring the influence of multiple hypothesized factors of decision making, and their interactions, within agent rules, when studying emergent outcomes generated by agent-based models of complex social systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Understanding water and energy fluxes in the Amazonia: Lessons from an observation‐model intercomparison

Abstract Tropical forests are an important part of global water and energy cycles, but the mechanisms that drive seasonality of their land‐atmosphere exchanges have proven challenging to capture in models. Here, we (1) report the seasonality of fluxes of latent heat (LE), sensible heat ( H ), and outgoing short and longwave radiation at four diverse tropical forest sites across Amazonia—along the equator from the Caxiuanã and Tapajós National Forests in the eastern Amazon to a forest near Manaus, and from the equatorial zone to the southern forest in Reserva Jaru; (2) investigate how vegetation and climate influence these fluxes; and (3) evaluate land surface model performance by comparing simulations to observations. We found that previously identified failure of models to capture observed dry‐season increases in evapotranspiration (ET) was associated with model overestimations of (1) magnitude and seasonality of Bowen ratios (relative to aseasonal observations in which sensible was only 20%–30% of the latent heat flux) indicating model exaggerated water limitation, (2) canopy emissivity and reflectance (albedo was only 10%–15% of incoming solar radiation, compared to 0.15%–0.22% simulated), and (3) vegetation temperatures (due to underestimation of dry‐season ET and associated cooling). These partially compensating model‐observation discrepancies (e.g., higher temperatures expected from excess Bowen ratios were partially ameliorated by brighter leaves and more interception/evaporation) significantly biased seasonal model estimates of net radiation ( R n ), the key driver of water and energy fluxes (LE ~ 0.6 R n and H ~ 0.15 R n ), though these biases varied among sites and models. A better representation of energy‐related parameters associated with dynamic phenology (e.g., leaf optical properties, canopy interception, and skin temperature) could improve simulations and benchmarking of current vegetation–atmosphere exchange and reduce uncertainty of regional and global biogeochemical models.

Restrepo‐Coupe, Natalia↗
DOE OSTI2023

An empirical approach to model selection: weak lensing and intrinsic alignments

ABSTRACT In cosmology, we routinely choose between models to describe our data, and can incur biases due to insufficient models or lose constraining power with overly complex models. In this paper, we propose an empirical approach to model selection that explicitly balances parameter bias against model complexity. Our method uses synthetic data to calibrate the relation between bias and the χ2 difference between models. This allows us to interpret χ2 values obtained from real data (even if catalogues are blinded) and choose a model accordingly. We apply our method to the problem of intrinsic alignments – one of the most significant weak lensing systematics, and a major contributor to the error budget in modern lensing surveys. Specifically, we consider the example of the Dark Energy Survey Year 3 (DES Y3), and compare the commonly used non-linear alignment (NLA) and tidal alignment and tidal torque (TATT) models. The models are calibrated against bias in the Ωm–S8 plane. Once noise is accounted for, we find that it is possible to set a threshold Δχ2 that guarantees an analysis using NLA is unbiased at some specified level Nσ and confidence level. By contrast, we find that theoretically defined thresholds (based on, e.g. p-values for χ2) tend to be overly optimistic, and do not reliably rule out cosmological biases up to ∼1–2σ. Considering the real DES Y3 cosmic shear results, based on the reported difference in χ2 from NLA and TATT analyses, we find a roughly $30{{\ \rm per\ cent}}$ chance that were NLA to be the fiducial model, the results would be biased (in the Ωm–S8 plane) by more than 0.3σ. More broadly, the method we propose here is simple and general, and requires a relatively low level of resources. We foresee applications to future analyses as a model selection tool in many contexts.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Empirical Validation of UBEM: An Assessment of Bias in Urban Building Energy Modeling for Chicago

Residential and commercial buildings currently account for 30% of total global final energy consumption. Urban-scale building energy modeling (UBEM) can enable scalable investments and unlock building improvements by quantifying energy, demand, emissions, and cost reductions of specific measures or packages for building-specific technologies in large geographic regions. While the sophistication of UBEM data sources and technologies have increased dramatically in the past decade, there remains a knowledge gap for empirical validation and sources of bias between building-specific energy models and measured data at varying geographic scales.As UBEM continues to develop, systemic analysis of accuracy, bias, and limitations of the resulting models is necessary to inform best practices and move toward standardization. These are characterized for the Automatic Building Energy Modeling (AutoBEM) software suite with an initial case study involving metered electricity consumption data from 247,188 buildings in Chicago, Illinois, USA - averaged across years 2019-2021 - compared to the following datasets: (1) the AutoBEM-generated nation-scale Model America version 2 (MAv2) data for 596,064 buildings, (2) tax assessor data for 579,829 buildings, (3) tax assessor data filled with MAv2, and (4) 102 representative dynamic archetypes. The accuracy is reported for every building type and vintage combination, along with multiple sources of bias for unique building descriptors. The AutoBEM simulation workflow produced energy consumption estimates that closely match aggregated metered electricity consumption data for different types of buildings constructed during various time periods at the city scale - with initial normalized mean bias error of 10.9%, and 1.1% after removing outliers. Contribution of statistically significant factors including building type, land use, age, and size to variance in UBEM bias is quantified.

Garg, Ankur↗