Search NASA⌕ Search

SEARCH · Search NASA

Results for “model bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

A Comparative Study of Cloud Properties Between Northern and Southern High Latitudes Based on ARM Observations and EAMv2 Simulations

Earth's high-latitude regions show a considerable amount of cloud coverage, which significantly affects global radiation budgets. Here, in this study, we examine ground- and ship-based remote sensing observations from two Atmospheric Radiation Measurement (ARM) field campaigns conducted in the high-latitude regions of Northern and Southern Hemispheres (NH and SH). A comparison of macrophysical properties for low, mid-level, high, and deep clouds shows that the cloud top heights and thickness values are higher in the Arctic for each cloud type compared with the Southern Ocean and Antarctic regions, possibly due to higher sea surface temperatures in the north Atlantic. The Arctic also shows lower ice phase occurrence frequencies compared with the SH high latitudes for low clouds. For high, mid-level and deep clouds, the cloud phase distributions as a function of temperature show small geographical variabilities. The observations are then compared with the Department of Energy (DOE) Energy Exascale Earth System Model (E3SM) to evaluate the representations of these cloud properties. Here, the results show that the model captures cloud base and top heights well and reproduces the differences in cloud macrophysical properties between the two hemispheres. But the model underestimates ice phase frequencies for all cloud types. Such model cloud phase bias is strongly correlated with positive relative humidity biases and negative aerosol number concentration biases, indicating an important role of relative humidity and aerosols in modulating cloud phase partitioning in the model.

54 ENVIRONMENTAL SCIENCES↗

Physics-informed regularization and structure preservation for learning stable reduced models from data with operator inference

Operator inference learns low-dimensional dynamical-system models with polynomial nonlinear terms from trajectories of high-dimensional physical systems (non-intrusive model reduction). Here, this work focuses on the large class of physical systems that can be well described by models with quadratic and cubic nonlinear terms and proposes a regularizer for operator inference that induces a stability bias onto learned models. The proposed regularizer is physics informed in the sense that it penalizes higher-order terms with large norms and so explicitly leverages the polynomial model form that is given by the underlying physics. This means that the proposed approach judiciously learns from data and physical insights combined, rather than from either data or physics alone. Additionally, a formulation of operator inference is proposed that enforces model constraints for preserving structure such as symmetry and definiteness in linear terms. Numerical results demonstrate that models learned with operator inference and the proposed regularizer and structure preservation are accurate and stable even in cases where using no regularization and Tikhonov regularization leads to models that are unstable.

97 MATHEMATICS AND COMPUTING↗

Uranium particle age dating, aggregation, and model age best estimators

We present important aspects of uranium particle age dating by Large-Geometry Secondary Ion Mass Spectrometry (LG-SIMS) that can introduce bias and increase model age uncertainties, especially for small, young, and/or low-enriched particles. This metrology is important for applications related to International Nuclear Safeguards. We explore influential factors related to model age estimation, including the effects of evolving surface chemistry on inter-element measurements of particles (e.g., Th and U), detector background, and aggregation methods using simulated and actual particle samples. We introduce a new model age estimator, called “mid68”, that supplements 95% confidence intervals, providing a “best estimate” and uncertainty about the most likely age. The mid68 estimator can be calculated using the Feldman and Cousins method or Bayesian methods and provides a value with a symmetric uncertainty that can be used for calculations and approximate aggregation of processed model age values when the raw data and correction factors are not available. For particles yielding low 230 Th counts amidst nonzero detector background, their underlying model age probability distributions are asymmetric, so the mid68 estimator provides additional robust information regarding the underlying model age likelihood. This study provides a comprehensive and timely examination of critical aspects of uranium particle age dating as more laboratories establish particle chronometry capabilities.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Microbial dormancy and its impacts on northern temperate and boreal terrestrial ecosystem carbon budget

A large amount of soil carbon in northern temperate and boreal regions could be emitted as greenhouse gases in a warming future. However, lacking detailed microbial processes such as microbial dormancy in current biogeochemistry models might have biased the quantification of the regional carbon dynamics. Here the effect of microbial dormancy was incorporated into a biogeochemistry model to improve the quantification for the last century and this century. Compared with the previous model without considering the microbial dormancy, the new model estimated the regional soils stored 75.9 Pg more C in the terrestrial ecosystems during the last century and will store 50.4 and 125.2 Pg more C under the RCP8.5 and RCP2.6 scenarios, respectively, in this century. This study highlights the importance of the representation of microbial dormancy in earth system models to adequately quantify the carbon dynamics in the northern temperate and boreal natural terrestrial ecosystems.

54 ENVIRONMENTAL SCIENCES↗

The winter central Arctic surface energy budget: A model evaluation using observations from the MOSAiC campaign

This study evaluates the simulation of wintertime (15 October, 2019, to 15 March, 2020) statistics of the central Arctic near-surface atmosphere and surface energy budget observed during the MOSAiC campaign with short-term forecasts from 7 state-of-the-art operational and experimental forecast systems. Five of these systems are fully coupled ocean-sea ice-atmosphere models. Forecast systems need to simultaneously simulate the impact of radiative effects, turbulence, and precipitation processes on the surface energy budget and near-surface atmospheric conditions in order to produce useful forecasts of the Arctic system. This study focuses on processes unique to the Arctic, such as, the representation of liquid-bearing clouds at cold temperatures and the representation of a persistent stable boundary layer. It is found that contemporary models still struggle to maintain liquid water in clouds at cold temperatures. Given the simple balance between net longwave radiation, sensible heat flux, and conductive ground flux in the wintertime Arctic surface energy balance, a bias in one of these components manifests as a compensating bias in other terms. This study highlights the different manifestations of model bias and the potential implications on other terms. Three general types of challenges are found within the models evaluated: representing the radiative impact of clouds, representing the interaction of atmospheric heat fluxes with sub-surface fluxes (i.e., snow and ice properties), and representing the relationship between stability and turbulent heat fluxes.

54 ENVIRONMENTAL SCIENCES↗

Assessment of WRF (v 4.2.1) dynamically downscaled precipitation on subdaily and daily timescales over CONUS

Abstract. This study analyzes the quality of simulated historical precipitation across the contiguous United States (CONUS) in a 12 km Weather Research and Forecasting model version 4.2.1 (WRF v 4.2.1)-based dynamical downscaling of the fifth-generation ECMWF atmospheric reanalysis (ERA5). This work addresses the following questions. First, how well are the 3 and 24 h precipitation characteristics (diurnal and annual cycles, precipitation frequency, annual and seasonal mean and maximum precipitation, and distribution of seasonal maximum precipitation) represented in the downscaled simulation, compared to ERA5? And second, how does the performance of the simulated WRF precipitation vary across seasons, regions, and timescales? Performance is measured against the National Centers for Environmental Prediction/Environmental Modeling Center (NCEP/EMC) 4 km Stage IV and Oregon State University Parameter-Elevation Regressions on Independent Slopes Model (PRISM) data on 3 and 24 h timescales, respectively. Our analysis suggests that the 12 km WRF exhibits biases typically found in other WRF simulations, including those at convection-permitting scales. In particular, WRF simulates both the timing and magnitude of the summer diurnal precipitation peak as well as ERA5 over most of the CONUS, except for a delayed diurnal peak over the Great Plains. As compared to ERA5, both the month and the magnitude of the precipitation peak annual cycle are remarkably improved in the downscaled WRF simulation. WRF slightly overestimates 3 and 24 h precipitation maximum over the CONUS, in contrast to ERA5, which generally underestimates these quantities mainly over the eastern half of the CONUS. Notably, WRF better captures the probability density distribution (PDF) of 3 and 24 h annual and seasonal maximum precipitation. WRF exhibits seasonally dependent precipitation biases across the CONUS, while ERA5's biases are relatively consistent year round over most of the CONUS. These results suggest that dynamical downscaling to a higher resolution improves upon some precipitation metrics but is susceptible to common regional climate model biases. Consequently, if used as input data for domain-specific models, we suggest moderate bias correction be applied to the dynamically downscaled product.

54 ENVIRONMENTAL SCIENCES↗

Understanding and Explicitly Measuring Linguistic and Stylistic Properties of Deception via Generation and Translation

Massive digital disinformation is one of the main risks of modern society. Hundreds of models and linguistic analyses have been done to compare and contrast misleading and credible content online. However, most models do not remove the confounding factor of a topic or narrative when training, so the resulting models learn a clear topical separation for misleading versus credible content. We study the feasibility of using two strategies to disentangle the topic bias from the models to understand and explicitly measure linguistic and stylistic properties of content from misleading versus credible content. First, we develop conditional generative models to create news content that is characteristic of different credibility levels. We perform multi-dimensional evaluation of model performance on mimicking both the style and linguistic differences that distinguish news of different credibility using machine translation metrics and classification models. We show that even though generative models are able to imitate both the style and language of the original content, additional conditioning on both the news category and the topic leads to reduced performance. In a second approach, we perform deception style ``transfer" by translating deceptive content into the style of credible content and vice versa. Extending earlier studies, we demonstrate that, when conditioned on a topic, deceptive content is shorter, less readable, more biased, and more subjective than credible content, and transferring the style from deceptive to credible content is more challenging than the opposite direction.

Saldanha, Emily G.↗

Non-parametric Lagrangian biasing from the insights of neural nets

We present a Lagrangian model of galaxy clustering bias in which we train a neural net using the local properties of the smoothed initial density field to predict the late-time mass-weighted halo field.By fitting the mass-weighted halo field in the AbacusSummit simulations at z = 0.5, we find that including three coarsely spaced smoothing scales gives the best recovery of the halo power spectrum. Adding more smoothing scales may lead to 2–5% underestimation of the large-scale power and can cause the neural net to overfit.We find that the fitted halo-to-mass ratio can be well described by two directions in the original high-dimension feature space.Projecting the original features into these two principal components and re-training the neural net either reproduces the original training result, or outperforms it with a better match of the halo power spectrum. The elements of the principal components are unlikely to be assigned physical meanings, partly owing to the features being highly correlated between different smoothing scales.Our work illustrates a potential need to include multiple smoothing scales when studying galaxy bias, and this can be done easily with machine-learning methods that can take in high dimensional input feature space.

79 ASTRONOMY AND ASTROPHYSICS↗

Explicit Representation of Orographic Anisotropy for All Directions Improves Nanling Mountain Rainfall Simulation

Climate models exhibit significant rainfall bias in mountainous regions. One reason is the insufficient representation of orographic anisotropy in these models. In this study, we implement the orographic drag scheme with 3-D orographic anisotropy (all flow directions (AFD)) into a general circulation model and investigate its impact on Nanling rainfall simulation where models have systematic dry bias in the summer. It is shown that the AFD alleviated the Nanling mountain rainfall bias by over 60%. This is through an anomalous “lower-convergence-higher-divergence” deceleration pattern of the flow windward of the Nanling Mountains that enhanced vertical motion and low-level moisture convergence. The results suggest the importance of explicit orographic anisotropy representation in rainfall simulation in mountainous regions.

54 ENVIRONMENTAL SCIENCES↗

Correcting for Selection Biases in the Determination of the Hubble Constant from Time-Delay Cosmography

The time delay between multiple images of strongly lensed quasars has been used to infer the Hubble constant. The primary systematic uncertainty for time-delay cosmography is the mass-sheet transform (MST), which preserves the lensing observables while altering the inferred ⁠H 0 . The TDCOSMO collaboration used velocity dispersion measurements of lensed quasars and lensed galaxies to infer that mass sheets are present, which decrease the inferred H 0 by 8 per cent. Here, we test the assumption that the density profiles of galaxy–galaxy and galaxy–quasar lenses are the same. We use a composite star-plus-dark-matter mass profile for the parent deflector population and model the selection function for galaxy–galaxy and galaxy–quasar lenses. We find that a power-law density profile with an MST is a good approximation to a two-component mass profile around the Einstein radius, but we find that galaxy–galaxy lenses have systematically higher mass-sheet components than galaxy–quasar lenses. For individual systems, λ int correlates with the ratio of the half-light radius and Einstein radius of the lens. By propagating these results through the TDCOSMO hierarchical inference code, we find that H 0 is lowered by a further 3 per cent. Using a more recent measurement of velocity dispersions and our fiducial model for selection biases, we infer H 0 = 66 ± 4 (stat) ± 1 (model sys) ± 2 (measurement sys) km s -1 Mpc -1 for the TDCOSMO plus SLACS data set. The first residual systematic error is due to plausible alternative choices in modelling the selection function, and the second is an estimate of the remaining systematic error in the measurement of velocity dispersions for SLACS lenses. Accurate time-delay cosmography requires precise velocity dispersion measurements and accurate calibration of selection biases.

79 ASTRONOMY AND ASTROPHYSICS↗

One Stomatal Model to Rule Them All? Toward Improved Representation of Carbon and Water Exchange in Global Models

Abstract Stomatal conductance schemes that optimize with respect to photosynthetic and hydraulic functions have been proposed to address biases in land‐surface model (LSM) simulations during drought. However, systematic evaluations of both optimality‐based and alternative empirical formulations for coupling carbon and water fluxes are lacking. Here, we embed 12 empirical and optimization approaches within a LSM framework. We use theoretical model experiments to explore parameter identifiability and understand how model behaviors differ in response to abiotic changes. We also evaluate the models against leaf‐level observations of gas‐exchange and hydraulic variables, from xeric to wet forest/woody species spanning a mean annual precipitation range of 361–3,286 mm yr −1 . We find that models differ in how easily parameterized they are, due to: (a) poorly constrained optimality criteria (i.e., resulting in multiple solutions), (b) low influence parameters, (c) sensitivities to environmental drivers. In both the idealized experiments and compared to observations, sensitivities to variability in environmental drivers do not agree among models. Marked differences arise in sensitivities to soil moisture (soil water potential) and vapor pressure deficit. For example, stomatal closure rates at high vapor pressure deficit range between −45% and +70% of those observed. Although over half the new generation of stomatal schemes perform to a similar standard compared to observations of leaf‐gas exchange, two models do so through large biases in simulated leaf water potential (up to 11 MPa). Our results provide guidance for LSM development, by highlighting key areas in need for additional experimentation and theory, and by constraining currently viable stomatal hypotheses.

54 ENVIRONMENTAL SCIENCES↗

Towards Diverse and Representative Global Pretraining Datasets for Remote Sensing Foundation Models

The design of a pretraining dataset is emerging as a critical component for the generality of foundation models. In the remote sensing realm, large volumes of imagery and benchmark datasets exist that can be leveraged to pretrain foundation models, however using this imagery in absence of a well-crafted sampling strategy is inefficient and has the potential to create biased and less generalizable models. Here, we provide a discussion and vision for the curation and assessment of pretraining datasets for remote sensing geospatial foundation models. We highlight the importance of geographic, temporal, and image acquisition diversity and review possible strategies to enable such diversity at global scale. In addition to these characteristics, support for various spatial-temporal pretext tasks within the dataset is also critical. Ultimately, our primary objective is to place emphasis on and draw attention to the data curation stage of the foundation model development pipeline. By doing so, we think it is possible to reduce biases of geospatial foundation models, as well as enable broader generalization to downstream remote sensing tasks and applications.

Arndt, Jacob↗

Bias Correction and Statistical Downscaling of Future Solar Irradiance Projections Using the NSRDB

Assessing renewable energy resources under future climate scenarios has been highlighted to understand potential impacts of future climate change in renewable generation on the power sector. Climate model projection has been recognized by the renewable energy community as a useful data set to analyze the impacts of future climate change on renewable resources. However, future climate projections generated from general circulation models (GCMs) contain inherent biases that need to be corrected for accurate analysis of future projections of climate variables. In addition, the coarse spatiotemporal resolution of GCMs needs to be improved for regional climate studies. In this work, we develop statistical methods to downscale future projections of global horizontal irradiance (GHI) in a computationally efficient way. Our approach builds statistical downscaling models that correct bias of climate projection of GHI and downscale the future GHI projection from daily-scale to hourly-scale. The National Solar Radiation Database (NSRDB) is used to calibrate the statistical models and validate the downscaled GHI projections across the contiguous United State (CONUS). Preliminary results show that the statistical approach efficiently downscales climate projections of GHI with a nBIAS of 3%, nMAE of 34 % and nRMSE of 46% calculated against NSRDB for CONUS. This study describes the implemented methodology and initial results as well as future research to create high-resolution climate data sets for solar energy applications.

analytical models↗

How close are urban scale building simulations to measured data? Examining bias derived from building metadata in urban building energy modeling

Residential and commercial buildings in the United States accounted for 40% of total energy in 2020. Building energy modeling (BEM) is a useful tool that allows individuals, researchers, companies, or utilities to save energy by optimizing buildings through estimation of building technology savings and performance projection of building energy under various environmental conditions. Urban building energy modeling (UBEM) expands the scope beyond individual buildings to the buildings in a neighborhood, city, utility and more. Yet there is a knowledge gap in the literature as to how these models compare to measured data on an individual and aggregated basis. As UBEM data and methods continue to develop, it is important to consider the accuracy, bias, and limitations of the models. Here, nation-scale data and UBEM software suite named Automatic Building Energy Modeling (AutoBEM) was used to model 50,843 buildings in Chattanooga, Tennessee. The uncalibrated simulation results were compared to aggregated 15-minute electricity data for the year 2019 with visualizations highlighting sources of bias in building data and the AutoBEM framework while considering how they relate to other UBEM methods. Estimation of building type and year of constructions are found to be the major sources of bias. Accounting for the amount of conditioned area per building significantly improves the overall fit of the simulated energy use intensity. it was found that inherent variation in building energy use contributes to R 2 values between 0.008 and 0.095 across building types but slope values near 1 for the total number of buildings. This indicates the need for building aggregation for representative building energy modeling with data sources available at an urban scale while illustrating the need for additional individual building data and model improvement beyond the originally produced UBEM models for individual building analysis.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

sparse_bias

This is a python package used to fit an unknown function from data that potential contains systematic biases related to metadata. The model fits the unknown function and uses a Bayesian horseshoe prior model to impose sparsity on the bias terms. This code has been generalized from research code developed for AIACHNE into a package that should have more general application in a wider class of statistical models.

Walton, Noah↗

Differentiable physics-enabled closure modeling for Burgers’ turbulence

Abstract Data-driven turbulence modeling is experiencing a surge in interest following algorithmic and hardware developments in the data sciences. We discuss an approach using the differentiable physics paradigm that combines known physics with machine learning to develop closure models for Burgers’ turbulence. We consider the one-dimensional Burgers system as a prototypical test problem for modeling the unresolved terms in advection-dominated turbulence problems. We train a series of models that incorporate varying degrees of physical assumptions on an a posteriori loss function to test the efficacy of models across a range of system parameters, including viscosity, time, and grid resolution. We find that constraining models with inductive biases in the form of partial differential equations that contain known physics or existing closure approaches produces highly data-efficient, accurate, and generalizable models, outperforming state-of-the-art baselines. Addition of structure in the form of physics information also brings a level of interpretability to the models, potentially offering a stepping stone to the future of closure modeling.

97 MATHEMATICS AND COMPUTING↗

Future Climate Projections for South Florida: Improving the Accuracy of Air Temperature and Precipitation Extremes With a Hybrid Statistical Bias Correction Technique

Projecting future climate variables is essential for comprehending the potential impacts on hydroclimatic hazards like floods and droughts. Evaluating these impacts is challenging due to the coarse spatial resolution of global climate models (GCMs); therefore, bias correction is widely used. Here, we applied two statistical methods—standard empirical quantile mapping (EQM) and a hybrid approach, EQM with linear correction (EQM-LIN)—to bias correct precipitation and air temperature simulated by nine GCMs. We used historical observations from 20 weather stations across South Florida to project future climate under three shared socioeconomic pathways (SSPs). Compared to the EQM, the hybrid EQM-LIN method improved R 2 of daily quantiles by up to 30% over the historical period and improved MAE up to 70% in months that contain most extreme values. Projected extreme precipitation at the weather stations showed that, compared to the EQM-LIN, the EQM method underestimates the high quantiles by up to 26% in SSP585. The projected changes in annual maximum precipitation from historical period (1985–2014) to near future (2040–2069) and far future (2070–2100) were between 2% and 16% across the study area. Projected future precipitation suggested a slight decrease during summer but an increase in fall. This, along with rising summer temperatures, suggested that South Florida can experience rapid oscillations from warmer summers and increased flooding in fall under future climate. Additionally, our comparative analyses with globally and nationally downscaled studies showed that such coarse scale studies do not represent the climatic extremes well, particularly for high quantile precipitation.

54 ENVIRONMENTAL SCIENCES↗

The Effect of Inverter Loading Ratio on Energy Estimate Bias: Preprint

Subhourly effects, particularly variability in solar irradiance, can lead to underestimation of inverter clipping losses and overestimation of energy in hourly photovoltaic system performance models, particularly for systems with high inverter loading ratios. Direct simulation of this error can be complicated by factors such as the representation of spatial and temporal variability in hourly weather data and transient system conditions. In this work we take an alternative approach using real system power measurements to show that energy predictions from typical industry models suffer from a bias that increases with inverter loading ratio. We also show that this loading ratio-dependent bias is strongly correlated with an empirical subhourly inverter clipping bias derived from real power plant data. Finally, we show that this bias is not necessarily specific to any one model or weather dataset by recreating similar biases with alternatives of each.

clipping↗