Search NASA⌕ Search

SEARCH · Search NASA

Results for “model bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Satellite-based evaluation of AeroCom model bias in biomass burning regions

Global models are widely used to simulate biomass burning aerosol (BBA). Exhaustive evaluations on model representation of aerosol distributions and properties are fundamental to assess health and climate impacts of BBA. Here we conducted a comprehensive comparison of Aerosol Comparisons between Observations and Models (AeroCom) project model simulations with satellite observations. A total of 59 runs by 18 models from three AeroCom Phase-III experiments (i.e., biomass burning emissions, CTRL16, and CTRL19) and 14 satellite products of aerosols were used in the study. Aerosol optical depth (AOD) at 550 nm was investigated during the fire season over three key fire regions reflecting different fire dynamics (i.e., deforestation-dominated Amazon, Southern Hemisphere Africa where savannas are the key source of emissions, and boreal forest burning in boreal North America). The 14 satellite products were first evaluated against AErosol RObotic NETwork (AERONET) observations, with large uncertainties found. But these uncertainties had small impacts on the model evaluation that was dominated by modeling bias. Through a comparison with Polarization and Directionality of the Earth’s Reflectances measurements with the Generalized Retrieval of Aerosol and Surface Properties algorithm (POLDER-GRASP), we found that the modeled AOD values were biased by –93 % to 152 %, with most models showing significant underestimations even for the state-of-the-art aerosol modeling techniques (i.e., CTRL19). By scaling up BBA emissions, the negative biases in modeled AOD were significantly mitigated, although it yielded only negligible improvements in the correlation between models and observations, and the spatial and temporal variations in AOD biases did not change much. For models in CTRL16 and CTRL19, the large diversity in modeled AOD was in almost equal measures caused by diversity in emissions, lifetime, and the mass extinction coefficient (MEC). We found that in the AeroCom ensemble, BBA lifetime correlated significantly with particle deposition (as expected) and in turn correlated strongly with precipitation. Additional analysis based on Cloud-Aerosol LIdar with Orthogonal Polarization (CALIOP) aerosol profiles suggested that the altitude of the aerosol layer in the current models was generally too low, which also contributed to the bias in modeled lifetime. Modeled MECs exhibited significant correlations with the Ångström exponent (AE, an indicator of particle size). Comparisons with the POLDER-GRASP-observed AE suggested that the models tended to overestimate the AE (underestimated particle size), indicating a possible underestimation of MECs in models. The hygroscopic growth in most models generally agreed with observations and might not explain the overall underestimation of modeled AOD. Our results imply that current global models contain biases in important aerosol processes for BBA (e.g., emissions, removal, and optical properties) that remain to be addressed in future research.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Hyper Suprime-Cam Year 3 results: Cosmology from galaxy clustering and weak lensing with HSC and SDSS using the minimal bias model

Here, we present cosmological parameter constraints from a blind joint analysis of three two-point correlation functions measured from the Year 3 Hyper Suprime-Cam (HSC-Y3) imaging data, covering about 416 deg 2 , and the SDSS DR11 spectroscopic galaxies spanning the redshift range [0.15, 0.70]. We subdivide the SDSS galaxies into three luminosity-cut, and therefore nearly volume-limited samples separated in redshift, each of which acts as a large-scale structure tracer characterized by the measurement of the projected correlation function, w p ⁡(R). We also use the measurements of the galaxy-galaxy weak-lensing signal Δ⁢Σ⁡(R) for each of these SDSS samples which act as lenses for a secure sample of source galaxies selected from the HSC-Y3 shape catalog based on their photometric redshifts. We combine these measurements with the cosmic shear correlation functions, ξ ± ⁡($\vartheta$) measured for our HSC source sample. We model these observables with the minimal bias model of the galaxy clustering observables in the context of a flat Λ⁢CDM cosmology. We use conservative scale cuts, R >12 and 8⁢ℎ -1 Mpc for Δ⁢Σ and w p , respectively, where the minimal bias model is valid, in addition to conservative prior on the residual bias in the mean redshift of the HSC photometric source galaxies. We present various validation tests of our model as well as analysis methods. Our baseline analysis yields S 8 = $0.77⁢5^{+0.043}_{-0.038}$ (68% C.I.) for the Λ⁢CDM model, after marginalizing over uncertainties in other parameters. Our value of S 8 is consistent with that from the Planck 2018 data, but the credible interval of our result is still relatively large. We show that various internal consistency tests based on different splits of the data are passed. Our results are statistically consistent with those of a companion paper, which extends this analysis to smaller scales with an emulator-based halo model, using Δ⁢Σ⁡(R) and w p ⁡(R) down to R >3 and 2⁢ℎ -1 Mpc, respectively.

79 ASTRONOMY AND ASTROPHYSICS↗

A fully Lagrangian, non-parametric bias model for dark matter halos

Here, we present a non-parametric Lagrangian biasing model and fit the ratio of the halo and mass densities at the field level using the mass-weighted halo field in the AbacusSummit simulations at z=0.5. Unlike the perturbative halo bias model that has been widely used in interpreting the observed large-scale structure traced by galaxies, we find a non-negative halo-to-mass ratio that increases monotonically with the linear overdensity δ 1 in the initial Lagrangian space. The bias expansion, however, does not guarantee non-negativity of the halo counts, and may lead to rising halo number counts at negative overdensities. The shape of the halo-to-mass ratio is unlikely to be described by a polynomial function of δ 1 and other quantities. Especially for massive halos with 6×10 12 h -1 M ⊙ , the halo-to-mass ratio starts soaring up at δ 1 >0, substantially different from the predictions of the bias expansion. We show that for the halo masses we consider (M>3×10 11 h -1 M ⊙ ) a non-parametric halo-to-mass ratio as a function of δ 1 and its local derivative ∇^2δ 1 can recover the halo power spectra to sub-percent level accuracy for wavenumbers k=0.01-0.1 h Mpc -1 given a proper smoothing scale to filter the initial density field, even though we do not fit the power spectrum directly. However, there is mild dependence of the recovery of the halo power spectrum on the smoothing scale and other input parameters. At k<0.01 h Mpc -1 and for massive halos with M>6x10 12 h -1 M ⊙ , our non-parametric model leads to a few percent overestimation of the halo power spectrum, indicating the need for larger or multiple smoothing scales. The halo-to-mass ratios obtained qualitatively agree with intuitions from extended Press-Schechter theory. We compare our framework to the bias expansion and discuss possible extensions.

79 ASTRONOMY AND ASTROPHYSICS↗

Implications of a Pervasive Climate Model Bias for Low‐Cloud Feedback

Abstract How low clouds respond to warming constitutes a key uncertainty for climate projections. Here we observationally constrain low‐cloud feedback through a controlling factor analysis based on ridge regression. We find a moderately positive global low‐cloud feedback (0.45 W , 90% range 0.18–0.72 W ), about twice the mean value (0.22 W ) of 16 models from the Coupled Model Intercomparison Project. We link this discrepancy to a pervasive model mean‐state bias: models underestimate the low‐cloud response to warming because (a) they systematically underestimate present‐day tropical marine low‐cloud amount, and (b) the low‐cloud sensitivity to warming is proportional to this present‐day low‐cloud amount. Our results hence highlight the importance of reducing model biases in both the mean state of clouds and their sensitivity to environmental factors for accurate climate change projections.

58 GEOSCIENCES↗

Surface Salinity Under Transitioning Ice Cover in the Canada Basin: Climate Model Biases Linked to Vertical Distribution of Fresh Water

Abstract The Canada Basin has exhibited a significant trend toward a fresher surface layer and thus a more stratified upper‐ocean over the past three decades. State‐of‐the‐art ice‐ocean models, by contrast, tend to simulate a surface layer that is saltier and less stratified than observed. Here, we examine decadal changes to seasonal processes that may contribute to this wide‐reaching model bias using climate model simulations from the Community Earth System Model and below‐ice observations from the Arctic Ice Dynamics Joint Experiment in 1975 and Ice Tethered Profilers in 2006–2012. In contrast to the observations, the models simulate salinity profiles that show relatively little variation between 1975 and 2012. We demonstrate that this bias can be mainly attributed to unrealistically deep vertical mixing in the model, creating a surface layer that is saltier than observed. The results provide insight for climate model improvement with broad implications for Arctic sea ice and ecosystem dynamics.

58 GEOSCIENCES↗

Near-term tropical cyclone risk and coupled Earth system model biases

Most current climate models predict that the equatorial Pacific will evolve under greenhouse gas–induced warming to a more El Niño-like state over the next several decades, with a reduced zonal sea surface temperature gradient and weakened atmospheric Walker circulation. Yet, observations over the last 50 y show the opposite trend, toward a more La Niña-like state. Recent research provides evidence that the discrepancy cannot be dismissed as due to internal variability but rather that the models are incorrectly simulating the equatorial Pacific response to greenhouse gas warming. This implies that projections of regional tropical cyclone activity may be incorrect as well, perhaps even in the direction of change, in ways that can be understood by analogy to historical El Niño and La Niña events: North Pacific tropical cyclone projections will be too active, North Atlantic ones not active enough, for example. Other perils, including severe convective storms and droughts, will also be projected erroneously. While it can be argued that these errors are transient, such that the models’ responses to greenhouse gases may be correct in equilibrium, the transient response is relevant for climate adaptation in the next several decades. Given the urgency of understanding regional patterns of climate risk in the near term, it would be desirable to develop projections that represent a broader range of possible future tropical Pacific warming scenarios—including some in which recent historical trends continue—even if such projections cannot currently be produced using existing coupled earth system models.

Science & Technology - Other Topics↗

Model bias in simulating major chemical components of PM 2.5 in China

High concentrations of PM 2.5 (particulate matter with an aerodynamic diameter less than 2.5 µm) in China have caused severe visibility degradation. Accurate simulations of PM 2.5 and its chemical components are essential for evaluating the effectiveness of pollution control strategies and the health and climate impacts of air pollution. In this study, we compared the GEOS-Chem model simulations with comprehensive datasets for organic aerosol (OA), sulfate, nitrate, and ammonium in China. Model results are evaluated spatially and temporally against observations. The new OA scheme with a simplified secondary organic aerosol (SOA) parameterization significantly improves the OA simulations in polluted urban areas, highlighting the important contributions of anthropogenic SOA from semivolatile and intermediate-volatility organic compounds. The model underestimates sulfate and overestimates nitrate for most of the sites throughout the year. More significant underestimation of sulfate occurs in winter, while the overestimation of nitrate is extremely large in summer. The model is unable to capture some of the main features in the diurnal pattern of the PM 2.5 chemical components, suggesting inaccuracies in the presented processes. Potential model adjustments that may lead to a better representation of the boundary layer height, the precursor emissions, hydroxyl radical concentrations, the heterogeneous formation of sulfate and nitrate, and the wet deposition of nitric acid and nitrate have been tested in the sensitivity analysis. The results show that uncertainties in chemistry perhaps dominate the model biases. The proper implementation of heterogeneous sulfate formation and the good estimates of the concentrations of sulfur dioxide, hydroxyl radical, and aerosol liquid water are essential for the improvement of the sulfate simulation. The update of the heterogeneous uptake coefficient of nitrogen dioxide significantly reduces the modeled concentrations of nitrate. However, the large overestimation of nitrate concentrations remains in summer for all tested cases. The possible bias in the chemical production and the wet deposition of nitrate cannot fully explain the model overestimation of nitrate, suggesting issues related to the atmospheric removal of nitric acid and nitrate. A better understanding of the atmospheric nitrogen budget, in particular, the role of the photolysis of particulate nitrate, is needed for future model developments. Moreover, the results suggest that the remaining underestimation of OA in the model is associated with the underrepresented production of SOA.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Dark Energy Survey Year 3 Results: Constraints on cosmological parameters and galaxy bias models from galaxy clustering and galaxy-galaxy lensing using the redMaGiC sample

We constrain cosmological parameters and galaxy-bias parameters using the combination of galaxy clustering and galaxy-galaxy lensing measurements from the Dark Energy Survey Year-3 data. We describe our modeling framework and choice of scales analyzed, validating their robustness to theoretical uncertainties in small-scale clustering by analyzing simulated data. Using a linear galaxy bias model and redMaGiC galaxy sample, we obtain constraints on the matter content of the universe to be $\Omega_{\rm m} = 0.325^{+0.033}_{-0.034}$. We also implement a non-linear galaxy bias model to probe smaller scales that includes parameterizations based on hybrid perturbation theory, and find that it leads to a 17% gain in cosmological constraining power. Using the redMaGiC galaxy sample as foreground lens galaxies, we find the galaxy clustering and galaxy-galaxy lensing measurements to exhibit significant signals akin to decorrelation between galaxies and mass on large scales, which is not expected in any current models. This likely systematic measurement error biases our constraints on galaxy bias and the $S_8$ parameter. We find that a scale-, redshift- and sky-area-independent phenomenological decorrelation parameter can effectively capture this inconsistency between the galaxy clustering and galaxy-galaxy lensing. We perform robustness tests of our methodology pipeline and demonstrate stability of the constraints to changes in the theory model. After accounting for this decorrelation, we infer the constraints on the mean host halo mass of the redMaGiC galaxies from the large-scale bias constraints, finding the galaxies occupy halos of mass approximately $1.5 \times 10^{13} M_{\odot}/h$.

79 ASTRONOMY AND ASTROPHYSICS↗

Dark Energy Survey year 3 results: Constraints on cosmological parameters and galaxy-bias models from galaxy clustering and galaxy-galaxy lensing using the redMaGiC sample

We constrain cosmological parameters and galaxy-bias parameters using the combination of galaxy clustering and galaxy-galaxy lensing measurements from the Dark Energy Survey (DES) year-3 data. We describe our modeling framework and choice of scales analyzed, validating their robustness to theoretical uncertainties in small-scale clustering by analyzing simulated data. Using a linear galaxy-bias model and redMaGiC galaxy sample, we obtain 10% constraints on the matter density of the Universe. Here, we also implement a nonlinear galaxy-bias model to probe smaller scales that includes parametrization based on hybrid perturbation theory and find that it leads to a 17% gain in cosmological constraining power. We perform robustness tests of our methodology pipeline and demonstrate stability of the constraints to changes in the theory model. Using the redMaGiC galaxy sample as foreground lens galaxies and adopting the best-fitting cosmological parameters from DES year-1 data, we find the galaxy clustering and galaxy-galaxy lensing measurements to exhibit significant signals akin to decorrelation between galaxies and mass on large scales, which is not expected in any current models. This likely systematic measurement error biases our constraints on galaxy bias and the S 8 parameter. We find that a scale-, redshift- and sky-area-independent phenomenological decorrelation parameter can effectively capture this inconsistency between the galaxy clustering and galaxy-galaxy lensing. We trace the source of this correlation to a color-dependent photometric issue and minimize its impact on our result by changing the selection criteria of redMaGiC galaxies. Using this new sample, our constraints on the S 8 parameter are consistent with previous studies and we find a small shift in the Ω m constraints compared to the fiducial redMaGiC sample. We infer the constraints on the mean host-halo mass of the redMaGiC galaxies in this new sample from the large-scale bias constraints, finding the galaxies occupy halos of mass approximately 1.6 × 10 13 M ⊙ /h.

79 ASTRONOMY AND ASTROPHYSICS↗

Relating CMIP5 Model Biases to Seasonal Forecast Skill in the Tropical Pacific

Abstract We examine links between tropical Pacific mean state biases and El Niño/Southern Oscillation forecast skill, using model‐analog hindcasts of sea surface temperature (SST; 1961–2015) and precipitation (1979–2015) at leads of 0–12 months, generated by 28 different models from the fifth phase of the Coupled Model Intercomparison Project (CMIP5). Model‐analog forecast skill has been demonstrated to match or even exceed traditional assimilation‐initialized forecast skill in a given model. Models with the most realistic mean states and interannual variability for SST, precipitation, and 10‐m zonal winds in the equatorial Pacific also generate the most skillful precipitation forecasts in the central equatorial Pacific and the best SST forecasts at 6‐month or longer leads. These results show direct links between model climatological biases and seasonal forecast errors, demonstrating that model‐analog hindcast skill—that is, how well a model can capture the observed evolution of tropical Pacific anomalies—is an informative El Niño/Southern Oscillation metric for climate simulations.

Ding, Hui↗

Drivers of coupled climate model biases in representing Labrador Sea convection

Abstract This study investigates the representation of ocean convection in the Labrador Sea in seven Earth System Models (ESMs) from the Coupled Model Intercomparison Project Phase 5 and 6 datasets. The relative role of the oceanic and atmospheric biases in the subpolar North Atlantic gyre are explored using regional ocean simulations where the atmospheric forcing or the ocean initial and boundary conditions are replaced by reanalysis data in the absence of interactive air-sea coupling. Commonalities and differences among model behaviors are discussed with the objective of finding a pathway forward to improve the representation of the ocean mean state and variability in a region of fundamental importance for climate variability and change. Results highlight that an improved representation of ocean stratification in the North Atlantic subpolar gyre is urgently needed to constrain future climate change projections. While improving the ocean model resolution in the North Atlantic alone may contribute a better representation of both boundary currents and propagation of heat and freshwater anomalies into the Labrador Sea, it may not be sufficient. Addressing the atmospheric heat flux bias with better resolution in the atmosphere and land topography may allow for deep convection to occur in the Labrador Sea in some of the models that miss it entirely, but the greatest priority remains improving the representation of ocean stratification.

Liu, Guangpeng↗

Predicting High Energy Arcing Fault Zones of Influence for Aluminum Using an Arc Flash Modeling Approach: Evaluation of a model bias, uncertainty, parameter sensitivity and zone of influence estimation

This report documents the development of an arc flash hazard model to calculate the incident energy and zone of influence from high energy arcing faults involving aluminum. The NRC has identified the potential for (HEAFs) involving aluminum to increase the damage zone beyond what is currently postulated in fire probabilistic risk assessment (PRA) methodologies. To estimate the hazard from HEAFs involving aluminum an arc flash model was developed. Differences between the initial model and nuclear power plant (NPP) fire PRA scenarios were identified. Modification of the initial model established from existing literature and test data was used to minimize these differences. The developed model was evaluated against NRC datasets to understand the model prediction and relative uncertainties. Finally, a range of fire PRA zone of influences (ZOI) were developed based on the developed model, target fragility estimates and update HEAF PRA methodology. The results were developed to support an NRC LIC-504 evaluation in tandem with other modeling efforts. The report documents the effort and provides a reference for any future advancements in arc flash modeling.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Assessment of Updraft Modeling Bias Using Computational Fluid Dynamics

Golden Eagle (Aquila chrysaetos) habitats may overlap with wind energy development in some regions of the US. Eagles, and similar soaring bird species, are therefore at risk of collision with wind turbines when flying through wind farms. Recently developed behavioral modeling approaches can predict the presence of eagles near turbines within the rotor-swept layer but require reliable prediction of atmospheric flowfield conditions. In particular, the vertical component of the wind speed dictates a soaring bird's ability to maintain or gain altitude, since they rely on updrafts to subsidize their flight. In this work, we investigate the atmospheric conditions around a wind farm in complex terrain and compare methods for atmospheric characterization. We use computational fluid dynamics (specifically, large-eddy simulations, or LES) to simulate the atmospheric boundary layer over a region encompassing multiple wind farms with high temporal and spatial resolution (seconds and 10's of meters, respectively). We compare traditional non-simulation-based methods of determining the orographic updraft potential based on wind direction, terrain slope and aspect, with the flowfields from LES that include both orographic updrafts alone and combined thermal and orographic updrafts. Preliminary analysis suggests that although the model captures the horizontal pattern of vertical updrafts, their magnitude can be improved with information about the surface heat flux, which is usually correlated with time of the day. Within our study region, we found that the low-fidelity model may over- or underestimate updraft potential by up to 400% at 80 m AGL, depending on local orographic features. This can result in an inaccurate representation of eagle presence and, consequently, risk. Another important finding is that flowfield time-averaging can hide important details about the flight environment, including how thermally generated flow structures within the atmospheric boundary layer (e.g., convective rolls and/or cells) may be important drivers of eagle flight.

atmospheric turbulence↗

Perturbation theory for modeling galaxy bias: validation with simulations of the Dark Energy Survey

We describe perturbation theory (PT) models of galaxy bias for applications to photometric galaxy surveys. We model the galaxy-galaxy and galaxy-matter correlation functions in configuration space and validate against measurements from mock catalogs designed for the Dark Energy Survey (DES). We find that an effective PT model with five galaxy bias parameters provides a good description of the 3D correlation functions above scales of 4 Mpc/$h$ and $z < 1$. Our tests show that at the projected precision of the DES-Year 3 analysis, two of the non-linear bias parameters can be fixed to their co-evolution values, and a third (the $k^2$ term for higher derivative bias) set to zero. The agreement is typically at the 2 percent level over scales of interest, which is the statistical uncertainty of our simulation measurements. To achieve this level of agreement, our {\it fiducial} model requires using the full non-linear matter power spectrum (rather than the 1-loop PT one). We also measure the relationship between the non-linear and linear bias parameters and compare them to their expected co-evolution values. We use these tests to motivate the galaxy bias model and scale cuts for the cosmological analysis of the Dark Energy Survey; our conclusions are generally applicable to all photometric surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Analysis of secondary organic aerosol simulation bias in the Community Earth System Model (CESM2.1)

Organic aerosol (OA) has been considered as one of the most important uncertainties in climate modeling due to the complexity in presenting its chemical production and depletion mechanisms. To better understand the capability of climate models and probe into the associated uncertainties in simulating OA, we evaluate the Community Earth System Model version 2.1 (CESM2.1) configured with the Community Atmosphere Model version 6 (CAM6) with comprehensive tropospheric and stratospheric chemistry representation (CAM6-Chem) through a long-term simulation (1988–2019) with observations collected from multiple datasets in the United States. We find that CESM generally reproduces the interannual variation and seasonal cycle of OA mass concentration at surface layer with a correlation of 0.40 compared to ground observations and systematically overestimates (69%) in summer and underestimates (-19%) in winter. Through a series of sensitivity simulations, we reveal that modeling bias is primarily related to the dominant fraction of monoterpene-formed secondary organic aerosol (SOA), and a strong positive correlation of 0.67 is found between monoterpene emission and modeling bias in the eastern US during summer. In terms of vertical profile, the model prominently underestimates OA and monoterpene concentrations by 37%–99% and 82%–99%, respectively, in the upper air (>500 m) as validated against aircraft observations. Our study suggests that the current volatility basis set (VBS) scheme applied in CESM might be parameterized with monoterpene SOA yields that are too high, which subsequently results in strong SOA production near the emission source area. We also find that the model has difficulty in reproducing the decreasing trend of surface OA in the southeastern US probably because of employing pure gas VBS to represent isoprene SOA which is in reality mainly formed through multiphase chemistry; thus, the influence of aerosol acidity and sulfate particle change on isoprene SOA formation has not been fully considered in the model. This study reveals the urgent need to improve the SOA modeling in climate models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Density modification of cryo-EM maps

Density modification uses expectations about features of a map such as a flat solvent and expected distributions of density in the region of the macromolecule to improve individual Fourier terms representing the map. This process transfers information from one part of a map to another and can improve the accuracy of a map. Here, the assumptions behind density modification for maps from electron cryomicroscopy are examined and a procedure is presented that allows the incorporation of model-based information. Density modification works best in cases where unfiltered, unmasked maps with clear boundaries between the macromolecule and solvent are visible, and where there is substantial noise in the map, both in the region of the macromolecule and the solvent. It also is most effective if the characteristics of the map are relatively constant within regions of the macromolecule and the solvent. Model-based information can be used to improve density modification, but model bias can in principle occur. Here, model bias is reduced by using ensemble models that allow an estimation of model uncertainty. A test of model bias is presented that suggests that even if the expected density in a region of a map is specified incorrectly by using an incorrect model, the incorrect expectations do not strongly affect the final map.

59 BASIC BIOLOGICAL SCIENCES↗