Search NASA⌕ Search

SEARCH · Search NASA

Results for “model bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Predicting High Energy Arcing Fault Zones of Influence for Aluminum Using an Arc Flash Modeling Approach: Evaluation of a model bias, uncertainty, parameter sensitivity and zone of influence estimation

This report documents the development of an arc flash hazard model to calculate the incident energy and zone of influence from high energy arcing faults involving aluminum. The NRC has identified the potential for (HEAFs) involving aluminum to increase the damage zone beyond what is currently postulated in fire probabilistic risk assessment (PRA) methodologies. To estimate the hazard from HEAFs involving aluminum an arc flash model was developed. Differences between the initial model and nuclear power plant (NPP) fire PRA scenarios were identified. Modification of the initial model established from existing literature and test data was used to minimize these differences. The developed model was evaluated against NRC datasets to understand the model prediction and relative uncertainties. Finally, a range of fire PRA zone of influences (ZOI) were developed based on the developed model, target fragility estimates and update HEAF PRA methodology. The results were developed to support an NRC LIC-504 evaluation in tandem with other modeling efforts. The report documents the effort and provides a reference for any future advancements in arc flash modeling.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Assessment of Updraft Modeling Bias Using Computational Fluid Dynamics

Golden Eagle (Aquila chrysaetos) habitats may overlap with wind energy development in some regions of the US. Eagles, and similar soaring bird species, are therefore at risk of collision with wind turbines when flying through wind farms. Recently developed behavioral modeling approaches can predict the presence of eagles near turbines within the rotor-swept layer but require reliable prediction of atmospheric flowfield conditions. In particular, the vertical component of the wind speed dictates a soaring bird's ability to maintain or gain altitude, since they rely on updrafts to subsidize their flight. In this work, we investigate the atmospheric conditions around a wind farm in complex terrain and compare methods for atmospheric characterization. We use computational fluid dynamics (specifically, large-eddy simulations, or LES) to simulate the atmospheric boundary layer over a region encompassing multiple wind farms with high temporal and spatial resolution (seconds and 10's of meters, respectively). We compare traditional non-simulation-based methods of determining the orographic updraft potential based on wind direction, terrain slope and aspect, with the flowfields from LES that include both orographic updrafts alone and combined thermal and orographic updrafts. Preliminary analysis suggests that although the model captures the horizontal pattern of vertical updrafts, their magnitude can be improved with information about the surface heat flux, which is usually correlated with time of the day. Within our study region, we found that the low-fidelity model may over- or underestimate updraft potential by up to 400% at 80 m AGL, depending on local orographic features. This can result in an inaccurate representation of eagle presence and, consequently, risk. Another important finding is that flowfield time-averaging can hide important details about the flight environment, including how thermally generated flow structures within the atmospheric boundary layer (e.g., convective rolls and/or cells) may be important drivers of eagle flight.

atmospheric turbulence↗
NASA NTRS2017

The North Pacific Summer Jet and Climate Extremes over North America: Mechanisms and Model Biases

The North Pacific summer jet (NPSJ) plays a critical role as a waveguide for weather systems and other sub-seasonal Rossby waves entering North America and therefore has a controlling influence on the warm season weather and climate extremes over much of the continent. In particular, much of the warm season precipitation that occurs over the central United States depends on subseasonal transients that are able to tap moisture from the Gulf of Mexico as they propagate across the continent. The GEOS-5 atmospheric general circulation model (AGCM), like many AGCMs, is deficient in the simulation of the NPSJ. It is shown that the deficiency is composed of: 1) a stunted jet in which the strongest winds are confined to the Asian continent, failing to extend across the North Pacific into the Gulf of Alaska as observed, and 2) a zonally symmetric poleward shift in the jet. These biases combine to impede the eastward propagation of the weather systems into the continent (the stunted jet), and deprive those systems that do enter the continent access to the moisture from the Gulf (the northward shift), leading to a dry bias over the central US. It is shown that the stunted jet bias is the result of too strong heating that occurs just south of the jet core over and near Tibet. Furthermore, it is shown that the poleward shift of the NPSJ can be corrected in the current GEOS-5 AGCM by increasing the vertical resolution. The implications of these results for improving warm season forecasts of extreme events will be discussed.

NPS↗
NASA NTRS2021

Tropospheric Age-of-Air: Influence of SF6 Emissions on Recent Surface Trends and Model Biases

The mean age since air was last at the Northern Hemisphere (NH) midlatitude surface is a fundamental property of tropospheric transport. Here we approximate the mean age in terms of an "SF6 age" (ΓSF6), derived from surface and aircraft measurements of SF6 that are broader in spatial scope and cover a longer time period (1997-2018) than considered previously. At the surface, ΓSF6 increases from near-zero values north of 30°N to ~1.5 years over the Southern Hemisphere (SH) extratropics, with the largest meridional gradients occurring in the tropics. By comparison, vertical gradients in ΓSF6 are weak throughout, with only slight increases/decreases with height in the NH/SH. The broader spatial coverage of the measurements reveals strong variations in the seasonal cycle of ΓSF6 within the (sub)tropics that are weaker over the Atlantic and Paci c oceans, compared to over the Indian Ocean. Observations from 2000-2018 reveal that the SF6 age at sites in the SH has been decreasing by ~0.12 yr/dec. However, this decrease is not due to changes in transport but, rather, is likely related to changes in emissions, which have increased globally and reportedly shifted from northern midlatitudes into the subtropics. Simulations, which reproduce the SF6 age trends, show no decreases in an age-of-air tracer, reinforcing the fact that ΓSF6 represents only an approximation to the mean age. Finally, the modeled SF6 ages are older than observed, by ~0.3-0.4 years throughout the southern extratropics. We show that this bias is partly related to an overestimation in simulated SF6 near emissions regions,

Mean age↗
NASA NTRS1988

A method for modeling bias in a person's estimates of likelihoods of events

It is of practical importance in decision situations involving risk to train individuals to transform uncertainties into subjective probability estimates that are both accurate and unbiased. We have found that in decision situations involving risk, people often introduce subjective bias in their estimation of the likelihoods of events depending on whether the possible outcomes are perceived as being good or bad. Until now, however, the successful measurement of individual differences in the magnitude of such biases has not been attempted. In this paper we illustrate a modification of a procedure originally outlined by Davidson, Suppes, and Siegel (3) to allow for a quantitatively-based methodology for simultaneously estimating an individual's subjective utility and subjective probability functions. The procedure is now an interactive computer-based algorithm, DSS, that allows for the measurement of biases in probability estimation by obtaining independent measures of two subjective probability functions (S+ and S-) for winning (i.e., good outcomes) and for losing (i.e., bad outcomes) respectively for each individual, and for different experimental conditions within individuals. The algorithm and some recent empirical data are described.

Nygren, Thomas E.↗
NASA NTRS2004

Model-Biased, Data-Driven Adaptive Failure Prediction

This final report, which contains a research summary and a viewgraph presentation, addresses clustering and data simulation techniques for failure prediction. The researchers applied their techniques to both helicopter gearbox anomaly detection and segmentation of Earth Observing System (EOS) satellite imagery.

Leen, Todd K.↗
DOE OSTI2020

Perturbation theory for modeling galaxy bias: validation with simulations of the Dark Energy Survey

We describe perturbation theory (PT) models of galaxy bias for applications to photometric galaxy surveys. We model the galaxy-galaxy and galaxy-matter correlation functions in configuration space and validate against measurements from mock catalogs designed for the Dark Energy Survey (DES). We find that an effective PT model with five galaxy bias parameters provides a good description of the 3D correlation functions above scales of 4 Mpc/$h$ and $z < 1$. Our tests show that at the projected precision of the DES-Year 3 analysis, two of the non-linear bias parameters can be fixed to their co-evolution values, and a third (the $k^2$ term for higher derivative bias) set to zero. The agreement is typically at the 2 percent level over scales of interest, which is the statistical uncertainty of our simulation measurements. To achieve this level of agreement, our {\it fiducial} model requires using the full non-linear matter power spectrum (rather than the 1-loop PT one). We also measure the relationship between the non-linear and linear bias parameters and compare them to their expected co-evolution values. We use these tests to motivate the galaxy bias model and scale cuts for the cosmological analysis of the Dark Energy Survey; our conclusions are generally applicable to all photometric surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Analysis of secondary organic aerosol simulation bias in the Community Earth System Model (CESM2.1)

Organic aerosol (OA) has been considered as one of the most important uncertainties in climate modeling due to the complexity in presenting its chemical production and depletion mechanisms. To better understand the capability of climate models and probe into the associated uncertainties in simulating OA, we evaluate the Community Earth System Model version 2.1 (CESM2.1) configured with the Community Atmosphere Model version 6 (CAM6) with comprehensive tropospheric and stratospheric chemistry representation (CAM6-Chem) through a long-term simulation (1988–2019) with observations collected from multiple datasets in the United States. We find that CESM generally reproduces the interannual variation and seasonal cycle of OA mass concentration at surface layer with a correlation of 0.40 compared to ground observations and systematically overestimates (69%) in summer and underestimates (-19%) in winter. Through a series of sensitivity simulations, we reveal that modeling bias is primarily related to the dominant fraction of monoterpene-formed secondary organic aerosol (SOA), and a strong positive correlation of 0.67 is found between monoterpene emission and modeling bias in the eastern US during summer. In terms of vertical profile, the model prominently underestimates OA and monoterpene concentrations by 37%–99% and 82%–99%, respectively, in the upper air (>500 m) as validated against aircraft observations. Our study suggests that the current volatility basis set (VBS) scheme applied in CESM might be parameterized with monoterpene SOA yields that are too high, which subsequently results in strong SOA production near the emission source area. We also find that the model has difficulty in reproducing the decreasing trend of surface OA in the southeastern US probably because of employing pure gas VBS to represent isoprene SOA which is in reality mainly formed through multiphase chemistry; thus, the influence of aerosol acidity and sulfate particle change on isoprene SOA formation has not been fully considered in the model. This study reveals the urgent need to improve the SOA modeling in climate models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS2019

Extratropical Cyclone Clouds in the GFDL Climate Model: Diagnosing Biases and the Associated Causes

The clouds in southern hemisphere extratropical cyclones generated by the GFDL climate model are analyzed against MODIS, CloudSat and CALIPSO cloud and precipitation observations. Two model versions are used: one is a developmental version of AM4, a model GFDL will utilize for CMIP6, the other is the same model with a different parameterization of moist convection. Both model versions predict a realistic top-of-atmosphere cloud cover in the southern oceans, within 5% of the observations. However, an examination of cloud cover transects in extratropical cyclones reveals a tendency in the models to overestimate high-level clouds (by differing amounts) and underestimate cloud cover at low-levels (again by differing amounts), especially in the post-cold frontal (PCF) region, when compared to observations. Focusing on only the models, their differences in high and mid-level clouds are consistent with their differences in convective activity and relative humidity (RH), but the same is not true for the PCF region. In this region, RH is higher in the model with less cloud fraction. These seemingly contradictory cloud and RH differences can be explained by differences in the cloud parameterization tuning parameters that ensure radiative balance. In the PCF region, the model cloud differences are smaller than either of the model biases with respect to observations, suggesting other physics changes are needed to address the bias. The process-oriented analysis used to assess these model differences will soon be automated and shared.

Catherine M Naud↗
DOE OSTI2020

Density modification of cryo-EM maps

Density modification uses expectations about features of a map such as a flat solvent and expected distributions of density in the region of the macromolecule to improve individual Fourier terms representing the map. This process transfers information from one part of a map to another and can improve the accuracy of a map. Here, the assumptions behind density modification for maps from electron cryomicroscopy are examined and a procedure is presented that allows the incorporation of model-based information. Density modification works best in cases where unfiltered, unmasked maps with clear boundaries between the macromolecule and solvent are visible, and where there is substantial noise in the map, both in the region of the macromolecule and the solvent. It also is most effective if the characteristics of the map are relatively constant within regions of the macromolecule and the solvent. Model-based information can be used to improve density modification, but model bias can in principle occur. Here, model bias is reduced by using ensemble models that allow an estimation of model uncertainty. A test of model bias is presented that suggests that even if the expected density in a region of a map is specified incorrectly by using an incorrect model, the incorrect expectations do not strongly affect the final map.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Galaxy bias in the era of LSST: perturbative bias expansions

Upcoming imaging surveys will allow for high signal-to-noise measurements of galaxy clustering at small scales. In this work, we present the results of the Rubin Observatory Legacy Survey of Space and Time (LSST) bias challenge, the goal of which is to compare the performance of different nonlinear galaxy bias models in the context of LSST Year 10 (Y10) data. Specifically, we compare two perturbative approaches, Lagrangian perturbation theory (LPT) and Eulerian perturbation theory (EPT) to two variants of Hybrid Effective Field Theory (HEFT), with our fiducial implementation of these models including terms up to second order in the bias expansion as well as nonlocal bias and deviations from Poissonian stochasticity. Here, we consider a variety of different simulated galaxy samples and test the performance of the bias models in a tomographic joint analysis of LSST-Y10-like galaxy clustering, galaxy-galaxy-lensing and cosmic shear. We find both HEFT methods as well as LPT and EPT combined with non-perturbative predictions for the matter power spectrum to yield unbiased constraints on cosmological parameters up to at least a maximal scale of k max = 0.4 Mpc -1 for all samples considered, even in the presence of assembly bias. While we find that we can reduce the complexity of the bias model for HEFT without compromising fit accuracy, this is not generally the case for the perturbative models. We find significant detections of non-Poissonian stochasticity in all cases considered, and our analysis shows evidence that small-scale galaxy clustering predominantly improves constraints on galaxy bias rather than cosmological parameters. These results therefore suggest that the systematic uncertainties associated with current nonlinear bias models are likely to be subdominant compared to other sources of error for tomographic analyses of upcoming photometric surveys, which bodes well for future galaxy clustering analyses using these high signal-to-noise data.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2005

The Contribution of CEOP Data to the Understanding and Modeling of Monsoon Systems

CEOP has contributed and will continue to provide integrated data sets from diverse platforms for better understanding of the water and energy cycles, and for validaintg models. In this talk, I will show examples of how CEOP has contributed to the formulation of a strategy for the study of the monsoon as a system. The CEOP data concept has led to the development of the CEOP Inter-Monsoon Studies (CIMS), which focuses on the identification of model bias, and improvement of model physics such as the diurnal and annual cycles. A multi-model validation project focusing on diurnal variability of the East Asian monsoon, and using CEOP reference site data, as well as CEOP integrated satellite data is now ongoing. Preliminary studies show that climate models have difficulties in simulating the diurnal signals of total rainfall, rainfall intensity and frequency of occurrence, which have different peak hours, depending on locations. Further more model diurnal cycle of rainfall in monsoon regions tend to lead the observed by about 2-3 hours. These model bias offer insight into lack of, or poor representation of, key components of the convective and stratiform rainfall. The CEOP data also stimulated studies to compare and contrasts monsoon variability in different parts of the world. It was found that seasonal wind reversal, orographic effects, monsoon depressions, meso-scale convective complexes, SST and land surface land influences are common features in all monsoon regions. Strong intraseasonal variability is present in all monsoon regions. While there is a clear demarcation of onset, breaks and withdrawal in the Asian and Australian monsoon region associated with climatological intraseasonal variabillity, it is less clear in the American and Africa monsoon regions. The examination of satellite and reference site data in monsoon has led to preliminary model experiments to study the impact of aerosol on monsoon variability. I will show examples of how the study of the dynamics of aerosol-water cycle interactions in the monsoon region, can be best achieved using the CEOP data and modeling strategy.

Lau, William K. M.↗
NASA NTRS2005

The contribution of CEOP data to the understanding and modeling of monsoon systems

CEOP has contributed and will continue to provide integrated data sets from diverse platforms for better understanding of the water and energy cycles, and for validating models. In this talk, I will show examples of how CEOP has contributed to the formulation of a strategy for the study of the monsoon as a system. The CEOP data concept has led to the development of the CEOP Inter-Monsoon Studies (CIMS), which focuses on the identification of model bias, and improvement of model physics such as the diurnal and annual cycles. A multi-model validation project focusing on diurnal variability of the East Asian monsoon, and using CEOP reference site data, as well as CEOP integrated satellite data is now ongoing. Similar validation projects in other monsoon regions are being started. Preliminary studies show that climate models have difficulties in simulating the diurnal signals of total rainfall, rainfall intensity and frequency of occurrence, which have different peak hours, depending on locations. Further more model diurnal cycle of rainfall in monsoon regions tend to lead the observed by about 2-3 hours. These model bias offer insight into lack of, or poor representation of key components of the convective,and stratiform rainfall. The CEOP data also stimulated studies to compare and contrasts monsoon variability in different parts of the world. It was found that seasonal wind reversal, orographic effects, monsoon depressions, meso-scale convective complexes, SST and land surface land influences are common features in all monsoon regions. Strong intraseasonal variability is present in all monsoon regions. While there is a clear demarcation of onset, breaks and withdrawal in the Asian and Australian monsoon region associated with climatological intraseasonal variability, it is less clear in the American and Africa monsoon regions. The examination of satellite and reference site data in monsoon has led to preliminary model experiments to study the impact of aerosol on monsoon variability. I will show examples of how the study of the dynamics of aerosol-water cycle interactions in the monsoon region, can be best achieved using the CEOP data and modeling strategy.

Lau, William K. M.↗
DOE OSTI2021

Regional-scale, sector-specific evaluation of global CO2 inversion models using aircraft data from the ACT-America project

We use vertical profiles of airborne measurements of CO2 from frontal cases during the summer 2016 Atmospheric Carbon and Transport – America (ACT-America) campaign to evaluate the skill of a set of ten global CO2 inversion models participating in the Orbiting Carbon Observatory – 2 (OCO-2) Model Intercomparison Project (MIP). Model errors and biases (model minus observation) were categorized by region (Mid-Atlantic, Midwest, and South), frontal sector (warm or cold), and transport model (predominantly Tracer Model 5 (TM5) and Goddard Earth Observing System – Chemistry (GEOS-Chem)). Overall, the inversions reproduce the general structures of the observed vertical profiles and the enhanced / depleted low-level CO2 in warm / cold sectors, but tend to underestimate the magnitude of the sector difference in each region. In the Midwest and South warm sectors, inversion biases were about 1 ppm above 1500 m AGL, though model spread (quantified by interquartile range) was often even smaller; below 1500 m AGL, model biases were negative and about -2 ppm near the surface. For the Midwest and South cold sectors, models had +2-3 ppm biases below 1500 m AGL, but with comparable model spread. Uniquely, in the Mid-Atlantic there was a consistent difference between TM5 and GEOS-Chem mole fractions for both sectors up to 3000 m AGL (TM5 lower by 2 ppm), on the order of the observation-relative biases. In the MidAtlantic TM5 inversions had negative biases in warm sectors, while GEOS-Chem inversions had positive biases in cold sectors. Possible reasons for the regional variability are discussed.

Gaudet, Brian J.↗