Search NASA⌕ Search

SEARCH · Search NASA

Results for “model bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Covariance matrices for variance-suppressed simulations

ABSTRACT Cosmological N-body simulations provide numerical predictions of the structure of the Universe against which to compare data from ongoing and future surveys, but the growing volume of the Universe mapped by surveys requires correspondingly lower statistical uncertainties in simulations, usually achieved by increasing simulation sizes at the expense of computational power. It was recently proposed to reduce simulation variance without incurring additional computational costs by adopting fixed-amplitude initial conditions. This method has been demonstrated not to introduce bias in various statistics, including the two-point statistics of galaxy samples typically used for extracting cosmological parameters from galaxy redshift survey data, but requires us to revisit current methods for estimating covariance matrices of clustering statistics for simulations. In this work, we find that it is not trivial to construct covariance matrices analytically for fixed-amplitude simulations, but we demonstrate that ezmock (Effective Zel’dovich approximation mock catalogue), the most efficient method for constructing mock catalogues with accurate two- and three-point statistics, provides reasonable covariance matrix estimates for such simulations. We further examine how the variance suppression obtained by amplitude-fixing depends on three-point clustering, small-scale clustering, and galaxy bias, and propose intuitive explanations for the effects we observe based on the ezmock bias model.

79 ASTRONOMY AND ASTROPHYSICS↗

Dark Energy Survey Year 6 results: Galaxy-galaxy lensing

Here, we present galaxy-galaxy lensing measurements from the full six years of data from the Dark Energy Survey (DES Y6), covering 4031 deg 2 and used in the DES Y6 3×2 pt cosmological analysis. We use the Maglim++ lens sample, containing ∼9 million galaxies divided into six redshift bins, and the Metadetection source catalog, including ∼140 million galaxies divided into four redshift bins. The mean tangential shear signal achieves a total signal-to-noise ratio (S/N) of 173, corresponding to a 17% improvement over DES Y3. After applying the scale cuts used in the cosmological analysis, with 𝑅 min =6 Mpc/ℎ (4 Mpc/ℎ) for the linear (nonlinear) galaxy-bias model, the S/N is reduced to 75 (90). A comprehensive suite of validation tests demonstrates that the measurement is robust against observational and astrophysical systematics at the statistical precision required for the DES Y6 analysis. Although not used in the main cosmological analysis, we extract high signal-to-noise geometric shear-ratio measurements from the galaxy-galaxy lensing signal on small angular scales. These measurements provide an internal consistency check on the photometric redshift distributions and shear calibration used in the 3 ×2 pt analysis.

cosmological parameters↗

Quantifying uncertainty in physics-based predictions of rare-isotope production cross sections via Bayesian-inspired model averaging across nuclear mass tables

Accurate prediction of fragmentation cross sections is essential for rare-isotope beam production, planning new-isotope searches, and designing experiments to study the most exotic regions of the nuclear chart. However, existing reaction models and phenomenological cross-section parametrizations often exhibit significant deviations over broad regions of mass and charge. In this work, a Bayesian-inspired model-averaging framework is developed to combine abrasion-ablation (AA) calculations based on multiple nuclear mass tables into a single statistically weighted estimate. For the calibrated systems, the model weights are assigned empirically according to the relative quality of fit to measured cross sections, thereby reducing systematic model bias while preserving the underlying physics content of the AA description. The weights are constrained using proton-rich fragmentation data for the 78 Kr and 124 Xe projectiles. The resulting parameter trends are then propagated to the 92 Mo and 144 Sm systems through a controlled scaling procedure. In the present implementation, the excitation-energy prescription is fixed, while the averaging is performed across nuclear-mass inputs; the framework provides both weighted cross sections and associated uncertainty estimates. Applied to proton-rich fragmentation, the present approach provides a practical basis for interpolation and limited extrapolation in regions relevant to rare-isotope production. The resulting predictions are used to assess the production of very proton-rich nuclei, and candidate new isotopes are discussed.

Bayesian methods↗

Scalar and tensor resonances in $J/\psi $ radiative decays

We perform a systematic analysis of the J/ψ → γπ 0 π 0 and → γ$K$$^{0}_{S}$$K$$^{0}_{S}$ partial waves measured by BESIII. We use a large set of amplitude parametrizations to reduce the model bias. We determine the physical properties of seven scalar and tensor resonances in the 1–2.5GeV mass range. These include the well known f 0 (1500) and f 0 (1710), that are considered to be the primary glueball candidates. The hierarchy of resonance couplings determined from this analysis favors the latter as the one with the largest glueball component.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Aerosol–Ice Formation Closure: A Southern Great Plains Field Campaign

Prediction of ice formation in clouds presents one of the grand challenges in the atmospheric sciences. Immersion freezing initiated by ice-nucleating particles (INPs) is the dominant pathway of primary ice crystal formation in mixed-phase clouds, where supercooled water droplets and ice crystals coexist, with important implications for the hydrological cycle and climate. However, derivation of INP number concentrations from an ambient aerosol population in cloud-resolving and climate models remains highly uncertain. We conducted an aerosol–ice formation closure pilot study using a field-observational approach to evaluate the predictive capability of immersion freezing INPs. The closure study relies on collocated measurements of the ambient size-resolved and single-particle composition and INP number concentrations. The acquired particle data serve as input in several immersion freezing parameterizations, which are employed in cloud-resolving and climate models, for prediction of INP number concentrations. We discuss in detail one closure case study in which a front passed through the measurement site, resulting in a change of ambient particle and INP populations. We achieved closure in some circumstances within uncertainties, but we emphasize the need for freezing parameterization of potentially missing INP types and evaluation of the choice of parameterization to be employed. Overall, this closure pilot study aims to assess the level of parameter details and measurement strategies needed to achieve aerosol–ice formation closure. Furthermore, the closure approach is designed to accurately guide immersion freezing schemes in models, and ultimately identify the leading causes for climate model bias in INP predictions.

58 GEOSCIENCES↗

Automated Operational Forecasting of Monsoon Low Pressure Systems

Monsoon low pressure systems (LPSs) are the dominant rain-bearing weather system of South Asia, often producing extreme precipitation and hydrological disasters in a region inhabited by nearly two billion people. Despite the importance of these storms, no operational system has automatically identified and tracked LPS in real time in numerical weather prediction model output; many commonly used vortex-tracking algorithms are ill suited for monsoon LPS because of the weak winds and cold cores of these systems. Here, we describe a new system that uses optimized algorithms to identify monsoon LPS in short- to medium-range forecasts from the U.S. Global Ensemble Forecast System (GEFS) and a version of the deterministic Global Forecast System (GFS) adapted and used operationally by the Indian Institute of Tropical Meteorology (IITM). We also assess the historical performance of these models in forecasting South Asian monsoon LPS, comparing this with the performance of the Integrated Forecasting System of the ECMWF. We assess the accuracy of model predictions of LPS genesis, position, intensity, and precipitation rates for forecast lead times of 1–5 days, yielding quantitative information on model biases to guide operational forecasters and disaster managers. The system we introduce here could be extended to other low-latitude regions affected by dynamically weak, heavily precipitating atmospheric vortices that are often not included in tropical cyclone inventories.

54 ENVIRONMENTAL SCIENCES↗

WRF Modelling of Deep Convection and Hail for Wind Power Applications

Deep convection and the related occurrence of hail, intense precipitation and wind gusts represent a hazard to a range of energy infrastructure including wind turbine blades. Wind turbine blade leading edge erosion (LEE) is caused by the impact of falling hydrometeors onto rotating wind turbine blades. It is a major source of wind turbine maintenance costs and energy losses from wind farms. In the United States Southern Great Plains (SGP), where there is widespread wind energy development, deep convection and hail events are common, increasing the potential for precipitation-driven LEE. A 25-day Weather Research and Forecasting (WRF) model simulation conducted at convection-permitting resolution and using a detailed microphysics scheme is carried out for the SGP to evaluate the effectiveness in modelling the wind and precipitation conditions relevant to LEE potential. WRF output for these properties is evaluated using radar observations of precipitation (including hail) and reflectivity, in situ wind speed measurements and wind power generation. This research demonstrates some skill for the primary drivers of LEE. Wind speeds, rainfall rates and precipitation totals show good agreement with observations. Here, the occurrence of precipitation during power producing wind speeds is also shown to exhibit fidelity. Hail events frequently occur during periods when wind turbines are rotating and are especially important to LEE in the SGP. The presence of hail is modelled with a mean proportion correct of 0.77 and an odds ratio 4.55. Further research is needed to demonstrate sufficient model performance to be actionable for the wind energy industry and there is evidence for positive model bias in cloud reflectivity.

17 WIND ENERGY↗

Quantifying Heavy Precipitation throughout the Entire Tropical Cyclone Life Cycle

Abstract Tropical cyclones (TCs) and their associated precipitation can have devastating impacts on the areas affected, with outcomes ranging from mudslides to inland flash flooding. Previous studies have used a fixed radius around the TC to isolate storm-related precipitation. One previous study instead used a dynamic radius of 8 m s −1 winds, but the wind field of the TC can deteriorate or shift quickly after landfall or the onset of extratropical transition (ET). This study uses a dynamical radius derived from the 500-hPa geopotential height in and around the TC to define TC- and post-tropical cyclone (PTC)-related heavy precipitation, allowing for the analysis of precipitation with tropical origins after the official demise of the original TC. Climatologies are constructed, indicating a maximum in TC- and PTC-related heavy precipitation in the west North Pacific and a secondary maximum in the east North Pacific. PTC-related heavy precipitation accounts for as much as 40% of the annual heavy precipitation in the northwest portion of the west North Pacific basin and 3.13% of heavy precipitation globally. We observe that the major hurricane stage contributes on average 2.6% of the global TC- and PTC-related precipitation, while the less intense but more common tropical storm stages of the TC life cycle contribute 85.7% of this observed precipitation. This analysis framework can be further extended to assess model biases and climate projections of TC and PTC precipitation.

Meteorology & Atmospheric Sciences↗

Estimating epistemic uncertainty in soil parameters for nonlinear site response analyses: Introducing the Latin Hypercube Sampling technique

This study quantifies the effects of epistemic uncertainty in soil parameters on nonlinear (NL) site response analysis (SRA) results, validated against the data recorded at a well-instrumented geotechnical downhole array located in Japan. To this end, a one-dimensional soil column model of the Service Hall Array (SHA) near the Kashiwazaki-Kariwa Nuclear Power Plant (KKNPP) is developed using the finite element (FE) program LS-DYNA. The dynamic stress–strain relationship is characterized by a modified two-stage hyperbolic (MTH) NL backbone curve formulation capable of capturing soil behavior at both small- and large-shear strains. The model is then validated against the ground motion recordings to capture the model bias. The uncertainties associated with the shear-wave velocity profile (a small-strain soil property) and soil shear strength (a large-strain soil property) are incorporated in NL SRA to quantify their separate and joint randomization effects on the results. This study proposes using the Latin Hypercube Sampling (LHS) method as an efficient alternative to commonly used methods, such as Standard Monte Carlo (SMC), to account for uncertainty propagation in such reliability analysis. Both low-intensity and design-level records from the recordings at the SHA are applied to study the contribution of the small- and large-strain NL dynamic soil properties. Results from 46,200 NL FE analyses (23,100 per input motion) are presented. Measured and predicted site response, using recorded ground motions at this downhole array, is compared to assess the significance of soil parameter uncertainty on the observed ground motion dispersions. It is demonstrated that increasing the number of soft realizations and implementing higher level earthquake intensity lead to higher ground motion dispersion. Unlike past studies in randomization of Vs profiles with the SMC method, the LHS method is shown to have no significant effect on the predicted median surface response spectra and amplification factors (AFs) for this case study.

Engineering↗

Processes Associated with Boundary Layer Cloud Ice Phase Precipitation in the High Southern Latitudes (Final Technical Report)

This is a final technical report for DOE Award No. DE-SC0018995. Using data collected during the MARCUS deployment of the 2nd ARM mobile facility, this project sought to address the following scientific questions: 1. What are the conditions that govern phase partitioning in supercooled boundary layer clouds over the high latitude Southern Oceans? 2. To what extent are supercooled mixed phase clouds responsible for the high cloud fractions over the Southern Ocean and do these mixed phase clouds contribute to the model biases in absorbed shortwave radiation? 3. Can the cloud properties and phase partitioning over the Southern Ocean be linked to the underlying aerosol environment? 4. How do the aerosol properties at the surface vary spatially and seasonally over the high latitude Southern Ocean and what processes control these features? 5. How well defined are the atmospheric compositional boundaries between Southern Ocean marine, Antarctic free tropospheric, and Antarctic surface airmasses, and how does this influence the chemistry and physics of the Southern Ocean atmosphere? In this project we published three peer review journal articles that address these questions.

54 ENVIRONMENTAL SCIENCES↗

Validation of Exploding Wire Tests Using Alegra-NG

Exploding wire tests are used to characterize materials undergoing high voltage loading and to validate computational models in a simple configuration. In this report, the materials emphasized are gold, aluminum, copper and nickel wires. Model validation is presented using the nominal model (no uncertainty) in the form of heat maps (per material) that show model bias across scalar quantities and initial voltage. Mesh convergence and uncertainty quantification is also presented.

36 MATERIALS SCIENCE↗

Evaluation of interactive and prescribed agricultural ammonia emissions for simulating atmospheric composition in CAM-chem

Abstract. Ammonia (NH3) plays a central role in the chemistry of inorganic secondary aerosols in the atmosphere. The largest emission sector for NH3 is agriculture, where NH3 is volatilized from livestock wastes and fertilized soils. Although the NH3 volatilization from soils is driven by the soil temperature and moisture, many atmospheric chemistry models prescribe the emission using yearly emission inventories and climatological seasonal variations. Here we evaluate an alternative approach where the NH3 emissions from agriculture are simulated interactively using the process model FANv2 (Flow of Agricultural Nitrogen, version 2) coupled to the Community Atmospheric Model with Chemistry (CAM-chem). We run a set of 6-year global simulations using the NH3 emission from FANv2 and three global emission inventories (EDGAR, CEDS and HTAP) and evaluate the model performance using a global set of multi-component (atmospheric NH3 and NH4+, and NH4+ wet deposition) in situ observations. Over East Asia, Europe and North America, the simulations with different emissions perform similarly when compared with the observed geographical patterns. The seasonal distributions of NH3 emissions differ between the inventories, and the comparison to observations suggests that both FANv2 and the inventories would benefit from more realistic timing of fertilizer applications. The largest differences between the simulations occur over data-scarce regions. In Africa, the emissions simulated by FANv2 are 200 %–300 % higher than in the inventories, and the available in situ observations from western and central Africa, as well as NH3 retrievals from the Infrared Atmospheric Sounding Interferometer (IASI) instrument, are consistent with the higher NH3 emissions as simulated by FANv2. Overall, in simulating ammonia and ammonium concentrations over regions with detailed regional emission inventories, the inventories based on these details (HTAP, CEDS) capture the atmospheric concentrations and their seasonal variability the best. However these inventories cannot capture the impact of meteorological variability on the emissions, nor can these inventories couple the emissions to the biogeochemical cycles and their changes with climate drivers. Finally, we show with sensitivity experiments that the simulated time-averaged nitrate concentration in air is sensitive to the temporal resolution of the NH3 emissions. Over the CASTNET monitoring network covering the US, resolving the NH3 emissions hourly instead monthly reduced the positive model bias from approximately 80 % to 60 % of the observed yearly mean nitrate concentration. This suggests that some of the commonly reported overestimation of aerosol nitrate over the US may be related to unresolved temporal variability in the NH3 emissions.

54 ENVIRONMENTAL SCIENCES↗

Characterization of HRRR-simulated rotor layer wind speeds and clouds along the coast of California

Stratocumulus clouds, with their low cloud base and top, affect the atmospheric boundary layer wind and turbulence profile, thereby modulating wind energy resources. GOES satellite data reveal an abundance of stratocumulus clouds in the late spring and summer months off the coast of northern and central California, where there are active plans to deploy floating offshore wind farms at two lease areas (near Morro Bay and Humboldt). Since the fall of 2020, two buoys equipped with multiple instruments, including Doppler lidar, have been deployed for about 1 year in these wind farm lease areas to assess the rotor layer wind conditions in these locations. The objective of this study is to evaluate how well the High-Resolution Rapid Refresh (HRRR) model represents stratocumulus cloud characteristics and turbine-relevant rotor layer winds (surface to 300 m) by comparing HRRR simulations with buoy and satellite observations. We first find that the HRRR model reproduces the seasonal cycle of cloud top height reasonably well in these regions. However, during the warm season – especially at Morro Bay – the HRRR-simulated stratocumulus clouds tend to have lower tops by about 150 m and exhibit weaker diurnal cycles than satellite observations. Our analysis also shows that rotor layer wind speeds and vertical shear are stronger at Humboldt than at Morro Bay, and both are generally stronger under clear-sky conditions. Finally, the HRRR model bias in rotor layer wind speed is small under cloudy conditions but larger and dependent on observed wind speed under clear skies. Specifically, HRRR underestimates wind speeds at Morro Bay and overestimates them at Humboldt under clear-sky conditions.

17 WIND ENERGY↗

Validation of Weather Forecasting Products

Weather forecasting is a tool in which the Savannah River Site relies on to complete daily tasks. The importance and integrity of forecasting systems and models is of the utmost importance to safety at SRS. By comparing and contrasting model bias, the meteorologists and employees of the Atmospheric Technologies Group will be equipped with bias data to create more accurate forecasts. Thus, furthering the safety of individuals at SRS.

Gray, Avery↗

Dark Energy Survey Year 6 Results: Galaxy-galaxy lensing

We present galaxy--galaxy lensing (GGL) measurements from the full six years of data from the Dark Energy Survey (DES Y6), covering $4031\,\mathrm{deg}^2$ and used in the DES Y6 $3\times2$pt cosmological analysis. We use the MagLim++ lens sample, containing $\sim 9$ million galaxies divided into six redshift bins, and the Metadetection source catalog, including $\sim 140$ million galaxies divided into four redshift bins. The mean tangential shear signal achieves a total signal-to-noise ratio (S/N) of $173$, corresponding to a $17\%$ improvement over DES Y3. After applying the scale cuts used in the cosmological analysis, with $R_{\min}=6\,\mathrm{Mpc}/h$ ($4\,\mathrm{Mpc}/h$) for the linear (nonlinear) galaxy-bias model, the S/N is reduced to $75$ (90). A comprehensive suite of validation tests demonstrates that the measurement is robust against observational and astrophysical systematics at the statistical precision required for the DES Y6 analysis. Although not used in the main cosmological analysis, we extract high--signal-to-noise geometric shear-ratio measurements from the galaxy--galaxy lensing signal on small angular scales. These measurements provide an internal consistency check on the photometric redshift distributions and shear calibration used in the $3\times2$pt analysis.

Giannini, G. [Barcelona, IEEC; Chicago U., KICP; B↗

The Physics behind Precipitation Onset Bias in CMIP6 Models: The Pseudo-Entrainment Diagnostic and Trade-Offs between Lapse Rate and Humidity

Conditional instability and the buoyancy of plumes drive moist convection but have a variety of representations in model convective schemes. Vertical thermodynamic structure information from Atmospheric Radiation Measurement (ARM) sites and reanalysis (ERA5), satellite-derived precipitation (TRMM3b42), and diagnostics relevant for plume buoyancy are used to assess climate models. Previous work has shown that CMIP6 models represent moist convective processes more accurately than their CMIP5 counterparts. However, certain biases in convective onset remain pervasive among generations of CMIP modeling efforts. Here we diagnose these biases in a cohort of nine CMIP6 models with sub-daily output, assessing conditional instability in profiles of equivalent potential temperature θ e and saturation equivalent potential temperature θ es in comparison to a plume model with different mixing assumptions. Most models capture qualitative aspects of the θ es vertical structure, including a substantial decrease with height in the lower free troposphere associated with the entrainment of subsaturated air. We define a “pseudo-entrainment” diagnostic that combines subsaturation and a θ es measure of conditional instability similar to what entrainment would produce under the small-buoyancy approximation. This captures the trade-off between larger θ es lapse rates (entrainment of dry air) and small subsaturation (permits positive buoyancy despite high entrainment). This pseudo-entrainment diagnostic is also a reasonable indicator of the critical value of integrated buoyancy for precipitation onset. Models with poor θ e /θ es structure (those using variants of the Tiedtke Scheme) or low entrainment runs of CAM5, and models with low subsaturation, such as NASA-GISS, lie outside the observational range in this diagnostic.

54 ENVIRONMENTAL SCIENCES↗

Mechanisms behind the Springtime North Pacific ENSO Teleconnection Bias in Climate Models

Previous studies have shown that models overestimate the strength of ENSO teleconnections to the North Pacific during springtime, but the underlying reasons for this bias remain unknown. Here, in this work, the relative contributions from basic-state and thermodynamic/dynamic forcing factors are disentangled through idealized experiments with the Community Earth System Model and a range of stationary wave modeling experiments. It is revealed that in CESM1 the diabatic heating biases over the tropical Indian Ocean and tropical central-western Pacific jointly favor a cyclonic (anticyclonic) circulation bias to occur in the North Pacific during the springtime of El Niño (La Niña) events. On one hand, the difference in the modeled and observed climatological basic state does not lead to the bias formation directly, as the diabatic heating biases are the primary cause. On the other hand, the springtime basic state is conducive to a more vigorous stationary wave response to the biased diabatic heating than the wintertime state, and this explains why the teleconnection bias occurs during springtime but not in winter. An iterative bias-correction approach is then implemented in the atmospheric model component of CESM1 to verify the linkage between the tropical diabatic heating bias and the teleconnection bias. Moreover, this explanation is shown to be relevant in other models of phase 5 of the Coupled Model Intercomparison Project (CMIP5) as a strong relationship is found between biases in ENSO-related tropical central-western Pacific/Indian Ocean precipitation and North Pacific circulation across models in spring.

54 ENVIRONMENTAL SCIENCES↗

Evaluating Probabilistic Deep Learning Methods for Uncertainty Quantification of Precipitation Bias Correction

Climate models often exhibit biases in their precipitation predictions, particularly underestimating high-intensity events and overestimating low precipitation. Deep learning approaches offer promising solutions, but their epistemic uncertainty associated with a deep learning–based bias correction method has not previously been quantified for reliable downstream climate impact studies. While methods for capturing the epistemic uncertainty in deep learning frameworks exist, there is currently no consensus on the best method. In this work, we compare three uncertainty quantification (UQ) methods—Deep Ensembles (DEns), Monte Carlo Dropout (MCD), and Flipout—by assessing the reliability of their uncertainty estimates using standard measures such as sharpness and calibration. These UQ methods are applied to an existing deep learning precipitation bias correction model known as UFNet: a coupled U-Net and fully connected neural network. The methods utilized to assess the models’ uncertainties are 1) calibration, which ensures that the expected probabilities of the model align with reality and 2) sharpness, which is a measure of the precision of the model’s probabilistic predictions. Of the three UQ methods evaluated, the DEns and MCD methods demonstrated the best-calibrated performance (expected calibration error of 0.36 and 0.35, respectively), compared to Flipout (0.58). In contrast, Flipout had the sharpest predictions and the highest metric performance in bias correcting precipitation—especially for higher-order moments such as kurtosis with a spatial correlation of 72% compared to 32% and 55% spatial correlation for DEns and MCD, respectively. Of the three UQ methods, MCD was found to be the most suitable method for UQ purposes based on its calibration, sharpness, and computational requirements.

Bayesian methods↗