Search NASA⌕ Search

SEARCH · Search NASA

Results for “model bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

An Extended Objective Evaluation of the 29-km Eta Model for Weather Support to the United States Space Program

This report describes the Applied Meteorology Unit's objective verification of the National Centers for Environmental Prediction 29-km eta model during separate warm and cool season periods from May 1996 through January 1998. The verification of surface and upper-air point forecasts was performed at three selected stations important for 45th Weather Squadron, Spaceflight Meteorology Group, and National Weather Service, Melbourne operational weather concerns. The statistical evaluation identified model biases that may result from inadequate parameterization of physical processes. Since model biases are relatively small compared to the random error component, most of the total model error results from day-to-day variability in the forecasts and/or observations. To some extent, these nonsystematic errors reflect the variability in point observations that sample spatial and temporal scales of atmospheric phenomena that cannot be resolved by the model. On average, Meso-Eta point forecasts provide useful guidance for predicting the evolution of the larger scale environment. A more substantial challenge facing model users in real time is the discrimination of nonsystematic errors that tend to inflate the total forecast error. It is important that model users maintain awareness of ongoing model changes. Such changes are likely to modify the basic error characteristics, particularly near the surface.

Nutter, Paul↗

Characterization of Transport Errors in Chemical Forecasts from a Global Tropospheric Chemical Transport Model

We propose a new methodology to characterize errors in the representation of transport processes in chemical transport models. We constrain the evaluation of a global three-dimensional chemical transport model (GEOS-CHEM) with an extended dataset of carbon monoxide (CO) concentrations obtained during the Transport and Chemical Evolution over the Pacific (TRACE-P) aircraft campaign. The TRACEP mission took place over the western Pacific, a region frequently impacted by continental outflow associated with different synoptic-scale weather systems (such as cold fronts) and deep convection, and thus provides a valuable dataset. for our analysis. Model simulations using both forecast and assimilated meteorology are examined. Background CO concentrations are computed as a function of latitude and altitude and subsequently subtracted from both the observed and the model datasets to focus on the ability of the model to simulate variability on a synoptic scale. Different sampling strategies (i.e., spatial displacement and smoothing) are applied along the flight tracks to search for systematic model biases. Statistical quantities such as correlation coefficient and centered root-mean-square difference are computed between the simulated and the observed fields and are further inter-compared using Taylor diagrams. We find no systematic bias in the model for the TRACE-P region when we consider the entire dataset (i.e., from the surface to 12 km ). This result indicates that the transport error in our model is globally unbiased, which has important implications for using the model to conduct inverse modeling studies. Using the First-Look assimilated meteorology only provides little improvement of the correlation, in comparison with the forecast meteorology. These general statements can be refined when the entire dataset is divided into different vertical domains, i.e., the lower troposphere (less than 2 km), the middle troposphere (2-6 km), and the upper troposphere (greater than 6 km). The best agreement between the observations and the model is found in the lower and middle troposphere. Downward displacements in the lower troposphere provide a better fit with the observed value, which could indicate a problem in the representation of boundary layer height in the model. Significant improvement is also found for downward and southward displacements in the upper troposphere. There are several potential sources of errors in our simulation of the continental outflow in the upper troposphere which could lead to such biases, including the location and/or the strength of deep convective cells as well as that of wildfires in Southeast Asia.

Bey, I.↗

Time Domain Tool Validation Using ARES I-X Flight Data

The ARES I-X vehicle was launched from NASA's Kennedy Space Center (KSC) on October 28, 2009 at approximately 11:30 EDT. ARES I-X was the first test flight for NASA s ARES I launch vehicle, and it was the first non-Shuttle launch vehicle designed and flown by NASA since Saturn. The ARES I-X had a 4-segment solid rocket booster (SRB) first stage and a dummy upper stage (US) to emulate the properties of the ARES I US. During ARES I-X pre-flight modeling and analysis, six (6) independent time domain simulation tools were developed and cross validated. Each tool represents an independent implementation of a common set of models and parameters in a different simulation framework and architecture. Post flight data and reconstructed models provide the means to validate a subset of the simulations against actual flight data and to assess the accuracy of pre-flight dispersion analysis. Post flight data consists of telemetered Operational Flight Instrumentation (OFI) data primarily focused on flight computer outputs and sensor measurements as well as Best Estimated Trajectory (BET) data that estimates vehicle state information from all available measurement sources. While pre-flight models were found to provide a reasonable prediction of the vehicle flight, reconstructed models were generated to better represent and simulate the ARES I-X flight. Post flight reconstructed models include: SRB propulsion model, thrust vector bias models, mass properties, base aerodynamics, and Meteorological Estimated Trajectory (wind and atmospheric data). The result of the effort is a set of independently developed, high fidelity, time-domain simulation tools that have been cross validated and validated against flight data. This paper presents the process and results of high fidelity aerospace modeling, simulation, analysis and tool validation in the time domain.

Hough, Steven↗

Evaluating Precipitation Features and Rainfall Characteristics in a Multi‐Scale Modeling Framework

Cloud and precipitation systems are simulated with a multi‐scale modeling framework (MMF) and compared over the Tropics and Subtropics against the Tropical Rainfall Measuring Mission (TRMM) Radar‐defined Precipitation Features (RPFs) product. A methodology, in close analogy to the TRMM RPFs, is developed to produce simulated precipitation features (PFs) from the output of the embedded two‐dimensional (2D) cloud‐resolving models (CRMs) within an MMF. Despite the limitations of 2D CRMs, the simulated population distribution, horizontal and vertical structure of PFs, and the geographical location and local rainfall contribution of mesoscale convective systems (MCSs) are in good agreement with the TRMM observations. However, some model discrepancies are found and can be identified and quantified within the PF distributions. Using model biases in relative population and rainfall contributions, PFs can be characterized into four size categories: small, medium to large, very large, and extremely large. Four different major mechanisms might account for the model biases in each different category: (1) the two‐dimensionality of the CRMs, (2) a positive convection‐wind‐evaporation feedback loop, (3) an artificial dynamic constraint in a bounded CRM domain with cyclic boundaries, and (4) the limited CRM domain size. The second and fourth mechanisms tend to contribute to the excessive tropical precipitation biases commonly found in most MMFs, whereas the other mechanisms reduce rainfall contributions from small and very large PFs. MMF sensitivity experiments with various CRM domain sizes and grid spacings showed that larger domains (higher resolutions) tend to shift PF populations toward larger (smaller) sizes.

Jiun-Dar Chern↗

Tropical Cyclones in the GEOS-S2S-2 Subseasonal Forecasts

This paper analyzes the climatology, prediction skill, and predictability of tropical cyclones (TCs) in NASA’s Global Earth Observing System Subseasonal to Seasonal (GEOS-S2S) forecast system version 2. GEOS reasonably simulates the number and spatial distribution of TCs compared to observations except in the Atlantic where the model simulates too few TCs due to low genesis rates in the Caribbean Sea and Gulf of Mexico. The environmental conditions, diagnosed through a genesis potential index, do not clearly explain model biases in the genesis rates, especially in the Atlantic. At the storm-scale, GEOS reforecasts replicate several key aspects of the thermodynamic and dynamic structure of observed TCs, such as a warm core and the secondary circulation. The model, however, fails to simulate an off-center eyewall when evaluating vertical velocity, precipitation and moisture. The analysis of prediction skill of TC genesis and occurrence shows that GEOS has comparable skill to other global models in WMO S2S archive and that its skill could be further improved by increasing the ensemble size. After calibration, GEOS forecasts are skillful in the Western North Pacific and Southern Indian Ocean up to 20 days in advance. A model-based predictability analysis demonstrates the importance of the Madden-Julian Oscillation (MJO) as a source of predictability of TC occurrence beyond the 14 day lead-time. Forecasts initialized under strong MJO conditions show evidence of predictability beyond week 3. However, due to model biases in the forecast distribution there are notable gaps between MJO-related prediction skill and predictability which require further study.

Jorge L. Garcia-Franco↗

Evaluating the Impact of Chemical Complexity and Horizontal Resolution on Tropospheric Ozone Over the Conterminous US With a Global Variable Resolution Chemistry Model

A new configuration of the Community Earth System Model (CESM)/Community Atmosphere Model with full chemistry (CAM-chem) supporting the capability of horizontal mesh refinement through the use of the spectral element (SE) dynamical core is developed and called CESM/CAM-chem-SE. Horizontal mesh refinement in CESM/CAM-chem-SE is unique and novel in that pollutants such as ozone are accurately represented at human exposure relevant scales while also directly including global feedbacks. CESM/CAM-chem-SE with mesh refinement down to ∼14 km over the conterminous US (CONUS) is the beginning of the Multi-Scale Infrastructure for Chemistry and Aerosols (MUSICAv0). Here MUSICAv0 is evaluated and used to better understand how horizontal resolution and chemical complexity impact ozone and ozone precursors over CONUS as compared to measurements from five aircraft campaigns, which occurred in 2013. This field campaign analysis demonstrates the importance of using finer horizontal resolution to accurately simulate ozone precursors such as nitrogen oxides and carbon monoxide. In general, the impact of using more complex chemistry on ozone and other oxidation products is more pronounced when using finer horizontal resolution where a larger number of chemical regimes are resolved. Large model biases for ozone near the surface remain in the Southeast US as compared to the aircraft observations even with updated chemistry and finer horizontal resolution. This suggests a need for adding the capability of replacing sections of global emission inventories with regional inventories, increasing the vertical resolution in the planetary boundary layer, and reducing model biases in meteorological variables such as temperature and clouds.

MUSICA↗

Reanalyses and Essential Climate Variables

Reanalyses are a potentially powerful climate data collection driven by observations but also subjected to model bias. Additionally, reanalyses can produce and use essential climate variables in a consistent method. For example, snow cover and soil moisture (among other variables) will eventually be assimilated into the reanalyses, but also provide crucial validation data. Sea surface temperature can be prescribed or assimilated in a coupled reanalysis. The strength of reanalysis lies in the ancillary data that is produced from the modeling components but not routinely observed thereby providing more complete Earth system information. The weakness in this concept is that the model derived data can be affected by model bias and may also change relative to the available observing system. Here, we will review the status of existing reanalyses and the ECVs being considered for the workshop. Purpose of Michael Bosilovich's contribution to the workshop: Michael Bosilovich will represent US reanalysis community in this international discussion of Essential Climate Variables (ECVs) and the relative nature of reanalyses to ECVs.

Bosilovich, Michael↗

Multi-Scale Three-Dimensional Variational Data Assimilation System for Coastal Ocean Prediction

A multi-scale three-dimensional variational data assimilation system (MS-3DVAR) has been formulated and the associated software system has been developed for improving high-resolution coastal ocean prediction. This system helps improve coastal ocean prediction skill, and has been used in support of operational coastal ocean forecasting systems and field experiments. The system has been developed to improve the capability of data assimilation for assimilating, simultaneously and effectively, sparse vertical profiles and high-resolution remote sensing surface measurements into coastal ocean models, as well as constraining model biases. In this system, the cost function is decomposed into two separate units for the large- and small-scale components, respectively. As such, data assimilation is implemented sequentially from large to small scales, the background error covariance is constructed to be scale-dependent, and a scale-dependent dynamic balance is incorporated. This scheme then allows effective constraining large scales and model bias through assimilating sparse vertical profiles, and small scales through assimilating high-resolution surface measurements. This MS-3DVAR enhances the capability of the traditional 3DVAR for assimilating highly heterogeneously distributed observations, such as along-track satellite altimetry data, and particularly maximizing the extraction of information from limited numbers of vertical profile observations.

Li, Zhijin↗

Diagnosing Bias in Modeled Soil Moisture/runoff Coefficient Correlation Using the SMAP Level 4 Soil Moisture Product

The physical parameterization of key processes in land surface models (LSMs) remains uncertain, and new techniques are required to evaluate LSM accuracy over coarse spatial scales. Given the role of soil moisture in the partitioning of surface water fluxes (between infiltration, runoff and evapotranspiration), surface soil moisture (SSM) estimates represent an important observational benchmark for such evaluations. Here, we apply SSM estimates from the NASA Soil Moisture Active Passive Level 4 product (SMAP_L4) to diagnose bias in the coupling between SSM and surface runoff for multiple Noah-Multiple Physics (Noah-MP) LSM parameterization cases. Results demonstrate that Noah-MP surface runoff parameterizations often underestimate the coupling strength between pre-storm SSM and the event-scale runoff coefficient (RC; defined as the ratio between event-scale streamflow and precipitation volumes). This bias squanders RC information contained in pre-storm SSM and reduces RC estimation skill. Such bias can be quantified against an observational benchmark calculated using streamflow observations and SMAP_L4 SSM and applied to explain a substantial fraction of the observed basin-to-basin (and case-to-case) variability in the skill of event-scale Noah-MP RC estimates. Based on this concept, a novel case selection strategy for ungauged basins is introduced and demonstrated to successfully identify poorly performing Noah-MP parameterization cases.

SSM↗

Incorporating affective bias in models of human decision making

Research on human decision making has traditionally focused on how people actually make decisions, how good their decisions are, and how their decisions can be improved. Recent research suggests that this model is inadequate. Affective as well as cognitive components drive the way information about relevant outcomes and events is perceived, integrated, and used in the decision making process. The affective components include how the individual frames outcomes as good or bad, whether the individual anticipates regret in a decision situation, the affective mood state of the individual, and the psychological stress level anticipated or experienced in the decision situation. A focus of the current work has been to propose empirical studies that will attempt to examine in more detail the relationships between the latter two critical affective influences (mood state and stress) on decision making behavior.

Nygren, Thomas E.↗

TPSAS-NF1676L-31979-DND

The rapid, and in many cases, unprecedented changes in the Arctic climate system observed since 1979 are having devastating impacts on both natural and human systems. These changes are marked by warming Arctic temperatures, rapid declines in sea ice and snow cover, permafrost thaw, mountain glacier melt, and Greenland Ice Sheet mass loss. A common thread through each of these changes is the impact on the surface energy budget. However, our understanding of the controls on and variability of the Arctic surface energy budget is incomplete and this contributes to the significant biases in the climate models. To better understand the controls on the variability of the Arctic surface energy budget and CMIP5 model biases, we use an atmospheric regime-based perspective of the Arctic surface energy budget decomposing variability by atmospheric dynamic and thermodynamic properties.

Patrick C. Taylor↗

Modeling the smoky troposphere of the southeast Atlantic: a comparison to ORACLES airborne observations from September of 2016

In the southeast Atlantic, well-defined smoke plumes from Africa advect over marine boundary layer cloud decks; both are most extensive around September, when most of the smoke resides in the free troposphere. A framework is put forth for evaluating the performance of a range of global and regional atmospheric composition models against observations made during the NASA ORACLES (ObseRvations of Aerosols above CLouds and their intEractionS) airborne mission in September 2016. A strength of the comparison is a focus on the spatial distribution of a wider range of aerosol composition and optical properties than has been done previously. The sparse airborne observations are aggregated into approximately 2° grid boxes and into three vertical layers: 3–6 km, the layer from cloud top to 3 km, and the cloud-topped marine boundary layer. Simulated aerosol extensive properties suggest that the flight-day observations are reasonably representative of the regional monthly average, with systematic deviations of 30 % or less. Evaluation against observations indicates that all models have strengths and weaknesses, and there is no single model that is superior to all the others in all metrics evaluated. Whereas all six models typically place the top of the smoke layer within 0–500 m of the airborne lidar observations, the models tend to place the smoke layer bottom 300–1400 m lower than the observations. A spatial pattern emerges, in which most models underestimate the mean of most smoke quantities (black carbon, extinction, carbon monoxide) on the diagonal corridor between 16° S, 6° E, and 10° S, 0° E, in the 3–6 km layer, and overestimate them further south, closer to the coast, where less aerosol is present. Model representations of the above-cloud aerosol optical depth differ more widely. Most models overestimate the organic aerosol mass concentrations relative to those of black carbon, and with less skill, indicating model uncertainties in secondary organic aerosol processes. Regional-mean free-tropospheric model ambient single scattering albedos vary widely, between 0.83 and 0.93 compared with in situ dry measurements centered at 0.86, despite minimal impact of humidification on particulate scattering. The modeled ratios of the particulate extinction to the sum of the black carbon and organic aerosol mass concentrations (a mass extinction efficiency proxy) are typically too low and vary too little spatially, with significant inter-model differences. Most models overestimate the carbonaceous mass within the offshore boundary layer. Overall, the diversity in the model biases suggests that different model processes are responsible. The wide range of model optical properties requires further scrutiny because of their importance for radiative effect estimates.

Yohei Shinozuka↗

Atmospheric Composition Forecast Model Evaluation Using Ozone Measurements Collected by the Langley Mobile Ozone Lidar

The Langley Mobile Ozone Lidar (LMOL) is a mobile ground based lidar system based at NASA Langley in Hampton, Virginia. Between 2022 and 2024, LMOL collected over 2500 hours of ozone measurements for a range of different atmospheric conditions, including calm days, stratospheric intrusions, surface frontal passages, and long-range transported wildfire smoke plumes. Here, the data is used to evaluate the forecast accuracy of NASA’s Global GEOS Composition Forecasting (GEOS-CF) model. GEOS-CF makes daily three-dimensional forecasts of trace gases and aerosol species. Overall, for calm periods, the forecast model predicts lower tropospheric ozone at NASA Langley with reasonable accuracy (within 20%). The model best predicts the timing and extent of stratospheric intrusions but often vary in the magnitude of the ozone mixing ratio. Among the other types of atmospheric conditions, there is more variability in the model forecasts. Based on this analysis, model forecasts are utilized to determine future data acquisition opportunities with the goal of providing feedback to the modeling teams, thereby enabling them to better understand the model biases and improve the model forecasts of ozone during these different atmospheric conditions.

Daniel B Phoenix↗

WRF Hindcasts of Cold Front Passages over the ARM Eastern North Atlantic Site: A Sensitivity Study

The present study explores the ability of the Weather Research and Forecasting (WRF) Model to accurately reproduce the passage of extratropical cold fronts at the DOE-ARM Eastern North Atlantic (ENA) observation site on the Azores Islands. An analysis of three case studies is performed in which the impact of the WRF domain size, position of the model boundary relative to the ENA site, grid spacing, and spectral nudging conditions are explored. The results from these case studies indicate that model biases in the timing and duration of cold front passages change with the distance between the model domain boundary and the ENA site. For these three cases, if the western model boundary is further than 1500 km from the site, the front becomes too meridional and fails to reach the site, making 1000 km or 1500 km the optimal distances. In contrast, integrations with small distances (e.g., 500 km) between the site and domain boundaries have inadequate spatial spin-up, i.e. the domain is too small for the model to properly stabilize. For all 3 cases, regardless of domain size, the model has biases in its upper-level circulation that impact the position and timing of the front. However, this issue is most serious for 4000 km2 domains and larger. For these domains, prolonged spectral nudging can correct cold front biases. As such, this analysis provides a framework to optimize the WRF model configuration necessary for a realistic hindcast of a cold front passage at a fixed location centered in a domain as large as computationally possible.

Faycal Lamraoui↗

Connections Between the Spring Breakup of the Southern Hemisphere Polar Vortex, Stationary Waves, and Air-sea Roughness

A robust connection between the drag on surface-layer winds and the stratospheric circulation is demonstrated in NASA's Goddard Earth Observing System Chemistry-Climate Model (GEOSCCM). Specifically, an updated parameterization of roughness at the air-sea interface, in which surface roughness is increased for moderate wind speeds (4ms to 20ms), leads to a decrease in model biases in Southern Hemispheric ozone, polar cap temperature, stationary wave heat flux, and springtime vortex breakup. A dynamical mechanism is proposed whereby increased surface roughness leads to improved stationary waves. Increased surface roughness leads to anomalous eddy momentum flux convergence primarily in the Indian Ocean sector (where eddies are strongest climatologically) in September and October. The localization of the eddy momentum flux convergence anomaly in the Indian Ocean sector leads to a zonally asymmetric reduction in zonal wind and, by geostrophy, to a wavenumber-1 stationary wave pattern. This tropospheric stationary wave pattern leads to enhanced upwards wave activity entering the stratosphere. The net effect is an improved Southern Hemisphere vortex: the vortex breaks up earlier in spring (i.e., the spring late-breakup bias is partially ameliorated) yet is no weaker in mid-winter. More than half of the stratospheric biases appear to be related to the surface wind speed biases. As many other chemistry climate models use a similar scheme for their surface layer momentum exchange and have similar biases in the stratosphere, we expect that results from GEOSCCM may be relevant for other climate models.

air-sea interaction↗

A Global Data Assimilation System for Atmospheric Aerosol

We will give an overview of an aerosol data assimilation system which combines advances in remote sensing of atmospheric aerosols, aerosol modeling and data assimilation methodology to produce high spatial and temporal resolution 3D aerosol fields. Initially, the Goddard Aerosol Assimilation System (GAAS) will assimilate TOMS, AVHRR and AERONET observations; later we will include MODIS and MISR. This data assimilation capability will allows us to integrate complementing aerosol observations from these platforms, enabling the development of an assimilated aerosol climatology as well as a global aerosol forecasting system in support of field campaigns. Furthermore, this system provides an interactive retrieval framework for each aerosol observing satellites, in particular TOMS and AVHRR. The Goddard Aerosol Assimilation System (GAAS) takes advantage of recent advances in constituent data assimilation at DAO, including flow dependent parameterizations of error covariances and the proper consideration of model bias. For its prognostic transport model, GAAS will utilize the Goddard Ozone, Chemistry, Aerosol, Radiation and Transport (GOCART) model developed at NASA/GSFC Codes 916 and 910.3. GOCART includes the Lin-Rood flux-form, semi-Langrangian transport model with parameterized aerosol chemistry and physical processes for absorbing (dust and black carbon) and non-absorbing aerosols (sulfate and organic carbon). Observations and model fields are combined using a constituent version of DAO's Physical-space Statistical Analysis System (PSAS), including its adaptive quality control system. In this talk we describe the main components of this assimilation system and present preliminary results obtained by assimilating TOMS data.

daSilva, Arlindo↗

Modeling Phenological Controls on Carbon Dynamics in Dryland Sagebrush Ecosystems

Dryland ecosystems play an important role in determining how precipitation anomalies affect terrestrial carbonfluxes at regional to global scales. Thus, to understand how climate change may affect the global carbon cycle,we must also be able to understand and model its effects on dryland vegetation. Dynamic Global VegetationModels (DGVMs) are an important tool for modeling ecosystem dynamics, but they often struggle to reproduceseasonal patterns of plant productivity. Because the phenological niche of many plant species is linked to bothtotal productivity and competitive interactions with other plants, errors in how process-based models representphenology hinder our ability to predict climate change impacts. This may be particularly problematic in drylandecosystems where many species have developed a complex phenology in response to seasonal variability in bothmoisture and temperature. Here, we examine how uncertainty in key parameters as well as the structure ofexisting phenology routines affect the ability of a DGVM to match seasonal patterns of leaf area index (LAI) andgross primary productivity (GPP) across a temperature and precipitation gradient. First, we optimized modelparameters using a combination of site-level eddy covariance data and remotely-sensed LAI data. Second, wemodified the model to include a semi-deciduous phenology type and added flexibility to the representation ofgrass phenology. While optimizing parameters reduced model bias, the largest gains in model performance wereassociated with the development of our new representation of phenology. This modified model was able to bettercapture seasonal patterns of both leaf area index (R2=0.75) and gross primary productivity (R2=0.84), thoughits ability to estimate total annual GPP depended on using eddy covariance data for optimization. The new modelalso resulted in a more realistic outcome of modeled competition between grass and shrubs. These findingsdemonstrate the importance of improving how DGVMs represent phenology in order to accurately forecastclimate change impacts in dryland ecosystems.

Ecosystem model Phenology Parameter optimization E↗