Results for “forecast uncertainty” — Page 8

NASA NTRS2012

The Use of Satellite-Measured Aerosol Optical Depth to Constrain Biomass Burning Emissions Source Strength in a Global Model GOCART

Small particles in the atmosphere, called "atmospheric aerosol" have a direct effect on Earth climate through scattering and absorbing sunlight, and also an indirect effect by changing the properties of clouds, as they interact with solar radiation as well. Aerosol typically stays in the atmosphere for several days, and can be transported long distances, affecting air quality, visibility, and human health not only near the source, but also far downwind. Smoke from vegetation fires is one of the main sources of atmospheric aerosol; other sources include anthropogenic pollution, dust, and sea salt. Chemistry transport models (CTMs) are among the major tools for studying the atmospheric and climate effects of aerosol. Due to the considerable variation of aerosol concentrations and properties on many temporal and spatial scales, and the complexity of the processes involved, the uncertainties in aerosol effects on climate are large, as is featured in the latest report of Intergovernmental Panel on Climate Change (IPCC) in 2007. Reducing this uncertainty in the models is very important both for predicting future climate scenarios and for regional air quality forecasting and mitigation. During vegetation fires, also called biomass burning (BB) events, complex mixture of gases and particles is emitted. The amount of BB emissions is usually estimated taking into account the intensity and size of the fire and the properties of burning vegetation. These estimates are input into CTMs to simulate BB aerosol. Unfortunately, due to large variability of fire and vegetation properties, the quantity of BB emissions is very difficult to estimate and BB emission inventories provide numbers that can differ by up to the order of magnitude in some regions. Larger uncertainties in data input make uncertainties in model output larger as well. A powerful way to narrow the range of possible model estimates is to compare model output to observations. We use satellite observations of aerosol properties, specifically aerosol optical depth, which is directly proportional to the amount of aerosol in the atmosphere, and compare it to the model output. Assuming the model represents aerosol transport and particle properties correctly, the amount of BB emissions determines the simulated aerosol optical depth. In this study, we explore the regional performance of 13 commonly used emission estimates. These are each input to global Goddard Chemistry Aerosol Radiation and Transport (GOCART) model. We then evaluate how well each emission estimate reproduces the smoke aerosol optical depth measured by the MODIS instrument. We compared GOCART-simulate aerosol optical depth with that measured from the satellite for 124 fire cases around the world during 2006 and 2007. We summarize the regional performance of each emission inventory and discuss reasons for their differences by considering the assumptions made during their development. We also show that because stronger wind disperses smoke plumes more readily, in cases with stronger wind, a larger increase in emission amount is needed to increase aerosol optical depth. In quiet, low-wind-speed environments, BB emissions produce a more significant increase in aerosol optical depth, other things being equal. Using the region-specific, quantitative relationships derived in our paper, together with the wind speed obtained from another source for a given fire case, we can constrain the amount of emission required in the model to reproduce the observations. The results of this paper are useful to the developers of BB emission inventories, as they show the strengths and weaknesses of individual emission inventories in different regions of the globe, and also for modelers who use these inventories and wish to improve their model results.

Petrenko, Mariya↗

NASA NTRS2024

Use of Forecast Atmosphere for Earth Entry, Descent, and Landing Modeling

Flight mechanics simulations are used to characterize the performance of Earth entry, descent, and landing vehicles. Atmospheric prediction models are often a key component of these simulations. Global atmospheric models are used for both engineering design due to their ability to define atmospheric properties over a large swath of locations and times as well as used for the availability of atmospheric uncertainties in the models that can be used in statistical performance analysis. However for day-of-flight operations, the use of forecast atmospheres based on more current measurements are beneficial to the accuracy of the performance prediction, including landing locations. Reanalysis of these forecasts can also be used for post-flight analysis, including trajectory reconstruction. This paper describes how forecast atmospheres can be beneficial for Earth entry, descent, and landing analysis and ways these models can be implemented in simulations.

Soumyo Dutta↗

NASA NTRS2012

Comparative Analysis of Upper Ocean Heat Content Variability from Ensemble Operational Ocean Analyses

Upper ocean heat content (HC) is one of the key indicators of climate variability on many time-scales extending from seasonal to interannual to long-term climate trends. For example, HC in the tropical Pacific provides information on thermocline anomalies that is critical for the longlead forecast skill of ENSO. Since HC variability is also associated with SST variability, a better understanding and monitoring of HC variability can help us understand and forecast SST variability associated with ENSO and other modes such as Indian Ocean Dipole (IOD), Pacific Decadal Oscillation (PDO), Tropical Atlantic Variability (TAV) and Atlantic Multidecadal Oscillation (AMO). An accurate ocean initialization of HC anomalies in coupled climate models could also contribute to skill in decadal climate prediction. Errors, and/or uncertainties, in the estimation of HC variability can be affected by many factors including uncertainties in surface forcings, ocean model biases, and deficiencies in data assimilation schemes. Changes in observing systems can also leave an imprint on the estimated variability. The availability of multiple operational ocean analyses (ORA) that are routinely produced by operational and research centers around the world provides an opportunity to assess uncertainties in HC analyses, to help identify gaps in observing systems as they impact the quality of ORAs and therefore climate model forecasts. A comparison of ORAs also gives an opportunity to identify deficiencies in data assimilation schemes, and can be used as a basis for development of real-time multi-model ensemble HC monitoring products. The OceanObs09 Conference called for an intercomparison of ORAs and use of ORAs for global ocean monitoring. As a follow up, we intercompared HC variations from ten ORAs -- two objective analyses based on in-situ data only and eight model analyses based on ocean data assimilation systems. The mean, annual cycle, interannual variability and longterm trend of HC have been analyzed

Xue, Yan↗

NASA NTRS2006

Convective Weather Forecast Quality Metrics for Air Traffic Management Decision-Making

Since numerical weather prediction models are unable to accurately forecast the severity and the location of the storm cells several hours into the future when compared with observation data, there has been a growing interest in probabilistic description of convective weather. The classical approach for generating uncertainty bounds consists of integrating the state equations and covariance propagation equations forward in time. This step is readily recognized as the process update step of the Kalman Filter algorithm. The second well known method, known as the Monte Carlo method, consists of generating output samples by driving the forecast algorithm with input samples selected from distributions. The statistical properties of the distributions of the output samples are then used for defining the uncertainty bounds of the output variables. This method is computationally expensive for a complex model compared to the covariance propagation method. The main advantage of the Monte Carlo method is that a complex non-linear model can be easily handled. Recently, a few different methods for probabilistic forecasting have appeared in the literature. A method for computing probability of convection in a region using forecast data is described in Ref. 5. Probability at a grid location is computed as the fraction of grid points, within a box of specified dimensions around the grid location, with forecast convection precipitation exceeding a specified threshold. The main limitation of this method is that the results are dependent on the chosen dimensions of the box. The examples presented Ref. 5 show that this process is equivalent to low-pass filtering of the forecast data with a finite support spatial filter. References 6 and 7 describe the technique for computing percentage coverage within a 92 x 92 square-kilometer box and assigning the value to the center 4 x 4 square-kilometer box. This technique is same as that described in Ref. 5. Characterizing the forecast, following the process described in Refs. 5 through 7, in terms of percentage coverage or confidence level is notionally sound compared to characterizing in terms of probabilities because the probability of the forecast being correct can only be determined using actual observations. References 5 through 7 only use the forecast data and not the observations. The method for computing the probability of detection, false alarm ratio and several forecast quality metrics (Skill Scores) using both the forecast and observation data are given in Ref. 2. This paper extends the statistical verification method in Ref. 2 to determine co-occurrence probabilities. The method consists of computing the probability that a severe weather cell (grid location) is detected in the observation data in the neighborhood of the severe weather cell in the forecast data. Probabilities of occurrence at the grid location and in its neighborhood with higher severity, and with lower severity in the observation data compared to that in the forecast data are examined. The method proposed in Refs. 5 through 7 is used for computing the probability that a certain number of cells in the neighborhood of severe weather cells in the forecast data are seen as severe weather cells in the observation data. Finally, the probability of existence of gaps in the observation data in the neighborhood of severe weather cells in forecast data is computed. Gaps are defined as openings between severe weather cells through which an aircraft can safely fly to its intended destination. The rest of the paper is organized as follows. Section II summarizes the statistical verification method described in Ref. 2. The extension of this method for computing the co-occurrence probabilities in discussed in Section HI. Numerical examples using NCWF forecast data and NCWD observation data are presented in Section III to elucidate the characteristics of the co-occurrence probabilities. This section also discusses the procedure for computing throbabilities that the severity of convection in the observation data will be higher or lower in the neighborhood of grid locations compared to that indicated at the grid locations in the forecast data. The probability of coverage of neighborhood grid cells is also described via examples in this section. Section IV discusses the gap detection algorithm and presents a numerical example to illustrate the method. The locations of the detected gaps in the observation data are used along with the locations of convective weather cells in the forecast data to determine the probability of existence of gaps in the neighborhood of these cells. Finally, the paper is concluded in Section V.

Chatterji, Gano B.↗

NASA NTRS2023

Improved Space Weather Observations and Modeling for Aviation Radiation

In recent years there has been a growing interest from the aviation community for space weather radiation forecasts tailored to the needs of the aviation industry. In 2019 several space weather centers began issuing advisories for the International Civil Aviation Organization alerting users to enhancements in the radiation environment at aviation flight levels. Due to a lack of routine observations, radiation modeling is required to specify the dose rates experienced by flight crew and passengers. While mature models exist, support for key observational inputs and further modeling advancements are needed. Observational inputs required from the ground-based neutron monitor network must be financially supported for research studies and operations to ensure real-time data is available for forecast operations and actionable end user decision making. An improved understanding of the geomagnetic field is required to reduce dose rate uncertainties in regions close to the open/closed geomagnetic field boundary, important for flights such as those between the continental US and Europe which operate in this region. Airborne radiation measurements, which are crucial for model validation and improvement, are lacking, particularly during solar energetic particle events. New measurement campaigns must be carried out to ensure progress and in situ atmospheric radiation measurements made available for real-time situational awareness. Furthermore, solar energetic particle forecasting must be improved to move aviation radiation nowcasts to forecasts in order to meet customer requirements for longer lead times for planning and mitigation.

space weather↗

NASA NTRS2013

Projected Climate Impacts to South African Maize and Wheat Production in 2055: A Comparison of Empirical and Mechanistic Modeling Approaches

Crop model-specific biases are a key uncertainty affecting our understanding of climate change impacts to agriculture. There is increasing research focus on intermodel variation, but comparisons between mechanistic (MMs) and empirical models (EMs) are rare despite both being used widely in this field. We combined MMs and EMs to project future (2055) changes in the potential distribution (suitability) and productivity of maize and spring wheat in South Africa under 18 downscaled climate scenarios (9 models run under 2 emissions scenarios). EMs projected larger yield losses or smaller gains than MMs. The EMs' median-projected maize and wheat yield changes were 3.6% and 6.2%, respectively, compared to 6.5% and 15.2% for the MM. The EM projected a 10% reduction in the potential maize growing area, where the MM projected a 9% gain. Both models showed increases in the potential spring wheat production region (EM = 48%, MM = 20%), but these results were more equivocal because both models (particularly the EM) substantially overestimated the extent of current suitability. The substantial water-use efficiency gains simulated by the MMs under elevated CO2 accounted for much of the EMMM difference, but EMs may have more accurately represented crop temperature sensitivities. Our results align with earlier studies showing that EMs may show larger climate change losses than MMs. Crop forecasting efforts should expand to include EMMM comparisons to provide a fuller picture of crop-climate response uncertainties.

DSSAT↗

NASA NTRS2017

Validation of Globsnow-2 Snow Water Equivalent Over Eastern Canada

In Qubec, Eastern Canada, snowmelt runoff contributes more than 30% of the annual energy reserve for hydroelectricity production, and uncertainties in annual maximum snow water equivalent (SWE) over the region are one of the main constraints for improved hydrological forecasting. Current satellite-based methods for mapping SWE over Qubec's main hydropower basins do not meet Hydro-Qubec operational requirements for SWE accuracies with less than 15% error. This paper assesses the accuracy of the GlobSnow-2 (GS-2) SWE product, which combines microwave satellite data and in situ measurements, for hydrological applications in Qubec. GS-2 SWE values for a 30-year period (1980 to 2009) were compared with space- and time-matched values from a comprehensive dataset of in situ SWE measurements (a total of 38,990 observations in Eastern Canada). The root mean square error (RMSE) of the GS-2 SWE product is 94.1+/- 20.3 mm, corresponding to an overall relative percentage error (RPE) of 35.9%. The main sources of uncertainty are wet and deep snow conditions (when SWE is higher than 150 mm), and forest cover type. However, compared to a typical stand-alone brightness temperature channel difference algorithm, the assimilation of surface information in the GS-2 algorithm clearly improves SWE accuracy by reducing the RPE by about 30%. Comparison of trends in annual mean and maximum SWE between surface observations and GS-2 over 1980-2009 showed agreement for increasing trends over southern Qubec, but less agreement on the sign and magnitude of trends over northern Qubec. Extended at a continental scale, the GS-2 SWE trends highlight a strong regional variability.

Snow water equivalent↗

NASA NTRS1994

Temperature-moisture biases in ECMWF analyses based on clear sky longwave simulations constrained by SSMI and MSU measurements and comparisons to ERBE estimates

Clear sky longwave radiation fluxes for the summer of 1988 and winter of 1989 have been simulated with a radiative transfer model that includes detailed treatment of atmospheric gas absorption. The input data to the model are humidity and temperature profiles from European Center for Medium-Range Weather Forecasts (ECMWF) analyses and surface temperature measurements from the International Satellite Cloud Climatology Project. To reduce the inherent uncertainties in humidity profiles, the ECMWF moisture fields have been adjusted, based on the climatological relationship between the moisture profile and total precipitable water (PW), so that the ECMWF PW is equal to that derived from Special Sensor Microwave Imager (SSMI) data. SSMI and ECMWF PW patterns are generally similar, but significant differences in magnitude are found in the low latitudes, particularly over the subtropical oceans in the Southern Hemisphere. At the same time the tropospheric brightness temperature (T(sub B)) at 53.74 GHz has been computed using a microwave transfer model with ECMWF temperature and humidity fields as inputs. The comparison of computed T(sub B) with the Microwave Sounding Unit (MSU) channel 2 T(sub B) revealed differences larger than 1.5 K over most of the oceans, suggesting that the ECMWF model atmosphere has a cold bias. Maximum biases greater than 3 K are found in low latitudes. After removing the bias from the ECMWF temperature field, a new set of temperature profiles yielding brightness temperature equal to MSU channel 2 T(sub B) has been obtained. Simulation results clearly demonstrate that inclusion of satellite estimates of PW and T(sub B) enhances the accuracy of the clear sky LW flux simulation, substantially reducing the differences from Earth Radiation Budget Experiment (ERBE) estimates. Global averages indicate that the model-derived top-of-atmosphere (TOA) clear sky fluxes from the adjusted moisture and temperature profiles are in very good agreement with satellite-measured ERBE values, differing by only 1.4 W/sq m. By contrast, the calculation using only ECMWF analyses without any adjustments gives a significant underestimation of TOA clear sky fluxes up to 10.7 W/sq m compared to the satellite measurements, suggesting that the constraint method can significantly improve the accuracy in the radiation budget simulation. The results also indicate that the ECMWF-based simulation errors are, at least for the two seasons studied, mainly attributed to the error in the temperature field rather than to errors in the moisture field.

Sohn, Byung-Ju↗

NASA NTRS2007

Tropical Cyclones Feed More Heavy Rain in a Warmer Climate

The possible linkage of tropical cyclones (TC) to global warming is a hotly debated scientific topic, with immense societal impacts. Most of the debate has been focused on the issue of uncertainty in the use of non-research quality data for long-term trend analyses, especially with regard to TC intensity provided by TC forecasting centers. On the other hand, it is well known that TCs are associated with heavy rain during the processes of genesis and intensification, and that there are growing evidences that rainfall characteristics (not total rainfall) are most likely to be affected by global warming. Yet, satellite rainfall data have not been exploited in any recent studies of linkage between tropical cyclones (TC) and global warming. This is mostly due to the large uncertainties associated with detection of long-term trend in satellite rainfall estimates over the ocean. This problem, as we demonstrate in this paper, can be alleviated by examining rainfall distribution, rather than rainfall total. This paper is the first to use research-quality, satellite-derived rainfall from TRMM and GPCP over the tropical oceans to estimate shift in rainfall distribution during the TC season, and its relationships with TCs, and sea surface temperature (SST) in the two major ocean basins, the northern Atlantic and the northern Pacific for 1979-2005. From the rainfall distribution, we derive the TC contributions to rainfall in various extreme rainfall categories as a function to time. Our results show a definitive trend indicating that TCs are contributing increasingly to heavier rain events, i.e., intense TC's are more frequent in the last 27 years. The TC contribution to top 5% heavy rain has nearly doubled in the last two decades in the North Atlantic, and has increased by about 10% in the North Pacific. The different rate of increase in TC contribution to heavy rain may be related to the different rates of different rate of expansion of the warm pool (SST >2S0 C) area in the two oceans.

Lau, K.-M.↗

NASA NTRS2019

POLARRIS: A POLArimetric Radar Retrieval and Instrument Simulator

This paper introduces a synthetic polarimetric radar simulator and retrieval package, POLArimetric Radar Retrieval and Instrument Simulator (POLARRIS), for evaluating cloud‐resolving models (CRMs). POLARRIS is composed of forward (POLARRIS‐f) and inverse (retrieval and diagnostic) components (iPOLARRIS) to generate not only polarimetric radar observables (Zh, Zdr, Kdp, ρhv) but also radar‐consistent geophysical parameters such as hydrometeor identification, vertical velocity, and rainfall rates retrieved from CRM data. To demonstrate its application and uncertainties, POLARRIS is applied to simulations of a mesoscale convective system over the Southern Great Plains on 23 May 2011, using the Weather Research and Forecasting model with both spectral bin microphysics (SBM) and the Goddard single‐moment bulk 4ICE microphysics. Statistical composites reveal a significant dependence of simulated polarimetric observables (Zdr, Kdp) on the assumptions of the particle axis ratio (oblateness) and orientation angle distributions. The simulated polarimetric variables differ considerably between the SBM and 4ICE microphysics in part due to the differences in their ice particle size distributions as revealed by comparisons with aircraft measurements. Regardless of these uncertainties, simulated hydrometeor identification distributions overestimate graupel and hail fractions, especially from the simulation with SBM. To minimize uncertainties in forward model, the particle shape and orientation angle distributions of frozen particles should be predicted in a microphysics scheme in addition to the size distributions and particle densities.

Toshi Matsui↗

NASA NTRSDate not supplied

More Data Needed for Failure Rate Estimation, Validation, and Uncertainty Reduction

Current Environmental Control and Life Support System (ECLSS) development and test activities are not generating data fast enough to provide statistically-supportable precise Orbital Replacement Unit (ORU) failure rate estimates for future missions. Accurate and precise failure rate estimates are critical for missions beyond Low Earth Orbit (LEO) because current risk mitigation approaches – namely regular resupply and rapid abort capabilities – will not be available. Safe operations will depend on mission planners’ ability to accurately forecast spares demand and efficiently provide the necessary resources. However, even after more than a decade of operations on board the International Space Station (ISS), a significant amount of uncertainty remains in failure rate estimates. Uncertain or inaccurate failure rates result in increased risk and spares mass for future missions. A Bayesian failure rate estimation approach, such as the one currently implemented by the ISS Program, can help reduce uncertainty by incorporating engineering judgement into failure rate estimates. However, experience on the ISS and with other complex systems shows that these prior failure rate estimates are often inaccurate. In addition, prior failure rate estimates are typically point values; some level of uncertainty must be added to convert these into probability distributions for Bayesian updating, and there are several potential methods for doing so. Due to the low rate of data collection, these subjective (and often inaccurate) prior estimates currently have a strong influence on the end result. This paper examines the challenges associated with failure rate estimation, validation, and uncertainty reduction in the context of ECLSS development for beyond-LEO missions. A variety of techniques for generating and updating Bayesian priors are discussed and evaluated using both real-world and simulated data. Potential solutions for improving failure rate estimation, including testing additional units, are analyzed and discussed, and a set of recommendations are provided for next-generation system development activities.

Supportability↗

NASA NTRSDate not supplied

More Data Needed for Failure Rate Estimation, Validation, and Uncertainty Reduction

The currently planned schedule for advanced Environmental Control and Life Support System (ECLSS) development and test activities to support human exploration missions is unlikely to generate sufficient data to enable statistically-supportable, precise Orbital Replacement Unit (ORU) failure rate estimates to meet existing crew safety expectations. Accurate and precise failure rate estimates are critical for missions beyond Low Earth Orbit (LEO) because current risk mitigation approaches –namely regular resupply and rapid abort capabilities –will not be available. Safe operations will depend on mission planners’ ability to accurately forecast spares demand and efficiently provide the necessary resources. However, even after more than a decade of International Space Station (ISS) ECLSS operations, a significant amount of uncertainty remains in failure rate estimates. Uncertain or inaccurate failure rates result in increased risk and spares mass. A Bayesian estimation approach, such as the one currently implemented by the ISS Program, can reduce uncertainty by incorporating engineering judgement into failure rate estimates. However, experience on the ISS and with other complex systems shows that these prior failure rate estimates are often inaccurate. In addition, prior estimates are typically point values; some level of uncertainty must be added to convert these into probability distributions for Bayesian updating, and there are several potential methods for doing so. Due to the low rate of data collection, any inaccuracy in theseprior estimates currently hasa strong influence on the end result. This paper examines the challenges associated with failure rate estimation, validation, and uncertainty reduction in the context of ECLSS development for beyond-LEO missions. A variety of techniques for generating and updating Bayesian priors are discussed and evaluated using both real-world and simulated data. Potential solutions for improving failure rate estimation, including testing additional units, are analyzed and discussed, and a set of recommendations are provided for next-generation system development activities.

Reliability↗

NASA NTRSDate not supplied

More Data Needed for Failure Rate Estimation, Validation, and Uncertainty Reduction

The currently planned schedule for advanced Environmental Control and Life Support System (ECLSS) development and test activities to support human exploration missions is unlikely to generate sufficient data to enable statistically-supportable, precise Orbital Replacement Unit (ORU) failure rate estimates to meet existing crew safety expectations. Accurate and precise failure rate estimates are critical for missions beyond Low Earth Orbit (LEO) because current risk mitigation approaches –namely regular resupply and rapid abort capabilities –will not be available. Safe operations will depend on mission planners’ ability to accurately forecast spares demand and efficiently provide the necessary resources. However, even after more than a decade of International Space Station (ISS) ECLSS operations, a significant amount of uncertainty remains in failure rate estimates. Uncertain or inaccurate failure rates result in increased risk and spares mass. A Bayesian estimation approach, such as the one currently implemented by the ISS Program, can reduce uncertainty by incorporating engineering judgement into failure rate estimates. However, experience on the ISS and with other complex systems shows that these prior failure rate estimates are often inaccurate. In addition, prior estimates are typically point values; some level of uncertainty must be added to convert these into probability distributions for Bayesian updating, and there are several potential methods for doing so. Due to the low rate of data collection, any inaccuracy in theseprior estimates currently hasa strong influence on the end result. This paper examines the challenges associated with failure rate estimation, validation, and uncertainty reduction in the context of ECLSS development for beyond-LEO missions. A variety of techniques for generating and updating Bayesian priors are discussed and evaluated using both real-world and simulated data. Potential solutions for improving failure rate estimation, including testing additional units, are analyzed and discussed, and a set of recommendations are provided for next-generation system development activities.

Reliability↗

NASA NTRS1998

Boreal Winter Predictions with the GEOS-2 GCM: The Role of Boundary Forcing and Initial Conditions

Ensembles of atmospheric General Circulation Model (GCM) seasonal forecasts and long-term simulations (1980-94) are analyzed to assess the controlling influences of boundary forcing and memory of the initial conditions. Both the forecasts and simulations are carried out with version 2 of the Goddard Earth Observing System (GEOS-2) GCM forced with observed sea surface temperatures (SSTs). While much of the focus is on the seasonal time scale (January- March) and the Pacific North American (PNA) region, we also present results for other regions, shorter time scales, and other known modes of variability in the northern hemisphere extratropics. Forecasts of indices of some of the key large-scale modes of variability show that there is considerable variability in skill between different regions of the Northern Hemisphere. The eastern North Atlantic region has the poorest long lead forecast skill showing no skill beyond about 10 days. Skillful seasonal forecasts are primarily confined to the wave-like ENSO response emanating from the tropical Pacific. In the Northern Hemisphere, this is associated with the well-known Pacific/North American (PNA) pattern. Memory of the initial conditions is the major factor leading to skillful extratropical forecasts of lead time less than one month, while SST forcing is the only factor at the seasonal time scale. SST forcing contributes to skillful forecasts at sub- seasonal time scales only over the PNA region. The GEOS-2 GCM produces average (1980-94) signal to noise ratios which are less than one everywhere in the extratropics, except for the subtropical Pacific where they approach 1.5. When confined to the ENSO years, the maximum signal to noise ratios occur in the PNA region where they exceed three. An assessment of the sampling distribution of the forecasts suggests the model's ENSO response is very likely too weak. These results show some sensitivity to the uncertainties in the estimates of the SST forcing fields. In the North Pacific region, the sensitivity to SST forcing manifests itself primarily as changes in the variability of the PNA response, underscoring the need for an ensemble approach to the seasonal prediction problem.

Chang, Yehui↗

NASA NTRS2006

A Mission to Observe Ice in Clouds from Space

To date there have been multiple satellite missions to observe and retrieve cloud top properties and the liquid in, and precipitation from, clouds. There are currently a few missions that attempt to measure cloud ice properties as a byproduct of other observations. However, we do not yet quantitatively understand the processes that control the water budget of the upper troposphere where ice is the predominant phase, and how these processes are linked to precipitation processes and the radiative energy budget. The ice in clouds either melts into rain or is detrained, and persists, as cirrus clouds affecting the hydrological and energy cycle, respectively. Fully modeling the Earth's climate and improving weather and climate forecasts requires accurate satellite measurements of various cloud properties at the temporal and spatial scales of cloud processes. The uncertainty in knowledge of these ice characteristics is reflected in the large discrepancies in model simulations of the upper tropospheric water budget. Model simulations are sensitive to the partition of ice between precipitation and outflow processes, i.e., to the parameterization of ice clouds and ice processes. This presentation will describe the Submillimeter-wave InfraRed Ice Cloud Experiment (SIRICE) concept, a satellite mission designed to acquire global Earth radiance measurements in the infrared and submillimeter-wave region (183-874 GHz). If successful, this mission will bridge the measurement gap between microwave sounders and shorter-wavelength infrared and visible sensors. The brightness temperatures at submillimeter-wave frequencies are especially sensitive to cirrus ice particle sizes (because they are comparable to the wavelength). This allows for more accurate ice water path estimates when multiple channels are used to probe into the cloud layers. Further, submillimeter wavelengths offer simplicity in the retrieval algorithms because they do not probe into the liquid and near surface portions of clouds, thus requiring only one term of the radiative transfer equation (ice scattering) to relate brightness temperatures to ice. Scientific justification and the SIRICE approach to measuring ice water path and particle size that span a range encompassing both the hydrologically active and radiatively active components of cloud systems will be presented.

Ackerman, S.↗

NASA NTRS2020

Ensemble Methodologies for Astronaut Cancer Risk Assessment in the face of Large Uncertainties

A new approach to NASA space radiation risk modeling has successfully extended the current NASA probabilistic cancer risk model to an ensemble framework able to consider sub-model parameter uncertainty (e.g. uncertainty in a radiation quality parameter) as well as model-form uncertainty associated with differing theoretical or empirical formalisms (e.g. combined dose-rate and radiation quality effects). Ensemble methodologies are already widely used in weather prediction, modeling of infectious disease outbreaks, and certain terrestrial radiation protection applications to better understand how uncertainty may influence risk decision-making. Applying ensemble methodologies to space radiation risk projections offers the potential to efficiently incorporate emerging research results, allow for the incorporation of future (including international) models, improve uncertainty quantification for underlying sub-models developed against sparse experimental data, and reduce the impact of subjective bias on risk projections. Moreover, risk forecasting across an ensemble of multiple predictive models can provide stakeholders additional information on risk acceptance if current health/medical standards cannot be met or the level of knowledge doesn’t permit a specific risk or exposure limit to be developed for future space exploration missions. In this work, ensemble risk projections implementing multiple sub-models of radiation quality, dose and dose-rate effectiveness factors, excess risk, and latency as ensemble members are presented. Initial consensus methods for ensemble model weights and correlations to account for individual model bias are discussed. In these analyses, the ensemble forecast compares well to results from NASA's current operational cancer risk projection model used to assess permissible exposure limits and permissible mission durations for astronauts. However, a large range of projected risk values are obtained at the upper 95th confidence level where models must extrapolate beyond available biological data sets; closer agreement is seen at the median + one sigma due to the inherent similarities in available models. Future work, including the addition of new models and methods for statistical correlation between predictive members are discussed to define alternate ways of thinking about risk and ‘acceptable’ uncertainty with respect to NASA’s current permissible exposure limits.

space radiation↗

NASA NTRSDate not supplied

Ensemble Cancer Risk Model for Astronaut Risk Assessment

A new approach to NASA space radiation risk modeling has successfully extended the current NASA probabilistic cancer risk model to an ensemble framework able to consider sub-model parameter uncertainty (e.g. uncertainty in a radiation quality parameter) as well as model-form uncertainty associated with differing theoretical or empirical formalisms (e.g. combined dose-rate and radiation quality effects). Ensemble methodologies are already widely used in weather prediction, modeling of infectious disease outbreaks, and certain terrestrial radiation protection applications to better understand how uncertainty may influence risk decision-making. Applying ensemble methodologies to space radiation risk projections offers the potential to efficiently incorporate emerging research results, allow for the incorporation of future (including international) models, improve uncertainty quantification for underlying sub-models developed against sparse experimental data, and reduce the impact of subjective bias on risk projections. Moreover, risk forecasting across an ensemble of multiple predictive models can provide stakeholders additional information on risk acceptance if current health/medical standards cannot be met or the level of knowledge doesn’t permit a specific risk or exposure limit to be developed for future space exploration missions. In this work, ensemble risk projections implementing multiple sub-models of radiation quality, dose and dose-rate effectiveness factors, excess risk, and latency as ensemble members are presented. Initial consensus methods for ensemble model weights and correlations to account for individual model bias are discussed. In these analyses, the ensemble forecast compares well to results from NASA's current operational cancer risk projection model used to assess permissible exposure limits and permissible mission durations for astronauts. However, a large range of projected risk values are obtained at the upper 95th confidence level where models must extrapolate beyond available biological data sets; closer agreement is seen at the median + one sigma due to the inherent similarities in available models. Future work, including the addition of new models and methods for statistical correlation between predictive members are discussed to define alternate ways of thinking about risk and ‘acceptable’ uncertainty with respect to NASA’s current permissible exposure limits.

Lisa C Simonsen↗

NASA NTRS2019

Validation of Regional CO2 Concentrations in the ECMWF Real-Time Analysis and Carbon-Tracker Reanalysis with Airborne Observations from ACT-A Field Campaign

Through verifying against hundreds of hours of airborne in-situ measurements from the NASA-sponsored Atmospheric Carbon and Transport – America (ACT-A) field campaign, this study systematically examines the regional uncertainties and biases of the carbon dioxide (CO2) concentrations from two of the state-of-the-art global analysis products, namely the real-time analysis from the European Center (EC) for Medium Range Forecasting and NOAA’s near real-time Carbon Tracker (CT) reanalysis. It is found that both the EC and CT-NRT analyses agree reasonably well with the independent ACT-A flight-level CO2 measurements in the free troposphere but the uncertainties are considerably larger in the boundary layer during both the summer months of 2016 and the winter months of 2017. There are also strong variabilities in accuracy and bias between seasons, and across three different subregions in the United States (Mid-Atlantic, Midwest and South). Overall, the analysis uncertainties of the EC and CT-NRT analyses in terms of root-mean square deviations against airborne data are comparable to each other, both of which are between 1-2 ppm in the free troposphere but can be as large as 10 ppm near the surface, which are grossly consistent with the difference between the two analyses. The current study not only provides systematic uncertainty estimates for both analysis products over North America but also demonstrated that these two independent estimates can be used to approximate the overall regional CO2 analysis uncertainties. Both statistics are important in future studies in quantifying the uncertainties of regional carbon concentration and flux estimates, as well as in assessing the impact of regional transport through more refined regional modeling and analysis systems.

Chen, Hans W.↗