Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Atmospheric and oceanographic research review, 1978

Research activities related to global weather, ocean/air interactions, and climate are reported. The global weather research is aimed at improving the assimilation of satellite-derived data in weather forecast models, developing analysis/forecast models that can more fully utilize satellite data, and developing new measures of forecast skill to properly assess the impact of satellite data on weather forecasting. The oceanographic research goal is to understand and model the processes that determine the general circulation of the oceans, focusing on those processes that affect sea surface temperature and oceanic heat storage, which are the oceanographic variables with the greatest influence on climate. The climate research objective is to support the development and effective utilization of space-acquired data systems in climate forecast models and to conduct sensitivity studies to determine the affect of lower boundary conditions on climate and predictability studies to determine which global climate features can be modeled either deterministically or statistically.

Source record↗

SEP Forecasting from the Lunar Gateway

The European Radiation Sensor Array (ERSA) planned to fly onboard the Gateway lunar space station will include a Standard Radiation Environment Monitor (SREM) energetic particle detector. The SREM detector has a long heritage and has flown aboard the Earth-orbiting INTEGRAL and PROBA-1 satellites, the L2 experiments Herschel and Planck, and the inner solar system mission Rosetta. SREM measures energetic protons between 11 – 250 MeV, enabling it to detect proton and electron enhancements due to solar energetic particle (SEP) events, which are potentially hazardous for humans and hardware in space. The UMASEP model, developed by Marlon Nuñez at the University of Malaga, ingests energetic particle measurements to produce forecasts of time to threshold crossing and the maximum flux expected within a certain time window. UMASEP is a mature model that has been running in real time for many years and has demonstrated forecasting skill. We plan to develop a UMASEP-Gateway >30 MeV forecast module using historical INTEGRAL/SREM data so that the model may begin forecasting as soon as ERSA begins returning real time data. UMASEP-Gateway will use the environment at the habitat to produce forecasts. This work will enable forecasting using the in situ environment at the spacecraft and will additionally act as a first step towards producing SEP forecasts directly at the vehicle where humans reside, a key capability that will be needed for exploration missions beyond the Moon.

space weather↗

Probability of US Heat Waves Affected by a Subseasonal Planetary Wave Pattern

Heat waves are thought to result from subseasonal atmospheric variability. Atmospheric phenomena driven by tropical convection, such as the Asian monsoon, have been considered potential sources of predictability on subseasonal timescales. Mid-latitude atmospheric dynamics have been considered too chaotic to allow significant prediction skill of lead times beyond the typical 10-day range of weather forecasts. Here we use a 12,000-year integration of an atmospheric general circulation model to identify a pattern of subseasonal atmospheric variability that can help improve forecast skill for heat waves in the United States. We find that heat waves tend to be preceded by 15-20 days by a pattern of anomalous atmospheric planetary waves with a wavenumber of 5. This circulation pattern can arise as a result of internal atmospheric dynamics and is not necessarily linked to tropical heating.We conclude that some mid-latitude circulation anomalies that increase the probability of heat waves are predictable beyond the typical weather forecast range.

Mid-Latitude Circulation↗

Measurements and Model Improvement: Insight into NWP Model Error Using Doppler Lidar and Other WFIP2 Measurement Systems

Abstract Doppler-lidar wind-profile measurements at three sites were used to evaluate NWP model errors from two versions of NOAA’s 3-km-grid HRRR model, to see whether updates in the latest version 4 reduced errors when compared against the original version 1. Nested (750-m grid) versions of each were also tested to see how grid spacing affected forecast skill. The measurements were part of the field phase of the Second Wind Forecasting Improvement Project (WFIP2), an 18-month deployment into central Oregon–Washington, a major wind-energy-producing region. This study focuses on errors in simulating marine intrusions, a summertime, 600–800-m-deep, regional sea-breeze flow found to generate large errors. HRRR errors proved to be complex and site dependent. The most prominent error resulted from a premature drop in modeled marine-intrusion wind speeds after local midnight, when lidar-measured winds of greater than 8 m s −1 persisted through the next morning. These large negative errors were offset at low levels by positive errors due to excessive mixing, complicating the interpretation of model “improvement,” such that the updates to the full-scale versions produced mixed results, sometimes enhancing but sometimes degrading model skill. Nesting consistently improved model performance, with version 1’s nest producing the smallest errors overall. HRRR’s ability to represent the stages of sea-breeze forcing was evaluated using radiation budget, surface-energy balance, and near-surface temperature measurements available during WFIP2. The significant site-to-site differences in model error and the complex nature of these errors mean that field-measurement campaigns having dense arrays of profiling sensors are necessary to properly diagnose and characterize model errors, as part of a systematic approach to NWP model improvement. Significance Statement Dramatic increases in NWP model skill will be required over the coming decades. This paper describes the role of major deployments of accurate profiling sensors in achieving that goal and presents an example from the Second Wind Forecast Improvement Program (WFIP2). Wind-profile data from scanning Doppler lidars were used to evaluate two versions of HRRR, the original and an updated version, and nested versions of each. This study focuses on the ability of updated HRRR versions to improve upon predicting a regional sea-breeze flow, which was found to generate large errors by the original HRRR. Updates to the full-scale HRRR versions produced mixed results, but the finer-mesh versions consistently reduced model errors.

Meteorology & Atmospheric Sciences↗

Efficient Methods to Assimilate Satellite Retrievals Based on Information Content: Suboptimal Retrieval Assimilation - Part 2

One of the outstanding problems in data assimilation has been and continues to be how best to utilize satellite data while balancing the tradeoff between accuracy and computational cost. A number of weather prediction centers have recently achieved remarkable success in improving their forecast skill by changing the method by which satellite data are assimilated into the forecast model from the traditional approach of assimilating retrievals to the direct assimilation of radiances in a variational framework. The operational implementation of such a substantial change in methodology involves a great number of technical details, e.g., pertaining to quality control procedures, systematic error correction techniques, and tuning of the statistical parameters in the analysis algorithm. Although there are clear theoretical advantages to the direct radiance assimilation approach, it is not obvious at all to what extent the improvements that have been obtained so far can be attributed to the change in methodology, or to various technical aspects of the implementation. The issue is of interest because retrieval assimilation retains many practical and logistical advantages which may become even more significant in the near future when increasingly high-volume data sources become available. The central question we address here is: how much improvement can we expect from assimilating radiances rather than retrievals, all other things being equal? We compare the two approaches in a simplified one-dimensional theoretical framework, in which problems related to quality control and systematic error correction are conveniently absent. By assuming a perfect radiative transfer model and perfect knowledge of radiance and background error covariances, we are able to formulate a nonlinear local error analysis for each assimilation method. Direct radiance assimilation is optimal in this idealized context, while the traditional method of assimilating retrievals is suboptimal because it ignores the cross-covariances between background errors and retrieval errors. We show that interactive retrieval assimilation (where the same background used for assimilation is also used in the retrieval step) is equivalent to direct assimilation of radiances with suboptimal analysis weights. We illustrate and extend these theoretical arguments with several one-dimensional assimilation experiments, where we estimate vertical atmospheric profiles using simulated data from both the High-resolution InfraRed Sounder 2 (HIRS2) and the future Atmospheric InfraRed Sounder (AIRS).

Joiner, J.↗

Impact of Assimilating AIRS Cloud Cleared Radiances on the Analysis and Forecast of Polar Lows

Previous work by this team (Reale et al. 2018) has found that the current assimilation of AIRS (Atmospheric InfraRed Sounder) radiances on a regularly spaced thinning grid is suboptimal, probably because of horizontal error correlation over meteorologically inactive areas. Moreover, cloud-cleared radiances appear to be a better product than clear-sky radiances, but need to be assimilated at a much lower density globally, because of the higher information content. Specifically: 1. Assimilation of AIRS cloud-cleared radiances at a density of about one quarter of the clear-sky radiances improves global forecast skill; 2. An adaptive thinning strategy assimilating cloud-cleared radiances at reduced density globally except around tropical cyclones (TCs), leads to substantial improvement in the structure and intensity forecast of TCs without damaging global skill.

Polar Low↗

Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) (Field Campaign Report)

The Arctic is rapidly changing, and these changes have substantial societal relevance. First, arctic change is a leading sign of global change, as the warming observed in the Arctic is 2-3 times faster than observed across the rest of the globe. This so-called arctic amplification is due to numerous feedbacks, including those linked to the declining sea ice. Broad arctic changes are also hypothesized to be related to shifts in large-scale circulation patterns that may have implications for mid-latitude weather and ocean circulation. Arctic change is further affecting the oceans through acidification that threatens food supplies. Declining sea ice also opens the Arctic for new resource development, shipping routes, tourism, and other commercial activities. Lastly, the changing Arctic is a hotbed for geopolitical challenges as nations vie for influence and control of this resource-rich and newly accessible region. Clearly the Arctic and its changes are playing a huge role in our Earth both from a geophysical and socio-political standpoint. To navigate, manage, and respond to the challenges associated with arctic change requires a vastly improved understanding of the coupled arctic system, and the drivers and implications of these changes. It is essential to better understand the physical basis for why the arctic sea ice is declining, the associated feedbacks that work to amplify or modulate this decline, and the myriad ways that the Earth system is responding. As a result of these changes and uncertainties, there are increasing societal needs for improved model predictive skill in the Arctic, to address pressing gaps in global climate prediction, to advance forecast skills for regional and hemispheric weather and sea ice, and to ensure robust ecosystem models that realistically link physical and biological systems. To fulfill these core needs requires new, sophisticated, and cross-cutting observations within the rapidly changing arctic ice pack.

54 ENVIRONMENTAL SCIENCES↗

A Case Study of the Impact of AIRS Temperature Retrievals on Numerical Weather Prediction

Large errors in numerical weather prediction are often associated with explosive cyclogenesis. Most studes focus on the under-forecasting error, i.e. cases of rapidly developing cyclones which are poorly predicted in numerical models. However, the over-forecasting error (i.e., to predict an explosively developing cyclone which does not occur in reality) is a very common error that severely impacts the forecasting skill of all models and may also present economic costs if associated with operational forecasting. Unnecessary precautions taken by marine activities can result in severe economic loss. Moreover, frequent occurrence of over-forecasting can undermine the reliance on operational weather forecasting. Therefore, it is important to understand and reduce the prdctions of extreme weather associated with explosive cyclones which do not actually develop. In this study we choose a very prominent case of over-forecasting error in the northwestern Pacific. A 960 hPa cyclone develops in less than 24 hour in the 5-day forecast, with a deepening rate of about 30 hPa in one day. The cyclone is not versed in the analyses and is thus a case of severe over-forecasting. By assimilating AIRS data, the error is largely eliminated. By following the propagation of the anomaly that generates the spurious cyclone, it is found that a small mid-tropospheric geopotential height negative anomaly over the northern part of the Indian subcontinent in the initial conditions, propagates westward, is amplified by orography, and generates a very intense jet streak in the subtropical jet stream, with consequent explosive cyclogenesis over the Pacific. The AIRS assimilation eliminates this anomaly that may have been caused by erroneous upper-air data, and represents the jet stream more correctly. The energy associated with the jet is distributed over a much broader area and as a consequence a multiple, but much more moderate cyclogenesis is observed.

Reale, O.↗

A GEOS-Based OSSE for the "MISTiC Winds" Concept

The Goddard Earth Observing System (GEOS) atmospheric model and data assimilation system are used to perform an Observing System Simulation Experiment (OSSE) for the proposed MISTiC Wind mission. The GEOS OSSE includes a reference simulation (the Nature Run), from which the pseudo-observations are generated. These pseuo-observations span the entire suite of in-situ and space space-based observations presently used in operational weather prediction, with the addition of the MISTiC-Wind dataset. New observation operators have been constructed for the MISTiC Wind data, including both the radiances measured in the 4-micron part of the solar spectrum and the winds derived from these radiances. The OSSE examines the impacts on global forecast skill of adding these observations to the current operational suite, showing substantial improvements in forecasts when the wind information are added. It is shown that a constellation of four MISTiC Wind satellites provides more benefit than a single platform, largely because of the increased accuracy of the feature-derived wind measurements when more platforms are used.

McCarty, W.↗

Using Climate Regionalization to Understand Climate Forecast System Version 2 (CFSv2) Precipitation Performance for the Conterminous United States (CONUS)

Dynamically based seasonal forecasts are prone to systematic spatial biases due to imperfections in the underlying global climate model (GCM). This can result in low-forecast skill when the GCM misplaces teleconnections or fails to resolve geographic barriers, even if the prediction of large-scale dynamics is accurate. To characterize and address this issue, this study applies objective climate regionalization to identify discrepancies between the Climate Forecast SystemVersion 2 (CFSv2) and precipitation observations across the Contiguous United States (CONUS). Regionalization shows that CFSv2 1 month forecasts capture the general spatial character of warm season precipitation variability but that forecast regions systematically differ from observation in some transition zones. CFSv2 predictive skill for these misclassified areas is systematically reduced relative to correctly regionalized areas and CONUS as a whole. In these incorrectly regionalized areas, higher skill can be obtained by using a regional-scale forecast in place of the local grid cell prediction.

geographic barriers↗

Planetary wave prediction: Benefits of tropical data and global models

Skillful numerical predictions of midlatitude atmospheric planetary waves generally require both tropical data for the initial conditions and a global domain for the forecast model. The lack of either adequate tropical observations or a global domain typically leads to a significant degradation of forecast skill in middle latitudes within the first one to three days of the forecast period. These effects were first discovered by numerical experimentation. They were subsequently explained theoretically, and their importance for practical forecasting was confirmed in a series of prediction experiments using FGGE data.

Somerville, R. C. J.↗

Weather forecasting expert system study

Weather forecasting is critical to both the Space Transportation System (STS) ground operations and the launch/landing activities at NASA Kennedy Space Center (KSC). The current launch frequency places significant demands on the USAF weather forecasters at the Cape Canaveral Forecasting Facility (CCFF), who currently provide the weather forecasting for all STS operations. As launch frequency increases, KSC's weather forecasting problems will be great magnified. The single most important problem is the shortage of highly skilled forecasting personnel. The development of forecasting expertise is difficult and requires several years of experience. Frequent personnel changes within the forecasting staff jeopardize the accumulation and retention of experience-based weather forecasting expertise. The primary purpose of this project was to assess the feasibility of using Artificial Intelligence (AI) techniques to ameliorate this shortage of experts by capturing aria incorporating the forecasting knowledge of current expert forecasters into a Weather Forecasting Expert System (WFES) which would then be made available to less experienced duty forecasters.

Source record↗

Operational Forecasting Inundation Extents using REOF analysis (FIER) over Lower Mekong and its Economic Impact on Agriculture

In the Lower Mekong River Basin floodplains, rice cultivation is highly crucial for regional and global food security. However, prolonged flooding can pose damage to rice cultivation and other socio-economic aspects. Yet, there is no rapid operational inundation forecasting system that can help decision-makers proactively mitigate flood damages. Here, we integrated the so-called Forecasting Inundation Extents using Rotated empirical orthogonal function analysis (FIER) framework with an altimetry-based operational Mekong River level forecasting system and built an operational web application, FIER-Mekong, (https://fier-mekong.streamlit.app/) that generates daily skillful forecasted inundation extents (>70% of critical success index) and depths in about 3 and 30 s, respectively, with up to 18-day lead times. One of its applications, predicting flood-induced rice economic losses, is also presented. Had FIER-Mekong being adopted, we estimated that the rice damages, up to 87 and 53 million US dollars during the 2020 and 2021 harvest time, respectively, could have been avoided.

Chi-Hung Chang↗

Leveraging Observing System Simulation Experiments for Satellite Instrument Design: Advancements and Challenges

This abstract highlights NASA's OSSE framework, developed at the Global Modeling and Assimilation Office, which has become a widely adopted tool for evaluating the impact of new observations on weather forecasts. The framework involves simulating realistic observations by introducing errors to mimic real-world scenarios. By utilizing advanced radiative transfer modeling, the accuracy of simulated observations is significantly improved, enhancing the reliability of experimental outcomes. The talk focuses on recent progress and challenges in three key areas. Firstly, it explores the techniques used to simulate synthetic observations, a crucial aspect of OSSE experiments. Secondly, the presentation also discusses the challenges of examining the observation errors that need to be added to the perfect observations to generate realistic simulated observations. Lastly, the assimilation of synthetic observations and their impact on forecast skills is evaluated, providing valuable insights for optimizing current and future observing systems for improving the weather forecasts. By sharing recent advancements and acknowledging challenges, this presentation seeks to inspire researchers to leverage the OSSE framework in weather forecasting. NASA's OSSE techniques hold promise for a better understanding of the atmosphere and the development of more accurate and reliable weather predictions.

Isaac Moradi↗

Improving probabilistic infectious disease forecasting through coherence

With an estimated $10.4 billion in medical costs and 31.4 million outpatient visits each year, influenza poses a serious burden of disease in the United States. To provide insights and advance warning into the spread of influenza, the U.S. Centers for Disease Control and Prevention (CDC) runs a challenge for forecasting weighted influenza-like illness (wILI) at the national and regional level. Many models produce independent forecasts for each geographical unit, ignoring the constraint that the national wILI is a weighted sum of regional wILI, where the weights correspond to the population size of the region. We propose a novel algorithm that transforms a set of independent forecast distributions to obey this constraint, which we refer to as probabilistically coherent. Enforcing probabilistic coherence led to an increase in forecast skill for 79% of the models we tested over multiple flu seasons, highlighting the importance of respecting the forecasting system’s geographical hierarchy.

59 BASIC BIOLOGICAL SCIENCES↗

Subseasonal Tropical Cyclone Prediction and Modulations by MJO and ENSO in CESM2

Subseasonal tropical cyclone (TC) reforecasts from the Community Earth System Model version 2 (CAM6) subseasonal prediction system are examined in this study. Here, we evaluate the modeled TC climatology and the probabilistic forecast skill of basin-wide TC genesis at weekly temporal resolution. Prediction skill is calculated using the Brier skill score relative to a constant annual mean climatology and to a monthly varying seasonal climatology during TC season. The model captures the observed basin-wide climatological TC seasonality and spatial distributions at weeks 1–6, but TC genesis is largely underestimated from Week 2 onward. For some basins and lead times, the predicted TC genesis is primarily controlled by the number of TC “seeds” and the mean-state climate condition. The model has good prediction skill relative to the constant climatology across all the basins and lead times, but is only skillful in the eastern Pacific, North Indian Ocean, and Southern Hemisphere at Week 1 when compared to the seasonal climatology, indicating limited skill in predicting deviations from the seasonal cycle. We find strong modulations of the predicted TC genesis at up to 3 weeks of forecast lead time by the Madden-Julian Oscillation. The interannual variability of predicted TC genesis and accumulated cyclone energy are skillfully predicted in the North Atlantic and the Northwestern Pacific, with a strong modulation by the El Nino-Southern Oscillation.

54 ENVIRONMENTAL SCIENCES↗

Comparative Analysis of Upper Ocean Heat Content Variability from Ensemble Operational Ocean Analyses

Upper ocean heat content (HC) is one of the key indicators of climate variability on many time-scales extending from seasonal to interannual to long-term climate trends. For example, HC in the tropical Pacific provides information on thermocline anomalies that is critical for the longlead forecast skill of ENSO. Since HC variability is also associated with SST variability, a better understanding and monitoring of HC variability can help us understand and forecast SST variability associated with ENSO and other modes such as Indian Ocean Dipole (IOD), Pacific Decadal Oscillation (PDO), Tropical Atlantic Variability (TAV) and Atlantic Multidecadal Oscillation (AMO). An accurate ocean initialization of HC anomalies in coupled climate models could also contribute to skill in decadal climate prediction. Errors, and/or uncertainties, in the estimation of HC variability can be affected by many factors including uncertainties in surface forcings, ocean model biases, and deficiencies in data assimilation schemes. Changes in observing systems can also leave an imprint on the estimated variability. The availability of multiple operational ocean analyses (ORA) that are routinely produced by operational and research centers around the world provides an opportunity to assess uncertainties in HC analyses, to help identify gaps in observing systems as they impact the quality of ORAs and therefore climate model forecasts. A comparison of ORAs also gives an opportunity to identify deficiencies in data assimilation schemes, and can be used as a basis for development of real-time multi-model ensemble HC monitoring products. The OceanObs09 Conference called for an intercomparison of ORAs and use of ORAs for global ocean monitoring. As a follow up, we intercompared HC variations from ten ORAs -- two objective analyses based on in-situ data only and eight model analyses based on ocean data assimilation systems. The mean, annual cycle, interannual variability and longterm trend of HC have been analyzed

Xue, Yan↗