Search NASA⌕ Search

SEARCH · Search NASA

Results for “performance forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Evaluating Flood Forecasting System Performance in Cambodia

Every year, Cambodia experiences flooding as a result of monsoon rains and typhoons. Flood forecasting systems are designed to enable people to mitigate economic and social impacts from these events. However, in order for forecasts to be used effectively, an assessment of their accuracy is needed. This study demonstrates the performance of regional and global flood forecasting systems over the 2019 flood season. To do this, we assess the flood forecast accuracy at different forecast lead times and gauge locations in Cambodia. We then compare the flood forecast performance to satellite-based flood maps produced by the Hydrological Remote Sensing Analysis of Floods (HYDRAFloods) tool currently being co-developed by SERVIR-Mekong in collaboration with the Myanmar Department of Disaster Management. This assessment of the flood forecasting systems’ performance and comparison to flood extents helps (1) provide valuable information to forecasters and disaster managers as they make improvements to their models, and (2) provides support to forecast users as they evaluate the strengths and weaknesses of different systems for taking action.

Nauman, Claire↗

Evaluating Flood Forecasting System Performance in Cambodia During the 2019 Flood Season

Every year, Cambodia experiences both flash and prolonged riverine flooding as a result of monsoon rains and typhoons. Floods occur frequently in various parts of the region, and result in significant economic cost. Flood forecasting systems are designed to mitigate economic and social impacts, enabling people to prepare for extreme events. However, in order for forecasts to be used effectively, an assessment of the available forecasting systems is needed. In addition, following the onset of flooding, satellite imagery is used to generate flood maps to aid in response efforts. This study demonstrates the performance of regional and global flood forecasting systems over the 2019 flood season. To do this, we assess the flood forecast accuracy at different forecast lead times through a series of forecast verification metrics at gauge locations in Cambodia. We then compare the flood forecast performance to Sentinel 1 flood maps produced by the Hydrological Remote Sensing Analysis of Floods (HYDRAFloods) tool currently being co-developed by SERVIR-Mekong in collaboration with the Myanmar Department of Disaster Management. This assessment of the flood forecasting systems’ performance and comparison to generated flood maps helps provide context to forecasters and disaster managers as they make improvements to their models. Additionally, these results provide support to forecast users as they evaluate the strengths and weaknesses of different systems for taking action.

Nauman, Claire M.↗

Assimilation of MODIS Dark Target and Deep Blue Observations in the Dust Aerosol Component of NMMB-MONARCH version 1.0

A data assimilation capability has been built for the NMMB-MONARCH chemical weather prediction system, with a focus on mineral dust, a prominent type of aerosol. An ensemble-based Kalman filter technique (namely the local ensemble transform Kalman filter - LETKF) has been utilized to optimally combine model background and satellite retrievals. Our implementation of the ensemble is based on known uncertainties in the physical parametrizations of the dust emission scheme. Experiments showed that MODIS AOD retrievals using the Dark Target algorithm can help NMMB-MONARCH to better characterize atmospheric dust. This is particularly true for the analysis of the dust outflow in the Sahel region and over the African Atlantic coast. The assimilation of MODIS AOD retrievals based on the Deep Blue algorithm has a further positive impact in the analysis downwind from the strongest dust sources of the Sahara and in the Arabian Peninsula. An analysis-initialized forecast performs better (lower forecast error and higher correlation with observations) than a standard forecast, with the exception of underestimating dust in the long-range Atlantic transport and degradation of the temporal evolution of dust in some regions after day 1. Particularly relevant is the improved forecast over the Sahara throughout the forecast range thanks to the assimilation of Deep Blue retrievals over areas not easily covered by other observational datasets.The present study on mineral dust is a first step towards data assimilation with a complete aerosol prediction system that includes multiple aerosol species.

atmospheric dust↗

Forecasting the Ambient Solar Wind with Numerical Models. I. On the Implementation of an Operational Framework

The ambient solar wind conditions in interplanetary space and in the near-Earth environment are determined by activity on the Sun. Steady solar wind streams modulate the propagation behavior of interplanetary coronal mass ejections and are themselves an important driver of recurrent geomagnetic storm activity. The knowledge of the ambient solar wind flows and fields is thus an essential component of successful space weather forecasting. Here, we present an implementation of an operational framework for operating, validating, and optimizing models of the ambient solar wind flow on the example of Carrington Rotation 2077. We reconstruct the global topology of the coronal magnetic field using the potential field source surface model (PFSS) and the Schatten current sheet model (SCS) and discuss three empirical relationships for specifying the solar wind conditions near the Sun, namely the Wang–Sheeley (WS) model, the distance from the coronal hole boundary model (DCHB), and the Wang-Sheeley–Arge (WSA) model. By adding uncertainty in the latitude about the sub-Earth point, we select an ensemble of initial conditions and map the solutions to Earth by the Heliospheric Upwind eXtrapolation (HUX) model. We assess the forecasting performance from a continuous variable validation and find that the WSA model most accurately predicts the solar wind speed time series (RMSE≈83 km/s). We note that the process of ensemble forecasting slightly improves the forecasting performance of all solar wind models investigated. We conclude that the implemented framework is well suited for studying the relationship between coronal magnetic fields and the properties of the ambient solar wind flow in the near-Earth environment.

Reiss, Martin A.↗

Evaluation of Aerosol Data Assimilation and Forecasts in the NASA GEOS Model during the ASIA-AQ Campaign

Fine particulate matter (PM2.5) poses significant risks to human health and the environment by penetrating the lungs and causing respiratory and cardiovascular diseases, making it crucial to understand its sources and behavior for effective air quality management. The Goddard Earth Observing System (GEOS) Forward Processing (FP) system model, operated by the Global Modeling and Assimilation Office (GMAO) at NASA's Goddard Space Flight Center, provides real-time weather and aerosol analyses and forecasts. In addition to meteorological data assimilation, the GEOS-FP system also assimilates aerosol using Moderate Resolution Imaging Spectroradiometer (MODIS) Aerosol Optical Depth (AOD) and Aerosol Robotic Network (AERONET) AOD data. In this study, the aerosol data assimilation and forecasts performance of the GEOS-FP model were evaluated for predicting PM2.5 in Korea using observations from the Airborne and Satellite Investigation of Asian Air Quality (ASIA-AQ) campaign. The ASIA-AQ campaign, an international collaborative field study initiative, aims to enhance understanding of local air quality issues and address common challenges in interpreting satellite data and air quality modeling. Conducted in South Korea from February 15 to March 13, 2024, during the high PM2.5 concentration winter season, this campaign provided extensive airborne and ground observations for intensive analysis of PM2.5 model simulations. We demonstrate how the assimilation runs and the forecasting performance of PM2.5 at 24-hour and 48-hour intervals vary. Additionally, we analyzed the differences and characteristics of PM2.5 composition in cases of long-range transport and local emissions. Using ASIA-AQ airborne data, we also examined the vertical profile of fine particulate matter. Through the intensive observations of this campaign, the GEOS model was assessed over South Korea using both in situ and airborne measurements to establish a baseline and identify priorities for future development.

Seunghee Lee↗

Multi-Agency Ensemble Forecast of Wildfire Air Quality in the United States: Toward Community Consensus of Early Warning

Wildfires pose increasing risks to human health and properties in North America. Due to large uncertainties in fire emission, transport, and chemical transformation, it remains challenging to accurately predict air quality during wildfire events, hindering our collective capability to issue effective early warnings to protect public health and welfare. Here we present a new real-time Hazardous Air Quality Ensemble System (HAQES) by leveraging various wildfire smoke forecasts from three U.S. federal agencies (NOAA, NASA, and Navy). Compared to individual models, the HAQES ensemble forecast significantly enhances forecast accuracy. To further enhance forecasting performance, a weighted ensemble forecast approach was introduced and tested. Compared to the unweighted ensemble mean, the multilinear regression weighted ensemble reduced fractional bias by 34% in the major fire regions, false alarm rate by 72%, and increased hit rate by 17%. Finally, we improved the weighted ensemble using quantile regression and weighted regression methods to enhance the forecast of extreme air quality events. The advanced weighted ensemble increased the PM2.5 exceedance hit rate by 55% compared to the ensemble mean. Our findings provide insights into the development of advanced ensemble forecast methods for wildfire air quality, offering a practical way to enhance decision-making support to protect public health.

Yunyao Li↗

A Validation Study of the Performance Prediction Methodology of the Early Warning Metrics

Complex projects frequently experience delays and develop backlogs of their project control milestones during the acquisition and development lifecycles. In response, the National Aeronautics and Space Administration (NASA) Goddard Space Flight Center (GSFC) formed an independent group of Subject Matter Experts (SMEs) to monitor the execution performance of GSFC Flight projects and instruments that are under development. The SME team’s objective is to generate data driven performance-based indicators that quantify the degree to which projects are meeting their respective schedule and budget commitments. One of these performance-based indicators, the Early Warning Metrics, provides performance forecasts and insight to project performance relative to historical successful projects. Herein this paper describes the purpose and utility of the Early Warning Metrics. Additionally, the initial prediction method used in the creation of the metrics is described along with its validity and the validity of comparable prediction methods.

Holloman, Sherrica↗

Soil Moisture as a Harbinger of Increased Forecast Reliability at Subseasonal Time Scales

The shape of the nonlinear relationship between evapotranspiration and soil moisture (the "ET-W relationship") helps control the evolution of soil moisture with time. Together, the shape of the relationship and the magnitude of the soil moisture anomaly at the beginning of a subseasonal forecast help determine whether a given anomaly will still be present at subseasonal leads, allowing it to contribute to skill in subseasonal temperature and precipitation prediction at those leads. In this study we examine subseasonal prediction in the context of soil moisture initialization using a suite of forecasts performed with the NASA GEOS seasonal forecast system. Large soil moisture anomalies are in fact found to be harbingers of increased skill in the subseasonal forecasts. Furthermore, accounting explicitly for the nonlinear shape of the ET-W relationship improves our ability to quantity the increase in forecast reliability associated with soil moisture initialization.

Koster, Randal↗

Stratospheric wind errors, initial states and forecast skill in the GLAS general circulation model

Relations between stratospheric wind errors, initial states and 500 mb skill are investigated using the GLAS general circulation model initialized with FGGE data. Erroneous stratospheric winds are seen in all current general circulation models, appearing also as weak shear above the subtropical jet and as cold polar stratospheres. In this study it is shown that the more anticyclonic large-scale flows are correlated with large forecast stratospheric winds. In addition, it is found that for North America the resulting errors are correlated with initial state jet stream accelerations while for East Asia the forecast winds are correlated with initial state jet strength. Using 500 mb skill scores over Europe at day 5 to measure forecast performance, it is found that both poor forecast skill and excessive stratospheric winds are correlated with more anticyclonic large-scale flows over North America. It is hypothesized that the resulting erroneous kinetic energy contributes to the poor forecast skill, and that the problem is caused by a failure in the modeling of the stratospheric energy cycle in current general circulation models independent of vertical resolution.

Tenenbaum, J.↗

Simulations of the February 1979 stratospheric sudden warming: Model comparisons and three-dimensional evolution

The evolution of the stratopsheric flow during the major stratospheric sudden warming of February 1979 is studied using two primitive equation models of the stratosphere and mesosphere. The United Kingdom Meteorological Office Stratosphere-Mesosphere Model (SMM) uses log pressure as a vertical coordinate. A spectral, entropy coordinate version of the SMM (entropy coordinate model, or ECM) that has recently been developed is also used. Comparison of SMM simulations with forecasts performed using the University of California, Los Angeles general circulation model confirms the previously noted sensitivity of stratospheric forecasts to tropospheric forecasts and emphasizes the importance of adequate vertical resolution in modeling the stratosphere. The ECM simulations provide a schematic description of the three-dimensional evolution of the polar vortex and the motion of air through it. During the warming, the two cyclonic vortices tilt westward and equatorward with height. Strong upward velocities develop in the lower stratosphere on the west (cold) side of a baroclinic zone as it forms over Europe and Asia. Strong downward velocities appear in the upper stratosphere on the east (warm) side, strengthening the temperature gradients. After the peak of the warming, vertical velocities decrease, downward velocities move into the lower stratosphere, and upward velocities move into the upper stratosphere.

Manney, G. L.↗

Use of Data to Improve El Nino Southern Oscillation Simulations and Forecasts

Various data over the period 1980-1998 have been used to improve El Nino Southern Oscillation (ENSO) simulations and forecasts performed by coupled ocean/atmosphere models. For such a study, oceanic and atmospheric satellite data are necessary. Models assume a baroclinic ocean with a mixed layer coupled to a baroclinic atmosphere to simulate the anomalous fields. The various data have been used to revisit the parameterizations of the subsurface temperature in the mixed layer, atmospheric convection, and friction in the baroclinic ocean. This new model, named Tsub.Conv, simulates 4-year oscillations like the model with the original parameterization, but with anomalous thermocline and wind anomalies that agree a lot better with reality. The atmospheric model still presents some deficiencies in the eastern Pacific and when it is replaced by a statistical atmosphere, the coupled model (Tsub.Astat) performs even better. It is found that the off-equatorial ocean and wind curl anomalies play a crucial role for all these models and that Tsub.Astat simulates an ocean heat content recharge coming from the north prior to a warm event like the ones observed during the 1985-1992 period. The ENSO forecasts over 1980-1998 are considerably improved with Tsub.Astat. One needs to add the simulation of westerly wind bursts to be able to forecast the 1997 event one year in advance. Additional information is contained in the original.

Perigaud, Claire↗

GRACE Improves Seasonal Groundwater Forecast Initialization Over the United States

We evaluate the impact of Gravity Recovery and Climate Experiment data assimilation (GRACE-DA) on seasonal hydrological forecast initialization over the United States, focusing on groundwater storage. GRACE-based terrestrial water storage (TWS) estimates are assimilated into a land surface model for the2003–16 period. Three-month hindcast (i.e., forecast of past events) simulations are initialized using states from the reference (no data assimilation) and GRACE-DA runs. Differences between the two initial hydrological condition (IHC) sets are evaluated for two forecast techniques at 305 wells where depth to water table measurements are available. Results show that using GRACE-DA-based IHC improves seasonal groundwater forecast performance in terms of both RMSE and correlation. While most regions show improvement, degradation is common in the High Plains, where withdrawals for irrigation practices affect groundwater variability more strongly than the weather variability, which demonstrates the need for simulating such activities. These findings contribute to recent efforts toward an improved U.S. drought monitoring and forecast system.

Augusto Getirana↗

Mt. Pinatubo's Impacts on the GEOS Forecasting System

The eruption of Mount Pinatubo in June 1991 had dramatic effects on the global climate, introducing a sudden and extreme forcing on the radiative budget. In this presentation we analyze the effects of the Mt. Pinatubo eruption on the seasonal forecast performed with Goddard Earth Observing System (GEOS), an Earth System Model that includes a bulk aerosol model coupled to radiation and an interactive ocean.We performed three ten-member ensembles of 12-month simulations (June 1991-May 1992). These simulations were performed with a 0.5 longitude by 0.5 latitude horizontal resolution. Out of the three ensembles, one excludes the eruption, representing the control experiment. The other two ensembles include the eruption of Mt. Pinatubo, varying in the effective radius of the volcanic sulfate: one assumed the effective radius to be equal to 0.35 micron (as for tropospheric aerosol) and the other has the effective radius set to 0.6 micron (closer to natural observation). Through the analysis of the aerosol forcing results derived from the two assumptions, we can show how this forcing acts on the seasonal forecast system. In particular, we will focus on the impacts to the surface and ocean temperatures and precipitation.

Mukherjee, Nikita↗

Report of the Panel on Computer and Information Technology

Aircraft have become more and more dependent on computers (information processing) for improved performance and safety. It is clear that this activity will grow, since information processing technology has advanced by a factor of 10 every 5 years for the past 35 years and will continue to do so. Breakthroughs in device technology, from vacuum tubes through transistors to integrated circuits, contribute to this rapid pace. This progress is nearly matched by similar, though not as dramatic, advances in numerical software and algorithms. Progress has not been easy. Many technical and nontechnical challenges were surmounted. The outlook is for continued growth in capability but will require surmounting new challenges. The technology forecast presented in this report has been developed by extrapolating current trends and assessing the possibilities of several high-risk research topics. In the process, critical problem areas that require research and development emphasis have been identified. The outlook assumes a positive perspective; the projected capabilities are possible by the year 2000, and adequate resources will be made available to achieve them. Computer and information technology forecasts and the potential impacts of this technology on aeronautics are identified. Critical issues and technical challenges underlying the achievement of forecasted performance and benefits are addressed.

Lundstrom, Stephen F.↗

Using Machine-Learning Methods and Expert Prediction Probabilities to Forecast Solar Flares

It has long been known that studying connection between solar flares and properties of magnetic field in active regions is very important for understanding the flare physics and developing space weather forecasts. The Helioseismic and Magnetic Imager onboard the Solar Dynamics Observatory (SDO/HMI) obtains tremendous amounts of magnetic field data products. However the operational NOAA Space Weather Prediction Center (SWPC) forecasts of solar flares still represent prediction probabilities issued by the experts. In this research we investigate the possibilities to enhance the daily operational flare forecasts performed at the SWPC by developing a synergy of the expert predictions and physics-based criteria, and by employing machine-learning methods. Among the physics-based criteria we consider the descriptors of the Polarity Inversion Line (PIL) and Space weather HMI Active Region Patches (SHARP), and derive from them daily characteristics of the entire Sun. We also consider the daily descriptors of the GOES Soft X-Ray (SXR) 1-8 Angstroms flux such as the flare history of the previous days and averaged X-Ray flux. We estimate the effectiveness in separation of flaring and non-flaring cases for each characteristic, as well as for the expert prediction probabilities, and find that some PIL, SHARP and SXR descriptors are as effective as the expert prediction probabilities and should be considered to issue the flare forecast. Finally, we train and test several Machine-Learning classification algorithms (Support Vector Classifiers with various kernel functions, k-Nearest Neighbor Classifier, Random Forest Classifier, and Neural Networks) using the most effective descriptors and expert prediction probabilities, and compare the obtained predictions with the current SWPC forecasts.

Machine-Learning↗

Template Matching Approach to Signal Prediction

A new approach to signal prediction and prognostic assessment of spacecraft health resolves an inherent difficulty in fusing sensor data with simulated data. This technique builds upon previous work that demonstrated the importance of physics-based transient models to accurate prediction of signal dynamics and system performance. While models can greatly improve predictive accuracy, they are difficult to apply in general because of variations in model type, accuracy, or intended purpose. However, virtually any flight project will have at least some modeling capability at its disposal, whether a full-blown simulation, partial physics models, dynamic look-up tables, a brassboard analogue system, or simple hand-driven calculation by a team of experts. Many models can be used to develop a predict, or an estimate of the next day s or next cycle s behavior, which is typically used for planning purposes. The fidelity of a predict varies from one project to another, depending on the complexity of the simulation (i.e. linearized or full differential equations) and the level of detail in anticipated system operation, but typically any predict cannot be adapted to changing conditions or adjusted spacecraft command execution. Applying a predict blindly, without adapting the predict to current conditions, produces mixed results at best, primarily due to mismatches between assumed execution of spacecraft activities and actual times of execution. This results in the predict becoming useless during periods of complicated behavior, exactly when the predict would be most valuable. Each spacecraft operation tends to show up as a transient in the data, and if the transients are misaligned, using the predict can actually harm forecasting performance. To address this problem, the approach here expresses the predict in terms of a baseline function superposed with one or more transient functions. These transients serve as signal templates, which can be relocated in time and space against the signal background. One then has the ability to reconstruct a signal regardless of the precise timing of the transients. During operation, one applies the actual start times of spacecraft activities as they occur, and produces a reconstructed, accurate predict in real-time. This general approach is valid under two important conditions. First, the transients themselves must be time-invariant. Second, the transients must be reasonably consistent with respect to different operating points. Both of these assumptions are generally valid, but in the case of a complicated system with numerous types of overlapping transients, this approach may not be effective. Fortunately, there tend to be few transients in spacecraft telemetry of sensor quantities or low-level health and status information because these signals rarely reflect multiple different types of operation. Furthermore, if the predict is at least reasonably close to actual operation, the shift either in time, or in the operating point when the transient occurs - is likely to be small. The proposed approach considers three ways to recognize a transient. The first and most reliable is to use a different signal that identifies operating mode - often the transient will be correlated to a change in operating mode, and this change can usually be detected positively from discrete signals in spacecraft telemetry. If there is no useful mode signal, the second option is to identify the transient template by hand, and detect the onset of the transient using a curve-fitting approach. Finally, if one elects not to choose by hand, there is an option for automatic selection. This technique has been applied to sensor data from several JPL missions and industrial applications, demonstrating an improvement in accurate prediction of future behavior and early detection of system problems. This technique is applicable to practically any time-varying, quantitative sensor measurement.

Mackey, Ryan↗

Experiments with the fourth order GISS general circulation model

The new GISS GCM with 4th order conservative horizontal finite difference is briefly described. A simple forecast performed with real initial data indicates a significant increase in skill with respect to standard 2nd order GISS GCM. The improvement is limited by other sources of errors, especially poor initial data and vertical truncation. It is estimated that with a 4th order - 200 km grid model, errors introduced by horizontal truncation will be negligible for about a week for most synoptic scales (wavelengths larger than 1000 km).

Kalnay-Rivas, E.↗