Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

Impact of Aquarius and SMAP Sea Surface Salinity Observations on Seasonal Predictions of the 2015 El Nino

We assess the impact of satellite sea surface salinity (SSS) observations on dynamical ENSO forecasts for the big 2015 El Nino event. From March to June 2015, the availability of two overlapping satellite SSS instruments, Aquarius and SMAP, allows a unique opportunity to compare and contrast coupled forecasts generated with the benefit of these two satellite SSS observation types. Four distinct experiments are presented that include 1) freely evolving model SSS (i.e. no satellite SSS), relaxation to 2) climatological SSS (i.e. WOA13 (World Ocean Atlas 2013) SSS), 3) Aquarius and 4) SMAP initialization. Coupled hindcasts are generated from these initial conditions for March 2015. These forecasts are then validated against observations and evaluated with respect to the observed El Nino development.

Kovach, R.↗
NASA NTRS2019

Evaluation of GEOS Total Cloud Fraction with GLOBE Citizen Science Observations and Co-Located Satellite Data

Here we evaluate the total cloud fraction in cycled forecast experiments with the NASA Global Earth Observing System (GEOS) model. Forecasts were run for summer and winter periods of 2017/2018 and compared with ground-based and satellite observations. Citizen science observations from the Global Learning and Observations to Benefit the Environment (GLOBE) Program were matched with MODIS satellite overpasses and geostationary cloud fraction, yielding a dataset of coincident observations for comparison with hourly model output. The observations indicate a model bias toward overcast and clear conditions, with underestimation of intermediate cloud fractions. We investigate underestimation of variance in the sub-grid total water probability density function (PDF) as a possible cause. The PDF determines large-scale cloud fraction as the sub-grid fraction with total water exceeding the saturation specific humidity. We conduct model experiments in which the shape, width, and spatial dependence of the PDF are varied, and consider the impacts on cloud fraction relative to the combined observations.

Starke, Matthew↗
NASA NTRSDate not supplied

Designing and Evaluating NASA SPoRT Center’s DustTracker-AI Model for Detecting Dust in NASA/NOAA Geostationary Satellite Imagery

- Near real-time identification of airborne dust in satellite imagery is important for mitigating the adverse effects of dust storms on human activities. - False color Red-Green-Blue (RGB) imagery has been used for dust detection, but it has limitations and can be difficult to interpret. - The NASA Short-term Research and Transition (SPoRT) center has developed a night-time dust detection random forest (NT-DustTracker-AI, Berndt et al. 2021) model using NASA/NOAA Geostationary Operational Environmental Satellite-16 (GOES-16) Advanced Baseline Imager (ABI) infrared imagery as inputs. - The SPoRT center has partnered with the NOAA National Weather Service to evaluate the model for use in weather forecasting operations, and preliminary results have been positive. - The SPoRT center has expanded the model to cover both day and night, continuing to use infrared imagery as inputs. This new model, known as DustTracker-AI, has shown good agreement with available dust observations

Robert A. Junod↗
NASA NTRS2003

Adaptation of Mesoscale Weather Models to Local Forecasting

Methodologies have been developed for (1) configuring mesoscale numerical weather-prediction models for execution on high-performance computer workstations to make short-range weather forecasts for the vicinity of the Kennedy Space Center (KSC) and the Cape Canaveral Air Force Station (CCAFS) and (2) evaluating the performances of the models as configured. These methodologies have been implemented as part of a continuing effort to improve weather forecasting in support of operations of the U.S. space program. The models, methodologies, and results of the evaluations also have potential value for commercial users who could benefit from tailoring their operations and/or marketing strategies based on accurate predictions of local weather. More specifically, the purpose of developing the methodologies for configuring the models to run on computers at KSC and CCAFS is to provide accurate forecasts of winds, temperature, and such specific thunderstorm-related phenomena as lightning and precipitation. The purpose of developing the evaluation methodologies is to maximize the utility of the models by providing users with assessments of the capabilities and limitations of the models. The models used in this effort thus far include the Mesoscale Atmospheric Simulation System (MASS), the Regional Atmospheric Modeling System (RAMS), and the National Centers for Environmental Prediction Eta Model ( Eta for short). The configuration of the MASS and RAMS is designed to run the models at very high spatial resolution and incorporate local data to resolve fine-scale weather features. Model preprocessors were modified to incorporate surface, ship, buoy, and rawinsonde data as well as data from local wind towers, wind profilers, and conventional or Doppler radars. The overall evaluation of the MASS, Eta, and RAMS was designed to assess the utility of these mesoscale models for satisfying the weather-forecasting needs of the U.S. space program. The evaluation methodology includes objective and subjective verification methodologies. Objective (e.g., statistical) verification of point forecasts is a stringent measure of model performance, but when used alone, it is not usually sufficient for quantifying the value of the overall contribution of the model to the weather-forecasting process. This is especially true for mesoscale models with enhanced spatial and temporal resolution that may be capable of predicting meteorologically consistent, though not necessarily accurate, fine-scale weather phenomena. Therefore, subjective (phenomenological) evaluation, focusing on selected case studies and specific weather features, such as sea breezes and precipitation, has been performed to help quantify the added value that cannot be inferred solely from objective evaluation.

Manobianco, John T.↗
NASA NTRSDate not supplied

Lessons Learned From Smallsat Microwave Sounders Data Assimilation in the NASA Goddard Earth Observing System (GEOS)

The NASA Time-Resolved Observations of Precipitation structure and storm Intensity with a Constellation of Smallsats (TROPICS) mission is a constellation of small satellites carrying state-of-art microwave temperature and humidity sounders with 12 channels between 91 GHz and 205 GHz frequency. Including TROPICS-pathfinder, launched on 30 June 2021, five TROPICS satellites operate and provide temperature and humidity data to NWP and atmospheric retrieval communities. This study evaluates the quality of radiance data from these five satellites. It assesses data impacts on NASA Goddard Earth Observing System (GEOS) global NWP analysis and forecasts while seeking answers to the following key questions: 1. What information do TROPICS satellites bring to NWP analysis? 2. How will TROPICS data assimilation affect NWP forecasts, including tropical cyclone analysis and forecasts? 3. What are the benefits of having multiple TROPICS satellites in NWP forecasts? 4. What are the weaknesses regarding instrument stability, consistency, and data quality of these CubeSats? 5. Can multiple TROPICS make similar impacts as conventional MW sensors such as ATMS or GPM Microwave Imager (GMI)? The sensitivities of each TROPICS channel to temperature, water vapor, cloud, and precipitation are examined in various weather conditions. Results from observing system experiments assimilating TROPICS radiance are used for evaluation metrics, including forecast skills and fit to other observations such as radiosondes and microwave and infrared sounders. Finally, the lessons learned from using these cube satellite radiance data in the GEOS atmospheric data assimilation system are shared.

Min-Jeong Kim↗
NASA NTRS2024

Enabling the Assimilation of CrIS Shortwave Infrared Observations in Global NWP at NOAA. Part II: OSEs and Results

The assimilation of data from hyperspectral infrared sounders in global data assimilation systems has historically been focused on observations in the longwave infrared (LWIR) region of the spectrum (650-1100 cm−1), despite the often concurrent availability of measurements from the shortwave infrared (SWIR) region of the spectrum (2150-2550 cm−1), because issues (like solar effects) have generally prevented the assimilation of SWIR observations. Recent advances in radiative transfer models have worked to address some of the previous challenges in simulating SWIR observations, and the assimilation of SWIR data (e.g. from potential future small-satellites) is now a feasible prospect. Still, a better understanding of how these observations perform in a data assimilation system and impact resulting analyses and NWP forecasts is necessary. In this study, the value of SWIR observations in global NWP is assessed by assimilating SWIR observations from the Cross-track Infrared Sounder (CrIS) in NOAA’s Global Data Assimilation System (GDAS). The methodologies used to enable the assimilation of these observations, including the implementation of a scene-dependent observation error and the enhancement of quality control procedures, are discussed, as are the results of Observing System Experiments (OSEs) conducted to evaluate the impact of assimilating SWIR observations on forecast skill. The overall results show that SWIR assimilation produces similar forecast impacts to LWIR assimilation. The ability to demonstrate that the assimilation or SWIR observations in NWP is a realistic prospect may help to shape future constellations of small-satellites to serve as a beneficial complement to the current constellation if hyperspectral IR sounders.

Erin Jones↗
NASA NTRS1996

Workstation-Based Real-Time Mesoscale Modeling Designed for Weather Support to Operations at the Kennedy Space Center and Cape Canaveral Air Station

This paper describes the capabilities and operational utility of a version of the Mesoscale Atmospheric Simulation System (MASS) that has been developed to support operational weather forecasting at the Kennedy Space Center (KSC) and Cape Canaveral Air Station (CCAS). The implementation of local, mesoscale modeling systems at KSC/CCAS is designed to provide detailed short-range (less than 24 h) forecasts of winds, clouds, and hazardous weather such as thunderstorms. Short-range forecasting is a challenge for daily operations, and manned and unmanned launches since KSC/CCAS is located in central Florida where the weather during the warm season is dominated by mesoscale circulations like the sea breeze. For this application, MASS has been modified to run on a Stardent 3000 workstation. Workstation-based, real-time numerical modeling requires a compromise between the requirement to run the system fast enough so that the output can be used before expiration balanced against the desire to improve the simulations by increasing resolution and using more detailed physical parameterizations. It is now feasible to run high-resolution mesoscale models such as MASS on local workstations to provide timely forecasts at a fraction of the cost required to run these models on mainframe supercomputers. MASS has been running in the Applied Meteorology Unit (AMU) at KSC/CCAS since January 1994 for the purpose of system evaluation. In March 1995, the AMU began sending real-time MASS output to the forecasters and meteorologists at CCAS, Spaceflight Meteorology Group (Johnson Space Center, Houston, Texas), and the National Weather Service (Melbourne, Florida). However, MASS is not yet an operational system. The final decision whether to transition MASS for operational use will depend on a combination of forecaster feedback, the AMU's final evaluation results, and the life-cycle costs of the operational system.

Manobianco, John↗
NASA NTRS2012

Comparing Physics Scheme Performance for a Lake Effect Snowfall Event in Northern Lower Michigan

High resolution forecast models, such as those used to predict severe convective storms, can also be applied to predictions of lake effect snowfall. A high resolution WRF model forecast model is provided to support operations at NWS WFO Gaylord, Michigan, using a 12 ]km and 4 ]km nested configuration. This is comparable to the simulations performed by other NWS WFOs adjacent to the Great Lakes, including offices in the NWS Eastern Region who participate in regional ensemble efforts. Ensemble efforts require diversity in initial conditions and physics configurations to emulate the plausible range of events in order to ascertain the likelihood of different forecast scenarios. In addition to providing probabilistic guidance, individual members can be evaluated to determine whether they appear to be biased in some way, or to better understand how certain physics configurations may impact the resulting forecast. On January 20 ]21, 2011, a lake effect snow event occurred in Northern Lower Michigan, with cooperative observing and CoCoRaHS stations reporting new snow accumulations between 2 and 8 inches and liquid equivalents of 0.1 ]0.25 h. The event of January 21, 2011 was particularly well observed, with numerous surface reports available. It was also well represented by the WRF configuration operated at NWS Gaylord. Given that the default configuration produced a reasonable prediction, it is used here to evaluate the impacts of other physics configurations on the resulting prediction of the primary lake effect band and resulting QPF. Emphasis here is on differences in planetary boundary layer and cloud microphysics parameterizations, given their likely role in determining the evolution of shallow convection and precipitation processes. Results from an ensemble of seven microphysics schemes and three planetary boundary layer schemes are presented to demonstrate variability in forecast evolution, with results used in an attempt to improve the forecasts in the 2011 ]2012 lake effect season.

Molthan, Andrew↗
NASA NTRS2014

Evaluation of Mixed-Phase Microphysics Within Winter Storms Using Field Data and In Situ Observations

Snow prediction within models is sensitive to the snow densities, habits, and degree of riming within the BMPs. Improving these BMPs is a crucial step toward improving both weather forecasting and climate predictions. Several microphysical schemes in the Weather Research and Forecasting (WRF) model down to 1.33-km grid spacing are evaluated using aircraft, radar, and ground in situ data from the Global Precipitation Mission Cold-season Precipitation Experiment (GCPEx) experiment over southern Ontario, as well as a few years (12 winter storms) of surface measurements of riming, crystal habit, snow density, and radar measurements at Stony Brook, NY (SBNY on north shore of Long Island) during the 2009-2012 winter seasons. Surface microphysical measurements at SBNY were taken every 15 to 30 minutes using a stereo microscope and camera, and snow depth and snow density were also recorded. During these storms, a vertically-pointing Ku band radar was used to observe the vertical evolution of reflectivity and Doppler vertical velocities. The GCPex presentation will focus on verification using aircraft spirals through warm frontal snow band event on 18 February 2012. All the BMPs realistically simulated the structure of the band and the vertical distribution of snow/ice aloft, except the SBU-YLIN overpredicted slightly and Thompson (THOM) underpredicted somewhat. The Morrison (MORR) scheme produced the best slope size distribution for snow, while the Stony Brook (SBU) underpredicted and the THOM slightly overpredicted. Those schemes that have the slope intercept a function of temperature (SBU and WSM6) tended to perform better for that parameter than others, especially the fixed intercept in Goddard. Overall, the spread among BMPs was smaller than in other studies, likely because there was limited riming with the band. For the 15 cases at SBNY, which include moderate and heavy riming events, the non-spherical snow assumption (THOM and SBU-YLIN) simulated a more realistic distribution of reflectivity than spherical snow assumptions in the WSM6 and MORR schemes. The MORR, WSM6, and SBU schemes are comparable to the observed velocity distribution in light and moderate riming periods. The THOM is approx. 0.25 m/s too slow with its velocity distribution in these periods. In heavier riming, the vertical Doppler velocities in the WSM6, THOM, and MORR schemes were approx. 0.25 m/s too slow, while the SBU was 0.25 to 0.5 m/s too fast because of some excessive cloud water issues.

Colle, Brian A.↗
NASA NTRS2020

Subseasonal-to-Seasonal Hindcast Skill Assessment of Ridging Events Related to Drought Over the Western United States

Persistent atmospheric ridging events centered near the western United States are associated with widespread precipitation deficits and meteorological drought. Due to the relatively low skill of- dynamical models in forecasting precipitation on subseasonal‐to‐seasonal (S2S) time scales across this region, forecasts of ridging are explored in this study as a potential bridge for early warning drought prediction. To assess skill, we evaluate deterministic and probabilistic S2S hindcasts (out to 6 week lead time) of ridging events and geopotential height anomalies over the western United States in five ensemble hindcast systems. Prediction skill for ridging events is shown to be highly variable across models. For some models, longer‐time‐averaged patterns of geopotential height anomalies across the first 6 weeks can be skillfully simulated, when evaluated probabilistically against climatology. The most skillful models show modest skill in forecasting above normal ridging occurrences at lead times of Weeks 3–4 and Weeks 5–6,with some sensitivity to the specific ridge location and method for determining skill. Using the European Centre for Medium‐Range Weather Forecasts (ECMWF) model as a case study, longer lead time forecast busts are shown to often occur under extended periods of highly active La Nina‐like tropical convection. Model errors at simulating these tropical convection features may have a disproportionately large impact and degrade downstream forecasts over the western United States. Despite the documented model shortcomings, our results highlight an opportunity to target skillful ridging forecasts from dynamical models for improving early warning drought forecasting at S2S lead times.

S2S↗
NASA NTRS2012

Evaluation of NASA SPoRT's Pseudo-Geostationary Lightning Mapper Products in the 2011 Spring Program

NASA's Short-term Prediction Research and Transition (SPoRT) program is a contributing partner with the GOES-R Proving Ground (PG) preparing forecasters to understand and utilize the unique products that will be available in the GOES-R era. This presentation emphasizes SPoRT s actions to prepare the end user community for the Geostationary Lightning Mapper (GLM). This preparation is a collaborative effort with SPoRT's National Weather Service partners, the National Severe Storms Laboratory (NSSL), and the Hazardous Weather Testbed s Spring Program. SPoRT continues to use its effective paradigm of matching capabilities to forecast problems through collaborations with our end users and working with the developers at NSSL to create effective evaluations and visualizations. Furthermore, SPoRT continues to develop software plug-ins so that these products will be available to forecasters in their own decision support system, AWIPS and eventually AWIPS II. In 2009, the SPoRT program developed the original pseudo geostationary lightning mapper (PGLM) flash extent product to demonstrate what forecasters may see with GLM. The PGLM replaced the previous GLM product and serves as a stepping-stone until the AWG s official GLM proxy is ready. The PGLM algorithm is simple and can be applied to any ground-based total lightning network. For 2011, the PGLM used observations from four ground-based networks (North Alabama, Kennedy Space Center, Oklahoma, and Washington D.C.). While the PGLM is not a true proxy product, it is intended as a tool to train forecasters about total lightning as well as foster discussions on product visualizations and incorporating GLM-resolution data into forecast operations. The PGLM has been used in 2010 and 2011 and is likely to remain the primary lightning training tool for the GOES-R program for the near future. This presentation will emphasize the feedback received during the 2011 Spring Program. This will discuss several topics. Based on feedback from the 2010 Spring Program, SPoRT created two variant PGLM products, which NSSL produced locally and provided in real-time within AWIPS for 2011. The first is the flash initiation density (FID) product, which creates a gridded display showing the number of flashes that originated in each 8 8 km grid box. The second product is the maximum flash density (MFD). This shows the highest PGLM value for each grid point over a specific period of time, ranging from 30 to 120 minutes. In addition to the evaluation of these two new products, the evaluation of the PGLM itself will be covered. The presentation will conclude with forecaster feedback for additional improvements requested for future evaluations, such as within the 2012 Spring Program.

Stano, Geoffrey T.↗
NASA NTRS2013

Evaluation of the Impact of Atmospheric Infrared Sounder (AIRS) Radiance and Profile Data Assimilation in Partly Cloudy Regions

Improvements to global and regional numerical weather prediction have been demonstrated through assimilation of data from NASA s Atmospheric Infrared Sounder (AIRS). Current operational data assimilation systems use AIRS radiances, but impact on regional forecasts has been much smaller than for global forecasts. Retrieved profiles from AIRS contain much of the information that is contained in the radiances and may be able to reveal reasons for this reduced impact. Assimilating AIRS retrieved profiles in an identical analysis configuration to the radiances, tracking the quantity and quality of the assimilated data in each technique, and examining analysis increments and forecast impact from each data type can yield clues as to the reasons for the reduced impact. By doing this with regional scale models individual synoptic features (and the impact of AIRS on these features) can be more easily tracked. This project examines the assimilation of hyperspectral sounder data used in operational numerical weather prediction by comparing operational techniques used for AIRS radiances and research techniques used for AIRS retrieved profiles. Parallel versions of a configuration of the Weather Research and Forecasting (WRF) model with Gridpoint Statistical Interpolation (GSI) are run to examine the impact AIRS radiances and retrieved profiles. Statistical evaluation of 6 weeks of forecast runs will be compared along with preliminary results of in-depth investigations for select case comparing the analysis increments in partly cloudy regions and short-term forecast impacts.

Zavodsky, Bradley↗
NASA NTRSDate not supplied

Application of the Global Precipitation Forecast dataset for Global Landslide Forecasting System

Landslides are extremely damaging, pervasive and cause fatalities and economic impacts. Extreme rainfall events, coupled with inopportune surface conditions, are the primary triggers of landslides around the world. Forecasting landslide events represent an area of open research. A global Landslide Hazard Assessment for Situational Awareness (LHASA) model has been created that provides near real-time dynamic landslide characterization using Integrated Multi-Satellite Retrievals for Global Precipitation Mission (IMERG). However, it does not provide information on prediction of landslides into future. This study considers how global precipitation forecast data compares to satellite rainfall at different spatiotemporal scales and outlines the potential for its use in landslide hazard prediction/forecasting system. NASA Goddard Earth Observing System (GEOS)-Forecast model assimilates new observations every 6 hours, at 00, 06, 12, and 18 UTC. The GEOS-Forecast model is initialized at 00 UTC and is evaluated with IMERG Early, using Multi-Radar Multi-Sensor gauge corrected (MRMS-GC) precipitation product as a reference over contiguous United States (CONUS). Categorical and continuous statistics along with probability density functions and cumulative distribution functions are considered to assess the performance of the precipitation products, with a focus on landslide hotspots. Seasonality appears to influence the performance of both the GEOS-Forecast and IMERG Early product. Moreover, the global comparison between the GEOS-Forecast and IMERG Early is carried out in terms of percentile difference, correlation, and bias maps. For extreme rainfall events in regions such as Mekong, Colombia, and Tajikistan, GEOS-Forecast appears to resolve high rainfall relative to IMERG Early more frequently. Validation over landslide points reveal that for 24hr rainfall accumulations > 100mm, GEOS-Forecast and IMERG coincide. GEOS-Forecast and IMERG Early precipitation matches more closely for tropical cyclones than other types of storms. Overall, the performance varies with respect to location, rainfall intensities, and type of precipitation events.

Sana Khan↗
NASA NTRS2002

Bridging the Gap Between Research and Operations in the National Weather Service: The Huntsville Model

The National Weather Service Office (WFO) in Huntsville, Alabama (HUN) is slated to begin full-time operations in early 2003. With the opening of the Huntsville WFO, a unique opportunity has arisen for close and productive collaboration with scientists at NASA Marshall Space Flight Center (MSFC) and the University of Alabama Huntsville (UAH). As a part of the collaboration effort, NASA has developed the Short-term Prediction Research and Transition (SPoRT) Center. The mission of the SPoRT center is to incorporate NASA earth science technology and research into the NWS operational environment. Emphasis will be on improving mesoscale and short-term forecasting in the first 24 hours of the forecast period. As part of the collaboration effort, the NWS and NASA will develop an implementation and evaluation plan to streamline the integration of the latest technologies and techniques into the operational forecasting environment. The desire of WFO HUN, NASA, and UAH is to provide a model for future collaborative activities between research and operational communities across the country.

Darden, C.↗
NASA NTRS1978

The 20/30 GHz satellite systems technology needs assessment

Rain attenuation in the 20/30 GHz bands, and the resultant impact on system user costs were estimated for a variety of satellite communication system concepts. Results of previous and current NASA Lewis contractual and in-house studies on system design are reported as well as market studies conducted to evaluate the concepts and test their relevancy against forecasted market needs. The 20/30 GHz bands appear attractive economically and, with certain technology, appear to offer a virtually unlimited spectrum resource. This attractiveness is especially relevant to high density trunking where there is sufficient traffic to justify dual-station site diversity.

Stevens, G.↗
NASA NTRS2000

Assimilation of Combined Microwave and Lightning Measurement in a Mesoscale Weather Prediction Model

Intermittent measurements of precipitation and integrated water vapor (IWV) distributions were retrieved from the Special Sensor Microwave/Imager (SSM/I) and Tropical Rainfall Measuring Mission (TRMM) Microwave Imager (TMI) radiometers. Lightning generates very low frequency (VLF) radio noise pulses called sferics. Those pulses propagate over large distances so that they can be continuously monitored with a sparse network of ground based radio receivers. Sferics data, tuned with intermittent spaceborne microwave radiometer data, were used to generate estimated rainfall that was assimilated into a mesoscale weather prediction model. Both continuous latent heating adjustment and a variational technique are applied as assimilation procedures to evaluate the impact of lightning observations on the forecast of an intense winter squall line over the Gulf of Mexico. Sensitivities to the assimilation of additional measurements such as IWV and sea surface temperature (SST), and measurement errors will also be discussed.

Chang, Dong-Eon↗