Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Evaluation of the GEOS-Chem UCX Stratosphere in the GEOS Composition Forecast System

The NASA GEOS Composition Forecast (GEOS-CF) system provides 3-dimensional atmospheric composition analyses and forecasts to the public in near-real time at the high spatial resolution of 25 km. While the main focus of this new product is on tropospheric air quality information, the GEOS-Chem chemistry model (v12) used in this system includes the UCX stratospheric chemistry mechanism. Here, we describe the GEOS-CF system and provide comparisons against remote-sensed observations for stratospheric composition, including measurements of HCl, ClO, NO2, and O3. The GEOS-CF nudges the stratospheric ozone towards the GEOS Forward Processing (GEOS FP) assimilated ozone product; as a result the stratospheric ozone analysis in theGEOS-CF agrees well with observations. Additionally, with the inclusion of the GEOS-Chem UCX stratospheric chemistry mechanism in GEOS-CF, 5-day forecasts, especially during the abnormal 2020 NH polar spring, capture the chemical and dynamical changes missed by the GEOS FP system, which tends towards climatology. The GEOS-CF is a new tool for the research community providing near-real time 3-dimensional gridded information on atmospheric composition throughout the troposphere and stratosphere.

Stratosphere↗

VISSR Atmospheric Sounder (VAS) Research Review

The VAS, an experimental instrument flown onboard Geostationary Operational Environmental Satellite (GOES), is capable of achieving mutlispectral imagery of atmospheric temperature, water vapor, and cloudiness patterns over short time intervals. In addition, this instrument provides an atmospheric sounding capability from geosynchronous orbit. The VAS demonstration is an effort for evaluating the VAS instrument's performance, and for demonstrating the capabilities of a VAS prototype system to provide useful geosynchronous satellite data for supporting weather forecasts and atmospheric research. The demonstration evaluates the performance of the VAS Instruments on GOES-4-5, and -6, develops research oriented and prototype/operational VAS data processing systems, determines the accuracy of certain basic and derived meteorological parameters that can be obtained from the VAS instrument, and assesses the utility of VAS derived information in analyzing severe weather situations.

Greaves, J. R.↗

AgRISTARS: Foreign commodity production forecasting. The 1980 US corn and soybeans exploratory experiment

The U.S. corn and soybeans exploratory experiment is described which consisted of evaluations of two technology components of a production forecasting system: classification procedures (crop labeling and proportion estimation at the level of a sampling unit) and sampling and aggregation procedures. The results from the labeling evaluations indicate that the corn and soybeans labeling procedure works very well in the U.S. corn belt with full season (after tasseling) LANDSAT data. The procedure should be readily adaptable to corn and soybeans labeling required for subsequent exploratory experiments or pilot tests. The machine classification procedures evaluated in this experiment were not effective in improving the proportion estimates. The corn proportions produced by the machine procedures had a large bias when the bias correction was not performed. This bias was caused by the manner in which the machine procedures handled spectrally impure pixels. The simulation test indicated that the weighted aggregation procedure performed quite well. Although further work can be done to improve both the simulation tests and the aggregation procedure, the results of this test show that the procedure should serve as a useful baseline procedure in future exploratory experiments and pilot tests.

Malin, J. T.↗

Cloud Computing Applications in Support of Earth Science Activities at Marshall Space Flight Center

Currently, the NASA Nebula Cloud Computing Platform is available to Agency personnel in a pre-release status as the system undergoes a formal operational readiness review. Over the past year, two projects within the Earth Science Office at NASA Marshall Space Flight Center have been investigating the performance and value of Nebula s "Infrastructure as a Service", or "IaaS" concept and applying cloud computing concepts to advance their respective mission goals. The Short-term Prediction Research and Transition (SPoRT) Center focuses on the transition of unique NASA satellite observations and weather forecasting capabilities for use within the operational forecasting community through partnerships with NOAA s National Weather Service (NWS). SPoRT has evaluated the performance of the Weather Research and Forecasting (WRF) model on virtual machines deployed within Nebula and used Nebula instances to simulate local forecasts in support of regional forecast studies of interest to select NWS forecast offices. In addition to weather forecasting applications, rapidly deployable Nebula virtual machines have supported the processing of high resolution NASA satellite imagery to support disaster assessment following the historic severe weather and tornado outbreak of April 27, 2011. Other modeling and satellite analysis activities are underway in support of NASA s SERVIR program, which integrates satellite observations, ground-based data and forecast models to monitor environmental change and improve disaster response in Central America, the Caribbean, Africa, and the Himalayas. Leveraging SPoRT s experience, SERVIR is working to establish a real-time weather forecasting model for Central America. Other modeling efforts include hydrologic forecasts for Kenya, driven by NASA satellite observations and reanalysis data sets provided by the broader meteorological community. Forecast modeling efforts are supplemented by short-term forecasts of convective initiation, determined by geostationary satellite observations processed on virtual machines powered by Nebula.

Molthan, Andrew L.↗

Real-Time Kennedy Space Center and Cape Canaveral Air Force Station High-Resolution Model Implementation and Verification

Customer: NASA's Launch Services Program (LSP), Ground Systems Development and Operations (GSDO), and Space Launch System (SLS) programs. NASA's LSP, GSDO, SLS and other programs at Kennedy Space Center (KSC) and Cape Canaveral Air Force Station (CCAFS) use the daily and weekly weather forecasts issued by the 45th Weather Squadron (45 WS) as decision tools for their day-to-day and launch operations on the Eastern Range (ER). For example, to determine if they need to limit activities such as vehicle transport to the launch pad, protect people, structures or exposed launch vehicles given a threat of severe weather, or reschedule other critical operations. The 45 WS uses numerical weather prediction models as a guide for these weather forecasts, particularly the Air Force Weather Agency (AFWA) 1.67 kilometer Weather Research and Forecasting (WRF) model. Considering the 45 WS forecasters' and Launch Weather Officers' (LWO) extensive use of the AFWA model, the 45 WS proposed a task at the September 2013 Applied Meteorology Unit (AMU) Tasking Meeting requesting the AMU verify this model. Due to the lack of archived model data available from AFWA, verification is not yet possible. Instead, the AMU proposed to implement and verify the performance of an ER version of the AMU high-resolution WRF Environmental Modeling System (EMS) model (Watson 2013) in real-time. The tasking group agreed to this proposal; therefore the AMU implemented the WRF-EMS model on the second of two NASA AMU modeling clusters. The model was set up with a triple-nested grid configuration over KSC/CCAFS based on previous AMU work (Watson 2013). The outer domain (D01) has 12-kilometer grid spacing, the middle domain (D02) has 4-kilometer grid spacing, and the inner domain (D03) has 1.33-kilometer grid spacing. The model runs a 12-hour forecast every hour, D01 and D02 domain outputs are available once an hour and D03 is every 15 minutes during the forecast period. The AMU assessed the WRF-EMS 1.33-kilometer domain model performance for the 2014 warm season (May-September). Verification statistics were computed using the Model Evaluation Tools, which compared the model forecasts to observations. The mean error values were close to 0 and the root mean square error values were less than 1.8 for mean sea-level pressure (millibars), temperature (degrees Kelvin), dewpoint temperature (degrees Kelvin), and wind speed (per millisecond), all very small differences between the forecast and observations considering the normal magnitudes of the parameters. The precipitation forecast verification results showed consistent under-forecasting of the precipitation object size. This could be an artifact of calculating the statistics for each hour rather than for the entire 12-hour period. The AMU will continue to generate verification statistics for the 1.33-kilometer WRF-EMS domain as data become available in future cool and warm seasons. More data will produce more robust statistics and reveal a more accurate assessment of model performance. Once the formal task was complete, the AMU conducted additional work to better understand the wind direction results. The results were stratified diurnally and by wind speed to determine what effects the stratifications would have on the model wind direction verification statistics. The results are summarized in the addendum at the end of this report. In addition to verifying the model's performance, the AMU also made the output available in the Advanced Weather Interactive Processing System II (AWIPS II). This allows the 45 WS and AMU staff to customize the model output display on the AMU and Range Weather Operations AWIPS II client computers and conduct real-time subjective analyses. In the future, the AMU will implement an updated version of the WRF-EMS model that incorporates local data assimilation. This model will also run in real-time and be made available in AWIPS II.

Numerical Weather Prediction↗

Some economic benefits of a synchronous earth observatory satellite

An analysis was made of the economic benefits which might be derived from reduced forecasting errors made possible by data obtained from a synchronous satellite system which can collect earth observation and meteorological data continuously and on demand. User costs directly associated with achieving benefits are included. In the analysis, benefits were evaluated which might be obtained as a result of improved thunderstorm forecasting, frost warning, and grain harvest forecasting capabilities. The anticipated system capabilities were used to arrive at realistic estimates of system performance on which to base the benefit analysis. Emphasis was placed on the benefits which result from system forecasting accuracies. Benefits from improved thunderstorm forecasts are indicated for the construction, air transportation, and agricultural industries. The effects of improved frost warning capability on the citrus crop are determined. The benefits from improved grain forecasting capability are evaluated in terms of both U.S. benefits resulting from domestic grain distribution and U.S. benefits from international grain distribution.

Battacharyya, R. K.↗

Hurricane risk assessment: Rollback or ride out

Winds in excess of 74.5 knots could cause severe damage to a space shuttle on the launch pad. Current plans exist for rollback to the Vehicle Assembly Building, but require 48 hour leadtime to implement. Decisions based upon cost/loss are evaluated to ascertain whether predetermined forecast probabilities for rollback/rideout decisions can be made far in advance of hurricane seasons for use in decision making.

Wohlman, Richard A.↗

NAVSTAR Global Positioning System. (Latest citations from the Aerospace Database)

The bibliography contains citations concerning the global system of navigation satellites developed to provide immediate and accurate worldwide three-dimensional positioning by air, land, and sea vehicles equipped with appropriate receiving equipment. Technological forecasting, reliability, performance tests, and evaluations are discussed. Developments and applications of the NAVSTAR system are included. (Contains 50-250 citations and includes a subject term index and title list.)

NAVIGATION↗

NAVSTAR Global Positioning System. (Latest citations from the Aerospace Database)

The bibliography contains citations concerning the global system of navigation satellites developed to provide immediate and accurate worldwide three-dimensional positioning by air, land, and sea vehicles equipped with appropriate receiving equipment. Technological forecasting, reliability, performance tests, and evaluations are discussed. Developments and applications of the NAVSTAR system are included.(Contains 50-250 citations and includes a subject term index and title list.)

BIBLIOGRAPHIES↗

Recent Developments in the Assimilation of Microwave and Radar Observations Into NWP Models

Microwave observations play a very important role in improving the weather forecasts. Although these observations are routinely assimilated into NWP models in clear-sky conditions, assimilation of all-sky microwave observations is very limited. Two main factors contributing to this limitation are inaccuracy in the input cloud and hydrometeor profiles used as input to the radiative transfer model and also error in scattering calculations performed by the radiative transfer model itself. The Mie theory is used by many fast RT models to estimate the optical properties of single particles. The Mie theory assumes spherical shapes for ice or snow particles with mixture of air and ice. However, hydrometeors scattering radiation at microwave frequencies have different shapes, sizes, and orientations. Therefore, using Mie theory to determine their optical properties leads to large uncertainties in all-sky radiative transfer calculations. The discrete dipole approximation (DDA) which approximates the optical properties of large objects in terms of discrete dipoles has shown promise in calculating the scattering properties of particles with different shapes in the microwave frequencies. This presentation focuses on recent advancements in the CRTM scattering calculations for frozen hydrometeors in the microwave frequencies using the DDA technique. In addition to using stand-alone CRTM calculations using collocated ATMS and reanalysis profiles, the data assimilation experiments conducted using the NOAA FV3GFS forecast system are used to evaluate the scattering improvements. Additionally, the backscattering information from the DDA database was used to implement a radar simulator into CRTM. The radar operator takes advantage of CRTM different modules to calculate clouds absorption and scattering properties. In addition to the forward model both adjoint and tangent linear of the radar simulator are implemented and evaluated as well. The radar simulator is currently being tested within the JEDI/GEOS data assimilation framework to facilitate the assimilation of radar measurements such as CloudSat CPR and GPM DPR into the NASA GEOS model.

Isaac Moradi↗

Enhancing CRTM All-Sky Simulations and Implementation of A New Active Sensor Module

Microwave observations play a very important role in improving the weather forecasts. Although these observations are routinely assimilated into NWP models in clear-sky conditions, assimilation of all-sky microwave observations is very limited. Two main factors contributing to this limitation are inaccuracy in the input cloud and hydrometeor profiles used as input to the radiative transfer model and also error in scattering calculations performed by the radiative transfer model itself. The Mie theory is used by many fast RT models to estimate the optical properties of single particles. The Mie theory assumes spherical shapes for ice or snow particles with mixture of air and ice. However, hydrometeors scattering radiation at microwave frequencies have different shapes, sizes, and orientations. Therefore, using Mie theory to determine their optical properties leads to large uncertainties in all-sky radiative transfer calculations. The discrete dipole approximation (DDA) which approximates the optical properties of large objects in terms of discrete dipoles has shown promise in calculating the scattering properties of particles with different shapes in the microwave frequencies. This presentation focuses on recent advancements in the CRTM scattering calculations for frozen hydrometeors in the microwave frequencies using the DDA technique. In addition to using stand-alone CRTM calculations using collocated ATMS and reanalysis profiles, the data assimilation experiments conducted using the NOAA FV3GFS forecast system are used to evaluate the scattering improvements. Additionally, the backscattering information from the DDA database was used to implement a radar simulator into CRTM. The radar operator takes advantage of CRTM different modules to calculate clouds absorption and scattering properties. In addition to the forward model both adjoint and tangent linear of the radar simulator are implemented and evaluated as well. The radar simulator is currently being tested within the JEDI/GEOS data assimilation framework to facilitate the assimilation of radar measurements such as CloudSat CPR and GPM DPR into the NASA GEOS model.

Isaac Moradi↗

CRTM Microwave Cloud Scattering Lookup Tables and Radar Simulator

Microwave observations play a very important role in improving the weather forecasts. Although these observations are routinely assimilated into NWP models in clear-sky conditions, assimilation of all-sky microwave observations is very limited. Two main factors contributing to this limitation are inaccuracy in the input cloud and hydrometeor profiles used as input to the radiative transfer model and also error in scattering calculations performed by the radiative transfer model itself. The Mie theory is used by many fast RT models to estimate the optical properties of single particles. The Mie theory assumes spherical shapes for ice or snow particles with mixture of air and ice. However, hydrometeors scattering radiation at microwave frequencies have different shapes, sizes, and orientations. Therefore, using Mie theory to determine their optical properties leads to large uncertainties in all-sky radiative transfer calculations. The discrete dipole approximation (DDA) which approximates the optical properties of large objects in terms of discrete dipoles has shown promise in calculating the scattering properties of particles with different shapes in the microwave frequencies. This presentation focuses on recent advancements in the CRTM scattering calculations for frozen hydrometeors in the microwave frequencies using the DDA technique. In addition to using stand-alone CRTM calculations using collocated ATMS and reanalysis profiles, the data assimilation experiments conducted using the NOAA FV3GFS forecast system are used to evaluate the scattering improvements. Additionally, the backscattering information from the DDA database was used to implement a radar simulator into CRTM. The radar operator takes advantage of CRTM different modules to calculate clouds absorption and scattering properties. In addition to the forward model both adjoint and tangent linear of the radar simulator are implemented and evaluated as well. The radar simulator is currently being tested within the JEDI/GEOS data assimilation framework to facilitate the assimilation of radar measurements such as CloudSat CPR and GPM DPR into the NASA GEOS model.

Isaac Moradi↗

Challenges in Observing, Modeling, and Forecasting the June 2023 Smoke Event Over the Northeast United States

In the first week of May 2023, boreal Canada began an early start to the biomass burning season when fires erupted across Alberta and western Saskatchewan. Smoke entered the troposphere and spread across the United States as biomass burning emissions in Canada quadrupled the prior maximum since the onset of the MODIS satellite record. Adding to the already existing smoke, wildfires ignited in Quebec on June 2, 2023, producing a heavy plume of aerosol over the northeastern part of the continent. Meteorological factors, including an area of low pressure situated, nearly stationary, over Maine, transported the smoke into a densely populated corridor containing the cities of Washington, DC, Baltimore, Philadelphia, and New York City. Air quality alerts became widespread as near-surface levels of fine particulate matter (PM2.5) exceeded harmful levels due the low altitude of the smoke plume. Forecasting the smoke transport and impacts of such events requires a complex combination of observed initial conditions for meteorology and aerosols, knowledge of the emissions from wildfires, and a state-of-the-art Earth System model that couples these components together. Using a case-study perspective with the Goddard Earth Observing System (GEOS), challenges associated with near real time forecasting of the smoke plume are presented. Analyzed and forecasted aerosol optical depth will be evaluated using available satellite and AERONET observations, while surface aerosol will be assessed relative to observations of PM2.5. Lacking real time estimates of biomass burning emissions for inputs to our forecast model, particular attention is given to the use of day-old biomass burning emissions throughout the forecast period covering the first ten days in June 2023, and the resulting reduction in forecast skill will be quantified.

Allison Collow↗

Challenges in Observing, Modeling, and Forecasting the June 2023 Smoke Event over the Northeast United States

In the first week of May 2023, boreal Canada began an early start to the biomass burning season when fires erupted across Alberta and western Saskatchewan. Smoke entered the troposphere and spread across the United States as biomass burning emissions in Canada quadrupled the prior maximum since the onset of the MODIS satellite record. Adding to the already existing smoke, wildfires ignited in Quebec on June 2, 2023, producing a heavy plume of aerosol over the northeastern part of the continent. Meteorological factors, including an area of low pressure situated, nearly stationary, over Maine, transported the smoke into a densely populated corridor containing the cities of Washington, DC, Baltimore, Philadelphia, and New York City. Air quality alerts became widespread as near-surface levels of fine particulate matter (PM2.5) exceeded harmful levels due the low altitude of the smoke plume. Forecasting the smoke transport and impacts of such events requires a complex combination of observed initial conditions for meteorology and aerosols, knowledge of the emissions from wildfires, and a state-of-the-art Earth System model that couples these components together. Using a case-study perspective with the Goddard Earth Observing System (GEOS ), challenges associated with near real time forecasting of the smoke plume are presented. Analyzed and forecasted aerosol optical depth will be evaluated using available satellite and AERONET observations, while surface aerosol will be assessed relative to observations of PM2.5. Lacking real time estimates of biomass burning emissions for inputs to our forecast model, particular attention is given to the use of day-old biomass burning emissions throughout the forecast period covering the first ten days in June 2023, and the resulting reduction in forecast skill will be quantified.

Allison Collow↗

A New Objective Technique for Verifying Mesoscale Numerical Weather Prediction Models

This report presents a new objective technique to verify predictions of the sea-breeze phenomenon over east-central Florida by the Regional Atmospheric Modeling System (RAMS) mesoscale numerical weather prediction (NWP) model. The Contour Error Map (CEM) technique identifies sea-breeze transition times in objectively-analyzed grids of observed and forecast wind, verifies the forecast sea-breeze transition times against the observed times, and computes the mean post-sea breeze wind direction and speed to compare the observed and forecast winds behind the sea-breeze front. The CEM technique is superior to traditional objective verification techniques and previously-used subjective verification methodologies because: It is automated, requiring little manual intervention, It accounts for both spatial and temporal scales and variations, It accurately identifies and verifies the sea-breeze transition times, and It provides verification contour maps and simple statistical parameters for easy interpretation. The CEM uses a parallel lowpass boxcar filter and a high-order bandpass filter to identify the sea-breeze transition times in the observed and model grid points. Once the transition times are identified, CEM fits a Gaussian histogram function to the actual histogram of transition time differences between the model and observations. The fitted parameters of the Gaussian function subsequently explain the timing bias and variance of the timing differences across the valid comparison domain. Once the transition times are all identified at each grid point, the CEM computes the mean wind direction and speed during the remainder of the day for all times and grid points after the sea-breeze transition time. The CEM technique performed quite well when compared to independent meteorological assessments of the sea-breeze transition times and results from a previously published subjective evaluation. The algorithm correctly identified a forecast or observed sea-breeze occurrence or absence 93% of the time during the two- month evaluation period from July and August 2000. Nearly all failures in CEM were the result of complex precipitation features (observed or forecast) that contaminated the wind field, resulting in a false identification of a sea-breeze transition. A qualitative comparison between the CEM timing errors and the subjectively determined observed and forecast transition times indicate that the algorithm performed very well overall. Most discrepancies between the CEM results and the subjective analysis were again caused by observed or forecast areas of precipitation that led to complex wind patterns. The CEM also failed on a day when the observed sea- breeze transition affected only a very small portion of the verification domain. Based on the results of CEM, the RAMS tended to predict the onset and movement of the sea-breeze transition too early and/or quickly. The domain-wide timing biases provided by CEM indicated an early bias on 30 out of 37 days when both an observed and forecast sea breeze occurred over the same portions of the analysis domain. These results are consistent with previous subjective verifications of the RAMS sea breeze predictions. A comparison of the mean post-sea breeze winds indicate that RAMS has a positive wind-speed bias for .all days, which is also consistent with the early bias in the sea-breeze transition time since the higher wind speeds resulted in a faster inland penetration of the sea breeze compared to reality.

Case, Jonathan L.↗

Developing Dual Polarization Applications For 45th Weather Squadron's (45 WS) New Weather Radar: A Cooperative Project With The National Space Science and Technology Center (NSSTC)

A new weather radar is being acquired for use in support of America s space program at Cape Canaveral Air Force Station, NASA Kennedy Space Center, and Patrick AFB on the east coast of central Florida. This new radar includes dual polarization capability, which has not been available to 45 WS previously. The 45 WS has teamed with NSSTC with funding from NASA Marshall Spaceflight Flight Center to improve their use of this new dual polarization capability when it is implemented operationally. The project goals include developing a temperature profile adaptive scan strategy, developing training materials, and developing forecast techniques and tools using dual polarization products. The temperature profile adaptive scan strategy will provide the scan angles that provide the optimal compromise between volume scan rate, vertical resolution, phenomena detection, data quality, and reduced cone-of-silence for the 45 WS mission. The mission requirements include outstanding detection of low level boundaries for thunderstorm prediction, excellent vertical resolution in the atmosphere electrification layer between 0 C and -20 C for lightning forecasting and Lightning Launch Commit Criteria evaluation, good detection of anvil clouds for Lightning Launch Commit Criteria evaluation, reduced cone-of-silence, fast volume scans, and many samples per pulse for good data quality. The training materials will emphasize the appropriate applications most important to the 45 WS mission. These include forecasting the onset and cessation of lightning, forecasting convective winds, and hopefully the inference of electrical fields in clouds. The training materials will focus on annotated radar imagery based on products available to the 45 WS. Other examples will include time sequenced radar products without annotation to simulate radar operations. This will reinforce the forecast concepts and also allow testing of the forecasters. The new dual polarization techniques and tools will focus on the appropriate applications for the 45 WS mission. These include forecasting the onset of lightning, the cessation of lightning, convective winds, and hopefully the inference of electrical fields in clouds. This presentation will report on the results achieved so far in the project.

Roeder, W.P.↗