Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
NASA NTRS2020

GRACE Improves Seasonal Groundwater Forecast Initialization Over the United States

We evaluate the impact of Gravity Recovery and Climate Experiment data assimilation (GRACE-DA) on seasonal hydrological forecast initialization over the United States, focusing on groundwater storage. GRACE-based terrestrial water storage (TWS) estimates are assimilated into a land surface model for the2003–16 period. Three-month hindcast (i.e., forecast of past events) simulations are initialized using states from the reference (no data assimilation) and GRACE-DA runs. Differences between the two initial hydrological condition (IHC) sets are evaluated for two forecast techniques at 305 wells where depth to water table measurements are available. Results show that using GRACE-DA-based IHC improves seasonal groundwater forecast performance in terms of both RMSE and correlation. While most regions show improvement, degradation is common in the High Plains, where withdrawals for irrigation practices affect groundwater variability more strongly than the weather variability, which demonstrates the need for simulating such activities. These findings contribute to recent efforts toward an improved U.S. drought monitoring and forecast system.

Augusto Getirana↗
DOE OSTI2022

Parameterization of cloud transmittance for expeditious assessment and forecasting of all-sky DNI

Radiative transfer models require vast computing resources to solve cloud transmittance and reflectance from the radiative transfer equation. As a result, models offering precise simulation in operations often acquire individual cloud transmittance or reflectance from a lookup table precomputed for practicable scenarios. To further expedite the computation of global horizontal irradiance and to reduce the storage requirements, the Fast All-sky Radiation Model for Solar applications (FARMS) parameterized the lookup table using elementary functions with specified coefficients. This study extends FARMS direct normal irradiance (DNI) computation by utilizing hyperbolic tangent functions and various polynomial functions to parameterize the cloud transmittance for scattered solar radiation in the circumsolar region. The parameterization is implemented in FARMS with DNI (FARMS-DNI) and accounts for the circumsolar radiation when assessing or forecasting DNI. The evaluation, with long-term observations at the National Renewable Energy Laboratory's, Solar Radiation Research Laboratory, and the Atmospheric Radiation Measurement, Southern Great Plains, Central Facility, shows that the parameterized DNIs are virtually identical with those computed by coupling FARMS-DNI to a lookup table of cloud transmittance. This parameterization has diverse applications in radiative transfer models and numerical weather prediction models used to assess or forecast direct solar radiation.

14 SOLAR ENERGY↗
NASA NTRS2009

Recent Weather Technologies Delivered to America's Space Program by the Applied Meteorology Unit

The Applied Meteorology Unit (AMU) is a unique joint venture of NASA, the Air Force and the National Weather Service (NWS) and has been supporting the Space Program for nearly two decades. The AMU acts as a bridge between the meteorological research community and operational forecasters by developing, evaluating and transitioning new technology and techniques to improve weather support to spaceport operations at the Eastern Range (ER) and Kennedy Space Center. Its primary customers are the 45th Weather Squadron at Cape Canaveral Air Force Station (CCAFS), the Spaceflight Meteorology Group at Johnson Space Center and the National Weather Service Office in Melbourne, FL. Its products are used to support NASA's Shuttle and ELV programs as well as Department of Defense and commercial launches from the ER. Shuttle support includes landing sites beyond the ER. The AMU is co-located with the Air Force operational forecasters at CCAFS to facilitate continuous two-way interaction between the AMU and its operational customers. It is operated under a NASA, Air Force, and NWS Memorandum of Understanding (MOU) by a competitively-selected contractor. The contract, which is funded and managed by NASA, provides five full time professionals with degrees in meteorology or related fields, some of whom also have operational experience. NASA provides a Ph.D.- level NASA civil service scientist as Chief of the AMU. The AMU is tasked by its customers through a unique, nationally recognized process. The tasks are limited to development, evaluation and operational transition of technology to improve weather support to spaceport operations and providing expert advice to the customers. The MOU expressly forbids using the AMU resources to conduct operations or do basic research. The presentation will provide a brief overview of the AMU and how it is tasked by its customers to provide high priority products and services. The balance of the presentation will cover a sampling of products delivered over the last 18 years that are currently in operational use. Each example will describe the problem to be solved, the solution provided, and the operational benefits of implementing that solution.

Bauman, WIlliam, H., III↗
NASA NTRS2010

Statistical Analysis of Model Data for Operational Space Launch Weather Support at Kennedy Space Center and Cape Canaveral Air Force Station

The 12-km resolution North American Mesoscale (NAM) model (MesoNAM) is used by the 45th Weather Squadron (45 WS) Launch Weather Officers at Kennedy Space Center (KSC) and Cape Canaveral Air Force Station (CCAFS) to support space launch weather operations. The 45 WS tasked the Applied Meteorology Unit to conduct an objective statistics-based analysis of MesoNAM output compared to wind tower mesonet observations and then develop a an operational tool to display the results. The National Centers for Environmental Prediction began running the current version of the MesoNAM in mid-August 2006. The period of record for the dataset was 1 September 2006 - 31 January 2010. The AMU evaluated MesoNAM hourly forecasts from 0 to 84 hours based on model initialization times of 00, 06, 12 and 18 UTC. The MesoNAM forecast winds, temperature and dew point were compared to the observed values of these parameters from the sensors in the KSC/CCAFS wind tower network. The data sets were stratified by model initialization time, month and onshore/offshore flow for each wind tower. Statistics computed included bias (mean difference), standard deviation of the bias, root mean square error (RMSE) and a hypothesis test for bias = O. Twelve wind towers located in close proximity to key launch complexes were used for the statistical analysis with the sensors on the towers positioned at varying heights to include 6 ft, 30 ft, 54 ft, 60 ft, 90 ft, 162 ft, 204 ft and 230 ft depending on the launch vehicle and associated weather launch commit criteria being evaluated. These twelve wind towers support activities for the Space Shuttle (launch and landing), Delta IV, Atlas V and Falcon 9 launch vehicles. For all twelve towers, the results indicate a diurnal signal in the bias of temperature (T) and weaker but discernable diurnal signal in the bias of dewpoint temperature (T(sub d)) in the MesoNAM forecasts. Also, the standard deviation of the bias and RMSE of T, T(sub d), wind speed and wind direction indicated the model error increased with the forecast period all four parameters. The hypothesis testing uses statistics to determine the probability that a given hypothesis is true. The goal of using the hypothesis test was to determine if the model bias of any of the parameters assessed throughout the model forecast period was statistically zero. For th is dataset, if this test produced a value >= -1 .96 or <= 1.96 for a data point, then the bias at that point was effectively zero and the model forecast for that point was considered to have no error. A graphical user interface (GUI) was developed so the 45 WS would have an operational tool at their disposal that would be easy to navigate among the multiple stratifications of information to include tower locations, month, model initialization times, sensor heights and onshore/offshore flow. The AMU developed the GUI using HyperText Markup Language (HTML) so the tool could be used in most popular web browsers with computers running different operating systems such as Microsoft Windows and Linux.

Bauman, William H., III↗
DOE OSTI2021

How New Mexico Leveraged a COVID-19 Case Forecasting Model to Preemptively Address the Healthcare Needs of the State: Quantitative Analysis

Prior to the COVID-19 pandemic, US hospitals relied on static projections of future trends for long-term planning and were only beginning to consider forecasting methods for short-term planning of staffing and other resources. With the overwhelming burden imposed by COVID-19 on the health care system, an emergent need exists to accurately forecast hospitalization needs within an actionable timeframe. Our goal was to leverage an existing COVID-19 case and death forecasting tool to generate the expected number of concurrent hospitalizations, occupied intensive care unit (ICU) beds, and in-use ventilators 1 day to 4 weeks in the future for New Mexico and each of its five health regions. We developed a probabilistic model that took as input the number of new COVID-19 cases for New Mexico from Los Alamos National Laboratory’s COVID-19 Forecasts Using Fast Evaluations and Estimation tool, and we used the model to estimate the number of new daily hospital admissions 4 weeks into the future based on current statewide hospitalization rates. The model estimated the number of new admissions that would require an ICU bed or use of a ventilator and then projected the individual lengths of hospital stays based on the resource need. By tracking the lengths of stay through time, we captured the projected simultaneous need for inpatient beds, ICU beds, and ventilators. We used a postprocessing method to adjust the forecasts based on the differences between prior forecasts and the subsequent observed data. Thus, we ensured that our forecasts could reflect a dynamically changing situation on the ground. Forecasts made between September 1 and December 9, 2020, showed variable accuracy across time, health care resource needs, and forecast horizon. Forecasts made in October, when new COVID-19 cases were steadily increasing, had an average accuracy error of 20.0%, while the error in forecasts made in September, a month with low COVID-19 activity, was 39.7%. Across health care use categories, state-level forecasts were more accurate than those at the regional level. Although the accuracy declined as the forecast was projected further into the future, the stated uncertainty of the prediction improved. Forecasts were within 5% of their stated uncertainty at the 50% and 90% prediction intervals at the 3- to 4-week forecast horizon for state-level inpatient and ICU needs. However, uncertainty intervals were too narrow for forecasts of state-level ventilator need and all regional health care resource needs. Real-time forecasting of the burden imposed by a spreading infectious disease is a crucial component of decision support during a public health emergency. Our proposed methodology demonstrated utility in providing near-term forecasts, particularly at the state level. This tool can aid other stakeholders as they face COVID-19 population impacts now and in the future.

60 APPLIED LIFE SCIENCES↗
NASA NTRS1998

Evaluation of the 29-km Eta Model: Objective Verification at Three Selected Stations - Part 1

This paper describes an objective verification of the National Centers for Environmental Prediction (NCEP) 29-km eta model from May 1996 through January 1998. The evaluation was designed to assess the model's surface and upper-air point forecast accuracy at three selected locations during separate warm (May - August) and cool (October - January) season periods. In order to enhance sample sizes available for statistical calculations, the objective verification includes two consecutive warm and cool season periods. Systematic model deficiencies comprise the larger portion of the total error in most of the surface forecast variables that were evaluated. The error characteristics for both surface and upper-air forecasts vary widely by parameter, season, and station location. At upper levels, a few characteristic biases are identified. Overall however, the upper-level errors are more nonsystematic in nature and could be explained partly by observational measurement uncertainty. With a few exceptions, the upper-air results also indicate that 24-h model error growth is not statistically significant. In February and August 1997, NCEP implemented upgrades to the eta model's physical parameterizations that were designed to change some of the model's error characteristics near the surface. The results shown in this paper indicate that these upgrades led to identifiable and statistically significant changes in forecast accuracy for selected surface parameters. While some of the changes were expected, others were not consistent with the intent of the model updates and further emphasize the need for ongoing sensitivity studies and localized statistical verification efforts. Objective verification of point forecasts is a stringent measure of model performance, but when used alone, is not enough to quantify the overall value that model guidance may add to the forecast process. Therefore, results from a subjective verification of the meso-eta model over the Florida peninsula are discussed in the companion paper by Manobianco and Nutter. Overall verification results presented here and in part two should establish a reasonable benchmark from which model users and developers may pursue the ongoing eta model verification strategies in the future.

Nutter, Paul A.↗
NASA NTRS1979

Forecasts of geomagnetic activity by Ottawa Magnetic Observatory: Their reliabilty and application

A 27 day forecast of geomagnetic activity based on the forecasts from two locations is presented. To evaluate the reliability of the forecasts, the predicted activity was compared with the actual geomagnetic activity at five geomagnetic observatories located in different magnetic zones: Ottawa (57.0N, 351.5E); Meanook (61.8N, 301.0E); Fort Churchill (68.8N, 322.5E); Cambridge Bay (76.7N, 294.0E); and Resolute Bay (83.1N, 287.7E). Results indicate that the percentage of correct predictions varies with the geomagnetic latitude of the observatory used for comparison. The percentage is on the average highest for lower latitude stations and lowest for the northern stations. The number of incorrect predictions ranges from 4.7% for Ottawa to 8.4% for Churchill.

Hruska, J.↗
DOE OSTI2022

A Statistical Interpolation Code for Ocean Analysis and Forecasting

Abstract We present a data assimilation package for use with ocean circulation models in analysis, forecasting, and system evaluation applications. The basic functionality of the package is centered on a multivariate linear statistical estimation for a given predicted/background ocean state, observations, and error statistics. Novel features of the package include support for multiple covariance models, and the solution of the least squares normal equations either using the covariance matrix or its inverse—the information matrix. The main focus of this paper, however, is on the solution of the analysis equations using the information matrix, which offers several advantages for solving large problems efficiently. Details of the parameterization of the inverse covariance using Markov random fields are provided and its relationship to finite-difference discretizations of diffusion equations are pointed out. The package can assimilate a variety of observation types from both remote sensing and in situ platforms. The performance of the data assimilation methodology implemented in the package is demonstrated with a yearlong global ocean hindcast with a 1/4° ocean model. The code is implemented in modern Fortran, supports distributed memory, shared memory, multicore architectures, and uses climate and forecasts compliant Network Common Data Form for input/output. The package is freely available with an open source license from www.tendral.com/tsis/ .

Srinivasan, Ashwanth↗
DOE OSTI2025

How extreme rainfall and failing dams unleashed the Derna flood disaster

On September 11, 2023, Storm Daniel unleashed unprecedented rainfall over the Wadi Derna watershed, triggering one of the most devastating floods in modern history, striking Derna, a coastal city in Libya. This study reconstructs the disaster using an integrated modeling approach that combines satellite imagery, hydrologic, hydraulic, and geotechnical simulations, machine learning, eyewitness accounts, and digital elevation data to assess the impact of cascading dam failures. Our findings reveal that the region’s dams, even if structurally sound, would have provided minimal protection against the extreme runoff. However, their failure unleashed a destructive surge wave, amplifying the disaster’s magnitude and devastation. Here, we show that the collapse of aging flood control infrastructures, compounded by inadequate risk assessment and emergency preparedness, dramatically escalated the disaster’s impact. Our findings underscore the urgent need for systematic dam safety evaluations, enhanced flood forecasting, and adaptive risk management strategies that address climate extremes and infrastructure vulnerabilities.

Hydrology↗
DOE OSTI2022

FAIRification, Quality Assessment, and Missingness Pattern Discovery for Spatiotemporal Photovoltaic Data

The growth of the photovoltaic market has pushed the demand for power forecasting and performance evaluation for a huge population of PV power plants. Many of these power plants have spatiotemporal coherence that can be utilized for improving model accuracy. We have demonstrated in this paper the FAIRification of spatiotemporal PV time series data. Through the creation of a solar power plant ontology, we propose standards for the naming and structure of metadata used to describe the data from these power plants. Using the structure from this ontology, we have developed both R and Python packages for the automation of the FAIRification process. Going further, we have also developed an R package that automates the analysis of the quality of a data set through the designation of letter grades. To solve the issue of data missingness, we propose the use of St-GNN autoencoders to detect and impute missing values from a data set by utilizing data from power plants nearby.

14 SOLAR ENERGY↗
DOE OSTI2022

FAIRification, Quality Assessment, and Missingness Pattern Discovery for Spatiotemporal Photovoltaic Data

The ongoing growth of the photovoltaic market has pushed the demand for power forecasting and performance evaluation for a huge population of PV power plants. Through access to a large number of time series data sets from different power plants, we have found common issues that impede the modeling process. Namely, the time series data are hard to transfer between groups due to differences in variable nomenclature, and the quality of the data sets can vary. We address the issue of variable nomenclature by FAIRifying spatiotemporal PV time series data. Through the creation of a solar power plant ontology, we propose standards for the naming and structure of metadata used to describe the data from these power plants. Using the structure from this ontology, we have developed both R and Python packages for the automation of the FAIRification process. We have also developed an R package that automates the analysis of the quality of a data set through the designation of letter grades. With access to large time series data sets across many power plants, we can utilize spatiotemporal coherence between the sites in order to improve the quality of our data. To solve the issue of data missingness, we propose the use of Spatiotemporal-GNN autoencoders to detect and impute missing values from a data set by utilizing data from power plants nearby.

14 SOLAR ENERGY↗
NASA NTRS1978

Post LANDSAT D advanced concept evaluation

Preliminary results of a past LANDSAT D advanced concept evaluation study to forecast and identify key technologies required for earth resources satellite systems in the 1985 to 2000 time period are presented. Mission categories discussed include agriculture, range management, forestry, geological resources, land use, water resources, environmental quality, and disaster assessment. Sensor and system concepts are described for a passive L-band radiometer (microsat), a texturometer to measure ground surface texture, and a ferris wheel radar configuration that relies on cable tension for support.

Flatow, F. S.↗
NASA NTRS1983

The impact of Seasat-A scatterometer data on GLAS model forecasts

The effect of SASS (Seasat-A Satellite Scatterometer) data on the GLAS analysis and forecast system is assessed. After discussing the objective analysis and assimilation of SASS winds, consideration is given to a scheme developed to objectively dealias the SASS data. Results are then presented from analysis and forecast experiments. The evaluation finds a negligible effect of the SASS data in the Northern Hemisphere. In the Southern Hemisphere, the impact is larger and for the most part beneficial when the VTPR (vertical temperature profile radiometer) is excluded. However, the inclusion of VTPR data effectively eliminates this positive impact, suggesting some redundancy between the two data sets.

Atlas, R.↗
NASA NTRS1985

Ability of a regional-scale model to predict the genesis of intense mesoscale convective systems

The mesoscale part of a two-part evaluation of 30 forecasts by a mesoscale numerical weather prediction model (MASS 2.0) is presented. Unfiltered fields are combined into convective predictor fields, the loci of which are then related at two-hour intervals to the loci of strong mesoscale convective systems identifiable in national radar summary plots and GOES satellite imagery. Examples of model 'forecasts' of intense convective storm clusters, a severe squall line triggered along a dryline, orographically induced hailstorms, and sea breeze thunderstorms are provided.

Koch, S. E.↗
NASA NTRS2004

The LATEST Project: Operational Assessment of Total Lightning Data in the U.S.

A government, university, and industry alliance has joined forces to transition total lightning observations from ground-based research networks and NASA satellites (LIS/TRMM) to improve the short range prediction of severe weather. This interest builds on the desire of the U.S Weather Research Program to foster a national Nowcasting Test Bed, with this specific transition activity initiated through the NASA short-term Prediction Research and Transition (SPoRT) Center in Huntsville, AL. A kick-off national workshop sponsored by the SPoRT Center was held in Huntsville April 1-2 to identify the common goals and objectives of the research and operational community, and to assign roles and responsibilities within the alliance. The workshop agenda, presentations, and summary are available at the SPoRT Center Web site ( h h under the "Meetings" tab. The next national workshop is planned for 2005 in Dallas, TX. The NASA North Alabama regional Lightning Mapping Array &MA) has been operational in the Huntsville area for 3 years, and has continuously sampled a variety of severe weather systems during that period. A gridded version of the LMA total lightning data is currently being supplied to National Weather Service offices in Huntsville, Nashville and Birmingham through the NWS AWES decision support system, for the purposes of assessing the utility of the data in the nowcasting of severe weather such as tornadoes, damaging straight line winds, flash flooding and other weather hazards (lightning induced forest fires, microbursts). While the raw LMA data have been useful to NWS forecasters, even greater utility would be realized if higher-order data products could be supplied through AWIPS along with the gridded data over a larger domain. In 2003-2004 additional LMA systems have been deployed across the southern US. from Florida to New Mexico, providing an opportunity for more than 20 NWS forecast offices to evaluate the incremental value of total lightning data in the warning decision making process.

Goodman, Steven↗
NASA NTRS2005

Contour Error Map Algorithm

The contour error map (CEM) algorithm and the software that implements the algorithm are means of quantifying correlations between sets of time-varying data that are binarized and registered on spatial grids. The present version of the software is intended for use in evaluating numerical weather forecasts against observational sea-breeze data. In cases in which observational data come from off-grid stations, it is necessary to preprocess the observational data to transform them into gridded data. First, the wind direction is gridded and binarized so that D(i,j;n) is the input to CEM based on forecast data and d(i,j;n) is the input to CEM based on gridded observational data. Here, i and j are spatial indices representing 1.25-km intervals along the west-to-east and south-to-north directions, respectively; and n is a time index representing 5-minute intervals. A binary value of D or d = 0 corresponds to an offshore wind, whereas a value of D or d = 1 corresponds to an onshore wind. CEM includes two notable subalgorithms: One identifies and verifies sea-breeze boundaries; the other, which can be invoked optionally, performs an image-erosion function for the purpose of attempting to eliminate river-breeze contributions in the wind fields.

Merceret, Francis↗
NASA NTRS2016

JPSS Preparations at the Satellite Proving Ground for Marine, Precipitation, and Satellite Analysis

The ocean prediction center at the national hurricane center's tropical analysis and forecast Branch, the Weather Prediction center and the Satellite analysis branch of NESDIS make up the Satellite Proving Ground for Marine, Precipitation and Satellite Analysis. These centers had early exposure to JPSS products using the S-NPP Satellite that was launched in 2011. Forecasters continue to evaluate new products in anticipation for the launch of JPSS-1 sometime in 2017.

Remote Sensing↗
NASA NTRS2022

NASA's NMME-Based S2S Hydrologic Forecast System for Food Insecurity Early Warning in Southern Africa

In situ hydrologic monitoring over regions most susceptible to food insecurity can be a challenge in current times due to various socio-economic and political issues in combination with environmental factors such as ongoing famine or drought. Hydrologic monitoring and initializing forecasts based on remotely sensed and analyzed data can contribute significantly to early warning in such regions. Routine hydrologic forecasts, as provided by NASA’s Hydrologic Forecasting and Analysis System (NHyFAS), are a recent addition to early warning systems. A custom instance of NHyFAS, termed FLDAS-Forecast, is used by FEWS NET’s Land Data Assimilation System (FLDAS). The FLDAS-Forecast’s dynamic forecasting component was originally set up with Goddard Earth Observing System (GEOS) forecast inputs and has been recently expanded with precipitation forecast forcing from the North American Multi-Model Ensemble (NMME). This paper describes the improvements in seasonal hydrologic forecasts produced with this updated system. Evaluations in this study focus on soil moisture across southern Africa’s growing season. Soil moisture forecasts are benchmarked and evaluated relative to climatology-based forecasts and historic runs, which are driven by observation-based meteorological forcing fields, and they are verified with remotely sensed observations of soil moisture and vegetation. Through multiple deterministic and probabilistic skill assessments, we show that using the larger ensemble of NMME precipitation inputs in the forecast system results in higher quality hydrologic forecasts than are allowed by climatology- or GEOS-only-based forecasts. Further, the near-real-time NMME-based rootzone soil moisture forecasts were able to correctly predict developing drought conditions over southern Africa through late 2019 and into early 2020.

Hydrologic forecasts↗