Search NASA⌕ Search

SEARCH · Search NASA

Results for “Prediction skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
NASA NTRS2022

Skillful Seasonal Forecasts of Land Carbon Uptake in Northern Mid- and High Latitudes

Here we present a first look at the Gross Primary Production (GPP) forecast skill levels achievable with a state-of-the-art subseasonal-to-seasonal (S2S) forecast system. Using NASA’s retrospective S2S ensemble forecast in conjunction with a terrestrial biosphere model, and using an independent, remote sensing-based dataset for validation, we demonstrate an ability to accurately forecast spring-summer carbon uptake at multi-month leads. Averaged across mid-and high latitudes of the Northern Hemisphere land, the GPP forecast initialized on January 1 produces statistically significant skill through summer. The skill achieved, however, is spatially variable, with some regions appearing to extract skill from accurate forecasts of snowpack removal and others extracting skill from the initialization of carbon and nitrogen states. Our results reveal some heretofore unexplored facets of climate predictability and provide a look at what might be possible with future S2S forecast systems that are fully integrated with biogeochemical cycles.

Eunjee Lee↗
NASA NTRS2023

Interpretation of Probabilistic Surface Ozone Forecasts: A Case Study for Philadelphia

The use of probabilistic forecasting has been growing in a variety of disciplines because of its potential to emphasize the degree of uncertainty inherent in a prediction. Interpretation of probabilistic forecasts, however, is oftentimes difficult, deterring users who may benefit from such forecasts. To encourage broader use of probabilistic forecasts in the field of air quality, a process for interpreting forecasts from a statistical probabilistic air quality surface ozone model [the Regression in Self Organizing Map (REGiS)] is demonstrated. Four procedures to convert probabilistic to deterministic forecasts are explored for the Philadelphia, Pennsylvania, metropolitan area. These procedures calibrate the predicted probability of daily maximum 8-h-average ozone exceeding a standard value by 1) estimating climatological relative frequency, 2) establishing a probability of an exceedance threshold as 50%, 3) maximizing the threat score, and 4) determining the unit bias ratio. REGiS is trained using 2000–11 ozone-season (1 May–30 September) data, calibrated using 2012–14 data, and evaluated using 2015–18 data. Assessment of the calibration data with the Pierce skill score suggests an exceedance threshold based on climatological relative frequency for the conversion from probabilistic to deterministic forecasts. Calibrated REGiS generally compares well to predictions from the U.S. national air quality model and operational “expert” forecasts over the evaluation period. For other probabilistic models and situations, different procedures of converting probabilistic to deterministic forecasts may be more beneficial. The methods presented in this paper represent an approach for operational air quality forecasters seeking to use probabilistic model output to support forecasts designed to protect public health.

Nikolay Balashov↗
NASA NTRS2013

Evaluating NMME Seasonal Forecast Skill for use in NASA SERVIR Hub Regions

The U.S. National Multi-Model Ensemble seasonal forecasting system is providing hindcast and real-time data streams to be used in assessing and improving seasonal predictive capacity. The coupled forecasts have numerous potential applications, both national and international in scope. The NASA / USAID SERVIR project, which leverages satellite and modeling-based resources for environmental decision making in developing nations, is focusing on the evaluation of NMME forecasts specifically for use in driving applications models in hub regions including East Africa, the Hindu Kush- Himalayan (HKH) region and Mesoamerica. A prerequisite for seasonal forecast use in application modeling (e.g. hydrology, agriculture) is bias correction and skill assessment. Efforts to address systematic biases and multi-model combination in support of NASA SERVIR impact modeling requirements will be highlighted. Specifically, quantilequantile mapping for bias correction has been implemented for all archived NMME hindcasts. Both deterministic and probabilistic skill estimates for raw, bias-corrected, and multi-model ensemble forecasts as a function of forecast lead will be presented for temperature and precipitation. Complementing this statistical assessment will be case studies of significant events, for example, the ability of the NMME forecasts suite to anticipate the 2010/2011 drought in the Horn of Africa and its relationship to evolving SST patterns.

Roberts, J. Brent↗
DOE OSTI2023

A new method for predicting hurricane rapid intensification based on co-occurring environmental parameters

Abstract Tropical cyclones (TCs) that undergo Rapid Intensification (RI) can pose serious socioeconomic threats and can potentially result in major damaging impacts along coastal areas. Considering the complexity of various physical mechanisms that play a role in RI and its relatively low probability of occurrence, predicting RI remains a major operational challenge. In this study, we propose a simple deterministic binary classification model based on the co-occurrence of environmental parameters (MCE) to predict an RI event. More specifically, the model determines the possibility of RI based on a simple count of the number of environmental predictors deemed favorable and unfavorable. We compare our model results to logistic regression (LR) and decision tree (DT) models, well-trained using the same set of environmental predictors. Results reveal that at an RI threshold of 30 kt, the MCE exhibits a critical success index score of 0.233 which is 14% higher than DT and LR model performances. When tested at multiple RI thresholds, the MCE displays relatively higher skill scores across multiple metrics. By simultaneously evaluating the favorability of predictors, the MCE is able to comparatively reduce the number of false alarms predicted when certain predictors are unfavorable toward RI. Interpreting these model results to gain a physical understanding of how co-occurring environmental parameters can affect RI, we highlight future directions for using models based on the MCE approach to understand and predict TC RI as well as other meteorological extremes.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2014

Drought Prediction for Socio-Cultural Stability Project

The primary objective of this project is to answer the question: "Can existing, linked infrastructures be used to predict the onset of drought months in advance?" Based on our work, the answer to this question is "yes" with the qualifiers that skill depends on both lead-time and location, and especially with the associated teleconnections (e.g., ENSO, Indian Ocean Dipole) active in a given region season. As part of this work, we successfully developed a prototype drought early warning system based on existing/mature NASA Earth science components including the Goddard Earth Observing System Data Assimilation System Version 5 (GEOS-5) forecasting model, the Land Information System (LIS) land data assimilation software framework, the Catchment Land Surface Model (CLSM), remotely sensed terrestrial water storage from the Gravity Recovery and Climate Experiment (GRACE) and remotely sensed soil moisture products from the Aqua/Advanced Microwave Scanning Radiometer - EOS (AMSR-E). We focused on a single drought year - 2011 - during which major agricultural droughts occurred with devastating impacts in the Texas-Mexico region of North America (TEXMEX) and the Horn of Africa (HOA). Our results demonstrate that GEOS-5 precipitation forecasts show skill globally at 1-month lead, and can show up to 3 months skill regionally in the TEXMEX and HOA areas. Our results also demonstrate that the CLSM soil moisture percentiles are a goof indicator of drought, as compared to the North American Drought Monitor of TEXMEX and a combination of Famine Early Warning Systems Network (FEWS NET) data and Moderate Resolution Imaging Spectrometer (MODIS)'s Normalizing Difference Vegetation Index (NDVI) anomalies over HOA. The data assimilation experiments produced mixed results. GRACE terrestrial water storage (TWS) assimilation was found to significantly improve soil moisture and evapotransportation, as well as drought monitoring via soil moisture percentiles, while AMSR-E soil moisture assimilation produced marginal benefits. We carried out 1-3 month lead-time forecast experiments using GEOS-5 forecasts as input to LIS/CLSM. Based on these forecast experiments, we find that the expected skill in GEOS-5 forecasts from 1-3 months is present in the soil moisture percentiles used to indicate drought. In the case of the HOA drought, the failure of the long rains in April appears in the February 1, March 1 and April 1 initialized forecasts, suggesting that for this case, drought forecasting would have provided some advance warning about the drought conditions observed in 2011. Three key recommendations for follow-up work include: (1) carry out a comprehensive analysis of droughts observed over the entire period of record for GEOS-5 forecasts; (2) continue to analyze the GEOS-5 forecasts in HOA stratifying by anomalies in long and short rains; and (3) continue to include GRACE TWS, Soil Moisture/Ocean Salinity (SMOS) and the upcoming NASA Soil Moisture Active/Passive (SMAP) soil moisture products in a routine activity building on this prototype to further quantify the benefits for drought assessment and prediction.

Peters-Lidard, Christa↗
DOE OSTI2020

A Numerical Study of Hypoxia in Chesapeake Bay Using an Unstructured Grid Model: Validation and Sensitivity to Bathymetry Representation

A three-dimensional unstructured-grid hydrodynamic and water quality model (Semi-implicit Cross-scale Hydroscience Intergrated System Model-Integrated Compartment Model) is applied successfully for Chesapeake Bay. The model is validated with observations of salinity, chlorophyll-a, dissolved oxygen, nutrients, and phytoplankton productions from the year 1991 to 1995 for the mainstem and some major tributaries, based on multiple model skill scores. Model experiments are conducted to test the importance of having (1) an accurate representation of bathymetry to correctly predict hypoxia and other processes and (2) a high-resolution model grid for tributaries to correctly simulate water quality variables. Further, comparison with the model experiment results with bathymetry smoothing indicates that bathymetry smoothing, as commonly used for many systems, changes the stratification and lateral circulation pattern, resulting in more salt intrusion into shallow water regions, and an increase in the freshwater age. Consequently, a model with bathymetry smoothing can lead to an unrealistic prediction of the distribution of hypoxia and phytoplankton production. Local grid refinement shows significant improvement of model simulations on local stratification and water quality variables. Overall, the use of high-resolution unstructured grid model leads to a faithful representation of the complex geometry, and thus a seamless cross-scale capability for simulating water quality processes in the Bay including tributaries and tidal creeks.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

Cognitive Engineering in Training: Monitoring and Pilot-Automation Coordination in Complex Environments

This paper reports our investigation of flight path monitoring in aviation. We interviewed experienced pilots to understand the knowledge and skills underlying effective monitoring and we developed an example learning environment to improve these skills. We explore how design of pilot training and learning, like the design of interfaces and of the underlying automation, benefits from cognitive engineering methods and perspective. In aviation, monitoring and managing flight path are critical activities. The influences on flight path are complex and come from the autoflight system, from control actions by the pilot, and from external factors, including weather and Air Traffic Control (ATC). Indeed, inadequate flight path monitoring is a current aviation concern as it has been implicated in accidents and incidents. Effective piloting depends on strategies for noticing, understanding, and anticipating these influences to monitor and manage flight path. Lack of such skills reduces pilots' ability to maintain safety margin and resilience. Although flightdeck automation is intended to aid pilot understanding and prediction, the Fight Management Systems (FMS) can mislead as well as aid the pilot's understanding and projection of what will happen. In dynamic conditions, FMS predictions may be based on old or incomplete information. Understanding such vulnerabilities is an important part of pilot-autoflight coordination. The learning environment we developed is designed to help pilots proactively monitor and manage flight path. We consider how a broad cognitive engineering approach might inform the "what" and "how" of learning in dynamic work domains.

pilot-monitoring↗
DOE OSTI2024

Relating flow resistance to equivalent roughness

Describing flow resistance using the physical properties of an underlying surface is a recalcitrant problem in overland flow models. If discharge measurements are available, an equivalent roughness (e.g., Manning’s n) can be calibrated to represent the effects of surface properties within the domain with a single numerical value. Alternatively, the flow resistance can be estimated from discharge and velocity measured at a point, typically a runoff plot outlet. However, such experimental estimates are often inconsistent with the equivalent roughness determined from calibration to discharge, even if both derive from the same dataset. For example, if Manning’s equation is used to parameterize flow resistance, the Manning’s n obtained by calibrating a model to discharge differs from the value of n calculated from measured flow and velocity at the hillslope outlet. Here, this discrepancy is resolved by deriving a correction factor relating experimentally-determined flow resistance to the equivalent roughness. The derived correction factor is tested for four commonly-used resistance formulations using 129 rainfall simulator experiments. The correction factor is necessary to reproduce measured velocities, and yields minor improvements in discharge prediction. Plain Language Summary: Accurate runoff prediction is needed for land and water management in dryland regions, where sporadic and limited rainfall necessitate efficient water use and drought mitigation strategies. The skill of runoff models is known to be hindered by out ability to estimate flow resistance, which is the quantity that describes how energy is lost from flowing water to the underlying surface. Typically, models represent flow resistance with an equivalent roughness, e.g., Manning’s n, that is adjusted until the model can reproduce available discharge observations at watershed scale. However, the flow resistance measured in plot-scale experiments (1–10 m) often exceeds equivalent roughness coefficients by a factor of 10. This means that the direct use of plot-scale experimental data to parameterize runoff models could cause errors in discharge and runoff velocity predictions. Here, we resolve these differences by deriving an analytic correction factor that relates flow resistance to the equivalent roughness required for models to reproduce experimental velocity and discharge data. This correction factor is tested using rainfall simulator data from 129 experiments performed in the US Southwest covering a wide range of precipitation intensities, soil textures and vegetation types. Use of the correction factor substantially improves model prediction of flow velocity, which is needed for reproducing the timing of flood events and the estimation of erosion.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

The Impacts of Horizontal Grid Spacing and Cumulus Parameterization on Subseasonal Prediction in a Global Convection-Permitting Model

Monthlong simulations targeting four Madden–Julian oscillation events made with several global model configurations are verified against observations to assess the roles of grid spacing and convective parameterization on the representation of tropical convection and midlatitude forecast skill. Specifically, the performance of a global convection-permitting model (CPM) configuration with a uniform 3-km mesh is compared to that of a global 15-km mesh with and without convective parameterization, and of a variable-resolution “channel” simulation using 3-km grid spacing only in the tropics with a scale-aware convection scheme. It is shown that global 3-km simulations produce realistic tropical precipitation statistics, except for an overall wet bias and delayed diurnal cycle. The channel simulation performs similarly, although with an unrealistically higher frequency of heavy rain. The 15-km simulations with and without cumulus schemes produce too much light and heavy tropical precipitation, respectively. Without convection parameterization, the 15-km global model produces unrealistically abundant, short-lived, and intense convection throughout the tropics. Only the global CPM configuration is able to capture eastward-propagating Madden–Julian oscillation events, and the 15-km runs favor stationary or westward-propagating convection organized at the planetary scale. The global 3-km CPM exhibits the highest extratropical forecast skill aloft and at the surface, particularly during week 3 of each hindcast. Although more cases are needed to confirm these results, this study highlights many potential benefits of using global CPMs for subseasonal forecasting. Furthermore, results show that alternatives to global convection-permitting resolution—using coarser or spatially variable resolution—feature compromises that may reduce their predictive performance.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1985

Dynamic and static initialization of a mesoscale model using VAS satellite data

Various mesoscale weather forecast model initialization procedures were tested in seven simulation forecasts for a 12 hr period in July 1981. Attention was given to the impacts of using as input radiosonde data, VISSR Atmospheric Sounder (VAS) data and a combination of VAS and data from a smoothed global analysis. The data were assimilated with successive correction objective analysis procedures. The model had a 60 km horizontal grid-length resolution, 14 layers in the vertical, and accounted for short- and long-wave energy in the surface energy budget but not in the atmosphere. Conventional data were used for the mass and moisture fields. The trials showed that VAS data enhanced the predictions of the temperature and mass variables, while winds were least accurately predicted when VAS data were entered in the initializations. Finally, statically initialized precipitation forecasts from radiosonde and/or VAS data exhibited equal skill.

Beauchamp, J. G.↗
NASA NTRS1988

An alternative to Guyan reduction of finite-element models

Structural modeling is a key part of structural system identification for large space structures. Finite-element structural models are commonly used in practice because of their general applicability and availability. The initial models generated by using a standard computer program such as NASTRAN, ANSYS, SUPERB, STARDYNE, STRUDL, etc., generally contain tens of thousands of degrees of freedom. The models must be reduced for purposes of identification. Not only does the magnitude of the identification effort grow exponentially as a function of the number of degrees of freedom, but numerical procedures may also break down because of accumulated round-off errors. Guyan reduction is usually applied after a static condensation. Misapplication of Guyan reduction can lead to serious modeling errors. It is quite unfortunate and disappointing, since the accuracy of the original detailed finite-element model one tries very hard to achieve is lost by the reduction. First, why and how Guyan reduction always causes loss of accuracy is examined. An alternative approach is then introduced. The alternative can be thought of as an improvement of Guyan reduction, the Rayleigh-Ritz method, and in particular the recent algorithm of Wilson, Yuan, and Dickens. Unlike Guyan reduction, the use of the alternative does not need any special insight, experience, or skill for partitioning the structural degrees of freedom. In addition to model condensation, this alternative approach can also be used for predicting analytically, quickly, and economically, what are those structural modes that are excitable by a force actuator at a given trial location. That is, in the excitation of the structural modes for identification, it can be used for guiding the placement of the force actuators.

Lin, Jiguan Gene↗
NASA NTRS2004

A Case Study of the Impact of AIRS Temperature Retrievals on Numerical Weather Prediction

Large errors in numerical weather prediction are often associated with explosive cyclogenesis. Most studes focus on the under-forecasting error, i.e. cases of rapidly developing cyclones which are poorly predicted in numerical models. However, the over-forecasting error (i.e., to predict an explosively developing cyclone which does not occur in reality) is a very common error that severely impacts the forecasting skill of all models and may also present economic costs if associated with operational forecasting. Unnecessary precautions taken by marine activities can result in severe economic loss. Moreover, frequent occurrence of over-forecasting can undermine the reliance on operational weather forecasting. Therefore, it is important to understand and reduce the prdctions of extreme weather associated with explosive cyclones which do not actually develop. In this study we choose a very prominent case of over-forecasting error in the northwestern Pacific. A 960 hPa cyclone develops in less than 24 hour in the 5-day forecast, with a deepening rate of about 30 hPa in one day. The cyclone is not versed in the analyses and is thus a case of severe over-forecasting. By assimilating AIRS data, the error is largely eliminated. By following the propagation of the anomaly that generates the spurious cyclone, it is found that a small mid-tropospheric geopotential height negative anomaly over the northern part of the Indian subcontinent in the initial conditions, propagates westward, is amplified by orography, and generates a very intense jet streak in the subtropical jet stream, with consequent explosive cyclogenesis over the Pacific. The AIRS assimilation eliminates this anomaly that may have been caused by erroneous upper-air data, and represents the jet stream more correctly. The energy associated with the jet is distributed over a much broader area and as a consequence a multiple, but much more moderate cyclogenesis is observed.

Reale, O.↗
NASA NTRS2012

The Role of Lightning in Controlling Interannual Variability of Tropical Tropospheric Ozone and OH and its Implications for Climate

Nitrogen oxides (NO(x) = NO + NO2) produced by lightning make a major contribution to the production of the dominant tropospheric oxidants (OH and ozone). These oxidants control the lifetime of many trace gases including long-lived greenhouse gases, and control the source-receptor relationship of inter-hemispheric pollutant transport. Lightning is affected by meteorological variability, and therefore represents a potentially important tropospheric chemistry-climate feedback. Understanding how interannual variability (IAV) in lightning affects IAV in ozone and OH in the recent past is important if we are to predict how oxidant levels may change in a future warmer climate. However, lightning parameterizations for chemical transport models (CTMs) show low skill in reproducing even climatological distributions of flash rates from the Lightning Imaging Sensor (LIS) and the Optical Transient Detector (OTD) satellite instruments. We present an optimized regional scaling algorithm for CTMs that enables sufficient sampling of spatiotemporally sparse satellite lightning data from LIS to constrain the spatial, seasonal, and interannual variability of tropical lightning. We construct a monthly time series of lightning flash rates for 1998-2010 and 35degS-35degN, and find a correlation of IAV in total tropical lightning with El Nino. We use the IAV-constraint to drive a 9-year hindcast (1998-2006) of the GEOS-Chem 3D chemical transport model, and find the increased IAV in LNO(x) drives increased IAV in ozone and OH, improving the model fs ability to simulate both. Although lightning contributes more than any other emission source to IAV in ozone, we find ozone more sensitive to meteorology, particularly convective transport. However, we find IAV in OH to be highly sensitive to lightning NO(x), and the constraint improves the ability of the model to capture the temporal behavior of OH anomalies inferred from observations of methyl chloroform and other gases. The sensitivity of OH is explained using photochemical reaction rates which show a "magnification" effect of the initial lightning NO perturbation on OH primary production, HO(x) recycling, and OH loss frequencies. This influence on OH may represent a negative feedback, if lightning increases in a warming world..

Murray, Lee T.↗
NASA NTRS2005

Global Positioning System (GPS) Precipitable Water in Forecasting Lightning at Spaceport Canaveral

Using meteorology data, focusing on precipitable water (PW), obtained during the 2000-2003 thunderstorm seasons in Central Florida, this paper will, one, assess the skill and accuracy measurements of the current Mazany forecasting tool and, two, provide additional forecasting tools that can be used in predicting lightning. Kennedy Space Center (KSC) and Cape Canaveral Air Force Station (CCAFS) are located in east Central Florida. KSC and CCAFS process and launch manned (NASA Space Shuttle) and unmanned (NASA and Air Force Expendable Launch Vehicles) space vehicles. One of the biggest cost impacts is unplanned launch scrubs due to inclement weather conditions such as thunderstorms. Each launch delay/scrub costs over a quarter million dollars, and the need to land the Shuttle at another landing site and return to KSC costs approximately $ 1M. Given the amount of time lost and costs incurred, the ability to accurately forecast (predict) when lightning will occur can result in significant cost and time savings. All lightning prediction models were developed using binary logistic regression. Lightning is the dependent variable and is binary. The independent variables are the Precipitable Water (PW) value for a given time of the day, the change in PW up to 12 hours, the electric field mill value, and the K-index value. In comparing the Mazany model results for the 1999 period B against actual observations for the 2000-2003 thunderstorm seasons, differences were found in the False Alarm Rate (FAR), Probability of Detection (POD) and Hit Rate (H). On average, the False Alarm Rate (FAR) increased by 58%, the Probability of Detection (POD) decreased by 31% and the Hit Rate decreased by 20%. In comparing the performance of the 6 hour forecast period to the performance of the 1.5 hour forecast period for the Mazany model, the FAR was lower by 15% and the Hit Rate was higher by 7%. However, the POD for the 6 hour forecast period was lower by 16% as compared to the POD of the 1.5 hour forecast period. Neither forecast period performed at the accuracy measures expected. A 2-Hr Forecasting Tool was developed to support a Phase I Lightning Advisory, which requires a 30-minute lead time for predicting lightning.

Kehrer, Kristen↗
NASA NTRS2015

High-Resolution Mesoscale Model Setup for the Eastern Range and Wallops Flight Facility

Mesoscale weather conditions can have an adverse effect on space launch, landing, ground processing, and weather advisories, watches, and warnings at the Eastern Range (ER) in Florida and Wallops Flight Facility (WFF) in Virginia. During summer, land-sea interactions across Kennedy Space Center (KSC) and Cape Canaveral Air Force Station (CCAFS) lead to sea breeze front formation, which can spawn deep convection that can hinder operations and endanger personnel and resources. Many other weak locally-driven low-level boundaries and their interactions with the sea breeze front and each other can also initiate deep convection in the KSC/CCAFS area. These convective processes often last 60 minutes or less and pose a significant challenge to the local forecasters. Surface winds during the transition seasons (spring and fall) pose the most difficulties for the forecasters at WFF. They also encounter problems forecasting convective activity and temperature during those seasons. Therefore, accurate mesoscale model forecasts are needed to better forecast a variety of unique weather phenomena. Global and national scale models cannot properly resolve important local-scale weather features at each location due to their horizontal resolutions being much too coarse. Therefore, a properly tuned local data assimilation (DA) and forecast model at a high resolution is needed to provide improved capability. To accomplish this, a number of sensitivity tests were performed using the Weather Research and Forecasting (WRF) model in order to determine the best DA/model configuration for operational use at each of the space launch ranges to best predict winds, precipitation, and temperature. A set of Perl scripts to run the Gridpoint Statistical Interpolation (GSI)/WRF in real-time were provided by NASA's Short-term Prediction Research and Transition Center (SPoRT). The GSI can analyze many types of observational data including satellite, radar, and conventional data. The GSI/WRF scripts use a cycled GSI system similar to the operational North American Mesoscale (NAM) model. The scripts run a 12-hour pre-cycle in which data are assimilated from 12 hours prior up to the model initialization time. A number of different model configurations were tested for both the ER and WFF by varying the horizontal resolution on which the data assimilation was done. Three different grid configurations were run for the ER and two configurations were run for WFF for archive cases from 27 Aug 2013 through 10 Nov 2013. To quantify model performance, standard model output will be compared to the Meteorological Assimilation Data Ingest System (MADIS) data. The MADIS observation data will be compared to the WRF forecasts using the Model Evaluation Tools (MET) verification package. In addition, the National Centers for Environmental Prediction's Stage IV precipitation data will be used to validate the WRF precipitation forecasts. The author will summarize the relative skill of the various WRF configurations and how each configuration behaves relative to the others, as well as determine the best model configuration for each space launch range.

Watson, Leela R.↗
NASA NTRS2007

Weather Research and Forecasting Model Sensitivity Comparisons for Warm Season Convective Initiation

Mesoscale weather conditions can significantly affect the space launch and landing operations at Kennedy Space Center (KSC) and Cape Canaveral Air Force Station (CCAFS). During the summer months, land-sea interactions that occur across KSC and CCAFS lead to the formation of a sea breeze, which can then spawn deep convection. These convective processes often last 60 minutes or less and pose a significant challenge to the forecasters at the National Weather Service (NWS) Spaceflight Meteorology Group (SMG). The main challenge is that a "GO" forecast for thunderstorms and precipitation is required at the 90 minute deorbit decision for End Of Mission (EOM) and at the 30 minute Return To Launch Site (RTLS) decision at the Shuttle Landing Facility. Convective initiation, timing, and mode also present a forecast challenge for the NWS in Melbourne, FL (MLB). The NWS MLB issues such tactical forecast information as Terminal Aerodrome Forecasts (TAFs), Spot Forecasts for fire weather and hazardous materials incident support, and severe/hazardous weather Watches, Warnings, and Advisories. Lastly, these forecasting challenges can also affect the 45th Weather Squadron (45 WS), which provides comprehensive weather forecasts for shuttle launch, as well as ground operations, at KSC and CCAFS. The need for accurate mesoscale model forecasts to aid in their decision making is crucial. Both the SMG and the MLB are currently implementing the Weather Research and Forecasting Environmental Modeling System (WRF EMS) software into their operations. The WRF EMS software allows users to employ both dynamical cores - the Advanced Research WRF (ARW) and the Non-hydrostatic Mesoscale Model (NMM). There are also data assimilation analysis packages available for the initialization of the WRF model- the Local Analysis and Prediction System (LAPS) and the Advanced Regional Prediction System (ARPS) Data Analysis System (ADAS). Having a series of initialization options and WRF cores, as well as many options within each core, provides SMG and NWS MLB with a lot of flexibility. It also creates challenges, such as determining which configuration options are best to address specific forecast concerns. The goal of this project is to assess the different configurations available and to determine which configuration will best predict warm season convective initiation in East-Central Florida. Four different combinations of WRF initializations will be run (ADAS-ARW, ADAS-NMM, LAPS-ARW, and LAPS-NMM) at a 4-km resolution over the Florida peninsula and adjacent coastal waters. Five candidate convective initiation days using three different flow regimes over East-Central Florida will be examined, as well as two null cases (non-convection days). Each model run will be integrated 12 hours with three runs per day, at 0900, 1200, and 1500 UTe. ADAS analyses will be generated every 30 minutes using Level II Weather Surveillance Radar-1988 Doppler (WSR-88D) data from all Florida radars to verify the convection forecast. These analyses will be run on the same domain as the four model configurations. To quantify model performance, model output will be subjectively compared to the ADAS analyses of convection to determine forecast accuracy. In addition, a subjective comparison of the performance of the ARW using a high-resolution local grid with 2-way nesting, I-way nesting, and no nesting will be made for select convective initiation cases. The inner grid will cover the East-Central Florida region at a resolution of 1.33 km. The authors will summarize the relative skill of the various WRF configurations and how each configuration behaves relative to the others, as well as determine the best model configuration for predicting warm season convective initiation over East-Central Florida.

Watson, Leela R.↗
DOE OSTI2023

Evaluating Multimodel Ensemble Seasonal Climate Forecasts on Rangeland Plant Production in the California Annual Grassland

Seasonal precipitation and temperature directly affect total plant production in the California Annual Grassland (CAG). Technological advances have resulted in skillful seasonal climate forecasts (i.e., significant correlations between actual and forecasted climate), which could be input into plant production models to inform stocking and other rangeland management decisions. This study presents a procedure for forecasting plant production in the CAG ecosystem to predict annual plant production for grazing, restoration, or other rangeland management practices using a combination of historical gridMET climate data and seasonal hindcasts (i.e., retrospective forecasts, from the North American Multi-Model Ensemble program). Further, the results of this study first confirmed high forecast skill, throughout the growing season at all sites. We also identified skillful plant production forecasts across most of the growing season at two sites and in three of the seven forecasting months at one study site. Forecasting climate and end-of-year plant production across the growing season at three CAG sites allowed us to identify the places and times in the growing season when forecasting might be most helpful in informing management decisions. Integrating plant production forecasting into rangeland management practices could significantly improve rangeland management outcomes. These procedures provide a user guide for creating plant production forecasts for any given area of interest and may be applicable across a wide range of other agricultural and rangeland management systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Data-driven modeling of municipal water system responses to hydroclimate extremes

Sustainable western US municipal water system (MWS) management depends on quantifying the impacts of supply and demand dynamics on system infrastructure reliability and vulnerability. Systems modeling can replicate the interactions but extensive parameterization, high complexity, and long development cycles present barriers to widespread adoption. To address these challenges, we develop the Machine Learning Water Systems Model (ML-WSM) – a novel application of data-driven modeling for MWS management. We apply the ML-WSM framework to the Salt Lake City, Utah water system, where we benchmark prediction performance on the seasonal response of reservoir levels, groundwater withdrawal, and imported water requests to climate anomalies at a daily resolution against an existing systems model. The ML-WSM accurately predicts the seasonal dynamics of all components; especially during supply-limiting conditions (KGE > 0.88, PBias < ±3%). Extreme wet conditions challenged model skill but the ML-WSM communicated the appropriate seasonal trends and relationships to component thresholds (e.g., reservoir dead pool). The model correctly classified nearly all instances of vulnerability (83%) and peak severity (100%), encouraging its use as a guidance tool that complements systems models for evaluating the influences of climate on MWS performance.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗