Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Bulk cloud microphysical properties as seen from numerical simulation and remote sensing products: case study of a hailstorm event over the La Plata Basin

Hailstorms develop over the La Plata Basin, in south-eastern South America, more often during later winter and early austral spring, between September and October. These systems have significant socioeconomic impacts over the region. Thus, a better understanding of how atmospheric drivers modulate the formation of hailstorms is important to improve the forecast of such phenomena. In this study, we selected a hailstorm event observed over the eastern La Plata Basin during 14–15 July 2016 to evaluate the performance of the Brazilian developments on the Regional Atmospheric Modelling System (BRAMS) model. The ability of the model in simulating cloud microphysical properties was evaluated by comparing simulations driven by different global forcings against in situ and remote sensing observations. The model results showed good skill in capturing the basic characteristics of the thunderstorm, particularly in terms of the spatial distribution of hydrometeors. The simulated spatial distribution of hail covers locations where hail fall was reported. The BRAMS simulations suggest that, despite relatively low values of the convective available potential energy (CAPE) (700–1000 J kg -1 ), environments with strong 0–8-km bulk shear (60–70 kt, ~30.9–36.0 m s –1 ) can promote the formation of ice clouds and hail fall over the eastern La Plata Basin. To be more conclusive, however, further research is needed to understand how different combinations of CAPE and shear affect hail formation over the region.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of WRF simulation of deep convection in the US Southern Great Plains

The Southern Great Plains (SGP) exhibits a relatively high frequency of periods with extremely high rainfall rates (RR) and hail. Here, seven months of 2017 are simulated using the Weather Research and Forecasting (WRF) model applied at convection permitting resolution with the Mibrandt-Yau microphysics scheme. Simulation fidelity is evaluated, particularly during intense convective events, using data from ASOS stations, dual-polarization RADAR, gridded data sets and observations at the DoE Atmospheric Radiation Measurement site. The spatial gradients and temporal variability of precipitation and the cumulative density functions for both RR and wind speeds exhibit fidelity. Odds ratios >1 indicate WRF is also skillful in simulating high composite reflectivity (cREF, used as a measure of widespread convection) and RR > 5 mmhr –1 over the domain. Detailed analyses of the ten days with highest spatial coverage of cREF >30 dBZ show spatially similar reflectivity fields and high RR in both RADAR data and WRF simulations. However, during periods of high reflectivity, WRF exhibits a positive bias in terms of very high RR (> 25 mmhr –1 ) and hail occurrence, and during the summer and transition months, maximum hail size is underestimated. For some renewable energy applications fidelity is required with respect to the joint probabilities of wind speed and RR and/or hail. While partial fidelity is achieved for the marginal probabilities, performance during events of critical importance to these energy applications is currently not sufficient. Further research into optimal WRF configurations in support of potential damage quantification for these applications is warranted.

54 ENVIRONMENTAL SCIENCES↗

Evaluating mesoscale model predictions of diurnal speedup events in the Altamont Pass Wind Resource Area of California

Mesoscale model predictions of wind, turbulence, and wind energy capacity factors are evaluated in the Altamont Pass Wind Resource Area of California (APWRA), where the diurnal regional sea breeze and associated terrain-driven speedup flows drive wind energy production during the summer months. Results from the Weather Research and Forecasting model version 4.4 using a novel three-dimensional planetary boundary layer (3D PBL) scheme, which treats both vertical and horizontal turbulent mixing, are compared to those using a well-established one-dimensional (1D) scheme that treats only vertical turbulent mixing. Each configuration is evaluated over a nearly 3-month-long period during the Hill Flow Study, and due to the recurring nature of the observed speedup flows, diurnal composite averaging is used to capture robust trends in model performance. Both model configurations showed similar overall skill. The general timing and direction of the speedup flows is captured, but their magnitude is overestimated within a typical wind turbine rotor layer. Both also fail to capture a persistent observed near-surface jet-like flow, likely due to the limited grid resolution that is typical of mesoscale models. However, the 3D PBL configuration shows several minor improvements over the 1D PBL configuration, including improved wind speed and turbulence kinetic energy profiles during the accelerating phase of the speedup events, as well as reduced positive wind speed bias at surface stations across the APWRA region. Using a mesoscale wind farm parameterization, modeled capacity factors are also compared to monthly data reported to the US Energy Information Administration (EIA) during the study period. Although the monthly trend in the data is captured, both model configurations overestimate capacity factors by roughly 7 %–11 %. Through model evaluation, this study provides confidence in the 3D PBL scheme for wind energy applications in complex terrain and provides guidance for future testing.

17 WIND ENERGY↗

Data-driven global ocean modeling for seasonal to decadal prediction

Accurate modeling of ocean dynamics is crucial for enhancing our understanding of complex ocean circulation processes, predicting climate variability, and tackling challenges posed by climate change. Although great efforts have been made to improve traditional numerical models, predicting global ocean variability over multiyear scales remains challenging. Here, we propose ORCA-DL (Oceanic Reliable foreCAst via Deep Learning), a data-driven three-dimensional ocean model for seasonal to decadal prediction of global ocean dynamics. ORCA-DL accurately simulates the three-dimensional structure of global ocean dynamics with high physical consistency and outperforms state-of-the-art numerical models in capturing extreme events, including El Niño–Southern Oscillation and upper ocean heat waves. Moreover, ORCA-DL stably emulates ocean dynamics at decadal timescales, demonstrating its potential even for skillful decadal predictions and climate projections. Our results demonstrate the high potential of data-driven models for providing efficient and accurate global ocean modeling and prediction.

Science & Technology - Other Topics↗

Improving the MJO Forecast of S2S Operation Models by Correcting Their Biases in Linear Dynamics

The operational dynamic subseasonal to seasonal (S2S) models for Madden-Julian oscillation (MJO) forecasting mostly still suffer from systematic errors in capturing the MJO's key dynamic features, such as its growth rate and propagation speed. By deriving the linear dynamic operators using the linear inverse modeling (LIM) approach, we propose a method to partly correct the errors in MJO linear dynamic operators to improve the MJO predictions of three operational dynamic S2S models. Correcting the deficiencies of the too-fast decay rates and the unrealistic propagating phase speeds lead to MJO prediction skills being extended by approximately 2–4 days. The improvements are more significant for the models with larger biases in MJO amplitude and propagation. This approach in principle may be extendable to predictions of other types of climate variability such as ENSO on one hand, and possible inclusions of nonlinear dynamics effects on the other hand.

58 GEOSCIENCES↗

Short–Term Forecasting of Wind Gusts at Airports Across CONUS Using Machine Learning

Short–term forecasting of wind gusts, particularly those of higher intensity, is of great societal importance but is challenging due to the presence of multiple gust generation mechanisms. Wind gust observations from eight high–passenger–volume airports across the continental United States (CONUS) are summarized and used to develop predictive models of wind gust occurrence and magnitude. These short–term (same hour) forecast models are built using multiple logistic and linear regression, as well as artificial neural networks (ANNs) of varying complexity. A suite of 19 upper–air predictors drawn from the ERA5 reanalysis and an autoregressive (AR) term are used. Stepwise procedures instruct predictor selection, and resampling is used to quantify model stability. All models are developed separately for the warm (April–September) and cold (October–March) seasons. Results show that ANNs of 3–5 hidden layers (HLs) generally exhibit higher hit rates than logistic regression models and also improve skill with respect to wind gust magnitudes. However, deeper networks with more HLs increase false alarm rates in occurrence models and mean absolute error in magnitude models due to model overfitting. For model skill, inclusion of the AR term is critical while the majority of the remaining skill derives from wind speeds and lapse rates. A predictive ceiling is also clearly demonstrated, particularly for the strong and damaging gust magnitudes, which appears to be partially due to ERA5 predictor characteristics and the presence of mixed wind climates.

54 ENVIRONMENTAL SCIENCES↗

Impact of boundary layer simulation on predicting radioactive pollutant dispersion: a case study for HANARO Research Reactor using the WRF-MMIF-CALPUFF modeling system

Wind plays an important role in cases of unexpected radioactive pollutant dispersion, deciding distribution and concentration of the leaked substance. The accurate prediction of wind has been challenging in numerical weather prediction models, especially near the surface because of the complex interaction between turbulent flow and topographic effect. As such, in this study, we investigated the characteristics of atmospheric dispersion of radioactive material (i.e. 137 Cs) according to the simulated boundary layer around the HANARO research nuclear reactor in Korea using the Weather Research and Forecasting (WRF)-Mesoscale Model Interface (MMIF)-California Puff (CALPUFF) model system. We examined the impacts of orographic drag on wind field, stability calculation methods, and planetary boundary layer parameterizations on the dispersion of radioactive material under a radioactive leaking scenario. We found that inclusion of the orographic drag effect in the WRF model improved the wind prediction most significantly over the complex terrain area, leading the model system to estimate the radioactive concentration near the reactor more conservatively. We also emphasized the importance of the stability calculation method and employing the skillful boundary layer parameterization to ensure more accurate low atmospheric conditions, in order to simulate more feasible spatial distribution of the radioactive dispersion in leaking scenarios.

54 ENVIRONMENTAL SCIENCES↗

Predictability of the early summer surface air temperature over Western South Asia

Variability of the Surface Air Temperature (SAT) over the Western South Asia (WSA) region leads to frequent heatwaves during the early summer (May-June) season. The present study uses the European Centre for Medium-Range Weather Forecast’s fifth-generation seasonal prediction system, SEAS5, from 1981 to 2022 based on April initial conditions (1-month lead) to assess the SAT predictability during early summer season. The goal is to evaluate the SEAS5’s ability to predict the El Niño-Southern Oscillation (ENSO) related interannual variability and predictability of the SAT over WSA, which is mediated through upper-level (200-hPa) geopotential height anomalies. This teleconnection leads to anomalously warm surface conditions over the region during the negative ENSO phase, as observed in the reanalysis and SEAS5. We evaluate SEAS5 prediction skill against two observations and three reanalyses datasets. The SEAS5 SAT prediction skill is higher with high spatial resolution observations and reanalysis datasets compared to the ones with low-resolution. Overall, SEAS5 shows reasonable skill in predicting SAT and its variability over the WSA region. Moreover, the predictability of SAT during La Niña is comparable to El Niño years over the WSA region.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of Turbulence and Dispersion in Multiscale Atmospheric Simulations over Complex Urban Terrain during the Joint Urban 2003 Field Campaign

Abstract This paper evaluates the representation of turbulence and its effect on transport and dispersion within multiscale and microscale-only simulations in an urban environment. These simulations, run using the Weather Research and Forecasting Model with the addition of an immersed boundary method, predict transport and mixing during a controlled tracer release from the Joint Urban 2003 field campaign in Oklahoma City, Oklahoma. This work extends the results of a recent study through analysis of turbulence kinetic energy and turbulence spectra and their role in accurately simulating wind speed, direction, and tracer concentration. The significance and role of surface heat fluxes and use of the cell perturbation method in the numerical simulation setup are also examined. Our previous study detailed the model development necessary for our multiscale simulations, examined model skill at predicting wind speeds and tracer concentrations, and demonstrated that dynamic downscaling from mesoscale to microscale through a sequence of nested simulations can improve predictions of transport and dispersion relative to a microscale-only simulation forced by idealized meteorology. Here, predictions are compared with observations to assess qualitative agreement and statistical model skill at predicting wind speed, wind direction, tracer concentration, and turbulent kinetic energy at locations throughout the city. We also investigate the scale distribution of turbulence and the associated impact on model skill, particularly for predictions of transport and dispersion. Our results show that downscaled large-scale turbulence, which is unique to the multiscale simulations, significantly improves predictions of tracer concentrations in this complex urban environment. Significance Statement Simulations of atmospheric transport and mixing in urban environments have many applications, including pollution modeling for urban planning or informing emergency response following a hazardous release. These applications include phenomena with spatial scales spanning from millimeters to kilometers. Most simulations resolve flow only within the urban area of interest, omitting larger scales of turbulence and regional influences. This study examines a method that resolves both the small and large-scale flow features. We evaluate simulation accuracy by comparing predictions with observations from an experiment involving the release of a tracer gas in Oklahoma City, Oklahoma, with emphasis on correctly modeling turbulent fluctuations. Our results demonstrate the importance of resolving large-scale flow features when predicting transport and dispersion in urban environments.

42 ENGINEERING↗

Subseasonal Great Plains Rainfall via Remote Extratropical Teleconnections: Regional Application of Theory‐Guided Causal Networks

Abstract Long‐range U.S. summer rainfall prediction skill is low. Monsoon variability, especially over the West North Pacific Monsoon (WNPM) and/or East Asian Monsoon (EAM) region, can influence U.S. Great Plains hydroclimate variability via a forced Rossby wave response. Here, we explored subseasonal monsoon variability as a source of predictability for Great Plains rainfall. The boreal summer intraseasonal oscillation (BSISO) is related to Great Plains convection and Great Plains low‐level jet (LLJ) anomalies as well as a cross‐Pacific wave train. Using a causal effect network, we found that the time between BSISO‐related geopotential height anomalies and Great Plains rainfall anomalies is about 2 weeks; therefore, BSISO convection may be a valuable forecast of opportunity for subseasonal prediction of Great Plains convection anomalies. More specifically, causal link patterns/maps revealed that the above‐normal weekly EAM rainfall, rather than WNPM rainfall or general geopotential height activity over the East Asia, was causally linked to Great Plains LLJ strengthening and active Great Plains convection the following week.

Meteorology & Atmospheric Sciences↗

2023 National Offshore Wind data set (NOW-23)

The 2023 National Offshore Wind data set (NOW-23) is the latest wind resource data set for offshore regions in the United States, which supersedes, for its offshore component, the Wind Integration National Dataset (WIND) Toolkit, which was published about a decade ago and is currently one of the primary resources for stakeholders conducting wind resource assessments in the continental United States. The NOW-23 data set was produced using the Weather Research and Forecasting Model (WRF) version 4.2.1. A regional approach was used: for each offshore region, the WRF setup was selected based on validation against available observations. The WRF model was initialized with the European Centre for Medium Range Weather Forecasts 5 Reanalysis (ERA-5) data set, using a 6-hour refresh rate. The model is configured with an initial horizontal grid spacing of 6 km and an internal nested domain that refined the spatial resolution to 2 km. The model is run with 61 vertical levels, with 12 levels in the lower 300m of the atmosphere, stretching from 5 m to 45 m in height. The MYNN planetary boundary layer and surface layer schemes were used the North Atlantic, Mid Atlantic, Great Lakes, Hawaii, and North Pacific regions. On the other hand, using the YSU planetary boundary layer and MM5 surface layer schemes resulted in a better skill in the South Atlantic, Gulf of Mexico, and South Pacific regions. A more detailed description of the WRF model setup can be found in the WRF namelist files linked at the bottom of this page. For all regions, the NOW-23 data set coverage starts on January 1, 2000. For Hawaii and the North Pacific regions, NOW-23 goes until December 31, 2019. For the South Pacific region, the model goes until 31 December, 2022. For all other regions, the model covers until December 31, 2020. Outputs are available at 5 minute resolution, and for all regions we have also included output files at hourly resolution. The NOW-23 data are provided here as HDF5 files. Examples of how to use the HSDS Service to Access the NOW-23 files are linked below. A list of the variables included in the NOW-23 files is also linked below. No filters have been applied to the raw WRF output.

Array↗

LES ARM Symbiotic Simulation and Observation Scenario for CACTI

The Large-Eddy Simulation (LES) Atmospheric Radiation Measurement (ARM) Symbiotic Simulation and Observation (LASSO) deep-convection scenario for the Cloud, Aerosol, and Complex Terrain Interactions (CACTI) field campaign. The LASSO-CACTI scenario consists of a library of mesoscale and LES simulations spanning grid spacings from 7.5 km to 100 m for convection near the Sierras de Córdoba mountain range, roughly centered on the ARM Mobile Facility. Supporting skill scores and observation comparisons complement the simulations in addition to subsets of the model output for various categories of model output variables. More information can be found at https://www.arm.gov/capabilities/modeling/lasso.

54 ENVIRONMENTAL SCIENCES↗

Exploring the Relative Importance of the MJO and ENSO to North Pacific Subseasonal Predictability

Abstract Here we explore the relative contribution of the Madden‐Julian Oscillation (MJO) and El Niño Southern Oscillation (ENSO) to midlatitude subseasonal predictive skill of upper atmospheric circulation over the North Pacific, using an inherently interpretable neural network applied to pre‐industrial control runs of the Community Earth System Model version 2. We find that this interpretable network generally favors the state of ENSO, rather than the MJO, to make correct predictions on a range of subseasonal lead times and predictand averaging windows. Moreover, the predictability of positive circulation anomalies over the North Pacific is comparatively lower than that of their negative counterparts, especially evident when the ENSO state is important. However, when ENSO is in a neutral state, our findings indicate that the MJO provides some predictive information, particularly for positive anomalies. We identify three distinct evolutions of these MJO states, offering fresh insights into opportune forecasting windows for MJO teleconnections.

58 GEOSCIENCES↗

PERSIANN Dynamic Infrared–Rain Rate Model (PDIR) for High-Resolution, Real-Time Satellite Precipitation Estimation

Precipitation measurements with high spatiotemporal resolution are a vital input for hydrometeorological and water resources studies; decision-making in disaster management; and weather, climate, and hydrological forecasting. Moreover, real-time precipitation estimation with high precision is pivotal for the monitoring and managing of catastrophic hydroclimate disasters such as flash floods, which frequently transpire after extreme rainfall. While algorithms that exclusively use satellite infrared data as input are attractive owing to their rich spatiotemporal resolution and near-instantaneous availability, their sole reliance on cloud-top brightness temperature (T b ) readings causes underestimates in wet regions and overestimates in dry regions—this is especially evident over the western contiguous United States (CONUS). We introduce an algorithm, the Precipitation Estimations from Remotely Sensed Information Using Artificial Neural Networks (PERSIANN) Dynamic Infrared–Rain rate model (PDIR), which utilizes climatological data to construct a dynamic (i.e., laterally shifting) T b –rain rate relationship that has several notable advantages over other quantitative precipitation-estimation algorithms and noteworthy skill over the western CONUS. Validation of PDIR over the western CONUS shows a promising degree of skill, notably at the annual scale, where it performs well in comparison to other satellite-based products. Analysis of two extreme landfalling atmospheric rivers show that solely IR-based PDIR performs reasonably well compared to other IR- and PMW-based satellite rainfall products, marking its potential to be effective in real-time monitoring of extreme storms. This research suggests that IR-based algorithms that contain the spatiotemporal richness and near-instantaneous availability needed for rapid natural hazards response may soon contain the skill needed for hydrologic and water resource applications.

54 ENVIRONMENTAL SCIENCES↗

A new method for predicting hurricane rapid intensification based on co-occurring environmental parameters

Abstract Tropical cyclones (TCs) that undergo Rapid Intensification (RI) can pose serious socioeconomic threats and can potentially result in major damaging impacts along coastal areas. Considering the complexity of various physical mechanisms that play a role in RI and its relatively low probability of occurrence, predicting RI remains a major operational challenge. In this study, we propose a simple deterministic binary classification model based on the co-occurrence of environmental parameters (MCE) to predict an RI event. More specifically, the model determines the possibility of RI based on a simple count of the number of environmental predictors deemed favorable and unfavorable. We compare our model results to logistic regression (LR) and decision tree (DT) models, well-trained using the same set of environmental predictors. Results reveal that at an RI threshold of 30 kt, the MCE exhibits a critical success index score of 0.233 which is 14% higher than DT and LR model performances. When tested at multiple RI thresholds, the MCE displays relatively higher skill scores across multiple metrics. By simultaneously evaluating the favorability of predictors, the MCE is able to comparatively reduce the number of false alarms predicted when certain predictors are unfavorable toward RI. Interpreting these model results to gain a physical understanding of how co-occurring environmental parameters can affect RI, we highlight future directions for using models based on the MCE approach to understand and predict TC RI as well as other meteorological extremes.

54 ENVIRONMENTAL SCIENCES↗

Machine learning-driven predictive resource management in complex science workflows

Here, the collaborative efforts of large communities in science experiments, often comprising thousands of global members, reflect a monumental commitment to exploration and discovery. Recently, advanced and complex data processing has gained increasing importance in science experiments. Data processing workflows typically consist of multiple intricate steps, and the precise specification of resource requirements is crucial for each step to allocate optimal resources for effective processing. Estimating resource requirements in advance is challenging due to a wide range of analysis scenarios, varying skill levels among community members, and the continuously increasing spectrum of computing options. One practical approach to mitigate these challenges involves initially processing a subset of each step to measure precise resource utilization from actual processing profiles before completing the entire step. While this two-staged approach enables processing on optimal resources for most of the workflow, it has drawbacks such as initial inaccuracies leading to potential failures and suboptimal resource usage, along with overhead from waiting for initial processing completion, which is critical for fast-turnaround analyses. In this context, our study introduces a novel pipeline of machine learning models within a comprehensive workflow management system, the Production and Distributed Analysis (PanDA) system. These models employ advanced machine learning techniques to predict key resource requirements, overcoming challenges posed by limited upfront knowledge of characteristics at each step. Accurate forecasts of resource requirements enable informed and proactive decision-making in workflow management, enhancing the efficiency of handling diverse, complex workflows across heterogeneous resources.

97 MATHEMATICS AND COMPUTING↗

Quantifying UAS Observation Error Variance Used in Data Assimilation Systems and Its Impact on Predictive Skill

Observation error determines the weights of the observations and background state used in data assimilation to generate analyses. Quantifying observation error is critical for the optimal assimilation of observational data sets. Uncrewed Aircraft System (UAS) observations have shown potential benefits in filling observational gaps in the lower atmosphere; however, characterization of their error characteristics has been limited. To optimize the use of UAS observations in numerical weather prediction, UAS observation error is estimated based on the 3‐cornered hat diagnostic approach which uses three independent estimates of the atmospheric state. This approach is applied to data from the 2018 Lower Atmospheric Profiling Studies at Elevation‐a Remotely‐piloted Aircraft Team Experiment field campaign using collocated UAS and rawinsonde observations along with output from a set of convection‐permitting model simulations. The estimated observation error values for UAS temperature, wind, and relative humidity measurements were found to be only weakly dependent on height AGL with mean values equal to 0.5°C, 0.8 m s −1 , and 3%, respectively. Only the newly estimated observation error for temperature differed from that previously used to assimilate commercial aircraft observations into global models (1.0°C). However, using this reduced temperature observation error produced more accurate mesoscale analyses and forecasts of both terrain‐driven flows and convection initiation generated by colliding outflow boundaries within the San Luis Valley of Colorado.

54 ENVIRONMENTAL SCIENCES↗

A graph neural network (GNN) approach to basin-scale river network learning: the role of physics-based connectivity and data fusion

Abstract. Rivers and river habitats around the world are under sustained pressure from human activities and the changing global environment. Our ability to quantify and manage the river states in a timely manner is critical for protecting the public safety and natural resources. In recent years, vector-based river network models have enabled modeling of large river basins at increasingly fine resolutions, but are computationally demanding. This work presents a multistage, physics-guided, graph neural network (GNN) approach for basin-scale river network learning and streamflow forecasting. During training, we train a GNN model to approximate outputs of a high-resolution vector-based river network model; we then fine-tune the pretrained GNN model with streamflow observations. We further apply a graph-based, data-fusion step to correct prediction biases. The GNN-based framework is first demonstrated over a snow-dominated watershed in the western United States. A series of experiments are performed to test different training and imputation strategies. Results show that the trained GNN model can effectively serve as a surrogate of the process-based model with high accuracy, with median Kling–Gupta efficiency (KGE) greater than 0.97. Application of the graph-based data fusion further reduces mismatch between the GNN model and observations, with as much as 50 % KGE improvement over some cross-validation gages. To improve scalability, a graph-coarsening procedure is introduced and is demonstrated over a much larger basin. Results show that graph coarsening achieves comparable prediction skills at only a fraction of training cost, thus providing important insights into the degree of physical realism needed for developing large-scale GNN-based river network models.

54 ENVIRONMENTAL SCIENCES↗