Search NASA⌕ Search

SEARCH · Search NASA

Results for “Prediction skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

A Spatiotemporal-Aware Weighting Scheme for Improving Climate Model Ensemble Predictions

Multimodel ensembling has been widely used to improve climate model predictions, and the improvement strongly depends on the ensembling scheme. In this work, we propose a Bayesian neural network (BNN) ensembling method, which combines climate models within a Bayesian model averaging framework, to improve the predictive capability of model ensembles. Our proposed BNN approach calculates spatiotemporally varying model weights and biases by leveraging individual models' simulation skill, calibrates the ensemble prediction against observations by considering observation data uncertainty, and quantifies epistemic uncertainty when extrapolating to new conditions. More importantly, the BNN method provides interpretability about which climate model contributes more to the ensemble prediction at which locations and times. Thus, beyond its predictive capability, the method also brings insights and understanding of the models to guide further model and data development. In this study, we design experiments using an ensemble of CMIP6 climate model simulations to illustrate the BNN ensembling method's capability with respect to prediction accuracy, interpretability, and uncertainty quantification (UQ). We demonstrate that BNN can correctly assign larger weights to the regions and seasons where the individual model fits the observation better. Moreover, its offered interpretability is consistent with our understanding of localized climate model performance. Additionally, BNN shows an increasing uncertainty when the prediction is farther away from the period with constrained data, which appropriately reflects our trustworthiness of the models in the changing climate.

54 ENVIRONMENTAL SCIENCES↗

Impacts of Interannual Climate Variability on Agricultural and Marine Ecosystems

The El Nino - Southern Oscillation (ENSO) is the dominant mode of global interannual climate variability, and seems to be the only mode for which current prediction methods are more skillful than climatology or persistence. The Zebiak and Cane intermediate coupled ocean-atmosphere model has been in use for ENSO prediction for more than a decade, with notable success. However, the sole dependence of its original initialization scheme and the improved initialization on wind fields derived from merchant ship observations proved to be a liability during 1997/1998 El Nino event: the deficiencies of wind observations prevented the oceanic component of the model from reaching the realistic state during the year prior to the event, and the forecast failed. Our work on the project was concentrated on the use of satellite data for improving various stages of ENSO prediction technology: model initialization, bias correction, and data assimilation. Close collaboration with other teams of the IDS project was maintained throughout.

Cane, M. A.↗

Predictability of the Minimum Sea Ice Extent from Late Winter Fram Strait Ice Export: Model vs Observations

Late winter coastal divergence along the Eurasian coastline (referred to as the ice factory) – or the Fram Strait ice export, a proxy for coastal divergence in the ice factory – is a skillful predictor of the minimum sea ice extent (Williams et al., 2016; Brunette et al., 2018; Sesternikov and, 1979). Coastal divergence leads to the formation of coastal polynya where new ice grows but to a thickness that is not large enough to survive the following summer melt. This signal is then amplified by the ice albedo feedback and leads to more open water at the end of the summer melt season. In this thesis project, we will identify if this source of predictive skill in the seasonal forecast of the minimum sea ice extent is present in General Circulation Models, more precisely in the CESM2-LE, GISS-E2.1-G, GFDL FLOR-LE, CNRM-CM6-1 and the CanESM5. Since even small biases in the large-scale atmospheric circulation simulated by a model can short circuit this coupling between dominant modes of atmospheric variability (NAO and AO), coastal divergence along the Eurasian coastline, Fram Strait ice export and therefore seasonal forecasting skill of the model, failure to reproduce this coupling observed in the real Arctic will be used to identify biases in GCM. Preliminary results show that subtle changes in the large-scale atmospheric circulation leads to opposite statistical relationship between Fram Strait ice area export, coastal divergence along the Eurasian coastline, and seasonal predictability of the minimum sea ice extent both in the CESM2-LE and the GISS-E2.1-G models. Differences are linked with the partitioning between recirculation within the Beaufort Gyre, ice exported through Fram Strait and ridging north of the Canadian Arctic Archipelago.

Sea ice↗

Understanding Predictability of Daily Southeast U.S. Precipitation Using Explainable Machine Learning

Abstract We investigate the predictability of the sign of daily southeastern U.S. (SEUS) precipitation anomalies associated with simultaneous predictors of large-scale climate variability using machine learning models. Models using index-based climate predictors and gridded fields of large-scale circulation as predictors are utilized. Logistic regression (LR) and fully connected neural networks using indices of climate phenomena as predictors produce neither accurate nor reliable predictions, indicating that the indices themselves are not good predictors. Using gridded fields as predictors, an LR and convolutional neural network (CNN) are more accurate than the index-based models. However, only the CNN can produce reliable predictions that can be used to identify forecasts of opportunity. Using explainable machine learning we identify which variables and grid points of the input fields are most relevant for confident and correct predictions in the CNN. Our results show that the local circulation is most important as represented by maximum relevance of 850-hPa geopotential heights and zonal winds to making skillful, high-probability predictions. Corresponding composite anomalies identify connections with El Niño–Southern Oscillation during winter and the Atlantic multidecadal oscillation and North Atlantic subtropical high during summer.

Pegion, Kathy↗

Prediction of Solar Energetic Particle Event Peak Proton Intensity Using a Simple Algorithm Based on CME Speed and Direction and Observations of Associated Solar Phenomena

We assess whether a formula obtained by Richardson et al. (2014,https://doi.org/10.1007/s11207-014-0524-8) relating the peak intensity of 14- to 24-MeV protons in a solar energetic particle (SEP) event at 1 AU to the solar event location and the speed of the associated coronal mass ejection (CME) may be used in a scheme to predict the intensity of an SEP event at any location at this heliocentric distance. Starting with all 334 CMEs in the CCMC/SWRC DONKI database in October 2011 to July 2012, we use the CME speed and direction to predict the proton intensity at Earth and the two Solar Terrestrial Relations Observatory spacecraft using this formula. Since most (85%)of these CMEs were not in fact associated with SEP events, many SEP events are predicted that are not actually observed. Such cases may be reduced by considering whether type II or type III radio emissions accompany the CMEs, or by selecting faster, wider CMEs. This method is also applied to predict the SEP intensities associated with 1,100 CMEs observed by the Solar and Heliospheric Observatory Large Angle and Spectrometric Coronagraph during 1997-2006 in solar cycle 23. Various skill scores are calculated, which assess different aspects of the skill of the SEP predictions. We conclude that the Richardson et al. (2014) formula has potential as a simple empirical SEP intensity prediction tool.

coronal mass ejections↗

A New Paradigm for Observing and Modeling of Air-Sea Interactions to Advance Earth System Prediction

The protection of people, property, and environmental resources from extreme weather, seasonal patterns, and climate change drives the need for predictions of weather, ocean, and climate patterns that have skill and value at timescales longer than traditional 1-10-day forecasts, including outlooks spanning weeks to decades. Advancing Earth System Prediction (ESP) skill at this range of timescales requires improved observations, understanding, and modeling of the processes in the ocean boundary layer, the atmospheric boundary layer, and their interface. A new way of referring to this coupled system is the Air-Sea Transition Zone (ASTZ). The report that follows is framed by the paradigm that the ASTZ is a single entity that regulates the flow of energy and matter between the ocean and the atmosphere. The ASTZ is thus the medium through which the ocean and atmosphere respond to and influence one another across their often disparate scales of variability. ASTZ modeling, observing, and understanding needs are particularly acute because very few measurements exist over oceans, and even fewer span the entire ASTZ, even though oceans cover 70% of Earth’s surface and are the source of most of the rain and snow that falls on both the land and the oceans.

54 ENVIRONMENTAL SCIENCES↗

The Power Curve Working Group's assessment of wind turbine power performance prediction methods

Wind turbine power production deviates from the reference power curve in real-world atmospheric conditions. Correctly predicting turbine power performance requires models to be validated for a wide range of wind turbines using inflow in different locations. The Share-3 exercise is the most recent intelligence-sharing exercise of the Power Curve Working Group, which aims to advance the modeling of turbine performance. The goal of the exercise is to search for modeling methods that reduce error and uncertainty in power prediction when wind shear and turbulence digress from design conditions. Herein, we analyze data from 55 wind turbine power performance tests from nine contributing organizations with statistical tests to quantify the skills of the prediction-correction methods. We assess the accuracy and precision of four proposed trial methods against the baseline method, which uses the conventional definition of a power curve with wind speed and air density at hub height. The trial methods reduce power-production prediction errors compared to the baseline method at high wind speeds, which contribute heavily to power production; however, the trial methods fail to significantly reduce prediction uncertainty in most meteorological conditions. For the meteorological conditions when a wind turbine produces less than the power its reference power curve suggests, using power deviation matrices leads to more accurate power prediction. We also determine that for more than half of the submissions, the data set has a large influence on the effectiveness of a trial method. Overall, this work affirms the value of data-sharing efforts in advancing power curve modeling and establishes the groundwork for future collaborations.

17 WIND ENERGY↗

Assessing the Impact of Pre-gpm Microwave Precipitation Observations in the Goddard WRF Ensemble Data Assimilation System

The forthcoming Global Precipitation Measurement (GPM) Mission will provide next generation precipitation observations from a constellation of satellites. Since precipitation by nature has large variability and low predictability at cloud-resolving scales, the impact of precipitation data on the skills of mesoscale numerical weather prediction (NWP) is largely affected by the characterization of background and observation errors and the representation of nonlinear cloud/precipitation physics in an NWP data assimilation system. We present a data impact study on the assimilation of precipitation-affected microwave (MW) radiances from a pre-GPM satellite constellation using the Goddard WRF Ensemble Data Assimilation System (Goddard WRF-EDAS). A series of assimilation experiments are carried out in a Weather Research Forecast (WRF) model domain of 9 km resolution in western Europe. Sensitivities to observation error specifications, background error covariance estimated from ensemble forecasts with different ensemble sizes, and MW channel selections are examined through single-observation assimilation experiments. An empirical bias correction for precipitation-affected MW radiances is developed based on the statistics of radiance innovations in rainy areas. The data impact is assessed by full data assimilation cycling experiments for a storm event that occurred in France in September 2010. Results show that the assimilation of MW precipitation observations from a satellite constellation mimicking GPM has a positive impact on the accumulated rain forecasts verified with surface radar rain estimates. The case-study on a convective storm also reveals that the accuracy of ensemble-based background error covariance is limited by sampling errors and model errors such as precipitation displacement and unresolved convective scale instability.

microwave observations↗

Examining the Impacts of High-Resolution Land Surface Initialization on Model Predictions of Convection in the Southeastern U.S.

One of the most challenging weather forecast problems in the southeastern U.S. is daily summertime pulse convection. During the summer, atmospheric flow and forcing are generally weak in this region; thus, convection typically initiates in response to local forcing along sea/lake breezes, and other discontinuities often related to horizontal gradients in surface heating rates. Numerical simulations of pulse convection usually have low skill, even in local predictions at high resolution, due to the inherent chaotic nature of these precipitation systems. Forecast errors can arise from assumptions within physics parameterizations, model resolution limitations, as well as uncertainties in both the initial state of the atmosphere and land surface variables such as soil moisture and temperature. For this study, it is hypothesized that high-resolution, consistent representations of surface properties such as soil moisture and temperature, ground fluxes, and vegetation are necessary to better simulate the interactions between the land surface and atmosphere, and ultimately improve predictions of local circulations and summertime pulse convection. The NASA Short-term Prediction Research and Transition (SPORT) Center has been conducting studies to examine the impacts of high-resolution land surface initialization data generated by offline simulations of the NASA Land Informatiot~ System (LIS) on subsequent numerical forecasts using the Weather Research and Forecasting (WRF) model (Case et al. 2008, to appear in the Journal of Hydrometeorology). Case et al. presents improvements to simulated sea breezes and surface verification statistics over Florida by initializing WRF with land surface variables from an offline LIS spin-up run, conducted on the exact WRF domain and resolution. The current project extends the previous work over Florida, focusing on selected case studies of typical pulse convection over the southeastern U.S., with an emphasis on improving local short-term WRF simulations over the Mobile, AL and Miami, FL NWS county warning areas. Future efforts may involve examining the impacts of assimilating remotely-sensed soil moisture data, and/or introducing weekly greenness vegetation fraction composites (as opposed to monthly climatologies) into ol'fline NASA LIS runs. Based on positive impacts, the offline LIS runs could be transitioned into an operational mode, providing land surface initialization data to NWS forecast offices in real time.

Case, Jonathan L.↗

Wide range of possible trajectories of North Atlantic climate in a warming world

Decadal variability in the North Atlantic Ocean impacts regional and global climate, yet changes in internal decadal variability under anthropogenic radiative forcing remain largely unexplored. Here we use the Community Earth System Model 2 Large Ensemble under historical and the Shared Socioeconomic Pathway 3-7.0 future radiative forcing scenarios and show that the ensemble spread in northern North Atlantic sea surface temperature (SST) more than doubles during the mid-twenty-first century, highlighting an exceptionally wide range of possible climate states. Furthermore, there are strikingly distinct trajectories in these SSTs, arising from differences in the North Atlantic deep convection among ensemble members starting by 2030. We propose that these are stochastically triggered and subsequently amplified by positive feedbacks involving coupled ocean-atmosphere-sea ice interactions. Freshwater forcing associated with global warming seems necessary for activating these feedbacks, accentuating the impact of external forcing on internal variability. Further investigation on seven additional large ensembles affirms the robustness of our findings. By monitoring these mechanisms in real time and extending dynamical model predictions after positive feedbacks activate, we may achieve skillful long-lead North Atlantic decadal predictions that are effective for multiple decades.

54 ENVIRONMENTAL SCIENCES↗

NASA's Advancements in Space-Based Spectrometry Lead to Improvements in Weather Prediction and Understanding of Climate Processes

AIRS (Atmospheric Infra-Red Sounder), was launched, in conjunction with AMSU-A (Advanced Microwave Sounding Unit-A) on the NASA polar orbiting research satellite EOS (Earth Observing System) Aqua satellite in May 2002 as a next generation atmospheric sounding system. Atmospheric sounders provide information primarily about the vertical distribution of atmospheric temperature and water vapor distribution. This is achieved by measuring outgoing radiation in discrete channels (spectral intervals) which are sensitive primarily to variations of these geophysical parameters. The primary objectives of AIRS/AMSU were to utilize such information in order to improve the skill of numerical weather prediction as well as to measure climate variability and trends. AIRS is a multi-detector array grating spectrometer with 2378 channels covering the spectral range 650/cm (15 microns) to 2660/cm (3.6 microns) with a resolving power (i/a i) of roughly 1200 where a i is the spectral channel bandpass. Atmospheric temperature profile can be determined from channel observations taken within the 15 micron (the long-wave CO2 absorption band) and within the 4.2 micron (the short-wave CO2 absorption band). Radiances in these (and all other) spectral intervals in the infrared are also sensitive to the presence of clouds in the instrument?s field of view (FOV), which are present about 95% of the time. AIRS was designed so as to allow for the ability to produce accurate Quality Controlled atmospheric soundings under most cloud conditions. This was achieved by having 1) extremely low channel noise values in the shortwave portion of the spectrum and 2) a very flat spatial response function within a channel?s FOV. IASI, the high spectral resolution IR interferometer flying on the European METOP satellite, does not contain either of these important characteristics. The AIRS instrument was also designed to be extremely stabile with regard to its spectral radiometric characteristics, which is critical with regard to the ability to measure accurate long term trends.

Susskind, Joel↗

Global decline in ocean memory over the 21st century

Ocean memory, the persistence of ocean conditions, is a major source of predictability in the climate system beyond weather time scales. We show that ocean memory, as measured by the year-to-year persistence of sea surface temperature anomalies, is projected to steadily decline in the coming decades over much of the globe. This global decline in ocean memory is predominantly driven by shoaling of the upper-ocean mixed layer depth in response to global surface warming, while thermodynamic and dynamic feedbacks can contribute substantially regionally. As the mixed layer depth shoals, stochastic forcing becomes more effective in driving sea surface temperature anomalies, increasing high-frequency noise at the expense of persistent signals. Reduced ocean memory results in shorter lead times of skillful persistence-based predictions of sea surface thermal conditions, which may present previously unknown challenges for predicting climate extremes and managing marine biological resources under climate change.

54 ENVIRONMENTAL SCIENCES↗

A Modeling and Verification Study of Summer Precipitation Systems Using NASA Surface Initialization Datasets

One of the most challenging weather forecast problems in the southeastern U.S. is daily summertime pulse-type convection. During the summer, atmospheric flow and forcing are generally weak in this region; thus, convection typically initiates in response to local forcing along sea/lake breezes, and other discontinuities often related to horizontal gradients in surface heating rates. Numerical simulations of pulse convection usually have low skill, even in local predictions at high resolution, due to the inherent chaotic nature of these precipitation systems. Forecast errors can arise from assumptions within parameterization schemes, model resolution limitations, and uncertainties in both the initial state of the atmosphere and land surface variables such as soil moisture and temperature. For this study, it is hypothesized that high-resolution, consistent representations of surface properties such as soil moisture, soil temperature, and sea surface temperature (SST) are necessary to better simulate the interactions between the surface and atmosphere, and ultimately improve predictions of summertime pulse convection. This paper describes a sensitivity experiment using the Weather Research and Forecasting (WRF) model. Interpolated land and ocean surface fields from a large-scale model are replaced with high-resolution datasets provided by unique NASA assets in an experimental simulation: the Land Information System (LIS) and Moderate Resolution Imaging Spectroradiometer (MODIS) SSTs. The LIS is run in an offline mode for several years at the same grid resolution as the WRF model to provide compatible land surface initial conditions in an equilibrium state. The MODIS SSTs provide detailed analyses of SSTs over the oceans and large lakes compared to current operational products. The WRF model runs initialized with the LIS+MODIS datasets result in a reduction in the overprediction of rainfall areas; however, the skill is almost equally as low in both experiments using traditional verification methodologies. Output from object-based verification within NCAR s Meteorological Evaluation Tools reveals that the WRF runs initialized with LIS+MODIS data consistently generated precipitation objects that better matched observed precipitation objects, especially at higher precipitation intensities. The LIS+MODIS runs produced on average a 4% increase in matched precipitation areas and a simultaneous 4% decrease in unmatched areas during three months of daily simulations.

Jonathan L. Case↗

Predictability of the 1997 and 1998 South Asian Summer Monsoons

The predictability of the 1997 and 1998 south Asian summer monsoon winds is examined from an ensemble of 10 Atmospheric General Circulation Model (AGCM) simulations with prescribed sea surface temperatures (SSTs) and soil moisture, The simulations are started in September 1996 so that they have lost all memory of the atmospheric initial conditions for the periods of interest. The model simulations show that the 1998 monsoon is considerably more predictable than the 1997 monsoon. During May and June of 1998 the predictability of the low-level wind anomalies is largely associated with a local response to anomalously warm Indian Ocean SSTs. Predictability increases late in the season (July and August) as a result of the strengthening of the anomalous Walker circulation and the associated development of easterly low level wind anomalies that extend westward across India and the Arabian Sea. During these months the model is also the most skillful with the observations showing a similar late-season westward extension of the easterly CD wind anomalies. The model shows little predictability or skill in the low level winds over southeast Asia during, 1997. Predictable wind anomalies do occur over the western Indian Ocean and Indonesia, however, over the Indian Ocean they are a response to SST anomalies that were wind driven and they show no skill. The reduced predictability in the low level winds during 1997 appears to be the result of a weaker (compared with 1998) simulated anomalous Walker circulation, while the reduced skill is associated with pronounced intraseasonal activity that is not well captured by the model. Remarkably, the model does produce an ensemble mean Madden-Julian Oscillation (MJO) response that is approximately in phase with (though weaker than) the observed MJ0 anomalies. This is consistent with the idea that SST coupling may play an important role in the MJO.

Schubert, Siegfred D.↗

Using Apex To Construct CPM-GOMS Models

process for automatically generating computational models of human/computer interactions as well as graphical and textual representations of the models has been built on the conceptual foundation of a method known in the art as CPM-GOMS. This method is so named because it combines (1) the task decomposition of analysis according to an underlying method known in the art as the goals, operators, methods, and selection (GOMS) method with (2) a model of human resource usage at the level of cognitive, perceptual, and motor (CPM) operations. CPM-GOMS models have made accurate predictions about behaviors of skilled computer users in routine tasks, but heretofore, such models have been generated in a tedious, error-prone manual process. In the present process, CPM-GOMS models are generated automatically from a hierarchical task decomposition expressed by use of a computer program, known as Apex, designed previously to be used to model human behavior in complex, dynamic tasks. An inherent capability of Apex for scheduling of resources automates the difficult task of interleaving the cognitive, perceptual, and motor resources that underlie common task operators (e.g., move and click mouse). The user interface of Apex automatically generates Program Evaluation Review Technique (PERT) charts, which enable modelers to visualize the complex parallel behavior represented by a model. Because interleaving and the generation of displays to aid visualization are automated, it is now feasible to construct arbitrarily long sequences of behaviors. The process was tested by using Apex to create a CPM-GOMS model of a relatively simple human/computer-interaction task and comparing the time predictions of the model and measurements of the times taken by human users in performing the various steps of the task. The task was to withdraw $80 in cash from an automated teller machine (ATM). For the test, a Visual Basic mockup of an ATM was created, with a provision for input from (and measurement of the performance of) the user via a mouse. The times predicted by the automatically generated model turned out to approximate the measured times fairly well (see figure). While these results are promising, there is need for further development of the process. Moreover, it will also be necessary to test other, more complex models: The actions required of the user in the ATM task are too sequential to involve substantial parallelism and interleaving and, hence, do not serve as an adequate test of the unique strength of CPM-GOMS models to accommodate parallelism and interleaving.

John, Bonnie↗

Representing Global Soil Erosion and Sediment Flux in Earth System Models

Abstract Soil erosion produces enormous amounts of sediment, carbon, and nutrient fluxes from land to rivers, thus playing crucial roles in global biogeochemical cycles and food security. To predict soil erosion in the context of climate and land use changes, we explicitly parameterize cropland management actions (i.e., irrigation, conserved agriculture, and crop residue management) and geological factors (i.e., lithology and glacier) in the Energy Exascale Earth System Model (E3SM) soil erosion module. The erosion model is calibrated using a global‐scale regionalized parameter calibration method. The spatial variabilities of the modeled and the Revised Universal Soil Loss Equation (RUSLE) based benchmark soil erosion are consistent across vegetation, climate and soil properties. Compared with independent data, our model shows a bias reduction in 59% of the observations relative to the RUSLE‐based soil erosion, with 53% of the bias reduction exceeding 50%. This improvement is mainly due to a better representation of the topographic effect on soil erosion. Our results indicate that conserved agriculture practices have effectively reduced soil erosion in cropland by over 25% in the United States and Argentina. In contrast, irrigation has increased soil erosion in many Asian countries. For upland sediment flux, our model is consistent with the WBMsed benchmark data in inter‐basin variability but could be more skillful in simulating intra‐basin variability because it couples soil erosion and sediment flux explicitly. The developed model provides useful skills for more realistic predictions of soil erosion and river sediment dynamics under environmental changes.

58 GEOSCIENCES↗

Probabilistic Machine Learning and Data Assimilation

This white paper responds to Focal Area 1. The associated portfolio of research activities is well-suited to DOE’s asset mix of HPC platforms, climate expertise, climate simulation codes, and AI expertise, which creates an opportunity to use manifold-finding probabilistic AI methods to create more powerful data assimilation techniques that increase the fidelity and forecasting skill of Earth System Prediction.

54 ENVIRONMENTAL SCIENCES↗

Value of Information and Data Management Platform Promoting Modern Data Analysis Utilization. STTR Phase I, Final Technical Report

The immense growth in weather and river sensor data availability along with increases in computational power and algorithmic sophistication have enabled the widespread application of physical, machine learning, and artificial intelligence algorithms to river forecasting. The forecasts produced by widely varying model approaches are inherently limited in different ways, such as by the number and quality of training observations, producing biased predictions that achieve optimal skill only over specific ranges of weather and river conditions. Thus, despite the growing availability and new sources of forecasts, hydropower owners cannot fully leverage the information because they lack an effective mechanism to determine the “best” forecast for given conditions or objectives. Tools are needed to consolidate forecast information, demonstrate skill, and extract optimal forecast guidance from the range of possibilities. Such tools will increase uptake and beneficial use of the growing wealth of forecast information, and lead to improved operating decisions, optimal power generation, and enhanced system value. This research proposes to improve the value of forecasts by developing a broadly accessible verification framework and applying machine learning techniques to identify the ‘best’ forecast from an ensemble of sources given the current weather, river, and operating conditions.

13 HYDRO ENERGY↗