Search NASA⌕ Search

SEARCH · Search NASA

Results for “Ensemble forecast”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Cybersecurity Anomaly Detection in SCADA-Assisted OT Networks Using Ensemble-Based State Prediction Model

The cybersecurity threats of power system gradually grow due to the increased sophisticated interactions between Information Technology (IT) and Operational Technology (OT) networks. False data injection attack (FDIA) that aims to compromise the Supervisory Control and Data Acquisition (SCADA) measurement and disturb the system operation is one of such cyber threats. Such attacks can potentially lead to significant operational issues at the control centers and substations, and hence, result in severe physical consequences. To avoid catastrophic failure across the power grid resulting from these attacks, it is essential to arm the OT network with real-time vulnerability assessment tools. To this end, this paper outlines various drawbacks of the Purdue architecture model to defend against cyberattacks in the OT network. Furthermore, a novel ensemble-based state prediction model is proposed to detect cybersecurity anomalies in SCADA assisted OT networks. The proposed model uses control center level generation and load forecasts, scheduled, and forced outages, power flow solutions, and the substation level historical data. The hypothesis of the proposed scheme relies on the fact that additional control center and substation data can hardly be accessed and compromised by attackers. One of the vital features of the proposed scheme is an hour-ahead prediction of the operational feasibility of the SCADA measurement range at the control center and substation in real time helps in detecting anomalies in measurements across both substation and the control center.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

New framework for benchmarking decadal predictions leveraging the PCMDI Metric Package with interactive visualization

Reliable climate predictions across multiple timescales are increasingly critical as climate-related risks continue to rise. With the growing number and diversity of climate prediction systems, systematic intercomparison has become essential. Here, we present a comprehensive evaluation framework based on the PCMDI Metric Package to assess the performance of multiple decadal climate prediction systems. Unlike uninitialized simulations, initialized predictions exhibit bias and predictive skill that evolve with forecast lead time. To address this, we introduce (1) model-by-lead-time portrait plots, which efficiently summarize metrics of global temperature, precipitation, and Arctic/Antarctic sea-ice extent, and (2) an HTML-based interactive visualization platform that provides detailed regional and seasonal diagnostics of model bias, skill scores, and ensemble spread for each model and lead time. Comparisons with uninitialized simulations further quantify the relative impacts of initialization and external forcing on prediction skill. The proposed framework provides a scalable and transparent approach for multi-model climate prediction assessments and can be readily extended to a wide range of operational and research forecasting systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Quantifying the Effect of Climate Change on Midlatitude Subseasonal Prediction Skill Provided by the Tropics

Abstract Subseasonal timescales (∼2 weeks–2 months) are known for their lack of predictability, however, specific Earth system states known to have a strong influence on these timescales can be harnessed to improve prediction skill (known as “forecasts of opportunity”). As the climate continues warming, it is hypothesized these states may change and consequently, their importance for subseasonal prediction may also be impacted. Here, we examine changes to midlatitude subseasonal prediction skill provided by the tropics under anthropogenic warming using artificial neural networks to quantify skill. The network is tasked to predict the sign of the 500 hPa geopotential height for historical and future time periods in the Community Earth System Model Version 2 ‐ Large Ensemble across the Northern Hemisphere at a 3 week lead using tropical precipitation. We show prediction skill changes substantially in key midlatitude regions and these changes appear linked to changes in seasonal variability with the largest differences in accuracy occurring during forecasts of opportunity.

Mayer, Kirsten J.↗
DOE OSTI2021

Attribution of the Australian bushfire risk to anthropogenic climate change

Abstract. Disastrous bushfires during the last months of 2019 and January 2020 affected Australia, raising the question to what extent the risk of these fires was exacerbated by anthropogenic climate change. To answer the question for southeastern Australia, where fires were particularly severe, affecting people and ecosystems, we use a physically based index of fire weather, the Fire Weather Index; long-term observations of heat and drought; and 11 large ensembles of state-of-the-art climate models. We find large trends in the Fire Weather Index in the fifth-generation European Centre for Medium-Range Weather Forecasts (ECMWF) Atmospheric Reanalysis (ERA5) since 1979 and a smaller but significant increase by at least 30 % in the models. Therefore, we find that climate change has induced a higher weather-induced risk of such an extreme fire season. This trend is mainly driven by the increase of temperature extremes. In agreement with previous analyses we find that heat extremes have become more likely by at least a factor of 2 due to the long-term warming trend. However, current climate models overestimate variability and tend to underestimate the long-term trend in these extremes, so the true change in the likelihood of extreme heat could be larger, suggesting that the attribution of the increased fire weather risk is a conservative estimate. We do not find an attributable trend in either extreme annual drought or the driest month of the fire season, September–February. The observations, however, show a weak drying trend in the annual mean. For the 2019/20 season more than half of the July–December drought was driven by record excursions of the Indian Ocean Dipole and Southern Annular Mode, factors which are included in the analysis here. The study reveals the complexity of the 2019/20 bushfire event, with some but not all drivers showing an imprint of anthropogenic climate change. Finally, the study concludes with a qualitative review of various vulnerability and exposure factors that each play a role, along with the hazard in increasing or decreasing the overall impact of the bushfires.

van Oldenborgh, Geert Jan (ORCID:0000000268989535)↗
DOE OSTI2022

Analysis of Integrated Vapor Transport Biases

Abstract High-fidelity analyses and forecasts of integrated vapor transport (VT) are central to the study of Earth’s hydrological cycle as well as high-impact phenomena such as monsoons and atmospheric rivers. The impact of the in-line analysis correction-based additive inflation (ACAI) on IVT biases and forecast errors is examined within the Navy Earth System Prediction Capability (Navy ESPC) global coupled system. The ACAI technique uses atmospheric analysis corrections from the data assimilation system to approximate model bias and as a representation of stochastic model error to simultaneously reduce systematic and random errors and improve ensemble performance. ACAI reduces the global average magnitude of the 7- and 14-day IVT bias by 16%–17% during Northern Hemisphere summer, reaching 70% reductions in some tropical regions. The global average IVT bias reduction is similar to the bias reduction for low-level wind speed bias and considerably smaller than the bias reduction in total precipitable water. The localized regions where ACAI increases IVT bias occur where the control IVT biases change sign and structure with increasing forecast lead time, such as the South Asian monsoon region. Substituting analyzed wind or moisture fields for the forecast fields when calculating the forecast IVT confirms that, on average, wind errors dominate the IVT error calculation in the tropics, although wind and moisture error contributions are comparable in the extratropics. The existence of regions where using either analyzed winds or analyzed moisture increases IVT bias or mean absolute error reveals areas with compensating errors.

Reynolds, Carolyn A.↗
DOE OSTI2022

Impacts of Lake Surface Temperature on the Summer Climate Over the Great Lakes Region

The surface of the Great Lakes interacts with the atmosphere, influencing the weather and climate over the Great Lakes Region (GLR). However, most climate models were not designed with sufficient emphasis on lake–atmosphere interactions, which could potentially cause model biases over the GLR. To understand how lake surface temperature (LST) affects the regional summer climate over the GLR, we conducted twin experiments using the Weather Research and Forecasting model at a spatial resolution of 4 km using two different LST data sets as the bottom boundary condition over the Great Lakes. In this work, our simulations include 10 ensemble members for the summer of 2018 and a single multiyear run for the summers of 2014–2020. Results show that variations in LST influence atmospheric temperature and moisture at a local scale—while affecting the convective environment and precipitation processes over a much larger spatial scale. In particular, an LST that is only 1°C–3°C warmer (depending on the lake) increases near-surface air temperature by 1.93°C and 0.97°C over Lake Superior and Lake Erie, respectively, and increases evaporation over the lakes by 0.23 and 1.1 mm day –1 . The warmer LST reduces mesoscale convective precipitation upstream of the GLR; however, it increases isolated deep convective precipitation and nonconvective precipitation downstream of GLR due to increased local instability and enhancement of moisture transport. Our analyses confirm the robustness of these impacts, which is at least 2 times larger than the model internal variability and is seen across all simulated summer seasons.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Meeting Global Health Needs via Infectious Disease Forecasting: Development of a Reliable Data-Driven Framework

Infectious diseases (IDs) have a significant detrimental impact on global health. Timely and accurate ID forecasting can result in more informed implementation of control measures and prevention policies. To meet the operational decision-making needs of real-world circumstances, we aimed to build a standardized, reliable, and trustworthy ID forecasting pipeline and visualization dashboard that is generalizable across a wide range of modeling techniques, IDs, and global locations. We forecasted 6 diverse, zoonotic diseases (brucellosis, campylobacteriosis, Middle East respiratory syndrome, Q fever, tick-borne encephalitis, and tularemia) across 4 continents and 8 countries. We included a wide range of statistical, machine learning, and deep learning models (n=9) and trained them on a multitude of features (average n=2326) within the One Health landscape, including demography, landscape, climate, and socioeconomic factors. The pipeline and dashboard were created in consideration of crucial operational metrics—prediction accuracy, computational efficiency, spatiotemporal generalizability, uncertainty quantification, and interpretability—which are essential to strategic data-driven decisions. While no single best model was suitable for all disease, region, and country combinations, our ensemble technique selects the best-performing model for each given scenario to achieve the closest prediction. For new or emerging diseases in a region, the ensemble model can predict how the disease may behave in the new region using a pretrained model from a similar region with a history of that disease. The data visualization dashboard provides a clean interface of important analytical metrics, such as ID temporal patterns, forecasts, prediction uncertainties, and model feature importance across all geographic locations and disease combinations. As the need for real-time, operational ID forecasting capabilities increases, this standardized and automated platform for data collection, analysis, and reporting is a major step forward in enabling evidence-based public health decisions and policies for the prevention and mitigation of future ID outbreaks.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Attribution of NAO Predictive Skill Beyond 2 Weeks in Boreal Winter

Weeks 3–6 averaged winter North Atlantic Oscillation (NAO) predictive skill in a state-of-the-art coupled climate prediction system is attributed to two principle sources: upper and lower boundary conditions linked to the stratosphere and El Niño-Southern Oscillation (ENSO), respectively. A 20-member ensemble of 45-day reforecasts over 1999–2015 is utilized, together with uninitialized simulations with the atmospheric component of the prediction system forced with observed radiative forcing and lower boundary conditions. NAO forecast skill for lead times out to 6 weeks is higher following extreme stratospheric polar vortex conditions (weak and strong vortex events) compared to neutral states. Enhanced weeks 3-6 NAO predictive skill for weak vortex events results primarily from stratospheric downward coupling to the troposphere, while enhanced skill for strong vortex events can be partly attributed to lower boundary forcing related to the ENSO phenomenon. Implications for forecast system development and improvement are discussed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Ensemble‐Based Assimilation of Satellite All‐Sky Microwave Radiances Improves Intensity and Rainfall Predictions for Hurricane Harvey (2017)

Abstract Ensemble‐based data assimilation of radar observations across inner‐core regions of tropical cyclones (TCs) in tandem with satellite all‐sky infrared (IR) radiances across the TC domain improves TC track and intensity forecasts. This study further investigates potential enhancements in TC track, intensity, and rainfall forecasts via assimilation of all‐sky microwave (MW) radiances using Hurricane Harvey (2017) as an example. Assimilating Global Precipitation Measurement constellation all‐sky MW radiances in addition to GOES‐16 all‐sky IR radiances reduces the forecast errors in the TC track, rapid intensification (RI), and peak intensity compared to assimilating all‐sky IR radiances alone, including a 24‐hr increase in forecast lead‐time for RI. Assimilating all‐sky MW radiances also improves Harvey's hydrometeor fields, which leads to improved forecasts of rainfall after Harvey's landfall. This study indicates that avenues exist for producing more accurate forecasts for TCs using available yet underutilized data, leading to better warnings of and preparedness for TC‐associated hazards in the future.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Examples of Mission-driven Data Science from Jefferson Lab and ACES

This presentation details mission-driven data science initiatives at Jefferson Lab and the Joint Institute for Advanced Computing on Environmental Studies (ACES). JLab, a U.S. Department of Energy Office of Science national laboratory, operates the Continuous Electron Beam Accelerator Facility (CEBAF), and is the lead institute for the new High Performance Data Facility (HPDF) Hub. The Joint Institute for ACES brings together interdisciplinary teams in health informatics, climate modeling, computer science, and physics to address environmental challenges, including flood modeling. The Hampton Roads region, particularly Norfolk and Virginia Beach, faces increasing flood risks, motivating the need for rapid, reliable, and risk-aware decision support. ACES’s flooding work has a focus on uncertainty quantification (UQ) and machine learning (ML) for coastal flood management. The work is motivated by the increasing vulnerability of communities such as Norfolk and Virginia Beach, Virginia, to frequent coastal flooding events, and the need for rapid, reliable decision support. The research develops computationally efficient ML surrogate models to forecast water levels and flooding risk. A central theme is the quantification and calibration of predictive uncertainty, especially for out-of-distribution (OOD) scenarios, using techniques such as Monte Carlo Dropout, Deep Ensembles, Gaussian Processes, and Deep Quantile Regression (DQR). The study demonstrates that distance-aware UQ is critical for reliable scientific AI, particularly in high-dimensional, safety-critical, and real-time applications.

McSpadden, Diana [Thomas Jefferson National Accele↗
DOE OSTI2022

The Influence of Shallow Cloud Populations on Transitions to Deep Convection in the Amazon

Abstract In this study, a pair of convection-permitting (2-km grid spacing), month-long, wet-season Weather Research and Forecasting (WRF) Model simulations with and without the eddy-diffusivity mass-flux (EDMF) scheme are performed for a portion of the Green Ocean Amazon (GoAmazon) 2014/15 field campaign period. EDMF produces an ensemble of subgrid-scale convective plumes that evolve in response to the boundary layer meteorological conditions and can develop into shallow clouds. The objective of this study is to determine how different treatments of shallow cumulus clouds (i.e., with and without EDMF) impact the total cloud population and precipitation across the Amazonian rain forest, with emphasis on impacts on the likelihood of shallow-to-deep convection transitions. Results indicate that the large-scale synoptic conditions in the EDMF and control simulations are nearly identical; however, on the local scale their rainfall patterns diverge drastically and the biases decrease in EDMF. The EDMF scheme significantly increases the frequency of shallow clouds, but the frequencies of deep clouds are similar between the simulations. Deep convective clouds are tracked using a cloud-tracking algorithm to examine the impact of shallow cumulus on the surrounding ambient environment where deep convective clouds initiate. Results suggest that a rapid increase of low-level cloudiness acts to cool and moisten the low to midtroposphere during the day, favoring the transition to deep convection.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Ecological niche models display nonlinear relationships with abundance and demographic performance across the latitudinal distribution of Astragalus utahensis (Fabaceae)

Abstract The potential for ecological niche models (ENMs) to accurately predict species' abundance and demographic performance throughout their geographic distributions remains a topic of substantial debate in ecology and biogeography. Few studies simultaneously examine the relationship between ENM predictions of environmental suitability and both a species' abundance and its demographic performance, particularly across its entire geographic distribution. Yet, studies of this type are essential for understanding the extent to which ENMs are a viable tool for identifying areas that may promote high abundance or performance of a species or how species might respond to future climate conditions. In this study, we used an ensemble ecological niche model to predict climatic suitability for the perennial forb Astragalus utahensis across its geographic distribution. We then examined relationships between projected climatic suitability and field‐based measures of abundance, demographic performance, and forecasted stochastic population growth (λ s ). Predicted climatic suitability showed a J‐shaped relationship with A. utahensis abundance, where low‐abundance populations were associated with low‐to‐intermediate suitability scores and abundance increased sharply in areas of high predicted climatic suitability. A similar relationship existed between climatic suitability and λ s from the center to the northern edge of the latitudinal distribution. Patterns such as these, where density or demographic performance only increases appreciably beyond some threshold of climatic suitability, support the contention that ENM‐predicted climatic suitability does not necessarily represent a reliable predictor of abundance or performance across large geographic regions.

Baer, Kathryn C.↗
DOE OSTI2026

ARM Trajectories Data Set Value-Added Product Report

The U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility’s ARM Trajectories Data Set (ARMTRAJ) Value-Added Product (VAP) provides trajectory data sets initialized at ARM deployment coordinates and configured using ARM data sets. The four trajectory data sets support aerosol, cloud, and planetary boundary-layer research. Trajectory calculations use the Hybrid Single-Particle Lagrangian Integrated Trajectory (HYSPLIT) model informed by the European Centre for Medium-Range Weather Forecasts (ECMWF) fifth-generation atmospheric reanalysis (ERA5) data set at its highest spatial resolution (~31 km). HYSPLIT also runs at multiple initial starting locations surrounding ARM deployments (in latitude/longitude and/or vertical coordinates), facilitating an ensemble for each sample in the data sets. The ensemble mean and variability reported in ARMTRAJ improve the fidelity and provide uncertainty estimates of trajectory coordinates, thermodynamic properties, and other output fields.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

ARM Trajectories Data Set Value-Added Product Report

The U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility’s ARM Trajectories Data Set (ARMTRAJ) Value-Added Product (VAP) provides trajectory data sets initialized at ARM deployment coordinates and configured using ARM data sets. The six trajectory data sets support aerosol, cloud, planetary boundary layer, and related research (aerosol-cloud interactions, etc.), as well as studies using ARM Aerial Facility (AAF) and tethered balloon system (TBS) measurements. Trajectory calculations use the Hybrid Single-Particle Lagrangian Integrated Trajectory (HYSPLIT) model informed by the European Centre for Medium-Range Weather Forecasts (ECMWF) fifth-generation atmospheric reanalysis (ERA5) data set at its highest spatial resolution (~31 km). HYSPLIT also runs at multiple initial starting locations surrounding ARM deployments (in latitude/longitude and/or vertical coordinates), facilitating an ensemble for each sample in the data sets. The ensemble mean and variability reported in ARMTRAJ improve the fidelity and provide uncertainty estimates of trajectory coordinates, thermodynamic properties, and other output fields.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Equation‐Free Surrogate Modeling of Geophysical Flows at the Intersection of Machine Learning and Data Assimilation

Abstract There is a growing interest in developing data‐driven reduced‐order models for atmospheric and oceanic flows that are trained on data obtained either from high‐resolution simulations or satellite observations. The data‐driven models are non‐intrusive in nature and offer significant computational savings compared to large‐scale numerical models. These low‐dimensional models can be utilized to reduce the computational burden of generating forecasts and estimating model uncertainty without losing the key information needed for data assimilation (DA) to produce accurate state estimates. This paper aims at exploring an equation‐free surrogate modeling approach at the intersection of machine learning and DA in Earth system modeling. With this objective, we introduce an end‐to‐end non‐intrusive reduced‐order modeling (NIROM) framework equipped with contributions in modal decomposition, time series prediction, optimal sensor placement, and sequential DA. Specifically, we use proper orthogonal decomposition (POD) to identify the dominant structures of the flow, and a long short‐term memory network to model the dynamics of the POD modes. The NIROM is integrated within the deterministic ensemble Kalman filter (DEnKF) to incorporate sparse and noisy observations at optimal sensor locations obtained through QR pivoting. The feasibility and the benefit of the proposed framework are demonstrated for the NOAA Optimum Interpolation Sea Surface Temperature (SST) V2 data set. Our results indicate that the NIROM is stable for long‐term forecasting and can model dynamics of SST with a reasonable level of accuracy. Furthermore, the prediction accuracy of the NIROM gets improved by almost one order of magnitude by the DEnKF algorithm.

Pawar, Suraj↗
DOE OSTI2022

Multifidelity Ensemble Kalman Filtering Using Surrogate Models Defined by Theory-Guided Autoencoders

Data assimilation is a Bayesian inference process that obtains an enhanced understanding of a physical system of interest by fusing information from an inexact physics-based model, and from noisy sparse observations of reality. The multifidelity ensemble Kalman filter (MFEnKF) recently developed by the authors combines a full-order physical model and a hierarchy of reduced order surrogate models in order to increase the computational efficiency of data assimilation. The standard MFEnKF uses linear couplings between models, and is statistically optimal in case of Gaussian probability densities. This work extends the MFEnKF into to make use of a broader class of surrogate model such as those based on machine learning methods such as autoencoders non-linear couplings in between the model hierarchies. We identify the right-invertibility property for autoencoders as being a key predictor of success in the forecasting power of autoencoder-based reduced order models. We propose a methodology that allows us to construct reduced order surrogate models that are more accurate than the ones obtained via conventional linear methods. Numerical experiments with the canonical Lorenz'96 model illustrate that nonlinear surrogates perform better than linear projection-based ones in the context of multifidelity ensemble Kalman filtering. We additionality show a large-scale proof-of-concept result with the quasi-geostrophic equations, showing the competitiveness of the method with a traditional reduced order model-based MFEnKF.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

A Scalable Real-Time Data Assimilation Framework for Predicting Turbulent Atmosphere Dynamics

AI-based foundation models like FourCastNet, GraphCast are revolutionizing weather and climate predictions but are not yet ready for operational use. Their limitation lies in the absence of a data assimilation system to incorporate real-time Earth system observations, crucial for accurately forecasting events like tropical cyclones. To overcome these obstacles, we introduce a generic real-time data assimilation framework and demonstrate its end-to-end performance on the Frontier supercomputer. This framework comprises two primary modules: an ensemble score filter (EnSF), which significantly outperforms the state-of-the-art data assimilation method, and a vision transformer-based surrogate capable of real-time adaptation through the integration of observational data. We demonstrate both the strong and weak scaling of our framework up to 1024 GPUs on the Exascale supercomputer, Frontier. Our results not only illustrate the framework's exceptional scalability on high-performance computing systems, but also demonstrate the importance of supercomputers in real-time data assimilation for weather and climate predictions.

Lu, Dan↗