Search NASA⌕ Search

SEARCH · Search NASA

Results for “reliability forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

FFTSF: Revisiting Sub-Seasonal Streamflow Forecasting with Simple Feedforward Network

Accurate short-to-subseasonal streamflow forecasts are vital for water management, including flood preparedness, drought mitigation, hydropower scheduling, and ecosystem protection. However, extending a forecast beyond a few days remains challenging due to complexity of hydrological processes. While recent self-attention based transformer architectures such as iTransformer have gained traction in time-series forecasting, these models suffer from several critical limitations: (1) significant computational overhead that scales quadratically with sequence length, (2) vulnerability to overfitting on limited hydrological datasets, (3) degraded performance on long-horizon forecasts due to attention decay, and (4) excessive architectural complexity that hampers interpretability and operational deployment. In this study, we propose a simple Feedforward Time Series Forecasting (FFTSF) network that directly addresses these limitations through its lightweight architecture and long-range forecasting capabilities. We evaluate FFTSF across 178 USGS stream gauges spanning diverse climate regimes by forecasting lead times of 1-, 7-, 14-, and 30-days. Our results demonstrate that FFTSF achieves competitive performance at short lead times (NSE of 0.778 for 1-day forecasts) while substantially outperforming complex baselines at longer forecast period, achieving the highest NSE (0.271) at 30-day forecasts with greater robustness and stability. For 30-day forecasts, FFTSF achieves a 71% improvement over NLinear, 57% improvement over DLinear and 12% improvement over the computationally intensive iTransformer while requiring fewer computational resources. Our findings reveal that architectural complexity is not necessary for hydrological forecasting, demonstrating that well-designed simple models can outperform attention mechanisms for subseasonal streamflow forecasting. The computational efficiency and consistent long-range performance of FFTSF make it suitable for water management applications where reliable extended forecasts are essential.

Krishnan Kutty Ambika, Anukesh [ORNL] (ORCID:00000↗

EV Load Forecasting Guide: A Report by the Energy Systems Integration Group’s EV Load Forecasting Task Force

Forecasting electricity usage is a foundational planning activity for utilities, underpinning billions of dollars in grid investments that ensure system reliability. Historically, forecasting relied on trends in economic and population growth; however, transportation electrification presents a new and complex planning challenge. Unlike conventional loads, electric vehicle (EV) charging has relatively limited usage history. In addition, charging is driven by complex human behaviors, is mobile, and at the same time can concentrate geographically in ways that, without proper planning, can quickly overwhelm local distribution systems.

Giraldez, Julieta [Electric Power Engineers, Austi↗

Field Accelerated Stress Testing (FAST): Forecasting Plant-specific Failure Modes and Degradation Rates

Photovoltaic plant owners and insurance companies would like to be prepared for the forthcoming material warranty claims (material defects) and power warranty claims (degradation rate). To address the needs of these stakeholders, this presentation aims to introduce a new conceptual approach to perform accelerated testing right at the field of interest and it is called field accelerated stress testing (FAST). The primary goal of this presentation is to present a conceptual approach to forecast the field specific failure modes and degradation rates in advance by a factor of 2 to 5, right at the plant site using a few spare modules available at the plant location itself.

14 SOLAR ENERGY↗

Reduced‐Order Probabilistic Emulation of Physics‐Based Ring Current Models: Application to RAM‐SCB Particle Flux

Abstract In this work, we address the computational challenge of large‐scale physics‐based simulation models for the ring current. Reduced computational cost allows for significantly faster than real‐time forecasting, enhancing our ability to predict and respond to dynamic changes in the ring current, valuable for space weather monitoring and mitigation efforts. Additionally, it can also be used for a comprehensive investigation of the system. Thus, we aim to create an emulator for the Ring current‐Atmosphere interactions Model with Self‐Consistent magnetic field (RAM‐SCB) particle flux that not only improves efficiency but also facilitates forecasting with reliable estimates of prediction uncertainties. The probabilistic emulator is built upon the methodology developed by Licata and Mehta (2023), https://doi.org/10.1029/2022sw003345 . A novel discrete sampling is used to identify 30 simulation periods over 20 years of solar and geomagnetic activity. Focusing on a subset of particle flux, we use Principal Component Analysis for dimensionality reduction and Long Short‐Term Memory (LSTM) neural networks to perform dynamic modeling. Hyperparameter space was explored extensively resulting in about 5% median symmetric accuracy across all data sets for one‐step dynamic prediction. Using a hierarchical ensemble of LSTMs, we have developed a reduced‐order probabilistic emulator (ROPE) tailored for time‐series forecasting of particle flux in the ring current. This ROPE offers accurate predictions of omnidirectional flux at a single energy with no pitch angle information, providing robust predictions on the test set with an error score below 11% and calibration scores under 8% with bias under 2% providing a significant speed up as compared to the full RAM‐SCB run.

79 ASTRONOMY AND ASTROPHYSICS↗

Evaluation of Radiation Belt Space Weather Forecasts for Internal Charging Analyses

A variety of static electron radiation belt models, space weather prediction tools, and energetic electron datasets are used by spacecraft designers and operations support personnel as internal charging code inputs to evaluate electrostatic discharge risks in space systems due to exposure to relativistic electron environments. Evaluating the environment inputs is often accomplished by comparing whether the data set or forecast tool reliability predicts measured electron flux (or fluence over a given period) for some chosen period. While this technique is useful as a model metric, it does not provide the information necessary to evaluate whether short term deviances of the predicted flux is important in the charging evaluations. In this paper, we use a 1-D internal charging model to compute electric fields generated in insulating materials as a function of time when exposed to relativistic electrons in the Earth's magnetosphere. The resulting fields are assumed to represent the "true" electric fields and are compared with electric field values computed from relativistic electron environments derived from a variety of space environment and forecast tools. Deviances in predicted fields compared to the "true" fields which depend on insulator charging time constants will be evaluated as a potential metric for determining the importance of predicted and measured relativistic electron flux deviations over a range of time scales.

Minow, Joseph I.↗

Huge ensembles – Part 1: Design of ensemble weather forecasts using spherical Fourier neural operators

Abstract. Simulating low-likelihood high-impact extreme weather events in a warming world is a significant and challenging task for current ensemble forecasting systems. While these systems presently use up to 100 members, larger ensembles could enrich the sampling of internal variability. They may capture the long tails associated with climate hazards better than traditional ensemble sizes. Due to computational constraints, it is infeasible to generate huge ensembles (comprised of 1000–10 000 members) with traditional, physics-based numerical models. In this two-part paper, we replace traditional numerical simulations with machine learning (ML) to generate hindcasts of huge ensembles. In Part 1, we construct an ensemble weather forecasting system based on spherical Fourier neural operators (SFNOs), and we discuss important design decisions for constructing such an ensemble. The ensemble represents model uncertainty through perturbed-parameter techniques, and it represents initial condition uncertainty through bred vectors, which sample the fastest-growing modes of the forecast. Using the European Centre for Medium-Range Weather Forecasts Integrated Forecasting System (IFS) as a baseline, we develop an evaluation pipeline composed of mean, spectral, and extreme diagnostics. With large-scale, distributed SFNOs with 1.1 billion learned parameters, we achieve calibrated probabilistic forecasts. As the trajectories of the individual members diverge, the ML ensemble mean spectra degrade with lead time, consistent with physical expectations. However, the individual ensemble members' spectra stay constant with lead time. Therefore, these members simulate realistic weather states during the rollout, and the ML ensemble passes a crucial spectral test in the literature. The IFS and ML ensembles have similar extreme forecast indices, and we show that the ML extreme weather forecasts are reliable and discriminating. These diagnostics ensure that the ensemble can reliably simulate the time evolution of the atmosphere, including low-likelihood high-impact extremes. In Part 2, we generate a huge ensemble initialized each day in summer 2023, and we characterize the simulations of extremes.

Mahesh, Ankur↗

The useful potential of using existing data to uniquely identify predictable wind events and regimes, part 2

Wind data from four sites were stratified and found to naturally fit into a few unique groups. These were compared with synoptic weather patterns using the Booz-Allen classification system. Strong relationships became evident between a particular synoptic type and wind events for each site. Statistics indicate certain patterns which result in strong winds and some that result in weak winds. For each site there is a preferred wind direction associated with the strongest speed. Important relationships were also found comparing 850-mb and surface wind. Additionally, comparisons between pressure gradient and wind speed for a given gradient direction show some significant relationships. It can be stated that the overall results show what by using existing data for any site, the winds can be characterized and correlated with synoptic weather patterns. As a result, reliable wind forecasts can be made for utility companies for the purpose of power generation.

Notis, C.↗

Comparison of Mean Climate Trends in the Northern Hemisphere Between N.C.E.P. and Two Atmosphere-Ocean Model Forced Runs

Results are presented for two greenhouse gas experiments of the Goddard Institute for Space Studies Atmosphere-Ocean Model (AOM). The computed trends of surface pressure, surface temperature, 850, 500 and 200 mb geopotential heights and related temperatures of the model for the time frame 1960-2000 are compared to those obtained from the National Centers for Environmental Prediction observations. A spatial correlation analysis and mean value comparison are performed, showing good agreement. A brief general discussion about the statistics of trend detection is presented. The domain of interest is the Northern Hemisphere (NH) because of the higher reliability of both the model results and the observations. The accuracy that this AOM has in describing the observed regional and NH climate trends makes it reliable in forecasting future climate changes.

Lucarini, Valerio↗

National Aeronautics and Space Administration 2003 Strategic Plan

Imagine knowing that we are not alone, but that life is abundant in our solar system and throughout the universe. Imagine a world where we can safely travel anywhere, anytime, on our home planet, and in space. Imagine a world in which long-term weather forecasts are reliable, and natural disasters are predictable and perhaps even preventable. NASA is changing our understanding of the world, exploring the unknown, and creating new awareness about who we are and what our place is in the cosmos. For the first time in history, we have the tools, the insight and ability to seek answers to some of humanity's most profound questions: 1) How did we get here? 2) Where are we going? 3) Are we alone? In addition to pursuing these compelling questions, NASA helps the Nation to meet its challenges and address its urgent national needs. Among these are the requirements to improve the security and safety of our air transportation system and counter the looming shortage of U.S. scientists and engineers in our next generation of Americans.

Source record↗

Data Mining for Understanding and Impriving Decision-Making Affecting Ground Delay Programs

The continuous growth in the demand for air transportation results in an imbalance between airspace capacity and traffic demand. The airspace capacity of a region depends on the ability of the system to maintain safe separation between aircraft in the region. In addition to growing demand, the airspace capacity is severely limited by convective weather. During such conditions, traffic managers at the FAA's Air Traffic Control System Command Center (ATCSCC) and dispatchers at various Airlines' Operations Center (AOC) collaborate to mitigate the demand-capacity imbalance caused by weather. The end result is the implementation of a set of Traffic Flow Management (TFM) initiatives such as ground delay programs, reroute advisories, flow metering, and ground stops. Data Mining is the automated process of analyzing large sets of data and then extracting patterns in the data. Data mining tools are capable of predicting behaviors and future trends, allowing an organization to benefit from past experience in making knowledge-driven decisions. The work reported in this paper is focused on ground delay programs. Data mining algorithms have the potential to develop associations between weather patterns and the corresponding ground delay program responses. If successful, they can be used to improve and standardize TFM decision resulting in better predictability of traffic flows on days with reliable weather forecasts. The approach here seeks to develop a set of data mining and machine learning models and apply them to historical archives of weather observations and forecasts and TFM initiatives to determine the extent to which the theory can predict and explain the observed traffic flow behaviors.

data mining↗

Pro2R: Procurement of Ramping Product and Regulation in CAISO Using Probabilistic Solar Power Forecasts

This presentation summarizes the objectives and findings from the project titled, "Pro2R: Coordinated Procurement of Ramping Product & Regulation in CAISO Using Probabilistic Solar Power Forecasts," funded by DOE SETO. The goal is to develop cutting edge probabilistic solar power forecasting methods, and integrate them into ISO market operations. The team has integrated in two ways: 1) to procure ramping product and regulation requirements (ancillary services) in the California ISO market, and 2) to develop an open source visitation and ramp alert related situational awareness using probabilistic forecasts. This deck also summarizes the results from the use of machine learning methods to relate probabilistic solar forecasts to the the needs for flexible ramp product in the California ISO system.

41 EE - Solar Energy Technologies Office (EE-4S)↗

A Phenomenon-Based Decomposition of Model-Based Estimates of Boreal Winter ENSO Variability

Climate models are now routinely being used to simulate and predict climate variability on time scales ranging from sub-seasonal to seasonal and longer. As such, there are now long histories of such simulations and predictions spanning multiple decades and multiple ensemble members, both of which are crucial for separating climate signal from climate noise. A key focus of such runs has been the El Niño-Southern Oscillation (ENSO), spurred by recent improvements in our ability to predict such events, though questions remain as to how well climate models do beyond simply always predicting the “canonical” atmospheric response to an ENSO event—something simple statistical models already do reasonably well. This is a critical issue that needs addressing, given the importance of event-to-event differences for predicting regional impacts of ENSO teleconnections, and the need to justify the expense of running sophisticated climate models. Unfortunately, current diagnostic tools are not well suited for quantifying the different sources of variability associated with specific phenomena such as ENSO. More generally, while much effort has focused on addressing model bias, less has been done to address errors in second moment statistics—an issue whose importance is gaining increased attention particularly as we build climate prediction systems capable of taking advantage of forecasts of opportunity—a capability that requires reliable estimates of forecast uncertainty. In this report, we outline a phenomenon-based statistical decomposition of climate variance(in essence a detailed variance budget)that is specifically tailored to address the above questions by separating the variability (both the signal and noise) into that tied to the long-term average impact of a particular phenomenon(the composite mean) and the event-to-event(E2E) variability about the composite mean. In addition, we provide related decompositions of the correlations that allow us to quantify how much of the agreement with observations (the skill) comes from the composite mean as opposed to from the E2Evariability. As an example, we present the results of such a decomposition for ENSO based on simulations with the GEOS atmospheric general circulation model (AGCM), with a focus on the monthly mean impacts over North America during boreal winter(December –March). Here we take advantage of existing GEOS AGCM simulations that were produced as companion simulations to MERRA-2for the period 1980-2016. Comparisons are made throughout with MERRA-2.

ENSO↗

Forecasts of geomagnetic activity by Ottawa Magnetic Observatory: Their reliabilty and application

A 27 day forecast of geomagnetic activity based on the forecasts from two locations is presented. To evaluate the reliability of the forecasts, the predicted activity was compared with the actual geomagnetic activity at five geomagnetic observatories located in different magnetic zones: Ottawa (57.0N, 351.5E); Meanook (61.8N, 301.0E); Fort Churchill (68.8N, 322.5E); Cambridge Bay (76.7N, 294.0E); and Resolute Bay (83.1N, 287.7E). Results indicate that the percentage of correct predictions varies with the geomagnetic latitude of the observatory used for comparison. The percentage is on the average highest for lower latitude stations and lowest for the northern stations. The number of incorrect predictions ranges from 4.7% for Ottawa to 8.4% for Churchill.

Hruska, J.↗

The Arctic Sea Ice Cover of 2016: A Year of Record-Low Highs and High-Than-Expected Lows

The Arctic sea ice cover of 2016 was highly noteworthy, as it featured record low monthly sea ice extents at the start of the year but a summer (September) extent that was higher than expected by most seasonal forecasts. Here we explore the 2016 Arctic sea ice state in terms of its monthly sea ice cover, placing this in the context of the sea ice conditions observed since 2000. We demonstrate the sensitivity of monthly Arctic sea ice extent and area estimates, in terms of their magnitude and annual rankings, to the ice concentration input data (using two widely used datasets) and to the averaging methodology used to convert concentration to extent (daily or monthly extent calculations). We use estimates of sea ice area over sea ice extent to analyse the relative “compactness†of the Arctic sea ice cover, highlighting anomalously low compactness in the summer of 2016 which contributed to the higher-than-expected September ice extent. Two cyclones that entered the Arctic Ocean during August appear to have driven this low-concentration/compactness ice cover but were not sufficient to cause more widespread melt-out and a new record-low September ice extent. We use concentration budgets to explore the regions and processes (thermodynamics/ dynamics) contributing to the monthly 2016 extent/area estimates highlighting, amongst other things, rapid ice intensification across the central eastern Arctic through September. Two different products show significant early melt onset across the Arctic Ocean in 2016, including record-early melt onset in the North Atlantic sector of the Arctic. Our results also show record-late 2016 freeze-up in the central Arctic, North Atlantic and the Alaskan Arctic sector in particular, associated with strong sea surface temperature anomalies that appeared shortly after the 2016 minimum (October onwards). We explore the implications of this low summer ice compactness for seasonal forecasting, suggesting that sea ice area could be a more reliable metric to forecast in this more seasonal, "New Arctic", sea ice regime.

sea ice↗

Systematic estimation of forecast and observation error covariances in four-dimensional data assimilation

A two-part algorithm is presented for reliably computing weather forecast model and observational error covariances during data assimilation. Data errors arise from instrumental inaccuracies and sub-grid scale variability, whereas forecast errors occur because of modeling errors and the propagation of previous analysis errors. A Kalman filter is defined as the primary algorithm for estimating the forecast and analysis error convariance matrices. A second algorithm is described for quantifying the noise covariance matrices of any degree to obtain accurate values for the observational error covariances. Numerical results are provided from a linearized one-dimensional shallow-water model. The results cover observational noise covariances, initial instrumental errors and erroneous model values.

Dee, D. P.↗

Enhancing Short-Range Weather Forecasts through Temporal Variation Encoding: A Multiperiod Embedding Approach

Machine learning (ML) techniques have emerged as promising approaches to improve regional weather forecast accuracy and reliability through data-driven methods. We propose a novel ML-based weather forecasting model, the Multiperiod Embed Net (MPENet). A key distinguishing feature of MPENet is its explicit utilization of the inherent cyclic nature in weather dynamics, unlike the autoregressive strategies commonly used in other ML weather forecasting approaches. Critical cyclic structures are identified via Fourier analyses of dynamic time series. Cyclicity in the convolutional representation is achieved by transforming one-dimensional time series of meteorological variables into two-dimensional tensors based on identified periods. This approach enables the model to leverage intrinsic weather patterns, enhancing regional forecast performance. To demonstrate the effectiveness of MPENet, we conduct a comparative analysis with Nvidia’s FourCastNet. Both models are trained on High-Resolution Rapid Refresh (HRRR) data from 2015 to 2022, over a 192 km × 192 km region in Tennessee. The comparisons are performed locally at two specific locations known to have different weather dynamics due to orographic effects: Crossville, on the relatively flat Cumberland Plateau with fewer topographic airflow disruptions, and Oak Ridge, in the ridge-and-valley region, where airflow is heavily influenced by surrounding valleys and mountains. Our results indicate that FourCastNet achieves strong accuracy at very short lead times, while MPENet maintains competitive skill and shows advantages in capturing temporal evolution over longer periods. Cross-correlation analyses of MPENet and FourCastNet predictions with the HRRR data suggest that encoding critical cyclicity into the network architecture leads to improvements in the forecasting skill.

Artificial intelligence↗

An efficient method to identify uncertainties of WRF-Solar variables in forecasting solar irradiance using a tangent linear sensitivity analysis

Uncertainty in predicting solar energy resources introduces major challenges in power system management and necessitates the development of reliable probabilistic solar forecasts. As the first part of the development of probabilistic forecasts based on the Weather Research and Forecasting model with solar extensions (WRF-Solar), this study presents a tangent linear approach to identify input variables responsible for the largest uncertainties in predicting surface solar irradiance and clouds. A tangent linear analysis is capable of efficiently investigating sensitivities of output variables with respect to various input variables of WRF-Solar because this approach avoids the computational burden of perturbing the initial conditions of individual input variables. We develop tangent linear models (TLMs) for six WRF-Solar physics packages that control the formation and dissipation of clouds and solar radiation, and we evaluate the validity of TLMs using a linearity test. The tangent linear sensitivity analysis is conducted under various scenarios based on satellite observations and model simulations to consider realistic input conditions. A simple method is used to quantify the impact of the uncertainty of input variables on the output variables from the TLMs. The results demonstrate that uncertainties in the output variables that are the focus of this study—including global horizontal irradiance, direct normal irradiance, cloud mixing ratio, cloud tendency, cloud fraction, and sensible and latent heat fluxes—are highly sensitive to uncertainties in 14 input variables. This study indicates that the tangent linear method can identify key variables of physics modules in WRF-Solar that can be stochastically perturbed to generate ensemble-based probabilistic forecasts.

14 SOLAR ENERGY↗

Satellite Gravimetry Improves Seasonal Streamflow Forecast Initialization in Africa

West Africa is one of the poorest regions in the world and highly vulnerable to extreme hydrological events due to the lack of reliable monitoring and forecast systems. For the first time, we demonstrate that initial hydrological conditions informed by satellite-based terrestrial water storage (TWS) estimates improve seasonal streamflow forecasts. TWS variability detected by the Gravity Recovery and Climate Experiment (GRACE) satellites is assimilated into a land surface model during 2003–2016 and used to initialize 6-month hindcasts (i.e., forecasts of past events) during West Africa's wet seasons. We find that GRACE data assimilation (DA) generally increases groundwater and soil moisture storage in the region, resulting in increased evapotranspiration and reduced total runoff. Total runoff is particularly lower at the headwaters of the Niger River, positively impacting streamflow simulations and hindcast initializations. Compared to simulations without GRACE-DA, hindcasts are notably improved at locations draining from large basin areas, in particular, over the Niger River basin, which is consistent with GRACE's coarse spatial resolution. The long memory of groundwater and deep soil moisture, two main TWS components updated by GRACE-DA, is reflected in prolonged improvements in the streamflow hindcasts. Model accuracy at Niamey, Niger, the most populated city where streamflow observations are available, improved up to 33% during the flood season. These new findings directly contribute to ongoing developments in food security, flood potential forecast, and water-related disaster warning systems for Africa.

Augusto Getirana↗