Online updating of a Markovian solar forecast representation
Not Available
Sward, Jeffrey A. (ORCID:0000000217438944)↗
SEARCH · Search NASA
Results for “online forecast”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Comparative Analysis of NOAA REFM and SNB3GEO Tools for the Forecast of the Fluxes of High-Energy Electrons at GEO
Reliable forecasts of relativistic electrons at geostationary orbit (GEO) are important for the mitigation of their hazardous effects on spacecraft at GEO. For a number of years the Space Weather Prediction Center at NOAA has provided advanced online forecasts of the fluence of electrons with energy >2 MeV at GEO using the Relativistic Electron Forecast Model (REFM). The REFM forecasts are based on real-time solar wind speed observations at L1. The high reliability of this forecasting tool serves as a benchmark for the assessment of other forecasting tools. Since 2012 the Sheffield SNB3GEO model has been operating online, providing a 24 h ahead forecast of the same fluxes. In addition to solar wind speed, the SNB3GEO forecasts use solar wind density and interplanetary magnetic field B(sub z) observations at L1. The period of joint operation of both of these forecasts has been used to compare their accuracy. Daily averaged measurements of electron fluxes by GOES 13 have been used to estimate the prediction efficiency of both forecasting tools. To assess the reliability of both models to forecast infrequent events of very high fluxes, the Heidke skill score was employed. The results obtained indicate that SNB3GEO provides a more accurate 1 day ahead forecast when compared to REFM. It is shown that the correction methodology utilized by REFM potentially can improve the SNB3GEO forecast.
Balikhin, M. A.↗
Forecasting Responses of a Northern Peatland Carbon Cycle to Elevated CO 2 and a Gradient of Experimental Warming
The ability to forecast ecological carbon cycling is imperative to land management in a world where past carbon fluxes are no longer a clear guide in the Anthropocene. However, carbon–flux forecasting has not been practiced routinely like numerical weather prediction. This study explored (1) the relative contributions of model forcing data and parameters to uncertainty in forecasting flux– versus pool–based carbon cycle variables and (2) the time points when temperature and CO 2 treatments may cause statistically detectable differences in those variables. We developed an online forecasting workflow (Ecological Platform for Assimilation of Data (EcoPAD)), which facilitates iterative data–model integration. EcoPAD automates data transfer from sensor networks, data assimilation, and ecological forecasting. We used the Spruce and Peatland Responses Under Changing Experiments data collected from 2011 to 2014 to constrain the parameters in the Terrestrial Ecosystem Model, forecast carbon cycle responses to elevated CO 2 and a gradient of warming from 2015 to 2024, and specify uncertainties in the model output. Our results showed that data assimilation substantially reduces forecasting uncertainties. Interestingly, we found that the stochasticity of future external forcing contributed more to the uncertainty of forecasting future dynamics of C flux–related variables than model parameters. However, the parameter uncertainty primarily contributes to the uncertainty in forecasting C pool–related response variables. Given the uncertainties in forecasting carbon fluxes and pools, our analysis showed that statistically different responses of fast–turnover pools to various CO 2 and warming treatments were observed sooner than slow–turnover pools. In conclusion, our study has identified the sources of uncertainties in model prediction and thus leads to improve ecological carbon cycling forecasts in the future.
54 ENVIRONMENTAL SCIENCES↗
Preliminary Evaluation of GEOS-5 Aerosol and CO Distributions Forecast During TC4
The NASA Tropical Composition, Cloud, and Climate Coupling (TC4) Mission was based out San Jose, Costa Rica during July and August 2007. During TC4 the NASA Global Modeling and Assimilation Office (GMAO) ran twice-daily 0.5 x 0.666 global 5-day forecasts of the Goddard Earth Observing System atmospheric general circulation model and data assimilation system (GEOS-5). This implementation of GEOS-5 contained an aerosol and carbon monoxide (CO) model to provide online forecast tropospheric distributions of dust, sea salt, sulfate, and carbonaceous aerosols and CO for both the planning of flights and for science. Here we provide a description of the aerosol and CO modeling system and give a preliminary evaluation of forecast tracer distributions. Our comparisons to satellite observations of aerosol and CO show qualitatively similar simulated distributions of tracers to those observed. During TC4 copious amounts of dust were observed in the Caribbean. The model generally reproduced the observations of the timing of dust events and the vertical structure in the lower atmosphere. However, the model simulations had too much aerosol at high altitudes relative to airborne Cloud Physics Lidar observations. The results were similar for biomass burning aerosol and CO tracers, where the model showed higher simulated concentrations of these tracers at aircraft flight altitude than observations.
Colarco, Peter R.↗
Online mapping and forecasting of epidemics using open-source indicators
Open-source indicators have been proposed as a way of tracking and forecasting disease outbreaks. Some, such are meteorological data, are readily available as reanalysis products. Others, such as those derived from our online behavior (web searches, media article etc.) are gathered easily and are more timely than public health reporting. In this study we investigate how these datastreams may be combined to provide useful epidemiological information. The investigation is performed by building data assimilation systems to track influenza in California and dengue in India. The first does not suffer from incomplete data and was chosen to explore disease modeling needs. The second explores the case when observational data is sparse and disease modeling complexities are beside the point. The two test cases are for opposite ends of the disease tracking spectrum. We find that data assimilation systems that produce disease activity maps can be constructed. Further, being able to combine multiple open-source datastreams is a necessity as any one individually is not very informative. The data assimilation systems have very little in common except that they contain disease models, calibration algorithms and some ability to impute missing data. Thus while the data assimilation systems share the goal for accurate forecasting, they are practically designed to compensate for the shortcomings of the datastreams. Thus we expect them to be disease and location-specific.
42 ENGINEERING↗
Online Simulations and Forecasts of the Global Aerosol Distribution in the NASA GEOS-5 Model
We present an analysis of simulations of the global aerosol system in the NASA GEOS-5 transport, radiation, and chemistry model. The model includes representations of all major tropospheric aerosol species, including dust, sea salt, black carbon, particulate organic matter, and sulfates. The aerosols are run online for the period 2000 through 2005 in a simulation driven by assimilated meteorology from the NASA Goddard Data Assimilation System. Aerosol surface mass concentrations are compared with existing long-term surface measurement networks. Aerosol optical thickness is compared with ground-based AERONET sun photometry and space-based retrievals from MODIS, MISR, and OMI. Particular emphasis is placed here on consistent sampling of model and satellite aerosol optical thickness to account for diurnal variations in aerosol optical properties. Additionally, we illustrate the use of this system for providing chemical weather forecasts in support of various NASA and community field missions.
Colarco, Peter↗
Online energy consumption forecast for battery electric buses using a learning-free algebraic method
Accurately predicting the energy consumption plays a vital role in battery electric buses (BEBs) route planning and deployment. Based on the algebraic derivative estimation, we present a novel method to forecast the energy consumption in real time. In contrast to the mainstream machine-learning-based methods, the proposed method does not require access to the historical energy consumption data. It eliminates the time-consuming and computationally expensive offline training. Consequently, its prediction performance is not constrained by the quantity and quality of the training data. Moreover, the method can swiftly adapt to new situations not included in the previous driving cycles, which makes it especially suitable for emerging transport modes, e.g., on-demand transit services. In addition, its online execution only involves algebraic calculations, yielding superior calculation efficiency. Using real-world data, we comprehensively compare the performance of the proposed learning-free algebraic method with multiple representative machine-learning-based methods. Finally, the advantages and limitations of the proposed method are discussed in detail.
33 ADVANCED PROPULSION SYSTEMS↗
Online evolutionary neural architecture search for multivariate non-stationary time series forecasting
Time series forecasting (TSF) is one of the most important tasks in data science. TSF models are usually pre-trained with historical data and then applied on future unseen datapoints. However, real-world time series data is usually non-stationary and models trained offline usually face problems from data drift. Models trained and designed in an offline fashion can not quickly adapt to changes quickly or be deployed in real-time. To address these issues, this work presents the Online NeuroEvolution-based Neural Architecture Search (ONE-NAS) algorithm, which is a novel neural architecture search method capable of automatically designing and dynamically training recurrent neural networks (RNNs) for online forecasting tasks. Without any pre-training, ONE-NAS utilizes populations of RNNs that are continuously updated with new network structures and weights in response to new multivariate input data. ONE-NAS is tested on real-world, large-scale multivariate wind turbine data as well as the univariate Dow Jones Industrial Average (DJIA) dataset. These results demonstrate that ONE-NAS outperforms traditional statistical time series forecasting methods, including online linear regression, fixed long short-term memory (LSTM) and gated recurrent unit (GRU) models trained online, as well as state-of-the-art, online ARIMA strategies. Additionally, results show that utilizing multiple populations of RNNs which are periodically repopulated provide significant performance improvements, allowing this online neural network architecture design and training to be successful.
97 MATHEMATICS AND COMPUTING↗
Consumption Behavior Analytics-Aided Energy Forecasting and Dispatch
For decades, electricity customers have been treated as mere recipients of electricity in vertically integrated power systems. However, as customers have widely adopted distributed energy resources and other forms of customer participation in active dispatch (such as demand response) have taken shape, the value of mining knowledge from customer behavior patterns and using it for power system operation is increasing. Further, the variability of renewable energy resources has been considered a liability to the grid. However, electricity consumption has shown the same level of variability and uncertainty, and this is sometimes overlooked. This article investigates data analytics and forecasting methods to identify correlations between electricity consumption behavior and distributed photovoltaic (PV) output. The forecasting results feed into a predictive energy management system that optimizes energy consumption in the near future to balance customer demand and power system needs.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Air quality impact of the Northern California Camp Fire of November 2018
The Northern California Camp Fire that took place in November 2018 was one of the most damaging environmental events in California history. Here, we analyze ground-based station observations of airborne particulate matter that has a diameter <2.5 µm (PM 2.5 ) across Northern California and conduct numerical simulations of the Camp Fire using the Weather Research and Forecasting model online coupled with chemistry (WRF-Chem). Simulations are evaluated against ground-based observations of PM 2.5 , black carbon, and meteorology, as well as satellite measurements, such as Tropospheric Monitoring Instrument (TROPOMI) aerosol layer height and aerosol index. The Camp Fire led to an increase in Bay Area PM 2.5 to over 50 µg m –3 for nearly 2 weeks, with localized peaks exceeding 300 µg m –3 . Using the Visible Infrared Imaging Radiometer Suite (VIIRS) high-resolution fire detection products, the simulations reproduce the magnitude and evolution of surface PM 2.5 concentrations, especially downwind of the wildfire. The overall spatial patterns of simulated aerosol plumes and their heights are comparable with the latest satellite products from TROPOMI. WRF-Chem sensitivity simulations are carried out to analyze uncertainties that arise from fire emissions, meteorological conditions, feedback of aerosol radiative effects on meteorology, and various physical parameterizations, including the planetary boundary layer model and the plume rise model. Downwind PM 2.5 concentrations are sensitive to both flaming and smoldering emissions over the fire, so the uncertainty in the satellite-derived fire emission products can directly affect the air pollution simulations downwind. Our analysis also shows the importance of land surface and boundary layer parameterization in the fire simulation, which can result in large variations in magnitude and trend of surface PM 2.5 . Inclusion of aerosol radiative feedback moderately improves PM 2.5 simulations, especially over the most polluted days. Results of this study can assist in the development of data assimilation systems as well as air quality forecasting of health exposures and economic impact studies.
54 ENVIRONMENTAL SCIENCES↗
Daily Forecasting of Regional Epidemics of Coronavirus Disease with Bayesian Uncertainty Quantification, United States
To increase situational awareness and support evidence-based policymaking, we formulated a mathematical model for coronavirus disease transmission within a regional population. This compartmental model accounts for quarantine, self-isolation, social distancing, a nonexponentially distributed incubation period, asymptomatic persons, and mild and severe forms of symptomatic disease. We used Bayesian inference to calibrate region-specific models for consistency with daily reports of confirmed cases in the 15 most populous metropolitan statistical areas in the United States. We also quantified uncertainty in parameter estimates and forecasts. This online learning approach enables early identification of new trends despite considerable variability in case reporting.
59 BASIC BIOLOGICAL SCIENCES↗
Descriptive Analytics-Based Anomaly Detection for Cybersecure Load Forecasting
As power delivery systems evolve and become increasingly reliant on accurate forecasts, they will be more and more vulnerable to cybersecurity issues. A coordinated data attack by sophisticated adversaries can render existing data corrupt or outlier detection methods ineffective. This would have a very negative impact on operational decisions. The focus of this paper is to develop descriptive analytics-based methods for anomaly detection to protect the load forecasting process against cyberattacks to essential data. We propose an integrated solution (IS) and a hybrid implementation of IS (HIIS) that can detect and mitigate cyberattack induced long sequence anomalies. HIIS is also capable of improving true positive rates and reducing false positive rates significantly comparing with IS. The proposed HIIS can serve as an online cybersecure load forecasting scheme.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Demand Response Optimization and Management System for Real-TIme (DROMS-RT)
To design and demonstrate DROMS-RT, a highly distributed Demand Response Optimization and Management System for Real-Time (DROMS-RT) power flow control to support large scale integration of distributed renewable generation into the grid. AutoGrid developed a novel control and communications platform to allow highly dispatchable demand response (DR) services in time frames suitable for providing ancillary services to the transmission grid. These services will be substantially less expensive and more efficient than other forms of ancillary services options currently available to manage the intermittency associated with large-scale renewable integration. DROMSRT successfully leveraged Automated Demand Response (ADR) by fundamentally re-thinking the architecture of the DR platform from the ground up and by developing innovative new technologies in a number of areas related to DR. DROMS-RT leveraged the low-cost, open, interoperable DR signaling technology, OpenADR, and low-cost, internet-protocol based telemetry solutions to reduce the cost of hardware. This allowed DROMS-RT to provide dynamic price signals to millions of OpenADR clients. Statistically rigorous signal processing techniques were developed to reliably detect even small load reductions in the presence of noisy baseline profiles. Novel forecasting engines based on modern online machine learning algorithms enabled accurate individualized forecasts for customer loads in the presence of dynamic pricing signals, and a real-time decision engines enabled continuous optimization and optimal dispatch of DR resources across a large portfolio of heterogeneous loads that respond at varying time-scales. Moreover, the real-time optimization conducted by the decision engine can utilize grid physics to maximize load reduction at the transmission system in addition to the distribution sites, for more efficient grid operation. Finally, the Software-as-a-Service (SaaS) availability of the DROMS-RT platform has reduced the cost of deployment and enable participation of small commercial and residential customers in DR who otherwise would not be able to do so.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Satellite Soil Moisture Data Assimilation Impacts on Modeling Weather Variables and Ozone in the Southeastern US – Part 2: Sensitivity to Dry-Deposition Parameterizations
Ozone (O3) dry deposition is a major O3 sink. As a follow-up study of Huang et al. (2021), we quantify the impact of satellite soil moisture (SM) on model representations of this process when different dry-deposition parameterizations are implemented, based on which the implications for interpreting O3 air pollution levels and assessing the O3 impacts on human and ecosystem health are provided. The SM data from NASA's Soil Moisture Active Passive mission are assimilated into the Noah-Multiparameterization (Noah-MP) land surface model within the NASA Land Information System framework, semicoupled with Weather Research and Forecasting model with online Chemistry (WRF-Chem) regional-scale simulations covering the southeastern US. Major changes in the modeling system used include enabling the dynamic vegetation option, adding the irrigation process, and updating the scheme for the surface exchange coefficient. Two dry-deposition schemes are implemented, i.e., the Wesely scheme and a “dynamic” scheme, in the latter of which dry-deposition parameterization is coupled with photosynthesis and vegetation dynamics. It is demonstrated that, when the dynamic scheme is applied, the simulated O3 dry-deposition velocities vd and their stomatal and cuticular portions, as well as the total O3 fluxes Ft, are larger overall; vd and Ft are 2–3 times more sensitive to the SM changes due to the data assimilation (DA). Further, through case studies at two forested sites with different soil types and hydrological regimes, we highlight that, applying the Community Land Model type of SM factor controlling stomatal resistance (i.e., β factor) scheme in replacement of the Noah-type β factor scheme reduced the v(d) sensitivity to SM changes by ∼75 % at one site, while it doubled this sensitivity at the other site. Referring to multiple evaluation datasets, which may be associated with variable extents of uncertainty, the model performance of vegetation, surface fluxes, weather, and surface O3 concentrations shows mixed responses to the DA, some of which display land cover dependency. Finally, using model-derived concentration- and flux-based policy-relevant O3 metrics as well as their matching exposure–response functions, the relative biomass/crop yield losses for several types of vegetation/crops are estimated to be within a wide range of 1 %–17 %. Their sensitivities to the model's dry-deposition scheme and the implementation of SM DA are discussed.
Min Huang↗
Distribution-Agnostic Stochastic Optimal Power Flow for Distribution Grids
This paper outlines a data-driven, distributionally robust approach to solve chance-constrained AC optimal power flow problems in distribution networks. Uncertain forecasts for loads and power generated by photovoltaic (PV) systems are considered, with the goal of minimizing PV curtailment while meeting power flow and voltage regulation constraints. A data- driven approach is utilized to develop a distributionally robust conservative convex approximation of the chance-constraints; particularly, the mean and covariance matrix of the forecast errors are updated online, and leveraged to enforce voltage regulation with predetermined probability via Chebyshev-based bounds. By combining an accurate linear approximation of the AC power flow equations with the distributionally robust chance constraint reformulation, the resulting optimization problem becomes convex and computationally tractable.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Data Assimilation with Machine Learning Surrogate Models: A Case Study with FourCastNet
Modern data-driven surrogate models for weather forecasting provide accurate short-term predictions but inaccurate and nonphysical long-term forecasts. This paper investigates online weather prediction using machine learning surrogates supplemented with partial and noisy observations. We empirically demonstrate and theoretically justify that, despite the long-time instability of the surrogates and the sparsity of the observations, filtering estimates can remain accurate in the long-time horizon. As a case study, we integrate the Fourier Forecasting Neural Network (FourCastNet), a weather surrogate model, within a variational data assimilation framework using partial, noisy ERA5 global reanalysis data from the European Centre for Medium-Range Weather Forecasts (ECMWF). Here, our results show that filtering estimates remain accurate over a year-long assimilation window and provide effective initial conditions for forecasting tasks, including extreme event prediction.
Data assimilation↗
Data Assimilation with Machine Learning Surrogate Models: A Case Study with FourCastNet
Modern data-driven surrogate models for weather forecasting provide accurate short-term predictions but inaccurate and nonphysical long-term forecasts. This paper investigates online weather prediction using machine learning surrogates supplemented with partial and noisy observations. We empirically demonstrate and theoretically justify that, despite the long-time instability of the surrogates and the sparsity of the observations, filtering estimates can remain accurate in the long-time horizon. As a case study, we integrate FourCastNet, a weather surrogate model, within a variational data assimilation framework using partial, noisy ERA5 data. Our results show that filtering estimates remain accurate over a year-long assimilation window and provide effective initial conditions for forecasting tasks, including extreme event prediction.
Adrian, Melissa [Univ. of Chicago, IL (United Stat↗
Ensemble Forecasting/Assimilation/Emissions Estimation with WRF-Chem/DART: Accomplishments, Lessons Learned, and Future Plans
Over the past ten years, we have been conducting research on regional ensemble atmospheric composition forecasting/data assimilation/emissions estimation with WRF-Chem/DART. WRF- Chem/DART integrates the Weather Research and Forecasting model (WRF) with online chemistry (WRF-Chem) into the Data Assimilation Research Testbed (DART). DART is an ensemble data assimilation system based on the ensemble adjustment Kalman filter (EAKF) with adaptive inflation, localization (physical and state space), and an optional non-Gaussian formulation of the EAKF. DART includes assimilation of meteorological and limited chemical observations. WRF-Chem/DART extends DART to include assimilation of: MOPITT CO; IASI CO and O3; MODIS AOD; OMI O3, NO2, and SO2; TROPOMI CO, O3, NO2, and SO2, TES CO, CO2 (research mode), O3, NH3, and CH4 (research mode); CrIS CO, O3, NH3, CH4 (research mode), and PAN; SCIAMACHY NO2; GOME2a NO2; MLS O3 and HNO3; and proxy TEMPO O3, and NO2 satellite retrievals as raw retrievals or as ‘compact phase space retrievals’ (CPSRs) for profile retrievals. WRF-Chem/DART also assimilates in situ atmospheric composition measurements and uses the ‘state augmentation method’ for emissions estimation. In our presentation, we will provide an overview of WRF-Chem/DART: • applications and results; • lessons learned from: (i) independent versus joint assimilation; (ii) total/partial column versus profile retrieval assimilation; (iii) joint in situ and retrieval assimilation; (iv) assimilation at grid resolutions ranging from 100 km to 4 km; (v) dynamic emissions estimation; and • future work related to wildfire emissions estimation and intercomparison of CMAQ (online)/JEDI and CMAQ (online and offline)/DART.
WRF-Chem/DART↗