Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Assimilation of SMAP Observations Over Land Improves the Simulation and Prediction of Tropical Cyclone Idai

This work is focused on the role of soil moisture in the prediction of tropical cyclones (TCs) approaching land and after landfall. Soil moisture conditions can impact the circulation and structure of an existing tropical cyclone (TC) when part or all of the circulation is over land. For example, dry land surface conditions may lead to faster dissipation of a TC over land (often associated with changes in precipitation structure), whereas very wet conditions may help sustain or in rare cases re-intensify a TC. Moreover, the presence of strong soil moisture gradients may affect the symmetry and development of the TC circulation leading to changes in its over-land track. While the link between soil moisture conditions and TC evolution in proximity to land is relatively well understood in theory, applications of these findings in the context of numerical weather prediction (NWP) have been limited. Here we present a case study that explores the potential of improving TC predictions through an improved soil moisture initialization in an NWP framework. Specifically, we examine the impact of assimilating observations from the NASA Soil Moisture Active Passive (SMAP) mission into the NASA Goddard Earth Observing System (GEOS) global weather model on the prediction of South-West Indian Ocean TC Idai (2019). SMAP provides accurate L-band (1.4 GHz) brightness temperatures (Tb) observations that are sensitive to soil moisture globally and at high revisit times of 2-3 days. It has previously been shown that the assimilation of SMAP Tb observations significantly improves modeled land surface states. Thus, it is expected that SMAP can be used to constrain land surface initial conditions and potentially benefit TC forecasts. Here we present two sets of retrospective forecasts of TC Idai that are compared in an Observing System Experiment framework at ¼ degree resolution: (i) forecasts initialized from an analysis that is comparable to the GEOS operational analysis (without SMAP Tb assimilation) and (ii) forecasts initialized from an analysis that additionally assimilates SMAP brightness temperature observations over land using a weakly-coupled land analysis. We find that the assimilation of SMAP meaningfully improves the representation of TC Idai’s structure as well as the prediction of its intensity and track. The analyzed TC size, as measured by the wind speed radius, is improved by up to 18% in the analysis with SMAP assimilation relative to the control run. The forecast intensity error, measured against the observed intensity, is reduced by up to 23%. At the 1/4-degree resolution used here, GEOS unavoidably under-estimates TC intensity and over-estimates TC size. The SMAP assimilation therefore corrects the model in the right direction, leading to a storm that is more energetic and more compact. Furthermore, we find that the along-track forecast error is reduced by up to 34%, indicating a more accurate propagation speed, which is consistent with the fact that TC speed over land is strongly affected by surface processes. The impact of SMAP assimilation on the forecast cross-track error is neutral. Across the TC forecast skill metrics used here, the improvements from SMAP DA are largest at lead times of 36 to 72 hours, suggesting that the predictability of forecasts at shorter lead times may be dominated by short-term convective processes, while the land and its longer memory gains in importance as a source of predictability on a 2-3 day timescale. We further investigated the underlying mechanisms leading to the skill improvements from SMAP data assimilation by isolating the land areas that directly influence TC Idai using a back trajectory analysis. We find that the assimilation of SMAP leads to wetter soil moisture conditions that cause an increased latent heat flux, which ultimately results in TC analyzed representation that has higher column-integrated total moisture content and total energy compared to the analysis in the control run without SMAP assimilation. Overall, the results highlight that the assimilation of SMAP observations into a global numerical weather prediction model can lead to pronounced improvements of TC predictions. This is a crucial step towards a better mitigation of the socio-economic impact of landfalling TCs and thus safeguarding human lives. Finally, our study presents an event-based approach that assesses the impact of land data assimilation for a particular weather event rather than by globally averaging differences in skill. We argue that global skill assessments – while necessary – can mute the impact of land data assimilation, because the land’s influence on the atmosphere is constrained to certain locations and certain times. Instead, the event-based approach better highlights the true potential of land data assimilation in the context of NWP, especially for extreme events when accurate predictions are critical.

Jana Kolassa↗

Assimilation of SMAP Observations Over Land Improves the Simulation and Prediction of Tropical Cyclone Idai

This work is focused on the role of soil moisture in the prediction of tropical cyclones (TCs) approaching land and after landfall. Soil moisture conditions can impact the circulation and structure of an existing tropical cyclone (TC) when part or all of the circulation is over land. For example, dry land surface conditions may lead to faster dissipation of a TC over land (often associated with changes in precipitation structure), whereas very wet conditions may help sustain or in rare cases re-intensify a TC. Moreover, the presence of strong soil moisture gradients may affect the symmetry and development of the TC circulation leading to changes in its over-land track. While the link between soil moisture conditions and TC evolution in proximity to land is relatively well understood in theory, applications of these findings in the context of numerical weather prediction (NWP) have been limited. Here we present a case study that explores the potential of improving TC predictions through an improved soil moisture initialization in an NWP framework. Specifically, we examine the impact of assimilating observations from the NASA Soil Moisture Active Passive (SMAP) mission into the NASA Goddard Earth Observing System (GEOS) global weather model on the prediction of South-West Indian Ocean TC Idai (2019). SMAP provides accurate L-band (1.4 GHz) brightness temperatures (Tb) observations that are sensitive to soil moisture globally and at high revisit times of 2-3 days. It has previously been shown that the assimilation of SMAP Tb observations significantly improves modeled land surface states. Thus, it is expected that SMAP can be used to constrain land surface initial conditions and potentially benefit TC forecasts. Here we present two sets of retrospective forecasts of TC Idai that are compared in an Observing System Experiment framework at ¼ degree resolution: (i) forecasts initialized from an analysis that is comparable to the GEOS operational analysis (without SMAP Tb assimilation) and (ii) forecasts initialized from an analysis that additionally assimilates SMAP brightness temperature observations over land using a weakly-coupled land analysis. We find that the assimilation of SMAP meaningfully improves the representation of TC Idai’s structure as well as the prediction of its intensity and track. The analyzed TC size, as measured by the wind speed radius, is improved by up to 18% in the analysis with SMAP assimilation relative to the control run. The forecast intensity error, measured against the observed intensity, is reduced by up to 23%. At the 1/4-degree resolution used here, GEOS unavoidably under-estimates TC intensity and over-estimates TC size. The SMAP assimilation therefore corrects the model in the right direction, leading to a storm that is more energetic and more compact. Furthermore, we find that the along-track forecast error is reduced by up to 34%, indicating a more accurate propagation speed, which is consistent with the fact that TC speed over land is strongly affected by surface processes. The impact of SMAP assimilation on the forecast cross-track error is neutral. Across the TC forecast skill metrics used here, the improvements from SMAP DA are largest at lead times of 36 to 72 hours, suggesting that the predictability of forecasts at shorter lead times may be dominated by short-term convective processes, while the land and its longer memory gains in importance as a source of predictability on a 2-3 day timescale. We further investigated the underlying mechanisms leading to the skill improvements from SMAP data assimilation by isolating the land areas that directly influence TC Idai using a back trajectory analysis. We find that the assimilation of SMAP leads to wetter soil moisture conditions that cause an increased latent heat flux, which ultimately results in TC analyzed representation that has higher column-integrated total moisture content and total energy compared to the analysis in the control run without SMAP assimilation. Overall, the results highlight that the assimilation of SMAP observations into a global numerical weather prediction model can lead to pronounced improvements of TC predictions. This is a crucial step towards a better mitigation of the socio-economic impact of landfalling TCs and thus safeguarding human lives. Finally, our study presents an event-based approach that assesses the impact of land data assimilation for a particular weather event rather than by globally averaging differences in skill. We argue that global skill assessments – while necessary – can mute the impact of land data assimilation, because the land’s influence on the atmosphere is constrained to certain locations and certain times. Instead, the event-based approach better highlights the true potential of land data assimilation in the context of NWP, especially for extreme events when accurate predictions are critical.

Jana Kolassa↗

Singular Vectors for Moisture-Measuring Norms

In dynamic meteorology, singular vectors (SVs) are the structures that maximize a given norm of a forecast perturbation given a tangent linear model and a quadratic constraint on the initial perturbation. That constraint is a prescription of the value of either the same or a different norm applied to the initial perturbations. In the sense that SVs maximize the forecast perturbations according to a specified measure, they may be considered as optimal perturbations. SVs are used to characterize predictability, to identify and correct possible initial errors given forecast errors, to create a set of significant perturbations for ensemble forecasting, or to determine locations for observation targeting. They are a specific application of generally defined singular vectors in mathematics.

Errico, Ronald M.↗

The GEOS Ozone Data Assimilation System: Specification of Error Statistics

A global three-dimensional ozone data assimilation system has been developed at the Data Assimilation Office of the NASA/Goddard Space Flight Center. The Total Ozone Mapping Spectrometer (TOMS) total ozone and the Solar Backscatter Ultraviolet (SBUV) or (SBUV/2) partial ozone profile observations are assimilated. The assimilation, into an off-line ozone transport model, is done using the global Physical-space Statistical Analysis Scheme (PSAS). This system became operational in December 1999. A detailed description of the statistical analysis scheme, and in particular, the forecast and observation error covariance models is given. A new global anisotropic horizontal forecast error correlation model accounts for a varying distribution of observations with latitude. Correlations are largest in the zonal direction in the tropics where data is sparse. Forecast error variance model is proportional to the ozone field. The forecast error covariance parameters were determined by maximum likelihood estimation. The error covariance models are validated using x squared statistics. The analyzed ozone fields in the winter 1992 are validated against independent observations from ozone sondes and HALOE. There is better than 10% agreement between mean Halogen Occultation Experiment (HALOE) and analysis fields between 70 and 0.2 hPa. The global root-mean-square (RMS) difference between TOMS observed and forecast values is less than 4%. The global RMS difference between SBUV observed and analyzed ozone between 50 and 3 hPa is less than 15%.

Stajner, Ivanka↗

Decomposition of Sources of Errors in Seasonal Streamflow Forecasting over the U.S. Sunbelt

Seasonal streamflow forecasts, contingent on climate information, can be utilized to ensure water supply for multiple uses including municipal demands, hydroelectric power generation, and for planning agricultural operations. However, uncertainties in the streamflow forecasts pose significant challenges in their utilization in real-time operations. In this study, we systematically decompose various sources of errors in developing seasonal streamflow forecasts from two Land Surface Models (LSMs) (Noah3.2 and CLM2), which are forced with downscaled and disaggregated climate forecasts. In particular, the study quantifies the relative contributions of the sources of errors from LSMs, climate forecasts, and downscaling/disaggregation techniques in developing seasonal streamflow forecast. For this purpose, three month ahead seasonal precipitation forecasts from the ECHAM4.5 general circulation model (GCM) were statistically downscaled from 2.8deg to 1/8deg spatial resolution using principal component regression (PCR) and then temporally disaggregated from monthly to daily time step using kernel-nearest neighbor (K-NN) approach. For other climatic forcings, excluding precipitation, we considered the North American Land Data Assimilation System version 2 (NLDAS-2) hourly climatology over the years 1979 to 2010. Then the selected LSMs were forced with precipitation forecasts and NLDAS-2 hourly climatology to develop retrospective seasonal streamflow forecasts over a period of 20 years (1991-2010). Finally, the performance of LSMs in forecasting streamflow under different schemes was analyzed to quantify the relative contribution of various sources of errors in developing seasonal streamflow forecast. Our results indicate that the most dominant source of errors during winter and fall seasons is the errors due to ECHAM4.5 precipitation forecasts, while temporal disaggregation scheme contributes to maximum errors during summer season.

Decomposition↗

Evaluation of NMME temperature and precipitation bias and forecast skill for South Asia

Systematic error and forecast skill for temperature and precipitation in two regions of Southern Asia are investigated using hindcasts initialized May 1 from the North American Multi-Model Ensemble. We focus on two contiguous but geographically and dynamically diverse regions: the Extended Indian Monsoon Rainfall (70–100E, 10–30 N) and the nearby mountainous area of Pakistan and Afghanistan (60–75E, 23–39 N). Forecast skill is assessed using the Sign test framework, a rigorous statistical method that can be applied to non-Gaussian variables such as precipitation and to different ensemble sizes without introducing bias. We find that models show significant systematic error in both precipitation and temperature for both regions. The multi-model ensemble mean (MMEM) consistently yields the lowest systematic error and the highest forecast skill for both regions and variables. However, we also find that the MMEM consistently provides a statistically significant increase in skill over climatology only in the first month of the forecast. While the MMEM tends to provide higher overall skill than climatology later in the forecast, the differences are not significant at the 95% level. We also find that MMEMs constructed with a relatively small number of ensemble members per model can equal or outperform MMEMs constructed with more members in skill. This suggests some ensemble members either provide no contribution to overall skill or even detract from it.

54 ENVIRONMENTAL SCIENCES↗

Autonomous Anomaly Detection for MPC Forecasts of HVAC Systems in Residential Communities

The use of residential heating, ventilation, and air conditioning (HVAC) to shift peak demand or provide ancillary services is a potential solution in the presence of older grids and distributed renewables. However, to ensure the efficient use of devices, utilities need to accurately forecast the load and adopt error correction schemes when necessary. While significant theoretical research exists in the area of predictive control of HVAC, little experimental evidence exists. The lack of experimental data in turn causes researchers to be unprepared for unsystematic errors which emerge due to the higher complexity of the data generating process. This study offers an anomaly detection methodology that uses unsupervised machine learning algorithms to detect and isolate these errors with different forecast error ranges. The results of anomaly detection procedure can then be used for error correction and would eventually help develop better predictive controllers. The methodology is tested using real world data from a smart neighborhood that currently operates in Atlanta. GA.

Lebakula, Viswadeep↗

Stratospheric wind errors, initial states and forecast skill in the GLAS general circulation model

Relations between stratospheric wind errors, initial states and 500 mb skill are investigated using the GLAS general circulation model initialized with FGGE data. Erroneous stratospheric winds are seen in all current general circulation models, appearing also as weak shear above the subtropical jet and as cold polar stratospheres. In this study it is shown that the more anticyclonic large-scale flows are correlated with large forecast stratospheric winds. In addition, it is found that for North America the resulting errors are correlated with initial state jet stream accelerations while for East Asia the forecast winds are correlated with initial state jet strength. Using 500 mb skill scores over Europe at day 5 to measure forecast performance, it is found that both poor forecast skill and excessive stratospheric winds are correlated with more anticyclonic large-scale flows over North America. It is hypothesized that the resulting erroneous kinetic energy contributes to the poor forecast skill, and that the problem is caused by a failure in the modeling of the stratospheric energy cycle in current general circulation models independent of vertical resolution.

Tenenbaum, J.↗

Two Topics in Seasonal Streamflow Forecasting: Soil Moisture Initialization Error and Precipitation Downscaling

Continental-scale offline simulations with a land surface model are used to address two important issues in the forecasting of large-scale seasonal streamflow: (i) the extent to which errors in soil moisture initialization degrade streamflow forecasts, and (ii) the extent to which the downscaling of seasonal precipitation forecasts, if it could be done accurately, would improve streamflow forecasts. The reduction in streamflow forecast skill (with forecasted streamflow measured against observations) associated with adding noise to a soil moisture field is found to be, to first order, proportional to the average reduction in the accuracy of the soil moisture field itself. This result has implications for streamflow forecast improvement under satellite-based soil moisture measurement programs. In the second and more idealized ("perfect model") analysis, precipitation downscaling is found to have an impact on large-scale streamflow forecasts only if two conditions are met: (i) evaporation variance is significant relative to the precipitation variance, and (ii) the subgrid spatial variance of precipitation is adequately large. In the large-scale continental region studied (the conterminous United States), these two conditions are met in only a somewhat limited area.

Koster, Randal↗

Synoptic scale forecast skill and systematic errors in the MASS 2.0 model

The synoptic scale performance characteristics of MASS 2.0 are determined by comparing filtered 12-24 hr model forecasts to same-case forecasts made by the National Meteorological Center's synoptic-scale Limited-area Fine Mesh model. Characteristics of the two systems are contrasted, and the analysis methodology used to determine statistical skill scores and systematic errors is described. The overall relative performance of the two models in the sample is documented, and important systematic errors uncovered are presented.

Koch, S. E.↗

Net Load Forecasting With Disaggregated Behind-the-Meter PV Generation

As worldwide use of residential photovoltaic (PV) systems grows, system operators and utilities will need to transition from forecasting pure demand to forecasting net load with behind-the-meter (BTM) PV generation. However, PV generation can be difficult to predict and the measurements of PV generation from BTM residential systems are often invisible behind a measurement of the net load, making net load forecasting challenging. This paper proposes a novel two-stage framework for net load forecasting in areas with limited observability and high BTM PV generation. First, the profiles of observable customers are used to disaggregate the net load measurements into the pure load and PV generation. Then, separate models are used to forecast the PV generation and pure load individually, and the results are combined for a net load forecast. Further, this paper also proposes a compensator for correcting the error of the net load forecast, using historical forecast errors of the PV generation, pure load, and net load. The proposed framework is tested through two case studies for areas with high BTM PV penetration and less than 10% observable customers. The two-stage forecasting model is compared to two benchmark methods - a time series forecasting model, and a model that forecasts the net load directly using historical net load measurements. Results show that the proposed disaggregation-forecasting framework reduces the error of the net load forecast compared to both benchmark models. In addition, when the net load forecast error is periodic, the compensator can correct the error to improve the forecast accuracy.

14 SOLAR ENERGY↗

Predicting tropical cyclone intensity using satellite-measured equivalent blackbody temperatures of cloud tops

A relationship between maximum winds and satellite-measured equivalent blackbody temperatures near tropical cyclones is investigated with data from both the Atlantic and western North Pacific areas. This investigation revealed not only a significant correlation between satellite-derived equivalent blackbody temperatures and maximum winds but also a strong lag relationship between these temperatures and maximum winds. From this latter relationship a regression technique was developed to forecast 24-h changes of the maximum winds for weak (maximum winds less than or equal to 65 kt) and strong (maximum winds greater than 65 kt) tropical cyclones by utilizing the equivalent blackbody temperatures around the storm alone, together with changes in maximum winds during the preceding 24 h and the current maximum winds. Testing of these equations with independent data showed that the mean errors of forecasts made by the equations are lower than the errors in forecasts made by persistence techniques.

Gentry, R. C.↗

Persistence and predictability in a perfect model

A realistic two-level GCM is used to examine the relationship between predictability and persistence. Predictability is measured by the average divergence of ensembles of solutions starting from perturbed initial conditions, and persistence is defined in terms of the autocorrelation function based on a single long-term model integration. The average skill of the dynamical forecasts is compared with the skill of simple persistence-based statistical forecasts. For initial errors comparable in magnitude to present-day analysis errors, the statistical forecast loses all skill after about one week, reflecting the lifetime of the lowest frequency fluctuations in the model. Large ensemble mean dynamical forecasts would be expected to remain skillful for about 3 wk. The disparity between the skill of the statistical and dynamical forecasts is greater for the higher frequency modes, which have little memory beyond 1 d, yet remain predictable for about 2 wk. The results are analyzed in terms of two characteristic time scales.

Schubert, Siegfried D.↗

Assimilation of GPM-retrieved Ocean Surface Meteorology Data for Two Snowstorm Events during ICE-POP 2018

As a component of the National Aeronautics and Space Administration (NASA) Weather Focus Area and Global Precipitation Measurement (GPM) Ground Validation participation in the International Collaborative Experiments for PyeongChang 2018 Olympic and Paralympic Winter Games (ICE-POP 2018) field research and forecast demonstration programs, hourly ocean surface meteorology properties were retrieved from the GPM microwave observations for January – March 2018. In this study, the retrieved ocean surface meteorological products – 2-m temperature, 2-m specific humidity, and 10-m wind speed were assimilated into a regional numerical weather prediction (NWP) framework to explore the application of these observations for two heavy snowfall events during the ICE-POP 2018: 27-28 February, and 7-8 March 2018. The Weather Research and Forecasting (WRF) model and the community Gridpoint Statistical Interpolation (GSI) were used to conduct high resolution simulations and data assimilation experiments. The results indicate that the data assimilation has a large influence on surface thermodynamic and wind fields in the model initial condition for both events. With cycled data assimilation, significantly positive influence of the retrieved surface observation was found for the March case with improved quantitative precipitation forecast and reduced error in temperature forecast. A slightly smaller yet positive impact was also found in the forecast of the February case.

assimilation↗

Enhanced Carbon Storage Forecasting via Cross-Geology Transfer Learning

Rapid simulation of the spatiotemporal evolution of pressure & saturation for SACROC 1. Neural operator was trained on only 153 simulation runs 2. Trained to account for heterogeneity and variations/uncertainties in engineering, fluids, and geology 3. Pressure forecast has less than 1% error 4. Saturation forecast has less than 2% error 5. Traditional simulator takes 1 hour for a single scenario, while neural operator takes less than 1 minute. Rapid simulation of the spatiotemporal evolution of pressure & saturation for IBDP 1. Transfer Learning was implemented on the SACROC-based Neural Operator that was trained on only 20 simulation runs for IBDP Site 2. SACROC and IBDP Sites have several significant differences in geology and engineering parameters. 3. Pressure forecast has less than 5 psi error 4. Saturation forecast has less than 7% error 5. Traditional simulator takes 1 hour for a single scenario, while neural operator takes less than 1 minute and only 20 simulations for training/validation.

Misra, Siddharth↗

The Wind Forecast Improvement Project (WFIP). A Public/Private Partnership for Improving Short Term Wind Energy Forecasts and Quantifying the Benefits of Utility Operations -- the Northern Study Area

This report contains the results from research aimed at improving short-range (0-6 hour) hub-height wind forecasts in the NOAA weather forecast models through additional data assimilation and model physics improvements for use in wind energy forecasting. Additional meteorological observing platforms including wind profilers, sodars, and surface stations were deployed for this study by NOAA and DOE, and additional meteorological data at or near wind turbine hub height were provided by South Dakota State University and WindLogics/NextEra Energy Resources over a large geographical area in the U.S. Northern Plains for assimilation into NOAA research weather forecast models. The resulting improvements in wind energy forecasts based on the research weather forecast models (with the additional data assimilation and model physics improvements) were examined in many different ways and compared with wind energy forecasts based on the current operational weather forecast models to quantify the forecast improvements important to power grid system operators and wind plant owners/operators participating in energy markets. Two operational weather forecast models (OP_RUC, OP_RAP) and two research weather forecast models (ESRL_RAP, HRRR) were used as the base wind forecasts for generating several different wind power forecasts for the NextEra Energy wind plants in the study area. Power forecasts were generated from the wind forecasts in a variety of ways, from very simple to quite sophisticated, as they might be used by a wide range of both general users and commercial wind energy forecast vendors. The error characteristics of each of these types of forecasts were examined and quantified using bulk error statistics for both the local wind plant and the system aggregate forecasts. The wind power forecast accuracy was also evaluated separately for high-impact wind energy ramp events. The overall bulk error statistics calculated over the first six hours of the forecasts at both the individual wind plant and at the system-wide aggregate level over the one year study period showed that the research weather model-based power forecasts (all types) had lower overall error rates than the current operational weather model-based power forecasts, both at the individual wind plant level and at the system aggregate level. The bulk error statistics of the various model-based power forecasts were also calculated by season and model runtime/forecast hour as power system operations are more sensitive to wind energy forecast errors during certain times of year and certain times of day. The results showed that there were significant differences in seasonal forecast errors between the various model-based power forecasts. The results from the analysis of the various wind power forecast errors by model runtime and forecast hour showed that the forecast errors were largest during the times of day that have increased significance to power system operators (the overnight hours and the morning/evening boundary layer transition periods), but the research weather model-based power forecasts showed improvement over the operational weather model-based power forecasts at these times.

17 WIND ENERGY↗

Incorporating single-side sparing in models for predicting parotid dose sparing in head and neck IMRT

Purpose: Sparing of single-side parotid gland is a common practice in head-and-neck (HN) intensity modulated radiation therapy (IMRT) planning. It is a special case of dose sparing tradeoff between different organs-at-risk. The authors describe an improved mathematical model for predicting achievable dose sparing in parotid glands in HN IMRT planning that incorporates single-side sparing considerations based on patient anatomy and learning from prior plan data. Methods: Among 68 HN cases analyzed retrospectively, 35 cases had physician prescribed single-side parotid sparing preferences. The single-side sparing model was trained with cases which had single-side sparing preferences, while the standard model was trained with the remainder of cases. A receiver operating characteristics (ROC) analysis was performed to determine the best criterion that separates the two case groups using the physician's single-side sparing prescription as ground truth. The final predictive model (combined model) takes into account the single-side sparing by switching between the standard and single-side sparing models according to the single-side sparing criterion. The models were tested with 20 additional cases. The significance of the improvement of prediction accuracy by the combined model over the standard model was evaluated using the Wilcoxon rank-sum test. Results: Using the ROC analysis, the best single-side sparing criterion is (1) the predicted median dose of one parotid is higher than 24 Gy; and (2) that of the other is higher than 7 Gy. This criterion gives a true positive rate of 0.82 and a false positive rate of 0.19, respectively. For the bilateral sparing cases, the combined and the standard models performed equally well, with the median of the prediction errors for parotid median dose being 0.34 Gy by both models (p = 0.81). For the single-side sparing cases, the standard model overestimates the median dose by 7.8 Gy on average, while the predictions by the combined model differ from actual values by only 2.2 Gy (p = 0.005). Similarly, the sum of residues between the modeled and the actual plan DVHs is the same for the bilateral sparing cases by both models (p = 0.67), while the standard model predicts significantly higher DVHs than the combined model for the single-side sparing cases (p = 0.01). Conclusions: The combined model for predicting parotid sparing that takes into account single-side sparing improves the prediction accuracy over the previous model.

61 RADIATION PROTECTION AND DOSIMETRY↗

Curriculum-based Reinforcement Learning for Distribution System Critical Load Restoration

This paper focuses on the critical load restoration problem in distribution systems following major outages. To provide fast online response and optimal sequential decision-making support, a reinforcement learning (RL) based approach is proposed to optimize the restoration. Due to the complexities stemming from the large policy search space, renewable uncertainty, and nonlinearity in a complex grid control problem, directly applying RL algorithms to train a satisfactory policy requires extensive tuning to be successful. To address this challenge, this paper leverages the curriculum learning (CL) technique to design a training curriculum involving a simpler steppingstone problem that guides the RL agent to learn to solve the original hard problem in a progressive and more effective manner. We demonstrate that compared with direct learning, CL facilitates controller training to achieve better performance. To study realistic scenarios where renewable forecasts used for decision-making are in general imperfect, the experiments compare the trained RL controllers against two model predictive controllers (MPCs) using renewable forecasts with different error levels and observe how these controllers can hedge against the uncertainty. Results show that RL controllers are less susceptible to forecast errors than the baseline MPCs and can provide a more reliable restoration process.

24 POWER TRANSMISSION AND DISTRIBUTION↗