Integrating Big Data for Applications in Machine Learning and Spatial Modeling to Forecast the Remaining Lifespan of Offshore Oil and Gas Infrastructure
Poster presented at AGU 2021 Fall Meeting, Virtual, December 13-17, 2021.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Poster presented at AGU 2021 Fall Meeting, Virtual, December 13-17, 2021.
Presentation for the Carbon Management Research Project Review Meeting, Pittsburgh, PA, August 28-September 1, 2023.
Our paper deals with extended-term energy storage (ES) arbitrage problems to maximize the annual revenue in deregulated power systems with high penetration wind power. The conventional ES arbitrage model takes the locational marginal prices (LMP) as an input and is unable to account for the impacts of ES operations on system LMPs. This paper proposes a bi-level ES arbitrage model, where the upper level maximizes the ES arbitrage revenue and the lower level simulates the market clearing process considering wind power and ES. The bi-level model is formulated as a mathematical program with equilibrium constraints (MPEC) and then recast into a mixed-integer linear programming (MILP) using strong duality theory. Wind power fluctuations are characterized by the GARCH forecast model and the forecast error is modeled by forecast-bin based Beta distributions. Case studies are performed on a modified PJM 5-bus system and an IEEE 118-bus system with a weekly time horizon over an annual term to show the validity of the proposed bi-level model. The results from the conventional model and the bi-level model are compared under different ES power and energy ratings, and also various load and wind penetration levels.
Solar forecasting has evolved towards becoming a key component of economical realization of high penetration levels of photovoltaic (PV) systems. This paper presents two novel stochastic forecasting models for solar PV by utilizing historical measurement data to outline a short-term high-resolution probabilistic behavior of solar. First, an uncertain basis functions method is used to forecast both solar radiation and PV power. Three possible distributions are considered for the uncertain basis functions - Gaussian, Laplace, and Uniform distributions. Second, stochastic state-space models are applied to characterize the behaviors of solar radiation and PV power output. A filter-based expectation-maximization and Kalman filtering mechanism is employed to recursively estimate the system parameters and state variables. This enables the system to accurately forecast small as well as large fluctuations of the solar signals. The introduced forecasting models are suitable for real-time tertiary dispatch controllers and optimal power controllers. The PV forecasting models are tested using solar radiation and PV power measurement data collected from a 13.5 kW PV panel installed on the rooftop of our laboratory. Furthermore, the results are compared with standard time series forecasting mechanisms and show a substantial improvement in the forecasting accuracy of the total energy produced.
The Wind Forecast Improvement Project 2 (WFIP2), in the complex terrain of the Columbia Gorge, focuses on a set of weather phenomena that poses particular challenges for wind and wind power forecasting. It further aims to understand and improve the skill of weather forecast models, particularly the National Oceanic and Atmospheric Administration's (NOAA's) High Resolution Rapid Refresh (HRRR), in complex terrain. The project also includes an extensive field campaign in the Columbia River Gorge, during which data from many different instruments were collected. WFIP2 is funded by the U.S. Department of Energy (DOE). Scientists from four U.S. national laboratories, NOAA, Vaisala, and universities contribute to the project with wide and varied interests and skill sets. Therefore, coordinated verification & validation (V&V) efforts across these members allows for the development of a clear picture of model improvements and scientific findings within WFIP2. The WFIP2 V&V team is tasked with providing tools, methods, and guidance to enable repeatable, metrics-based assessment of the Weather Research and Forecasting (WRF) model and associated modeling suites for analysis and forecasting of mesoscale weather phenomena that are important for wind energy in the Columbia River Gorge and other parts of the continental United States. This report summarizes what has been worked on and accomplished within the duration of the WFIP2 project, 4 years, by the V&V team.
Nuclear power plants collect and store large volumes of heterogeneous data from various components and systems. With recent advances in machine learning (ML) techniques, these data can be leveraged to develop diagnostic and short-term forecasting models to better predict future equipment condition. Maintenance operations can then be planned in advance whenever degraded performance is predicted, thus resulting in fewer unplanned outages and the optimization of maintenance activities. This enables lower maintenance costs and improves the overall economics of nuclear power. This report primarily focuses on developing a short-term forecasting process that leverages a feature selection process to distill large volumes of heterogeneous data and predict specific equipment parameters. A variety of feature selection methods, including Shapley Additive Explanations (SHAP) and variance inflation factor (VIF), were used to select the optimal features as inputs for three ML methods: long short-term memory (LSTM) networks, support vector regression (SVR), and random forest (RF). Each combination of model and input features was used to predict a pump bearing temperature both 1 and 24 hours in advance, based on actual plant system data. The optimal inputs for the LSTM and SVR were selected using the SHAP values, while the optimal input for the RF consisted solely of the response variable itself. Each model produced similar 1-hour-ahead predictions, with root mean square errors (RMSEs) of roughly 0.006. For the 24-hour-ahead predictions, differences could be seen between LSTM, SVR, and RF, as reflected by model performances of 0.036 ± 0.014, 0.0026 ± 0, and 0.063 ± 0.004 RMSE, respectively. As big data and continuous online monitoring become more widely available, the proposed feature selection process can be used for many applications beyond the prediction of process parameters within nuclear infrastructure. This report summarizes the Fiscal Year 2021 research progress encompassing the (1) data cleaning and feature selection necessary for ML applications; (2) development of short-term forecasting models to predict future plant process parameters for both single and multiple time steps ahead; and (3) validation of the feature selection methods and short-term forecasting models given new data from different systems.
This study presents enhancements of the Weather Research and Forecasting model with solar extensions (WRF-Solar) to provide probabilistic forecasts of solar radiation. Our approach builds ensemble WRF-Solar runs by introducing stochastic perturbations of variables that produce the largest uncertainties in predicting surface irradiance and clouds. The key variables are identified using tangent linear sensitivity analysis of six physics packages responsible for all-sky irradiance variability. An optimal strategy to stochastically perturb the selected variables is developed and applied to WRF-Solar to generate ensemble members for day-ahead solar prediction. The National Solar Radiation Database (NSRDB) is used to validate the ensemble forecast at arbitrary locations on the model grid. Preliminary results indicate that the proposed technique can potentially produce WRF-Solar ensembles providing reliable information of solar prediction uncertainty. This study describes the implemented methodology and initial results as well as future research to improve ensemble-based probabilistic forecasts with WRF-Solar.
Biomass burning (BB) aerosols can influence regional and global climate through interactions with radiation, clouds, and precipitation. Here, we investigate the impact of BB aerosols on the energy balance and hydrological cycle over the Amazon Basin during the dry season. We performed simulations with a fully coupled meteorology–chemistry model, the Weather Research and Forecasting model coupled with Chemistry (WRF-Chem), for a range of different BB emission scenarios to explore and characterize nonlinear effects and individual contributions from aerosol–radiation interactions (ARIs) and aerosol–cloud interactions (ACIs). The ARIs of BB aerosols tend to suppress low-level liquid clouds by local warming and increased evaporation and to facilitate the formation of high-level ice clouds by enhancing updrafts and condensation at high altitudes. In contrast, the ACIs of BB aerosol particles tend to enhance the formation and lifetime of low-level liquid clouds by providing more cloud condensation nuclei (CCN) and to suppress the formation of high-level ice clouds by reducing updrafts and condensable water vapor at high altitudes (>8 km). For scenarios representing the lower and upper limits of BB emission estimates for recent years (2002–2016), we obtained total regional BB aerosol radiative forcings of –0.2 and 1.5 W m –2 , respectively, showing that the influence of BB aerosols on the regional energy balance can range from modest cooling to strong warming. We find that ACIs dominate at low BB emission rates and low aerosol optical depth (AOD), leading to an increased cloud liquid water path (LWP) and negative radiative forcing, whereas ARIs dominate at high BB emission rates and high AOD, leading to a reduction of LWP and positive radiative forcing. In all scenarios, BB aerosols led to a decrease in the frequency of occurrence and rate of precipitation, caused primarily by ACI effects at low aerosol loading and by ARI effects at high aerosol loading. The dependence of precipitation reduction on BB aerosol loading is greater in a strong convective regime than under weakly convective conditions. Overall, our results show that ACIs tend to saturate at high aerosol loading, whereas the strength of ARIs continues to increase and plays a more important role in highly polluted episodes and regions. This should hold not only for BB aerosols over the Amazon, but also for other light-absorbing aerosols such as fossil fuel combustion aerosols in industrialized and densely populated areas. The importance of ARIs at high aerosol loading highlights the need for accurately characterizing aerosol optical properties in the investigation of aerosol effects on clouds, precipitation, and climate.
Effective flood simulation capabilities can tremendously support early warning and disaster prevention. To examine the applicability of a fully physics-based and high-performance flood simulation and forecasting modeling framework for a flood-prone region in Taiwan, we conduct a numerical experiment that couples the Weather Research and Forecasting (WRF) Model, WRF-Hydrological modeling system (WRF-Hydro), and the Two-Dimensional Runoff Inundation Toolkit for Operational Needs (TRITON) to perform integrated rainfall, streamflow, and flood simulations. Furthermore, we first use the coupled WRF and WRF-Hydro (WWH) to predict rainfall and streamflow and then drive TRITON with the predicted streamflow hydrographs to simulate flood depth and inundation area. With the refined spatial resolution and parameterization, this framework can better predict rainfall with reasonable spatial patterns. Although WWH could overestimate the amount of rainfall in some areas, the uncertain rainfall–streamflow predictions produce reasonable flood maps able to pinpoint regions at risk of flooding. In terms of model efficiency, the graphics processing unit–based computation can yield a speed-up factor as high as ∼13 compared to the central processing unit–based computation, promoting the efficacy of the coupled modeling framework in practical real-time flood forecasting.
Because of unique characteristics such as clean and cost-competitive electricity as well as fast-ramping and storage abilities, the power industry continues to evolve its operation strategies for cascading hydroelectric (CHE) systems for providing enhanced values to the grid, especially under the deeper renewable resource integration. However, existing operation practices of CHEs predate the integration of renewables, which could prohibit the effective utilization of their inherent flexibilities in delivering maximum financial benefits and providing valuable grid services to the power system and electricity market operations. Indeed, modeling and optimizing these resource-limited while flexible CHE assets with uncertainties and imperfect information across multiple spatial-temporal dimensions present significant challenges. To facilitate CHE facility operators in effectively coordinating water usage and hydropower plant operations across multiple timescales, this project aims to fill the existing gaps by developing a suite of accurate water inflow (WI) forecast models as well as enhanced CHE modeling and optimization approaches with proper consideration of their unique characteristics, which would help explore their multidimensional spatial-temporal operational flexibility potentials. The developed approaches could better align reservoir operation strategies with variability and uncertainty of future water availability. They can also promote more effective utilization of multidimensional spatial-temporal hydropower operational flexibility potentials by designing long-term evacuation plans of reservoirs and short-term operation of CHEs, along with their coordination with other types of renewables. The project leverages various resources to facilitate the research and development activities, including actual characteristics data of CHE systems and a library of current and future cases of Portland General Electric (PGE). These realistic data enable the project team to study how to maximize the value of CHEs under current and future portfolios and evaluate opportunities to improve operation practices.
Influenza infects an estimated 9–35 million individuals each year in the United States and is a contributing cause for between 12,000 and 56,000 deaths annually. Seasonal outbreaks of influenza are common in temperate regions of the world, with highest incidence typically occurring in colder and drier months of the year. Real-time forecasts of influenza transmission can inform public health response to outbreaks. We present the results of a multiinstitution collaborative effort to standardize the collection and evaluation of forecasting models for influenza in the United States for the 2010/2011 through 2016/2017 influenza seasons. For these seven seasons, we assembled weekly real-time forecasts of seven targets of public health interest from 22 different models. We compared forecast accuracy of each model relative to a historical baseline seasonal average. Across all regions of the United States, over half of the models showed consistently better performance than the historical baseline when forecasting incidence of influenza-like illness 1 wk, 2 wk, and 3 wk ahead of available data and when forecasting the timing and magnitude of the seasonal peak. In some regions, delays in data reporting were strongly and negatively associated with forecast accuracy. More timely reporting and an improved overall accessibility to novel and traditional data sources are needed to improve forecasting accuracy and its integration with real-time public health decision making.
Weather forecasting has been a critical component to predict and control building energy consumption for better building energy management. Without accessibility to other data sources, the onsite observed temperatures or the airport temperatures are used in forecast models. In this paper, we present a novel approach by utilizing the crowdsourcing weather data from neighboring personal weather stations (PWS) to improve the weather forecast accuracy around buildings using a general spatial-temporal modeling framework. The final forecast is based on the ensemble of local forecasts for the target location using neighboring PWSs. Our approach is distinguished from existing literature in various aspects. First, we leverage the crowdsourcing weather data from PWS in addition to public data sources. In this way, the data is at much finer time resolution (e.g., at 5-minute frequency) and spatial resolution (e.g., arbitrary location vs grid). Second, our proposed model incorporates spatial-temporal correlation information of weather variables between the target building and a set of neighboring PWSs so that underlying correlations can be effectively captured to improve forecasting performance. Here, we demonstrate the performance of the proposed framework by comparing to the benchmark models on temperature forecasting for a building located at an arbitrary location at San Antonio, Texas, USA. In general, the proposed model framework equipped with machine learning technique such as Random Forest can improve forecasting by 50% compares with persistent model and has 90% chance to outperform airport forecast in short-term forecasting. In a real-time setting, the proposed model framework can provide more accurate temperature forecasting results compared with using airport temperature forecast for most forecast horizon. Moreover, we analyze the sensitivity of model parameters to gain insights on how crowdsourcing data from the neighboring personal weather stations impacts forecasting performance. Finally, we implement our model in other cities such as Syracuse and Chicago to test the model's performance in different landforms and climate types.
This project explored the role of tropical oceans in regulating cloud populations within the Madden-Julian oscillation (MJO)–a large-scale tropical weather disturbance that influences extreme weather events across the globe by affecting the position of the jet stream and patterns of moisture transport. Our project sought to 1) document ocean feedback strength to the MJO in climate models, 2) understand how air-sea interactions affect the intensity, organization, and propagation of MJO convection, 3) utilize existing observations to identify sources of model bias for tropical air-sea interactions, and 4) better understand the effects of slow and fast ocean variability on MJO cloudiness. We found that transfers of heat and moisture across the air-sea interface (i.e., surface fluxes) in most climate models are over-supportive in maintaining MJO convection and under-supportive in propagating MJO convection. This can lead to misrepresentations in the frequency of extreme weather events across the globe through erroneous MJO feedbacks to jet stream position and moisture transport. Furthermore, using observations collected by ocean moorings across the tropical oceans, we showed that most models greatly overestimate surface evaporation in the subtropics, and that this bias is likely one contributor to a pervasive bias among climate models in their ability to simulate the mean state of rainfall over the tropical oceans (i.e., the “double ITCZ bias”). Replacing the default surface flux algorithm in two climate models with a state-of-the-art surface flux algorithm modestly reduced the double ITCZ bias in those models. Our work produced two model diagnostics packages that are now publicly available through DOE and NOAA model diagnostics archives. The first, the Analysis of Scales of Precipitation (ASoP) diagnoses scales of precipitation variability across space and time, with temporal resolution as fine as the model integration timestep. The second, the air-sea flux diagnostic diagnoses model surface fluxes and allows direct comparison of model fluxes to observations without having to recompute fluxes using model output and a state-of-the-art flux algorithm. These diagnostics, which were developed using climate models, can be readily applied to regional and global forecast model output to improve forecasts for the benefit of society.
This report provides a detailed description of a set of numerical simulations that represent reservoir behavior over time in response to different operational decision scenarios for detection of potential leakage and reduction or avoidance of leakage impact at a hypothetical geological carbon storage (GCS) site. These simulations serve as the basis for a series of GCS leakage risk forecasts that are to be developed using the National Risk Assessment Partnership’s Open-Source Integrated Assessment Model (NRAP-Open-IAM), and a demonstration of a simple decision support workflow for evaluation of mitigation strategies based on results of those system model forecasts. This risk assessment and decision support study is forthcoming. Four injection scenarios were considered: a constant rate carbon dioxide (CO 2 ) injection case (base case), a case with CO 2 injection rate adjustment, a case with early termination of injection operations, and a case with brine extraction. CO 2 injection operations were controlled to ensure that the pressure transient remains below the defined manageable reservoir fracture pressure, with consideration shown to hypothetical locations within the modeled spatial domain where the overburden was weaker and lower transient pressure increases were allowable. Additionally, a brine extraction alternative was considered as a reservoir management and risk mitigation option to reduce reservoir pressure, steer the plume away from any hypothetical geohazard such as fault as needed, and enhance storage capacity. Such operational actions contribute to risk management overtime. This study explores the potential utility of reservoir management for risk reduction at GCS sites. This study shows that the injection design may modify the time to CO 2 breakthrough at a legacy well; in particular, these results show that brine extraction can add value for mitigating risk both by delaying leakage and reducing pressure build-up. For the scenario considered, both pressure plots and pressure distributions demonstrate that pressure build-up was decreased by 3% with brine extraction. Additionally, extraction of brine afforded enhancement of CO 2 storage capacity by 5% compared to the base case. These findings suggest that brine extraction has substantial potential to steer the risk-related reservoir effects away from known geohazards (e.g., faults and legacy wells) by conducting pressure transient effects and CO 2 plume movement toward the production well. Injection rate adjustment scenarios considered in this study show potential value for managing both reservoir pressure transients and CO 2 plume behavior. Operational actions for reducing injection and/or early termination of injection (as compared to the base case), however, require careful design; tailoring both the extent and timing of injection rate adjustment over the injection and post-injection operational period must be thoroughly planned to balance maximizing storage and minimizing subsurface environmental risk. The study also gives preliminary consideration to the effectiveness that monitoring strategy may play in providing useful information to inform reservoir management decisions for risk reduction. Two types of monitoring were considered: 1) pressure build-up or pressure transient; and 2) potential leakage detection from a CO 2 mass or plume. Four hypothetical legacy wells, two plugged and two abandoned, were placed in the model domain. Monitoring along these wells was measured over time in individual stacked reservoir formations and shale formations to support risk mitigation decisions, especially operational decisions that assisted in risk reduction. These simulations will serve as the basis for a series of GCS leakage risk forecasts that are to be developed using NRAP’s Open-IAM, and demonstration of a simple decision support workflow for comparative assessment of mitigation alternatives based on results of those system model forecasts. This risk assessment and decision support study is forthcoming.
Abstract We examine links between tropical Pacific mean state biases and El Niño/Southern Oscillation forecast skill, using model‐analog hindcasts of sea surface temperature (SST; 1961–2015) and precipitation (1979–2015) at leads of 0–12 months, generated by 28 different models from the fifth phase of the Coupled Model Intercomparison Project (CMIP5). Model‐analog forecast skill has been demonstrated to match or even exceed traditional assimilation‐initialized forecast skill in a given model. Models with the most realistic mean states and interannual variability for SST, precipitation, and 10‐m zonal winds in the equatorial Pacific also generate the most skillful precipitation forecasts in the central equatorial Pacific and the best SST forecasts at 6‐month or longer leads. These results show direct links between model climatological biases and seasonal forecast errors, demonstrating that model‐analog hindcast skill—that is, how well a model can capture the observed evolution of tropical Pacific anomalies—is an informative El Niño/Southern Oscillation metric for climate simulations.
This study for the first time assesses the influence of employing solar reflective “cool” walls on the urban energy budget and summertime climate of the Los Angeles basin. Here, we systematically compare the effects of cool walls to cool roofs, a heat mitigation strategy that has been widely studied and employed, using a consistent modeling framework (the Weather Research and Forecasting model). Adoption of cool walls leads to increases in urban grid cell albedo that peak in the early morning and late afternoon, when the ratio of solar radiation onto vertical walls versus horizontal surfaces is at a maximum. In Los Angeles County, daily average increase in grid cell reflected solar radiation from increasing wall albedo by 0.80 is 9.1 W m –2 , 43% of that for increasing roof albedo. Cool walls reduce canyon air temperatures in Los Angeles by 0.43 K (daily average), with the peak reduction (0.64 K) occurring at 09:00 LST and a secondary peak (0.53 K) at 18:00 LST. Per 0.10 wall (roof) albedo increase, cool walls (roofs) can reduce summertime daily average canyon air temperature by 0.05 K (0.06 K). Results reported here can be used to inform policies on urban heat island mitigation or climate change adaptation.
Abstract The correct representation of low‐level midlatitude clouds found in the wake of cold fronts strongly relies on the representation of planetary boundary layer (PBL) and convection processes, which are typically parameterized separately in numerical models. Using the Weather Research and Forecasting Model (WRF), this study investigates how distinct pairs of PBL and convection parameterization schemes represent cloud fraction in the post cold frontal region. The simulations focus on the region of the Department of Energy Atmospheric Radiation Measurement (ARM) Eastern North Atlantic observation site in the Azores Islands in the wake of a cold front that passed on 25 December 2015. Different PBL and convection schemes are combined to create 12 distinct configurations. The main differences between the selected physical parameterizations are the strength of vertical mixing and the entrainment. The simulations produce a wide range of cloud fractions, where some configurations significantly underestimate while others clearly overestimate satellite and surface‐based estimates of cloud fraction. A skill score is used to quantitatively assess the performance of each configuration with respect to ground‐based radar data. The key processes that are found to significantly impact the cloud fraction distribution are the strength of the PBL decoupling, the vertical wind shear, entrainment and detrainment rates in shallow convection, and the occurrence of drizzle. This indicates that to successfully simulate post cold frontal clouds, modeled physics must balance strong internal vertical mixing and weak exchange with the free troposphere. For this case study, cloud fraction was more sensitive to the choice of convection scheme than PBL scheme.
The major goals of this project were: 1) to use field campaign measurements from DOE’s Atmospheric Radiation Measurement (ARM) program to characterize variability of important parameters describing properties of ice particles in the atmosphere; 2) based on this observational analysis, to develop a parameterization scheme for weather and climate models that stochastically varies these parameters, and implement the new scheme into a weather model called the Weather Research and Forecasting model (WRF); 3) to use WRF coupled with the new stochastic scheme to simulate ARM field campaign thunderstorm cases and analyze how accounting for this parameter variability affects the model simulations. This work was performed jointly between the National Center for Atmospheric Research, University of Oklahoma, and University of Utah. To accomplish these goals, we extended an approach previously developed to characterize the variability in the size distribution of ice particles to parameters that are explicitly represented in models (i.e., relationships between ice particle mass and size, and between particle fall velocity and size). Our project was, to our knowledge, the first to apply observationally-constrained estimates of this parameter variability describing mass-size and fall velocity-size in a modeling framework. Our results showed efficacy of the approach, evaluated using ARM observations. Similarly, to our knowledge, work in this project was the first to propose and evaluate in detail a stochastic approach for unresolved turbulent mixing in high-resolution model simulations against detailed, benchmark large eddy simulations and ARM observations. Results showed some promising behavior, particularly with increased mixing and dilution of air in thunderstorm cores with surrounding environmental air, bringing the stochastic simulations closer to the benchmark large eddy simulations; however, results were somewhat degraded using stochastic mixing compared to observations from the AMIE/DYNAMO field campaign. This project also further refined and applied a modeling methodology called “piggybacking” that can robustly separate dynamical and thermodynamic impacts of model changes, and comparison studies of different models based on cases developed from ARM observations. Finally, this project directly supported three graduate students who completed their PhDs as well as a postdoctoral research fellow.