Search NASA⌕ Search

Engineering topics

Hou, Zhangshuan

Publications and source records attributed to Hou, Zhangshuan.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

A novel construct for scaling groundwater–river interactions based on machine-guided hydromorphic classification

Hydrologic exchange between river channels and adjacent subsurface environments is a key process that influences water quality and ecosystem function in river corridors. Predictive numerical models are needed to understand responses of river corridors to environmental change and to support sustainable watershed management. We posit that systematic hydromorphic classification provides a scaling construct that facilitates extrapolation of outputs from local-scale mechanistic models to reduced-order models applicable at reach and watershed scales. This in turn offers the potential to improve large-scale predictions of river corridor hydrobiogeochemical processes. Here we present a new machine-guided hydromorphic classification methodology that addresses the key requirements of this objective, and we demonstrate its application to a segment of the Columbia River in the northwestern United States. The resulting hydromorphic classes form spatially coherent and physically interpretable hydromorphic units that exhibit distinct behaviors in terms of distributions of subsurface residence times (a primary control on critical biogeochemical reactions). This approach forms the basis of ongoing research that is evaluating the formulation of reduced-order models and transferability of results to other river reaches and larger scales.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Model, data, and code for paper "Modeling of streamflow in a 30-kilometer-long reach spanning 5 years using OpenFOAM 5.x"

The data package includes data, model, and code that support the analyses and conclusions in the paper titled “modeling of streamflow in a 30-kilometer-long reach spanning 5 years using OpenFOAM 5.x”. The primary goal of this paper is to demonstrate that key streamflow properties such as water depth, flow velocity, and dynamic pressure in a natural river at 30-kilometer scale over 5 years can be reliably and efficiently modeled using the computational framework presented in this paper. To support the paper, various data types from remote sensing, field observations, and computational models are used. Specific details are described as follows. Firstly, the river bathymetry data was obtained from a Light Detection and Ranging (LiDAR) survey. This data is then converted to a triangulated surface format, STL, for mesh generation in OpenFOAM. The STL data can be found in Model_Setups/BaseCase_2013To2015/constant/triSurface. The OpenFOAM mesh generated using this STL file can be found in constant/polyMesh. Other model setups, boundary and initial conditions can be found in /system and /0.org under folder BaseCase_2013To2015. A similar data structure can also be found in BaseCase_2018To2019 for the simulations during 2018 and 2019. Secondly, the OpenFOAM simulations need the upstream discharge and water depth information at the upstream boundary to drive the model. These data are generated from a one-dimensional hydraulic model and the data can be found under the folder Model_Setups /1D model Mass1 data. The mass1_65.csv and mass1_191.csv files include the results of the 1D model at the model inlet and outlet, respectively. The Matlab source code Mass1ToOFBC20182019.m is used to convert these data into OpenFOAM boundary condition setups.With the above OpenFOAM model, it can generate data for water surface elevation, flow velocity, and dynamic pressure. In this paper, the water surface elevation was measured at 7 locations during different periods between 2011 and 2019. The exact survey locations (see Fig1_SurveyLocations.txt) can be found in folder Fig_1. The variation of water stage over time at the 7 locations can be found in folder /Observation_WSE. The data type include .txt, .csv, .xlsx, and .mat. The .mat data can be loaded by Matlab.We also measured the flow velocities at 12 cross-sections along the river. At each cross-section, we recorded the x, y locations, depth, three velocity components u,v,w. These data are saved to a Matlab format which can be found under folder /Observation_Velocity and /Fig_1. The relative locations of velocity survey locations to the river bathymetry can be found in Figure 1c.The water stage data at the 7 locations from OpenFOAM, 1D, and 2D hydraulic models are also provided to evaluate the long-term performance of 3D models vs 1D/2D models. The water stage data for the 7 locations from OpenFOAM have been saved to .mat format and can be found in /OpenFOAM_WSE. The water stage data from the 1D model are saved in .csv format and can be found in /Mass1_WSE. The water stage from the 2D model is saved as .mat format and can be found in / Mass2_WSEIn addition, the OpenFOAM model outputs the information of hydrostatic and hydrodynamic pressure. They are saved as .mat format under folder /Fig_11/2013_1. As the files are too large, we only uploaded the data for January 2013. The area of different ratio of dynamic pressure to static pressure for all simulation range, i.e., 2013-2015, are saved to .mat format. They can be found in /Fig_11/PA. Further, the data of wall clock time versus the solution time of the OpenFOAM modeling are also saved to .mat format under folder /Fig_13/LogsMat. In summary, the data package contains seven data types, including .txt, .csv, .xlsx, .dat, .stl, .m, and .mat. The former 4 types can be directly open using a text editor or Microsoft Office. The .mat format needs to be read by Matlab. The Matlab source code .m files need to be run with Matlab. The OpenFOAM setups can be visualized in ParaView. The .stl file can be opened in ParaView or Blender. The data in subfolders Fig_1 to Fig_10 and Fig_12 are copied from the aforementioned data folders to generate specific figures for the paper. A readME.txt file is included in each subfolder to further describe how the data in each folder are generated and used to support the paper.Please use the data package's DOI to cite the data package. Please contact yunxiang.chen@pnnl.gov if you need more data related to the paper.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Improving Prediction of Surface Solar Irradiance Variability by Integrating Observed Cloud Characteristics and Machine Learning

A 5-year, 1-minute resolution observational dataset of clouds and solar radiation was produced that includes two metrics of the variability in surface solar irradiance due to cloud type and fractional sky cover. Multiple regression models were trained to fit observations of surface solar irradiance variability from those two cloud property predictors. We found that ensemble tree-based methods, Random Forest and Gradient Boosting Machine, have the least overfitting issues and showed the best performance with an R2 of 0.42. While the observational data trained in this study was only from one site, the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) site in Oklahoma, initial comparisons of the seasonality of the statistics suggest that these results are relatively weather regime independent; the generality of such a finding across sites will be tested in future work. The observational data and developed machine learning model are being used to create a numerical weather prediction model parameterization to enable day-ahead solar variability prediction in a computationally efficient way. This is a first step towards creating a new paradigm of predicting day-ahead variability with the potential to provide a new tool to improve grid operation, planning, and resilience.

Riihimaki, Laura↗
DOE OSTI2021

Deep Learning for Automated Detection and Identification of Migrating American Eel Anguilla rostrata from Imaging Sonar Data

Adult American eels (Anguilla rostrata) are vulnerable to hydropower turbine mortality during outmigration from growth habitat in inland waters to the ocean where they spawn. Imaging sonar is a reliable and proven technology for monitoring of fish passage and migration; however, there is no efficient automated method for eel detection. We designed a deep learning model for automated detection of adult American eels from sonar data. The method employs convolution neural network (CNN) to distinguish between 14 images of eels and non-eel objects. Prior to image classification with CNN, background subtraction and wavelet denoising were applied to enhance sonar images. The CNN model was first trained and tested on data obtained from a laboratory experiment, which yielded overall accuracies of >98% for image-based classification. Then, the model was trained and tested on field data that were obtained near the Iroquois Dam located on the St. Lawrence River; the accuracy achieved was commensurate with that of human experts.

13 HYDRO ENERGY↗
DOE OSTI2021

Transformative remedial action scheme tool (TRAST)

Techniques and apparatuses are described that enable transformative Remedial Action Scheme (RAS) analyses and methodologies for a bulk electric power system, including methods of designing, reviewing, revising, testing, implementing, verifying, or validating a RAS. An improved RAS improves operation of the power system, including performance, reliability, control, and asset utilization. The example methodologies discussed—also referred to as a transformative Remedial Action Scheme tool (TRAST)—provide an end-to-end solution for adaptively setting RAS parameters based on realistic and near real-time operation conditions to improve power grid reliability and grid asset utilization, by leveraging utility data analysis and employing dynamic simulations and machine learning to significantly simplify and shorten the entire RAS process.

Fan, Xiaoyuan↗
DOE OSTI2021

A Self-Evolution Data Fusion Platform for Large-Scale Water Models

Focal Area: Data acquisition and assimilation enabled by machine learning (ML), artificial intelligence (AI), and advanced methods including experimental/network design/optimization, unsupervised learning (deep learning), leveraging advanced hardware (e.g., edge computing). This development is to enable solving the science questions regarding the human and climatic factors that interact with and drive global water scarcity.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Develop a weather-aware climate model to understand and predict extremes and associated power outages and renewable energy shortages with uncertainty-aware and physics-informed machine learning

Focal Area(s): The focus area is predictive modeling through the use of AI techniques and AI-derived model components with a particular emphasis on extreme weather in Atmospheric Science and power outages and shortages in Energy Science. Science Challenge: Predicting weather extremes (e.g., heavy precipitation, strong wind, and large hailstones), and weather-related power system outages and shortages can mitigate economic losses, save lives, support renewables integration, and improve power system resiliency. However, currently, the poor reliability and large uncertainty associated with the weather extreme prediction in the current climate models make the problem intractable. The key challenges are: (1) physical factors like green-house gases (GHGs), aerosols, and land use and land cover (LULC) can significantly impact extreme storms, but the understanding of these impacts is limited, particularly globally; (2) the convective permitting resolutions needed to model severe convective storms and their impacts are computationally prohibitive with global climate models (GCMs); (3) interactions between weather extremes and power system outages are complex and subject to great uncertainty. Current outage prediction models are short lead (~ 3 days), which do not allow for long-time planning of energy production and distribution. Moreover, we have limited capacity to predict weather events leading to sustained shortages in a renewable-energy-dominated power system. These challenges drive motivation for mechanistic understanding and reliable and efficient predictive modeling of extremes and their impacts from the sub-seasonal to long term projections.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Machine Learning for a-posteriori model-observed data fusion to enhance predictive value of ESM output

The proposed research is consistent with focal areas 2 and 3: when successful, this effort will enhance the predictive value of Earth System Model (ESM) output by identifying and quantifying its systematic deviations from available observations and by correcting and recalibrating to existing data. The product is a hybrid process & data-driven modeling tool whose estimation can also bring insights through pattern discovery recognition on model deficiencies on the one hand and data gaps on the other.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Multi-scale Multi-physics Scientific Machine Learning for Water Cycle Extreme Events Identification, Labelling, Representation, and Characterization

Impacts of climate are usually felt through extreme events such as droughts, floods, thunderstorms, windstorms, wildfires, and so on, that are intimately tied to the water cycle. Predicting the frequency and severity of extreme events under climate change remains a significant challenge; meanwhile, the mechanisms and impacts of these extremes are far from well understood. There are several major science challenges: (1) Lack of labelled extreme events data and missing standards in defining extremes; (2) Computational demand of high-resolution ensemble climate modeling; (3) Modeling the multiscale multi-physics hierarchical structure of compound extremes; (4) Lack of understanding of mechanisms of extreme events; (5) Large uncertainty in extreme events impacts on infrastructure; (6) Subjective assessment of weather-related risk from seasonal to multi-decadal time scales and lack of metrics for risk assessment and mitigation control.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Machine Learning Analysis of Hydrologic Exchange Flows and Transit Time Distributions in a Large Regulated River

Hydrologic exchange between river channels and adjacent subsurface environments is a key process that influences water quality and ecosystem function in river corridors. High-resolution numerical models were often used to resolve the spatial and temporal variations of exchange flows, which are computationally expensive. In this study, we adopt Random Forest (RF) and Extreme Gradient Boosting (XGB) approaches for deriving reduced order models of hydrologic exchange flows and associated transit time distributions, with integrated field observations (e.g., bathymetry) and hydrodynamic simulation data (e.g., river velocity, depth). The setup allows an improved understanding of the influences of various physical, spatial, and temporal factors on the hydrologic exchange flows and transit times. The predictors also contain those derived using hybrid clustering, leveraging our previous work on river corridor system hydromorphic classification. The machine learning-based predictive models are developed and validated along the Columbia River Corridor, and the results show that the top parameters are the thickness of the top geological formation layer, the flow regime, river velocity, and river depth; the RF and XGB models can achieve 70% to 80% accuracy and therefore are effective alternatives to the computational demanding numerical models of exchange flows and transit time distributions. Each machine learning model with its favorable configuration and setup have been evaluated. The transferability of the models to other river reaches and larger scales, which mostly depends on data availability, is also discussed.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Scale-dependent spatial variabilities of hydrological exchange flows and transit time in a large regulated river

Hydrological exchange flows (HEF) across the river-aquifer interface and the associated residence time of river water in the aquifer have important implications for contaminant plume migration and biogeochemical processes in the river corridor. HEFs and residence time are influenced by both subsurface physical features and hydrologic forcing related to the transport process, which can exhibit complex spatial and temporal variations. In this study, we used a massively parallel subsurface flow model and a particle-tracking model to study the influences of different control factors on spatial variability of HEFs and residence time distributions (RTD) in the Hanford Reach of the Columbia River in Washington State. A total number of 100M particles were randomly injected in time and space and then tracked in a model domain that covers a 51-km 2 area (15.1M model cells). We used hourly river stages and groundwater levels to drive the model to provide dynamic velocity fields for the particle tracking in the simulation period that was longer than 2 years. The groundwater flow simulation and particle-tracking results provide the first comprehensive assessment of the spatial distribution of HEFs and residence time in large complex river corridors. Overall, our results show that the aquifer hydrogeological structure has the strongest correlation with the extent and magnitude of exchange flux. The residence time exhibits complex patterns that are impacted by all the river geomorphologic, hydrodynamic, and hydrogeologic factors and are strongly correlated with the downwelling ratio of exchange flux. The new insights gained through this study can be used to support the development of reduced-order models of HEFs and RTDs for large complex river systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Weather and Random Forest-based Load Profiling Approximation Models and its Transferability across Climate Zones

This study is to provide predictive understanding of the associations of various weather attributes with residential and commercial load profiles, for a variety of climate zones and seasons. In this work, machine learning (ML) approaches were used to identify and quantify the impacts of various weather attributes on residential and commercial electricity demand and its components across the western United States. Performance and transferability of the developed ML models were then evaluated across different temperate zones (e.g., southern, middle, and northern US) and across coastal, mid-continent, and wet zones, with inputs of weather condition data from the National Oceanic and Atmospheric Administration (NOAA) at representative weather stations. The predictive models were developed based on the ranked/screened factors using the regression tree (RT) and random forest (RF) approaches, for five different scenarios (seasons).

load composite, Random Forest, regression tree, lo↗
DOE OSTI2020

Spatiotemporal Pattern Recognition in the PMU Signals in the WECC system

Phasor measurement unit (PMU) data has been used by multiple power system applications, including state estimation, post event analysis, oscillation detection, model validation, and many others. Still, due to its big data nature and availability to general research institutions, comprehensive understanding of the spatiotemporal patterns and underlying mechanisms are incomplete. This study applies a set of signal processing and machine learning approaches aiming at deciphering the characteristic behaviors of multiple phasor measurement units (PMUs) attributes (e.g., voltage, frequency, rate of change of frequency, phase angle), including their auto-correlation, cross-dependence, similarities and discrepancies across units and temporal scales, and distributions of anomalies and their linkages to potential external factors such as weather events. Data analytics are applied to PMUs from the U.S. Western Electricity Coordinating Council (WECC) system. The PMU measurements, recorded events, outages, and weather extremes are all from real world datasets. The findings from the study and mechanistic understanding of the PMU dynamics help provide guidance on system control or preventing blackouts. The derived metrics can be directly used for adjusting or filtering simulated PMU data used for advanced algorithm development.

Hou, Zhangshuan↗
DOE OSTI2020

Probabilistic Forecasting of Generators Startups and Shutdowns in the MISO System Based on Random Forest

Solving security constrained unit commitment (SCUC) problems to plan an economical generation schedule for day-head electricity market has been an important research topic in recent years. Mixed integer programming method (MIP), the-state-of-art approach for solving SCUC problem, is known computationally hard when the number of binary status variables is large. In this paper, a machine learning-based algorithm - random forest (RF), was applied to forecast the startups (SU) and shutdowns (SD) hours of generators, based on historical hourly system condition observations in the Midcontinent Independent System Operator (MISO) system. The main purpose is to reduce the number of binary status variables, by fixing the SU/SD hours to a narrow range of high confidence. This would significantly reduce the size of the decision space, and therefore speed up SCUC solutions with reduced uncertainty.

Lin, Xinming↗
DOE OSTI2020

High-Performance Simulation of Dynamic Hydrologic Exchange and Implications for Surrogate Flow and Reactive Transport Modeling in a Large River Corridor

Hydrologic exchange flows (HEFs) have environmental significance in riverine ecosystems. Key river channel factors that influence the spatial and temporal variations of HEFs include river stage, riverbed morphology, and riverbed hydraulic conductivity. However, their impacts on HEFs were often evaluated independently or on small scales. In this study, we numerically evaluated the combined interactions of these factors on HEFs using a high-performance simulator, PFLOTRAN, for subsurface flow and transport. The model covers 51 square kilometers of a selected river corridor with large sinuosity along the Hanford Reach of the Columbia River in Washington, US. Three years of spatially distributed hourly river stages were applied to the riverbed. Compared to the simulation when riverbed heterogeneity is not ignored, the simulation using homogeneous riverbed conductivity underestimated HEFs, especially upwelling from lateral features, and overestimated the mean residence times derived from particle tracking. To derive a surrogate model for the river corridor, we amended the widely used transient storage model (TSM) for riverine solute study at reach scale with reactions. By treating the whole river corridor as a batch reactor, the temporal changes in the exchange rate coefficient for the TSM were derived from the dynamic residence time estimated from the hourly PFLOTRAN results. The TSM results were evaluated against the effective concentrations in the hyporheic zone calculated from the PFLOTRAN simulations. Our results show that there is potential to parameterize surrogate models such as TSM amended with biogeochemical reactions while incorporating small-scale process understandings and the signature of time-varying streamflow to advance the mechanistic understanding of river corridor processes at reach to watershed scales. However, the assumption of a well-mixed storage zone for TSM should be revisited when redox-sensitive reactions in the storage zones play important roles in river corridor functioning.

Fang, Yilin↗
DOE OSTI2020

Spatial Mapping of Riverbed Grain-Size Distribution Using Machine Learning

Recent alluvial sediments in riverbeds play a significant role in controlling hydrologic exchange flows (HEFs) in river systems. The alluvial layer is usually associated with strong heterogeneity in physical properties (e.g., permeability and hydraulic conductivity), which affects local HEFs and therefore biogeochemical processes. The spatial distribution of these physical properties needs to be determined to inform the numerical models used to reveal the realistic hydro-biogeochemical behaviors. Such information can be obtained based on the intrinsic link between sediment grain-size distribution and hydraulic properties where sediment texture information is available. However, grain-size measurements are usually spatially sparse and do not have adequate coverage and resolution, particularly for a relatively large domain such as the Hanford Reach of the Columbia River. In this paper, we adopted machine learning (ML) approaches for categorizing and mapping the spatial distributions of riverbed substrate grain size and filling in missing areas of substrate data using the ML models along the reach. Such ML models for substrate size mapping were trained at 13,372 locations using measured substrate sizes along with observed and simulated attributes, including bathymetric attributes (e.g., elevation, slope, and aspect ratio) from LIDAR and bathymetric surveys, and hydrodynamic properties (e.g., water depth, velocity, shear stress, and their statistical moments). An ensemble bagging-based ML technique, Random Forest, was adopted to identify the most influential factors as predictors to develop the predictive models with over-fitting issues addressed. The models were evaluated with respect to each individual substrate size class and the lumped group, and then used to generate the final substrate size maps covering all the grid cells in the numerical modeling domain.

54 ENVIRONMENTAL SCIENCES↗