Search NASA⌕ Search

Engineering topics

Shen, Chaopeng

Publications and source records attributed to Shen, Chaopeng.

At least 37 records · Page 2

Integrated parameter and process learning for hydrologic and biogeochemical modules in Earth System Models

Focus area: Primary focal area #2; secondary focal area #3: Learning about parameters and processes of land surface hydrologic and biogeochemical models in Earth System models by integrating machine learning, physics, and big data. Science challenges: How do we maximally leverage big-data observations to improve hydrobiogeochemical process description and parameterization so that such modules more realistically capture hydrologic and vegetation responses and feedbacks under the future climate? For example, how can we leverage physics, limited observations of vegetation and streamflow to better estimate evapotranspiration, and, relatedly, net primary productivity, especially for drought areas? Vegetation plays a critical role in regional and global water cycles; however, existing vegetation models have failed to predict vegetation response to droughts (McDowell & Xu, 2017) , arctic greening (Keenan & Riley, 2018) , and critical transitions between forest and savanna (Hirota et al., 2011) . These studies suggest that when we build process-based models (PBM) parameterized from regional and global plant traits, we tend to poorly describe plant adaptation and local-scale competition processes. The models and their associated parameters assigned for different regions in the world are not capturing essential heterogeneity in vegetation responses at finer spatial scales. Many parameters of the land surface models control hydrology and vegetation dynamics at the same time. The heterogeneity in vegetation response is a function of (i) plant type, (ii) plant size, (iii) competition and succession, (iv) environmental controls, and (v) local variations due to the unique ecological community that are very difficult to describe (e.g., the size of gaps resulting from fire that facilitated the coexistence of pioneering species). In the demographic models, only factors (i) and (iv) were captured, and plant types were generally described only by leaf phenology and climate zones. With current demographic models, we generally consider more traits to define plant types (i) and calibrate these traits to consider factors (ii), (iii) and (iv); however, it is substantially challenging to scale to regional and global simulations due to trait variations across space (Ali et al., 2016). Moreover, it has been noted that hillslope processes, including ridge-to-valley flow and sunny vs. shady slopes are primary organizers of water, energy, and vegetation (Clark et al., 2015; Fan et al., 2019) . Although gradual improvements in the hydrologic model component in earth system models may reduce this error (at a remarkably slow pace), the long-term, gradual impact of hydrology on plant traits are not well captured. Recent work showed that the hydrologic controls exerted by groundwater and lateral flow are primary regulators of rooting depth (Fan et al., 2017) . Such hydrologic controls have seldom been reflected in vegetation model parameterizations.

54 ENVIRONMENTAL SCIENCES↗

Evaluating the Potential and Challenges of an Uncertainty Quantification Method for Long Short–Term Memory Models for Soil Moisture Predictions

Recently, recurrent deep networks have shown promise to harness newly available satellite–sensed data for long–term soil moisture projections. However, to be useful in forecasting, deep networks must also provide uncertainty estimates. Here we evaluated Monte Carlo dropout with an input–dependent data noise term (MCD+N), an efficient uncertainty estimation framework originally developed in computer vision, for hydrologic time series predictions. MCD+N simultaneously estimates a heteroscedastic input–dependent data noise term (a trained error model attributable to observational noise) and a network weight uncertainty term (attributable to insufficiently constrained model parameters). Although MCD+N has appealing features, many heuristic approximations were employed during its derivation, and rigorous evaluations and evidence of its asserted capability to detect dissimilarity were lacking. To address this, we provided an in–depth evaluation of the scheme's potential and limitations. We showed that for reproducing soil moisture dynamics recorded by the Soil Moisture Active Passive (SMAP) mission, MCD+N indeed gave a good estimate of predictive error, provided that we tuned a hyperparameter and used a representative training data set. The input–dependent term responded strongly to observational noise, while the model term clearly acted as a detector for physiographic dissimilarity from the training data, behaving as intended. However, when the training and test data were characteristically different, the input–dependent term could be misled, undermining its reliability. Additionally, due to the data–driven nature of the model, data noise also influences network weight uncertainty, and therefore the two uncertainty terms are correlated. Altogether, this approach has promise, but care is needed to interpret the results.

54 ENVIRONMENTAL SCIENCES↗

Enhancing Streamflow Forecast and Extracting Insights Using Long-Short Term Memory Networks With Data Integration at Continental Scales

Recent observations with varied schedules and types (moving average, snapshot, or regularly spaced) can help to improve streamflow forecasts, but it is challenging to integrate them effectively. Based on a long short-term memory (LSTM) streamflow model, we tested multiple versions of a flexible procedure we call data integration (DI) to leverage recent discharge measurements to improve forecasts. DI accepts lagged inputs either directly or through a convolutional neural network unit. DI ubiquitously elevated streamflow forecast performance to unseen levels, reaching a record continental-scale median Nash-Sutcliffe Efficiency coefficient value of 0.86. Integrating moving-average discharge, discharge from the last few days, or even average discharge from the previous calendar month could all improve daily forecasts. Directly using lagged observations as inputs was comparable in performance to using the convolutional neural network unit. Importantly, we obtained valuable insights regarding hydrologic processes impacting LSTM and DI performance. Before applying DI, the base LSTM model worked well in mountainous or snow-dominated regions, but less well in regions with low discharge volumes (due to either low precipitation or high precipitation-energy synchronicity) and large interannual storage variability. DI was most beneficial in regions with high flow autocorrelation: it greatly reduced baseflow bias in groundwater-dominated western basins and also improved peak prediction for basins with dynamical surface water storage, such as the Prairie Potholes or Great Lakes regions. However, even DI cannot elevate performance in high-aridity basins with 1-day flash peaks. Despite this limitation, there is much promise for a deep-learning-based forecast paradigm due to its performance, automation, efficiency, and flexibility.

54 ENVIRONMENTAL SCIENCES↗

Near-Real-Time Forecast of Satellite-Based Soil Moisture Using Long Short-Term Memory with an Adaptive Data Integration Kernel

Nowcasts, or near-real-time (NRT) forecasts, of soil moisture based on the Soil Moisture Active and Passive (SMAP) mission could provide substantial value for a range of applications including hazards monitoring and agricultural planning. To provide such a NRT forecast with high fidelity, we enhanced a time series deep learning architecture, long short-term memory (LSTM), with a novel data integration (DI) kernel to assimilate the most recent SMAP observations as soon as they become available. The kernel is adaptive in that it can accommodate irregular observational schedules. Testing over the CONUS, this NRT forecast product showcases predictions with unprecedented accuracy when evaluated against subsequent SMAP retrievals. It showed smaller error than NRT forecasts reported in the literature, especially at longer forecast latency. The comparative advantage was due to LSTM’s structural improvements, as well as its ability to utilize more input variables and more training data. The DI-LSTM was compared to the original LSTM model that runs without data integration, referred to as the projection model here. We found that the DI procedure removed the autocorrelated effects of forcing errors and errors due to processes not represented in the inputs, for example, irrigation and floodplain/lake inundation, as well as mismatches due to unseen forcing conditions. The effects of this purely data-driven DI kernel are discussed for the first time in the geosciences. Furthermore, this work presents an upper-bound estimate for the random component of the SMAP retrieval error.

54 ENVIRONMENTAL SCIENCES↗

Final project report for DE-SC0010620: Scale-aware, improved hydrological and biogeochemical simulations of the Amazon under a changing climate

Shen was the PI for DOE project entitled Scale-Aware, Improved Hydrological and Biogeochemical Simulations of the Amazon Under a Changing Climate (contract DE-SC0010620; PI: Chaopeng Shen; co-PI, John Melack, William Riley, $976,000, 2013-2018). Under this project, the group has made substantial progress in (a) scientific advancement: (b) model and software engineering development; (c) aided parallel DoE project; (d) generating datasets; and (e) graduate and postdoc education that are useful global data fusion and model validation; and (f) participated and presented in several conferences. In summary, we have published 15 peer-reviewed papers (citations bolded below) and numerous conference presentations. One more paper is still under review. Our software progress has been shared with the wider community.

97 MATHEMATICS AND COMPUTING↗

Combining a land surface model with groundwater model calibration to assess the impacts of groundwater pumping in a mountainous desert basin

The quantification of recharge and trans-valley underflow is needed in arid regions to estimate the impacts of new water withdrawals on the water table. However, for mountainous desert areas, such estimates are highly challenging, due to data scarcity, heterogeneous soils, and long residence times. Conventional assessment employs isolated groundwater models configured with simplified uniform estimates of recharge. Here, we employed a data-constrained surface-subsurface process model to provide an ensemble of spatially distributed recharge and underflow estimates using perturbed parameters. Then, the Model-Independent Parameter Estimation and Uncertainty Quantification (PEST) package was used to calibrate the aquifer hydraulic conductivity field in MODFLOW for this ensemble and reject implausible recharge values. This novel dual-model approach, broadly applicable to mountainous arid regions, was designed to maximally exploit available data sources. It can assimilate groundwater head observations, reject unrealistic parameters, and narrow the range of estimated drawdowns due to pumping. We applied this approach to the Chuckwalla basin in California, USA to determine natural recharge. Simulated recharge concentrates along alluvial fans at the mountain fronts and ephemeral washes where run-off water infiltrates. If an evenly distributed recharge was employed as in conventional studies, it would result in regional biases in estimated drawdown and larger uncertainty bounds. Here, we also note that the speed of groundwater recovery does not guarantee sustainability: heavy pumping induces large hydraulic gradients that initially recover quickly when pumping is halted, but the system may not ultimately recover to pre-pumping levels.

54 ENVIRONMENTAL SCIENCES↗

Seasonal and Interannual Patterns and Controls of Hydrological Fluxes in an Amazon Floodplain Lake With a Surface-Subsurface Process Model

Floodplain lakes represent important aquatic ecosystems, and field-based estimates of their water budgets are difficult to obtain, especially over multiple years. We examine the hydrological fluxes for an Amazon floodplain lake connected to the Solimões River using a process-based hydrologic model. Water exchanges between the river and lake agree well with field estimates, including the timing of different hydrological phases. However, beyond available field data, modeling results show that the seven simulated years all differed from each other. These interannual differences were caused by the interplay between phases when water levels were rising with river-water flowing into the lake (RWRI), versus rising with lake-water flowing out to the river (RWLO). This exchange determines the river-water content in the lake ( C L ). Maximum C L occurred before river levels peaked because local catchment contributions can be sufficient to push lake-water out to the river, even as river levels rise. Numerical experiments show that the seasonal distribution of local rainfall, local catchment size, and interannual variability in both climate and river stage can contribute to differing dynamics of C L in a floodplain lake. Their impacts vary among phases: river-rise dominates the RWRI, whereas local hydrological processes dominate the RWLO and receding-water phases. Intermediate-to-long-term rainfall accumulation controls C L during the RWLO phase, whereas annual precipitation accumulation is important for C L during low water. Finally, our model generalizes beyond limited available field studies and offers potential to better understand floodplain lakes in other areas and how regional versus local changes in climate may affect their hydrological dynamics.

54 ENVIRONMENTAL SCIENCES↗

Hillslope Hydrology in Global Change Research and Earth System Modeling

Earth System Models (ESMs) are essential tools for understanding and predicting global change, but they cannot explicitly resolve hillslope-scale terrain structures that have been long recognized by hydrologists as the fundamental organizers of water, energy, and biogeochemical stores and fluxes. Here, we bring together hydrologists, Critical Zone scientists and ESM developers, to explore how hillslope structures may modulate ESM grid-level water, energy and biogeochemical fluxes. In contrast to the traditional one-dimensional (1D), vertical, 2-3m deep, and free-draining soil hydrology in current ESM land models, we argue that 3D, lateral ridge-to-valley flow through shallow and deep paths, and insolation contrasts between sunny and shady slopes, are the top two basic, long-acknowledged, and readily quantifiable organizers of water and energy (and hence vegetation) within an ESM grid cell. We argue that these two processes will be most consequential where (and when) water and/or energy are limiting. We further hypothesize that if they are implemented in ESM land models, they will increase continental water storage and residence time, buffering land ecosystems against seasonal and interannual droughts. We explore efficient ways to capture these mechanisms in ESMs and identify critical knowledge gaps preventing us from scaling up hillslope to global processes. One such gap is our extremely limited view of the subsurface, where water is stored to support vegetation and released to stream baseflow and aquatic ecosystems. We conclude with a call for global syntheses activities and model experiments to assess the impact of hillslope hydrology on global change predictions.

Fan, Ying↗

A Transdisciplinary Review of Deep Learning Research and Its Relevance for Water Resources Scientists

Deep learning (DL), a new generation of artificial neural network research, has transformed industries, daily lives, and various scientific disciplines in recent years. DL represents significant progress in the ability of neural networks to automatically engineer problem-relevant features and capture highly complex data distributions. I argue that DL can help address several major new and old challenges facing research in water sciences such as interdisciplinarity, data discoverability, hydrologic scaling, equifinality, and needs for parameter regionalization. This review paper is intended to provide water resources scientists and hydrologists in particular with a simple technical overview, transdisciplinary progress update, and a source of inspiration about the relevance of DL to water. The review reveals that various physical and geoscientific disciplines have utilized DL to address data challenges, improve efficiency, and gain scientific insights. DL is especially suited for information extraction from image-like data and sequential data. Techniques and experiences presented in other disciplines are of high relevance to water research. Meanwhile, less noticed is that DL may also serve as a scientific exploratory tool. A new area termed AI neuroscience , where scientists interpret the decision process of deep networks and derive insights, has been born. This budding subdiscipline has demonstrated methods including correlation-based analysis, inversion of network-extracted features, reduced-order approximations by interpretable models, and attribution of network decisions to inputs. Moreover, DL can also use data to condition neurons that mimic problem-specific fundamental organizing units, thus revealing emergent behaviors of these units. Vast opportunities exist for DL to propel advances in water sciences.

54 ENVIRONMENTAL SCIENCES↗

HESS Opinions: Incubating deep-learning-powered hydrologic science advances as a community

Recently, deep learning (DL) has emerged as a revolutionary and versatile tool transforming industry applications and generating new and improved capabilities for scientific discovery and model building. The adoption of DL in hydrology has so far been gradual, but the field is now ripe for breakthroughs. This paper suggests that DL-based methods can open up a complementary avenue toward knowledge discovery in hydrologic sciences. In the new avenue, machine-learning algorithms present competing hypotheses that are consistent with data. Interrogative methods are then invoked to interpret DL models for scientists to further evaluate. However, hydrology presents many challenges for DL methods, such as data limitations, heterogeneity and co-evolution, and the general inexperience of the hydrologic field with DL. The roadmap toward DL-powered scientific advances will require the coordinated effort from a large community involving scientists and citizens.Integrating process-based models with DL models will help alleviate data limitations. The sharing of data and baseline models will improve the efficiency of the community as a whole. Open competitions could serve as the organizing events to greatly propel growth and nurture data science education in hydrology, which demands a grassroots collaboration. The area of hydrologic DL presents numerous research opportunities that could, in turn,stimulate advances in machine learning as well.

58 GEOSCIENCES↗

Prolongation of SMAP to Spatiotemporally Seamless Coverage of Continental U.S. Using a Deep Learning Neural Network

The Soil Moisture Active Passive (SMAP) mission has delivered valuable sensing of surface soil moisture since 2015. However, it has a short time span and irregular revisit schedules. Utilizing a state-of-the-art time series deep learning neural network, Long Short-Term Memory (LSTM), we created a system that predicts SMAP level-3 moisture product with atmospheric forcings, model-simulated moisture, and static physiographic attributes as inputs. The system removes most of the bias with model simulations and improves predicted moisture climatology, achieving small test root-mean-square errors (<0.035) and high-correlation coefficients >0.87 for over 75% of Continental United States, including the forested southeast. As the first application of LSTM in hydrology, we show the proposed network avoids overfitting and is robust for both temporal and spatial extrapolation tests. LSTM generalizes well across regions with distinct climates and environmental settings. With high fidelity to SMAP, LSTM shows great potential for hindcasting, data assimilation, and weather forecasting.

54 ENVIRONMENTAL SCIENCES↗

The introspective may achieve more: Enhancing existing Geoscientific models with native-language emulated structural reflection

Geoscientific models manage myriad and increasingly complex data structures as trans -disciplinary models are integrated. They often incur significant redundancy with cross-cutting tasks. Reflection, the ability of a program to inspect and modify its structure and behavior at runtime, is known as a powerful tool to improve code reusability, abstraction, and separation of concerns. Reflection is rarely adopted in high-performance Geoscientific models, especially with Fortran, where it was previously deemed implausible. Practical constraints of language and legacy often limit us to feather-weight, native-language solutions. We demonstrate the usefulness of a structural-reflection-emulating, dynamically-linked metaObjects, gd . We show real-world examples including data structure self-assembly, effortless save/restart and upgrade to parallel I/O, recursive actions and batch operations. We share gd and a derived module that reproduces MATLAB-like structure in Fortran and C++. We suggest that both a gd representation and a Fortran-native representation are maintained to access the data, each for separate purposes. In conclusion, embracing emulated reflection allows generically-written codes that are highly re-usable across projects.

58 GEOSCIENCES↗

Full-flow-regime storage-streamflow correlation patterns provide insights into hydrologic functioning over the continental US

Interannual changes in low, median, and high regimes of streamflow have important implications for flood control, irrigation, and ecologic and human health. The Gravity Recovery and Climate Experiment (GRACE) satellites record global terrestrial water storage anomalies (TWSA), providing an opportunity to observe, interpret, and potentially utilize the complex relationships between storage and full-flow-regime streamflow. Here we show that utilizable storage-streamflow correlations exist throughout vastly different climates in the continental US (CONUS) across low- to high-flow regimes. A panoramic framework, the storage-streamflow correlation spectrum (SSCS), is proposed to examine macroscopic gradients in these relationships. SSCS helps form, corroborate or reject hypotheses about basin hydrologic behaviors. SSCS patterns vary greatly over CONUS with climate, land surface, and geologic conditions. Data mining analysis suggests that for catchments with hydrologic settings that favor storage over runoff, e.g., a large fraction of precipitation as snow, thick and highly-permeable permeable soil, SSCS values tend to be high. Based on our results, we form the hypotheses that groundwater flow dominates streamflows in South-eastern CONUS and Great Plains, while thin soils in a belt along the Appalachian Plateau impose a limit on water storage. SSCS also suggests shallow water table caused by high-bulk density soil and flat terrain induces rapid runoff in several regions. Our results highlight the importance of subsurface properties and groundwater flow in capturing flood and drought. Finally, we propose that SSCS can be used as a fundamental hydrologic signature to constrain models and to provide insights that lead us to better understand hydrologic functioning.

54 ENVIRONMENTAL SCIENCES↗

Assessing the nexus between groundwater and solar energy plants in a desert basin with a dual-model approach under uncertainty

Globally, many solar power plants and other types of renewable energy are being located in water-scarce regions. Many projects rely on groundwater resources whose sustainability is uncertain. In the Chuckwalla Basin in California, quantification of recharge and trans-valley underflow is needed to estimate the impacts of solar project withdrawals on the water table. However, such estimates are highly challenging due to data scarcity, heterogeneous soils and long residence times. Conventional assessment employs isolated groundwater models configured with crude and uniform estimates of recharge. Here, we employ a data-constrained surface subsurface processes model, PAWS+CLM, to provide an ensemble of recharges and underflows with perturbed parameters. Then, the Parameter Estimation (PEST) package is used to calibrate MODFLOW aquifer conductivity and filter out implausible recharges. The novel dual-model approach, potentially applicable in other arid regions, can effectively assimilate groundwater head observations, reject unrealistic parameters, and narrow the range of estimated drawdowns. Simulated recharge concentrates along alluvial fans at the mountain fronts and ephemeral washes where run-off water infiltrates. If an evenly distributed recharge was assumed, it resulted in under-estimated drawdown and larger uncertainty bounds. The withdrawals are approaching total inflow, suggesting the system will be nearing, if not exceeding, its sustainable groundwater production capacity, and a boom of such projects will not be sustainable. Especially, the cost/benefit of pumped-storage projects is called into question as the initial-fill phase depletes entire area’s recharge. Our study highlights the stress on groundwater resources of solar development, and that the speed of groundwater recovery does not indicate sustainability.

14 SOLAR ENERGY↗