Search NASA⌕ Search

SEARCH · Search NASA

Results for “deep data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

A MULTIBAND STUDY OF THE GALAXY POPULATIONS OF THE FIRST FOUR SUNYAEV-ZEL'DOVICH EFFECT SELECTED GALAXY CLUSTERS

We present first results of an examination of the optical properties of the galaxy populations in Sunyaev-Zel'dovich Effect (SZE) selected galaxy clusters. Using clusters selected by the South Pole Telescope survey and deep multiband optical data from the Blanco Cosmology Survey, we measure the radial profile, the luminosity function (LF), the blue fraction, and the halo occupation number (HON) of the galaxy populations of these four clusters with redshifts ranging from 0.3 to 1. Our goal is to understand whether there are differences among the galaxy populations of these SZE-selected clusters and previously studied clusters selected in the optical and the X-ray. The radial distributions of galaxies in the four systems are consistent with Navarro-Frenk-White profiles with a galaxy concentration of 3 to 6. We show that the characteristic luminosities in griz bands are consistent with passively evolving populations emerging from a single burst at redshift z = 3. The faint-end power-law slope of the LF is found to be on average {alpha} {approx} -1.2 in griz. HONs (to m* + 2) for these systems appear to be consistent with those based on X-ray-selected clusters. The blue fraction estimated to 0.36 L*, for the three lower redshift systems, suggests an increase with redshift, although with the current sample the uncertainties are still large. Overall, this pilot study of the first four clusters provides no evidence that the galaxy populations in these systems differ significantly from those in previously studied cluster populations selected in the X-ray or the optical.

79 ASTRONOMY AND ASTROPHYSICS↗

Deep CFHT Y-band Imaging of VVDS-F22 Field. II. Quasar Selection and Quasar Luminosity Function

We report the results of a faint quasar survey in a one-square-degree field. The aim is to test the Y−K/g−z and J−K/i−Y color selection criteria for quasars at faint magnitudes to obtain a complete sample of quasars based on deep optical and near-infrared color–color selection and to measure the faint end of the quasar luminosity function (QLF) over a wide redshift range. We carried out a quasar survey based on the Y−K/g−z and J−K/i−Y quasar selection criteria, using the deep Y-band data obtained from our CFHT/WIRCam Y-band images in a two-degree field within the F22 field of the VIMOS VLT deep survey, optical co-added data from Sloan Digital Sky Survey Stripe 82 and deep near-infrared data from the UKIDSS Deep Extragalactic Survey in the same field. We discovered 25 new quasars at 0.5 2.5.

79 ASTRONOMY AND ASTROPHYSICS↗

Deep Learning-based Parameterization of Complex 3D CO2 Saturation Data in Large-scale Geological Carbon Storage

In deep learning (DL), dimension reduction plays a pivotal role in improving training efficiency and minimizing overfitting, especially when working with complex datasets like three-dimensional (3D) saturation data. In the context of geological carbon storage (GCS), 3D saturation data introduces unique challenges due to its sparse nature and sharp transitions at plume boundaries, known as shock fronts. To tackle these challenges, we developed a novel DL framework that combines dimension reduction with advanced 3D reconstruction techniques. Our approach utilizes latent variables derived from 2D average saturation fields to efficiently capture the essential features of high-dimensional data while reducing the number of variables. This enhances both the robustness and accuracy of DL models, making the framework more practical for real-world applications. By offering a tailored solution for modeling complex 3D saturation dynamics, this framework holds significant potential for environmental monitoring, energy storage, and other geological applications.

Wang, Hongsheng [University of Texas at Austin]↗

Deep structural clustering for single-cell RNA-seq data jointly through autoencoder and graph neural network

Abstract Single-cell RNA sequencing (scRNA-seq) permits researchers to study the complex mechanisms of cell heterogeneity and diversity. Unsupervised clustering is of central importance for the analysis of the scRNA-seq data, as it can be used to identify putative cell types. However, due to noise impacts, high dimensionality and pervasive dropout events, clustering analysis of scRNA-seq data remains a computational challenge. Here, we propose a new deep structural clustering method for scRNA-seq data, named scDSC, which integrate the structural information into deep clustering of single cells. The proposed scDSC consists of a Zero-Inflated Negative Binomial (ZINB) model-based autoencoder, a graph neural network (GNN) module and a mutual-supervised module. To learn the data representation from the sparse and zero-inflated scRNA-seq data, we add a ZINB model to the basic autoencoder. The GNN module is introduced to capture the structural information among cells. By joining the ZINB-based autoencoder with the GNN module, the model transfers the data representation learned by autoencoder to the corresponding GNN layer. Furthermore, we adopt a mutual supervised strategy to unify these two different deep neural architectures and to guide the clustering task. Extensive experimental results on six real scRNA-seq datasets demonstrate that scDSC outperforms state-of-the-art methods in terms of clustering accuracy and scalability. Our method scDSC is implemented in Python using the Pytorch machine-learning library, and it is freely available at https://github.com/DHUDBlab/scDSC.

Gan, Yanglan↗

Data-Driven Day-Ahead PV Estimation Using Hybrid Deep Learning

Ongoing smart grid activities and associated automation resulted in rich set of data. Here, these data can be utilized for monitoring and estimation of real time photovoltaic (PV) generation. Inherent variability in PV and related impact on power systems is a challenging problem. Improving the accuracy of PV generation estimation is beneficial for both the PV owners and the grid operators. Recently, deep learning algorithms possible by the availability of data have shown its advantages for time series estimation; however, its application on PV generation estimation is still in the early stage. In this paper, a hybrid estimation model with a combination of long-short-term-memory network (LSTM) and persistence model (PM) is developed to provide day-ahead PV estimation at 15-minute time interval with high accuracy and robustness. Simulation results show the superior performance of the proposed method over existing methods for most of the test cases.

24 POWER TRANSMISSION AND DISTRIBUTION↗

THE WYOMING SURVEY FOR H{alpha}. III. A MULTI-WAVELENGTH LOOK AT ATTENUATION BY DUST IN GALAXIES OUT TO z {approx} 0.4

We report results from the Wyoming Survey for H{alpha} (WySH), a comprehensive four-square degree survey to probe the evolution of star-forming galaxies over the latter half of the age of the universe. We have supplemented the H{alpha} data from WySH with infrared data from the Spitzer Wide-area Infrared Extragalactic Survey and ultraviolet data from the Galaxy Evolution Explorer Deep Imaging Survey. This data set provides a multi-wavelength look at the evolution of the attenuation by dust, and here we compare a traditional measure of dust attenuation (L(TIR)/L(FUV)) to a diagnostic based on a recently developed robust star formation rate (SFR) indicator, [Ha{sub obs}+24{mu}m]/Ha{sub obs}. With such data over multiple epochs, the evolution in the attenuation by dust with redshift can be assessed. We present results from the ELAIS-N1 and Lockman Hole regions at z {approx} 0.16, 0.24, 0.32, and 0.40. While the ensemble averages of both diagnostics are relatively constant from epoch to epoch, each epoch individually exhibits a larger attenuation by dust for higher SFRs. Hence, an epoch-to-epoch comparison at a fixed SFR suggests a mild decrease in dust attenuation with redshift.

79 ASTRONOMY AND ASTROPHYSICS↗

Hawthorne Nevada Deep Direct-Use Feasibility Study - Data Used for Geothermal Resource Conceptual Modeling and Power Capacity Estimates

This data submission includes several data components that were used to develop a conceptual model and power capacity-estimates of two low-temperature geothermal resources that define geothermal prospect A at Hawthorne, Nevada. Data are sourced from a combination of legacy publicly-available data and more recent data acquisition conducted by the US Navy Geothermal Program Office (2008-2013) and the Great Basin Center for Geothermal Energy at the University of Nevada, Reno (2008-2010). Data sets include compiled fluid geochemistry data, down-hole temperature logs for wells in the vicinity of prospect A, 2 meter temperature survey data, temperature-spinner logs acquired in well HWAAD-2A, fracture picks from image log data acquired in wells HWAAD-2 and HWAAD-3, and X-Ray Diffraction (XRD) analyses on cuttings from wells HWAAD-2A and HWAAD-3. These data have been reviewed for errors and inconsistencies, but it is possible that few errors could still remain. The resource conceptual model and power capacity estimates are included in the final report to the US Department of Energy, and are presented in a manuscript by Ayling and Hinz. A link to the manuscript published in Geothermics is linked below in this submission.

15 GEOTHERMAL ENERGY↗

Deep Learning categorization of infrasound array data

An analyst review created a labelled catalog of pseudo-ground truth data with almost 9,000 examples spanning four categories: transient signals, persistent signals, signals from moving sources, and noise.

42 ENGINEERING↗

Deep learning to estimate permeability using geophysical data

Time-lapse electrical resistivity tomography (ERT) is a popular geophysical method to estimate three-dimensional (3D) permeability fields from electrical potential difference measurements. Traditional inversion and data assimilation methods are used to ingest this ERT data into hydrogeophysical models to estimate permeability. Due to ill-posedness and the curse of dimensionality, existing inversion strategies provide poor estimates and low resolution of the 3D permeability field. Recent advances in deep learning provide us with powerful algorithms to overcome this challenge. This paper presents a deep learning (DL) framework to estimate the 3D subsurface permeability from time-lapse ERT data. To test the feasibility of the proposed framework, we train DL-enabled inverse models on simulation data. Each measurement in both synthetic and field data is standardized by removing the mean and scaling the time-series to unit variance. This pre-processing step is necessary to bring simulation data closer to field observations. Subsurface process models based on hydrogeophysics are used to generate this synthetic data. Training performed on limited simulation data resulted in the DL model over-fitting. An advanced data augmentation based on mixup is implemented to generate additional training samples to overcome this issue. This mixup technique creates weakly labeled (low-fidelity) samples from strongly labeled (high-fidelity) data. The weakly labeled training data is then used to develop DL-enabled inverse models and reduce over-fitting. As both time-lapse ERT (1133048 features/realization) and 3D permeability (585453 features/realization) data samples are from a high-dimensional space, principal component analysis (PCA) is employed to reduce dimensionality. Encoded ERT and encoded permeability are generated using the trained PCA estimators. A deep neural network is then trained to map the encoded ERT to encoded permeability. This mixup training and unsupervised learning allowed us to build a fast and reasonably accurate DL-based inverse model under limited simulation data. Results show that proposed weak supervised learning can capture salient spatial features in the 3D permeability field. Quantitatively, the average mean squared error (in terms of the natural log) on the strongly labeled training, validation, and test datasets is less than 0.5. The R 2 -score (global metric) is greater than 0.75, and the percent error in each cell (local metric) is less than 10%. Finally, an added benefit in terms of computational cost is that the proposed DL-based inverse model is at least O(10 4 ) times faster than running a forward model once it is trained. Data generation, DL model training, and hyperparameter tuning to identify optimal neural network architectures utilized high-performance computing resources while the DL inference is performed on a standard laptop. Approximately, O(10 5 ) processor hours are used for generating data and DL tuning and training. We acknowledge that the data generation and DL model development are expensive. But once a DL model is trained, it can be re-used for inversion rapidly for the given system, with set physics and domain. Note that traditional inversion may require multiple forward model simulations (e.g., in the order of 10 to 1000), which are very expensive. This computational savings ≈ O(10 5 ) – O(10 7 )) makes the proposed DL-based inverse model attractive for subsurface imaging and real-time ERT monitoring applications due to fast and yet reasonably accurate estimations of permeability field.

58 GEOSCIENCES↗

Learning dynamical systems from data: An introduction to physics-guided deep learning

Modeling complex physical dynamics is a fundamental task in science and engineering. Traditional physics-based models are first-principled, explainable, and sample-efficient. However, they often rely on strong modeling assumptions and expensive numerical integration, requiring significant computational resources and domain expertise. While deep learning (DL) provides efficient alternatives for modeling complex dynamics, they require a large amount of labeled training data. Furthermore, its predictions may disobey the governing physical laws and are difficult to interpret. Physics-guided DL aims to integrate first-principled physical knowledge into data-driven methods. It has the best of both worlds and is well equipped to better solve scientific problems. Recently, this field has gained great progress and has drawn considerable interest across discipline Here, we introduce the framework of physics-guided DL with a special emphasis on learning dynamical systems. We describe the learning pipeline and categorize state-of-the-art methods under this framework. We also offer our perspectives on the open challenges and emerging opportunities.

97 MATHEMATICS AND COMPUTING↗

Data and scripts associated with the manuscript "Encoding Diel Hysteresis and the Birch Effect in Dryland Soil Respiration Models through Knowledge-Guided Deep Learning"

This package contains the data and scripts used in "Encoding Diel Hysteresis and the Birch Effect in Dryland Soil Respiration Models through Knowledge-Guided Deep Learning" (Jiang et al., 2022). The data.zip file contains the flux tower and automated chamber observations used for developing the deep learning model for modeling soil respiration. The scripts.zip file contains the Jupyter notebooks and python scripts for preprocessing the data, training the deep learning models, and postprocessing the results. The src.zip contains the source code for training the deep learning model, performing mutual information analysis, and plotting functions. The trained_models.zip contains multiple folders used for hosting the trained deep-learning models and the associated soil respiration predictions. The whole process is performed using python. We include the REAMD.md to document the python package requirements.Soil respiration in dryland ecosystems is challenging to model due to its complex interactions with environmental drivers. Knowledge-guided deep learning provides a much more effective means of accurately representing these complex interactions than traditional Q10-based models. Mutual information analysis revealed that future soil temperature shares more information with soil respiration than past soil temperature, consistent with their clockwise diel hysteresis. We explicitly encoded diel hysteresis, soil drying, and soil rewetting effects on soil respiration dynamics in a newly designed Long Short Term Memory (LSTM) model. The model takes both past and future environmental drivers as inputs to predict soil respiration. The new LSTM model substantially outperformed three Q10-based models and the Community Land Model when reproducing the observed soil respiration dynamics in a semi-arid ecosystem. The new LSTM model clearly demonstrated its superiority for temporally extrapolating soil respiration dynamics, such that the resulting correlation with observational data is up to 0.7 while the correlations of both Q10-based models and the Community Land Model (CLM) are less than 0.4. Our results underscore the high potential for knowledge-guided deep learning to replace Q10-based soil respiration modules in Earth system models.

54 ENVIRONMENTAL SCIENCES↗

An investigation on machine learning predictive accuracy improvement and uncertainty reduction using VAE-based data augmentation

The confluence of ultrafast computers with large memory, rapid progress in Machine Learning (ML) algorithms, and the availability of large datasets place multiple engineering fields at the threshold of dramatic progress. However, a unique challenge in nuclear engineering is data scarcity because experimentation on nuclear systems is usually more expensive and time-consuming than most other disciplines. One potential way to resolve the data scarcity issue is deep generative learning, which uses certain ML models to learn the underlying distribution of existing data and generate synthetic samples that resemble the real data. In this way, one can significantly expand the dataset to train more accurate predictive ML models. In this study, our objective is to evaluate the effectiveness of data augmentation using variational autoencoder (VAE)-based deep generative models. We investigated whether the data augmentation leads to improved accuracy in the predictions of a deep neural network (DNN) model trained using the augmented data. Additionally, the DNN prediction uncertainties are quantified using Bayesian Neural Networks (BNN) and conformal prediction (CP) to assess the impact on predictive uncertainty reduction. To test the proposed methodology, we used TRACE simulations of steady-state void fraction data based on the NUPEC Boiling Water Reactor Full-size Fine-mesh Bundle Test (BFBT) benchmark. Here, we found that augmenting the training dataset using VAEs has improved the DNN model’s predictive accuracy, improved the prediction confidence intervals, and reduced the prediction uncertainties.

Bayesian neural network↗

Sensitive Detection of Structural Differences using a Statistical Framework for Comparative Crystallography

Chemical and conformational changes underlie the functional cycles of proteins. Comparative crystallography can reveal these changes over time, over ligands, and over chemical and physical perturbations in atomic detail. A key difficulty, however, is that the resulting observations must be placed on the same scale by correcting for experimental factors. We recently introduced a Bayesian framework for correcting (scaling) X-ray diffraction data by combining deep learning with statistical priors informed by crystallographic theory. To scale comparative crystallography data, we here combine this framework with a multivariate statistical theory of comparative crystallography. By doing so, we find strong improvements in the detection of protein dynamics, element-specific anomalous signal, and the binding of drug fragments.

Hekstra, Doeke R. [Harvard Univ., Cambridge, MA (U↗