Search NASA⌕ Search

SEARCH · Search NASA

Results for “deep data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

New Determination of Fundamental Properties of Palomar 5 Using Deep DESI Imaging Data

The legacy imaging surveys for the Dark Energy Spectroscopic Instrument project provides multiple-color photometric data, which are about 2 mag deeper than those from the SDSS. In this study, we redetermine the fundamental properties for an old halo globular cluster of Palomar 5 based on these new imaging data, including structure parameters, stellar population parameters, and luminosity and mass functions. These characteristics, together with its tidal tails, are key for dynamical studies of the cluster and constraining the mass model of the Milky Way. By fitting the King model to the radial surface density profile of Palomar 5, we derive the core radius of [[Formula]], tidal radius of [[Formula]], and concentration parameter of c = 0.78 ± 0.04. We apply a Bayesian analysis method to derive the stellar population properties and get an age of 11.508 ± 0.027 Gyr, metallicity of [Fe/H] = −1.798 ± 0.014, reddening of E(B − V) = 0.0552 ± 0.0005, and distance modulus of (m−M){sub 0} = 16.835±0.006. The main-sequence luminosity and mass functions for both the cluster center and tidal tails are investigated. The luminosity and mass functions at different distances from the cluster center suggest that there is obvious spatial mass segregation. Many faint low-mass stars have been evaporated at the cluster center, and the tidal tails are enhanced by low-mass stars. Both the concentration and relaxation times suggest that Palomar 5 is a totally relaxed system.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS2014

An Empirical Determination of the Intergalactic Background Light Using Near-Infrared Deep Galaxy Survey Data Out to 5 Micrometers and the Gamma-Ray Opacity of the Universe

We extend our previous model-independent determination of the intergalactic background light, based purely on galaxy survey data, out to a wavelength of 5 micrometers. Our approach enables us to constrain the range of photon densities, based on the uncertainties from observationally determined luminosity densities and colors. We further determine a 68% confidence upper and lower limit on the opacity of the universe to gamma-rays up to energies of 1.6/(1 + z) terraelectron volts. A comparison of our lower limit redshift-dependent opacity curves to the opacity limits derived from the results of both ground-based air Cerenkov telescope and Fermi-LAT observations of PKS 1424+240 allows us to place a new upper limit on the redshift of this source, independent of IBL modeling.

BL Lacertae↗
NASA NTRS1981

Telecommunications and data acquisition

Deep Space Network progress in flight project support, tracking and data acquisition research and technology, network engineering, hardware and software implementation, and operations is reported. In addition, developments in Earth based radio technology as applied to geodynamics, astrophysics, and the radio search for extraterrestrial intelligence are reported.

Renzetti, N. A.↗
DOE OSTI2023

Domain Adaptive Graph Neural Networks for Constraining Cosmological Parameters Across Multiple Data Sets

Deep learning models have been shown to outperform methods that rely on summary statistics, like the power spectrum, in extracting information from complex cosmological data sets. However, due to differences in the subgrid physics implementation and numerical approximations across different simulation suites, models trained on data from one cosmological simulation show a drop in performance when tested on another. Similarly, models trained on any of the simulations would also likely experience a drop in performance when applied to observational data. Training on data from two different suites of the CAMELS hydrodynamic cosmological simulations, we examine the generalization capabilities of Domain Adaptive Graph Neural Networks (DA-GNNs). By utilizing GNNs, we capitalize on their capacity to capture structured scale-free cosmological information from galaxy distributions. Moreover, by including unsupervised domain adaptation via Maximum Mean Discrepancy (MMD), we enable our models to extract domain-invariant features. We demonstrate that DA-GNN achieves higher accuracy and robustness on cross-dataset tasks. Using data visualizations, we show the effects of domain adaptation on proper latent space data alignment. This shows that DA-GNNs are a promising method for extracting domain-independent cosmological information, a vital step toward robust deep learning for real cosmic survey data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Domain Adaptive Graph Neural Networks for Constraining Cosmological Parameters Across Multiple Data Sets

Deep learning models have been shown to outperform methods that rely on summary statistics, like the power spectrum, in extracting information from complex cosmological data sets. However, due to differences in the subgrid physics implementation and numerical approximations across different simulation suites, models trained on data from one cosmological simulation show a drop in performance when tested on another. Similarly, models trained on any of the simulations would also likely experience a drop in performance when applied to observational data. Training on data from two different suites of the CAMELS hydrodynamic cosmological simulations, we examine the generalization capabilities of Domain Adaptive Graph Neural Networks (DA-GNNs). By utilizing GNNs, we capitalize on their capacity to capture structured scale-free cosmological information from galaxy distributions. Moreover, by including unsupervised domain adaptation via Maximum Mean Discrepancy (MMD), we enable our models to extract domain-invariant features. We demonstrate that DA-GNN achieves higher accuracy and robustness on cross-dataset tasks (up to $28\%$ better relative error and up to almost an order of magnitude better $\chi^2$). Using data visualizations, we show the effects of domain adaptation on proper latent space data alignment. This shows that DA-GNNs are a promising method for extracting domain-independent cosmological information, a vital step toward robust deep learning for real cosmic survey data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Deep Learning on Multimodal Chemical and Whole Slide Imaging Data for Predicting Prostate Cancer Directly from Tissue Images

Prostate cancer is one of the most common cancers globally and is the second most common cancer in the male population in the US. Here we develop a study based on correlating the hematoxylin and eosin (H&E)-stained biopsy data with MALDI mass-spectrometric imaging data of the corresponding tissue to determine the cancerous regions and their unique chemical signatures and variations of the predicted regions with original pathological annotations. We obtain features from high-resolution optical micrographs of whole slide H&E stained data through deep learning and spatially register them with mass spectrometry imaging (MSI) data to correlate the chemical signature with the tissue anatomy of the data. We then use the learned correlation to predict prostate cancer from observed H&E images using trained coregistered MSI data. This multimodal approach can predict cancerous regions with ~80% accuracy, which indicates a correlation between optical H&E features and chemical information found in MSI. Further, we show that such paired multimodal data can be used for training feature extraction networks on H&E data which bypasses the need to acquire expensive MSI data and eliminates the need for manual annotation saving valuable time. Two chemical biomarkers were also found to be predicting the ground truth cancerous regions. This study shows promise in generating improved patient treatment trajectories by predicting prostate cancer directly from readily available H&E-stained biopsy images aided by coregistered MSI data.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Accelerating Collective Communication in Data Parallel Training across Deep Learning Frameworks

This work develops new techniques within Horovod, a generic communication library supporting data parallel training across deep learning frameworks. In particular, we improve the Horovod control plane by implementing a new coordination scheme that takes advantage of the characteristics of the typical data parallel training paradigm, namely the repeated execution of collectives on the gradients of a fixed set of tensors. Using a caching strategy, we execute Horovod’s existing coordinator-worker logic only once during a typical training run, replacing it with a more efficient decentralized orchestration strategy using the cached data and a global intersection of a bitvector for the remaining training duration. Next, we introduce a feature for end users to explicitly group collective operations, enabling finer grained control over the communication buffer sizes. To evaluate our proposed strategies, we conduct experiments on a world-class supercomputer — Summit. We compare our proposals to Horovod’s original design and observe 2x performance improvement at a scale of 6000 GPUs; we also compare them against tf.distribute and torch.DDP and achieve 12% better and comparable performance, respectively, using up to 1536 GPUs; we compare our solution against BytePS in typical HPC settings and achieve about 20% better performance on a scale of 768 GPUs. Finally, we test our strategies on a scientific application (STEMDL) using up to 27,600 GPUs (the entire Summit) and show that we achieve a near-linear scaling of 0.93 with a sustained performance of 1.54 exaflops (with standard error +- 0.02) in FP16 precision.

Romero, Joshua↗
DOE OSTI2017

Deep Learning-Based Data Forgery Detection in Automatic Generation Control

Automatic Generation Control (AGC) is a key control system in the power grid. It is used to calculate the Area Control Error (ACE) based on frequency and tie-line power flow between balancing areas, and then adjust power generation to maintain the power system frequency in an acceptable range. However, attackers might inject malicious frequency or tie-line power flow measurements to mislead AGC to do false generation correction which will harm the power grid operation. Such attacks are hard to be detected since they do not violate physical power system models. In this work, we propose algorithms based on Neural Network and Fourier Transform to detect data forgery attacks in AGC. Different from the few previous work that rely on accurate load prediction to detect data forgery, our solution only uses the ACE data already available in existing AGC systems. In particular, our solution learns the normal patterns of ACE time series and detects abnormal patterns caused by artificial attacks. Evaluations on the real ACE dataset show that our methods have high detection accuracy.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

DLIO: A DATA-CENTRIC BENCHMARK FOR DEEP LEARNING APPLICATIONS

SF-22-136 Deep learning has been shown as a successful method for various tasks, and its popularity results in numerous open-source deep learning software tools. Deep learning has been applied to a broad spectrum of scientific domains such as cosmology, particle physics, computer vision, fusion, and astrophysics. Scientists have performed a great deal of work to optimize the computational performance of deep learning frameworks. However, the same cannot be said for I/O performance. As deep learning algorithms rely on big-data volume and variety to effectively train neural networks accurately, I/O is a significant bottleneck on large-scale distributed deep learning training. DLIO, is a novel representative benchmark suite built based on the I/O profiling of the selected workloads. DLIO can be utilized to accurately emulate the I/O behavior of modern deep learning applications. Using DLIO, application developers and system software solution architects can identify potential I/O bottlenecks in their applications and guide optimizations to boost the I/O performance leading to lower training times. The storage vendor can also use DLIO as a guide for designing and optimize the storage and filesystem targeting at deep learning application.

ZHENG, HUIHUO↗
NASA NTRS2022

Unique NISTAR-Based Climate GCM Diagnostics of the Earth’s Planetary Albedo and Spectral Absorption Through Longitudinal Data Slicing

Deep Space Climate Observatory (DSCOVR) measurements of Earth’s reflected solar and emitted thermal radiation permit a unique model/data comparison perspective that is not readily available from other satellite data. The key factor is the unique Lissajous orbital viewing geometry from the Lagrangian L1 point, which enables a continuous view of Earth’s sunlit hemisphere. The National Institute of Standards and Technology Advanced Radiometer (NISTAR) is the DSCOVR Mission energy budget instrument, which views the reflected and emitted radiation of the Earth’s sunlit hemisphere by means of single pixel active cavity full-spectrum (Band-A, 0.2–100 μm) and filtered solar wavelength (Band-B, 0.2–4.0 μm; and Band-C, 0.7–4.0 μm) radiometer measurements. An additional solar wavelength photodiode channel (0.3–1.1 μm) provides a calibration reference. The objective of this study is the assessment of climate GCM performance via direct model/data comparisons. Such comparisons are difficult due to quasi-chaotic natural variability present in real-world observational data and in climate GCM simulations. This is where the unique DSCOVR viewing geometry makes possible the longitudinal data slicing methodology for more direct model/data comparison. The key point of the longitudinal slicing approach is that data integration over the entire sunlit hemisphere eliminates the quasi-chaotic meteorological weather-scale noise, while preserving intra-seasonal and planetary-scale variability. The rotation of the Earth that retrieves this climate-style, large-scale longitudinal and seasonal variability. The hemispheric averaging is accomplished automatically in NISTAR measurements with its single-pixel view of the Earth. For climate GCMs, this requires implementing the Sunlit Hemisphere Sampling (SHS) scheme to operate on the GCM run-time output data, utilizing the DSCOVR Satellite Ephemeris data to assure precise viewing geometry between NISTAR measurements and GCM output data, while averaging out the meteorological weather noise. However, GCM generated data are radiative fluxes, while NISTAR (and EPIC) measurements are near-backscattered radiances. Conversing NISTSR measurements into radiative fluxes cannot be accomplished using NISTAR data alone, even with detailed support from conventional satellite data. But the identical viewing geometry of Earth’s sunlit hemisphere, and synergistic analyses of EPIC data make it feasible for this conversion of NISTAR near-backscatter radiances into radiative fluxes.

deep space climate observatory↗