Search NASA⌕ Search

SEARCH · Search NASA

Results for “deep data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

DEEP Solar: Data DrivEn Modeling and Analytics for Enhanced System Layer ImPlementation

Realizing the SETO 2030 mission of reducing solar energy costs to 3-5 c/kWh will require innovative enabling research on effective, cost-efficient integration of local PV within distribution systems. However, the intermittent and variable nature of PVs compels operators to impose conservative hosting capacity constraints. Given the extremely high variability of (intermittent and unpredictable) solar energy generation, relaxing the capacity constraints (which are currently around 15%) and achieving 100% or greater integration of renewables will require a fundamental transformation of the power grid via the utilization of exponentially larger amounts of AMI enabled fine-grained data. To address the challenges in increasing the penetration of renewable energy based DERs, this project envisions an Enhanced System Layer (ESL) at the distribution network level that is reliable, cost-effective and scalable to millions of Distributed Energy Resources (DERs)/devices. This includes developing: 1) Transformative and highly scalable machine learning based predictive analytics tools that plug into distribution system planning and provide real-time situational awareness at the distribution level for short and long-term operational planning. The tools will be built using novel data-driven energy models of millions of active nodes with AMI, 2) Adaptive stochastic analysis and optimization algorithms for real-time grid operations, 3) Dynamic Scenario Analysis using parallel Cloudenabled implementations with < 1 minute computational cycle times.

14 SOLAR ENERGY↗
DOE OSTI2022

Using Deep Mutational Data and Machine Learning to Guide Outbreak and Pandemic Response

A significant fraction of pathogens known to infect humans originate in non-human (zoonotic) hosts (Taylor, Latham, and Woolhouse 2001), and new and emerging pathogens continue to spill over into the human population more frequently at an alarming rate (e.g., SARS, MERS, Cholera, etc.). The recent outbreaks of Ebola virus in West Africa and the ongoing SARS-CoV-2 pandemic demonstrate the need for rapid and reliable assessments of viral phenotype information to help inform scientists and policy makers how best to control the spread of disease. Further understanding of the virus pathogenic evolutionary space and potential trajectory could guide appropriate control measures to limit the spread of a new virus throughout the local and global human population.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2017

Characterization and Modeling of Contamination for Lyman Break Galaxy Samples at High Redshift

The selection of high-redshift sources from broadband photometry using the Lyman-break galaxy (LBG) technique is a well established methodology, but the characterization of its contamination for the faintest sources is still incomplete. We use the optical and near-IR data from four (ultra)deep Hubble Space Telescope legacy fields to investigate the contamination fraction of LBG samples at z∼5--8 selected using a color–color method. Our approach is based on characterizing the number count distribution of interloper sources, that is, galaxies with colors similar to those of LBGs, but showing detection at wavelengths shorter than the spectral break. Without sufficient sensitivity at bluer wavelengths, a subset of interlopers may not be properly classified, and contaminate the LBG selection. The surface density of interlopers in the sky gets steeper with increasing redshift of LBG selections. Since the intrinsic number of dropouts decreases significantly with increasing redshift, this implies increasing contamination from misclassified interlopers with increasing redshift, primarily by intermediate redshift sources with unremarkable properties (intermediate ages, lack of ongoing star formation and low/moderate dust content). Using Monte-Carlo simulations, we estimate that the CANDELS deep data have contamination induced by photometric scatter increasing from ∼2% at z∼5 to ∼6% at z∼8 for a typical dropout color ⩾1 mag, with contamination naturally decreasing for a more stringent dropout selection. Contaminants are expected to be located preferentially near the detection limit of surveys, ranging from 0.1 to 0.4 contaminants per arcmin{sup 2} at J{sub 125} = 30, depending on the field considered. This analysis suggests that the impact of contamination in future studies of z>10 galaxies needs to be carefully considered.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Quasar UV Luminosity Function at 3.5 < z < 5.0 from SDSS Deep Imaging Data

We present a well-designed sample of more than 1000 type 1 quasars at 3.5 < z < 5 and derive UV quasar luminosity functions (QLFs) in this redshift range. These quasars were selected using the Sloan Digital Sky Survey (SDSS) imaging data in the Stripe 82 and overlap regions with repeat imaging observations that are about 1 mag fainter than the SDSS single-epoch data. The follow-up spectroscopic observations were conducted by the SDSS-III Baryon Oscillation Spectroscopic Survey (BOSS) as one of the BOSS ancillary programs. Reaching i ~ 21.5 mag, our sample bridges previous samples from brighter and deeper surveys. We use a 1/V a method to derive binned QLFs at 3.6 < z < 4.0, 4.0 < z < 4.5, and 4.5 < z < 4.9 and then use a double power-law model to parameterize the QLFs. We also combine our data with literature QLFs to better constrain the QLFs across a much wider luminosity baseline. The faint- and bright-end slopes of the QLFs in this redshift range are around –1.7 and –3.7, respectively, with uncertainties from 0.2 to 0.3 to >0.5. The evolution of the QLFs from z ~ 5 to 3.5 can be described by a pure density evolution model (∝10 kz ) with a parameter k similar to that at 5 < z < 7, suggesting a nearly uniform evolution of the quasar density at z = 3.5–7.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRSDate not supplied

Pushing the Limits of Aquatic Remote Sensing: Synthetic Data and Deep Learning for Fast Inverse Emulation of A Coupled Ocean-Atmosphere Radiative Transfer Model

The inversion of electromagnetic information to physical and biological properties of the water column is a notoriously difficult problem, yet fundamental to our ability of understanding aquatic processes on large time and space scales. There is now a growing necessity to develop pragmatic approaches that allow timely and effective extrapolation of local processes, to spatially resolved global products, and to promote operational and sustainable resource policy management. This presentation will discuss research integrating advanced biological and radiative modeling, high-end computation, and machine learning to develop a portable global processor for simultaneous retrieval of atmosphere and water optics for diverse aquatic systems from the open and coastal ocean to optically extreme inland waters and harmful algal blooms. We will discuss some of the basic concepts behind the forward modeling approach including DEAP, the novel Distributed Equivalent Algal Populations model, for developing large spectral libraries of aquatic particle optics to aid in our ability to distinguish phytoplankton functional types (PFTs) and inorganic material, as well as other factors which enable comprehensive modeling from the benthos to top-of-atmosphere (TOA). This information is being used to understand how we can leverage next-generation deep learning methods for maximum information retrieval and rapid image processing, while also providing capabilities to identify minimum sensor spectral requirements necessary for certain aquatic applications. Further, I will touch on how we envision this research to enable the aquatic community for science discovery and how we are moving closer towards the capability for high-fidelity global analysis of aquatic ecosystems.

Jeremy Alan Kravitz↗
DOE OSTI2020

DeepFreeze: Towards Scalable Asynchronous Checkpointing of Deep Learning Models

In the age of big data, deep learning has emerged as a powerful tool to extract insight and exploit its value, both in industry and scientific applications. One common pattern emerging in such applications is frequent checkpointing of the state of the learning model during training, needed in a variety of scenarios: analysis of intermediate states to explain features and correlations with training data, exploration strategies involving alternative models that share a common ancestor, knowledge transfer, resilience, etc. However, with increasing size of the learning models and popularity of distributed data-parallel training approaches, simple checkpointing techniques used so far face several limitations: low serialization performance, blocking I/O, stragglers due to the fact that only a single process is involved in checkpointing. This paper proposes a checkpointing technique specifically designed to address the aforementioned limitations, introducing efficient asynchronous techniques to hide the overhead of serialization and I/O, and distribute the load over all participating processes. Experiments with two deep learning applications (CANDLE and ResNet) on a pre-Exascale HPC platform (Theta) shows significant improvement over state-of-art, both in terms of checkpointing duration and runtime overhead.

checkpointing↗
NASA NTRS2023

Do Citizen Science Intense Observation Periods Increase Data Usability? A Deep Dive of the NASA GLOBE Clouds Data Set With Satellite Comparisons

The Global Learning and Observations to Benefit the Environment (GLOBE) citizen science program has recently conducted a series of month-long intensive observation periods (IOPs), asking the public to submit daily reports on cloud and sky conditions from all regions of Earth. This provides a wealth of crowdsourced observations from the ground, which complements other conventional scientific cloud data. In addition, the GLOBE reports are matched in space and time with geostationary and low Earth orbit satellites, which allows for a straightforward comparison of cloud properties, and minimizes the biases associated with mismatched sampling between participants and satellites. The matched GLOBE dataset is used to calculate the mean observed cloud cover by atmospheric level both worldwide and by region. The overall magnitudes of cloud cover between the GLOBE participants and the matched satellites agree within 10%, which is notable given the distinctly different natures of the data sources. The mean vertical cloud profiles show GLOBE reporting more low-level clouds and fewer high-level clouds than satellites. The low cloud disagreement is likely related to satellites missing low clouds when high clouds block their view. Conversely, the high cloud disagreement is related primarily to cloud opacity, as satellites may miss some optically thin clouds. Monte Carlo testing shows the results to be robust, and the tripled amount of IOP data reduces uncertainty by half. These findings also highlight ways in which citizen science IOP data may be used to support scientific research while accounting for their unique properties. Plain Language Summary: Citizen science is becoming an increasingly prominent aspect of scientific research, and so it important to study how citizen science data can be used effectively. For example, The GLOBE Program has recently conducted a series of special data-collecting events, or “challenges”, which gathered large numbers of reports on cloud and sky conditions. Because NASA GLOBE Clouds matches the participant reports with cloud observations from satellites, we can use these data to get a combined view of clouds from above and below. When looking at the average cloud cover for different atmospheric levels across Earth, we find that the GLOBE participants and the satellites agree quite closely. This is a surprising and fascinating find, given how different in nature volunteer ground reports are to satellite measurements. However, there are some small but notable disagreements between GLOBE participants and satellites about the distribution of cloud cover at different levels. In addition, by testing the data for uncertainty, we show that the results from the GLOBE data are reliable, and that more public participation improves the reliability. So, by carefully designing the analysis methodology, and by testing for the uncertainty of the data, citizen science can make a meaningful contribution to scientific research.

J. Brant Dodson↗
DOE OSTI2024

Extraction of the neutron F 2 structure function from inclusive proton and deuteron deep-inelastic scattering data

The available world deep-inelastic scattering (DIS) data on proton and deuteron structure functions F 2 p , F 2 d , and their ratios are leveraged to extract the free neutron F 2 n structure function, the F 2 n / F 2 p ratio, and associated uncertainties using the latest nuclear effect calculations in the deuteron. Special attention is devoted to the normalization of the proton and deuteron experimental datasets and to the treatment of correlated systematic errors, as well as the quantification of procedural and theoretical uncertainties. The extracted F 2 n dataset is utilized to evaluate the Q 2 dependence of the Gottfried sum rule and the nonsinglet F 2 p − F 2 n moments. To facilitate replication of our study, as well as for general applications, we provide a comprehensive DIS database including all recent Jefferson Lab 6 GeV measurements, the extracted F n 2 , a modified CTEQ-JLab global parton distribution function fit named CJ15nlo_mod, and grids with calculated proton, neutron, and deuteron DIS structure functions. Published by the American Physical Society 2024

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

The VST ATLAS quasar survey I: Catalogue of photometrically selected quasar candidates

We present the VST ATLAS Quasar Survey, consisting of ~1229 000 quasar (QSO) candidates with 16 < g < 22.5 over ~4700 deg 2 . The catalogue is based on VST ATLAS+NEOWISE imaging surveys and aims to reach a QSO sky density of 130 deg –2 for $z$ < 2.2 and ~30 deg –2 for $z$ > 2.2. To guide our selection, we use X-ray/UV/optical/MIR data in the extended William Herschel Deep Field (WHDF) where we find a g < 22.5 broad-line QSO density of 269 ± 67 deg –2 , roughly consistent with the expected ~196 deg –2 . We find that ~25 per cent of our QSOs are morphologically classed as optically extended. Overall, we find that in these deep data, MIR, UV, and X-ray selections are ~70–90 per cent complete while X-ray suffers less contamination than MIR and UV. MIR is however more sensitive than X-ray or UV to $z$ > 2.2 QSOs at g < 22.5 and the S X (0.5 – 10 keV) > 1 X 10 -14 ergs cm –2 s –1 limit of eROSITA. We adjust the selection criteria from our previous 2QDES pilot survey and prioritize VST ATLAS candidates that show both UV and MIR excess, also selecting candidates initially classified as extended. We test our selections using data from DESI (which will be released in DR1) and 2dF to estimate the efficiency and completeness, and we use ANNz2 to determine photometric redshifts. Applying over the ~4700 deg 2 ATLAS area gives us ~ 917 000 $z$ < 2.2 QSO candidates of which 472 000 are likely to be $z$ < 2.2 QSOs, implying a sky density of ~100 deg –2 , which our WHDF analysis suggests will rise to at least 130 deg –2 when eROSITA X-ray candidates are included. At $z$ > 2.2, we find ~310() 000 candidates, of which 169 000 are likely to be QSOs for a sky density of ~36 deg –2 .

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2016

On the Performance of Adaptive Data Rate over Deep Space Ka-Bank Link: Case Study Using Kepler Data

Future missions envisioned for both human and robotic exploration demand increasing communication capacity through the use of Ka-band communications. The Ka-band channel, being more sensitive to weather impairments, presents a unique trade-offs between data storage, latency, data volume and reliability. While there are many possible techniques for optimizing Ka-band operations such as adaptive modulation and coding and site-diversity, this study focus exclusively on the use of adaptive data rate (ADR) to achieve significant improvement in the data volume-availability tradeoff over a wide range of link distances for near Earth and Mars exploration. Four years of Kepler Ka-band downlink symbol signal-to-noise (SNR) data reported by the Deep Space Network were utilized to characterize the Ka-band channel statistics at each site and conduct various what-if performance analysis for different link distances. We model a notional closed-loop adaptive data rate system in which an algorithm predicts the channel condition two-way light time (TWLT) into the future using symbol SNR reported in near-real time by the ground receiver and determines the best data rate to use. Fixed and adaptive margins were used to mitigate errors in channel prediction. The performance of this closed-loop adaptive data rate approach is quantified in terms of data volume and availability and compared to the actual mission configuration and a hypothetical, optimized single rate configuration assuming full a priori channel knowledge.

Gao, Jay L.↗