Search NASA⌕ Search

SEARCH · Search NASA

Results for “deep generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Pushing the Limits of Aquatic Remote Sensing: Synthetic Data and Deep Learning for Fast Inverse Emulation of A Coupled Ocean-Atmosphere Radiative Transfer Model

The inversion of electromagnetic information to physical and biological properties of the water column is a notoriously difficult problem, yet fundamental to our ability of understanding aquatic processes on large time and space scales. There is now a growing necessity to develop pragmatic approaches that allow timely and effective extrapolation of local processes, to spatially resolved global products, and to promote operational and sustainable resource policy management. This presentation will discuss research integrating advanced biological and radiative modeling, high-end computation, and machine learning to develop a portable global processor for simultaneous retrieval of atmosphere and water optics for diverse aquatic systems from the open and coastal ocean to optically extreme inland waters and harmful algal blooms. We will discuss some of the basic concepts behind the forward modeling approach including DEAP, the novel Distributed Equivalent Algal Populations model, for developing large spectral libraries of aquatic particle optics to aid in our ability to distinguish phytoplankton functional types (PFTs) and inorganic material, as well as other factors which enable comprehensive modeling from the benthos to top-of-atmosphere (TOA). This information is being used to understand how we can leverage next-generation deep learning methods for maximum information retrieval and rapid image processing, while also providing capabilities to identify minimum sensor spectral requirements necessary for certain aquatic applications. Further, I will touch on how we envision this research to enable the aquatic community for science discovery and how we are moving closer towards the capability for high-fidelity global analysis of aquatic ecosystems.

Jeremy Alan Kravitz↗

Technical note: Deep learning for creating surrogate models of precipitation in Earth system models

Abstract. We investigate techniques for using deep neural networks to produce surrogatemodels for short-term climate forecasts. A convolutional neural network istrained on 97 years of monthly precipitation output from the 1pctCO2 run (theCO 2 concentration increases by 1 % per year) simulated by the second-generation Canadian Earth System Model (CanESM2). The neural network clearly outperforms a persistence forecast anddoes not show substantially degraded performance even when the forecast lengthis extended to 120 months. The model is prone to underpredicting precipitationin areas characterized by intense precipitation events. Scheduled sampling(forcing the model to gradually use its own past predictions rather than groundtruth) is essential for avoiding amplification of early forecasting errors.However, the use of scheduled sampling also necessitates preforecasting(generating forecasts prior to the first forecast date) to obtain adequateperformance for the first few prediction time steps. We document the trainingprocedures and hyperparameter optimization process for researchers who wish toextend the use of neural networks in developing surrogate models.

54 ENVIRONMENTAL SCIENCES↗

Model Intercomparison of the Impacts of Varying Cloud Droplet–Nucleating Aerosols on the Life Cycle and Microphysics of Isolated Deep Convection

The microphysical impacts of aerosol particles on scattered isolated deep convective cells near Houston, Texas, on 19 June 2013, are examined using multiple cloud-resolving model (CRM) simulations initialized with vertical profiles of low and high concentrations of cloud droplet–nucleating aerosols. These simulations formed part of the Model Intercomparison Project (MIP) conducted by the Deep Convective Working Group of the Aerosol, Cloud, Precipitation and Climate (ACPC) initiative. Each CRM generated a field of convective cells representing those observed during the case study with varying degrees of accuracy. The Tracking and Object-Based Analysis of Clouds (tobac) cell-tracking algorithm was applied to each MIP CRM simulation to track relatively long-lived convective cells (20–60 min). Most of the CRMs produced similar aerosol loading impacts on the warm phase of tracked cell properties with reduced autoconversion and accretion growth of rain, increased cloud water, reduced rainfall, and reduced near-surface evaporation of rain. The sign of aerosol impacts on the warm-phase properties of the convective cells was also quite consistent over cell lifetimes with the greatest magnitude of influence in the first half of the life cycle in most CRMs. In contrast, the ice-phase response to aerosol loading was highly variable among CRMs and included increases or decreases in ice amounts at inconsistent stages of the cell life cycle and midlevel versus upper-level changes in ice. This intermodel variability in ice is indicative both of the complex indirect interactions between aerosols and ice-phase processes in deep convection and their associated parameterizations.

Aerosol-cloud interaction↗

Investigations on Repository Near-Field Thermal Modeling - Repository Science/Thermal Load Management & Design Concepts (M41UF033302)

The various layers of material from the waste package (such as components of the engineered barrier system and the host rock surface) to a given distance within the rock wall at a given distance can be described as concentric circles with varying thermal properties (see Figure 5.1-1). The selected model approach examines the contributions of the waste package, axial waste package neighbors and lateral neighboring emplacement drifts (see Section 5.2.1 and Appendix H, Section 2). In clay and deep borehole media, the peak temperature is driven by the central waste package whereas, in granite and salt, the contribution to the temperature rise by adjacent (lateral) waste packages in drift or emplacement borehole lines is dominant at the time of the peak temperature. Mathematical models generated using Mathcad software provide insight into the effects of changing waste package spacing for six waste forms, namely UOX, MOX, co-extraction, new extraction, E-Chem ceramic and E-Chem metal in four different geologic media (granite, clay, salt and deep borehole). Each scenario includes thermal conductivity and diffusivity for each layer between the waste package and the host rock, dimensions of representative repository designs (such as waste package spacing, drift or emplacement borehole spacing, waste package dimensions and layer thickness), and decay heat curves generated from knowledge of the contents of a given waste form after 10, 50, 100 and 200 years of surface storage. Key results generated for each scenario include rock temperature at a given time calculated at a given radius from the central waste package (Section 5.2.1 and Appendix H, Section 3), the corresponding temperature at the interface of the waste package and EBS material, and at each EBS layer in between (Section 5.2.2 and Appendix H, Section 4). This information is vital to understand the implications of repository design (waste package capacity, surface storage time, waste package spacing, and emplacement drift or borehole spacing) by comparing the peak temperature to the thermal limits of the concentric layers surrounding the waste package; specifically 100 C for the bentonite buffer in granite and clay repositories, 100 C for rock wall in a clay repository and 200 C at the rock wall for a salt repository. These thermal limits are both preliminary and approximate, and serve as a means to evaluate design options rather than determining compliance for licensing situations. The thermal behavior of a salt repository is more difficult to model because it is not a concentric geometry and because the crushed salt backfill initially has a much higher thermal resistance than intact salt. Three models were investigated, namely a waste package in complete contact with crushed salt, secondly a waste package in contact with intact salt, and thirdly a waste package in contact with 75% intact and 25% crushed salt. The latter model best depicts emplacement of a waste package in the corner of an intact salt alcove and subsequently covered with crushed salt backfill to the angle of repose. The most conservative model (crushed salt) had temperatures much higher than the other models and although bounding, is too conservative to use. The most realistic model (75/25) had only a small temperature difference from the simplest (non-conservative, intact salt) model, and is the one chosen in this report (see Section 5.2.3). A trade-study investigating three key variables (surface storage time, waste package capacity and waste package spacing) is important to understand and design a repository. Waste package heat can be reduced by storing for longer periods prior to emplacement, or by reducing the number of assemblies or canisters within that waste package. Waste package spacing can be altered to optimize the thermal load without exceeding the thermal limits of the host rock or EBS components. By examining each of these variables, repository footprint (and therefore cost) can be optimized. For this report, the layout was fixed for each geologic medium based on prior published designs in the international community, but it will be varied in future work. Section 5.2.4 summarizes the conclusions based on varying two of the three parameters (storage time and waste package capacity), and the results are shown in Appendix H, Sections 5 and 6.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Enhancing Convection Parameterization for Next Generation E3SM (Final Technical Report)

This technical report summarizes the achievements during the project period. The general goal of the project is to enhance the representation of atmospheric deep convection in the DOE global climate model E3SM. By implementing a stochastic convection scheme into E3SM, we improved the simulation of precipitation intensity and frequency. As a result, it has a profound impact on the simulation of other fields in the model, including aerosol scavenging by precipitation and aerosol radiative effects. We also implemented a convective cloud microphysics scheme into E3SMv2 to represent more accurately the interaction between convection and grid-scale clouds. An extensive analysis of model simulations as part of the Next Generation Development (NGD) convection scheme assessment project found that including the convective microphysics scheme improved the simulation of Madden-Julian oscillations (MJO) in the model. To make convective parameterization schemes more scale-aware as the GCM resolution increases, we analyzed the output from cloud-resolving model (CRM) simulations of both organized and unorganized convection by coarse-graining the CRM data to different GCM resolutions. Using a novel approach to modify the convective closure, we demonstrated that the convection scheme used in E3SM (ZM scheme) can be made scale-aware.

54 ENVIRONMENTAL SCIENCES↗

Entanglement engineering of optomechanical systems by reinforcement learning

Entanglement is fundamental to quantum information science and technology, yet controlling and manipulating entanglement—so-called entanglement engineering—for arbitrary quantum systems remains a formidable challenge. There are two difficulties: the fragility of quantum entanglement and its experimental characterization. We develop a model-free deep reinforcement-learning (RL) approach to entanglement engineering, in which feedback control together with weak continuous measurement and partial state observation is exploited to generate and maintain desired entanglement. We employ quantum optomechanical systems with linear or nonlinear photon–phonon interactions to demonstrate the workings of our machine-learning-based entanglement engineering protocol. In particular, the RL agent sequentially interacts with one or multiple parallel quantum optomechanical environments, collects trajectories, and updates the policy to maximize the accumulated reward to create and stabilize quantum entanglement over an arbitrary amount of time. The machine-learning-based model-free control principle is applicable to the entanglement engineering of experimental quantum systems in general.

97 MATHEMATICS AND COMPUTING↗

Understanding Relationships Between Satellite, Model, and Ground-Based Surface Temperature Characterizations From Overcast to Clear Conditions in Support of Satellite Remote Sensing of Clouds and Radiation

Accurate and consistent global estimates of cloud coverage and their properties are fundamental to long-term Earth radiation budget (ERB) monitoring efforts like the Clouds and the Earth’s Radiant Energy System (CERES) project. Cloud detection algorithms often apply thresholding approaches to identify where clouds occur by comparing satellite-measured radiances with those that are expected under cloud-free conditions. In addition, once a cloud is detected, the derivation of cloud optical and microphysical properties also requires knowledge of the background radiances below the cloud. In the infrared, knowledge of the surface emissivity and the expected skin temperature under both cloudy and cloud-free conditions is needed. These traits are generally well known over the oceans. Over land, however, comparisons between satellite-derived land surface temperature (LST) with that characterized in numerical weather analyses reveal large differences in many parts of the world, often exceeding 5 K, which can lead to significant satellite cloud detection and cloud property retrieval errors. Furthermore, clouds have a dramatic influence on the LST, and therefore characterization of that model parameter also depends on the capability of the model to accurately resolve clouds. Thus, the LST characterized in models is, at times, a poor approximation for what would otherwise be observed, thereby impeding accurate satellite cloud retrievals. As a result, we seek to develop a more robust method for estimating the LST required for satellite cloud characterizations. This effort is accomplished through a combination of surface emission/air temperature relationship studies in all-sky conditions using ground measurement stations, along with deep neural network (DNN) estimates of expected LST under overcast and cloud-free conditions. We demonstrate that substituting DNN-predicted LST for that generated by numerical models can mitigate model-inherent diurnal dependencies and reduce overall bias and uncertainty relative to satellite/ground observations by 0.5–4 K and 0.5–2 K, respectively. It is expected that this work will lead to improved satellite cloud retrievals that enhance ERB monitoring efforts.

B Scarino↗

hippynn Python Package

hippynn is a python package for defining, training, and applying neural networks to atomistic systems. In particular, it focuses on Hierarchical Interacting Particle Neural Networks (HIP-NNs), a deep learning architecture for atomistic systems. HIP-NNs take input data describing the properties of atomistic systems (often generated using ab-initio quantum mechanics) to learn fast and accurate models. A trained HIP-NN can predict potential energy surfaces, atomic charges, and more. hippynn uses PyTorch for portable high-performance code, including both CPU and GPU support. hippynn allows for extensive customization, including user-defined models and loss functions, to facilitate future research into extensions of HIP-NN as well as other atomistic deep learning models.

Lubbers, Nicolas↗

Encoding Frequency Constraints in Preventive Unit Commitment Using Deep Learning With Region-of-Interest Active Sampling

With the increasing penetration of renewable energy, frequency response and its security are of significant concerns for reliable power system operations. Frequency-constrained unit commitment (FCUC) is proposed to address this challenge. Despite existing efforts in modeling frequency characteristics in unit commitment (UC), current strategies can only handle oversimplified low-order frequency response models and do not consider wide-range operating conditions. This paper presents a generic data-driven framework for FCUC under high renewable penetration. Here, deep neural networks (DNNs) are trained to predict the frequency response using real data or high-fidelity simulation data. Next, the DNN is reformulated as a set of mixed-integer linear constraints to be incorporated into the ordinary UC formulation. In the data generation phase, all possible power injections are considered, and a region-of-interest active sampling is proposed to include power injection samples with frequency nadirs closer to the UFLC threshold, which enhances the accuracy of frequency constraints in FCUC. The proposed FCUC is investigated on the IEEE 39-bus system. Then, a full-order dynamic model simulation using PSS/E verifies the effectiveness of FCUC in frequency-secure generator commitments.

42 ENGINEERING↗

Diamond formation due to a pH drop during fluid–rock interactions

Diamond formation has typically been attributed to redox reactions during precipitation from fluids or magmas. Either the oxidation of methane or the reduction of carbon dioxide has been suggested, based on simplistic models of deep fluids consisting of mixtures of dissolved neutral gas molecules without consideration of aqueous ions. The role of pH changes associated with water–silicate rock interactions during diamond formation is unknown. Here we show that diamonds could form due to a drop in pH during water–rock interactions. We use a recent theoretical model of deep fluids that includes ions, to show that fluid can react irreversibly with eclogite at 900 °C and 5.0 GPa, generating diamond and secondary minerals due to a decrease in pH at almost constant oxygen fugacity. Overall, our results constitute a new quantitative theory of diamond formation as a consequence of the reaction of deep fluids with the rock types that they encounter during migration. Diamond can form in the deep Earth during water–rock interactions without changes in oxidation state.

36 MATERIALS SCIENCE↗

Hydrogen transport diagnostics by atomic and molecular emission line profiles simultaneously measured for large helical device

We observe the Balmer-{alpha}, -{beta}, and -{gamma} lines of hydrogen atoms and Q branches of the Fulcher-{alpha} band of hydrogen molecules simultaneously with their polarization resolved for large helical device. From the fit including the line splits and the polarization dependences by the Zeeman effect, the emission locations, intensities, and the temperatures of the atoms and molecules are determined. The emission locations of the hydrogen atoms are determined outside but close to the last closed flux surface (LCFS). The results are consistent with a previous work (Phys. Plasmas 12, 042501 (2005)). On the other hand, the emission locations of the molecules are determined to be in the divertor legs, which is farer from those of the atoms. The kinetic energy of the atoms is 1 {approx} 20 eV, while the rotational temperature of molecules is {approx}0.04 eV. Additionally, substantial wings, which originate from high velocity atoms and are not reproduced by the conventional spectral analysis, are observed in the Balmer line profiles. We develop a one-dimensional model to simulate the transport of the atoms and molecules. The model reproduces the differences of the emission locations of the atoms and molecules when their initial temperatures are assumed to be 3 eV and 0.04 eV, respectively. From the model, the wings of the Balmer-{alpha} line is attributed to the high velocity atoms exist deep inside the LCFS, which are generated by the charge exchange collisions with hot protons there.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Discovering Ca II absorption lines with a neural network

Quasar absorption line analysis is critical for studying gas and dust components and their physical and chemical properties as well as the evolution and formation of galaxies in the early universe. Calcium II (Ca II ) absorbers, which are one of the dustiest absorbers and are located at lower redshifts than most other absorbers, are especially valuable when studying physical processes and conditions in recent galaxies. However, the number of known quasar Ca II absorbers is relatively low due to the difficulty of detecting them with traditional methods. In this work, we developed an accurate and quick approach to search for Ca II absorption lines using deep learning. In our deep learning model, a convolutional neural network, tuned using simulated data, is used for the classification task. The simulated training data are generated by inserting artificial Ca II absorption lines into original quasar spectra from the Sloan Digital Sky Survey (SDSS), while an existing Ca II catalogue is adopted as the test set. The resulting model achieves an accuracy of 96 per cent on the real data in the test set. Our solution runs thousands of times faster than traditional methods, taking a fraction of a second to analyse thousands of quasars, while traditional methods may take days to weeks. The trained neural network is applied to quasar spectra from SDSS’s DR7 and DR12 and discovered 399 new quasar Ca II absorbers. In addition, we confirmed 409 known quasar Ca II absorbers identified previously by other research groups through traditional methods.

79 ASTRONOMY AND ASTROPHYSICS↗

Next-generation yeast-two-hybrid analysis with Y2H-SCORES identifies novel interactors of the MLA immune receptor

Protein-protein interaction networks are one of the most effective representations of cellular behavior. In order to build these models, high-throughput techniques are required. Next-generation interaction screening (NGIS) protocols that combine yeast two-hybrid (Y2H) with deep sequencing are promising approaches to generate interactome networks in any organism. However, challenges remain to mining reliable information from these screens and thus, limit its broader implementation. Here, we present a computational framework, designated Y2H-SCORES, for analyzing high-throughput Y2H screens. Y2H-SCORES considers key aspects of NGIS experimental design and important characteristics of the resulting data that distinguish it from RNA-seq expression datasets. Three quantitative ranking scores were implemented to identify interacting partners, comprising: 1) significant enrichment under selection for positive interactions, 2) degree of interaction specificity among multi-bait comparisons, and 3) selection of in-frame interactors. Using simulation and an empirical dataset, we provide a quantitative assessment to predict interacting partners under a wide range of experimental scenarios, facilitating independent confirmation by one-to-one bait-prey tests. Simulation of Y2H-NGIS enabled us to identify conditions that maximize detection of true interactors, which can be achieved with protocols such as prey library normalization, maintenance of larger culture volumes and replication of experimental treatments. Y2H-SCORES can be implemented in different yeast-based interaction screenings, with an equivalent or superior performance than existing methods. Proof-of-concept was demonstrated by discovery and validation of novel interactions between the barley nucleotide-binding leucine-rich repeat (NLR) immune receptor MLA6, and fourteen proteins, including those that function in signaling, transcriptional regulation, and intracellular trafficking.

59 BASIC BIOLOGICAL SCIENCES↗

Searches for Bound Neutron-Antineutron Oscillation in Liquid Argon Time Projection Chambers

The next-generation Deep Underground Neutrino Experiment’s liquid argon detector represents an opportunity to probe previously unexplored parameter space for beyond-Standard Model processes. One such process is baryon number violating neutron-antineutron oscillation, the observation of which would have profound implications on our understanding of the origin of the matter-antimatter asymmetry in the universe, and provide strong hints as to the nature of neutrino mass. A GENIE n

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Predictability and feedbacks of the ocean-soil-plant-atmosphere water cycle: deep learning water conductance in Earth System Model

This white paper responds to Focal Area 2. We seek to build predictive models of leaf and surface conductance of water by implementing deep learning (DL) data assimilation techniques. These new models would then be implemented in existing Land Surface Models (LSMs) and Earth System models (ESMs), generating novel water cycle feedbacks. In doing so, we would improve predictability of expected changes in land precipitation, soil moisture, and vegetation dynamics in the long-term, and the role of land cover on the impacts and feedbacks of extreme weather events in the short-term

54 ENVIRONMENTAL SCIENCES↗

Synthetic Infrasound Data for Machine Learning Detectors

Synthetic data is a powerful tool to generate large amounts of training data for machine learning models. The methods outlined in this report will be used to retrain the deep learning classifier for increased accuracy. Synthetic data will be useful to address the natural class imbalance between the different categories in the original ML work. Additionally, these tools will be applied for a variety of signal analysis methods that would use signals with a known signal-to-noise ratio for validation and testing.

58 GEOSCIENCES↗

Electrical and Seismic Response of Saline Permafrost Soil during Freeze - Thaw Transition: Supporting Data

These data were collected during a repeat freeze-thaw cycle on a saline permafrost portion of a core to understand mechanical and geophysical property changes over time. The core used for the experiment was collected from the NGEE-Arctic Site 0 transect site located in the Barrow Environmental Observatory (BEO) in Barrow, Alaska. This region features polygonal ground, and the core was collected in the center of a flat centered polygon. The saline permafrost portion of the core was at the bottom 260-280 cm below ground surface. Data files (*.csv) include: Electrical signal change during freeze-thaw-refreeze cycle at 1 Hz; Spectral data - Complex resistivity data during Freeze-thaw of the saline permafrost core; Seismic data; and CT cross sections (*.jpg) of the core sample from approximately the same location: (A, D) before the test (thawed), (B, E) after the test (frozen), and (C, F) after deep freeze (frozen).The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

The contribution of galaxy clusters to the soft X-ray background

The present paper examines models for the expected contribution to the X-ray background (XRB) from clusters of galaxies in a flat universe with a spectrum of fluctuations corresponding to the standard cold dark matter picture and for a power-law spectrum P(k) varies as k sup n with n = -2. A self-similar scaling model for clusters proposed by Kaiser (1986) is presented, along with several variants. Photon statistics from synthesized maps of deep Einstein fields show a granularity similar to that deduced by Hamilton and Helfand (1987) from the Einstein data but overproduces by a large factor the number of discrete sources observed as clusters, and the fluctuation limit derived from the recent correlation analyses of the background. Two alternative models are designed to be consistent with the local luminosity function data; for these, expected deep images for the Rosat satellite are generated. Clusters of galaxies should be a significant source of background at energies around 2 keV, and it is proposed that clusters of galaxies contribute up to 30 percent of the unresolved component.

Blanchard, A.↗