Search NASA⌕ Search

SEARCH · Search NASA

Results for “deep generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

WaveDP

We developed a robust deep learning model designed to effectively reduce background noise and measure signal arrival times from seismic waveforms. This model processes a 57-second, three-component seismogram to predict the probability of Primary (P) and Secondary (S) waves for each timestamp, while also generating a denoised seismogram. Training was conducted using the benchmark STEAD dataset, which includes globally distributed earthquake signals recorded at local distances ranging from 0 to 350 kilometers.

Chai, Chengping [Oak Ridge National Laboratory (OR↗

Evaluating large scale aqueous organic redox flow battery performance with a hybrid numerical and machine learning framework

Aqueous organic redox flow battery (AORFB) is a promising cost-competitive technology for large-scale energy storage. Among existing work, the dihydroxyphenazine (DHP)-based AORFB has demonstrated high energy density and low-capacity degradation in 10 cm$^2$ cells during lab tests. However, its commercial-scale performance in more complex environments remains unknown, posing a barrier to commercialization. To address this gap, this work presents a comprehensive performance evaluation of a 780 cm$^2$ DHP-based AORFB by combining a physics-based numerical model, machine learning (ML)-based surrogate models, and ML-derived sensitivity quantification. Specifically, we first select 12 key battery parameters that include 10 physicochemical and 2 operation quantities, then select 6 performance metrics that include energy efficiency (EE), discharging capacity, charging energy, and power losses due to concentration, activation, and ohmic over-potentials. With such selection, 12800 combinations of the 12 parameters are subsequently generated using the Latin Hypercube Sampling method. Such combinations, together with 38 pre-defined State of Charge, are then integrated to a validated AORFB model developed in COMSOL to compute the performance metrics. With both input parameters and performance metrics, 60 deep neural network (DNN) surrogate models are then trained to approximate the relationship between the 10 physicochemical quantities and 6 performance metrics at each flow rate and current density. Sensitivity scores are then calculated based on the DNN models. Two additional sensitivity analysis tools, i.e., MARS, and SHAP, are also used to cross-validate the sensitivity scores from the DNN. The results demonstrate that 1) the standard potential ranks first in controlling EE and charging energy, 2) the membrane conductivity is most critical for power loss and EE, and 3) specific area and reaction rate control activation power loss.

25 ENERGY STORAGE↗

Deriving Severe Hail Likelihood from Satellite Observations and Model Reanalysis Parameters using a Deep Neural Network

Geostationary satellite imagers, such as those of the Geostationary Operational Environmental Satellite (GOES) series, have been observing severe convection at 15–60-minute intervals for over 40 years. When properly assessed, such a data record can be valuable in efforts of estimating severe storm risk throughout the diurnal cycle based on automated detection of patterns consistently found atop severe storms. Furthermore, environmental conditions favorable for severe weather are well-known and are thought to be represented well by modern reanalysis products. Promoting resilience against such hazards on local and global scales is a chief goal the NASA Disasters program, which seeks to encourage use of satellite observations to mitigate risk. For instance, hail is the costliest severe weather hazard across the globe in terms of insured loss, but reporting inconsistencies for hail events globally make it difficult to develop models that can quantify the risk. Satellite observation and model reanalysis taken together have the potential to, with reasonable skill and specificity, characterize environmental conditions that are favorable for hazardous weather, and thereby enable creation of hazard climatologie. Such climatologies are particularly useful over regions without extensive radar networks or storm reporting. By mapping the multivariate combination of observed cloud features and reanalysis environmental parameters/indices to United States Next Generation Weather Radar (NEXRAD) radar-estimated Maximum Expected Size of Hail (MESH) by way of a deep neural network (DNN), estimates of likelihood for potentially severe hail can be produced. Such estimates are of greater complexity and efficiency than could be performed with previous multivariate or logistic regression analyses for observed points within convective systems. Statistical distributions of convective parameters from satellite and reanalysis are shown to highlight non-severe/severe class separation for well-known hailstorm predictors, e.g., overshooting cloud top characteristics, deep-layer wind shear, mid-level stability, helicity, and convective inhibition. These complex, multivariate predictor relationships are exploited within a DNN, which can efficiently produce a quantitative hail risk metric with better than 70% detection rate and under 30% false alarms. These hail classifications can then be aggregated across the satellite record to yield a hazard climatology for hail frequency and severity – knowledge of which is of particular interest to those who manage risk (e.g., insurers) and are seeking opportunities to identify hail-prone regions, particularly in developing nations. This NASA study uses satellite observations and model parameters in a DNN to perform climatological hailstorm analysis in support of catastrophe model development, with the hope of promoting risk resilience particularly in regions without adequate weather radar coverage.

Passive Remote Sensing↗

DEEP Solar: Data DrivEn Modeling and Analytics for Enhanced System Layer ImPlementation

Realizing the SETO 2030 mission of reducing solar energy costs to 3-5 c/kWh will require innovative enabling research on effective, cost-efficient integration of local PV within distribution systems. However, the intermittent and variable nature of PVs compels operators to impose conservative hosting capacity constraints. Given the extremely high variability of (intermittent and unpredictable) solar energy generation, relaxing the capacity constraints (which are currently around 15%) and achieving 100% or greater integration of renewables will require a fundamental transformation of the power grid via the utilization of exponentially larger amounts of AMI enabled fine-grained data. To address the challenges in increasing the penetration of renewable energy based DERs, this project envisions an Enhanced System Layer (ESL) at the distribution network level that is reliable, cost-effective and scalable to millions of Distributed Energy Resources (DERs)/devices. This includes developing: 1) Transformative and highly scalable machine learning based predictive analytics tools that plug into distribution system planning and provide real-time situational awareness at the distribution level for short and long-term operational planning. The tools will be built using novel data-driven energy models of millions of active nodes with AMI, 2) Adaptive stochastic analysis and optimization algorithms for real-time grid operations, 3) Dynamic Scenario Analysis using parallel Cloudenabled implementations with < 1 minute computational cycle times.

14 SOLAR ENERGY↗

Modeling of a solar-pumped iodine laser

The direct conversion in space of solar radiation into laser radiation for power transmission to earth, satellites, or deep space probes shows promise as a reasonably simple technology and may have cost advantage in deployment and greater reliability compared to other methods of space power generation and transmission. The main candidates for solar pumping are the gas dynamic, photochemical, and direct photoexcited lasers. Here consideration is given to the photochemical reaction of alkyliodides which predominantly excite the I(2P1/2) state which then lases at 1.315 microns. The iodine ground state is eventually lost to reconstituting the gas or in the formation of molecular iodine. The rates at which the gas is required to be recycled through the laser system are modest. The side exposure at 100-fold solar concentration of a 100-m long tube with a 1 sq m cross section is estimated to provide 20 kW of continuous laser output. Scaling laws and optimum operating conditions of this system are discussed.

Wilson, J. W.↗

Electroactive complex in thermally treated Ge-Si crystals

It is shown by Hall measurements that quenching complexly doped Ge{sub 1-x}Si{sub x} (0 {<=} x {<=} 0.20) crystals from 1050-1080 K leads to the formation of additional electroactive acceptor centers in them. The activation energy of these centers increases linearly with an increase in the silicon content in the crystal and is described by the relation E{sub k}{sup x} = (52 + 320x) meV. Annealing these crystals at 550-570 K removes the additional acceptor levels. It is established that the most likely model for the additional electroactive centers is a pair composed of substituent copper and aluminum atoms (Cu{sub s}Al{sub s}) or interstitial copper and substituent aluminum atoms (Cu{sub i}Al{sub s}). It is shown that the generation of additional deep acceptor levels must be taken into account when using the method of precise doping of Ge{sub 1-x}Si{sub x} crystals with copper.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Synchrophasor Measurements-based Events Detection Using Deep Learning

Deep learning algorithms have been developed for phasor measurement units (PMUs) analysis aiming at providing grid operators to observe and react to significant real-time changes in the grid associated with multiple factors (e.g., power generation and load variations, different type of faults, and equipment mailfunction), or for offline post-event system diagnostics. In this study, a Long Short-Term Memory (LSTM)-based deep neural network (DNN) is adopted and evaluated to identify the most appropriate model configurations for event detection and longer-term anomalous pattern extraction. The proposed DNN model shows the potential on long-term predictions with the ability to capture nonlinear and nonstationary mixture complex patterns in PMU datasets. Real-world PMU in the WECC system were used for model development and validation.

deep learning↗

Exploring 2D X-ray diffraction phase fraction analysis with convolutional neural networks: Insights from kinematic-diffraction simulations

Abstract Deep-learning models are effective for analyzing the complex information in 2D X-ray diffraction (XRD) patterns. Accurately collecting parameters of the material sample is crucial during model training, significantly impacting model performance. In this study, we employ a kinematic-diffraction simulator to generate simulated 2D XRD patterns for Ti–6Al–4V alloy, allowing precise control of sample parameters. These simulated patterns are used to train convolutional neural networks, predicting $$\upbeta$$ β -phase volume fractions. The training data set consists exclusively of 2D XRD patterns with pure $$\upalpha$$ α - or pure $$\upbeta$$ β -phase, while the testing set incorporates patterns with intermediate phase volume fraction. In particular, we investigate how the architectures of the model influence prediction reliability and computational performance. Experimental results reveal that, with appropriate training, the convolutional neural network accurately detects intermediate phase volume fractions even trained with only pure-phase patterns, achieving a mean square error accuracy of $$9.4 \times 10^{-4}$$ 9.4 × 10 - 4 . Graphical abstract

Yue, Weiqi↗

Thermodynamic Properties of Aqueous Carbonate Species and Solid Carbonate Phases of Selected Trace Elements pertinent to Drinking Water Standards of the U.S. Environmental Protection Agency

This report contains a series of tables summarizing the thermodynamic properties of aqueous carbonate complexes and solid carbonate phases of the following elements: arsenic (As), barium (Ba), cadmium (Cd), chromium (Cr), cobalt (Co), copper (Cu), iron (Fe), lead (Pb), manganese (Mn), mercury (Hg), nickel (Ni) thallium (Tl), uranium (U) and zinc (Zn). Most of these elements are potentially hazardous as defined by extant primary drinking water standards of the United States Environmental Protection Agency (EPA). The remainder are not considered hazardous, but are either listed by EPA under secondary standards, or because they can adversely affect drinking water quality. Additional tables are included giving the thermodynamic properties for carbonates of the alkali metal and alkali earth elements, sodium (Na), potassium (K), magnesium (Mg), calcium (Ca), and strontium (Sr), because of their value in developing correlative models to estimate the thermodynamic properties of carbonate minerals for which no such data currently exist. The purpose in creating the tables in this report is to provide future investigators with a convenient source for selecting and tracing the sources of thermodynamic data of the above listed elements for use in modeling their geochemical behavior in “underground sources of drinking water” (USDW). The incentive for doing so lies with a heightened concern over the potential consequences of the proposed capture and storage of carbon dioxide (CO2) generated by fossil fuel fired power plants in deep subsurface reservoirs. If CO2 were to leak from such reservoirs, it could migrate upward and contaminate USDWs with undesirable, but undetermined, consequences to water quality. The EPA, Office of Research and Development, through an Interagency Agreement with the U.S. Department of Energy at the Lawrence Berkeley National Laboratory, funded the preparation of this report.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Solid lubrication design methodology, phase 2

The high temperature performance of solid lubricated rolling elements was conducted with a specially designed traction (friction) test apparatus. Graphite lubricants containing three additives (silver, phosphate glass, and zinc orthophosphate) were evaluated from room temperature to 540 C. Two hard coats were also evaluated. The evaluation of these lubricants, using a burnishing method of application, shows a reasonable transfer of lubricant and wear protection for short duration testing except in the 200 C temperature range. The graphite lubricants containing silver and zinc orthophosphate additives were more effective than the phosphate glass material over the test conditions examined. Traction coefficients ranged from a low of 0.07 to a high of 0.6. By curve fitting the traction data, empirical equations for slope and maximum traction coefficient as a function of contact pressure (P), rolling speed (U), and temperature (T) can be developed for each lubricant. A solid lubricant traction model was incorporated into an advanced bearing analysis code (SHABERTH). For comparison purposes, preliminary heat generation calculations were made for both oil and solid lubricated bearing operation. A preliminary analysis indicated a significantly higher heat generation for a solid lubricated ball bearing in a deep groove configuration. An analysis of a cylindrical roller bearing configuration showed a potential for a low friction solid lubricated bearing.

Pallini, R. A.↗

DeepWelding: a Deep Learning Enhanced Approach to GTAW Using Multi-source Sensing Images

Deep learning has great potential to reshape manufacturing industries. In this paper, we present DeepWelding, a novel framework that applies deep learning techniques to improve gas tungsten arc welding (GTAW) process monitoring and penetration detection using multi-source sensing images. The framework is capable of analyzing multiple types of optical sensing images synchronously and consists of three deep learning enhanced consecutive phases: image preprocessing, image selection, and weld penetration classification. Specifically, we adopted generative adversarial networks (pix2pix) for image denoising and classic convolutional neural networks (AlexNet) for image selection. Both pix2pix and AlexNet delivered satisfactory performance. However, five individual neural networks with heterogeneous architectures demonstrated inconsistent generalization capabilities in the classification phase when holding out multi-source images generated with specific experimental settings. Therefore, two ensemble methods combining multiple neural networks were designed to improve the model performance on unseen data collected from different experimental settings. In conclusion, we also found that the quality of model prediction was heavily influenced by the data stream collection environment. We think these findings are beneficial for the broad intelligent welding community.

42 ENGINEERING↗

The importance of inner-shell electronic structure for enhancing the EUV absorption of photoresist materials

In order to increase computation power and efficiency, the semiconductor industry continually strives to reduce the size of features written using lithographic techniques. The planned switch to a shorter wavelength extreme ultraviolet (EUV) source presents a challenge for the associated photoresists, which in their current manifestation show much poorer photoabsorption cross sections for the same dose. Here we consider the critical role that an inner-shell electronic structure might play in enhancing photoabsorption cross sections, which one can control by the choice of substituent elements in the photoresist. In order to increase the EUV sensitivity of current photoresists, it is critical to consider the inner-shell atomic structure of the elements that compose the materials. We validate this hypothesis using a series of halogenated organic molecules, which all have similar valence structures, but differ in the character of their semi-core and deep valence levels. Using various implementations of time-dependent density functional theory, the absorption cross sections are computed for the model systems of CH3X, X = H, OH, F, Cl, Br, I, as well as a representative polymer fragment: 2-methyl-phenol and its halogenated analogues. Iodine has a particularly high cross section in the EUV range, which is due to delayed absorption by its 4d electrons. The computational results are compared to standard database values and experimental data when available. Generally we find that the states that dominate the EUV oscillator strength are generated by excitations of deep valence or semi-core electrons, which are primarily atomic-like and relatively insensitive to the specific molecular structure.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Theoretical tools for neutrino scattering: interplay between lattice QCD, EFTs, nuclear physics, phenomenology, and neutrino event generators

Maximizing the discovery potential of increasingly precise neutrino experiments will require an improved theoretical understanding of neutrino-nucleus cross sections over a wide range of energies. Low-energy interactions are needed to reconstruct the energies of astrophysical neutrinos from supernovae bursts and search for new physics using increasingly precise measurement of coherent elastic neutrino scattering. Higher-energy interactions involve a variety of reaction mechanisms including quasi-elastic scattering, resonance production, and deep inelastic scattering that must all be included to reliably predict cross sections for energies relevant to DUNE and other accelerator neutrino experiments. Refined nuclear interaction models in these energy regimes will also be valuable for other applications, such as measurements of reactor, solar, and atmospheric neutrinos. This manuscript discusses the theoretical status, challenges, required resources, and path forward for achieving precise predictions of neutrino-nucleus scattering and emphasizes the need for a coordinated theoretical effort involved lattice QCD, nuclear effective theories, phenomenological models of the transition region, and event generators.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Inverse Analysis with Variational Autoencoders: A Comparison of Shallow and Deep Networks

Inverse problems are applied to determine unknown properties by matching observational data with a physical model that often takes many parameters as input. To overcome the underconstrained nature of inverse problems and achieve good performance, an approach is presented involving regularization with a technique known as a variational autoencoder (VAE), which is trained to map a high-dimensional parameter space with a complex structure to a low-dimensional latent space with a simple structure. We apply this approach to unconditioned realizations of the parameters (heterogeneous hydraulic fields) for a hydrogeological inverse problem. Two types of hydraulic conductivity fields are used to evaluate the characterization for the different levels of heterogeneity complexity of the physical inputs. This approach keeps the computational cost of generating the training data low. The reason is unconditioned realizations neither rely on the observational data used to perform the inverse analysis nor require any groundwater flow model forward runs. In addition, this approach applies regularization on a low-dimensional latent space from the VAE and increases optimization efficiency through automatic differentiation. Furthermore, two different neural network (NN) structures are tested for their utility in using the VAE for inverse analysis. The performance of a deep, convolutional neural network strongly depends on the dimensionality of the latent space, which requires tuning. In contrast, a shallow, dense neural network provides consistently accurate characterization without tuning. Furthermore, our approach evaluates the advantages of the shallow, dense neural network over the deep, convolutional one and enables future application to a wide range of inverse problems.

97 MATHEMATICS AND COMPUTING↗

Revealing the Formation Energy–Exfoliation Energy–Structure Correlation of MAB Phases Using Machine Learning and DFT

MAB phases are popular as high-temperature materials with high damage tolerance and excellent electrical conductivity that are used to exfoliate two-dimensional (2D) transition metal borides (MBenes); a promising material for developing next- generation nanodevices. In this report, we explore the correlation between the formation energy, exfoliation energy and structural factors of MAB phases using DFT and machine learning. In order to do so, we developed three different machine learning models based on the support vector machine, deep neural network, and random forest regressor to study the stability of the MAB phases by calculating their formation energies. Furthermore, our support vector machine and deep neural network models are capable of predicting the formation energies with mean absolute errors less than 0.1 eV/atom. We demonstrated that the stability of a MAB phase for a given transition metal decreases when the A element changes from Al to Tl. The density functional theory (DFT) re- vealed that M-A and M-B bond strength strongly correlates with the stability of MAB phases. In addition, the exfoliation possibility of 2D MBenes becomes higher when the A element changes from Al to Tl due to weakening of M-A and M-B bonds.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

AB INITIO SIMULATIONS FOR MATERIAL PROPERTIES ALONG THE JUPITER ADIABAT

We determine basic thermodynamic and transport properties of hydrogen-helium-water mixtures for the extreme conditions along Jupiter's adiabat via ab initio simulations, which are compiled in an accurate and consistent data set. In particular, we calculate the electrical and thermal conductivity, the shear and longitudinal viscosity, and diffusion coefficients of the nuclei. We present results for associated quantities like the magnetic and thermal diffusivity and the kinematic shear viscosity along an adiabat that is taken from a state-of-the-art interior structure model. Furthermore, the heat capacities, the thermal expansion coefficient, the isothermal compressibility, the Grueneisen parameter, and the speed of sound are calculated. We find that the onset of dissociation and ionization of hydrogen at about 0.9 Jupiter radii marks a region where the material properties change drastically. In the deep interior, where the electrons are degenerate, many of the material properties remain relatively constant. Our ab initio data will serve as a robust foundation for applications that require accurate knowledge of the material properties in Jupiter's interior, e.g., models for the dynamo generation.

79 ASTRONOMY AND ASTROPHYSICS↗

SynthNotes: A Generator Framework for High-volume, High-fidelity Synthetic Mental Health Notes

One of the key, emerging challenges that connects the "Big Data" and the AI domain is the availability of sufficient volumes of training data for AI/Machine Learning tasks. SynthNotes is a framework for generating standards-compliant, realistic mental health progress report notes at the very large, population-level scale, and in a strict privacy-preserving manner. Our framework, inspired by the needs to explore, evaluate, and train computational methods for the emerging mental health crisis in the US, is useful for benchmarking, optimization, and training of biomedical natural language processing, information extraction, and machine learning systems intended to operate at "Big Data" scale (billions of notes). The free text notes generated by SynthNotes are based on the literature and public statistical models allowing for realistic, natural language representation of a patient, and his or her mental health characteristics. Additionally, SynthNotes can partially simulate stylistic, grammatical, and expressive characteristics of a licensed mental health professional. SynthNotes is modular and flexible, allowing for representation of variety of conditions, incorporation of alternative foundational models, and parametrization of the variability of the structure, content, and size of the synthetically generated corpus. In this paper, we report on the initial use and performance characteristics of our SynthNotes framework and on the ongoing work for inclusion of content planning and deep learning-based generative methods trained on real data.

Begoli, Edmon↗

Intersection of Hydrologic Change and Hydropower in the United States: Needs for Future Research and Practice

Hydropower is crucial for electric‐grid stability in the context of variable renewables but faces threats from changing hydrology. Here, we summarize the state of the science at the intersection of hydropower operations and planning, hydrologic science, and climate. We focus on the United States, outlining research, development, and training needs. Key knowledge gaps include the risk that intensification of compound extreme events poses to future generation, as well as uncertainties surrounding greenhouse gas emissions from hydropower reservoirs with relevance to hydropower's role in energy decarbonization. Quantifying such impacts and reducing uncertainty are critical where possible, but remaining irreducible or deep uncertainty will require new approaches. Future monitoring and modeling methods must provide a better understanding of the complexity inherent in large watersheds that is critical to managing both hydropower and watersheds in the context of hydrologic change. Yet, research and development will have little impact if they do not inform practice. Standardization and consolidation of platforms are essential for data, modeling, and tool translation to local scales and small operators. An enhanced industry‐academia dialog is pivotal for fostering a robust pipeline of hydropower professionals. Collaboration among researchers, policymakers, authorities, and industry stakeholders emerges as a recurring theme, highlighting the imperative for collective efforts.

13 HYDRO ENERGY↗