Derivative-based pre-training of graph neural networks for materials property predictions
General pre-training strategy of graph neural networks for materials science.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
General pre-training strategy of graph neural networks for materials science.
For economic reasons, the nuclear industry is witnessing premature closure of nuclear power plants, despite excellent safety records. Operations and Maintenance (O&M) activities are some of the largest costs in operating legacy light-water plants. By reducing O&M costs, nuclear energy can become more economically competitive with other energy sources. This can be achieved by leveraging machine-learning and artificial intelligence technologies to develop data-driven algorithms to better diagnose potential faults within the system. Improved accuracy of the models can lead to a reduction in unnecessary maintenance, thus reducing costs associated with parts, labor, and unnecessary planned, forced, or extended outages. To address these challenges, the goal of this project is to perform research and development in the area of digital monitoring, i.e., the application of advanced sensor technologies (particularly wireless sensor technologies) and data science based analytic capabilities, to advance online monitoring and predictive maintenance in nuclear plants and improve plant performance (efficiency gain and economic competitiveness). This report summarizes the fiscal year 2020 research progress encompassing (1) different wireless vibration sensor and data indicators used to assess the health of a plant asset; (2) development of diagnostic models for fault detection; and (3) development of prognostic models for estimating the health of the system up to 7 days ahead.
Patient-derived xenografts (PDXs) are an appealing platform for preclinical drug studies. A primary challenge in modeling drug response prediction (DRP) with PDXs and neural networks (NNs) is the limited number of drug response samples. We investigate multimodal neural network (MM-Net) and data augmentation for DRP in PDXs. The MM-Net learns to predict response using drug descriptors, gene expressions (GE), and histology whole-slide images (WSIs). We explore whether combining WSIs with GE improves predictions as compared with models that use GE alone. We propose two data augmentation methods which allow us training multimodal and unimodal NNs without changing architectures with a single larger dataset: 1) combine single-drug and drug-pair treatments by homogenizing drug representations, and 2) augment drug-pairs which doubles the sample size of all drug-pair samples. Unimodal NNs which use GE are compared to assess the contribution of data augmentation. The NN that uses the original and the augmented drug-pair treatments as well as single-drug treatments outperforms NNs that ignore either the augmented drug-pairs or the single-drug treatments. In assessing the multimodal learning based on the MCC metric, MM-Net outperforms all the baselines. Our results show that data augmentation and integration of histology images with GE can improve prediction performance of drug response in PDXs.
Planetary spacecraft are viewed through a troposphere that absorbs and delays radio signals propagating through it. Tropospheric water, in the form of vapor, cloud liquid, and precipitation, emits radio noise which limits satellite telemetry communication link performance. Even at X-band, rain storms have severely affected several satellite experiments including a planetary encounter. The problem will worsen with DSN implementation of Ka-band because communication link budgets will be dominated by tropospheric conditions. Troposphere-induced propagation delays currently limit VLBI accuracy and are significant sources of error for Doppler tracking. Additionally, the success of radio science programs such as satellite gravity wave experiments and atmospheric occultation experiments depends on minimizing the effect of water vapor-induced propagation delays. In order to overcome limitations imposed by the troposphere, the Deep Space Network has supported a program of radiometric remote sensing. Currently, water vapor radiometers (WVRs) and microwave temperature profilers (MTPs) support many aspects of the Deep Space Network operations and research and development programs. Their capability to sense atmospheric water, microwave sky brightness, and atmospheric temperature is critical to development of Ka-band telemetry systems, communication link models, VLBI, satellite gravity wave experiments, and radio science missions. During 1993, WVRs provided data for propagation model development, supported planetary missions, and demonstrated advanced tracking capability. Collection of atmospheric statistics is necessary to model and predict performance of Ka-band telemetry links, antenna arrays, and radio science experiments. Since the spectrum of weather variations has power at very long time scales, atmospheric measurements have been requested for periods ranging from one year to a decade at each DSN site. The resulting database would provide reliable statistics on daily, monthly, and seasonal variations. Only long-term monitoring will prevent biases from being introduced by an exceptionally wet or dry year. Support for planetary missions included tropospheric calibration for the recent Mars Observer gravity wave experiments and Ka-band link experiment (KaBLE). Additionally, several proposed radio science experiments such as profiling planetary atmospheres using satellite occultations and Ka-band gravitational wave searches require advanced radiometer technology development. Finally, there has been a consistent advanced technology program to advance satellite navigational and tracking capabilities. This year that included an experiment with radiometer based tropospheric calibration for a series of VLBI catalog measurements.
The goal of weather prediction is to provide information people and organizations can use to reduce weather-related losses and enhance societal benefits, including protection of life and property, public health and safety, and support of economic prosperity and quality of life. In economic terms, the benefit of the investment in public weather forecasts and warnings is substantial: the estimated annualized benefit is about $31.5 billion, compared to the $5.1 billion cost of generating the information. Between 1980 and 2009, 96 weather disasters in the United States each caused at least $1 billion in damages, with total losses exceeding $700 billion. Between 1999 and 2008, there were an average of 629 direct weather fatalities per year. The annual impacts of adverse weather on the national highway system and roads are staggering: 1.5 million weather-related crashes with 7,400 deaths, more than 700,000 injuries, and $42 billion in economic losses.
The Coalition for Aerospace and Science (CAS) is hosting an exhibition on Capitol Hill on June 14, 2017, to highlight the contributions of CAS members to NASAs portfolio of activities. This exhibition represents an opportunity for an HFES members ground breaking work to be displayed and to build on support within Congress for NASAs human research program including in those areas that are of specific interest to the HFE community. The intent of this poster presentation is to demonstrate the positive outcome that comes from funding HFE related research on a project like the one exemplified by MIDAS-FAST.
Explore the source record for details and available documents.
Lynx is an X-Ray telescope large-mission concept for consideration in NASA's 2020 Astrophysics Decadal Survey. A conceptual structural design is evolving that leverages the success and lessons learned from Chandra and that takes into account unique needs of Lynx. Space optics systems require extreme stability. Any motion in-service (thermal effects, structural dynamics, etc.) impacts performance. An initial analysis was performed to predict the first-cut dynamic responses, jitter, at two selected points on the Lynx observatory. One point is on the Lynx X-ray Mirror Assembly (LMA) and the other, on the focal plane Integrated Science Instrument Module (ISIM). Relative motion between these two points was predicted along with vibration spectra. This information will be used in upcoming analyses of the LMA and the ISIM.
This document is intended to detail the theoretical basis, equations, references and data that are necessary to enhance the functionality of commercially available Finite Element codes, with the objective of having functionality better suited for the aerospace industry in the area of composite structural analysis. The specific area of focus will be improvements to composite interlaminar fatigue and progressive interlaminar failure. Suggestions are biased towards codes that perform interlaminar Linear Elastic Fracture Mechanics (LEFM) using Virtual Crack Closure Technique (VCCT)-based algorithms [1,2]. All aspects of the science associated with composite interlaminar crack growth are not fully developed and the codes developed to predict this mode of failure must be programmed with sufficient flexibility to accommodate new functional relationships as the science matures.
Planetary spacecraft are viewed through a troposphere that absorbs and delays radio signals propagating through it. Tropospheric water, in the form of vapor, cloud liquid,and precipitation , emits radio noise which limits satellite telemetry communication link performance. Even at X-band, rain storms have severely affected several satellite experiments including a planetary encounter. The problem will worsen with DSN implementation of Ka-band becausecommunication link budgets will be dominated by tropospheric conditions. Troposphere-induced propagation delays currently limit VLBI accuracy and are significant sources of error for Doppler tracking. Additionally, the success of radio science programs such as satellite gravity wave experiments and atmospheric occultation experiments depends on minimizing the effect of watervapor-induced prop agation delays. In order to overcome limitations imposed by the troposphere, the Deep Space Network has supported a program of radiometric remote sensing. Currently, water vapor radiometers (WVRs) and microwave temperature profilers (MTPs) support many aspects of the Deep Space Network operations and research and development programs. Their capability to sense atmospheric water, microwave sky brightness, and atmospheric temperature is critical to development of Ka-band telemetry systems, communication link models, VLBI, satellite gravity waveexperiments, and r adio science missions. During 1993, WVRs provided data for propagation mode development, supp orted planetary missions, and demonstrated advanced tracking capability. Collection of atmospheric statistics is necessary to model and predict performance of Ka-band telemetry links, antenna arrays, and radio science experiments. Since the spectrum of weather variations has power at very long time scales, atmospheric measurements have been requested for periods ranging from one year to a decade at each DSN site. The resulting database would provide reliable statistics on daily, monthly, and seasonal variations. Only long-term monitoring will prevent biases from being introduced by an exceptionally wet or dry year. Support for planetary missions included tropospheric calibration for the recent Mars Observer gravity wave experiments and Ka-band link experiment (KaBLE). Additionally, several proposed radio science experiments such as profiling planetary atmospheres using satellite occultations and Ka-band gravitational wave searches require advanced radiometer technology development. Finally, there has been a consistent advanced technology program to advance satellite navigational and tracking capabilities. This year that included an experiment with radiometer based tropospheric calibration for a series of VLBI catalog measurements.
Explore the source record for details and available documents.
Predicting the moisture durability of building envelope components remains challenging due to multiple influencing factors, including material selection, assembly positioning, local climate conditions, air tightness, interior environment, and construction quality. Building codes increasingly emphasize energy efficiency through enhanced insulation and tighter envelopes but offer limited guidance on moisture durability considerations. Consequently, builders face uncertainty, particularly as new materials and assemblies enter the market.The Building Science Advisor (BSA) is a free, web-based expert system developed to address these challenges by providing actionable insights into the moisture durability and energy efficiency of both new and retrofit wall designs. Recently updated, we are now providing version 3.0 of the tool. BSA features significant user interface improvements, enhancing navigation and user interaction through a refreshed, intuitive design. Additionally, the tool incorporates a newly developed database containing pre-simulated wall assembly cases, significantly reducing response times and improving the accuracy of moisture durability assessments. Furthermore, the updated BSA includes moisture content as a performance criterion, providing users with a more comprehensive understanding of moisture-related durability risks. These enhancements enable rapid, reliable assessments tailored to specific climate zones and local building practices. BSA continues to offer targeted guidance on wall retrofit scenarios and delivers access to an expanded library of location-specific building science resources.This paper describes these key updates, highlighting the enhanced features, expanded capabilities, and overall improvements to user experience and educational content. The paper includes a demonstration that illustrates how the revised BSA effectively supports practitioners in designing durable, energy-efficient building envelope assemblies.
Abstract Substantial progresses in protein structure prediction have been made by utilizing deep‐learning and residue‐residue distance prediction since CASP13. Inspired by the advances, we improve our CASP14 MULTICOM protein structure prediction system by incorporating three new components: (a) a new deep learning‐based protein inter‐residue distance predictor to improve template‐free (ab initio) tertiary structure prediction, (b) an enhanced template‐based tertiary structure prediction method, and (c) distance‐based model quality assessment methods empowered by deep learning. In the 2020 CASP14 experiment, MULTICOM predictor was ranked seventh out of 146 predictors in tertiary structure prediction and ranked third out of 136 predictors in inter‐domain structure prediction. The results demonstrate that the template‐free modeling based on deep learning and residue‐residue distance prediction can predict the correct topology for almost all template‐based modeling targets and a majority of hard targets (template‐free targets or targets whose templates cannot be recognized), which is a significant improvement over the CASP13 MULTICOM predictor. Moreover, the template‐free modeling performs better than the template‐based modeling on not only hard targets but also the targets that have homologous templates. The performance of the template‐free modeling largely depends on the accuracy of distance prediction closely related to the quality of multiple sequence alignments. The structural model quality assessment works well on targets for which enough good models can be predicted, but it may perform poorly when only a few good models are predicted for a hard target and the distribution of model quality scores is highly skewed. MULTICOM is available at https://github.com/jianlin-cheng/MULTICOM_Human_CASP14/tree/CASP14_DeepRank3 and https://github.com/multicom-toolbox/multicom/tree/multicom_v2.0 .
Based on observational estimates and global ocean eddy-resolving coupled retrospective initialized predictions, we show that Kuroshio Extension variability affects rainfall variability along the west coast of North America. We show that the teleconnection between the current undulations and downstream rainfall can lead to improved subseasonal to seasonal predictions of precipitation over California, and we demonstrate that capturing these teleconnections requires coupled systems with sufficient ocean resolution (i.e., eddy-resolving), especially over time scales longer than one season. The improved forecast skill is diagnosed in terms of 35 years of retrospective initialized ensemble forecasts with an ocean eddy-resolving and an ocean eddy-parameterized coupled model. Not only does the ocean eddy-resolving model show sensitivity to Kuroshio Extension variability in terms of western North America precipitation, but the ocean eddy-resolving forecasts also show improved forecast skill compared to the ocean eddy-parameterized model. Additionally, the ocean eddy-parameterized coupled model shows no sensitivity to Kuroshio Extension variability. We also find near-decadal variability associated with a progression of a lower-tropospheric height dipole around the North Pacific and how these height anomalies lead to wind-driven Rossby waves that affect the eddy activity in the Kuroshio Extension with a time lag on the order of four years. This decadal-scale variability (~10 years) opens the possibility of multiyear predictability of western North American rainfall.
Abstract Predicting material’s microstructure under new processing conditions is essential in advanced manufacturing and materials science. This is because the material’s microstructure hugely influences the material’s properties. We demonstrate an elegant machine learning algorithm that faithfully predicts the microstructure under new conditions, without the need of knowing the governing laws. We name this algorithm, RCWGAN-GP, which is regression-based conditional generative adversarial networks with Wasserstein loss function and gradient penalty. This algorithm was trained with experimental SEM micrographs from laser-sintered alumina under various laser powers. The RCWGAN-GP realistically regenerates the SEM micrographs under the trained laser powers. Impressively, it also faithfully predicts the alumina’s microstructure under unexplored laser powers. The predicted microstructure features, including the morphology of the sintered particles and the pores, match the experimental SEM micrographs very well. We further quantitatively examined the prediction accuracy of the RCWGAN-GP. We trained the algorithm with computer-created micrograph datasets of secondary-phase growth governed by the well-known Johnson–Mehl–Avrami (JMA) equation. The RCWGAN-GP accurately regenerates the micrographs at the trained time series, in terms of the grains’ shapes, sizes, and spatial distributions. More importantly, the predicted secondary phase fraction accurately follows the JMA curve.
Abstract Northwestern South America (NWSA) is the rainiest region on Earth, with diurnal precipitation exhibiting extensive westward offshore propagation of up to about 1,200 km in boreal spring (March‐May). The diurnal offshore precipitation propagation begins slowly (3–10 m s −1 ) near the coast of NWSA (<200 km) but accelerates significantly (∼20 m s −1 ) and shows an afternoon enhancement far from the coast (>400 km). However, the driving mechanisms behind this long‐distance precipitation propagation remain unclear. Using a new cloud tracking and classification data set, we found that mesoscale convective systems (MCSs) are the dominant precipitation contributors in the offshore region of NWSA. Cloud tracking shows that the long‐distance propagation and the afternoon enhancement of diurnal precipitation primarily originate from MCSs initiated in the early morning, either over open oceans or from the coast of Central America. Composite tendency analysis shows that MCSs initiated near the coast of Central America have significant upward cooling and moistening signals starting from the surface before initiation. Further analysis of surface diurnal perturbation fields indicates that the land breeze is the primary driving mechanism for MCS initiation. Conversely, for MCSs initiated over open oceans, a significant downward cooling signal from 400 hPa is observed ∼7 hr before initiation, corresponding to the passage of diurnal gravity waves emitted from the Andes. Additionally, our findings highlight the critical role of lower and mid‐level moisture conditions in MCS initiation, alongside the influence of gravity waves.
Africa contains some of the most vulnerable ecosystems to fires. Successful seasonal prediction of fire activity over these fire-prone regions remains a challenge and relies heavily on in-depth understanding of various driving mechanisms underlying fire evolution. Here, we assess the seasonal environmental drivers and predictability of African fire using the analytical framework of Stepwise Generalized Equilibrium Feedback Assessment (SGEFA) and machine learning techniques (MLTs). The impacts of sea-surface temperature, soil moisture, and leaf area index are quantified and found to dominate the fire seasonal variability by regulating regional burning condition and fuel supply. Compared with previously-identified atmospheric and socioeconomic predictors, these slowly evolving oceanic and terrestrial predictors are further identified to determine the seasonal predictability of fire activity in Africa. Our combined SGEFA-MLT approach achieves skillful prediction of African fire one month in advance and can be generalized to provide seasonal estimates of regional and global fire risk.
The present manuscript explores application of machine learning methods for determining elastic constants and other derived mechanical properties of multi-component alloys. Here, a number of machine learning models, including linear regression, neural network and random forest based models, are trained and tested on a dataset of binary alloys generated using density functional theory (DFT) calculations and spanning over a large number of elemental species in the periodic table. Starting with a wide range of simple and easily accessible compositionally-averaged elemental features, a correlation-based feature selection strategy was used to systematically down-select a set of most relevant features towards the prediction of the elasticity tensor components. The true predictive performance and the associated uncertainties of the models were established by testing on unseen data and bootstrapping, respectively. A single and pair-wise feature partial dependence analysis was performed to visualize the average property trends in the multi-dimensional feature space in order to further understand the achieved predictive performance. The utility of the trained model is further demonstrated by obtaining sufficiently accurate yet highly efficient approximations for bulk modulus, Young’s modulus, shear modulus and Poisson’s ratio for alloys beyond the binary space (i.e., two-component alloys) on which the model was originally trained. More importantly, we test and validate the predictive performance of the developed model directly against the experimentally measured elastic constants of technologically relevant multi-component alloys (such as, Ni- and Ti-based alloys). Finally, utility of such a data-enabled route is demonstrated by predicting the possible range of various elastic properties for vast composition space available within the five component Ni-Cr-Fe-Mo-W alloy system in a high-throughput manner.