Search NASA⌕ Search

SEARCH · Search NASA

Results for “active machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Reductive catalytic fractionation of agricultural residue and energy crop lignin and application of lignin oil as antimicrobials

Cheap and abundant waste from bioethanol and agricultural processing industries are an alluring alternative feedstock for biorefineries. In this work, we employ reductive catalytic fractionation (RCF) to depolymerize, over Ru/C powder and Ru/Al 2 O 3 pellets, five herbaceous biomass feedstocks, namely corn stover, miscanthus, switchgrass, sugarcane bagasse, and wheat straw into phenolic monomers with high yields (~40 wt.% based on total (Klason + acid soluble) lignin and > 50 wt.% when stabilized using aldehydes), leaving behind a carbohydrate pulp residue. Interestingly, a polar solvent is sufficient to solubilize and fragment the lignin polymer into monomers without any catalyst. Here, contrary to woody biomass, where the monomer yields are positively correlated with the S-content of lignin, principal component analysis indicates that the monomer yields from herbaceous biomass depend on the content of lignin crosslinker – ferulate. Using NMR, we further identify α – 6 C-C linked oligomers formed from condensation reactions, explaining the unexpected low monomer yields of high β-O-4 herbaceous biomass. Recyclability experiments indicate that catalyst deactivation occurs through sintering, leaching, and fouling. Lignin oil from herbaceous biomass exhibits bacteriostatic effects against Staphylococcus aureus, highlighting a potential application in functional food development and as food or feed preservative.

09 BIOMASS FUELS↗

Quantification of neural networks uncertainties with applications to SAFARI-1 axial neutron flux profiles

Deep Neural Networks (DNNs) have been widely used as a data-driven modelling tool in nuclear engineering. However, as a Machine Learning model, Artificial Neural Network (ANN) predictions are subjected to uncertainties originating from the noise in training data, incomplete coverage of the domain, and imperfect neural network architectures. In this work, we target at quantifying the prediction/approximation uncertainties of ANNs using Monte Carlo Dropout (MCD), as well as Bayesian Neural Networks (BNNs) which are solved by variational inference. With a demonstration problem in which neural networks are used to predict the assembly axial neutron flux profiles, the results have shown that the three different neural network models (regular DNNs, DNNs solved with MCD and BNNs) can produce results that agree very well among each other and with the measurement data, on cycles that are not used in the training process. Besides the excellent generalization capability, the uncertainty bands produced by MCD and BNN agree very well, and in general, they can fully envelop the noisy measurement data points. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Architecture for Adaptive Intelligent Systems

We identify a class of niches to be occupied by 'adaptive intelligent systems (AISs)'. In contrast with niches occupied by typical AI agents, AIS niches present situations that vary dynamically along several key dimensions: different combinations of required tasks, different configurations of available resources, contextual conditions ranging from benign to stressful, and different performance criteria. We present a small class hierarchy of AIS niches that exhibit these dimensions of variability and describe a particular AIS niche, ICU (intensive care unit) patient monitoring, which we use for illustration throughout the paper. We have designed and implemented an agent architecture that supports all of different kinds of adaptation by exploiting a single underlying theoretical concept: An agent dynamically constructs explicit control plans to guide its choices among situation-triggered behaviors. We illustrate the architecture and its support for adaptation with examples from Guardian, an experimental agent for ICU monitoring.

ACTIVE CONTROL↗

Automated Knowledge Discovery from Simulators

In this paper, we explore one aspect of knowledge discovery from simulators, the landscape characterization problem, where the aim is to identify regions in the input/ parameter/model space that lead to a particular output behavior. Large-scale numerical simulators are in widespread use by scientists and engineers across a range of government agencies, academia, and industry; in many cases, simulators provide the only means to examine processes that are infeasible or impossible to study otherwise. However, the cost of simulation studies can be quite high, both in terms of the time and computational resources required to conduct the trials and the manpower needed to sift through the resulting output. Thus, there is strong motivation to develop automated methods that enable more efficient knowledge extraction.

landscapes↗

Discovery of structure–property relations for molecules via hypothesis-driven active learning over the chemical space

The discovery of the molecular candidates for application in drug targets, biomolecular systems, catalysts, photovoltaics, organic electronics, and batteries necessitates the development of machine learning algorithms capable of rapid exploration of chemical spaces targeting the desired functionalities. Here, we introduce a novel approach for active learning over the chemical spaces based on hypothesis learning. We construct the hypotheses on the possible relationships between structures and functionalities of interest based on a small subset of data followed by introducing them as (probabilistic) mean functions for the Gaussian process. This approach combines the elements from the symbolic regression methods, such as SISSO and active learning, into a single framework. The primary focus of constructing this framework is to approximate physical laws in an active learning regime toward a more robust predictive performance, as traditional evaluation on hold-out sets in machine learning does not account for out-of-distribution effects which may lead to a complete failure on unseen chemical space. Here, we demonstrate it for the QM9 dataset, but it can be applied more broadly to datasets from both domains of molecular and solid-state materials sciences.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine learning prediction and experimental verification of Pt-modified nitride catalysts for ethanol reforming with reduced precious metal loading

Ethanol is the smallest molecule containing C–O, C–C, C–H, and O–H bonds present in biomass-derived oxygenates. The development of inexpensive and selective catalysts for ethanol reforming is important towards the renewable generation of hydrogen from biomass. Transition metal nitrides (TMN) are interesting catalyst support materials that can effectively reduce precious metal loading for the catalysis of ethanol and other oxygenates. Herein theoretical and experimental methods were used to probe platinum-modified molybdenum nitride (Pt/Mo 2 N) surfaces for ethanol reforming. Computations using density-functional theory and machine learning predicted monolayer Pt/Mo 2 N to be highly active and selective for ethanol reforming. Temperature-programmed desorption (TPD) experiments verified that ethanol primarily underwent decomposition on Mo 2 N, and the reaction pathway shifted to reforming on Pt/Mo 2 N surfaces. Additionally, high-resolution electron energy loss spectroscopy (HREELS) results further indicated that while Mo2N decomposed the ethoxy intermediate by cleaving C–C, C–O, and C–H bonds, Pt-modification preserved the C–O bond, resulting in ethanol reforming.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Experimentally Driven Automated Machine-Learned Interatomic Potential for a Refractory Oxide

Understanding the structure and properties of refractory oxides is critical for high temperature applications. In this work, a combined experimental and simulation approach uses an automated closed loop via an active learner, which is initialized by x-ray and neutron diffraction measurements, and sequentially improves a machine-learning model until the experimentally predetermined phase space is covered. Furthermore, a multiphase potential is generated for a canonical example of the archetypal refractory oxide, HfO 2 , by drawing a minimum number of training configurations from room temperature to the liquid state at similar to 2900 degrees C. The method significantly reduces model development time and human effort.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Insights into Prismatic Loop Formation in Irradiated Fe–Cr Alloys from Hypothesis-Driven Active Learning and Causal Analysis

Neutron and electron irradiation experimental studies conducted on body-centered cubic Fe and Fe–Cr alloys have established two prismatic dislocation loop populations, which have Burgers vectors of either a/2$\langle$111$\rangle$ or a$\langle$100$\rangle$. Here, the loop formation depends on factors such as dose (D), dose rate (D rt ), temperature (T), chromium content (Cr%), and other alloying elements. Hence, it is important to understand how irradiation-induced dislocation loops evolve conditional upon the loop characteristics, such as loop density (DD), average loop size d̅, and irradiation parameters (D, D rt , T, and irradiation type), which is still an active area of research. To understand these complex structure–property relationships, machine learning (ML) is employed in a three-step approach. This includes imputing missing data with a k-nearest neighbor, generating functionalized features, and assessing feature importance with random forest classification and regression. Physics-based features are incorporated in a hypothesis-driven active learning scheme to overcome data unavailability challenges. Insights obtained from ML models (i) to categorize dislocation loop types, show the highest correlation with d̅; (ii) Log(DD), obtained through mathematical formulations involving D, Cr%, d̅, and T (e.g., Log(DD) ~ D + exp(-Cr%) + 1/d̅ and log(DD) ~ D + exp(-Cr%) + 1/T). Hypothesis-driven active learning is able to predict Log(DD) in which the experimental date is not known. Causal models verify cause–effect relationships for dislocation loop classification and irradiation factors in FeCr alloys.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Advancing Fusion with Machine Learning Research Needs Workshop

The pursuit of fusion energy has required extensive experimental and theoretical science activities to develop the knowledge needed that will enable design of successful fusion power plants. Even today, following decades of research in many key areas including plasma physics and material science, much remains to be learned to enable optimization of the tokamak or other paths to fusion energy. Data science methods from the fields of machine learning and artificial intelligence (ML/AI) offer opportunities for enabling or accelerating progress toward the realization of fusion energy by maximizing the amount and usefulness of information extracted from experimental and simulation output data. Jointly supported by the Department of Energy Offices of Fusion Energy Science (FES) and Advanced Scientific Computing Research (ASCR), a workshop was organized to identify Priority Research Opportunities (PRO’s) for application of ML/AI methods to enable accelerated solution of fusion problems. The resulting “Advancing Fusion with Machine Learning Research Needs Workshop,” held in Gaithersburg, MD, April 30 – May 2, 2019, brought together ~ 60 experts in fields spanning fusion science, data science, statistical inference and mathematics, machine learning, and artificial intelligence, along with DOE program managers and technical experts, to identify key PRO’s.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Identification of the Selective Sites for Electrochemical Reduction of CO to C 2+ Products on Copper Nanoparticles by Combining Reactive Force Fields, Density Functional Theory, and Machine Learning

Recent experiments have shown that CO reduction on oxide derived Cu nanoparticles (NP) are highly selective toward C 2+ products. However, understanding of the active sites on such NPs is limited, because the NPs have ~200 000 atoms with more than 10 000 surface sites, far too many for direct quantum mechanical calculations and experimental identifications. We show here how to overcome the computational limitation by combining multiple levels of theoretical computations with machine learning. This approach allows us to map the machine learned CO adsorption energies on the surface of the copper nanoparticle to construct the active site visualization (ASV). Furthermore, we identify the structural criteria for optimizing selective reduction by predicting the reaction energies of the potential determining step, $ΔE_{OCCOH}$, for the C 2+ product. Based on this structural criterion, we design a new periodic copper structure for CO reduction with a theoretical faradaic efficiency of 97%.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Machine Learning Framework for Modeling Ensemble Properties of Atomically Disordered Materials

Atomic disorder can strongly influence material properties such as charge transport, optical response, and catalytic activity. However, efficiently modeling these disorder effects remains challenging for first-principles methods due to the cost of sampling large configurational spaces and computing complex physical quantities. Recent advances of machine learning techniques, particularly graph neural networks (GNNs), has enabled the efficient and accurate predictions of complex material properties, offering promising tools for studying disordered systems. In this work, we present a general machine-learning-assisted computational framework that integrates equivariant GNNs with Monte Carlo simulations to compute the thermodynamic and ensemble-averaged functional properties of disordered materials. Using the surface-termination-disordered MXene monolayer Ti 3 C 2 T 2–x as a representative system, we find that electrical conductivity exhibits an emergent peak near the order–disorder phase transition temperature due to the interplay between electron scattering and doping. In contrast, optical conductivity remains largely insensitive to local atomic disorder and reflects the global surface chemical composition. These results highlight the role of atomic disorder in affecting material properties and demonstrate the potential of our approach for statistically modeling disorder effects in a wide range of materials such as high-entropy alloys and spin liquids.

MXene↗

Active Learning for Anomaly Detection in Environmental data

Due to the growing amount of data from in-situ sensors in environmental monitoring, it becomes necessary to automatically detect anomalous data points. Nowadays, this is mainly performed using supervised machine learning models, which need a fully labelled data set for their training process. However, the process of labelling data is typically cumbersome and, as a result, a hindrance to the adoption of machine learning methods for automated anomaly detection. In this work, we propose to address this challenge by means of active learning. This method consists of querying the domain expert for the labels of only a selected subset of the full data set. We show that this reduces the time and costs associated to labelling while delivering the same or similar anomaly detection performances. Finally, we also show that machine learning models providing a nonlinear classification boundary are to be recommended for anomaly detection in complex environmental data sets.

54 ENVIRONMENTAL SCIENCES↗

Prediction of Specificity of α-Conotoxins to Subtypes of Human Nicotinic Acetylcholine Receptors with Semi-supervised Machine Learning

Conotoxins are a family of highly toxic neurotoxins composed of cysteine-rich peptides produced by marine cone snails. The most lethal cone snail species to humans is Conus geographus, with fatality rates of up to ∼65% from a single sting, which is caused mostly by the activity of α-conotoxins against human nicotinic acetylcholine receptors (nAChRs). While sequence-based machine learning (ML) classifiers have been trained to identify targets of conotoxins binding voltage-gated ion channels, no ML model has been built to predict the subtype-specific nAChR targets of α-conotoxins. Here, we trained an ML model in a semi-supervised manner to predict the specificity of α-conotoxin binding toward different human nAChR subtypes to overcome the challenge of limited data in subtype-specific nAChR targets of α-conotoxins and the issue that one α-conotoxin can bind multiple nAChR subtypes with high selectivity. We considered additional features of sequences of α-conotoxins in training our ML model, including the secondary structure propensities and electrostatic properties, which resulted in better prediction capability for the ML model. Notably, we identify that most α-conotoxins bind to α3β2, α1γδ, and α7 subtypes of human nAChRs. Our findings from this study provide a framework for predicting targets of various kinds of toxins.

59 BASIC BIOLOGICAL SCIENCES↗

ACTIVE LEARNING TO OVERCOME SAMPLE SELECTION BIAS: APPLICATION TO PHOTOMETRIC VARIABLE STAR CLASSIFICATION

Despite the great promise of machine-learning algorithms to classify and predict astrophysical parameters for the vast numbers of astrophysical sources and transients observed in large-scale surveys, the peculiarities of the training data often manifest as strongly biased predictions on the data of interest. Typically, training sets are derived from historical surveys of brighter, more nearby objects than those from more extensive, deeper surveys (testing data). This sample selection bias can cause catastrophic errors in predictions on the testing data because (1) standard assumptions for machine-learned model selection procedures break down and (2) dense regions of testing space might be completely devoid of training data. We explore possible remedies to sample selection bias, including importance weighting, co-training, and active learning (AL). We argue that AL-where the data whose inclusion in the training set would most improve predictions on the testing set are queried for manual follow-up-is an effective approach and is appropriate for many astronomical applications. For a variable star classification problem on a well-studied set of stars from Hipparcos and Optical Gravitational Lensing Experiment, AL is the optimal method in terms of error rate on the testing data, beating the off-the-shelf classifier by 3.4% and the other proposed methods by at least 3.0%. To aid with manual labeling of variable stars, we developed a Web interface which allows for easy light curve visualization and querying of external databases. Finally, we apply AL to classify variable stars in the All Sky Automated Survey, finding dramatic improvement in our agreement with the ASAS Catalog of Variable Stars, from 65.5% to 79.5%, and a significant increase in the classifier's average confidence for the testing set, from 14.6% to 42.9%, after a few AL iterations.

79 ASTRONOMY AND ASTROPHYSICS↗

Screening of bimetallic electrocatalysts for water purification with machine learning

Electrocatalysis provides a potential solution to NO 3 - pollution in wastewater by converting it to innocuous N 2 gas. However, materials with excellent catalytic activity are typically limited to expensive precious metals, hindering their commercial viability. Here, in response to this challenge, we have conducted the most extensive computational search to date for electrocatalysts that can facilitate NO 3 - reduction reaction, starting with 59 390 candidate bimetallic alloys from the Materials Project and Automatic-Flow databases. Using a joint machine learning- and computation-based screening strategy, we evaluated our candidates based on corrosion resistance, catalytic activity, N 2 selectivity, cost, and the ability to synthesize. We found that only 20 materials will satisfy all criteria in our screening strategy, all of which contain varying amounts of Cu. Our proposed list of candidates is consistent with previous materials investigated in the literature, with the exception of Cu–Co and Cu–Ag based compounds that merit further investigation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

MAGNETIC NONPOTENTIALITY IN PHOTOSPHERIC ACTIVE REGIONS AS A PREDICTOR OF SOLAR FLARES

Based on several magnetic nonpotentiality parameters obtained from the vector photospheric active region magnetograms obtained with the Solar Magnetic Field Telescope at the Huairou Solar Observing Station over two solar cycles, a machine learning model has been constructed to predict the occurrence of flares in the corresponding active region within a certain time window. The Support Vector Classifier, a widely used general classifier, is applied to build and test the prediction models. Several classical verification measures are adopted to assess the quality of the predictions. We investigate different flare levels within various time windows, and thus it is possible to estimate the rough classes and erupting times of flares for particular active regions. Several combinations of predictors have been tested in the experiments. The True Skill Statistics are higher than 0.36 in 97% of cases and the Heidke Skill Scores range from 0.23 to 0.48. The predictors derived from longitudinal magnetic fields do perform well, however, they are less sensitive in predicting large flares. Employing the nonpotentiality predictors from vector fields improves the performance of predicting large flares of magnitude {>=}M5.0 and {>=}X1.0.

79 ASTRONOMY AND ASTROPHYSICS↗

(Active) Learning on Groups of Data with Information-Theoretic Estimators

A wide range of machine learning problems, including astronomical inference about galaxy clusters, scene classification, parametric statistical inference, and predictions of public opinion, can be well-modeled as learning a function on (samples from) distributions. This project explores problems in learning such functions via kernel methods, particularly for large-scale problems. When learning from large numbers of distributions, the computation of typical methods scales between quadratically and cubically, and so they are not amenable to large datasets. We investigate the approach of approximate embeddings into Euclidean spaces such that inner products in the embedding space approximate kernel values between the source distributions. We first improve the understanding of the workhorse methods of random Fourier features: we show that of the two approaches in common usage, one is strictly superior. We then present a new embedding for a class of information-theoretic distribution distances, and evaluate it and existing embeddings on several real-world applications.

97 MATHEMATICS AND COMPUTING↗

Data Analytics for SAR

We assess the ability of variants of anomalous change detection (ACD) to identify human activity associated with large outdoor music festivals as they are seen from synthetic aperture radar (SAR) imagery collected by the Sentinel-1 satellite constellation. We found that, with appropriate feature vectors, ACD using random-forest machine learning was most effective at identifying changes associated with the human activity.

47 OTHER INSTRUMENTATION↗