Search NASA⌕ Search

SEARCH · Search NASA

Results for “active machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

Explaining machine-learning models for gamma-ray detection and identification

As more complex predictive models are used for gamma-ray spectral analysis, methods are needed to probe and understand their predictions and behavior. Recent work has begun to bring the latest techniques from the field of Explainable Artificial Intelligence (XAI) into the applications of gamma-ray spectroscopy, including the introduction of gradient-based methods like saliency mapping and Gradient-weighted Class Activation Mapping (Grad-CAM), and black box methods like Local Interpretable Model-agnostic Explanations (LIME) and SHapley Additive exPlanations (SHAP). In addition, new sources of synthetic radiological data are becoming available, and these new data sets present opportunities to train models using more data than ever before. In this work, we use a neural network model trained on synthetic NaI(Tl) urban search data to compare some of these explanation methods and identify modifications that need to be applied to adapt the methods to gamma-ray spectral data. We find that the black box methods LIME and SHAP are especially accurate in their results, and recommend SHAP since it requires little hyperparameter tuning. We also propose and demonstrate a technique for generating counterfactual explanations using orthogonal projections of LIME and SHAP explanations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Developing a Descriptor-Based Approach for CO and NO Adsorption Strength to Transition Metal Sites in Zeolites

The discovery of new materials tailored for a given application typically requires the screening of a large number of compounds, and this process can be significantly accelerated by computational analysis. In such an approach the performance of a compound is correlated to a materials property, a so-called descriptor. Here we develop a descriptor-based approach for the adsorption of CO and NO to Cu, Ni, Co, and Fe sites in zeolites. Here we start out by discussing a possible design strategy for zeolite catalysts, define the studied test set of sites in the zeolites SSZ-13 and mordenite, and define a set of appropriate descriptors. In a subsequent step we use these descriptors in single-parameter, two-parameter, and multiparameter regression analysis and finally use a machine-learning genetic algorithm to reduce the number of variables. We find that one or two descriptors are not sufficient to accurately capture the interactions between molecules and metal centers in zeolites, and indeed a multiparameter approach is necessary. Even though many of the descriptors are directly correlated, we identify the position of the s orbital and the number of valence electrons of the active site as well as the HOMO–LUMO gap of the adsorbate as most important descriptors. Furthermore, the reconstruction of the active sites upon adsorption plays a crucial role, and when it is explicitly included in the analysis, correlations improve significantly. In the future we expect that the fundamental methodology developed here will be adapted and transferred to selected problems in adsorption and catalysis and will assist the rational design of materials for the given application.

36 MATERIALS SCIENCE↗

Machine-learning-revealed statistics of the particle-carbon/binder detachment in lithium-ion battery cathodes

The microstructure of a composite electrode determines how individual battery particles are charged and discharged in a lithium-ion battery. It is a frontier challenge to experimentally visualize and, subsequently, to understand the electrochemical consequences of battery particles’ evolving (de)attachment with the conductive matrix. Herein, we tackle this issue with a unique combination of multiscale experimental approaches, machine-learning-assisted statistical analysis, and experiment-informed mathematical modeling. Our results suggest that the degree of particle detachment is positively correlated with the charging rate and that smaller particles exhibit a higher degree of uncertainty in their detachment from the carbon/binder matrix. We further explore the feasibility and limitation of utilizing the reconstructed electron density as a proxy for the state-of-charge. Our findings highlight the importance of precisely quantifying the evolving nature of the battery electrode’s microstructure with statistical confidence, which is a key to maximize the utility of active particles towards higher battery capacity.

25 ENERGY STORAGE↗

Deep Learning for Unsupervised Insider Threat Detection in Structured Cyber Security Data Streams

Analysis of an organization's computer network activity is a key component of early detection and mitigation of insider threat, a growing concern for many organizations. Raw system logs are a prototypical example of streaming data that can quickly scale beyond the cognitive power of a human analyst. As a prospective filter for the human analyst, we present an online unsupervised deep learning approach to detect anomalous network activity from system logs in real time. Our models decompose anomaly scores into the contributions of individual user behavior features for increased interpretability to aid analysts reviewing potential cases of insider threat. Using the CERT Insider Threat Dataset v6.2 and threat detection recall as our performance metric, our novel deep and recurrent neural network models outperform Principal Component Analysis, Support Vector Machine and Isolation Forest based anomaly detection baselines. For our best model, the events labeled as insider threat activity in our dataset had an average anomaly score in the 95.53 percentile, demonstrating our approach's potential to greatly reduce analyst workloads.

Deep Learning, Insider Threat↗

Recurrent Convolutional Deep Neural Networks for Modeling Time-Resolved Wildfire Spread Behavior

The increasing incidence and severity of wildfires underscores the necessity of accurately predicting their behavior. While high-fidelity models derived from first principles offer physical accuracy, they are too computationally expensive for use in real-time fire response. Low-fidelity models sacrifice some physical accuracy and generalizability via the integration of empirical measurements, but enable real-time simulations for operational use in fire response. Machine learning techniques have demonstrated the ability to bridge these objectives by learning first-principles physics while achieving computational speedups. While deep learning approaches have demonstrated the ability to predict wildfire propagation over large time periods, time-resolved fire-spread predictions are needed for active fire management. Here, in this work, we evaluate the ability of deep learning approaches in accurately modeling the time-resolved dynamics of wildfires. We use an autoregressive process in which a convolutional recurrent deep learning model makes predictions that propagate a wildfire over 15 min increments. We apply the model to four simulated datasets of increasing complexity, containing both field fires with homogeneous fuel distribution as well as real-world topologies sampled from the California region of the United States. We show that even after 100 autoregressive predictions representing more than 24 h of simulated fire spread, the resulting models generate stable and realistic propagation dynamics, achieving a Jaccard score between 0.89 and 0.94 when predicting the resulting fire scar. The inference time of the deep learning models are examined and compared, and directions for future work are discussed.

54 ENVIRONMENTAL SCIENCES↗

Application of machine learning interatomic potentials in heterogeneous catalysis

Heterogeneous catalysts are crucial in modern societies as they promote sustainability by enabling lower-energy pathways for various chemical reactions. While Density Functional Theory (DFT) computations can provide critical insights into how heterogeneous catalysts operate at the atomic level, they are limited by computational costs and unfavorable scaling with system size. Recently, machine learning interatomic potentials (MLIPs) have emerged as a promising alternative to DFT, offering near-DFT accuracy at significantly reduced cost. Here, in this perspective, we discuss the application of MLIPs in heterogeneous catalyst modeling as a surrogate for DFT. We detail how MLIPs have been applied in thermal catalysis to probe active sites, enable studying complex metallic and nanoporous catalysts, and investigate the reconstruction of catalytic surfaces. We review the use of MLIPs in electrocatalysis and photocatalysis, emphasizing their capabilities in studying transition metal oxide surfaces and solid–liquid interfaces. We also discuss the current limitations of MLIPs, particularly their challenges with transferability and description of non-local interactions. Finally, we conclude by identifying promising and underexplored domains in which MLIPs can further advance our understanding of heterogeneous catalysts.

Catalytic surfaces↗

In vivo mapping of mutagenesis sensitivity of human enhancers

Distant-acting enhancers are central to human development1. However, our limited understanding of their functional sequence features prevents the interpretation of enhancer mutations in disease2. Here we determined the functional sensitivity to mutagenesis of human developmental enhancers in vivo. Focusing on seven enhancers that are active in the developing brain, heart, limb and face, we created over 1,700 transgenic mice for over 260 mutagenized enhancer alleles. Systematic mutation of 12-base-pair blocks collectively altered each sequence feature in each enhancer at least once. We show that 69% of all blocks are required for normal in vivo activity, with mutations more commonly resulting in loss (60%) than in gain (9%) of function. Using predictive modelling, we annotated critical nucleotides at the base-pair resolution. The vast majority of motifs predicted by these machine learning models (88%) coincided with changes in in vivo function, and the models showed considerable sensitivity, identifying 59% of all functional blocks. Taken together, our results reveal that human enhancers contain a high density of sequence features that are required for their normal in vivo function and provide a rich resource for further exploration of human enhancer logic.

Kosicki, Michael↗

On the quenching of star formation in observed and simulated central galaxies: evidence for the role of integrated AGN feedback

ABSTRACT In this paper, we investigate how massive central galaxies cease their star formation by comparing theoretical predictions from cosmological simulations: EAGLE, Illustris, and IllustrisTNG with observations of the local Universe from the Sloan Digital Sky Survey (SDSS). Our machine learning (ML) classification reveals supermassive black hole mass (MBH) as the most predictive parameter in determining whether a galaxy is star forming or quenched at redshift z = 0 in all three simulations. This predicted consequence of active galactic nucleus (AGN) quenching is reflected in the observations, where it is true for a range of indirect estimates of MBH via proxies as well as its dynamical measurements. Our partial correlation analysis shows that other galactic parameters lose their strong association with quiescence, once their correlations with MBH are accounted for. In simulations, we demonstrate that it is the integrated power output of the AGN, rather than its instantaneous activity, which causes galaxies to quench. Finally, we analyse the change in molecular gas content of galaxies from star-forming to passive populations. We find that both gas fractions (fgas) and star formation efficiencies (SFEs) decrease upon transition to quiescence in the observations but SFE is more predictive than fgas in the ML passive/star-forming classification. These trends in the SDSS are most closely recovered in IllustrisTNG and are in direct contrast with the predictions made by Illustris. We conclude that a viable AGN feedback prescription can be achieved by a combination of preventative feedback and turbulence injection which together quench star formation in central galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗

Classification of HTTP Attacks: A Study on the ECML/PKDD 2007 Discovery Challenge

As the world becomes more reliant on Web applications for commercial, financial, and medical transactions, cyber attacks on the World Wide Web are increasing in frequency and severity. Web applications provide an attractive alternative to traditional desktop applications due to their accessibility and ease of deployment. However, the accessibility of Web applications also makes them extremely vulnerable to attack. This inherent vulnerability is intensified by the distributed nature ofWeb applications and the complexity of configuring application servers. These factors have led to a proliferation of Web-based attacks, in which attackers surreptitiously inject code into HTTP requests, allowing them to execute arbitrary commands on remote systems and perform malicious activities such as reading, altering, or destroying sensitive data. One approach for dealing with HTTP-based attacks is to identify malicious code in incoming HTTP requests and eliminate bad requests before they are processed. Using machine learning techniques, we can build a classifier to automatically label requests as “Valid” or “Attack.” For this study, we develop a simple, but effective HTTP attack classifier, based on the vector space model used commonly for Information Retrieval. Our classifier not only separates attacks from valid requests, but can also identify specific attack types (e.g., “SQL Injection” or “Path Traversal”). We demonstrate the effectiveness of our approach through experiments on the ECML/PKDD 2007 Discovery Challenge data set. Specifically, we show that our approach achieves higher precision and recall than previous methods. In addition, our approach has a number of desirable characteristics, including robustness to missing contextual information, interpretability of models, and scalability.

97 MATHEMATICS AND COMPUTING↗

Evaluating Compliance Inspection Data to Understand Emissions from Marginal Conventional Oil & Gas Wells in New York State

It is estimated that over half (~66%) of active oil and gas wells are marginally productive, producing less than 15 barrels of oil equivalent per day. This presentation showcases an evaluation of New York State compliance inspection reports and discusses the current capabilities of machine learning to identify high-risk MCWs that could be targeted during methane emission reduction efforts and future model deployments. Findings are valuable to the New York Department of Environmental Conservation and other state oil and gas regulatory agencies seeking to prioritize the spending of Methane Emission Reduction Program funds to plug marginal conventional wells with emissions.

compliance inspection data↗

Importance of Engineered and Learned Molecular Representations in Predicting Organic Reactivity, Selectivity, and Chemical Properties

Machine-readable chemical structure representations are foundational in all attempts to harness machine learning for the prediction of reactivities, selectivities, and chemical properties directly from molecular structure. The featurization of discrete chemical structures into a continuous vector space is a critical phase undertaken before model selection, and the development of new ways to quantitatively encode molecules is an active area of research. Here, we highlight the application and suitability of different representations, from expert-guided “engineered” descriptors to automatically “learned” features, in different prediction tasks relevant to organic and organometallic chemistry, where differing amounts of training data are available. These tasks include statistical models of stereo- and enantioselectivity, thermochemistry, and kinetics developed using experimental and quantum chemical data. The use of expert-guided molecular descriptors provides an opportunity to incorporate chemical knowledge, domain expertise, and physical constraints into statistical modeling. In applications to stereoselective organic and organometallic catalysis, where data sets may be relatively small and 3D-geometries and conformations play an important role, mechanistically informed features can be used successfully to obtain predictive statistical models that are also chemically interpretable. We provide an overview of several recent applications of this approach to obtain quantitative models for reactivity and selectivity, where topological descriptors, quantum mechanical calculations of electronic and steric properties, along with conformational ensembles, all feature as essential ingredients of the molecular representations used. Alternatively, more flexible, general-purpose molecular representations such as attributed molecular graphs can be used with machine learning approaches to learn the complex relationship between a structure and prediction target. This approach has the potential to out-perform more traditional representation methods such as “hand-crafted” molecular descriptors, particularly as data set sizes grow. One area where this is particularly relevant is in the use of large sets of quantum mechanical data to train quantitative structure–property relationships. A general approach toward curating useful data sets and training highly accurate graph neural network models is discussed in the context of organic bond dissociation enthalpies, where this strategy outperforms regression using precomputed descriptors. Finally, we describe how graph neural network predictions can be incorporated into mechanistically informed statistical models of chemical reactivity and selectivity. Once trained, this approach avoids the expensive computational overhead associated with quantum mechanical calculations, while maintaining chemical interpretability. We illustrate examples for which fast predictions of bond dissociation enthalpy and of the identities of radicals formed through cleavage of a molecule’s weakest bond are used in simple physical models of site-selectivity and reactivity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Thermodynamic properties of the Nd-Bi system via emf measurements, $\mathrm{DFT}$ calculations, machine learning, and $\mathrm{CALPHAD}$ modeling

Thermodynamic properties of the Nd-Bi system were investigated using a combination of experimental measurements, first-principles calculations based on density functional theory (DFT), data mining and machine learning (DM + ML) predictions, and calculation of phase diagrams (CALPHAD) modeling. The electromotive force (emf) of Nd-Bi alloys in molten LiCl-KCl-NdCl 3 at 773–973 K was measured via coulometric titration of Nd into Bi for the determination of thermochemical properties such as activity coefficients and solubilities of Nd in Bi. A new peritectic reaction of [liquid + NdBi 2 = Nd 3 Bi 7 ] at 774 K was confirmed using differential scanning calorimetry, structural (X-ray diffraction), and microstructural (scanning electron microscopy) analyses. The unknown crystal structure of NdBi2 was suggested to be a mixture of the anti-La 2 Sb configuration and the La 2 Te-type configuration based on ML predictions for over 26,000 data-mined AB 2 -type configurations together with DFT-based verifications. Using the newly acquired experimental data and DFT-based calculations, the thermodynamic description of the Nd-Bi system was remodeled, and a more complete Nd-Bi phase diagram was calculated, including the Nd 3 Bi 7 compound, invariant transition reactions, and liquidus temperatures.

36 MATERIALS SCIENCE↗

A hybrid numerical and machine learning framework for evaluating the performance of a 780 cm 2 aqueous organic redox flow battery

Aqueous organic redox flow battery (AORFB) is a promising cost-competitive technology for large-scale energy storage. Among existing work, the dihydroxyphenazine (DHP)-based AORFB has demonstrated high energy density and low capacity degradation in 10 cm2 cells during lab tests. However, its commercial-scale performance in more complex environments remains unknown, posing a barrier for commercialization. To address this gap, this work presents a comprehensive performance evaluation of a 780 cm 2 DHP-based AORFB by combining physics-based numerical model, machine learning (ML)-based surrogate models, and ML-derived sensitivity quantification. Specifically, we first select 12 key battery parameters that include 10 physicochemical quantities and 2 operation quantities, then select 6 performance metrics that include energy efficiency (EE), discharging capacity, charging energy, and power losses due to concentration, activation, and ohmic over-potentials. With such selection, 12800 combinations of the 12 parameters are subsequently generated using the Latin Hypercube Sampling method. These combinations, together with 38 pre-defined State of Charge, are then integrated to a validated AORFB model developed in COMSOL to compute the performance metrics. With both input parameters and performance metrics, 60 deep neural network (DNN) surrogate models are then trained to approximate the relationship between the 10 physicochemical quantities and 6 performance metrics at each flow rate and current density. Sensitivity scores are then calculated based on the DNN models. Two additional sensitivity analysis tools, i.e., MARS, and SHAP, are also used to cross-validate the sensitivity scores from the DNN. The results demonstrate that 1) the standard potential ranks the first in controlling EE and charging energy, 2) the membrane conductivity is most critical for power loss and EE, and 3) specific area and reaction rate control activation power loss.

25 ENERGY STORAGE↗

Predicting Solar Energetic Particles Using SDO/HMI Vector Magnetic Data Products and a Bidirectional LSTM Network

Solar energetic particles (SEPs) are an essential source of space radiation, and are hazardous for humans in space, spacecraft, and technology in general. In this paper, we propose a deep-learning method, specifically a bidirectional long short-term memory (biLSTM) network, to predict if an active region (AR) would produce an SEP event given that (i) the AR will produce an M- or X-class flare and a coronal mass ejection (CME) associated with the flare, or (ii) the AR will produce an M- or X-class flare regardless of whether or not the flare is associated with a CME. The data samples used in this study are collected from the Geostationary Operational Environmental Satellite's X-ray flare catalogs provided by the National Centers for Environmental Information. We select M- and X-class flares with identified ARs in the catalogs for the period between 2010 and 2021, and find the associations of flares, CMEs, and SEPs in the Space Weather Database of Notifications, Knowledge, Information during the same period. Each data sample contains physical parameters collected from the Helioseismic and Magnetic Imager on board the Solar Dynamics Observatory. Experimental results based on different performance metrics demonstrate that the proposed biLSTM network is better than related machine-learning algorithms for the two SEP prediction tasks studied here. We also discuss extensions of our approach for probabilistic forecasting and calibration with empirical evaluation

79 ASTRONOMY AND ASTROPHYSICS↗

Battery calendar aging and machine learning

Batteries continue to attract immense attention due to the critical need for new energy technologies that can help humankind transition to a net-zero future. To meet global goals for implementation of new batteries, the research community needs to more coherently consider how to go about the process of innovation, development, and validation of new technologies. Current practices for bringing a new battery technology from the benchtop to deployment can be very time consuming and complex, given that batteries can have distinct aging pathways based on both how they are cycled and their storage conditions. In nearly all use cases, batteries experience periods of active cycling and also extended periods of rest. Thus, calendar time often occurs when a battery is close to fully charged. Currently, the combined cycle and calendar life aspects receive inconsistent attention during most stages of research and development. For batteries to fulfill the critical role envisioned to meet global energy demands, greater uniformity in practice is needed to alleviate potential delays caused by the inconsistent acquisition of aging data. In this study, we present our thoughts and recommendations on the need to further advance commonality and availability of calendar aging data for emerging high-energy and long-duration batteries. While there is a broad need to adopt best practices for both calendar and cycle life assessment, a push to greater uniformity in approach and reporting is sorely needed to allow calendar life predictions to harness many of the advances that have recently been seen for cycle life prediction using machine learning (ML) and other techniques.

25 ENERGY STORAGE↗

Deep data analytics for genetic engineering of diatoms linking genotype to phenotype via machine learning

Abstract Genome engineering for materials synthesis is a promising avenue for manufacturing materials with unique properties under ambient conditions. Biomineralization in diatoms, unicellular algae that use silica to construct micron-scale cell walls with nanoscale features, is an attractive candidate for functional synthesis of materials for applications including photonics, sensing, filtration, and drug delivery. Therefore, controllably modifying diatom structure through targeted genetic modifications for these applications is a very promising field. In this work, we used gene knockdown in Thalassiosira pseudonana diatoms to create modified strains with changes to structural morphology and linked genotype to phenotype using supervised machine learning. An artificial neural network (NN) was developed to distinguish wild and modified diatoms based on the SEM images of frustules exhibiting phenotypic changes caused by a specific protein (Thaps3_21880), resulting in 94% detection accuracy. Class activation maps visualized physical changes that allowed the NNs to separate diatom strains, subsequently establishing a specific gene that controls pores. A further NN was created to batch process image data, automatically recognize pores, and extract pore-related parameters. Class interrelationship of the extracted paraments was visualized using a multivariate data visualization tool, called CrossVis, and allowed to directly link changes in morphological diatom phenotype of pore size and distribution with changes in the genotype.

59 BASIC BIOLOGICAL SCIENCES↗

Analytics-at-scale of Sensor Data for Digital Monitoring in Nuclear Plants: 2nd Annual Report

For economic reasons, the nuclear industry is witnessing premature closure of nuclear power plants, despite excellent safety records. Operations and Maintenance (O&M) activities are some of the largest costs in operating legacy light-water plants. By reducing O&M costs, nuclear energy can become more economically competitive with other energy sources. This can be achieved by leveraging machine-learning and artificial intelligence technologies to develop data-driven algorithms to better diagnose potential faults within the system. Improved accuracy of the models can lead to a reduction in unnecessary maintenance, thus reducing costs associated with parts, labor, and unnecessary planned, forced, or extended outages. To address these challenges, the goal of this project is to perform research and development in the area of digital monitoring, i.e., the application of advanced sensor technologies (particularly wireless sensor technologies) and data science based analytic capabilities, to advance online monitoring and predictive maintenance in nuclear plants and improve plant performance (efficiency gain and economic competitiveness). This report summarizes the fiscal year 2020 research progress encompassing (1) different wireless vibration sensor and data indicators used to assess the health of a plant asset; (2) development of diagnostic models for fault detection; and (3) development of prognostic models for estimating the health of the system up to 7 days ahead.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Analyzing Multifaceted Scientific Data with Topological Analytics (Final Technical Report)

This final technical report describes the activities undertaken through Department of Energy, Office of Science, Advanced Scientific Computing Research Early Career award DE-SC-0019039, “Analyzing Multifaceted Scientific Data with Topological Analytics." This report summarizes contributions made toward the research of visualization, machine learning, and topological data analysis of complex simulation data.

97 MATHEMATICS AND COMPUTING↗