Search NASA⌕ Search

SEARCH · Search NASA

Results for “active machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

Ferroelectric FET-based context-switching FPGA enabling dynamic reconfiguration for adaptive deep learning machines

Field programmable gate array (FPGA) is widely used in the acceleration of deep learning applications because of its reconfigurability, flexibility, and fast time-to-market. However, conventional FPGA suffers from the trade-off between chip area and reconfiguration latency, making efficient FPGA accelerations that require switching between multiple configurations still elusive. Here, we propose a ferroelectric field-effect transistor (FeFET)–based context-switching FPGA supporting dynamic reconfiguration to break this trade-off, enabling loading of arbitrary configuration without interrupting the active configuration execution. Leveraging the intrinsic structure and nonvolatility of FeFETs, compact FPGA primitives are proposed and experimentally verified. The evaluation results show our design shows a 63.0%/74.7% reduction in a look-up table (LUT)/connection block (CB) area and 82.7%/53.6% reduction in CB/switch box power consumption with a minimal penalty in the critical path delay (9.6%). Besides, our design yields significant time savings by 78.7 and 20.3% on average for context-switching and dynamic reconfiguration applications, respectively.

97 MATHEMATICS AND COMPUTING↗

Learning nonlinear level sets for dimensionality reduction in function approximation

We developed a Nonlinear Level-set Learning (NLL) method for dimensionality reduction in high-dimensional function approximation with small data. This work is motivated by a variety of design tasks in real-world engineering applications, where practitioners would replace their computationally intensive physical models (e.g., high-resolution fluid simulators) with fast-to-evaluate predictive machine learning models, so as to accelerate the engineering design processes. There are two major challenges in constructing such predictive models: (a) high-dimensional inputs (e.g., many independent design parameters) and (b) small training data, generated by running extremely time-consuming simulations. Thus, reducing the input dimension is critical to alleviate the over-fitting issue caused by data insufficiency. Existing methods, including sliced inverse regression and active subspace approaches, reduce the input dimension by learning a linear coordinate transformation; our main contribution is to extend the transformation approach to a nonlinear regime. Specifically, we exploit reversible networks (RevNets) to learn nonlinear level sets of a high-dimensional function and parameterize its level sets in low-dimensional spaces. A new loss function was designed to utilize samples of the target functions' gradient to encourage the transformed function to be sensitive to only a few transformed coordinates. The NLL approach is demonstrated by applying it to three 2D functions and two 20D functions for showing the improved approximation accuracy with the use of nonlinear transformation, as well as to an 8D composite material design problem for optimizing the buckling-resistance performance of composite shells of rocket inter-stages.

Zhang, Guannan↗

MOFSimplify, machine learning models with extracted stability data of three thousand metal–organic frameworks

Abstract We report a workflow and the output of a natural language processing (NLP)-based procedure to mine the extant metal–organic framework (MOF) literature describing structurally characterized MOFs and their solvent removal and thermal stabilities. We obtain over 2,000 solvent removal stability measures from text mining and 3,000 thermal decomposition temperatures from thermogravimetric analysis data. We assess the validity of our NLP methods and the accuracy of our extracted data by comparing to a hand-labeled subset. Machine learning (ML, i.e. artificial neural network) models trained on this data using graph- and pore-geometry-based representations enable prediction of stability on new MOFs with quantified uncertainty. Our web interface, MOFSimplify, provides users access to our curated data and enables them to harness that data for predictions on new MOFs. MOFSimplify also encourages community feedback on existing data and on ML model predictions for community-based active learning for improved MOF stability models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Probabilistic Physics-Informed Graph Convolutional Network for Active Distribution System Voltage Prediction

Here this letter proposes a novel data-driven probabilistic physics-informed graph convolutional network (GCN) for active distribution system voltage prediction with PVs and EVs. It leverages both measurements and network topology to accurately and efficiently predict node voltages without the need for an accurate distribution system power flow model. The dropout-enabled Bayesian inference is developed to achieve uncertainty quantification of the voltage prediction. Thanks to the network model embedding, it also has robustness against topology changes, a key difference with existing machine learning-based approaches. Comparison results with other state-of-the-art machine learning methods on a realistic 759-node distribution system demonstrate that the proposed method can achieve better accuracy and robustness under different scenarios.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A Novel Hollow Fiber Membrane Reactor for High Purity H 2 Generation from Thermal Catalytic NH 3 Decomposition (Final Report)

Ammonia (NH 3 ), as a promising carbon neutral liquid fuel (CNLF) and an effective H 2 source, can be synthesized from air and water (N 2 extracted from air and H 2 from water) using renewable energy sources. To produce H 2 as an intermediate, it is essential to develop effective and economic NH 3 decomposition technologies. We have been developing an innovative hollow fiber membrane reactor for high purity H 2 generation from thermal catalytic NH 3 decomposition. The objective of the proposed research is to fabricate a compact and robust prototype with high energy efficiency (>80%) to deliver high purity (>99%) H2 at high rate per volume (>0.15 g H 2 /h/cm 3 ) from NH3 decomposition at low temperature (<450 °C) and high conversion (>99%). Our overall technical approach is to effectively combine an active catalyst for NH 3 decomposition with a selective H 2 membrane separation process in a novel, compact modular system to generate high purity H 2 and simultaneously achieve high NH 3 conversion and optimize the entire system energy efficiency. This novel integrated membrane reactor design, together with low-cost, highly active Ru-based catalyst, makes it most appropriate for the project objective. The proposed applied research and development work, therefore, represents an innovative and transformational solution to H 2 generation from thermal catalytic NH 3 decomposition. During the course of our research we i) synthesized and characterized ruthenium(Ru)-based catalysts, evaluated their catalytic performance for NH 3 decomposition and optimized the catalyst composition and performance based on machine learning, ii) prepared SAPO-34, MFI membranes on α-alumina hollow fibers and measured their performance for H 2 /N 2 , H 2 /N 2 /NH 3 separation and evaluated carbon molecular sieve (CMS) and Pd/Ag membranes for H 2 /N 2 , H 2 /N 2 /NH 3 separation at different conditions, iii) designed and evaluated several types of membrane reactors for H 2 production from NH 3 decomposition, and iv) evaluated the H 2 delivery cost base on catalysts development, membrane development and membrane reactor. For 3,1,12 RuYK catalyst, H 2 productivity of 6.35 mmol/min/gcat with NH 3 conversion of 95~98% was achieved at 5 bar and 400 °C; for SAPO-34 membrane, the best membrane showed H 2 permeance of 7.56×10 -7 mol/(m 2 ∙s∙Pa) and H 2 /N 2 selectivity of 23.1 at 20 °C; For CMS and Pd/Ag membranes, both showed superior stability for 71%H 2 /24%N 2 /5%NH 3 mixture separation at 450 °C and 7 bar for over 120 h; for the membrane reactor, high H 2 purity of >99.99% with NH 3 conversion of >99.4% were achieved in Pd/Ag membrane reactor at 450 °C, and the NH 3 concentration was always below 10 ppb in H 2 product. The H 2 generation rate was calculated to be as high as 0.47 g/h/cm 3 and the energy efficiency was calculated to be 88%. The membrane reactor showed superior stability for over 370 h and high H 2 purity, H 2 production rate and NH 3 conversion. Based on calculation, the H 2 delivery cost can be as low as $3.66/kg.

08 HYDROGEN↗

Additive manufacturing system with at least one electronic nose

An additive manufacturing system comprising at least one electronic nose (e-nose) is provided. The e-nose may comprise a housing and gas sensors. The housing may have an air channel. The active sensor portion of the sensors are positioned in the air channel. The housing may be mounted to an extruder head of an additive manufacturing device. The system may also comprise a processor. The processor may determine whether there is an abnormality in an additive manufacturing process based on one or more combinations of outputs from the gas sensors received during the additive manufacturing process input into a deployed machine learning model; and generate a report for the additive manufacturing process containing the determination.

Ivanov, Ilia N.↗

LANL Activities on Mechanistic Approach to Analyzing and Improving Unconventional Hydrocarbon Production

Hydrocarbon production from shale reservoirs is inherently inefficient and challenging since these are low permeability plays. In addition, there is a limited understanding of the fundamentals and the controlling mechanisms, further complicating how to optimize these plays. Herein, we summarize our experimental and computational efforts fully and partially supported by the fundamental shale portfolio to reveal unconventional shale fundamentals and devise development strategies to enhance extraction efficiency with a minimal environmental footprint. Integrating these fundamentals with machine learning, we outline a pathway to improve the predictive power of our models, which enhances the forecast quality of production, thereby improving the economics of operations in unconventional reservoirs. For instance, we have developed science informed workflows and platforms for optimizing pressure-drawdown at a site, which allow operators to make reservoir-management decisions that optimize recovery in consideration of future production. Recently, our work relies on the hybridization of physics-based prediction and machine learning, whereby accurate synthetic data (combined with available site data) can enable the application of machine learning methods for rapid forecasting and optimization. Consequently, the workflow and platform are readily extendable to operations at other sites, plays, and basins.

04 OIL SHALES AND TAR SANDS↗

Creep in multi-principal element materials –– A review

The ongoing push towards enhanced energy efficiency and reduced emissions has necessitated the creation of materials with superior performance, especially under extreme conditions. Modern industries, such as aerospace, energy production, and nuclear power, rely heavily on materials that can withstand elevated temperatures without compromising structural integrity. At these heightened temperatures, materials, even when subjected to mechanical stresses well below their yield strength, may experience slow deformation leading to eventual rupture — a phenomenon known as creep. With the expansive design space that comes with the high entropy concept and their reported excellent high temperature strength, multi-principal element materials (MPEMs) have attracted interest in the scientific community for high-temperature applications. Here, this review offers a comprehensive examination of existing studies on creep in MPEMs, which includes multi-principal element−alloys, −bulk metallic glasses, −ceramics, and −superalloys, comparing published findings on MPEMs with pure elements, traditional alloys, bulk metallic glasses, and superalloys. The sub-topics covered include a comparison among different creep-testing methods, creep mechanisms, creep exponents, creep strain rates, activation volume, and creep-activation energy. Modeling efforts for predicting creep behavior of MPEMs are also reviewed. Methods for improving creep resistance by performing heat treatments and/or modifying microstructures are discussed. Overall, the current state of MPEMs has not yet surpassed the creep performance of commercial alloys. Finally, directions for future efforts are suggested, such as experimenting in various controlled environments, expanding the number of compositions tested, exploring advanced manufacturing techniques, and using machine-learning to predict creep properties based on compositions and microstructures.

36 MATERIALS SCIENCE↗

Using electronic health record metadata to predict housing instability amongst veterans

Housing instability is considered a significant life stressor and preemptive screening should be applied to identify those at risk for homelessness as early as possible so that they can be targeted for specialized care. We developed models to classify patient outcomes for an established VA Homelessness Screening Clinical Reminder (HSCR), which identifies housing instability, in the two months prior to its administration. Logistic Regression and Random Forest models were fit to classify responses using the last 18 months of document activity. We measure concentration of risk across stratifications of predicted probability and observe an enriched likelihood of finding confirmed false negative responses from veterans with diagnosed housing instability. Positive responses were 34 times more likely to be detected within the top 1 % of patients predicted at risk than from those randomly selected. There is a 1 in 4 chance of detecting false negatives within the top 1 % of predicted risk. Machine learning methods can classify between episodes of housing instability using a data-driven approach that does not rely on variables curated from domain experts. This method has the potential to improve clinicians’ ability to identify veterans who are experiencing housing instability but are not captured by HSCR.

60 APPLIED LIFE SCIENCES↗

Using Machine Learning to Discern Eruption in Noisy Environments: A Case Study Using CO2-Driven Cold-Water Geyser in Chimayó, New Mexico

In this paper, we present an approach based on machine learning (ML) to distinguish eruption and precursory signals of Chimayó geyser (New Mexico, U.S.A.) under noisy environmental conditions. This geyser can be considered a natural analog of CO 2 intrusion into shallow water aquifers. By studying this geyser, we can understand upwelling of CO 2 -rich fluids from depth, which has relevance to leak monitoring in a CO 2 sequestration project. ML methods such as random forests (RFs) are known to be robust multiclass classifiers and perform well under unfavorable, noisy conditions. However, the extent of the RF method’s accuracy is poorly understood for this CO 2 -driven geysering application. The current study aims to quantify the performance of RF classifiers to discern the geyser state. Toward this goal, we first present the data collected from the seismometer that is installed near the Chimayó geyser. The seismic signals collected at this site contain different types of noises such as daily temperature variations, animal movement near the geyser, and human activity. First, we filter the signals from these noises by combining the Butterworth high-pass (BH) filter and an autoregressive (AR) method in a multilevel fashion. We show that by combining these filtering techniques in a hierarchical fashion leads to a reduction in noise in the seismic data without removing the precursors and eruption event signals. We then use RF on the filtered data to classify the state of geyser into three classes: remnant noise, precursor, and eruption states. RF classifier is constructed based on the comprehensive features extracted using the Tsfresh Python package. We show that the classification accuracy using RF on the filtered data is greater than 90%. We also evaluate the accuracy of other classical time-series methods such as dynamic time warping (DTW) on filtered data along with RF on partially filtered data in which we remove the daily trends. Classification accuracy shows that DTW performs poorly (44%) and RF on partially filtered data performs decently (87%). Denoising seismic signals from both daily trends and human activity enhances RF classifier performance by 7%. Finally, these aspects make the proposed ML framework attractive for event discrimination and signal enhancement under noisy conditions, with strong potential for application to monitor leaks in CO 2 sequestration.

58 GEOSCIENCES↗

Physicochemical signatures of nanoparticle-dependent complement activation

Nanoparticles are potentially powerful therapeutic tools that have the capacity to target drug payloads and imaging agents. However, some nanoparticles can activate complement, a branch of the innate immune system, and cause adverse side-effects. Recently, we developed an in vitro hemolytic assay protocol for measuring the nanoparticle-dependent complement activity of serum samples and applied this protocol to several nanoparticle formulations that differed in size, surface charge, and surface chemistry; quantifying the nanoparticle-dependent complement activity using a metric called Residual Hemolytic Activity (RHA). In the present work, we have used a decision tree learning algorithm to derive the rules for estimating nanoparticle-dependent complement response based on the data generated from the hemolytic assay studies. Our results indicate that physicochemical properties of nanoparticles, namely, size, polydispersity index, zeta potential, and mole percentage of the active surface ligand of a nanoparticle, can serve as good descriptors for prediction of nanoparticle-dependent complement activation in the decision tree modeling framework. The robustness and predictability of the model can be improved by training the model with additional data points that are uniformly distributed in the RHA/physicochemical descriptor space and by incorporating instability effects on nanoparticle physicochemical properties into the model.

informatics↗

Learning the Low Frequency Earthquake Activity on the Central San Andreas Fault

Abstract Low frequency earthquakes (LFEs) originating below the central San Andreas Fault are associated with slow‐slip beneath the seismogenic zone within the more ductile portion of the crust. Monitoring efforts over 15 years detected >1 million LFEs. We train a gradient boosted tree model using statistical features describing the seismic waveforms to estimate the hourly LFE event count. The burst‐like LFE behavior is reproduced, while lower amplitudes are predicted during the most active periods. The hourly event counts are up to 18% greater than the catalog. The ability to continuously monitor LFE activity provides insight to when geodetic measurements of slow slip are possible, without the need for developing a computational‐intensive template‐matching catalog. Similar waveform statistical features are found between detecting LFEs and tremors, which provides additional evidence tremors are composed of LFEs. The approach extracts information contained in continuous seismic waveforms that might benefit detecting precursory signals.

58 GEOSCIENCES↗

Sequence-to-sequence neural networks for short-term electrical load forecasting in commercial office buildings

The U.S. power grid is transforming to become smarter, cleaner, and more effi- cient. This is leading to the addition of significant distributed variable renew- able generation. Due to the variable nature of renewable generation, the short- and long-term supply-demand imbalances are less predictable, and conventional approaches to mitigating the imbalance will not be efficient or cost-effective. To address this challenge, transactive control technologies have been proposed which balance energy generation and consumption with market activity and in- frastructural limitations. Transactive control requires the ability of individual end-use loads to express flexibility as a function of a transactive signal (e.g., price). Empirical gray- and black-box models have been widely used to express flexibility, and although these approaches are generally easy to construct and simple to use, they do not capture the non-linear behavior that some end-use loads represent . Machine learning approaches have been proposed to address this limitation. Although deep learning approaches for forecasting end-use loads have been explored, certain aspects of the application of deep models to load forecasting are not well understood. These aspects include how much training data is required, and how models should be structured and trained. To that end, this work explores how to approach applying deep recurrent neural networks to short-term electrical load forecasting with a case study of four commercial office buildings. We identify data requirements for training accurate models of whole building electricity use conditioned on outdoor temperature, provide insight into model hyperparameter sensitivity, and demonstrate how readily models can be generalized to unseen buildings.

Skomski, Elliott↗

Machine learning for automated experimentation in scanning transmission electron microscopy

Abstract Machine learning (ML) has become critical for post-acquisition data analysis in (scanning) transmission electron microscopy, (S)TEM, imaging and spectroscopy. An emerging trend is the transition to real-time analysis and closed-loop microscope operation. The effective use of ML in electron microscopy now requires the development of strategies for microscopy-centric experiment workflow design and optimization. Here, we discuss the associated challenges with the transition to active ML, including sequential data analysis and out-of-distribution drift effects, the requirements for edge operation, local and cloud data storage, and theory in the loop operations. Specifically, we discuss the relative contributions of human scientists and ML agents in the ideation, orchestration, and execution of experimental workflows, as well as the need to develop universal hyper languages that can apply across multiple platforms. These considerations will collectively inform the operationalization of ML in next-generation experimentation.

36 MATERIALS SCIENCE↗

Advancing energy storage through solubility prediction: leveraging the potential of deep learning

Solubility prediction plays a crucial role in energy storage applications, such as redox flow batteries, because it directly affects the efficiency and reliability. Researchers have developed various methods that utilize quantum calculations and descriptors to predict the aqueous solubilities of organic molecules. Notably, machine learning models based on descriptors have shown promise for solubility prediction. As deep learning tools, graph neural networks (GNNs) have emerged to capture complex structure–property relationships for material property prediction. Specifically, MolGAT, a type of GNN model, was designed to incorporate n-dimensional edge attributes, enabling the modeling of intricacies in molecular graphs and enhancing the prediction capabilities. In a previous study, MolGAT successfully screened 23 467 promising redox-active molecules from a database of over 500 000 compounds, based on redox potential predictions. This study focused on applying the MolGAT model to predict the aqueous solubility (log S) of a broad range of organic compounds, including those previously screened for redox activity. The model was trained on a diverse sample of 8494 organic molecules from AqSolDB and benchmarked against literature data, demonstrating superior accuracy compared with other state of the art graph-based and descriptor-based models. Subsequently, the trained MolGAT model was employed to screen redox-active organic compounds identified in the first phase of high-throughput virtual screening, targeting favorable solubility in energy storage applications. The second round of screening, which considered solubility, yielded 12 332 promising redox-active and soluble organic molecules suitable for use in aqueous redox flow batteries. Thus, the two-phase high-throughput virtual screening approach utilizing MolGAT, specifically trained for redox potential and solubility, is an effective strategy for selecting suitable intrinsically soluble redox-active molecules from extensive databases, potentially advancing energy storage through reliable material development. This indicates that the model is reliable for predicting the solubility of various molecules and provides valuable insights for energy storage, pharmaceutical, environmental, and chemical applications.

25 ENERGY STORAGE↗

Small Molecule Evaluator

Using machine learning to score potential drug candidates may offer an advantage over traditional imprecise scoring functions because the parameters and model structure can be learned from the data. However, models may lack interpretability, are often overfit to the data, and are not generalizable to drug targets and chemotypes not in the training data. Benchmark datasets are prone to artificial enrichment and analogue bias due to the overrepresentation of certain scaffolds in experimentally determined active sets. Datasets can be evaluated using spatial statistics to quantify the dataset topology and better understand potential biases. Dataset clumping comprises a combination of self-similarity of actives and separation from decoys in chemical space and is associated with overoptimistic virtual screening results. This code explores methods of quantifying potential biases and examines some common benchmark datasets.

Ellingson, Sally↗

Robust In-Situ Strain Measurements to Monitor CO 2 Storage

The goal of this project was to develop and demonstrate robust instrumentation to monitor the in-situ strain tensor in order to improve the reliability and security of CO 2 storage in geologic formations. We met the original goals of the project and the major overarching accomplishment is the advancement of strain tensor monitoring from an intriguing concept to a commercially available technology with a solid foundation of novel instruments supported by theoretical analyses and validation experiments. The main accomplishments of the project are summarized below. We designed, built and evaluated nine new optical fiber strainmeters and tiltmeters using Michelson interferometers to measure deformation with ultra-high resolution at both shallow and deep point locations in the subsurface. These are the robust strainmeters that motivated the title of the project. We designed, built and evaluated a novel method of measuring distributed strain in optical fibers with nanostrain resolution, and cm-scale location, and sampling into the seismic band. The new method is called Coherence-length-gated Microwave Photonics Interfereometry (CMPI). CMPI technology has advantages over existing commercial DAS and DSS methods. We developed and demonstrated capabilities to deploy instruments in the field and used them to measure strain caused by ambient signals like barometric pressure and tides, as well as induced signals like surface loading and pore pressure changes from pumping tests. We deployed a working strainmeter at 1,700 ft depth, slightly above an active reservoir. This is to our knowledge the greatest depth a strainmeter has been deployed and the techniques we used can readily be extended to greater depths. Optical fiber borehole tensor strainmeter techology was advanced from a TRL 4 at the start, to a TRL of 7 at the conclusion of the project. The project included advances in simulations and theoretical analyses. We developed and demonstrated a computational workflow that uses machine learning to reduce the computational requirements and make it practical to use Bayesian inversion to solve large numerical poroelastic analyses needed to interpret strain tensor field data. We evaluated the strain tensor fields and time series that would be caused by leaks of CO 2 or other fluids from reservoirs. These simulations demonstrated that signals from leaks could be measured with instruments developed for the project, opening a potentially new method for ensuring storage security. We showed that strains in caprock can be used to estimate pressure in a reservoir. This avoids the need to drill monitoring wells into the reservoir, and it expands the capabilities of monitoring in the caprock. The project includes a derivation and application of a novel analytical solution to the strains in the vicinity of a pressurized poroelastic inclusion. This solution explains field data measured during injeciton tests at the North Avant Field, and it will simplify future interpretation of strain tensor data. The project included a broad range of experiments, and of the most significant is the characterization of the strain tensor at an array three strainmeters during six injection tests at the North Avant Field, Oklahoma. This demonstrated repeatability of the strain signal measured by the new instruments developed for the project, and it showed similarities between the strain signal at shallow depths and pressure in the underlying reservoir. We also demonstrated that useful strain data can be measured at reservoir depths. This confirms that strain tensor data can be measured throughout the caprock over a reservoir. The project demonstrated the feasibility of using the strain tensor and distributed strain measured in caprock during a variety of different well tests where the pumping rate was constant, sinusoidal and positive, or a periodic square wave with zero net rate. This further strengthens the validity of using strain data to characterize reservoirs and aquifers. We also demonstrated that strain caused be fluctuations of air pressure and water pressure in the vadose zone can be measured and interpreted, suggesting that high resolution distributed strain measurements hold promise for monitoring the vadose zone. The project partially supported nine graduate students in the Environmental Engineering, Hydrogeology, Electrical Engineering programs at Clemson University. The research was described in nine journal papers, 23 talks and conference abstracts. Additional journal papers are in preparation. A new company called Tensora was started to provide strainmeter technology for commercial applications.

01 COAL, LIGNITE, AND PEAT↗

Accelerated version of NUBEAM capabilities in DIII-D using neural networks

A neural network model of the effects of neutral beam injection on DIII-D has been developed. The training and testing data used by the model have been generated by the NUBEAM module of TRANSP for experimental discharges from the 2018 DIII-D campaign. Using a principle component analysis to reduce the dimensionality of profile data, the model has been shown to reproduce the results of the Monte Carlo code NUBEAM with a high level of accuracy and an execution time orders of magnitude faster than the execution time of NUBEAM. Furthermore, this makes the neural network model uniquely suited to applications in model-based scenario planning (off-line) and active control (on-line), where a large number of simulation runs are required by the associated optimization tasks that need to be performed before and during the discharge.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗