Search NASA⌕ Search

SEARCH · Search NASA

Results for “Traditional Machine Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

From Chaos to Clarity: Autonomous Materials Discovery for Extreme Environments [Slides]

The pursuit of advanced functional materials for energy applications demands an understanding of their behavior under the most challenging conditions. Extreme environments, characterized by intense radiation, high temperatures, and corrosive chemistries, push materials to their limits, often revealing unexpected behaviors and degradation pathways. Traditional materials research approaches, relying on trial-and-error experimentation, are often slow and resource-intensive, ill-suited to the complexities of extreme environments. This talk will explore the transformative potential of autonomous materials science in revolutionizing our understanding of materials synthesis and degradation in extreme environments. By integrating advanced microscopy techniques, artificial intelligence, and robotic experimentation, we can accelerate the discovery and design of resilient materials for a sustainable future. The presentation will highlight recent breakthroughs in autonomous microscopy, computer vision, and machine learning, showcasing their ability to unravel complex material transformations at the atomic scale. The talk will also delve into the challenges and opportunities associated with deploying autonomous systems to probe extreme environments, emphasizing the importance of robust algorithms, real-time data analysis, and adaptive experimentation. The ultimate goal is to empower scientists with unprecedented capabilities to explore, understand, and engineer materials that can withstand the harshest conditions, paving the way for innovations in energy, aerospace, and beyond.

14 SOLAR ENERGY↗

Failure Analysis on Multivariate Time-series Data given Uncertain Labels

Machine failure analysis and detection is critical to today’s industrial society. Given a number of failure events on multivariate temporal data, the ability to identify 1) the discriminative patterns prior to the events and 2) the most relevant features to the failure has practical use for early warning and root cause analysis. However, since these patterns are not necessarily adjacent to the onset of failure in time, faulty labels are often with uncertainty, which makes traditional supervised detection methods inapplicable. To address the label uncertainty and learn the complicated correlation in multivariate time series, we design Failure Analysis on Multivariate Time-series Data (MAMT) that jointly selects the most failure-relevant features and time-instances by a novel dynamic and directional label diffusion process. Extensive experiments demonstrate that MAMT is more effective while more efficient than popular baselines.

97 MATHEMATICS AND COMPUTING↗

From Chaos to Clarity: Autonomous Materials Discovery for Extreme Environments

The pursuit of advanced functional materials for energy applications demands an understanding of their behavior under the most challenging conditions. Extreme environments, characterized by intense radiation, high temperatures, and corrosive chemistries, push materials to their limits, often revealing unexpected behaviors and degradation pathways. Traditional materials research approaches, relying on trial-and-error experimentation, are often slow and resource-intensive, ill-suited to the complexities of extreme environments. This talk will explore the transformative potential of autonomous materials science in revolutionizing our understanding of materials synthesis and degradation in extreme environments. By integrating advanced microscopy techniques, artificial intelligence, and robotic experimentation, we can accelerate the discovery and design of resilient materials for a sustainable future. The presentation will highlight recent breakthroughs in autonomous microscopy, computer vision, and machine learning, showcasing their ability to unravel complex material transformations at the atomic scale. The talk will also delve into the challenges and opportunities associated with deploying autonomous systems to probe extreme environments, emphasizing the importance of robust algorithms, real-time data analysis, and adaptive experimentation. Our ultimate goal is to empower scientists with unprecedented capabilities to explore, understand, and engineer materials that can withstand the harshest conditions, paving the way for innovations in energy, aerospace, and beyond.

artificial intelligence↗

Data Fusion and Feature Extraction of Explosions Recorded on Smartphones

The prompt detection of explosions is a key element of the nuclear non-proliferation mission. With traditional sensors being limited in number and scale, smartphones as compact and economical multi-modal sensors are gaining traction and are being deployed. To address the flood of heterogeneous smartphone data, our team proposes a feature extraction using standardized constant-Q frequency bands across acoustic, barometric, and accelerometer data. The work presented in this poster utilizes three explosions collected on smartphones with Idaho National Lab. More explosions are planned in the near future at INL and NNSS. These extracted features will be used in machine learning methods in future iterations.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Flow-based likelihoods for non-Gaussian inference

We investigate the use of data-driven likelihoods to bypass a key assumption made in many scientific analyses, which is that the true likelihood of the data is Gaussian. In particular, we suggest using the optimization targets of flow-based generative models, a class of models that can capture complex distributions by transforming a simple base distribution through layers of nonlinearities. We call these flow-based likelihoods (FBL). We analyze the accuracy and precision of the reconstructed likelihoods on mock Gaussian data, and show that simply gauging the quality of samples drawn from the trained model is not a sufficient indicator that the true likelihood has been learned. We nevertheless demonstrate that the likelihood can be reconstructed to a precision equal to that of sampling error due to a finite sample size. We then apply FBLs to mock weak lensing convergence power spectra, a cosmological observable that is significantly non-Gaussian (NG). We find that the FBL captures the NG signatures in the data extremely well, while other commonly used data-driven likelihoods, such as Gaussian mixture models and independent component analysis, fail to do so. This suggests that works that have found small posterior shifts in NG data with data-driven likelihoods such as these could be underestimating the impact of non-Gaussianity in parameter constraints. By introducing a suite of tests that can capture different levels of NG in the data, we show that the success or failure of traditional data-driven likelihoods can be tied back to the structure of the NG in the data. Here, unlike other methods, the flexibility of the FBL makes it successful at tackling different types of NG simultaneously. Because of this, and consequently their likely applicability across datasets and domains, we encourage their use for inference when sufficient mock data are available for training.

79 ASTRONOMY AND ASTROPHYSICS↗

Machine Learning Applied to Zeolite Synthesis: The Missing Link for Realizing High-Throughput Discovery

Zeolites are microporous crystalline materials with well-defined cavities and pores, which can be prepared under different pore topologies and chemical compositions. Their preparation is typically defined by multiple interconnected variables (e.g., reagent sources, molar ratios, aging treatments, reaction time and temperature, among others), but unfortunately their distinctive influence, particularly on the nucleation and crystallization processes, is still far from being understood. Thus, the discovery and/or optimization of specific zeolites is closely related to the exploration of the parametric space through trial-and-error methods, generally by studying the influence of each parameter individually. In the past decade, machine learning (ML) methods have rapidly evolved to address complex problems involving highly nonlinear or massively combinatorial processes that conventional approaches cannot solve. Considering the vast and interconnected multiparametric space in zeolite synthesis, coupled with our poor understanding of the mechanisms involved in their nucleation and crystallization, the use of ML is especially timely for improving zeolite synthesis. Indeed, the complex space of zeolite synthesis requires drawing inferences from incomplete and imperfect information, for which ML methods are very well-suited to replace the intuition-based approaches traditionally used to guide experimentation. In this Account, we contend that both existing and new ML approaches can provide the “missing link” needed to complete the traditional zeolite synthesis workflow used in our quest to rationalize zeolite synthesis. Within this context, we have made important efforts on developing ML tools in different critical areas, such as (1) data-mining tools to process the large amount of data generated using high-throughput platforms; (2) novel complex algorithms to predict the formation of energetically stable hypothetical zeolites and guide the synthesis of new zeolite structures; (3) new “ab initio” organic structure directing agent predictions to direct the synthesis of hypothetical or known zeolites; (4) an automated tool for nonsupervised data extraction and classification from published research articles. ML has already revolutionized many areas in materials science by enhancing our ability to map intricate behavior to process variables, especially in the absence of well-understood mechanisms. Undoubtedly, ML is a burgeoning field with many future opportunities for further breakthroughs to advance the design of molecular sieves. For this reason, this Account includes an outlook of future research directions based on current challenges and opportunities. We envision this Account will become a hallmark reference for both well-established and new researchers in the field of zeolite synthesis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Boundary Topology Optimization Approach for Lightweighting Electric Machines Inspired by Additive Manufacturing

Minimizing the mass in electric machines while maintaining superior performance has become a new requirement for the advancement of drivetrains used in wind energy and electric mobility. Topology optimization for light-weighting electric machines using traditional approaches typically explore a restricted design space allowed by standard parametrizable geometry and manufacturing, while advanced methods like cell-based density approaches suffer from a lack of robust manufacturability constraints during the optimization process. To overcome these drawbacks, we explore a grid-independent, boundary TO where the outer shape of the magnet is parameterized using Bezier curves. We conduct a design of experiments (DOE) to study the effect of different magnet shapes on machine performance by varying the control points on the Bezier curves. A machine-learning based surrogate model is constructed using the data from the DOE to quantify the relationship between the control points, air-gap torque and mass. The control points are then optimized to maximize the torque density. The approach is used for minimizing electrical steel mass in the IEA-15MW radial flux direct-drive wind turbine generator. The free-from boundary TO resulted in smooth and concise shapes that can be easily additively manufactured with upto 20-ton reduction in electrical steel mass.

additive manufacturing↗

Recent Advances in Small Angle X-ray Scattering for Superlattice Study

Small-angle x-ray scattering is used for the structure determination of superlattice for its superior resolution, nondestructive nature, and high penetration power of x rays. With the advent of high brilliance x-ray sources and innovative computing algorithms, there have been notable advances in small angle x-ray scattering analysis of superlattices. High brilliance x-ray beams have made data analyses less model-dependent. Additionally, novel data acquisition systems are faster and more competitive than ever before, enabling a more accurate mapping of the superlattices' reciprocal space. Fast and high-throughput computing systems and algorithms also make possible advanced analysis methods, including iterative phasing algorithms, non-parameterized fitting of scattering data with molecular dynamics simulations, and the use of machine learning algorithms. As a result, solving nanoscale structures with high resolutions has become an attainable task. In this review, we highlight new developments in the field and introduce their applications for the analysis of nanoscale ordered structures, including nanoparticle supercrystals, nanoscale lithography patterns, and supramolecular self-assemblies. Particularly, we highlight the reciprocal space mapping techniques and the use of iterative phase retrieval algorithms. We also cover coherent-beam-based small angle x-ray scattering techniques such as ptychography and ptycho-tomography in view of the traditional small angle x-ray scattering perspective.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A New Shape Optimization Approach for Lightweighting Electric Machines Inspired by Additive Manufacturing

Minimizing the mass in electric machines while maintaining superior performance is a new requirement for the advancement of drivetrains used in wind energy and electric mobility. Topology optimization (TO) for lightweighting electric machines using traditional approaches typically explores a restricted design space allowed by standard parametrizable geometry and manufacturing, while advanced methods, such as cell-based density approaches, suffer from a lack of robust manufacturability constraints during the optimization process. To overcome these drawbacks, we explore a grid-independent, boundary optimization where the outer shape of the magnet is parameterized using Bezier curves. We conduct a design of experiments (DOE) to study the effect of different magnet shapes on machine performance by varying the control points on the Bezier curves. A machine-learning-based surrogate model is constructed using the data from the DOE to quantify the relationship between the control points, air-gap torque, and mass. The control points are then optimized to maximize the torque density. The approach is used for minimizing electrical steel mass in the International Energy Agency (IEA) 15-MW radial flux direct-drive wind turbine generator. The new approach to shape optimization resulted in smooth and concise shapes that can be easily additively manufactured with up to a 20-ton reduction in electrical steel mass.

additive manufacturing↗

A New Shape Optimization Approach for Lightweighting Electric Machines Inspired by Additive Manufacturing: Preprint

Minimizing the mass in electric machines while maintaining superior performance is a new requirement for the advancement of drivetrains used in wind energy and electric mobility. Topology optimization (TO) for lightweighting electric machines using traditional approaches typically explores a restricted design space allowed by standard parametrizable geometry and manufacturing, while advanced methods, such as cell-based density approaches, suffer from a lack of robust manufacturability constraints during the optimization process. To overcome these drawbacks, we explore a grid-independent, boundary TO where the outer shape of the magnet is parameterized using Bezier curves. We conduct a design of experiments (DOE) to study the effect of different magnet shapes on machine performance by varying the control points on the Bezier curves. A machine-learning-based surrogate model is constructed using the data from the DOE to quantify the relationship between the control points, air-gap torque, and mass. The control points are then optimized to maximize the torque density. The approach is used for minimizing electrical steel mass in the International Energy Agency (IEA) 15-MW radial flux direct-drive wind turbine generator. The free-form boundary TO resulted in smooth and concise shapes that can be easily additively manufactured with up to a 20-ton reduction in electrical steel mass.

additive manufacturing↗

A multiscale recurrent neural network model for predicting energy production from geothermal reservoirs

Optimization of energy production from geothermal reservoirs requires reliable prediction of energy production performance under alternative operation and development scenarios. Traditionally, reservoir simulation models are used for the evaluation and screening of alternative production and development plans. However, simulation models require extensive data collection and modeling efforts and are time-consuming to build, run, and update. Data-driven predictive models, on the other hand, can serve as efficient prediction tools that can be used for decision support and management of daily operations and surveillance activities. Data-driven models become particularly attractive when a reservoir simulation model for a field does not exist and/or is difficult to build. Machine learning (ML)-based data-driven models that have recently become popular in several fields exploit statistical patterns and relations in training data to generate predictions. As such, they tend to perform better in interpolation problems (that is, prediction within the training data range) than when they are used to extrapolate beyond the training data. Production data from geothermal reservoirs tend to exhibit short-term variabilities as well as long-term trends, such as monotonically declining production temperatures. Capturing both short-term features and long-term trends with ML-based models is not trivial. We evaluate the use of recurrent neural networks (RNN) for the prediction of energy production from geothermal reservoirs. RNN is a class of ML architectures that are used to represent and predict sequential/dynamic data. Thus, it can be challenging to apply RNN to problems where long-term trends must be captured and extrapolation beyond the training data range is needed. We introduce the multiscale RNN architecture to extend the application of RNN to detect and predict both short-term variabilities and long-term trends in geothermal data. The developed architecture consists of a long-term component to only capture low-frequency data patterns, and a short-term component to detect features with higher frequency and more nonlinearity. The final prediction is obtained by combining the long-term and short-term predictions. Both synthetic and field data are used to evaluate the presented multiscale RNN model. The prediction performance of the multiscale RNN is compared against those obtained from the regular RNN and the autoregressive (AR) model. The results suggest that the multiscale architecture improves the long-term prediction performance of the regular RNN and enhances its robustness against noise.

15 GEOTHERMAL ENERGY↗

Conduction-Cooled Operation of an SRF Multi-Cell Cavity

The development of compact, SRF-based accelerators for applications beyond research is experiencing notable advancements due to the use of cryocoolers for conduction-cooling instead of traditional liquid cryogens. Following the successful demonstration of a single-cell cavity operated through conduction cooling with three two-stage cryocoolers, Jefferson Lab (JLab) has made strides in the operation of a multi-cell resonator. This milestone paves the way for high-energy applications of compact, conduction-cooled SRF machines. The demonstration, carried out in collaboration with General Atomics, will take place in a dedicated horizontal test cryostat (HTC) at their San Diego facility. This presentation will highlight the technological developments, the latest results, and valuable lessons learned.

Vennekate, J. [Thomas Jefferson National Accelerat↗

LDRD 226360 Final Project Report: Simulated X-ray Diffraction and Machine Learning for Optimizing Dynamic Experiment Analysis

This report is the final documentation for the one-year LDRD project 226360: Simulated X-ray Diffraction and Machine Learning for Optimizing Dynamic Experiment Analysis. As Sandia has successfully developed in-house X-ray diffraction tools for study of atomic structure in experiments, it has become increasingly important to develop computational analysis methods to support these experiments. When dynamically compressed lattices and orientations are not known a priori, the identification requires a cumbersome and sometimes intractable search of possible final states. These final states can include phase transition, deformation and mixed/evolving states. Our work consists of three parts: (1) development of an XRD simulation tool and use of traditional data science methods to match XRD patterns to experiments; (2) development of ML-based models capable of decomposing and identifying the lattice and orientation components of multicomponent experimental diffraction patterns; and (3) conducting experiments which showcase these new analysis tools in the study of phase transition mechanisms. Our target material has been cadmium sulfide, which exhibits complex orientation-dependent phase transformation mechanisms. In our current one-year LDRD, we have begun the analysis of high-quality c-axis CdS diffraction data from DCS and Thor experiments, which had until recently eluded orientation identification.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Conduction-Cooled Operation of an SRF Multi-Cell Cavity

The development of compact, SRF-based accelerators for applications beyond research is experiencing notable advancements due to the use of cryocoolers for conduction-cooling instead of traditional liquid cryogens. Following the successful demonstration of a single-cell cavity operated through conduction cooling with three two-stage cryocoolers, Jefferson Lab (JLab) has made strides in the operation of a multi-cell resonator. This milestone paves the way for high-energy applications of compact, conduction-cooled SRF machines. The demonstration, carried out in collaboration with General Atomics, will take place in a dedicated horizontal test cryostat (HTC) at their San Diego facility. This presentation will highlight the technological developments, the latest results, and valuable lessons learned.

Vennekate, J. [Thomas Jefferson National Accelerat↗

Introduction to Special Section: Machine Learning for Image-based Geologic Interpretation

Image-based geological interpretation has been a labor-intensive and time-consuming process because it requires well-trained geoscientists to identify geological structures, features, and textures from various types of images. These images include scanning electron microscopic images, optical microscopic images, optical photos, resistivity images, seismic volumes, remote-sensing images, etc. With fast-evolving machine learning (ML) technology and computing power in recent decades, computers can achieve nearhuman-level to super-human-level performance with scalable high efficiency in the computer vision field. These technological revolutions facilitated image-based geological interpretation in petroleum exploration and production. For example, a fault picking method applied to 3-D seismic volume data using deep learning can achieve superior performance in comparison to conventional auto-picking methods. In addition, under the new normal of low oil prices, the petroleum industry seeks cost-effective strategies such as automating traditionally labor-intensive processes. Nevertheless, the potential of applying ML to geological image interpretation is still facing a few key challenges including data scarcity, data distribution, poor data and/or label quality, data leakage, learning algorithms, model architecture, training methodologies, testing and evaluation metrics, hyper-parameters optimization, model drift, production deployment, and the like.

58 GEOSCIENCES↗

Comparison of multifidelity machine learning models for potential energy surfaces

Multifidelity modeling is a technique for fusing the information from two or more datasets into one model. It is particularly advantageous when one dataset contains few accurate results and the other contains many less accurate results. Within the context of modeling potential energy surfaces, the low-fidelity dataset can be made up of a large number of inexpensive energy computations that provide adequate coverage of the N-dimensional space spanned by the molecular internal coordinates. The high-fidelity dataset can provide fewer but more accurate electronic energies for the molecule in question. Here, we compare the performance of several neural network-based approaches to multifidelity modeling. We show that the four methods (dual, Δ-learning, weight transfer, and Meng–Karniadakis neural networks) outperform a traditional implementation of a neural network, given the same amount of training data. We also show that the Δ-learning approach is the most practical and tends to provide the most accurate model.

Chemistry↗

A Medium‐Sized Paleo‐Tsunami Reconstruction by a Deep Neural Network Processing Sedimentary Deposits

Abstract Reconstructing the magnitude and recurrence time of tsunamis, one of the most destructive and unpredictable natural hazards impacting coastal communities, is essential. While major tsunamis are the most studied due to their disastrous impact, small/medium tsunamis (SMTs) are much more frequent and can still significantly impact the coast. Therefore, SMTs potentially provide an extensive archive of information preserved in the geological record. Analyzing the deposits of small/medium paleo‐tsunamis (SMPTs) opens a window into when their direct observation was unavailable. However, deposits of SMPTs are often degraded, traditional sediment deposition inversion models might fail. Recent research has shown that Deep Neural Networks (DNN) can effectively reconstruct the flow conditions of major tsunamis from their deposits. We evaluate the effectiveness of this approach in reconstructing the characteristics of a recent medium size tsunami (2006 Java) and of a medium paleo‐tsunami (1929 Grand Banks). We successfully reconstruct the flow characteristics of the 2006 Java event and show that an inversion of comparable quality is possible for the 1929 Grand Banks tsunami, despite greater uncertainties due to the deposit degradation. Our research shows that Machine Learning has the potential to unseal the meaning of data of thousands SMPTs.

Batubo, P.↗

Seismic Spatial Gradients and Machine Learning-Based Classifiers for Explosion Monitoring (LDRD 218327)

This final report summarizes the work completed under the Laboratory Directed Research and Development (LDRD) project “Seismic Spatial Gradients as a Machine Learning-Based Classifier for Explosion Monitoring.” The overarching goal of the project was to explore the efficacy of using machine learning-based classification algorithms where the input data are the spatial gradient of the seismic wavefield collected at a single point on the Earth’s surface. The methods that I describe here are in direct contrast to conventional methods of seismic discrimination which typically rely on a spatially extended network of instruments and physics-based wavefield attributes such as, for example, the ratio between $\textit{P}$ and $\textit{S}$ waves. Rather, we use the spatial gradient of the seismic wavefield observed at a single point on the Earth’s surface and data processing approaches inspired by the machine learning community. We tested two algorithms, a neural network and a modified version of principal component analysis termed Spectrally Filtered Principal Component Analysis (SFPCA). To test these algorithms, we first conducted a series of numerical tests using synthetic data and then conducted a small-scale controlled field experiment. The tests using synthetic data showed that both algorithms had high success rates on gradiometric data, even when simulated noise was added to the signal. Furthermore, we found that using seismic spatial gradients increased the performance of our discrimination algorithms when compared to using just the traditional translational motion seismic data. The tests with field data also showed a high degree of discriminative success.

58 GEOSCIENCES↗