Search NASA⌕ Search

SEARCH · Search NASA

Results for “experimental learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Survey of Machine Learning-Based Rotating Detonation Engine Diagnostics: Evaluation for Broad Application in Experimental Facilities

This work evaluates and compares various convolutional neural networks (CNNs) trained in previous NETL studies according to metrics effecting diagnostic feasibility, external applicability, and performance. Each CNN surveyed, including image classification, object detection, and time series classification, is used to develop total RDE diagnostics and evaluated alongside conventional techniques with respect to real-time capabilities. Real-time capable diagnostics are deployed and evaluated in the laboratory environment using an altered experimental setup, which is outlined herein for possible adaptations in external experimental facilities.

Johnson, Kristyn↗

Survey of Machine Learning-Based Rotating Detonation Engine Diagnostics: Evaluation for Broad Application in Experimental Facilities

This work evaluates and compares various convolutional neural networks (CNNs) trained in previous NETL studies according to metrics effecting diagnostic feasibility, external applicability, and performance. Each CNN surveyed, including image classification, object detection, and time series classification, is used to develop total RDE diagnostics and evaluated alongside conventional techniques with respect to real-time capabilities. Real-time capable diagnostics are deployed and evaluated in the laboratory environment using an altered experimental setup, which is outlined herein for possible adaptations in external experimental facilities.

Johnson, Kristyn↗

Physics-driven learning of Wasserstein GAN for density reconstruction in dynamic tomography

Object density reconstruction from projections containing scattered radiation and noise is of critical importance in many applications. Existing scatter correction and density reconstruction methods may not provide the high accuracy needed in many applications and can break down in the presence of unmodeled or anomalous scatter and other experimental artifacts. Incorporating machine-learning models could prove beneficial for accurate density reconstruction, particularly in dynamic imaging, where the time evolution of the density fields could be captured by partial differential equations or by learning from hydrodynamics simulations. In this work, we demonstrate the ability of learned deep neural networks to perform artifact removal in noisy density reconstructions, where the noise is imperfectly characterized. Here, we use a Wasserstein generative adversarial network (WGAN), where the generator serves as a denoiser that removes artifacts in densities obtained from traditional reconstruction algorithms. We train the networks from large density time-series datasets, with noise simulated according to parametric random distributions that may mimic noise in experiments. The WGAN is trained with noisy density frames as generator inputs, to match the generator outputs to the distribution of clean densities (time series) from simulations. A supervised loss is also included in the training, which leads to an improved density restoration performance. In addition, we employ physics-based constraints such as mass conservation during the network training and application to further enable highly accurate density reconstructions. Our preliminary numerical results show that the models trained in our frameworks can remove significant portions of unknown noise in density time-series data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Active meta-learning for predicting and selecting perovskite crystallization experiments

Autonomous experimentation systems use algorithms and data from prior experiments to select and perform new experiments in order to meet a specified objective. In most experimental chemistry situations, there is a limited set of prior historical data available, and acquiring new data may be expensive and time consuming, which places constraints on machine learning methods. Active learning methods prioritize new experiment selection by using machine learning model uncertainty and predicted outcomes. Meta-learning methods attempt to construct models that can learn quickly with a limited set of data for a new task. Here in this paper, we applied the model-agnostic meta-learning (MAML) model and the Probabilistic LATent model for Incorporating Priors and Uncertainty in few-Shot learning (PLATIPUS) approach, which extends MAML to active learning, to the problem of halide perovskite growth by inverse temperature crystallization. Using a dataset of 1870 reactions conducted using 19 different organoammonium lead iodide systems, we determined the optimal strategies for incorporating historical data into active and meta-learning models to predict reaction compositions that result in crystals. We then evaluated the best three algorithms (PLATIPUS and active-learning k-nearest neighbor and decision tree algorithms) with four new chemical systems in experimental laboratory tests. With a fixed budget of 20 experiments, PLATIPUS makes superior predictions of reaction outcomes compared to other active-learning algorithms and a random baseline.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Enabling machine learning-ready HPC ensembles with Merlin

With the growing complexity of computational and experimental facilities, many scientific researchers are turning to machine learning (ML) techniques to analyze large scale ensemble data. With complexities such as multi-component workflows, heterogeneous machine architectures, parallel file systems, and batch scheduling, care must be taken to facilitate this analysis in a high performance computing (HPC) environment. Here, we present Merlin, a workflow framework to enable large ML-friendly ensembles of scientific HPC simulations. By augmenting traditional HPC with distributed compute technologies, Merlin aims to lower the barrier for scientific subject matter experts to incorporate ML into their analysis. As a producer–consumer workflow model, Merlin enables multi-machine, cross-batch job, dynamically allocated yet persistent workflows capable of utilizing surge-compute resources. Key features of Merlin are a flexible HPC-centric interface, low per-task overhead, multi-tiered fault recovery, and a hierarchical sampling algorithm that allows for $\mathscr{O}$(N) task execution and $\mathscr{O}$(N ln N) task queuing to ensembles of millions of tasks. In addition to Merlin’s design, we test the algorithm’s performance in an HPC center and demonstrate the ability to enqueue 40 million simulations in 100 s, with a 30 millisecond per-task overhead that is independent of ensemble size. Finally, we describe some example applications that Merlin has enabled on leadership-class HPC resources, such as the ML-augmented optimization of nuclear fusion experiments and the calibration of infectious disease models to study the progression of and possible mitigation strategies for COVID-19.

97 MATHEMATICS AND COMPUTING↗

Design Space Exploration of Emerging Memory Technologies for Machine Learning Applications

Memory design space exploration methods study memory systems’ performances and limitations before implementation. The computer memory design space has grown exponentially because of the enormous growth of memory types, memory controllers, and application software. Computer simulators are commonly used for memory design space exploration. However, complex memory simulations take an enormous amount of time. Hence, in this paper, we proposed a machine learning-based design space exploration method for dynamic random-access memory and non-volatile memory systems. We applied our method to the CosmoGAN and LeNet applications to predict the following six memory response parameters: (i) bandwidth, (ii) power, (iii) average latency, (iv) average total latency, (v) memory reads, and (vi) memory writes. Our experimental results show that machine learning models can predict memory response parameter values faster than simulations. We used support vector machine, random forest, and gradient boosting machine learning models. We observed that the support vector machine provides better performance for bandwidth, average latency, and average total latency. The random forest model works better for memory reads and writes. The gradient boosting model provides superior prediction performance for power. We provide a detailed discussion on learning curve characteristics, error analysis, and memory type recommendation.

Hasan, S M Shamimul↗

Stability boundary and optimal operating parameter identification in milling using Bayesian learning

Here, this paper describes a novel Bayesian learning approach for stability boundary and optimal parameter identification in milling without the knowledge of the underlying tool dynamics or material cutting force coefficients. The paper is divided into two parts. First, a Bayesian learning method for stability lobe identification using test results is described. Each axial depth and spindle speed combination is characterized by a probability of stability which is updated using Bayes’ rule when a test result (stable or unstable) is made available. A novel likelihood function is defined which incorporates knowledge of the stability behavior. Numerical results show convergence to the analytical stability lobe diagram. Second, an adaptive experimental strategy to identify optimal operating parameters that maximize material removal rate is described. Numerical evaluation shows convergence to the optimal operating point with error less than 15 % within ten tests on average. The approach is validated using experimental results. Results show that the proposed method is an efficient and robust learning method to identify the stability lobe diagram and optimal operating parameters with a limited number of tests/data points.

Bayesian machine learning↗

There is No Free Lunch: Tradeoffs in the Utility of Learned Knowledge

With the recent introduction of learning in integrated systems, there is a need to measure the utility of learned knowledge for these more complex systems. A difficulty arrises when there are multiple, possibly conflicting, utility metrics to be measured. In this paper, we present schemes which trade off conflicting utility metrics in order to achieve some global performance objectives. In particular, we present a case study of a multi-strategy machine learning system, mutual theory refinement, which refines world models for an integrated reactive system, the Entropy Reduction Engine. We provide experimental results on the utility of learned knowledge in two conflicting metrics - improved accuracy and degraded efficiency. We then demonstrate two ways to trade off these metrics. In each, some learned knowledge is either approximated or dynamically 'forgotten' so as to improve efficiency while degrading accuracy only slightly.

Kedar, Smadar T.↗

Insights into Prismatic Loop Formation in Irradiated Fe–Cr Alloys from Hypothesis-Driven Active Learning and Causal Analysis

Neutron and electron irradiation experimental studies conducted on body-centered cubic Fe and Fe–Cr alloys have established two prismatic dislocation loop populations, which have Burgers vectors of either a/2$\langle$111$\rangle$ or a$\langle$100$\rangle$. Here, the loop formation depends on factors such as dose (D), dose rate (D rt ), temperature (T), chromium content (Cr%), and other alloying elements. Hence, it is important to understand how irradiation-induced dislocation loops evolve conditional upon the loop characteristics, such as loop density (DD), average loop size d̅, and irradiation parameters (D, D rt , T, and irradiation type), which is still an active area of research. To understand these complex structure–property relationships, machine learning (ML) is employed in a three-step approach. This includes imputing missing data with a k-nearest neighbor, generating functionalized features, and assessing feature importance with random forest classification and regression. Physics-based features are incorporated in a hypothesis-driven active learning scheme to overcome data unavailability challenges. Insights obtained from ML models (i) to categorize dislocation loop types, show the highest correlation with d̅; (ii) Log(DD), obtained through mathematical formulations involving D, Cr%, d̅, and T (e.g., Log(DD) ~ D + exp(-Cr%) + 1/d̅ and log(DD) ~ D + exp(-Cr%) + 1/T). Hypothesis-driven active learning is able to predict Log(DD) in which the experimental date is not known. Causal models verify cause–effect relationships for dislocation loop classification and irradiation factors in FeCr alloys.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The NASA Turbulent Heat Flux Experiments: Summary and Lessons Learned

The Turbulent Heat Flux (THX) experiments were conducted at NASA Glenn Research Center (GRC) in order to collect measurements of velocities and temperatures for computational fluid dynamics (CFD) validation of heated flows, with a focus on propulsion system components. The experiments spanned 5 phases; four of which were conducted in the GRC AeroAcoustic Propulsion Laboratory (AAPL) using the Small Hot Jet Flow Rig (SHJAR). In addition to making velocity measurements with Particle Image Velocimetry (PIV), the THX experiments introduced a new Raman-scattering based capability to measure temperatures. Computational studies were also conducted for each of the experimental configurations, in order to provide a baseline of expected CFD results and conduct an assessment of the capability of various CFD approaches for calculating flows where the turbulent transport of heat was important. Two of the collected sets of data were used for American Institute of Aeronautics and Astronautics (AIAA) Propulsion Aerodynamic Workshops (PAWs). The data set from the 5th phase, collected for heated supersonic jets, was also used to construct new validation cases for the NASA Turbulence Model Resource (TMR). This paper provides an overview of the experiments and associated computations for each of the 5 test phases. Key experimental findings are presented. Lessons learned are provided concerning the effect of computational modeling choice on accuracy of predicting turbulent flows where thermal transport is important. Emphasis is placed on comparing Reynolds- averaged Navier-Stokes approaches with large-eddy simulation approaches. The benefits of utilizing a conjugate heat transfer method in conjunction with CFD solver for film cooling is demonstrated.

RANS↗

The NASA Turbulent Heat Flux (THX) Experiments: Summary and Lessons Learned

The Turbulent Heat Flux (THX) experiments were conducted at NASA Glenn Research Center (GRC) in order to collect measurements of velocities and temperatures for computational fluid dynamics (CFD) validation of heated flows, with a focus on propulsion system components. The experiments spanned 5 phases; four of which were conducted in the GRC AeroAcoustic Propulsion Laboratory (AAPL) using the Small Hot Jet Flow Rig (SHJAR). In addition to making velocity measurements with Particle Image Velocimetry (PIV), the THX experiments introduced a new Raman-scattering based capability to measure temperatures. Computational studies were also conducted for each of the experimental configurations, in order to provide a baseline of expected CFD results and conduct an assessment of the capability of various CFD approaches for calculating flows where the turbulent transport of heat was important. Two of the collected sets of data were used for American Institute of Aeronautics and Astronautics (AIAA) Propulsion Aerodynamic Workshops (PAWs). The data set from the 5th phase, collected for heated supersonic jets, was also used to construct new validation cases for the NASA Turbulence Model Resource (TMR). This paper provides an overview of the experiments and associated computations for each of the 5 test phases. Key experimental findings are presented. Lessons learned are provided concerning the effect of computational modeling choice on accuracy of predicting turbulent flows where thermal transport is important. Emphasis is placed on comparing Reynolds-averaged Navier-Stokes approaches with large-eddy simulation approaches. The benefits of utilizing a conjugate heat transfer method in conjunction with CFD solver for film cooling is demonstrated.

RANS↗

Processed Lab Data for Neural Network-Based Shear Stress Level Prediction

Machine learning can be used to predict fault properties such as shear stress, friction, and time to failure using continuous records of fault zone acoustic emissions. The files are extracted features and labels from lab data (experiment p4679). The features are extracted with a non-overlapping window from the original acoustic data. The first column is the time of the window. The second and third columns are the mean and the variance of the acoustic data in this window, respectively. The 4th-11th column is the the power spectrum density ranging from low to high frequency. And the last column is the corresponding label (shear stress level). The name of the file means which driving velocity the sequence is generated from. Data were generated from laboratory friction experiments conducted with a biaxial shear apparatus. Experiments were conducted in the double direct shear configuration in which two fault zones are sheared between three rigid forcing blocks. Our samples consisted of two 5-mm-thick layers of simulated fault gouge with a nominal contact area of 10 by 10 cm^2. Gouge material consisted of soda-lime glass beads with initial particle size between 105 and 149 micrometers. Prior to shearing, we impose a constant fault normal stress of 2 MPa using a servo-controlled load-feedback mechanism and allow the sample to compact. Once the sample has reached a constant layer thickness, the central block is driven down at constant rate of 10 micrometers per second. In tandem, we collect an AE signal continuously at 4 MHz from a piezoceramic sensor embedded in a steel forcing block about 22 mm from the gouge layer The data from this experiment can be used with the deep learning algorithm to train it for future fault property prediction.

15 GEOTHERMAL ENERGY↗

Emerging opportunities for hybrid perovskite solar cells using machine learning

While there are several bottlenecks in hybrid organic–inorganic perovskite (HOIP) solar cell production steps, including composition screening, fabrication, material stability, and device performance, machine learning approaches have begun to tackle each of these issues in recent years. Different algorithms have successfully been adopted to solve the unique problems at each step of HOIP development. Specifically, high-throughput experimentation produces vast amount of training data required to effectively implement machine learning methods. Here, we present an overview of machine learning models, including linear regression, neural networks, deep learning, and statistical forecasting. Experimental examples from the literature, where machine learning is applied to HOIP composition screening, thin film fabrication, thin film characterization, and full device testing, are discussed. These paradigms give insights into the future of HOIP solar cell research. As databases expand and computational power improves, increasingly accurate predictions of the HOIP behavior are becoming possible.

Hering, Abigail R. (ORCID:0000000270806953)↗

In-Situ Scanning Electron Microscope Experiments for Microscale Mechanical Testing and Validated Modeling of Fiber Reinforced Thermoplastics

A novel, in-situ, scanning electron microscope (SEM) mechanical testing capability for materials at the microscale which provides experimental validation to a machine learning (ML) toolset for full-field validation of physics-based micromechanics models is being developed by researchers at NASA Glenn Research Center. These are enabling technologies for the integration of multiscale digital twins for materials into system level models which will result in the improved performance, material discovery, reduced production cost and time, rapid characterization, and prognostic structural health monitoring (SHM) for materials and structures for extreme environments in support of NASA space exploration missions. In order to bridge the material structure-to-system gap for digital twins, physics-based models must be experimentally validated at multiple length scales. Seminal microscale experiments, conducted at the Air Force Research Laboratory (AFRL), were limited to transverse compression of single-layer, unidirectional thermoset polymer matrix composite (PMC) micropillar specimens [1]. The early phases of the current project followed those initial results and setup to reproduce the compression testing of PMC material on the custom-built piezoelectric actuated micromechanical testing rig built by MicroTesting Solutions LLC. In this work, samples of thermoplastic PMC material were first machined into 3 mm cubes, and then further machining and final milling was done using a Focused Ion Beam (FIB). The initial experiment was done on a pillar roughly 20 µm x 20 µm x 40 µm tall. Additional pillars were milled with final sizes ranging from 20 µm x 20 µm x 40 µm tall to 40 µm x 40 µm x 65 µm tall. A speckle pattern for in-situ full-field measurements using Digital Image Correlation (DIC) was applied with platinum, which was coated on the surface, and then the FIB was used to mill away some of the coating to produce an irregular pattern of Pt on the pillar surface. The samples were loaded into the custom testing rig and placed into the SEM and loaded under compression until failure. Images were collected in the SEM during testing. Post-processing of the images was conducted using DIC to obtain full-field displacement and strain measurements elucidating the role of the matrix as well as fiber-fiber interaction at the microscale within the composite subjected to compression loading well into the non-linear regime of the material. Moreover, the evolution of fiber-matrix debonding and matrix cracking is observed in-situ at the microscale. This data, along with images segmented with a newly developed ML toolset [2], was used to create and validate physics-based micromechanics models. An image of the failed micropillar is shown in Figure 1. The techniques developed in the initial compression experiment was tailored to the validation needs of the models and expanded to include different sized samples as well as possibly tension and fatigue.

Laura Wilson↗

Editorial: Functional microcircuits in the brain and in artificial intelligent systems

Fundamental principles underlying higher-order cognitive functions remain elusive, but recent breakthroughs in neurophysiology and deep learning offer new perspectives. First, experimental studies have uncovered neural circuit motifs consisting of various neuron types; see Brain Initiative Cell Census Network (https://www.nature.com/collections/cicghheddj). For example, inhibitory neuron types expressing exclusive genes have specific targets and distinct functions (Pfeffer et al., 2013). Furthermore, diverse neuron types in cortex and their connectomes were identified in cortical columns (Jiang et al., 2015); see also Barth et al. (2016) for a debate on neuron types. Second, artificial neural networks were originally inspired by structures of the brain (McCulloch and Pitts, 1943) and could be trained to perform complex functions similar to human perception/cognition by deep learning (DL) (Lecun et al., 2015).

59 BASIC BIOLOGICAL SCIENCES↗

High Energy Density Physics of Inertial Confinement Fusion Ablator Materials

The historic December 5, 2022 experiment at Lawrence Livermore National Lab’s (LLNL) National Ignition Facility (NIF) reached fusion energy ignition for the first time. This is the most important scientific breakthrough of the 21st century paves the way to future clean inertial fusion energy (IFE). The diamond (high density carbon (HDC)) ablator material used in this experiment displays detrimental effects due to the development of hydrodynamic instabilities at the diamond/fuel interface under shock compression. New alternatives to diamond ablators are required to step up the energy yield in ICF experiments. The unique combination of mechanical strength (approaching that of diamond), the ability to accommodate high-Z dopants (in contrast to diamond), and the tunability of the properties (through synthesis material with varying sp 3 content) make amorphous carbon (a-C) a promising material for next-generation IFE ablative capsules. However, despite its critical importance to the IFE program, the behavior of a-C carbon at extreme temperatures and pressures remains largely unexplored. The primary goals of this project were to perform groundbreaking dynamic compression experiments and predictive simulations to uncover the fundamental high-energy-density physics of amorphous carbon. Our goals were (1) to uncover the metastability range of amorphous carbon and probe phase transitions to diamond or metastable supercooled liquid carbon; (2) to acquire high-quality equation of state (EOS) data and develop an experimentally validated EOS from machine-learning MD simulations of the complex states of carbon; and (3) to uncover the complex behavior of carbon liquid in both thermodynamically stable and metastable supercooled states by accessing large areas of carbon phase diagram with amorphous samples with variable sp 3 content. Our proposed experimental program included measurements of equation of state and diffraction measurements using the Omega EP laser at the Laboratory of Laser Energetics at the University of Rochester. The theoretical/simulation program involved the development of machine-learning models of the complex response of amorphous carbon under dynamic compression by performing molecular dynamics simulations at experimental time and length scales using leadership class DOE supercomputers. Simulations guided experiments to observe predicted phenomena and acquire critical experimental data in specific pressure-temperature domains to validate theoretical models. This research delivered fundamental properties of novel amorphous carbon IFE ablator material, including phase diagram and EOS. These results will aid in IFE target design and implosion experiments. A unique combination of predictive simulations and dynamic and static experiments provided a highly inspirational intellectual environment for graduate students and postdocs involved in this project.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Learning Without Boundaries: A NASA - National Guard Bureau Distance Learning Partnership

With a variety of high-quality live interactive educational programs originating at the Johnson Space Center in Houston, Texas and other space and research centers, the US space agency NASA (National Aeronautics and Space Administration) has a proud track record of connecting with students throughout the world and stimulating their creativity and collaborative skills by teaching them underlying scientific and technological underpinnings of space exploration. However, NASA desires to expand its outreach capability for this type of interactive instruction. In early 2002, NASA and the National Guard Bureau -- using the Guard's nationwide system of state-ofthe-art classrooms and high bandwidth network -- began a collaboration to extend the reach of NASA content and educational programs to more of America's young people. Already, hundreds of elementary, middle, and high school students have visited Guard e-Learning facilities and participated in interactive NASA learning events. Topics have included experimental flight, satellite imagery-interpretation, and Mars exploration. Through this partnership, NASA and the National Guard are enabling local school systems throughout the United States (and, increasingly, the world) to use the excitement of space flight to encourage their students to become passionate about the possibility of one day serving as scientists, mathematicians, technologists, and engineers. At the 54th International Astronautical Conference MAJ Stephan Picard, the guiding visionary behind the Guard's partnership with NASA, and Chris Chilelli, an educator and senior instructional designer at NASA, will share with attendees background on NASA's educational products and the National Guard's distributed learning network; will discuss the unique opportunity this partnership already has provided students and teachers throughout the United States; will offer insights into the formation by government entities of e-Learning partnerships with one another; and will suggest a possible future for the NASA - National Guard Bureau partnership, one potentially to include live multi-party interaction of hundreds of students in several countries with astronauts, scientists, engineers and designers. To inspire the next generation of explorers as only NASA can!

Anderson, Susan H.↗

Improving Self-Driving Labs: Quantifying System-Level Experiment Repeatability and Broadening Instrument-Level Compatibility

Modular Autonomous Research System (MARS) is a self-driving laboratory (SDL) which performs wet-lab science with peptide-lanthanide combinations in an automated and, ultimately, an autonomous manner to aid in soil analysis for domestic lithium mining. Autonomous experimentation involves automated experimentation, experiment planning, and active learning. MARS consists of a 6-axis robotic arm (UR5e) on a linear rail, pipette robots (Opentrons 2), and microplate readers. These components transport, operate on, and collect data with chemical solutions in standard labware. For effective autonomy, MARS must perform system-level labware operations repeatably, plan experiments autonomously, and be portable between research-domains. Repeatability is evaluated by labware placement precision, such that future operations can properly locate labware, as well as the elapsed time, so that low variance mean estimates of experiment duration can inform high-level researcher decision making. Autonomous experiment planning is the next step to decouple experimentation from human management; however, there is a conflict between the ideal system-level experiment goals and the constraints imposed by instruments’ limitations. Sub-domain portability is a long-term goal to extend MARS’ research beyond the chemistry of peptide-lanthanide binding to other sub-domains without having to invest significant overhead to system retrofitting. To address these goals, we manually trained the robotic arm labware placement and modelled statistical failurerate and uncertainty Additionally, we benchmarked the duration and variance of each experiment sub-operation as a heuristic for research decision making. Next, we use a parameterized geometric program (PGP) approach to design experiments that optimize system-level objectives and satisfy instrument-level constraints. Lastly, we proposed a Python framework to maximize MARS’ extensibility to other scientific sub-domains through a JSON-based experiment specification.

36 MATERIALS SCIENCE↗