Search NASA⌕ Search

SEARCH · Search NASA

Results for “Contrastive learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Accuracy, transferability, and computational efficiency of interatomic potentials for simulations of carbon under extreme conditions

Large-scale atomistic molecular dynamics (MD) simulations provide an exceptional opportunity to advance the fundamental understanding of carbon under extreme conditions of high pressures and temperatures. However, the fidelity of these simulations depends heavily on the accuracy of classical interatomic potentials governing the dynamics of many-atom systems. Here, this study critically assesses several popular empirical potentials for carbon, as well as machine learning interatomic potentials (MLIPs), in their ability to simulate a range of physical properties at high pressures and temperatures, including the diamond equation of state, its melting line, shock Hugoniot, uniaxial compressions, and the structure of liquid carbon. Empirical potentials fail to accurately predict the behavior of carbon under high pressure–temperature conditions. In contrast, MLIPs demonstrate quantum accuracy, with Spectral Neighbor Analysis Potential (SNAP) and atomic cluster expansion (ACE) being the most accurate in reproducing the density functional theory results. ACE displays remarkable transferability despite not being specifically trained for extreme conditions. Furthermore, ACE and SNAP exhibit superior computational performance on graphics processing unit-based systems in billion atom MD simulations, with SNAP emerging as the fastest. In addition to offering practical guidance in selecting an interatomic potential with a fine balance of accuracy, transferability, and computational efficiency, this work also highlights transformative opportunities for groundbreaking scientific discoveries facilitated by quantum-accurate MD simulations with MLIPs on emerging exascale supercomputers.

36 MATERIALS SCIENCE↗
DOE OSTI2023

NREM sleep as a novel protective cognitive reserve factor in the face of Alzheimer's disease pathology

Alzheimer’s disease (AD) pathology impairs cognitive function. Yet some individuals with high amounts of AD pathology suffer marked memory impairment, while others with the same degree of pathology burden show little impairment. Why is this? One proposed explanation is cognitive reserve i.e., factors that confer resilience against, or compensation for the effects of AD pathology. Deep NREM slow wave sleep (SWS) is recognized to enhance functions of learning and memory in healthy older adults. However, that the quality of NREM SWS (NREM slow wave activity, SWA) represents a novel cognitive reserve factor in older adults with AD pathology, thereby providing compensation against memory dysfunction otherwise caused by high AD pathology burden, remains unknown. Here, we tested this hypothesis in cognitively normal older adults (N = 62) by combining 11 C-PiB (Pittsburgh compound B) positron emission tomography (PET) scanning for the quantification of β-amyloid (Aβ) with sleep electroencephalography (EEG) recordings to quantify NREM SWA and a hippocampal-dependent face-name learning task. We demonstrated that NREM SWA significantly moderates the effect of Aβ status on memory function. Specifically, NREM SWA selectively supported superior memory function in individuals suffering high Aβ burden, i.e., those most in need of cognitive reserve (B = 2.694, p = 0.019). In contrast, those without significant Aβ pathological burden, and thus without the same need for cognitive reserve, did not similarly benefit from the presence of NREM SWA (B = -0.115, p = 0.876). This interaction between NREM SWA and Aβ status predicting memory function was significant after correcting for age, sex, Body Mass Index, gray matter atrophy, and previously identified cognitive reserve factors, such as education and physical activity (p = 0.042). These findings indicate that NREM SWA is a novel cognitive reserve factor providing resilience against the memory impairment otherwise caused by high AD pathology burden. Furthermore, this cognitive reserve function of NREM SWA remained significant when accounting both for covariates, and factors previously linked to resilience, suggesting that sleep might be an independent cognitive reserve resource. Beyond such mechanistic insights are potential therapeutic implications. Unlike many other cognitive reserve factors (e.g., years of education, prior job complexity), sleep is a modifiable factor. As such, it represents an intervention possibility that may aid the preservation of cognitive function in the face of AD pathology, both present moment and longitudinally.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Grid-Interactive Multi-Zone Building Control Using Reinforcement Learning with Global-Local Policy Search

In this paper, we develop a grid-interactive multi-zone building controller based on a deep reinforcement learning (RL) approach. The controller is designed to facilitate building operation during normal conditions and demand response events, while ensuring occupants comfort and energy efficiency. We leverage a continuous action space RL formulation, and devise a two-stage global-local RL training framework. In the first stage, a global fast policy search is performed using a gradient-free RL algorithm. In the second stage, a local fine-tuning is conducted using a policy gradient method. In contrast to the state-of-the-art model predictive control (MPC) approach, the proposed RL controller does not require complex computation during real-time operation and can adapt to nonlinear building models. We illustrate the controller performance numerically using a five-zone commercial building.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2021

Comprehensive framework for data-driven model form discovery of the closure laws in thermal-hydraulics codes

The two-phase two-fluid model is a basis of many thermal-hydraulics codes used in design, licensing, and safety considerations of nuclear power plants. Thermal-hydraulics codes rely on the closure laws to close the system of conservation equations and describe the interactions between phases. These laws, derived from years of experimental investigations, are semi-empirical correlations that lack generality and have a limited range of applicability. Increase of computational power, availability of new experiments, and development of high-fidelity simulations has increased the number of validation data. The discrepancies between the code predictions and the validation data are a great source of knowledge. Missing physics that are not included in the model but are important for the considered phenomena can be discovered by propagating the information from the experimental results through the model. Furthermore, physics-discovered data-driven model form (P3DM) methodology integrates available integral effect tests and separate effects tests to determine the necessary corrections to the model form of the closure laws. In contrast to existing calibration techniques, the methodology modifies the functional form of the closure laws. Based on the functional form of the correction, the missing physics that were not included in the original model can be discovered. The methodology provides the alternative to the machine learning approach, in which the model is discovered in the form of the intractable black-box relation. In this work, the methodology was applied to the CTF subchannel code to improve the prediction of the two-phase flow phenomena.

42 ENGINEERING↗
DOE OSTI2026

2D nanoconfinement distorts the solvation structure of hydroxide but not of hydronium

Understanding ion-specific behavior in nanoconfined water is essential for controlling charge transport and selectivity in two-dimensional membranes. Motivated by recent experiments revealing anomalous dielectric and transport behavior of water confined between hBN sheets, we use machine-learning-accelerated first-principles molecular dynamics to investigate the interfacial propensities of hydronium and hydroxide ions under similar confinement. We find that hydronium remains interfacial across all confinement regimes, whereas hydroxide shifts toward the interior as the environment becomes more bulk-like. This contrasting behavior reflects the combined influence of hydrogen bonding, interfacial water layering, and the polarization of hBN, which collectively stabilize hydronium at the surface while making hydroxide slightly more favorable within the structured interior. These findings expose an asymmetry in ion-surface coupling and establish a microscopic origin for hydronium’s enhanced interfacial affinity. The results provide mechanistic insight into ion partitioning in two-dimensional channels and highlight the collective structuring of confined water as a key determinant of interfacial ion thermodynamics.

organic↗
DOE OSTI2021

Grid-Interactive Multi-Zone Building Control Using Reinforcement Learning with Global-Local Policy Search: Preprint

In this paper, we develop a grid-interactive multi-zone building controller based on a deep reinforcement learning (RL) approach. The controller is designed to facilitate building operation during normal conditions and demand response events, while ensuring occupants comfort and energy efficiency. We leverage a continuous action space RL formulation, and devise a two-stage global-local RL training framework. In the first stage, a global fast policy search is performed using a gradient-free RL algorithm. In the second stage, a local fine-tuning is conducted using a policy gradient method. In contrast to the state-of-the-art model predictive control (MPC) approach, the proposed RL controller does not require complex computation during real-time operation and can adapt to non-linear building models. We illustrate the controller performance numerically using a five-zone commercial building.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2026

Li + /H + Exchange in Solid-State Oxide Li-Ion Conductors

Understanding the moisture stability of oxide Li-ion conductors is important for their practical applications in solid-state batteries. Unlike sulfide or halide conductors, oxide conductors generally better resist degradation when in contact with water but can still undergo topotactic Li + /H + exchange (LHX). Here, we combine density functional theory (DFT) calculations with a machine-learning interatomic potential model to investigate the thermodynamic driving force of the LHX reaction for two representative oxide Li-ion conductor families: garnets and NASICONs. Li-stuffed garnets exhibit a strong driving force for proton exchange due to their high Li chemical potential. In contrast, NASICONs demonstrate a higher resistance against proton exchange due to the lower Li chemical potential and the lower O–H bond covalency for polyanion-bonded oxygens. Our findings reveal a critical trade-off: Li stuffing enhances conductivity but increases moisture susceptibility. This study underscores the importance of designing Li-ion conductors that possess both high conductivity and high stability in practical environments.

Li, Zhuohan [Lawrence Berkeley National Laboratory↗
DOE OSTI2023

Resolution-enhanced X-ray fluorescence microscopy via deep residual networks

Abstract Multimodal hard X-ray scanning probe microscopy has been extensively used to study functional materials providing multiple contrast mechanisms. For instance, combining ptychography with X-ray fluorescence (XRF) microscopy reveals structural and chemical properties simultaneously. While ptychography can achieve diffraction-limited spatial resolution, the resolution of XRF is limited by the X-ray probe size. Here, we develop a machine learning (ML) model to overcome this problem by decoupling the impact of the X-ray probe from the XRF signal. The enhanced spatial resolution was observed for both simulated and experimental XRF data, showing superior performance over the state-of-the-art scanning XRF method with different nano-sized X-ray probes. Enhanced spatial resolutions were also observed for the accompanying XRF tomography reconstructions. Using this probe profile deconvolution with the proposed ML solution to enhance the spatial resolution of XRF microscopy will be broadly applicable across both functional materials and biological imaging with XRF and other related application areas.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Emerging signals of declining forest resilience under climate change

Forest ecosystems depend on their capacity to withstand and recover from natural and anthropogenic perturbations (that is, their resilience). Experimental evidence of sudden increases in tree mortality is raising concerns about variation in forest resilience, yet little is known about how it is evolving in response to climate change. Here we integrate satellite-based vegetation indices with machine learning to show how forest resilience, quantified in terms of critical slowing down indicators, has changed during the period 2000–2020. We show that tropical, arid and temperate forests are experiencing a significant decline in resilience, probably related to increased water limitations and climate variability. By contrast, boreal forests show divergent local patterns with an average increasing trend in resilience, probably benefiting from warming and CO 2 fertilization, which may outweigh the adverse effects of climate change. These patterns emerge consistently in both managed and intact forests, corroborating the existence of common large-scale climate drivers. Reductions in resilience are statistically linked to abrupt declines in forest primary productivity, occurring in response to slow drifting towards a critical resilience threshold. Approximately 23% of intact undisturbed forests, corresponding to 3.32 Pg C of gross primary productivity, have already reached a critical threshold and are experiencing a further degradation in resilience. Together, these signals reveal a widespread decline in the capacity of forests to withstand perturbation that should be accounted for in the design of land-based mitigation and adaptation plans

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Integrating deep neural networks with full-waveform inversion: Reparameterization, regularization, and uncertainty quantification

Full-waveform inversion (FWI) is an accurate imaging approach for modeling the velocity structure by minimizing the misfit between recorded and predicted seismic waveforms. However, the strong nonlinearity of FWI resulting from fitting oscillatory waveforms can trap the optimization in local minima. We have adopted a neural-network-based full-waveform inversion (NNFWI) method that integrates deep neural networks with FWI by representing the velocity model with a generative neural network. Neural networks can naturally introduce spatial correlations as regularization to the generated velocity model, which suppresses noise in the gradients and mitigates local minima. Furthermore, the velocity model generated by neural networks is input to the same partial differential equation (PDE) solvers used in conventional FWI. The gradients of the neural networks and PDEs are calculated using automatic differentiation, which back propagates gradients through the acoustic PDEs and neural network layers to update the weights of the generative neural network. Experiments on 1D velocity models, the Marmousi model, and the 2004 BP model determine that NNFWI can mitigate local minima, especially for imaging high-contrast features such as salt bodies, and it significantly improves the inversion in the presence of noise. Adding dropout layers to the neural network model also allows analyzing the uncertainty of the inversion results through Monte Carlo dropout. NNFWI opens a new pathway to combine deep learning and FWI for exploiting the characteristics of deep neural networks and the high accuracy of PDE solvers. Because NNFWI does not require extra training data and optimization loops, it provides an attractive and straightforward alternative to conventional FWI.

58 GEOSCIENCES↗
DOE OSTI2023

Contrasting changes in ozone during 2019–2021 between eastern and the other regions of China attributed to anthropogenic emissions and meteorological conditions

Ozone pollution is one of the most severe air quality issues in China that poses a serious threat to human health and ecosystems. During 2019–2021, the maximum daily 8-h average ozone concentrations in eastern China (110–122.5°E, 26–42°N) and the rest of China (ROC) show different decreasing patterns, with ozone concentrations in eastern China decreasing by 14.9 μg/m 3 , which is much larger than 4.8 μg/m 3 in ROC. Here, based on two independent methods, the atmospheric chemical transport model (GEOS-Chem) simulations and the machine learning (ML) model (LightGBM) predictions, the reasons for the differences in ozone changes between eastern China and ROC during the warm season (April to September) are investigated. According to the GEOS-Chem (LightGBM) results, changes in the meteorological conditions contributed to an ozone decrease by 7.3 (6.8) μg/m 3 in eastern China due to decreased chemical production and an ozone decrease by 6.8 (7.0) μg/m 3 in ROC attributed to the weakened horizontal and vertical advection. With the influence of meteorological factors excluded, the observations show that changes in anthropogenic emissions resulted in an ozone decrease by 7.6 (8.1) μg/m 3 in eastern China and an ozone increase by 2.0 (2.2) μg/m 3 in ROC, which is primarily induced by the changes in NO x emissions. The surface measurements and satellite retrievals also indicate that the reduction in NO x emissions in ROC is less efficient than that in the more developed eastern China, leading to contrasting changes in ozone concentrations between eastern China and ROC during 2019–2021. In conclusion, our results highlight the critical need to reduce ozone precursor emissions in the rest regions of China apart from eastern China.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Automated Experiments of Local Non–Linear Behavior in Ferroelectric Materials

An automated experiment in multimodal imaging to probe structural, chemical, and functional behaviors in complex materials and elucidate the dominant physical mechanisms that control device function is developed and implemented. Here, the emergence of non-linear electromechanical responses in piezoresponse force microscopy (PFM) is explored. Non-linear responses in PFM can originate from multiple mechanisms, including intrinsic material responses often controlled by domain structure, surface topography that affects the mechanical phenomena at the tip-surface junction, and the presence of surface contaminants. Using an automated experiment to probe the origins of non-linear behavior in ferroelectric lead titanate (PTO) and ferroelectric Al 0.93 B 0.07 N films, it is found that PTO shows asymmetric nonlinear behavior across a/c domain walls and a broadened high nonlinear response region around c/c domain walls. In contrast, for Al 0.93 B 0.07 N, well-poled regions show high linear piezoelectric responses, when paired with low non-linear responses regions that are multidomain show low linear responses and high nonlinear responses. It is shown that formulating dissimilar exploration strategies in deep kernel learning as alternative hypotheses allows for establishing the preponderant physical mechanisms behind the non-linear behaviors, suggesting that automated experiments can potentially discern between competing physical mechanisms. Furthermore, this technique can also be extended to electron, probe, and chemical imaging.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Increasing sensitivity of dryland vegetation greenness to precipitation due to rising atmospheric CO 2

Water availability plays a critical role in shaping terrestrial ecosystems, particularly in low- and mid-latitude regions. The sensitivity of vegetation growth to precipitation strongly regulates global vegetation dynamics and their responses to drought, yet sensitivity changes in response to climate change remain poorly understood. Here we use long-term satellite observations combined with a dynamic statistical learning approach to examine changes in the sensitivity of vegetation greenness to precipitation over the past four decades. We observe a robust increase in precipitation sensitivity (0.624% yr –1 ) for drylands, and a decrease (–0.618% yr –1 ) for wet regions. Using model simulations, we show that the contrasting trends between dry and wet regions are caused by elevated atmospheric CO 2 (eCO 2 ). eCO 2 universally decreases the precipitation sensitivity by reducing leaf-level transpiration, particularly in wet regions. However, in drylands, this leaf-level transpiration reduction is overridden at the canopy scale by a large proportional increase in leaf area. The increased sensitivity for global drylands implies a potential decrease in ecosystem stability and greater impacts of droughts in these vulnerable ecosystems under continued global change.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Fourier-based three-dimensional multistage transformer for aberration correction in multicellular specimens

High-resolution tissue imaging is often compromised by sample-induced optical aberrations that degrade resolution and contrast. Although wavefront sensor-based adaptive optics (AO) can measure these aberrations, such hardware solutions are typically complex, expensive to implement and slow when serially mapping spatially varying aberrations across large fields of view. Here we introduce AOViFT (adaptive optical vision Fourier transformer)—a machine learning-based aberration sensing framework built around a three-dimensional multistage vision transformer that operates on Fourier domain embeddings. AOViFT infers aberrations and restores diffraction-limited performance in puncta-labeled specimens with substantially reduced computational cost, training time and memory footprint compared to conventional architectures or real-space networks. We validated AOViFT on live gene-edited zebrafish embryos, demonstrating its ability to correct spatially varying aberrations using either a deformable mirror or postacquisition deconvolution. By eliminating the need for the guide star and wavefront sensing hardware and simplifying the experimental workflow, AOViFT lowers technical barriers for high-resolution volumetric microscopy across diverse biological samples.

Alshaabi, Thayer [Howard Hughes Medical Institute,↗
DOE OSTI2024

Understanding Twinning and Deformation in High Entropy Alloys

A combination of high strength and high ductility has been observed in multi-principal element alloys due to twin formation attributed to low stacking fault energy (SFE). In the pursuit of low SFE alloys, a key bottleneck is the lack of understanding of the composition–SFE cor- relations that would guide tailoring SFE via alloy composition. Using density functional theory (DFT), we show that dopant radius, which have been postulated as a key descriptor for SFE in dilute alloys, does not fully explain SFE trends across different host metals. Instead, charge density is a much more central descriptor. It allows us to (1) explain contrasting SFE trends in Ni and Cu host metals due to various dopants in dilute concentrations, (2) explain the large SFE variations observed in the literature even within a given alloy composition due to the nearest neighbor environments in “model” concentrated alloys, and (3) develop a machine learning model that can be used to predict SFEs in multi-elemental alloys. This model opens a possibility to use charge density as a descriptor for predicting SFE in alloys. Furthermore, a descriptor-less machine learning (ML) model based only on charge density images extracted from density functional theory (DFT) is developed to predict stacking fault energies (SFE) in concentrated alloys. The model is based on convolutional neural networks (CNNs) as one of the promising ML techniques for dealing with complex images and data. Identification of correct descriptors is a key bottleneck to develop ML models for predicting materials properties. Often, in most ML models, textbook physical descriptors such as atomic radius, valence charge and electronegativity are used as descriptors which have limitations because these properties change in concentrated alloys when multiple elements are mixed to form a solid solution. We illustrate that, within the scope of DFT, the search for descriptors can be circumvented by electronic charge density, which is the backbone of the Kohn-Sham DFT and describes the system completely. The performance of our model is demonstrated by predicting SFE of concentrated alloys with an RMSE and R2 of 6.18 mJ/m2 and 0.87, respectively, validating the accuracy of the proposed approach.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Probing degradation at solid-state battery interfaces using machine-learning interatomic potential

Solid-state batteries featuring fast ion-conducting solid electrolytes are promising next-generation energy storage technologies, yet challenges remain for practical deployment due to electro-chemo-mechanical instabilities at solid-solid interfaces. These interfaces, which include homogeneous/internal interfaces such as grain boundaries (GBs) and heterogeneous/external interfaces between solid-electrolyte and electrode materials, can impede Li-ion transport, deteriorate performance, and eventually lead to cell failure. Here, in this study, we leverage large-scale molecular simulations, enabled by validated machine-learning interatomic potentials, to directly probe the onset of interfacial degradation at the garnet Li 7 La 3 Zr 2 O 12 (LLZO) solid-electrolyte/LiCoO 2 (LCO) cathode interface. By surveying different interfacial geometries and compositions, it is found that Li-deficient interfaces can lead to severe interfacial disordering with cation mixing and Co interdiffusion from LCO into LLZO. By contrast, Li-sufficient interfaces are less disordered, although elemental segregation with local ordering is observed. As a consequence of Co interdiffusion, Co-rich regions are formed at the GBs of LLZO due to cation segregation and trapping effects. This behavior is independent of the GB tilting axis, degree of disorder at the GBs, and Co concentration, which implies Co clustering at GBs is a general phenomenon in polycrystalline LLZO and can dictate its overall transport and mechanical properties. Our findings elucidate the underlying fundamental mechanisms that give rise to experimentally observed physicochemical properties and provide guidelines for interface design that can mitigate interfacial degradation and improve cycling performance.

25 ENERGY STORAGE↗
DOE OSTI2021

Monitoring leaf phenology in moist tropical forests by applying a superpixel-based deep learning method to time-series images of tree canopies

Tropical leaf phenology-particularly its variability at the tree-crown scale-dominates the seasonality of carbon and water fluxes. However, given enormous species diversity, accurate means of monitoring leaf phenology in tropical forests is still lacking. Time series of the Green Chromatic Coordinate (GCC) metric derived from tower-based red-green-blue (RGB) phenocams have been widely used to monitor leaf phenology in temperate forests, but its application in the tropics remains problematic. To improve monitoring of tropical phenology, we explored the use of a deep learning model (i.e. superpixel-based Residual Networks 50, SP-ResNet50) to automatically differentiate leaves from non-leaves in phenocam images and to derive leaf fraction at the tree-crown scale. To evaluate our model, we used a year of data from six phenocams in two contrasting forests in Panama. Here, we first built a comprehensive library of leaf and non-leaf pixels across various acquisition times, exposure conditions and specific phenocams. We then divided this library into training and testing components. We evaluated the model at three levels: 1) superpixel level with a testing set, 2) crown level by comparing the model-derived leaf fractions with those derived using image-specific supervised classification, and 3) temporally using all daily images to assess the diurnal stability of the model-derived leaf fraction. Finally, we compared the model-derived leaf fraction phenology with leaf phenology derived from GCC. Our results show that: 1) the SP-ResNet50 model accurately differentiates leaves from non-leaves (overall accuracy of 93%) and is robust across all three levels of evaluations; 2) the model accurately quantifies leaf fraction phenology across tree-crowns and forest ecosystems; and 3) the combined use of leaf fraction and GCC helps infer the timing of leaf emergence, maturation and senescence, critical information for modeling photosynthetic seasonality of tropical forests. Collectively, this study offers an improved means for automated tropical phenology monitoring using phenocams.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Artificial intelligence for materials research at extremes

Abstract Materials development is slow and expensive, taking decades from inception to fielding. For materials research at extremes, the situation is even more demanding, as the desired property combinations such as strength and oxidation resistance can have complex interactions. Here, we explore the role of AI and autonomous experimentation (AE) in the process of understanding and developing materials for extreme and coupled environments. AI is important in understanding materials under extremes due to the highly demanding and unique cases these environments represent. Materials are pushed to their limits in ways that, for example, equilibrium phase diagrams cannot describe. Often, multiple physical phenomena compete to determine the material response. Further, validation is often difficult or impossible. AI can help bridge these gaps, providing heuristic but valuable links between materials properties and performance under extreme conditions. We explore the potential advantages of AE along with decision strategies. In particular, we consider the problem of deciding between low-fidelity, inexpensive experiments and high-fidelity, expensive experiments. The cost of experiments is described in terms of the speed and throughput of automated experiments, contrasted with the human resources needed to execute manual experiments. We also consider the cost and benefits of modeling and simulation to further materials understanding, along with characterization of materials under extreme environments in the AE loop. Graphical abstract AI sequential decision-making methods for materials research: Active learning, which focuses on exploration by sampling uncertain regions, Bayesian and bandit optimization as well as reinforcement learning (RL), which trades off exploration of uncertain regions with exploitation of optimum function value. Bayesian and bandit optimization focus on finding the optimal value of the function at each step or cumulatively over the entire steps, respectively, whereas RL considers cumulative value of the labeling function, where the latter can change depending on the state of the system (blue, orange, or green).

36 MATERIALS SCIENCE↗