Search NASA⌕ Search

SEARCH · Search NASA

Results for “Learning systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Uncovering the Forced Climate Response from a Single Ensemble Member Using Statistical Learning

Internal atmospheric variability fundamentally limits predictability of climate and obscures evidence of anthropogenic climate change regionally and on time scales of up to a few decades. Dynamical adjustment techniques estimate and subsequently remove the influence of atmospheric circulation variability on temperature or precipitation. The residual component is expected to contain the thermodynamical signal of the externally forced response but with less circulation-induced noise. Existing techniques have led to important insights into recent trends in regional (hydro-) climate and their drivers, but the variance explained by circulation is often low. Here, we develop a novel dynamical adjustment technique by implementing principles from statistical learning. We demonstrate in an ensemble of Community Earth System Model (CESM) simulations that statistical learning methods, such as regularized linear models, establish a clearer relationship between circulation variability and atmospheric target variables, and need relatively short periods of record for training (around 30 years). The method accounts for, on average, 83% and 78% of European monthly winter temperature and precipitation variability at gridcell level, and around 80% of global mean temperature and hemispheric precipitation variability. We show that the residuals retain forced thermodynamical contributions to temperature and precipitation variability. Accurate estimates of the total forced response can thus be recovered assuming that forced circulation changes are gradual over time. Overall, forced climate response estimates can be extracted at regional or global scales from approximately 3–5 times fewer ensemble members, or even a single realization, using statistical learning techniques. We anticipate the technique will contribute to reducing uncertainties around internal variability and facilitating climate change detection and attribution.

54 ENVIRONMENTAL SCIENCES↗

Technical note: Deep learning for creating surrogate models of precipitation in Earth system models

Abstract. We investigate techniques for using deep neural networks to produce surrogatemodels for short-term climate forecasts. A convolutional neural network istrained on 97 years of monthly precipitation output from the 1pctCO2 run (theCO 2 concentration increases by 1 % per year) simulated by the second-generation Canadian Earth System Model (CanESM2). The neural network clearly outperforms a persistence forecast anddoes not show substantially degraded performance even when the forecast lengthis extended to 120 months. The model is prone to underpredicting precipitationin areas characterized by intense precipitation events. Scheduled sampling(forcing the model to gradually use its own past predictions rather than groundtruth) is essential for avoiding amplification of early forecasting errors.However, the use of scheduled sampling also necessitates preforecasting(generating forecasts prior to the first forecast date) to obtain adequateperformance for the first few prediction time steps. We document the trainingprocedures and hyperparameter optimization process for researchers who wish toextend the use of neural networks in developing surrogate models.

54 ENVIRONMENTAL SCIENCES↗

Potential of deep learning methods to enhance satellite-based monitoring of nuclear power plants focusing on remote operation evaluations

The anticipated expansion of the nuclear industry and the deployment of new nuclear reactors (200 + GW of new nuclear capacity by 2050) require the development of monitoring systems that align with safety and security concerns, providing enhanced evaluation capabilities. A remote monitoring system using satellites and deep learning techniques was evaluated for its ability to detect anomalies and capture various features of nuclear reactors independently of the conditions on the ground. Satellite images of current operational and under-construction nuclear power plants were collected from Google Earth Pro as a surrogate database. Subsequently, five datasets were created from the collected images. Transfer learning technique was used for several classification tasks utilizing VGG16, ResNet50V2, Xception, DenseNet121, and MobileNetV2 pre-trained models. In the first task, the capability of the monitoring system to detect abnormal conditions or processes in a nuclear power plant was investigated. In the second task, the ability to capture operational features remotely was examined. As an example, for the purposes of this study, these features included classifying reactors based on type, power range, or onsite condition. Several evaluation metrics were used to compare the performance of the pre-trained models and the overall monitoring system. Here, the evaluation results demonstrated that deep learning techniques and pre-trained models applied to satellite images have the potential to facilitate further and expand capabilities in monitoring systems to assess plant operation details.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Exploring the Use of Large Immersive Display Systems in the Nuclear Industry

Large immersive display systems play a critical role in the nuclear industry by enabling advanced training, design reviews, scientific visualization, and safety simulations. These systems, such as CAVE and powerwalls, allow engineers and operators to interact with virtual nuclear environments in real-time, providing a deeper understanding of complex systems. Their ability to simulate real-world scenarios for testing and optimization in a safe, controlled environment ensures that operators and engineers can refine process, enhance safety protocols, and troubleshoot complex challenges. This article outlines key lessons learned from deploying these systems, practical insights into their applications, and considerations for future improvements, aiming to guide their broader adoption and effective use in the nuclear industry.

99 - GENERAL AND MISCELLANEOUS↗

Traffic Signal Control With Adaptive Online-Learning Scheme Using Multiple-Model Neural Networks

This article proposes a new traffic signal control algorithm to deal with unknown-traffic-system uncertainties and reduce delays in vehicle travel time. Unknown-traffic-system dynamics are approximated using a recurrent neural network (NN). To accurately identify the traffic system model, an online-learning scheme is developed to switch among a set of candidate NNs (i.e., multiple-model NNs) based on their estimation errors. Then, a bank of optimal signal-timing controllers is designed based on the online identification of the traffic system. Simulation studies have been carried out for the obtained control strategies using multiple-model NNs, and the desired results have been obtained. Moreover, compared with the widely used actuated traffic signal control schemes, it is shown that the proposed method can reduce vehicle travel delays and improve traffic system robustness.

99 GENERAL AND MISCELLANEOUS↗

Application of machine learning interatomic potentials in heterogeneous catalysis

Heterogeneous catalysts are crucial in modern societies as they promote sustainability by enabling lower-energy pathways for various chemical reactions. While Density Functional Theory (DFT) computations can provide critical insights into how heterogeneous catalysts operate at the atomic level, they are limited by computational costs and unfavorable scaling with system size. Recently, machine learning interatomic potentials (MLIPs) have emerged as a promising alternative to DFT, offering near-DFT accuracy at significantly reduced cost. Here, in this perspective, we discuss the application of MLIPs in heterogeneous catalyst modeling as a surrogate for DFT. We detail how MLIPs have been applied in thermal catalysis to probe active sites, enable studying complex metallic and nanoporous catalysts, and investigate the reconstruction of catalytic surfaces. We review the use of MLIPs in electrocatalysis and photocatalysis, emphasizing their capabilities in studying transition metal oxide surfaces and solid–liquid interfaces. We also discuss the current limitations of MLIPs, particularly their challenges with transferability and description of non-local interactions. Finally, we conclude by identifying promising and underexplored domains in which MLIPs can further advance our understanding of heterogeneous catalysts.

Catalytic surfaces↗

Entropy-Infused Deep Learning Loss Function for Capturing Extreme Values in Wind Power Forecasting

Extreme scenarios in wind power generation occur with higher frequency and larger magnitude in the recent years due to the ever-increasing extreme meteorological factors. Accurate forecasting of the occurrence of extreme values in wind power generation is of great concern to ensure reliable power system operation. Recently, deep learning models have surged in popularity for wind power forecasting, with the mean squared error (MSE) loss function being commonly used. However, the MSE loss function, being sensitive to extreme values, disproportionately penalizes larger errors, cannot adequately capture the extreme values present in wind energy data, and novel loss functions have seldom been tailored for wind power forecasting. To this end, in this paper, we introduce a novel loss function specifically crafted to capture extreme values in wind power forecasting. The experimental results with four fundamental deep learning methods on open source wind power dataset validate that the new loss function is efficient and superior in all cases compared to MSE in capturing extreme values while maintaining forecasting performance.

17 WIND ENERGY↗

Machine learning to generate gridded extreme precipitation data sets for global land areas with limited in situ measurements

There is a strong need for gridded observational data sets that describe the climatology of extreme precipitation across the globe; such data sets are critical for quantifying precipitation extremes and their corresponding influence on large perturbations on surface and groundwater systems and flooding. Machine learning (ML) methods can be used to generate pseudo in situ measurements of the climatology of extreme precipitation for land regions with poor sampling by matching relevant geographic (e.g., orography) and atmospheric (e.g., surface temperature, precipitation, and pressure) variables for densely sampled regions and those with limited geographic sampling.

54 ENVIRONMENTAL SCIENCES↗

Proactive Defense for Evolving Cyber Threats

There is great interest to develop proactive methods of cyber defense, in which future attack strategies are anticipated and these insights are incorporated into defense designs; however, little has been done to place this ambitious objective on a sound scientific foundation. Indeed, even fundamental issues associated with how the “arms race” between attackers and defenders actually leads to predictability in attacker activity, or how to effectively and scalably detect this predictability in the relational/temporal data streams generated by attacker/defender adaptation, haven’t been resolved. This LDRD project addressed many of these challenges and the results are briefly summarized here. We have characterized the predictability of attacker/defender coevolution and have leveraged our findings to create a framework for designing proactive defenses for large (organizational) networks. More specifically, this project applied rigorous predictability-based analytics to two central and complementary aspects of the network defense problem – attack strategies of the adversaries and vulnerabilities of the defenders’ systems – and used the results to develop a scientifically-grounded, practically-implementable methodology for designing proactive cyber defense systems. Briefly, predictive analysis of attack strategies involved first conducting predictability assessments to characterize attacker adaptation patterns in given domains, and then used these patterns to “train” adaptive defense systems capable of providing robust performance against both current and (near) future threats. The problem of identifying and prioritizing defender system vulnerabilities was addressed using statistical and machine learning to analyze a broad range of data (e.g., cyber, social media) on recently detected system vulnerabilities to “learn” classifiers that predict how likely it is that, and how soon, new vulnerabilities will be exploited. A variety of cyber threat case studies were developed and investigated throughout the project, one selected from the cyber security research community and one that is more comprehensive and of higher priority to SNL and to external national security partners. A sample of research results and application of this methodology are included in this report (as a series of peer-reviewed publications). For ease of reference the title and SAND number are included below.

97 MATHEMATICS AND COMPUTING↗

Embedding hard physical constraints in neural network coarse-graining of three-dimensional turbulence

In recent years, deep learning approaches have shown much promise in modeling complex systems in the physical sciences. A major challenge in deep learning of partial differential equations is enforcing physical constraints and boundary conditions. In this work, we propose a general framework to directly embed the notion of an incompressible fluid into convolutional neural networks, and apply this to coarse-graining of turbulent flow. These physics-embedded neural networks leverage interpretable strategies from numerical methods and computational fluid dynamics to enforce physical laws and boundary conditions by taking advantage the mathematical properties of the underlying equations. Here, we demonstrate results on three-dimensional fully developed turbulence, showing that this technique drastically improves local conservation of mass, without sacrificing performance according to several other metrics characterizing the fluid flow.

97 MATHEMATICS AND COMPUTING↗

Machine learning the spectral function of a hole in a quantum antiferromagnet

Understanding charge motion in a background of interacting quantum spins is a fundamental problem in quantum many-body physics. The most extensively studied model for this problem is the so-called t-t'-t''-J model, where the determination of the parameter t' in the context of cuprate superconductors is challenging. Here we present a theoretical study of the spectral functions of a mobile hole in the t-t'-t''-J model using two machine-learning techniques: K-nearest neighbor regression (KNN) and a feed-forward neural network (FFNN). We employ the self-consistent Born approximation to generate a dataset of about 1.3 x 10 5 spectral functions. Here we show that, for the forward problem, both methods allow for the accurate and efficient prediction of spectral functions, allowing, e.g., rapid searches through parameter space. Furthermore, we find that for the inverse problem (inferring Hamiltonian parameters from spectra), the FFNN can, but the KNN cannot, accurately predict the model parameters using merely the density of states. Our results suggest that it may be possible to use deep-learning methods to predict materials parameters from experimentally measured spectral functions.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Satellite image analysis for surveillance, vegetation and climate change

Recently, many studies have provided abundant evidence to show the trend of tree mortality is increasing in many regions, and the cause of tree mortality is associated with drought, insect outbreak, or fire. Unfortunately, there is no current capability available to monitor vegetation changes, and correlate and predict tree mortality with CO{sub 2} change, and climate change on the global scale. Different survey platforms (methods) have been used for forest management. Typical ground-based forest surveys measure tree stem diameter, species, and alive or dead. The measurements are low-tech and time consuming, but the sample sizes are large, running into millions of trees, covering large areas, and spanning many years. These field surveys provide powerful ground validation for other survey methods such as photo survey, helicopter GPS survey, and aerial overview survey. The satellite imagery has much larger coverage. It is easier to tile the different images together, and more important, the spatial resolution has been improved such that close to or even higher than aerial survey platforms. Today, the remote sensing satellite data have reached sub-meter spatial resolution for panchromatic channels (IKONOS 2: 1 m; Quickbird-2: 0.61 m; Worldview-2: 0.5 m) and meter spatial resolution for multi-spectral channels (IKONOS 2: 4 meter; Quickbird-2: 2.44 m; Worldview-2: 2 m). Therefore, high resolution satellite imagery can allow foresters to discern individual trees. This vital information should allow us to quantify physiological states of trees, e.g. healthy or dead, shape and size of tree crowns, as well as species and functional compositions of trees. This is a powerful data resource, however, due to the vast amount of the data collected daily, it is impossible for human analysts to review the imagery in detail to identify the vital biodiversity information. Thus, in this talk, we will discuss the opportunities and challenges to use high resolution satellite imagery and machine learning theory to monitor tree mortality at the level of individual trees.

47 OTHER INSTRUMENTATION↗

A GPT‐4 Reticular Chemist for Guiding MOF Discovery**

Abstract We present a new framework integrating the AI model GPT‐4 into the iterative process of reticular chemistry experimentation, leveraging a cooperative workflow of interaction between AI and a human researcher. This GPT‐4 Reticular Chemist is an integrated system composed of three phases. Each of these utilizes GPT‐4 in various capacities, wherein GPT‐4 provides detailed instructions for chemical experimentation and the human provides feedback on the experimental outcomes, including both success and failures, for the in‐context learning of AI in the next iteration. This iterative human‐AI interaction enabled GPT‐4 to learn from the outcomes, much like an experienced chemist, by a prompt‐learning strategy. Importantly, the system is based on natural language for both development and operation, eliminating the need for coding skills, and thus, make it accessible to all chemists. Our collaboration with GPT‐4 Reticular Chemist guided the discovery of an isoreticular series of MOFs, with each synthesis fine‐tuned through iterative feedback and expert suggestions. This workflow presents a potential for broader applications in scientific research by harnessing the capability of large language models like GPT‐4 to enhance the feasibility and efficiency of research activities.

Chemistry↗