Search NASA⌕ Search

SEARCH · Search NASA

Results for “Learning systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

Active Learning in the Era of Big Data

Active learning methods automatically adapt data collection by selecting the most informative samples in order to accelerate machine learning. Because of this, real-world testing and comparing active learning algorithms requires collecting new datasets (adaptively), rather than simply applying algorithms to benchmark datasets, as is the norm in (passive) machine learning research. To facilitate the development, testing and deployment of active learning for real applications, we have built an open-source software system for large-scale active learning research and experimentation. The system, called NEXT, provides a unique platform for realworld, reproducible active learning research. This paper details the challenges of building the system and demonstrates its capabilities with several experiments. The results show how experimentation can help expose strengths and weaknesses of active learning algorithms, in sometimes unexpected and enlightening ways.

Jamieson, Kevin↗

Change Detection Applications in the Earth Sciences Using UAS-Based Sensing: A Review and Future Opportunities

Over the past decade, advancements in collection platforms such as unoccupied aerial systems (UAS), survey-grade GNSS, sensor packages, processing software, and spatial analytical tools have facilitated change detection analyses at an unprecedented resolution over broader spatial and temporal extents and in environments where such investigations present challenges. These technological improvements, coupled with the accessibility and versatility of UAS technology, have pushed the boundaries of spatial and temporal scales in geomorphic change detection. As a result, the cm-scale analysis of topographic signatures can detect and quantify surface anomalies during geomorphic evolution. This review focuses on the use of UAS photogrammetry for fine spatial (cm) and temporal (hours to days) scale geomorphic analyses, and it highlights analytical approaches to detect and quantify surface processes that were previously elusive. The review provides insight into topographic change characterization with precise spatial validations applied to landscape processes in various fields, such as the cryosphere and geosphere, as well as anthropogenic earth processes and national security applications. This work sheds light on previously unexplored aspects of both natural and human-engineered environments, demonstrating the potential of UAS observations in change detection. Our discussion examines the emerging horizons of UAS-based change detection, including machine learning and LIDAR systems. In addition, our meta-analysis of spatial and temporal UAS-based observations highlights the new fine-scale niche of UAS-photogrammetry. This scale advancement sets a new frontier in change detection, offering exciting possibilities for the future of land surface analysis and environmental monitoring in the field of Earth Science.

Andresen, Christian G.↗

Discovering Blind Geothermal Systems in the Great Basin Region: An Integrated Geologic and Geophysical Approach for Establishing Geothermal Play Fairways: All Phases

Most geothermal resources in the Great Basin region of the western USA are blind, and thus the discovery of new commercial-grade systems requires synthesis of favorable characteristics for geothermal activity. The geothermal play fairway concept involves integration of multiple parameters indicative of geothermal activity to identify promising areas for new development. This project integrated multiple datasets to apply the play fairway concept and assess geothermal potential in a large region of the Great Basin in Nevada. It is therefore referred to as the Nevada play fairway project. This project was a strong collaborative effort between several organizations, led by the Nevada Bureau of Mines and Geology at the University of Nevada, Reno, but with key support from the U.S. Geological Survey, ATLAS Geosciences, Inc,, Hi-Q Geophysical, Inc., Lawrence Berkeley National Laboratory, Utah Geological Survey, and Innovative Geothermal Ltd. In Budget Period 1 of this project, available data for nine geologic, geochemical, and geophysical parameters were initially synthesized to produce a new detailed geothermal potential map of 96,000 km2 from west-central to eastern Nevada. These parameters were grouped into subsets and individually weighted to delineate rankings for local permeability, intermediate permeability, regional permeability, and thermal potential, which collectively defined geothermal play fairways (i.e., most likely locations for significant geothermal fluid flow). This initial work was aimed at reducing the risks in regional exploration and therefore facilitating discovery of new commercial-grade systems in blind settings, as well as in areas with surface expressions of geothermal activity. Budget Period 2 of the project involved detailed analysis of some of the most promising areas identified in Phase 1. Twenty-four highly prospective areas, including both known undeveloped systems and previously undiscovered potential blind systems, were identified for further analysis. After reconnaissance of these areas, five of the most promising sites were selected for detailed studies. Multiple techniques were employed in the detailed studies, including geologic mapping, shallow temperature surveys, gravity surveys, Lidar, geochemical studies, seismic reflection analysis, and 3D modeling. The goal of the detailed studies was to identify specific areas with the highest likelihood for high permeability and thermal fluids, such that drill sites could be targeted. Three main sets of predictive maps were generated for each detailed study area: 1) play fairway maps, 2) play fairway error maps, and 3) direct evidence maps. Local- and intermediate-scale permeability models were revised to reflect results of the detailed geologic, geophysical, and geochemical analyses. Budget Period 3 of the project involved more detailed geophysical analyses and temperature-gradient (TG) drilling in southeastern Gabbs Valley and northern Granite Springs Valley, deemed the two most promising sites, with the goal of providing preliminary validation of the play fairway methodology. In southeastern Gabbs Valley, the collocation of a favorable structural setting (displacement transfer zone and fault intersections), Quaternary faults, intersecting and terminating gravity gradients, magnetic low, shallow (2 m) temperature anomaly, low resistivity anomaly, and promising geothermometry from nearby water wells provided evidence for a blind system. Drilling of six TG holes defines an apparent geothermal system at this locality with temperatures as high as 124°C at 152 m. This system is blind, with no surface hot springs, fumaroles, or paleo-geothermal deposits. For northern Granite Springs Valley, a favorable structural setting (termination of a major Quaternary normal fault), terminating gravity gradient, magnetic gradient, newly discovered sinter deposits, nearby warm water wells, previously drilled TG holes in the vicinity, and promising geothermometry suggest a hidden system. Drilling of six new TG holes yields temperatures of ~96°C at ~250 m, suggesting the presence of a geothermal system. Major lessons learned in the course of this project include: 1) initially identified sites commonly include multiple favorable structural settings at a finer scale; 2) promising sites in Cenozoic basins cannot be recognized without detailed geophysical surveys; and 3) play fairway analysis should be refined as the exploration program vectors into the most promising sites and finer-scale data are acquired. In addition to producing copious amounts of data, this project resulted in 16 published papers, 10 abstracts, more than 40 presentations across the U.S. and abroad (including several keynote addresses), 2 Masters theses, and 7 media reports.

15 GEOTHERMAL ENERGY↗

Development of a Smart Alarm System for the CEBAF Injector

RadiaSoft and Jefferson Laboratory are working together to develop a machine-learning-based smart alarm system for the CEBAF injector. Because of the injector’s large number of parameters and possible fault scenarios, it is highly desirable to have an autonomous alarm system that can quickly identify and diagnose unusual machine states. We present our work on artificial neural networks designed to identify such undesirable machine states. In particular, we test both auto-encoders and inverse models as possible tools for differentiating between normal and abnormal states. These models are being developed using both supervised and unsupervised learning techniques, and are being trained using CEBAF injector data collected during dedicated machine studies as well as during regular operations. Lastly, we discuss tradeoffs between the two types of models.

Abell, D. T.↗

ClimGen: Learning the Forcing-Response Relationship in Climate System

Solar Radiation Management (SRM) is emerging as a potential geoengineering strategy to address the anthropogenic impact on climate, but its effective implementation requires an iterative and large ensemble of highly accurate and efficient climate projections. Traditional climate projections rely on executing computationally demanding and time-consuming numerical climate models. Recent advances in machine learning (ML) aim to enhance these approaches by emulating traditional methods. In this work, we propose a novel framework for directly learning the relationship between solar radiation flux at the top of the atmosphere and the corresponding surface temperature response. To evaluate the feasibility of this direct ML-based projection, we developed a dataset using an intermediate complexity model, incorporating a comprehensive suite of different forcing patterns and evaluation metrics to rigorously assess the ML model’s performance. We introduce a Conditional Denoising Diffusion Probabilistic Model (cDDPM) for this task, which demonstrates encouraging skill in representing climate statistics under previously unseen forcing patterns. This approach provides a promising pathway for direct climate projections by accurately learning the forcing-response relationship, with a wide range of applications in impact mitigation, emissions policy design, and SRM strategies.

Chen, Tse-Chun [BATTELLE (PACIFIC NW LAB)] (ORCID:↗

A deep potential model with long-range electrostatic interactions

Machine learning models for the potential energy of multi-atomic systems, such as the deep potential (DP) model, make molecular simulations with the accuracy of quantum mechanical density functional theory possible at a cost only moderately higher than that of empirical force fields. However, the majority of these models lack explicit long-range interactions and fail to describe properties that derive from the Coulombic tail of the forces. To overcome this limitation, we extend the DP model by approximating the long-range electrostatic interaction between ions (nuclei + core electrons) and valence electrons with that of distributions of spherical Gaussian charges located at ionic and electronic sites. The latter are rigorously defined in terms of the centers of the maximally localized Wannier distributions, whose dependence on the local atomic environment is modeled accurately by a deep neural network. In the DP long-range (DPLR) model, the electrostatic energy of the Gaussian charge system is added to short-range interactions that are represented as in the standard DP model. The resulting potential energy surface is smooth and possesses analytical forces and virial. Missing effects in the standard DP scheme are recovered, improving on accuracy and predictive power. By including long-range electrostatics, DPLR correctly extrapolates to large systems the potential energy surface learned from quantum mechanical calculations on smaller systems. We illustrate the approach with three examples: the potential energy profile of the water dimer, the free energy of interaction of a water molecule with a liquid water slab, and the phonon dispersion curves of the NaCl crystal.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Earth's record-high greenness and its attributions in 2020

Terrestrial vegetation is a crucial component of Earth's biosphere, regulating global carbon and water cycles and contributing to human welfare. Despite an overall greening trend, terrestrial vegetation exhibits a significant inter-annual variability. The mechanisms driving this variability, particularly those related to climatic and anthropogenic factors, remain poorly understood, which hampers our ability to project the long-term sustainability of ecosystem services. Here, in this work, by leveraging diverse remote sensing measurements, we pinpointed 2020 as a historic landmark, registering as the greenest year in modern satellite records from 2001 to 2020. Using ensemble machine learning and Earth system models, we found this exceptional greening primarily stemmed from consistent growth in boreal and temperate vegetation, attributed to rising CO 2 levels, climate warming, and reforestation efforts, alongside a transient tropical green-up linked to the enhanced rainfall. Contrary to expectations, the COVID-19 pandemic lockdowns had a limited impact on this global greening anomaly. Our findings highlight the resilience and dynamic nature of global vegetation in response to diverse climatic and anthropogenic influences, offering valuable insights for optimizing ecosystem management and informing climate mitigation strategies.

54 ENVIRONMENTAL SCIENCES↗

hippynn Python Package

hippynn is a python package for defining, training, and applying neural networks to atomistic systems. In particular, it focuses on Hierarchical Interacting Particle Neural Networks (HIP-NNs), a deep learning architecture for atomistic systems. HIP-NNs take input data describing the properties of atomistic systems (often generated using ab-initio quantum mechanics) to learn fast and accurate models. A trained HIP-NN can predict potential energy surfaces, atomic charges, and more. hippynn uses PyTorch for portable high-performance code, including both CPU and GPU support. hippynn allows for extensive customization, including user-defined models and loss functions, to facilitate future research into extensions of HIP-NN as well as other atomistic deep learning models.

Lubbers, Nicolas↗

Projecting Trouble: Light Based Adversarial Attacks on Deep Learning Classifiers

This work demonstrates a physical attack on a deep learning image classification system using projected light onto a physical scene. Prior work is dominated by techniques for creating adversarial examples which directly manipulate the digital input of the classifier. Such an attack is limited to scenarios where the adversary can directly update the inputs to the classifier such as Clarifai or Cloud Vision. Such limitations have led to a vein of research around physical attacks where objects are constructed to be inherently adversarial or adversarial modifications are added to cause misclassification. Our work differs from other physical attacks in that we can cause misclassification dynamically without altering physical objects in a permanent way. We construct a test setup which includes a light projection source, an object for classification, and a camera to capture the scene. Experiments are conducted against 2D and 3D objects. For the 2D demonstration, a CIFAR-10 image is printed and attacked with light. In this 2D presentation, the classifier confidence of the target class drops from 98% probability to 22%. The 3D presentation places a toy car in the camera frame, attacks the car with projected light, and recaptures the scene for verification of attack success. The classifier confidence the image is a car drops from 89% probability to 43%

adversarial machine learning, deep learning, adver↗

A machine learning-based fast frequency response control for a VSC-HVDC system

An HVDC system can realize a very fast frequency response to the disturbed system under a contingency because its active power control is decoupled from the frequency deviation. However, most of existing HVDC frequency control strategies are coupled with system primary frequency control and secondary frequency control. Since the traditional system frequency control is dominated by the thermal generators, the advantage of the fast response of the HVDC system is not made fully used. The development of a frequency response estimation based on a machine learning algorithm provides another approach to improve the frequency response capability of the HVDC system. Different from other frequency deviation tracking strategies, a machine learning based HVDC frequency response control can directly increase the power flow of a HVDC system by estimation of the system generator or load lost. In this paper, a fast frequency response control using a HVDC system for a large power system disturbance based on the multivariate random forest regression (MRFR) algorithm is proposed. The simulation is carried out with an integrated power system model based on the North American interconnections. The simulation results indicate that the proposed MRFR based frequency response control can significantly improve the frequency low point during an event, while stabilizing the frequency in advance.

42 ENGINEERING↗

Bayesian learning with Gaussian processes for low-dimensional representations of time-dependent nonlinear systems

This work presents a data-driven method for learning low-dimensional time-dependent physics-based surrogate models whose predictions are endowed with uncertainty estimates. We use the operator inference approach to model reduction that poses the problem of learning low-dimensional model terms as a regression of state space data and corresponding time derivatives by minimizing the residual of reduced system equations. Standard operator inference models perform well with accurate training data that are dense in time, but producing stable and accurate models when the state data are noisy and/or sparse in time remains a challenge. Another challenge is the lack of uncertainty estimation for the predictions from the operator inference models. Our approach addresses these challenges by incorporating Gaussian process surrogates into the operator inference framework to (1) probabilistically describe uncertainties in the state predictions and (2) procure analytical time derivative estimates with quantified uncertainties. The formulation leads to a generalized least-squares regression and, ultimately, reduced-order models that are described probabilistically with a closed-form expression for the posterior distribution of the operators. The resulting probabilistic surrogate model propagates uncertainties from the observed state data to reduced-order predictions. Furthermore, we demonstrate the method is effective for constructing low-dimensional models of two nonlinear partial differential equations representing a compressible flow and a nonlinear diffusion–reaction process, as well as for estimating the parameters of a low-dimensional system of nonlinear ordinary differential equations representing compartmental models in epidemiology.

Data-driven model reduction↗

SMC 2021 Data Challenge: Analyzing Resource Utilization and User Behavior on Titan Supercomputer

Resource utilization statistics of submitted jobs on a supercomputer can help us understand how users from various scientific domains use HPC platforms and better design a job scheduler. We explore to generate insight regarding workload distribution and usage pattern domains from job scheduler trace, GPU failure information, and project-specific information collected from Titan supercomputer. Furthermore, we want to know how the scheduler performance varies over time and how the users' scheduling behavior changes following a system failure. These observations have the potential to provide valuable insight, which is helpful to prepare for system failures. These practices will help us develop and apply novel machine learning algorithms in understanding system behavior, requirement, and better scheduling of HPC systems. There are two datasets, RUR and GPU: RUR dataset is the job scheduler traces collected from the Titan supercomputer from 01/01/2015 to 07/31/2019 (2015.csv - 2019.csv). These were collected using resource Utilization Report (RUR), a Cray-developed resource-usage data collection and reporting system. It contains the usage information of its critical resources (CPU, Memory, GPU, and I/O) of each running job on Titan during that period (https://ieeexplore.ieee.org/abstract/document/8891001). It includes ProjectAreas as additional information, every job is associated with a project ID. TheProjectAreas.csv dataset provides a mapping of the project ID to its domain science. GPU dataset has information regarding GPU failure on Titan. There have been some hardware-related issues in the GPUs in Titan that caused some GPUs to fail, sometimes irrecoverably during some job runs. This dataset provides information regarding these failures during the execution of the submitted jobs. GPUs on Titan are uniquely identified by a serial number (SN), and they are installed in a location. A GPU can be installed in a location, then removed from that location following a failure, and then re-installed in a different location after fixing the problem. If the failure can't be recovered, the GPU might be removed entirely from Titan. There are two prominent types of failures that resulted in the removal of GPUs from Titan: Double Bit Error (DBE) and Out of the Bus (OTB). The dataset (gc_full.csv) has seven attributes, we provided a short description of these attributes in the ReadMe file. To learn more about this dataset, please refer to the git repository https://github.com/olcf/TitanGPULife and the related publication (https://ieeexplore.ieee.org/abstract/document/9355319).

42 ENGINEERING↗

Comparative study of machine learning techniques for post-combustion carbon capture systems

Computational analysis of countercurrent flows in packed absorption columns, often used in solvent-based post-combustion carbon capture systems (CCSs), is challenging. Typically, computational fluid dynamics (CFD) approaches are used to simulate the interactions between a solvent, gas, and column's packing geometry while accounting for the thermodynamics, kinetics, heat, and mass transfer effects of the absorption process. These simulations can then be used explain a column's hydrodynamic characteristics and evaluate its CO 2 -capture efficiency. However, these approaches are computationally expensive, making it difficult to evaluate numerous designs and operating conditions to improve efficiency at industrial scales. In this work, we comprehensively explore the application of statistical ML methods, convolutional neural networks (CNNs), and graph neural networks (GNNs) to aid and accelerate the scale-up and design optimization of solvent-based post-combustion CCSs. We apply these methods to CFD datasets of countercurrent flows in absorption columns with structured packings characterized by several geometric parameters. We train models to use these parameters, inlet velocity conditions, and other model-specific representations of the column to estimate key determinants of CO 2 -capture efficiency without having to simulate additional CFD datasets. We also evaluate the impact of different input types on the accuracy and generalizability of each model. We discuss the strengths and limitations of each approach to further elucidate the role of CNNs, GNNs, and other machine learning approaches for CO 2 -capture property prediction and design optimization.

97 MATHEMATICS AND COMPUTING↗

Enhancing Network Visibility and Security through Tensor Analysis

The increasing size, variety, rate of growth and change, and complexity of network data has warranted advanced network analysis and services. Tools that provide automated analysis through traditional or advanced signature-based systems or machine learning classifiers suffer from practical difficulties. These tools fail to provide comprehensive and contextual insights into the network when put to practical use in operational cyber security. In this paper, we present an effective tool for network security and traffic analysis that uses high-performance data analytics based on a class of unsupervised learning algorithms called tensor decompositions. The tool aims to provide a scalable analysis of the network traffic data and also reduce the cognitive load of network analysts and be network-expert-friendly by presenting clear and actionable insights into the network. With this being said, In this paper, we demonstrate the successful use of the tool in two completely diverse operational cyber security environments, namely, (1) security operations center (SOC) for the SCinet network at the SuperComputing (SC) Conference in 2016 and 2017 and (2) Reservoir Labs’ Local Area Network (LAN). In each of these environments, we produce actionable results for cyber security specialists including (but not limited to) (1) finding malicious network traffic involving internal and external attackers using port scans, SSH brute forcing, and NTP amplification attacks, (2) uncovering obfuscated network threats such as data exfiltration using DNS port and using ICMP traffic, and (3) finding network misconfiguration and performance degradation patterns.

97 MATHEMATICS AND COMPUTING↗

nmRanalysis: An Open-Source Web Application for Semi-automated NMR Metabolite Profiling

Though data acquisition and initial signal pre-processing of nuclear magnetic resonance (NMR) spectra have achieved high degrees of automation, downstream processing - specifically the profiling of spectra - has bottlenecked the overall NMR analysis workflow. Several efforts have been made to mitigate this bottleneck, but these solutions often trade an increase in automation for limitations elsewhere. Here, in this technical note, we introduce nmRanalysis, a user-friendly web-application that integrates the strengths of existing profiling tools for a more automated profiling workflow. nmRa-nalysis additionally incorporates novel features, including a machine-learning-driven recommender system for me-tabolite identification, further increasing the utility of nmRanalysis over the individual tools that it incorporates.

Flores, Javier E. [Pacific Northwest National Labo↗

Machine Learning for Optimized Polarization at Jefferson Lab

Polarized cryo-targets and polarized photon beams are widely used in experiments at Jefferson Lab. Traditional methods for maintaining the optimal polarization involve manual adjustments throughout data taking by human shift takers. This may introduce some level of inconsistency simply due to the wide variety of experience and expertise of the shift takers themselves. Implementing machine learning-based control systems can improve the stability of the polarization without relying on human intervention. The cryo-target polarization is influenced by temperature, microwave energy, the distribution of paramagnetic radicals, as well as operational conditions including the radiation dose. Diamond radiators are used to generate linearly polarized photons from a primary electron beam. The energy spectrum of these photons can drift over time due to changes in the primary electron beam conditions and diamond degradation. As a first step towards automating the continuous optimization and control processes, uncertainty aware surrogate models have been developed to predict the polarization based on historical data. This talk will provide an overview of the use cases and models developed, highlighting the collaboration between data scientists and physicists at Jefferson Lab.

Jeske, Torri [Thomas Jefferson National Accelerato↗