Search NASA⌕ Search

SEARCH · Search NASA

Results for “NEURAL NETWORKS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,621 records · Page 90

Analytic continuation of noisy data using Adams Bashforth residual neural network

We propose a data-driven learning framework for the analytic continuation problem in numerical quantum many-body physics. Designing an accurate and efficient framework for the analytic continuation of imaginary time using computational data is a grand challenge that has hindered meaningful links with experimental data. The standard Maximum Entropy (MaxEnt)-based method is limited by the quality of the computational data and the availability of prior information. Also, the MaxEnt is not able to solve the inversion problem under high level of noise in the data. Here we introduce a novel learning model for the analytic continuation problem using a Adams-Bashforth residual neural network (AB-ResNet). Additionally, the advantage of this deep learning network is that it is model independent and, therefore, does not require prior information concerning the quantity of interest given by the spectral function. More importantly, the ResNet-based model achieves higher accuracy than MaxEnt for data with higher level of noise. Finally, numerical examples show that the developed AB-ResNet is able to recover the spectral function with accuracy comparable to MaxEnt where the noise level is relatively small.

97 MATHEMATICS AND COMPUTING↗

Synthesis of CdZnTeSe single crystals for room temperature radiation detector fabrication: mitigation of hole trapping effects using a convolutional neural network

In this article, we report the growth of Cd 0.9 Zn 0.1 Te 0.97 Se 0.03 (CZTS) wide bandgap semiconductor single crystals for room temperature gamma-ray detection using a modified vertical Bridgman method. Charge transport properties measured in the radiation detectors, fabricated from the grown CZTS crystals, indicated signs of hole trapping. Hole traps inhibit high-resolution radiation detection especially for energetic gamma rays. Machine learning (ML) applications are gaining tremendous mpetus in improving device and sensor performance by compensating for limi tations arising from such intrinsic material properties. In this article, we describe a deep convolutional neural network (CNN) that has demonstrated remarkable efficiency in identifying the energy of a gamma photon detected by a CZTS detector. The CNN has been trained using simulated data that resemble output pulses from actual CZTS detectors when exposed to 662-keV gamma photons. The device properties required for the simulation have been derived from radiation detection measurements on a real Cd 0.9 Zn 0.1 Te 0.97 Se 0.03 detector fabricated in our laboratory. The CNN has been trained with detector pulses arising through photoelectric (PE) and Compton scattering (CS) separately. The percentage error in predicting the detected energies, within an extremely small duration of 0.28 ms, was found to be lower than 0.1% for gamma energies above 50 keV and for training datasets con taining PE and CS events separately. The CNN was also validated for a mixed PE and CS dataset to obtain a prediction error of 1%. Additionally, the effect of detector resolution on the efficiency of the CNN was also explored.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A 24-h forecast of solar irradiance using artificial neural network: Application for performance prediction of a grid-connected PV plant at Trieste, Italy

Forecasting of solar irradiance is in general significant for planning the operations of power plants which convert renewable energies into electricity. In particular, the possibility to predict the solar irradiance (up to 24 h or even more) can became - with reference to the Grid Connected Photovoltaic Plants (GCPV) - fundamental in making power dispatching plans and - with reference to stand alone and hybrid systems - also a useful reference for improving the control algorithms of charge controllers. In this paper, a practical method for solar irradiance forecast using artificial neural network (ANN) is presented. The proposed Multilayer Perceptron MLP-model makes it possible to forecast the solar irradiance on a base of 24 h using the present values of the mean daily solar irradiance and air temperature. An experimental database of solar irradiance and air temperature data (from July 1st 2008 to May 23rd 2009 and from November 23rd 2009 to January 24th 2010) has been used. The database has been collected in Trieste (latitude 45 40'N, longitude 13 46'E), Italy. In order to check the generalization capability of the MLP-forecaster, a K-fold cross-validation was carried out. The results indicate that the proposed model performs well, while the correlation coefficient is in the range 98-99% for sunny days and 94-96% for cloudy days. As an application, the comparison between the forecasted one and the energy produced by the GCPV plant installed on the rooftop of the municipality of Trieste shows the goodness of the proposed model. (author)

14 SOLAR ENERGY↗

Usage-based Lifing of Lithium-Ion Battery with HybridPhysics-Informed Neural Networks

Lithium-ion batteries are commonly used to power unmanned aircraft vehicles (UAVs).The ability to model and forecast the remaining useful life of these batteries enables UAV reliability assurance. Building accurate models for battery state of charge and state of health based on first principles is challenging due to the complex electrochemistry that governs battery operations and computational complexity required to solve them. Therefore, reduced order models are often used due to their ability to capture the overall battery discharge. Un-fortunately, these simplifications lead to residual discrepancy between model predictions and observed data. In this paper, we present a hybrid modeling approach merging reduced-order models and neural networks. In this approach, while most of the input-output relationship is captured by Nernst and Butler-Volmer equations, data-driven kernels reduce the gap between predictions and observations. We validate our approach using data publicly available through the NASA Prognostics Center of Excellence repository. Results showed that our hybrid battery prognosis model can be successfully calibrated, even with a limited number of observations.

Lithium-ion Battery↗

Neural network for 3D inertial confinement fusion shell reconstruction from single radiographs

In inertial confinement fusion (ICF), x-ray radiography is a critical diagnostic for measuring implosion dynamics, which contain rich three-dimensional (3D) information. Traditional methods for reconstructing 3D volumes from 2D radiographs, such as filtered backprojection, require radiographs from at least two different angles or lines of sight (LOS). In ICF experiments, the space for diagnostics is limited, and cameras that can operate on fast timescales are expensive to implement, limiting the number of projections that can be acquired. To improve the imaging quality as a result of this limitation, convolutional neural networks (CNNs) have recently been shown to be capable of producing 3D models from visible light images or medical x-ray images rendered by volumetric computed tomography. Here, we propose a CNN to reconstruct 3D ICF spherical shells from single radiographs. We also examine the sensitivity of the 3D reconstruction to different illumination models using preprocessing techniques such as pseudo-flatfielding. To resolve the issue of the lack of 3D supervision, we show that training the CNN utilizing synthetic radiographs produced by known simulation methods allows for reconstruction of experimental data as long as the experimental data are similar to the synthetic data. We also show that the CNN allows for 3D reconstruction of shells that possess low mode asymmetries. Further comparisons of the 3D reconstructions with direct multiple LOS measurements are justified.

3D Reconstruction↗

Identifications and classifications of human locomotion using Rayleigh-enhanced distributed fiber acoustic sensors with deep neural networks

Abstract This paper reports on the use of machine learning to delineate data harnessed by fiber-optic distributed acoustic sensors (DAS) using fiber with enhanced Rayleigh backscattering to recognize vibration events induced by human locomotion. The DAS used in this work is based on homodyne phase-sensitive optical time-domain reflectometry (φ-OTDR). The signal-to-noise ratio (SNR) of the DAS was enhanced using femtosecond laser-induced artificial Rayleigh scattering centers in single-mode fiber cores. Both supervised and unsupervised machine-learning algorithms were explored to identify people and specific events that produce acoustic signals. Using convolutional deep neural networks, the supervised machine learning scheme achieved over 76.25% accuracy in recognizing human identities. Conversely, the unsupervised machine learning scheme achieved over 77.65% accuracy in recognizing events and human identities through acoustic signals. Through integrated efforts on both sensor device innovation and machine learning data analytics, this paper shows that the DAS technique can be an effective security technology to detect and to identify highly similar acoustic events with high spatial resolution and high accuracies.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Identifying Heterogeneous Micromechanical Properties of Biological Tissues via Physics–Informed Neural Networks

The heterogeneous micromechanical properties of biological tissues have profound implications across diverse medical and engineering domains. However, identifying full-field heterogeneous elastic properties of soft materials using traditional engineering approaches is fundamentally challenging due to difficulties in estimating local stress fields. Recently, there has been a growing interest in data-driven models for learning full-field mechanical responses, such as displacement and strain, from experimental or synthetic data. However, research studies on inferring full-field elastic properties of materials, a more challenging problem, are scarce, particularly for large deformation, hyperelastic materials. Here, a physics-informed machine learning approach is proposed to identify the elasticity map in nonlinear, large deformation hyperelastic materials. This study reports the prediction accuracies and computational efficiency of physics-informed neural networks (PINNs) in inferring the heterogeneous elasticity maps across materials with structural complexity that closely resemble real tissue microstructure, such as brain, tricuspid valve, and breast cancer tissues. Further, the improved architecture is applied to three hyperelastic constitutive models: Neo-Hookean, Mooney Rivlin, and Gent. Furthermore, the improved network architecture consistently produces accurate estimations of heterogeneous elasticity maps, even when there is up to 10% noise present in the training data.

59 BASIC BIOLOGICAL SCIENCES↗

Expediting DECam Multimessenger Counterpart Searches with Convolutional Neural Networks

Searches for counterparts to multimessenger events with optical imagers use difference imaging to detect new transient sources. However, even with existing artifact-detection algorithms, this process simultaneously returns several classes of false positives: false detections from poor-quality image subtractions, false detections from low signal-to-noise images, and detections of preexisting variable sources. Currently, human visual inspection to remove the false positives is a central part of multimessenger follow-up observations, but when next generation gravitational wave and neutrino detectors come online and increase the rate of multimessenger events, the visual inspection process will be prohibitively expensive. We approach this problem with two convolutional neural networks operating on the difference imaging outputs. The first network focuses on removing false detections and demonstrates an accuracy of 92% on our data set. The second network focuses on sorting all real detections by the probability of being a transient source within a host galaxy and distinguishes between various classes of images that previously required additional human inspection. We find the number of images requiring human inspection will decrease by a factor of 1.5 using our approach alone and a factor of 3.6 using our approach in combination with existing algorithms, facilitating rapid multimessenger counterpart identification by the astronomical community.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Augmented signal processing in Liquid Argon Time Projection Chambers with a deep neural network

The Liquid Argon Time Projection Chamber (LArTPC) is an advanced neutrino detector technology widely used in recent and upcoming accelerator neutrino experiments. It features a low energy threshold and high spatial resolution that allow for comprehensive reconstruction of event topologies. In current-generation LArTPCs, the recorded data consist of digitized waveforms on wires produced by induced signal on wires of drifting ionization electrons, which can also be viewed as two-dimensional (2D) (time versus wire) projection images of charged-particle trajectories. For such an imaging detector, one critical step is the signal processing that reconstructs the original charge projections from the recorded 2D images. For the first time, we introduce a deep neural network in LArTPC signal processing to improve the signal region of interest detection. By combining domain knowledge (e.g., matching information from multiple wire planes) and deep learning, this method shows significant improvements over traditional methods. This work details the method, software tools, and performance evaluated with realistic detector simulations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Predicting Unreinforced Fabric Mechanical Behavior with Recurrent Neural Networks

Unreinforced woven fabrics are widely employed in various high-performance applications, including parachute deployment systems, airbags, and ballistic armor. The analysis of such materials is inherently complex due to the multiscale structure of these materials, and the dependence of macroscale behavior on changes that occur at lower scales. Previously, NASA’s Multiscale Analysis Tool (NASMAT) showed its capability in predicting unreinforced fabric behavior at the macroscale by capturing finite rotations that occur at the mesoscale. Though effective, the tool can face high computational cost for large, complex problems, motivating the need for the development of a surrogate model that can capture the same behavior. A recurrent neural network (RNN) was developed and trained on virtual NASMAT data to mimic the physics-based solutions while improving the computational runtime. The architecture of the RNN to best simulate the fabric behavior was carefully crafted based on heuristic knowledge of predicting physics-based temporal data, manual hyperparameter case studies, and Hyperband optimization.. The resultant model was able to predict a variety of stress-strain curves for fabrics with different mesoscale geometries, and was further validated by comparing to experimental data for the K706 style Kevlar plain-weave fabric, demonstrating the ability of the model to effectively capture the geometric changes in the fabric without explicitly calculating them, as is done in NASMAT. Furthermore, the tool showed its ability to improve on the runtime by a factor of 10 for fabric solutions compared to the multiscale tool, which would further enable the simulation of complex loading scenarios on unreinforced fabrics.

Fabric↗

Improving near real-time precipitation estimation using a U-Net convolutional neural network and geographical information

Reliable near real-time precipitation estimates are essential for monitoring and managing of natural disasters such as floods. Quality of inputs and capability of the retrieval algorithm are two important aspects for developing satellite-based precipitation datasets. Most retrieval algorithms utilize infrared (IR) information as their input due to its fine spatiotemporal resolution and near-instantaneous availability. However, their sole reliance on IR information limits their capability to learn different mechanisms of precipitation during training, resulting in less accurate estimates. Moreover, recent advances in the field of machine learning offer attractive opportunities to improve the precipitation retrieval algorithms. This work investigates the effectiveness of adding geographical information (i.e. latitude and longitude) to IR information and the application of a U-Net-based convolutional neural network for improving the accuracy of retrieval algorithms. This research suggests that applying an appropriate CNN architecture on geographical and IR information provides an opportunity to improve the satellite-based precipitation products.

42 ENGINEERING↗

Use of Convolutional Neural Network Image Classification and High-Speed Ion Probe Data Toward Real-Time Detonation Characterization in a Water-Cooled Rotating Detonation Engine

As rotating detonation engines (RDEs) progress in maturity, the importance of monitoring advancements toward development of active control becomes more critical. Experimental RDE data processing at time scales which satisfy real-time diagnostics will likely require the use of machine learning. This study aims to develop and deploy a novel real-time monitoring technique capable of determining detonation wave number, direction, frequency, and individual wave speeds throughout experimental RDE operational windows. To do so, the diagnostic integrates image classification by a convolutional neural network (CNN) and ionization current signal analysis. Wave mode identification through single-image CNN classification bypasses the need to evaluate sequential images and offers instantaneous identification of the wave mode present in the RDE annulus. Here, real-time processing speeds are achieved due to low data volumes required by the methodology, namely one short-exposure image and a short window of sensor data to generate each diagnostic output. The diagnostic acquires live data using a modified experimental setup alongside Pylon and PyDAQmx libraries within a python data acquisition environment. Lab-deployed diagnostic results are presented across varying wave modes, operating conditions, and data quality, currently executed at 3–4 Hz with a variety of iteration speed optimization options to be considered as future work. These speeds exceed that of conventional techniques and offer a proven structure for real-time RDE monitoring. The demonstrated ability to analyze detonation wave presence and behavior during RDE operation will certainly play a vital role in the development of RDE active control, necessary for RDE technology maturation toward industrial integration.

42 ENGINEERING↗

Explicit physics-informed neural networks for nonlinear closure: The case of transport in tissues

In upscaling methods, closures for nonlinear problems present a well-known challenge. While a number of theoretical methods have been proposed for handling such closures, nonlinearities still remain a significant obstacle for many problems. In this work, we use a combination of formal upscaling and data-driven machine learning for explicitly closing a nonlinear transport and reaction process in multiscale tissues. The classical effectiveness factor model is used to formulate the macroscale reaction kinetics. We train a multilayer perceptron network using training data generated by direct numerical simulations over microscale examples. Once trained, the network is used in an algorithm for numerically solving the upscaled (coarse-grained) differential equation describing mass transport and reaction in two example tissues. The network is described as being explicit in the sense that the network is trained using macroscale concentrations and gradients of concentration as components of the feature space rather than incorporating them as part of a constraint in the optimization process. Network training and solutions to the macroscale transport equations were computed for two different tissues. The two tissue types (brain and liver) exhibit markedly different geometrical complexity and spatial scale (cell size and sample size). The upscaled solutions for the average concentration are compared with numerical solutions derived from the microscale concentration fields by a posteriori averaging. There are three outcomes of this work of particular note. 1) Our overall approach results in an upscaled nonlinear PDE. The PDE is closed using a neural network, and our approach results in the definition of the classical effectiveness factor for effecting closure. 2) We identify particular source terms for the closure problem that are important for representing the structure of the closure. These source terms involve macroscale concentrations and their gradients. We adopt these source terms to use as explicit features in the learning algorithm. We find the trained networks that include the macroscale source terms generate models that are able to predict the correction factor with increased fidelity over those that do not. 3) We find that the trained network exhibits good generalizability, and it is able to predict the effectiveness factor with high fidelity for realistically-structured tissues despite the significantly different scale and geometrical complexity of the two example tissue types. This latter result emphasizes our purposeful connection between conventional averaging methods with the use of machine learning for closure; this contrasts with some machine learning methods for upscaling where the exact form of the macroscale equation remains unknown.

97 MATHEMATICS AND COMPUTING↗

Recurrent Neural Network Attention Mechanisms for Interpretable System Log Anomaly Detection

Deep learning has recently demonstrated state-of-the art performance on key tasks related to the maintenance of computer systems, such as intrusion detection, denial of service attack detection, hardware and software system failures, and malware detection. In these contexts, model interpretability is vital for administrator and analyst to trust and act on the automated analysis of machine learning models. Deep learning methods have been criticized as black box oracles which allow limited insight into decision factors. In this work we seek to "bridge the gap'' between the impressive performance of deep learning models and the need for interpretable model introspection. To this end we present recurrent neural network (RNN) language models augmented with attention for anomaly detection in system logs. Our methods are generally applicable to any computer system and logging source. By incorporating attention variants into our RNN language models we create opportunities for model introspection and analysis without sacrificing state-of-the art performance. We demonstrate model performance and illustrate model interpretability on an intrusion detection task using the Los Alamos National Laboratory (LANL) cyber security dataset, reporting upward of 0.99 area under the receiver operator characteristic curve despite being trained only on a single day's worth of data.

Anomaly detection, Attention, Recurrent Neural Net↗

Cross-reactive immunogenicity of group A streptococcal vaccines designed using a recurrent neural network to identify conserved M protein linear epitopes

The M protein of group A streptococci (Strep A) is a major virulence determinant and protective antigen. The N-terminal sequence of the protein defines the more than 200 M types of Strep A and also contains epitopes that elicit opsonic antibodies, some of which cross-react with heterologous M types. Current efforts to develop broadly protective M protein-based vaccines are directed at identifying potential cross-protective epitopes located in the N-terminal regions of cluster-related M proteins for use as vaccine antigens. In this study, we have used a comprehensive approach using the recurrent neural network ABCpred and IEDB epitope conservancy analysis tools to predict 16 residue linear B-cell epitopes from 117 clinically relevant M types of Strep A (~88% of global Strep A infections). Furthermore, to examine the immunogenicity of these epitope-based vaccines, nine peptides that together shared ≥60% sequence identity with 37 heterologous M proteins were incorporated into two recombinant hybrid protein vaccines, in which the epitopes were repeated 2 or 3 times, respectively. The combined immune responses of immunized rabbits showed that the vaccines elicited significant levels of antibodies against all nine vaccine epitopes present in homologous N-terminal 1–50 amino acid synthetic M peptides, as well as cross-reactive antibodies against 16 of 37 heterologous M peptides predicted to contain similar epitopes. The epitope-specificity of the cross-reactive antibodies was confirmed by ELISA inhibition assays and functional opsonic activity was assayed in HL-60-based bactericidal assays. The results provide important information for the future design of broadly protective M protein-based Strep A vaccines.

60 APPLIED LIFE SCIENCES↗

A Comparative Study on Artificial Neural Network, Phenomenological-Based Constitutive and Modified Fields–Backofen Models to Predict Flow Stress in Ti-4Al-3V-2Mo-2Fe Alloy

The flow curve was obtained from the superplastic tensile tests in the temperature range of 1033-1153 K and strain rate range of 0.001-0.1 s{sup −1}. Results showed that strain hardening (SH) was insensitive to deformation parameter variation but with the nature of material, while stable state (SS) and dynamic softening (DS) were significantly associated with a thermal activated process. The occurrence of secondary hardening and softening was attributed to discontinuous dynamic recrystallization. And the generation of necklace microstructure at grain boundaries was caused by bulging. Based on the experimental data, the artificial neural network (ANN), phenomenological-based constitutive (PBC) and modified Fields–Backofen (MFB) models were developed, and their predictability and adaptability for the description of the flow behavior during hot processing were evaluated by analyzing the employed standard statistical parameters. Comparatively, ANN model is capable of tracing the complex flow behavior including SH, SS and DS substages. Concerning PBC model, it can not only predict flow stress with satisfactory accuracy, but also represent the flow trend with the larger strain. MFB model adapts well to the flow curve with a broad SH region without DS effect.

36 MATERIALS SCIENCE↗

Adjustment of Non-linear Interaction Parameters for Relativistic Mean Field Approach by Using Artificial Neural Networks

The relativistic mean field (RMF) model with a small number of adjusted parameters has been used successfully in the last thirty years for predictions of various ground-state nuclear properties of nuclei. In this model, Dirac and Klein–Gordon like equations obtained from application of variation principle on phenomenological Lagrangian density are solved iteratively for calculations of nuclear properties of nuclei. For this purpose, parameters such as masses of considered mesons, nucleon–meson coupling constants, and self-couplings of mesons are needed and they are fitted from experimental data. Some parameter sets for RMF model introduced to correct predictions of nuclear properties of nuclei cover nuclidic chart. Besides Artificial Neural Network (ANN) method is used successfully in many field of science as in nuclear physics. ANN is known as a very powerful tool that are used when standard techniques fail to estimate the correlation between the variables. In the present study, ANN method has been employed to check its understanding capability of relations between RMF model parameters and their predictions on the ground-state binding energies of some spherical nuclei. Understanding capability of ANN method for these relations of considered nuclei has been found well. Based on this success, new non-linear parameter set for RMF model called DEFNE by us have been produced by using ANN method. Furthermore, predictions of RMF model with DEFNE parameter set for ground-state binding energies and charge radii of nuclei cover nuclidic chart have been found as in agreement with the available experimental data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

CoolPINNs: A physics-informed neural network modeling of active cooling in vascular systems

Emerging technologies like hypersonic aircraft, space exploration vehicles, and batteries avail fluid circulation in embedded microvasculatures for efficient thermal regulation. Modeling is vital during the design and operational phases of these engineered systems. However, many challenges exist in developing a modeling framework. What is lacking is an accurate framework that (i) captures sharp jumps in the thermal flux across complex vasculature layouts, (ii) deals with oblique derivatives (involving tangential and normal components), (iii) handles nonlinearity because of radiative heat transfer, (iv) provides a high-speed forecast for real-time monitoring, and (v) facilitates robust inverse modeling. Here, this paper addresses these challenges by availing the power of physics-informed neural networks (PINNs). We develop a fast, reliable, and accurate Scientific Machine Learning (SciML) framework for vascular-based thermal regulation—called CoolPINNs: a PINNs-based modeling framework for active cooling. The proposed mesh-less framework elegantly overcomes all the mentioned challenges. The significance of the reported research is multi-fold. First, the framework is valuable for real-time monitoring of thermal regulatory systems because of rapid forecasting. Second, researchers can address complex thermoregulation designs since the approach is meshless. Finally, the framework facilitates systematic parameter identification and inverse modeling studies, perhaps the most significant utility of the current framework.

97 MATHEMATICS AND COMPUTING↗