Search NASA⌕ Search

SEARCH · Search NASA

Results for “Network Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Fishing for Clickbaits in Social Images and Texts with Linguistically-Infused Neural Network Models

This paper presents the results and conclusions of our participation in the Clickbait Challenge 2017 on automatic clickbait detection in social media. We first describe linguistically-infused neural network models and identify informative representations to predict the level of clickbaiting present in Twitter posts. Our models allow to answer the question not only whether a post is a clickbait or not, but to what extent it is a clickbait post e.g., not at all, slightly, considerably, or heavily clickbaity using a score ranging from 0 to 1. We evaluate the predictive power of models trained on varied text and image representations extracted from tweets. Our best performing model that relies on the tweet text and linguistic markers of biased language extracted from the tweet and the corresponding page yields mean squared error (MSE) of 0.04, mean absolute error (MAE) of 0.16 and R2 of 0.43 on the held-out test data. For the binary classification setup (clickbait vs. non-clickbait), our model achieved F1 score of 0.69. We have not found that image representations combined with text yield significant performance improvement yet. Nevertheless, this work is the first to present preliminary analysis of objects extracted using Google Tensorflow object detection API from images in clickbait vs. non-clickbait Twitter posts. Finally, we outline several steps to improve model performance as a part of the future work.

dlickbait challenge, Twitter, neural networks, mac↗

The Lifecycle of Bayesian Network Models Developed for Multi-Source Signature Assessment of Nuclear Programs

The Multi-Source Signatures for Nuclear Programs project, part of Pacific Northwest National Laboratory’s (PNNL) Signature Discovery Initiative, seeks to computationally capture expert assessment of multi-type information such as text, sensor output, imagery, or audio/video files, to assess nuclear activities through a series of Bayesian network (BN) models. These models incorporate knowledge from a diverse range of information sources in order to help assess a country’s nuclear activities. The models span engineering topic areas, state-level indicators, and facility-specific characteristics. To illustrate the development, calibration, and use of BN models for multi-source assessment, we present a model that predicts a country’s likelihood to participate in the international nuclear nonproliferation regime. We validate this model by examining the extent to which the model assists non-experts arrive at conclusions similar to those provided by nuclear proliferation experts. We also describe the PNNL-developed software used throughout the lifecycle of the Bayesian network model development.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Temperature dependence of nuclear quantum effects on liquid water via artificial neural network model based on SCAN meta-GGA functional

We investigate the temperature dependence of nuclear quantum effects (NQEs) on structural and dynamic properties of liquid water by training a neural network force field using first-principles molecular dynamics (FPMD) based on the strongly constrained and appropriately normed meta-generalized gradient approximation exchange-correlation approximation. The FPMD simulation based on density functional theory has become a powerful computational approach for studying a wide range of condensed phase systems. However, its large computational cost makes it difficult to incorporate NQEs in the simulation and investigate temperature dependence of various properties. To circumvent this difficulty, we use an artificial neural network model and employ the thermostatted ring polymer MD approach for studying the temperature dependence of NQEs on various properties. The NQEs generally bring the radial distribution functions closer to the experimental measurements. Translational diffusivity and rotational dynamics of water molecules are both slowed down by the NQEs. The competing inter-molecular and intra-molecular quantum effects on hydrogen bonds, as discussed by Habershon, Markland, and Manolopoulos [J. Chem. Phys. 131(2), 024501 (2019)], can explain the observed temperature dependence of the NQEs on the dynamical properties in our simulation.

Yao, Yi (ORCID:0000000299576979)↗

A Projected Network Model of Online Disinformation Cascades

Within the past half-decade, it has become overwhelmingly clear that suppressing the spread of deliberate false and misleading information is of the utmost importance for protecting democratic institutions. Disinformation has been found to come from both foreign and domestic actors, but the effects from either can be disastrous. From the simple encouragement of unwarranted distrust to conspiracy theories promoting violence, the results of disinformation have put the functionality of American democracy under direct threat. Present scientific challenges posed by this problem include detecting disinformation, quantifying its potential impact, and preventing its amplification. We present a model on which we can experiment with possible strategies toward the third challenge: the prevention of amplification. This is a social contagion network model, which is decomposed into layers to represent physical, ''offline'', interactions as well as virtual interactions on a social media platform. Along with the topological modifications to the standard contagion model, we use state-transition rules designed specifically for disinformation, and distinguish between contagious and non-contagious infected nodes. We use this framework to explore the effect of grassroots social movements on the size of disinformation cascades by simulating these cascades in scenarios where a proportion of the agents remove themselves from the social platform. We also test the efficacy of strategies that could be implemented at the administrative level by the online platform to minimize such spread. These top-down strategies include banning agents who disseminate false information, or providing corrective information to individuals exposed to false information to decrease their probability of believing it. We find an abrupt transition to smaller cascades when a critical number of random agents are removed from the platform, as well as steady decreases in the size of cascades with increasingly more convincing corrective information. Finally, we compare simulated cascades on this framework with real cascades of disinformation recorded on Whatsapp surrounding the 2019 Indian election. We find a set of hyperparameter values that produces a distribution of cascades matching the scaling exponent of the distribution of actual cascades recorded in the dataset. We acknowledge the available future directions for improving the performance of the framework and validation methods, as well as ways to extend the model to capture additional features of social contagion.

42 ENGINEERING↗

An Artificial Neural Network Model to Predict the Bainite Plate Thickness of Nanostructured Bainitic Steels Using an Efficient Network-Learning Algorithm

Nanostructured bainitic steel has an extraordinary ultrahigh strength of about 2.0 GPa along with good toughness of 30 MPa m{sup 1/2}. The finer thickness of plate 20-80 nm is largely responsible for achieving such a large hardness of 690-720 HV. In this work, a multilayer perceptron-based artificial neural network (ANN) model has been developed to predict the thickness of bainite plate pertaining to nanostructured bainitic steels. The inputs of the ANN model are, namely, Gibbs free energy for bainitic transformation, austenite strength, transformation temperature for bainite and carbon concentration in the steel. The model prediction revealed that the bainite plate thickness critically depends on austenite strength and Gibbs free energy. From the neural prediction, it is concluded that formation of nanostructured bainitic steel is feasible only if sufficient austenite strength (above 165 MPa) has been achieved. This can be accomplished with a minimum carbon content of 0.5 wt.% in steel and transformation temperature below 300 °C. Higher driving force (Gibbs free energy) below − 1800 J/mol is another prerequisite condition of formation of nanostructured bainite steel. The network-learning architecture has been optimized using the Broyden–Fletcher–Goldfarb–Shanno (BFGS) algorithm to minimize the network training error within eight training cycles. The algorithm facilitates a faster convergence of network training and testing errors.

36 MATERIALS SCIENCE↗

A Convolutional Neural Network Model for Battery Capacity Fade Curve Prediction using Early Life Data

Herein, early prediction of battery performance degradation trends can facilitate research of new materials and cell designs, rapid deployment of batteries in real-world applications, timely replacement of batteries in critical applications, and even the secondary use market. In this study, we design a convolutional neural network model to predict the entire battery capacity fade curve - a critical indicator of battery performance degradation - using first 100 cycles of data (~ three weeks of testing). We use the discharge voltage-capacity curves as input to the model and automate the feature extraction process through the convolutional layers of the network. Our approach can predict the per cycle capacity fade rate and rollover cycle (knee point) in the capacity fade curve, which indicate the onset of rapid capacity decay. On the publicly available graphite/LiFePO 4 battery dataset, optimized networks predict the capacity fade curves, rollover cycle, and end of life with 3.7% (worst-case), 19%, and 17% mean absolute percentage errors, respectively.

25 ENERGY STORAGE↗

Prediction of moisture transfer in cement-based materials: Use of a porous network model to access transfer parameters

Knowing the water transport phenomena is fundamental for understanding the durability of cement-based materials. The moisture content within cementitious materials is of primary importance because it has a direct influence on mechanical (shrinkage, creep) and chemical (penetration of aggressive agents) degradation. Many models based on the determination of the transfer properties of the material under study already exist but require fitting of the parameters to find the experimental kinetics. Transfer parameters are generally estimated from the empirical approaches developed for soils by Van Genuchten and the water vapour diffusion reduction factor is often calculated via Millington's semi-empirical model. In this paper, we make a proposal to improve the prediction of moisture transfer, through mechanisms such as drying, capillary imbibition and water vapour permeability in cement-based materials, by using a porous network model to access the transfer parameters.

36 MATERIALS SCIENCE↗

Hybrid Improved Empirical Mode Decomposition and Artificial Neural Network Model for the Prediction of Critical Heat Flux (CHF)

Three Hybrid artificial neural network (ANN) models namely radial basis function (RBF), generalized regression neural networks (GRNN), and multi-layer perceptron (MLP) combined with empirical mode decomposition (EMD) are developed for CHF predictive modelling using CHF experimental databases.First, the original experimental inputs data series are decomposed into several intrinsic mode functions (IMFs) and one residual by EMD, whose components are divided into high, medium and low components. The performance parameters of the hybrid models indicates that the root mean square error (RMSE) are 0.8831, 0.6522, and 0.4149; the mean absolute error (MAE) are 0.6697, 0.4636, and 0.1935. The values of the R-square of the developed prediction approach utilizing EMD-RBF, EMD-GRNN, and EMD-MLP models are 0.8553, 0.9302, and 0.9818, and the index of agreement are 0.9464, 0.9700, and 0.9894., The value of the R-square and the index of agreement of the proposed models are much higher than those of the simple models .The Pearson's test results show that the association strength between the measured and the predicted values of the proposed model EMD-MLP is the strongest. These results show the following: (a) compared with other related, recent studies, the prediction accuracy of the hybrid model EMD- MLP proposed in this research is the best hybrid model; (b) the proposed hybrid model (EMD-MLP) attains superior performance compared with simple models.

Djeddou, Messaoud↗

The predictive skill of convolutional neural networks models for disease forecasting

In this paper we investigate the utility of one-dimensional convolutional neural network (CNN) models in epidemiological forecasting. Deep learning models, in particular variants of recurrent neural networks (RNNs) have been studied for ILI (Influenza-Like Illness) forecasting, and have achieved a higher forecasting skill compared to conventional models such as ARIMA. In this study, we adapt two neural networks that employ one-dimensional temporal convolutional layers as a primary building block—temporal convolutional networks and simple neural attentive meta-learners—for epidemiological forecasting. We then test them with influenza data from the US collected over 2010-2019. We find that epidemiological forecasting with CNNs is feasible, and their forecasting skill is comparable to, and at times, superior to, plain RNNs. Thus CNNs and RNNs bring the power of nonlinear transformations to purely data-driven epidemiological models, a capability that heretofore has been limited to more elaborate mechanistic/compartmental disease models.

59 BASIC BIOLOGICAL SCIENCES↗

Assessing the Value of Seismic Amplitude Versus Offset (AVO) Attributes for CO2 Storage Project Using a Bayesian Network Model for Decision Support

Attributes versus offset (AVO) are a set of measurements to analyze how the characteristics of reflected seismic waves change as a function of the offset. It can be useful for monitoring CO2 storage sites because the presence of leaked CO2 into the overlying aquifer can change the properties of the rocks and pore fluids composition that can alter the way seismic waves reflect and their amplitudes. The time-lapse changes in AVO attributes derived from repeat seismic surveys can help identify anomalies or shifts in the subsurface that could potentially be used as an indicator for CO2 leak detection. Our study leverages multiple seismic attributes derived from synthetic seismic data and Bayesian network model to quantify the probability of leak detection in the overlying aquifer above the storage reservoir. It helps to quantify the value of individual seismic attributes at multiple monitoring periods based upon their sensitivities.

Kumar, Abhash↗

Three-dimensional dendritic needle network model for alloy solidification

Here, we present a three-dimensional (3D) formulation of the multiscale Dendritic Needle Network (DNN) model for dendritic microstructure growth. This approach is aimed at simulating quantitatively the solidification dynamics of complex hierarchical networks in spatially extended dendritic arrays, hence bridging the scale gap between phase-field simulations at the scale of a few dendrites and coarse-grained simulations on the larger scale of entire polycrystalline structures. In the DNN model, the dendritic network is represented by a network of branches that interact through the solutal diffusion field. The tip velocity V(t) and tip radius ρ(t) of each needle is determined by combining a standard solvability condition that fixes the product ρ 2 V and a solute flux conservation condition that fixes the product ρV 2 in 2D and ρV in 3D as a function of a solutal flux intensity factor ℱ(t). The latter measures the intensity of the solute flux in the dendrite tip region and can be calculated by contour (2D) or surface (3D) integration around the tip of each needle. We first present an extended formulation of the 2D DNN model where needles have a finite thickness and parabolic tips. This formulation remains valid for a larger range of tip Péclet number than the original thin needle formulation and is readily extended to 3D needles with paraboloidal tips. The 3D DNN model based on this thick-needle formulation is developed for both isothermal and directional solidification. Model predictions are validated by comparisons with known analytical solutions that describe the early transient and steady-state growth regimes. We exploit the power of the DNN model to characterize the competitive growth of well-developed secondary branches in 3D on the scale of the diffusion length. The results show that the length of active secondary branches increases as a power law of distance behind the tip with an exponent in good quantitative agreement with experimental measurements. Finally, we apply the model to simulate the three-dimensional directional solidification of an Al-7wt% Si alloy, which we directly compare to observed microstructures from microgravity experiments onboard the International Space Station. The predictions of selected microstructural features, such as dendrite arm spacings, show a good agreement with experiments. The computationally-efficient DNN model opens new avenues for investigating the dynamics of large dendritic arrays at length and time scales relevant to solidification experiments and processes.

36 MATERIALS SCIENCE↗

Weak and Strong Connectivity Regimes for a General Time Elapsed Neuron Network Model

For large fully connected neuron networks, we study the dynamics of homogenous assemblies of interacting neurons described by time elapsed models. Under general assumptions on the firing rate which include the ones made in previous works (Pakdaman et al. in Nonlinearity 23(1):55–75, 2010; SIAM J Appl Math 73(3):1260–1279, 2013, Mischler and Weng in Acta Appl Math, 2015), we establish accurate estimate on the long time behavior of the solutions in the weak and the strong connectivity regime both in the case with and without delay. Our results improve (Pakdaman et al. 2010, 2013) where a less accurate estimate was established and Mischler and Weng (2015) where only smooth firing rates were considered. Our approach combines several arguments introduced in the above previous works as well as a slightly refined version of the Weyl’s and spectral mapping theorems presented in Voigt (Monatsh Math 90(2):153–161, 1980) and Mischler and Scher (Ann Inst H Poincaré Anal Non Linéaire 33(3):849–898, 2016).

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Neural network model of the multi-mode anomalous transport module for accelerated transport simulations

Here, a neural network version of the Multi-Mode Anomalous Transport Module, known as MMMnet, has been developed to calculate plasma turbulent diffusivities in DIII-D with a calculation time suitable for control applications. MMMnet uses a simple artificial neural network structure to predict the ion thermal, electron thermal, and toroidal momentum diffusivities while reproducing Multi-Mode Model (MMM) data with good accuracy and keeping the calculation time as a fraction of that associated with MMM. Model-based control techniques require models with fast calculation times, making many existing physics-oriented predictive codes unsuitable. The control-oriented predictive code COTSIM (Control Oriented Transport SIMulator) calculates the most significant plasma dynamics in response to the different actuators while running at a speed useful for control design. In order to achieve this calculation speed, COTSIM often relies on scaling laws and control-level models. Replacing some of these scaling laws and control-level models with neural network versions of more complex physics-level models has the potential of increasing the range of validity and the level of accuracy of COTSIM without compromising its computational speed. In this work, MMMnet is integrated into COTSIM to improve the turbulent diffusivity predictions, which will in turn improve the prediction accuracy associated with the dynamics of many plasma properties.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Uncertainty propagation in feed-forward neural network models

We develop new uncertainty propagation methods for feed-forward neural network architectures with leaky ReLU activation functions subject to random perturbations in the input vectors. In particular, we derive analytical expressions for the probability density function (PDF) of the neural network output and its statistical moments as a function of the input uncertainty and the parameters of the network, i.e., weights and biases. A key finding is that an appropriate linearization of the leaky ReLU activation function yields accurate statistical results even for large perturbations in the input vectors. This can be attributed to the way information propagates through the network. We also propose new analytically tractable Gaussian copula surrogate models to approximate the full joint PDF of the neural network output. To validate our theoretical results, we conduct Monte Carlo simulations and a thorough error analysis on a multi-layer neural network representing a nonlinear integro-differential operator between two polynomial function spaces. Our findings demonstrate excellent agreement between the theoretical predictions and Monte Carlo simulations.

MLP networks↗

Neural network modelling of thermal stratification in a solar DHW storage

In this study an artificial neural network (ANN) model is introduced for modelling the layer temperatures in a storage tank of a solar thermal system. The model is based on the measured data of a domestic hot water system. The temperatures distribution in the storage tank divided in 8 equal parts in vertical direction were calculated every 5 min using the average 5 min data of solar radiation, ambient temperature, mass flow rate of collector loop, load and the temperature of the layers in previous time steps. The introduced ANN model consists of two parts describing the load periods and the periods between the loads. The identified model gives acceptable results inside the training interval as the average deviation was 0.22 C during the training and 0.24 C during the validation. (author)

14 SOLAR ENERGY↗

Application of Artificial Neural Network Model for Optimized Control of Condenser Water Temperature Set-Point in a Chilled Water System

Here, in this study, real-time predictive control and optimization model based on an ANN (artificial neural network) was developed to evaluate the cooling energy saving performance of the optimized control of CndWT (condenser water temperature). For this purpose, the difference in TCEC (total cooling energy consumption) between the conventional control strategy when the CndWT produced by the cooling tower is fixed and the optimized control strategy when real-time control of the CndWT through the optimal ANN model is applied was compared and analyzed. For the modeling of the building to be simulated, the co-simulation of EnergyPlus and MATLAB was built through the middleware Building Controls Virtual Test Bed. For the prediction of TCEC, an ANN model was developed through MATLAB's neural network toolbox. The model accuracy of the ANN was examined through Cv(RMSE) index and as a result, Cv(RMSE) of the optimized ANN model turned out to be approximately 25 %. More importantly, the predictive control technique was able to save TCEC by 5.6 % compared to the conventional control method constantly fixing CndWT set-point to 30 °C. These results showed that the CndWT needs to be dynamically controlled using artificial intelligence technique such as ANN model and that significant energy savings were achievable compared to the conventional fixed control.

42 ENGINEERING↗