Search NASA⌕ Search

SEARCH · Search NASA

Results for “Network parameter error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

DeepMerge: Studying Distant Merging Galaxies with Deep Neural Networks

The hierarchical merging of galaxies is a probe of the cosmos to test the canonical ?CDM cosmology paradigm. A particularly interesting period is "cosmic high noon" at redshifts z? 2?3, during which star formation rates were the highest, and significant amounts of stellar mass assembled into galaxy-scale bodies. Detecting galaxy mergers in observations by conventional automated methods (which use extracted parameters of galaxy structure - asymmetry, clumpiness, concentration etc.) or by visual inspection has proven to be quite time-consuming and prone to errors. Convolutional Neural Network (CNNs) are a primary representative of deep learning algorithms which are used in computer vision tasks by training to detect features in images. CNNs were already used for classification of low-redshift merging galaxies [1, 2]. Here we will use CNN to to learn directly from images (without the need to extract morphology parameters) of distant merging galaxies in order to distinguish between merging and non-merging objects.

79 ASTRONOMY AND ASTROPHYSICS↗

Performance Study of Hybrid DS/FFH Spread-Spectrum Systems in the Presence of Frequency-Selective Fading and Multiple-Access Interference

Hybrid spread-spectrum (HSS) systems have recently received considerable interest in commercial, Smart Grid, and military communication systems because they accommodate high data rates with high link integrity, even in the presence of significant multipath effects and interfering signals. A highly useful form of this modulation scheme is the specific code-related combination of standard direct-sequence spread spectrum (DSSS) with fast frequency-hopping (FFH) spread spectrum, denoted hybrid DS/FFH, wherein multiple frequency hops occur within a single data-bit time. In this paper we perform a simulation-based study of the DS/FFH performance as compared to the existing standard DSSS and FHSS wireless networks. The performance metrics are bit-error probability and multiple-access capability. The parameter space of DS/FFH, including the DS spreading rate, frequency hopping rate, carrier frequencies, and numbers of users, is explored to show its performance under frequency-selective Rayleigh fading environments and multiuser interference. Direct digital synthesizers to achieve fast hopping speeds are also considered in our study.

99 GENERAL AND MISCELLANEOUS↗

Satisfiability of logic programming based on radial basis function neural networks

In this paper, we propose a new technique to test the Satisfiability of propositional logic programming and quantified Boolean formula problem in radial basis function neural networks. For this purpose, we built radial basis function neural networks to represent the proportional logic which has exactly three variables in each clause. We used the Prey-predator algorithm to calculate the output weights of the neural networks, while the K-means clustering algorithm is used to determine the hidden parameters (the centers and the widths). Mean of the sum squared error function is used to measure the activity of the two algorithms. We applied the developed technique with the recurrent radial basis function neural networks to represent the quantified Boolean formulas. The new technique can be applied to solve many applications such as electronic circuits and NP-complete problems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Analytic Theory for the Dynamics of Wide Quantum Neural Networks

Here, parametrized quantum circuits can be used as quantum neural networks and have the potential to outperform their classical counterparts when trained for addressing learning problems. To date, much of the results on their performance on practical problems are heuristic in nature. In particular, the convergence rate for the training of quantum neural networks is not fully understood. Here, we analyze the dynamics of gradient descent for the training error of a class of variational quantum machine learning models. We define wide quantum neural networks as parametrized quantum circuits in the limit of a large number of qubits and variational parameters. Then, we find a simple analytic formula that captures the average behavior of their loss function and discuss the consequences of our findings. For example, for random quantum circuits, we predict and characterize an exponential decay of the residual training error as a function of the parameters of the system. Finally, we validate our analytic results with numerical experiments.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Decentralized Filtering Adaptive Neural Network Control for Uncertain Switched Interconnected Nonlinear Systems

This article presents a novel decentralized filtering adaptive neural network control framework for uncertain switched interconnected nonlinear systems. Each subsystem has its own decentralized controller based on the established decentralized state predictor. For each subsystem, the nonlinear uncertainties are approximated by a Gaussian radial basis function (GRBF) neural network incorporated with a piecewise constant adaptive law, where the adaptive law will update adaptive parameters from the error dynamics between the host system and the decentralized state predictor by discarding the unknowns, whereas a decentralized filtering control law is derived to cancel both local and mismatched uncertainties from other subsystems, as well as achieve the local objective tracking of the host system. The achievement of global objective depends on the achievement of local objective for each subsystem. The matched uncertainties are canceled directly by adopting their opposite in the control signal, whereas a dynamic inversion of the system is required to eliminate the effect of the mismatched uncertainties on the output. By exploiting the average dwell time principle, the error bounds between the real system and the virtual reference system, which defines the best performance that can be achieved by the closed-loop system, are derived. A numerical example is given to illustrate the effectiveness of the decentralized filtering adaptive neural network control architecture by comparing against the model reference adaptive control (MRAC).

Average dwell time, decentralized, filtering adapt↗

Stochastic solution of population balance equations for reactor networks

This work presents a sequential modular approach to solve a generic network of reactors with a population balance model using a stochastic numerical method. Full-coupling to the gas-phase is achieved through operator-splitting. The convergence of the stochastic particle algorithm in test networks is evaluated as a function of network size, recycle fraction and numerical parameters. These test cases are used to identify methods through which systematic and statistical error may be reduced, including by use of stochastic weighted algorithms. The optimal algorithm was subsequently used to solve a one-dimensional example of silicon nanoparticle synthesis using a multivariate particle model. This example demonstrated the power of stochastic methods in resolving particle structure by investigating the transient and spatial evolution of primary polydispersity, degree of sintering and TEM-style images. Highlights: •An algorithm is presented to solve reactor networks with a population balance model. •A stochastic method is used to solve the population balance equations. •The convergence and efficiency of the reported algorithms are evaluated. •The algorithm is applied to simulate silicon nanoparticle synthesis in a 1D reactor. •Particle structure is reported as a function of reactor length and time.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Neural Architecture and Feature Search for Predicting the Ridership of Public Transportation Routes

Accurately predicting the ridership of public-transit routes provides substantial benefits to both transit agencies, who can dispatch additional vehicles proactively before the vehicles that serve a route become crowded, and to passengers, who can avoid crowded vehicles based on publicly available predictions. The spread of the coronavirus disease has further elevated the importance of ridership prediction as crowded vehicles now present not only an inconvenience but also a public-health risk. At the same time, accurately predicting ridership has become more challenging due to evolving ridership patterns, which may make all data except for the most recent records stale. One promising approach for improving prediction accuracy is to fine-tune the hyper-parameters of machine-learning models for each transit route based on the characteristics of the particular route, such as the number of records. However, manually designing a machine-learning model for each route is a labor-intensive process, which may require experts to spend a significant amount of their valuable time. To help experts with designing machine-learning models, we propose a neural-architecture and feature search approach, which optimizes the architecture and features of a deep neural network for predicting the ridership of a public-transit route. Our approach is based on a randomized local hyper-parameter search, which minimizes both prediction error as well as the complexity of the model. We evaluate our approach on real-world ridership data provided by the public transit agency of Chattanooga, TN, and we demonstrate that training neural networks whose architectures and features are optimized for each route provides significantly better performance than training neural networks whose architectures and features are generic.

Ayman, Afiya↗

Real-time evolution of Anderson impurity models via tensor network influence functionals

In this work, we present and analyze two tensor network-based influence functional approaches for simulating the real-time dynamics of quantum impurity models such as the Anderson model. Via comparison with recent numerically exact simulations, we show that such methods accurately capture the long-time nonequilibrium quench dynamics. The two parameters that must be controlled in these tensor network influence functional approaches are a time discretization (Trotter) error and a bond dimension (tensor network truncation) error. We show that the actual numerical uncertainties are controlled by an intricate interplay of these two approximations, which we demonstrate in different regimes. Our work opens the door to using these tensor network influence functional methods as general impurity solvers.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Bayesian approach to model-based extrapolation of nuclear observables

Here, we considered 10 global models based on nuclear density functional theory with realistic energy density functionals as well as two more phenomenological mass models. The emulators of two-neutron separation energy residuals and Bayesian confidence intervals defining theoretical error bars were constructed using Bayesian Gaussian processes and Bayesian neural networks. By establishing statistical methodology and parameters, we carried out extrapolations toward the two-neutron dripline. While both Gaussian processes (GP) and Bayesian neural networks reduce the root-mean-square (rms) deviation from experiment significantly, GP offers a better and much more stable performance. The increase in the predictive power of microscopic models aided by the statistical treatment is quite astonishing: The resulting rms deviations from experiment on the testing dataset are similar to those of more phenomenological models. The estimated credibility intervals on predictions make it possible to evaluate predictive power of individual models and also make quantified predictions using groups of models. The proposed robust statistical approach to extrapolation of nuclear model results can be useful for assessing the impact of current and future experiments in the context of model developments. The new Bayesian capability to evaluate residuals is also expected to impact research in the domains where experiments are currently impossible, for instance, in simulations of the astrophysical r process.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

2020 IEEE PES Innovative Smart Grid Technologies Europe (ISGT-Europe)

Recent proliferation of distributed energy sources in distribution or sub-transmission systems necessitates close monitoring of these three-phase power grids which typically operate under unbalanced loading conditions. Unlike the transmission systems where the network equations are commonly based on the positive sequence component models, a detailed three phase model will have to be used in implementing network applications for these systems. In the specific case of the state estimator, where measurement and parameter errors may bias the solution, bad data and parameter error detection algorithms should also be incorporated. Implementing the state estimator and error detection algorithms for three-phase systems impose additional computational burden and modifications to the state estimation code. This paper proposes a practical solution to avoid these issues by using synchronized phasor measurements and modal decoupling. The previously developed parameter error detection algorithm based on the normalized Lagrange multipliers (NLM) test is applied to the measurements independently in each mode in parallel, not only saving CPU time but also avoiding new code development for a three-phase estimator. Different parameter error scenarios are created and tested to verify the effectiveness of the proposed error detection approach.

Khalili, Ramtin↗

A Measurement of Electron Neutrino Appearance in the MINOS Experiment After Four Years of Data

This work attempts to measure or set a limit on sin 2 (2θ 13 ), the parameter which describes v μ → v e oscillations. The MINOS detectors at Fermilab are used to perform a search for the oscillations utilizing a beam of v μ neutrinos created in the NuMI beamline by the collisions of 120 GeV protons with a carbon target. These collisions create π ± and K ± which are focused with magnetic horns, are allowed to decay, and result in a beam of v μ in the energy range of 1 to 30 GeV. Two functionally identical steel-scintillator calorimetric detectors are utilized to measure the interactions of the generated neutrinos. A detector close to the NuMI beam, located 104 m underground and 1040 m from the target, is used to measure the properties of the neutrino beam, including the flux, composition, and energy spectrum. This information is used in part to generate a predicted spectrum of neutrinos in absence of v μ → v e oscillations in the detector located far from the target, at a distance of 705 m underground and 735.5 km from the target. An excess of predicted v e charged current events in this far detector will be interpreted as v μ → v e oscillations, and a measurement of sin 2 (2θ 13 ) will be made using a Feldman-Cousins analysis. The measurement of v μ → v e requires the separation of v e candidates from background events. New reconstruction software was developed with a focus on identifying v e candidate events in order to reduce systematic errors. The event parameters measured by this software were used as an input to an artificial neutral network event discriminator. The details of this reconstruction software and the other steps of the analysis necessary to making the measurement will be discussed. This work builds on a previous measurement made with this experiment. After two years of running with 3.14 x 10 20 protons-on-target (POT), a limit was set at δCP = 0 for the normal (inverted) hierarchy of sin 2 (2θ 13 ) < 0.29 (0.42) at 90% C.L. This study finds after four years of data with an accumulated intensity of 7 x 10 20 POT that sin 2 (2θ 13 ) < 0.12 (0.20) with δCP = 0 at 90% C.L. for the normal (inverted) hierarchy.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Wind turbine gearbox fault prognosis using high-frequency SCADA data

Condition-based maintenance using routinely collected Supervisory Control and Data Acquisition (SCADA) data is a promising strategy to reduce downtime and costs associated with wind farm operations and maintenance. New approaches are continuously being developed to improve the condition monitoring for wind turbines. Development of normal behaviour models is a popular approach in studies using SCADA data. This paper first presents a data-driven framework to apply normal behaviour models using an artificial neural network approach for wind turbine gearbox prognostics. A one-class support vector machine classifier, combining different error parameters, is used to analyse the normal behaviour model error to develop a robust threshold to distinguish anomalous wind turbine operation. A detailed sensitivity study is then conducted to evaluate the potential of using high-frequency SCADA data for wind turbine gearbox prognostics. The results based on operational data from one wind turbine show that, compared to the conventionally used 10-min averaged SCADA data, the use of high-frequency data is valuable as it leads to improved prognostic predictions. High-frequency data provides more insights into the dynamics of the condition of the wind turbine components and can aid in earlier detection of faults.

17 WIND ENERGY↗

Automated prediction of lattice parameters from X-ray powder diffraction patterns

A key step in the analysis of powder X-ray diffraction (PXRD) data is the accurate determination of unit-cell lattice parameters. This step often requires significant human intervention and is a bottleneck that hinders efforts towards automated analysis. This work develops a series of one-dimensional convolutional neural networks (1D-CNNs) trained to provide lattice parameter estimates for each crystal system. A mean absolute percentage error of approximately 10% is achieved for each crystal system, which corresponds to a 100- to 1000-fold reduction in lattice parameter search space volume. The models learn from nearly one million crystal structures contained within the Inorganic Crystal Structure Database and the Cambridge Structural Database and, due to the nature of these two complimentary databases, the models generalize well across chemistries. A key component of this work is a systematic analysis of the effect of different realistic experimental non-idealities on model performance. It is found that the addition of impurity phases, baseline noise and peak broadening present the greatest challenges to learning, while zero-offset error and random intensity modulations have little effect. However, appropriate data modification schemes can be used to bolster model performance and yield reasonable predictions, even for data which simulate realistic experimental non-idealities. In order to obtain accurate results, a new approach is introduced which uses the initial machine learning estimates with existing iterative whole-pattern refinement schemes to tackle automated unit-cell solution.

42 ENGINEERING↗

Explicitly integrating parameter, input, and structure uncertainties into Bayesian Neural Networks for probabilistic hydrologic forecasting

Estimating uncertainty of hydrologic forecasting is valuable to water resources and other relevant decision making processes. Recently, Bayesian Neural Networks (BNNs) have been proved powerful tools for quantifying uncertainty of streamflow forecasting. In this study, we propose a Markov Chain Monte Carlo (MCMC) framework to incorporate the uncertainties associated with input, model structure, and parameter into BNNs. This framework allows the structure of the neural networks to change by removing or adding connections between neurons and enables scaling of input data by using rainfall multipliers. The results show that the new BNNs outperform the BNNs that only consider uncertainties associated with parameter and model structure. Critical evaluation of posterior distribution of neural network weights, number of effective connections, rainfall multipliers, and hyper-parameters show that the assumptions held in our BNNs are not well supported. Further understanding of characteristics of different uncertainty sources and including output error into the MCMC framework are expected to enhance the application of neural networks for uncertainty analysis of hydrologic forecasting.

58 GEOSCIENCES↗

Skip-Connected Self-Recurrent Spiking Neural Networks with Joint Intrinsic Parameter and Synaptic Weight Training

As an important class of spiking neural networks (SNNs), recurrent spiking neural networks (RSNNs) possess great computational power and have been widely used for processing sequential data like audio and text. However, most RSNNs suffer from two problems. 1. Due to the lack of architectural guidance, random recurrent connectivity is often adopted, which does not guarantee good performance. 2. Training of RSNNs is in general challenging, bottlenecking achievable model accuracy. To address these problems, we propose a new type of RSNNs called Skip-Connected Self-Recurrent SNNs (ScSr-SNNs). Recurrence in ScSr-SNNs is introduced in a stereotyped manner by adding self-recurrent connections to spiking neurons. The SNNs with self-recurrent connections can realize recurrent behaviors similar to those of more complex RSNNs while the error gradients can be more straightforwardly calculated due to the mostly feedforward nature of the network. The network dynamics is enriched by skip connections between nonadjacent layers. Moreover, we propose a new backpropagation (BP) method called backpropagated intrinsic plasticity (BIP) to further boost the performance of ScSr-SNNs by training intrinsic model parameters. Unlike standard intrinsic plasticity rules that adjust the neuron's intrinsic parameters according to neuronal activity, the proposed BIP method optimizes intrinsic parameters based on the backpropagated error gradient of a well-defined global loss function in addition to synaptic weight training. Here, based on challenging speech, neuromorphic speech, and neuromorphic image datasets, the proposed ScSr-SNNs can boost performance by up to 2.85% compared with other types of RSNNs trained by state-of-the-art BP methods.

97 MATHEMATICS AND COMPUTING↗

Heisenberg-scaling measurement protocol for analytic functions with quantum sensor networks

Here we generalize past work on quantum sensor networks to show that, for d input parameters, entanglement can yield a factor O(d) improvement in mean-squared error when estimating an analytic function of these parameters. We show that the protocol is optimal for qubit sensors, and we conjecture an optimal protocol for photons passing through interferometers. Our protocol is also applicable to continuous variable measurements, such as one quadrature of a field operator. We outline a few potential applications, including calibration of laser operations in trapped ion quantum computing.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Constitutive Modeling of High-Temperature Flow Stress of Armor Steel in Ballistic Applications: A Comparative Study

Armox 500T is one of the armor grade steels extensively used as armor against bullet penetration in ballistic applications. In such applications, the material undergoes plastic deformation at large strain rates (10{sup 3} s{sup −1}) at temperatures of the order of 673-1373 K. In the present work, an attempt has been made to predict strain rate and temperature-dependent flow behavior of Armox 500T steel through physical-based model like modified Zerilli–Armstrong (M-ZA) and phenomenological-based models like Cowper Symonds (CS), modified Johnson–Cook (M-JC), Arrhenius (Arr.) and Khan–Huang–Liang (KHL) constitutive material model. Isothermal uniaxial compression tests at low strain rates (10{sup −3}-10{sup −1} s{sup −1}) and dynamic compression tests at high strain rates (600-3000 s{sup −1}) in the temperatures range of 673-1373 K have been carried out to determine constitutive material model parameters. In addition, an artificial neural network (ANN) model that works on multilayer perceptron (MLP) based back propagation neural network (BPNN) has also been developed. The results from all these models have been compared in terms of three statistical parameters namely correlation coefficient (R), mean absolute percent error (MAPE) and its standard deviation (Δ). The results revealed that M-JC model shows highest correlation coefficient and lowest average absolute error. Further, ANN model prediction has the highest accuracy with R = 0.999 and MAPE = 1.052.

36 MATERIALS SCIENCE↗

Estimating the parameters of nonspinning binary black holes using ground-based gravitational-wave detectors: Statistical errors

We assess the statistical errors in estimating the parameters of nonspinning black hole binaries using ground-based gravitational-wave detectors. While past assessments were based on partial information provided by only the inspiral and/or ring-down pieces of the coalescence signal, the recent progress in analytical and numerical relativity enables us to make more accurate projections using complete inspiral-merger-ring-down waveforms. We employ the Fisher information-matrix formalism to estimate how accurately the source parameters will be measurable using a single interferometric detector as well as a network of interferometers. Those estimates are further vetted by full-fledged Monte Carlo simulations. We find that the parameter accuracies of the complete waveform are, in general, significantly better than those of just the inspiral waveform in the case of binaries with total mass M > or approx. 20M{sub {center_dot}}. In particular, for the case of the Advanced LIGO detector, parameter estimation is the most accurate in the M=100-200M{sub {center_dot}} range. For an M=100M{sub {center_dot}} system, the errors in measuring the total mass and the symmetric mass-ratio are reduced by an order of magnitude or more compared to inspiral waveforms. Furthermore, for binaries located at a fixed luminosity distance d{sub L}, and observed with the Advanced LIGO-Advanced Virgo network, the sky-position error is expected to vary widely across the sky: For M=100M{sub {center_dot}} systems at d{sub L}=1 Gpc, this variation ranges mostly from about a hundredth of a square degree to about a square degree, with an average value of nearly a tenth of a square degree. This is more than 40 times better than the average sky-position accuracy of inspiral waveforms at this mass range. For the mass parameters as well as the sky position, this improvement in accuracy is due partly to the increased signal-to-noise ratio and partly to the information about these parameters harnessed through the post-inspiral phases of the waveform. The error in estimating d{sub L} is dominated by the error in measuring the wave's polarization and is roughly 43% for low-mass (M{approx}20M{sub {center_dot}}) binaries and about 23% for high-mass (M{approx}100M{sub {center_dot}}) binaries located at d{sub L}=1 Gpc.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗