Search NASA⌕ Search

SEARCH · Search NASA

Results for “Network parameter error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Wind turbine gearbox fault prognosis using high-frequency SCADA data

Condition-based maintenance using routinely collected Supervisory Control and Data Acquisition (SCADA) data is a promising strategy to reduce downtime and costs associated with wind farm operations and maintenance. New approaches are continuously being developed to improve the condition monitoring for wind turbines. Development of normal behaviour models is a popular approach in studies using SCADA data. This paper first presents a data-driven framework to apply normal behaviour models using an artificial neural network approach for wind turbine gearbox prognostics. A one-class support vector machine classifier, combining different error parameters, is used to analyse the normal behaviour model error to develop a robust threshold to distinguish anomalous wind turbine operation. A detailed sensitivity study is then conducted to evaluate the potential of using high-frequency SCADA data for wind turbine gearbox prognostics. The results based on operational data from one wind turbine show that, compared to the conventionally used 10-min averaged SCADA data, the use of high-frequency data is valuable as it leads to improved prognostic predictions. High-frequency data provides more insights into the dynamics of the condition of the wind turbine components and can aid in earlier detection of faults.

17 WIND ENERGY↗

Automated prediction of lattice parameters from X-ray powder diffraction patterns

A key step in the analysis of powder X-ray diffraction (PXRD) data is the accurate determination of unit-cell lattice parameters. This step often requires significant human intervention and is a bottleneck that hinders efforts towards automated analysis. This work develops a series of one-dimensional convolutional neural networks (1D-CNNs) trained to provide lattice parameter estimates for each crystal system. A mean absolute percentage error of approximately 10% is achieved for each crystal system, which corresponds to a 100- to 1000-fold reduction in lattice parameter search space volume. The models learn from nearly one million crystal structures contained within the Inorganic Crystal Structure Database and the Cambridge Structural Database and, due to the nature of these two complimentary databases, the models generalize well across chemistries. A key component of this work is a systematic analysis of the effect of different realistic experimental non-idealities on model performance. It is found that the addition of impurity phases, baseline noise and peak broadening present the greatest challenges to learning, while zero-offset error and random intensity modulations have little effect. However, appropriate data modification schemes can be used to bolster model performance and yield reasonable predictions, even for data which simulate realistic experimental non-idealities. In order to obtain accurate results, a new approach is introduced which uses the initial machine learning estimates with existing iterative whole-pattern refinement schemes to tackle automated unit-cell solution.

42 ENGINEERING↗

Explicitly integrating parameter, input, and structure uncertainties into Bayesian Neural Networks for probabilistic hydrologic forecasting

Estimating uncertainty of hydrologic forecasting is valuable to water resources and other relevant decision making processes. Recently, Bayesian Neural Networks (BNNs) have been proved powerful tools for quantifying uncertainty of streamflow forecasting. In this study, we propose a Markov Chain Monte Carlo (MCMC) framework to incorporate the uncertainties associated with input, model structure, and parameter into BNNs. This framework allows the structure of the neural networks to change by removing or adding connections between neurons and enables scaling of input data by using rainfall multipliers. The results show that the new BNNs outperform the BNNs that only consider uncertainties associated with parameter and model structure. Critical evaluation of posterior distribution of neural network weights, number of effective connections, rainfall multipliers, and hyper-parameters show that the assumptions held in our BNNs are not well supported. Further understanding of characteristics of different uncertainty sources and including output error into the MCMC framework are expected to enhance the application of neural networks for uncertainty analysis of hydrologic forecasting.

58 GEOSCIENCES↗

Skip-Connected Self-Recurrent Spiking Neural Networks with Joint Intrinsic Parameter and Synaptic Weight Training

As an important class of spiking neural networks (SNNs), recurrent spiking neural networks (RSNNs) possess great computational power and have been widely used for processing sequential data like audio and text. However, most RSNNs suffer from two problems. 1. Due to the lack of architectural guidance, random recurrent connectivity is often adopted, which does not guarantee good performance. 2. Training of RSNNs is in general challenging, bottlenecking achievable model accuracy. To address these problems, we propose a new type of RSNNs called Skip-Connected Self-Recurrent SNNs (ScSr-SNNs). Recurrence in ScSr-SNNs is introduced in a stereotyped manner by adding self-recurrent connections to spiking neurons. The SNNs with self-recurrent connections can realize recurrent behaviors similar to those of more complex RSNNs while the error gradients can be more straightforwardly calculated due to the mostly feedforward nature of the network. The network dynamics is enriched by skip connections between nonadjacent layers. Moreover, we propose a new backpropagation (BP) method called backpropagated intrinsic plasticity (BIP) to further boost the performance of ScSr-SNNs by training intrinsic model parameters. Unlike standard intrinsic plasticity rules that adjust the neuron's intrinsic parameters according to neuronal activity, the proposed BIP method optimizes intrinsic parameters based on the backpropagated error gradient of a well-defined global loss function in addition to synaptic weight training. Here, based on challenging speech, neuromorphic speech, and neuromorphic image datasets, the proposed ScSr-SNNs can boost performance by up to 2.85% compared with other types of RSNNs trained by state-of-the-art BP methods.

97 MATHEMATICS AND COMPUTING↗

Learning a trajectory using adjoint functions and teacher forcing

A new methodology for faster supervised temporal learning in nonlinear neural networks is presented which builds upon the concept of adjoint operators to allow fast computation of the gradients of an error functional with respect to all parameters of the neural architecture, and exploits the concept of teacher forcing to incorporate information on the desired output into the activation dynamics. The importance of the initial or final time conditions for the adjoint equations is discussed. A new algorithm is presented in which the adjoint equations are solved simultaneously (i.e., forward in time) with the activation dynamics of the neural network. We also indicate how teacher forcing can be modulated in time as learning proceeds. The results obtained show that the learning time is reduced by one to two orders of magnitude with respect to previously published results, while trajectory tracking is significantly improved. The proposed methodology makes hardware implementation of temporal learning attractive for real-time applications.

Toomarian, Nikzad B.↗

(abstract) Satellite-Enhanced Personal Communications Experiments

As an initial step in exploring the opportunities afforded by the merger of satellite-based and land-based networks, Bellcore and JPL conducted several experiments utilizing NASA's Advanced Communications Technology Satellite (ACTS) and JPL's ACTS Mobile Terminal (AMT). Experimental goals fell into three categories: a) demonstrate personal communication applications, b) demonstrate interoperability among multiple wireless networks and the Public Switched Telecommunications Network (PSTN), and c) evaluate new protocol mechanisms for data communications using wireless links. We describe the performance of Point-of-Sale, e-mail, FAX, and call control applications, where the communication path passed through up to four networks: a wireless packet data network, the Satellite network, the PSTN, and a wireless cellular network. One important element of satellite-terrestrial interoperability is the efficiency of data communications protocols. Most protocols in use today (e.g., TCP/IP) have been optimized for wireline channels; their use over wireless networks presents significant new challenges. The characteristics of wireless channels -- increased error, longer packet delay, and limited bandwidth -- affect the design of the protocol. We describe experimental results for differing protocol mechanisms and parameters, such as acknowledgment schemes and packet sizes, that demonstrate the types of protocol needed for efficient use of wireless satellite-terrestrial networks.

personal↗

Heisenberg-scaling measurement protocol for analytic functions with quantum sensor networks

Here we generalize past work on quantum sensor networks to show that, for d input parameters, entanglement can yield a factor O(d) improvement in mean-squared error when estimating an analytic function of these parameters. We show that the protocol is optimal for qubit sensors, and we conjecture an optimal protocol for photons passing through interferometers. Our protocol is also applicable to continuous variable measurements, such as one quadrature of a field operator. We outline a few potential applications, including calibration of laser operations in trapped ion quantum computing.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Constitutive Modeling of High-Temperature Flow Stress of Armor Steel in Ballistic Applications: A Comparative Study

Armox 500T is one of the armor grade steels extensively used as armor against bullet penetration in ballistic applications. In such applications, the material undergoes plastic deformation at large strain rates (10{sup 3} s{sup −1}) at temperatures of the order of 673-1373 K. In the present work, an attempt has been made to predict strain rate and temperature-dependent flow behavior of Armox 500T steel through physical-based model like modified Zerilli–Armstrong (M-ZA) and phenomenological-based models like Cowper Symonds (CS), modified Johnson–Cook (M-JC), Arrhenius (Arr.) and Khan–Huang–Liang (KHL) constitutive material model. Isothermal uniaxial compression tests at low strain rates (10{sup −3}-10{sup −1} s{sup −1}) and dynamic compression tests at high strain rates (600-3000 s{sup −1}) in the temperatures range of 673-1373 K have been carried out to determine constitutive material model parameters. In addition, an artificial neural network (ANN) model that works on multilayer perceptron (MLP) based back propagation neural network (BPNN) has also been developed. The results from all these models have been compared in terms of three statistical parameters namely correlation coefficient (R), mean absolute percent error (MAPE) and its standard deviation (Δ). The results revealed that M-JC model shows highest correlation coefficient and lowest average absolute error. Further, ANN model prediction has the highest accuracy with R = 0.999 and MAPE = 1.052.

36 MATERIALS SCIENCE↗

Estimating the parameters of nonspinning binary black holes using ground-based gravitational-wave detectors: Statistical errors

We assess the statistical errors in estimating the parameters of nonspinning black hole binaries using ground-based gravitational-wave detectors. While past assessments were based on partial information provided by only the inspiral and/or ring-down pieces of the coalescence signal, the recent progress in analytical and numerical relativity enables us to make more accurate projections using complete inspiral-merger-ring-down waveforms. We employ the Fisher information-matrix formalism to estimate how accurately the source parameters will be measurable using a single interferometric detector as well as a network of interferometers. Those estimates are further vetted by full-fledged Monte Carlo simulations. We find that the parameter accuracies of the complete waveform are, in general, significantly better than those of just the inspiral waveform in the case of binaries with total mass M > or approx. 20M{sub {center_dot}}. In particular, for the case of the Advanced LIGO detector, parameter estimation is the most accurate in the M=100-200M{sub {center_dot}} range. For an M=100M{sub {center_dot}} system, the errors in measuring the total mass and the symmetric mass-ratio are reduced by an order of magnitude or more compared to inspiral waveforms. Furthermore, for binaries located at a fixed luminosity distance d{sub L}, and observed with the Advanced LIGO-Advanced Virgo network, the sky-position error is expected to vary widely across the sky: For M=100M{sub {center_dot}} systems at d{sub L}=1 Gpc, this variation ranges mostly from about a hundredth of a square degree to about a square degree, with an average value of nearly a tenth of a square degree. This is more than 40 times better than the average sky-position accuracy of inspiral waveforms at this mass range. For the mass parameters as well as the sky position, this improvement in accuracy is due partly to the increased signal-to-noise ratio and partly to the information about these parameters harnessed through the post-inspiral phases of the waveform. The error in estimating d{sub L} is dominated by the error in measuring the wave's polarization and is roughly 43% for low-mass (M{approx}20M{sub {center_dot}}) binaries and about 23% for high-mass (M{approx}100M{sub {center_dot}}) binaries located at d{sub L}=1 Gpc.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Physics Informed Neural Nets for Systems Health Management

To facilitate and solve the prediction problem, awareness of the current health state of the system is key, since it is necessary to perform condition-based predictions. To accurately predict the future state of any system, it is required to possess knowledge of its current health state and future operational conditions. Development in data-driven algorithms in regression of complex nonlinear functions and classification tasks have generated a growing interest in artificial intelligence for industrial applications. Complex multi-physics models as well as digital twins, once purely built on physics and corresponding simplified lumped parameter iterations, can now benefit from machine learning algorithms to mitigate the lack of understanding of some complex behavior. The research work presents application of physics-informed neural nets application to a representative electric powertrain for unmanned aerial vehicles. The model is composed of physics-derived and empirical equations, integrated with connected networks that are strategically placed within the model to substitute equations that are subject to large uncertainty. Polynomial fit driven by heuristics or empirical observations can be substituted by more flexible networks that can minimize the error between model predictions and observations without being restricted to a predefined functional form. This modeling strategy allows training of networks deep inside the model and unknown parameters in a single learning stage.

Physics Informed↗

Robust system size reduction of discrete fracture networks: a multi-fidelity method that preserves transport characteristics

In this paper, we propose a multi-fidelity system reduction technique that uses weighted graphs paired with three-dimensional discrete fracture network (DFN) modelling for efficient simulation of subsurface flow and transport in fractured media. DFN models are used to simulate flow and transport in subsurface fractured rock with low-permeability. One method to alleviate the heavy computational overhead associated with these simulations is to reduce the size of the DFN using a graph representation of it to identify the primary flow sub-network and only simulate flow and transport thereon. The first of these methods used unweighted graphs constructed solely on DFN topology and could be used for accurate predictions of first-passage times. However, these techniques perform poorly when predicting later stages of the mass breakthrough. We utilize a weighted-graph representation of the DFN where edge weights are based on hydrological parameters in the DFN that allows us to exploit the kinematic quantities derivable a posteriori from the flow solution obtained on the graph representation of the DFN to perform system reduction and predict the later stages of the breakthrough curve with high fidelity. We also propose and demonstrate the use of an adaptive pruning algorithm with error control that produces a pruned DFN sub-network whose predicted mass breakthrough agrees with the original DFN within a user-specified tolerance. Lastly, the method allows for the level of accuracy to be a user-controlled parameter.

58 GEOSCIENCES↗

Determination of Earth orientation using the Global Positioning System

Modern spacecraft tracking and navigation require highly accurate Earth-orientation parameters. For near-real-time applications, errors in these quantities and their extrapolated values are a significant error source. A globally distributed network of high-precision receivers observing the full Global Positioning System (GPS) configuration of 18 or more satellites may be an efficient and economical method for the rapid determination of short-term variations in Earth orientation. A covariance analysis using the JPL Orbit Analysis and Simulation Software (OASIS) was performed to evaluate the errors associated with GPS measurements of Earth orientation. These GPS measurements appear to be highly competitive with those from other techniques and can potentially yield frequent and reliable centimeter-level Earth-orientation information while simultaneously allowing the oversubscribed Deep Space Network (DSN) antennas to be used more for direct project support.

Freedman, A. P.↗

Neural Network Machine Learning and Dimension Reduction for Data Visualization

Neural network machine learning in computer science is a continuously developing field of study. Although neural network models have been developed which can accurately predict a numeric value or nominal classification, a general purpose method for constructing neural network architecture has yet to be developed. Computer scientists are often forced to rely on a trial-and-error process of developing and improving accurate neural network models. In many cases, models are constructed from a large number of input parameters. Understanding which input parameters have the greatest impact on the prediction of the model is often difficult to surmise, especially when the number of input variables is very high. This challenge is often labeled the "curse of dimensionality" in scientific fields. However, techniques exist for reducing the dimensionality of problems to just two dimensions. Once a problem's dimensions have been mapped to two dimensions, it can be easily plotted and understood by humans. The ability to visualize a multi-dimensional dataset can provide a means of identifying which input variables have the highest effect on determining a nominal or numeric output. Identifying these variables can provide a better means of training neural network models; models can be more easily and quickly trained using only input variables which appear to affect the outcome variable. The purpose of this project is to explore varying means of training neural networks and to utilize dimensional reduction for visualizing and understanding complex datasets.

Liles, Charles A.↗

Invertible neural networks for real-time control of extrusion additive manufacturing

Material extrusion additive manufacturing (AM) has enabled an elegant fabrication pathway for a vast material library. Nonetheless, each material requires optimization of printing parameters generally determined through significant trial-and-error testing. To eliminate arduous, iteration-based optimization approaches, many researchers have used machine learning (ML) algorithms which provide opportunities for automated process optimization. Here, in this work, we demonstrate the use of an ML-driven approach for real-time material extrusion print-parameter optimization through in-situ monitoring of printed line geometry. To do this, we use deep invertible neural networks (INNs) which can solve both forward and inverse, or optimization, problems using a single network. By combining in-situ computer vision and deep INNs, the printing parameters can be autonomously optimized to print a target line width in 1.2 s. Furthermore, defects that occur during printing can be rapidly identified and corrected autonomously. The methods developed and presented in this work eliminate user-intensive, time-consuming, and iterative parameter discovery approaches that currently limit accelerated implementation of extrusion-based AM processes. Furthermore, the presented approach can be generalized to provide real-time monitoring and optimization pathways for increasingly complex AM environments.

36 MATERIALS SCIENCE↗

Identifying attributes of CO 2 leakage zones in shallow aquifers using a parametric level set method: Original Research Article: Identifying attributes of CO 2 leakage zones in shallow aquifers using a parametric level set method

Leakage through abandoned wells and geologic faults poses the greatest risk to CO 2 storage permanence. For shallow aquifers, secondary CO 2 plumes emanating from the leak zones may go undetected for a sustained period of time and has the greatest potential to cause large-scale and long-term environmental impacts. Identification of the attributes of leak zones, including their shape, location, and strength, is required for environmental risk assessment. This study applies a parametric level set (PaLS) method to characterize leak zones. Level set methods are appealing for tracking topological changes and recovering unknown shapes of objects. However, level set evolution using the conventional level set methods is computationally challenging. In PaLS, the level set function is approximated by using a weighted sum of basis functions and the level set evolution problem is replaced by an optimization problem. The efficacy of PaLS is demonstrated by reconstructing attributes of a CO 2 leak zone in a carbonate aquifer. Our results show that PaLS is a robust source identification method that can recover the approximate leak zone locations in the presence of measurement errors, model parameter uncertainty, and inaccurate guesses of source flux strengths. Accurate delineation of source geometry is achievable when a relatively dense observation network is used. The PaLS-based, source recovery framework introduced in this work is generic and can be adapted for any reactive transport model by simply switching the pre- and post-processing routines.

54 ENVIRONMENTAL SCIENCES↗

Total ozone trend significance from space time variability of daily Dobson data

Estimates of standard errors of total ozone time and area means, as derived from ozone's natural temporal and spatial variability and autocorrelation in middle latitudes determined from daily Dobson data are presented. Assessing the significance of apparent total ozone trends is equivalent to assessing the standard error of the means. Standard errors of time averages depend on the temporal variability and correlation of the averaged parameter. Trend detectability is discussed, both for the present network and for satellite measurements.

Wilcox, R. W.↗

Estimation of Stability and Control Derivatives of an F-15

A technique for real-time estimation of stability and control derivatives (derivatives of moment coefficients with respect to control-surface deflection angles) was used to support a flight demonstration of a concept of an indirect-adaptive intelligent flight control system (IFCS). Traditionally, parameter identification, including estimation of stability and control derivatives, is done post-flight. However, for the indirect-adaptive IFCS concept, parameter identification is required during flight so that the system can modify control laws for a damaged aircraft. The flight demonstration was carried out on a highly modified F-15 airplane (see Figure 1). The main objective was to estimate the stability and control derivatives of the airplane in nearly real time. A secondary goal was to develop a system to automatically assess the quality of the results, so as to be able to tell a learning neural network which data to use. Parameter estimation was performed by use of Fourier-transform regression (FTR) a technique developed at NASA Langley Research Center. FTR is an equation- error technique that operates in the frequency domain. Data are put into the frequency domain by use of a recursive Fourier transform for a discrete frequency set. This calculation simplifies many subsequent calculations, removes biases, and automatically filters out data beyond the chosen frequency range. FTR as applied here was tailored to work with pilot inputs, which produce correlated surface positions that prevent accurate parameter estimates, by replacing half the derivatives with predicted values. FTR was also set up to work only on a recent window of data, to accommodate changes in flight condition. A system of confidence measures was developed to identify quality-parameter estimates that a learning neural network could use. This system judged the estimates primarily on the basis of their estimated variances and of the level of aircraft response. The resulting FTR system was implemented in the Simulink software system and auto-coded in the C programming language for use on the Airborne Research Test System (ARTS II) computer installed in the F-15 airplane. The Simulink model was also used in a control room that utilizes the Ring Buffered Network Bus hardware and software, making it possible to evaluate test points during flights. In-flight parameter estimation was done for piloted and automated maneuvers, primarily at three test conditions. Figure 2 shows results for pitching moment due to symmetric stabilator actuations for a series of three pitch doublet maneuvers (in a doublet maneuver, a command to change attitude in a given direction by a given amount is followed immediately by a command to change attitude in the opposite direction by the same amount). A time window of 5 seconds was used. The portions of the curves shown in red are those that passed the confidence tests. The technique showed good convergence for most derivatives for both kinds of maneuvers - typically within a few seconds. The confidence tests were marginally successful, and it would be necessary to refine them for use in an IFCS.

Smith, Mark↗