Search NASA⌕ Search

SEARCH · Search NASA

Results for “Neural Network Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Nested Neural Networks

Report presents analysis of nested neural networks, consisting of interconnected subnetworks. Analysis based on simplified mathematical models more appropriate for artificial electronic neural networks, partly applicable to biological neural networks. Nested structure allows for retrieval of individual subpatterns. Requires fewer wires and connection devices than fully connected networks, and allows for local reconstruction of damaged subnetworks without rewiring entire network.

Baram, Yoram↗

A neural net-based approach to software metrics

Software metrics provide an effective method for characterizing software. Metrics have traditionally been composed through the definition of an equation. This approach is limited by the fact that all the interrelationships among all the parameters be fully understood. This paper explores an alternative, neural network approach to modeling metrics. Experiments performed on two widely accepted metrics, McCabe and Halstead, indicate that the approach is sound, thus serving as the groundwork for further exploration into the analysis and design of software metrics.

Boetticher, G.↗

Neural network error correction for solving coupled ordinary differential equations

A neural network is presented to learn errors generated by a numerical algorithm for solving coupled nonlinear differential equations. The method is based on using a neural network to correctly learn the error generated by, for example, Runge-Kutta on a model molecular dynamics (MD) problem. The neural network programs used in this study were developed by NASA. Comparisons are made for training the neural network using backpropagation and a new method which was found to converge with fewer iterations. The neural net programs, the MD model and the calculations are discussed.

Shelton, R. O.↗

Analyzing rocket plume spectral data with neural networks

The Optical Plume Anomaly Detection (OPAD) system is under development to provide early-warning failure detection in support of ground-level testing of the Space Shuttle Main Engine (SSME). Failure detection is to be achieved through the acquisition of spectrally resolved plume emissions and subsequent identification of abnormal levels indicative of engine corrosion or component failure. Two computer codes (one linear and the other non-linear) are used by the OPAD system to iteratively determine specific element concentrations in the SSME plume, given emission intensity and wavelength information. Since this analysis is extremely labor intensive, a study was initiated to develop neural networks that would model the 'inverse' of these computer codes. Optimally connected feed-forward networks with imperceptible prediction error have been developed for each element modeled by the linear code, SPECTRA4. Radial basis function networks were developed for the non-linear code, SPECTRA5, and predict combustion temperature in addition to element concentrations.

Whitaker, Kevin W.↗

Nonlinear Stability and Response of Lifting Surfaces Via Volterra Series

This investigation concerns the time and frequency formulations of non-linear two-dimensional lifting surfaces exposed to an incompressible flow field and subjected to an external pressure pulse. In order to address this problem, Volterra series approach in conjunction with the multidimensional Laplace transform is used. This methodology enabling one to solve the aeroelastic governing equations of lifting surfaces opens the way to connect this methodology with that based on neural networks and NARMAX/NARX networks models. Moreover, this extended way to address this problem constitutes a good basis for treatment of the theory of 3D lifting surfaces.

Marzocca, Piergiovanni↗

System Identification of X-33 Neural Network

Modern flight control research has improved spacecraft survivability as its goal. To this end we need to have a failure detection system on board. In case the spacecraft is performing imperfectly, reconfiguration of control is needed. For that purpose we need to have parameter identification of spacecraft dynamics. Parameter identification of a system is called system identification. We treat the system as a black box which receives some inputs that lead to some outputs. The question is: what kind of parameters for a particular black box can correlate the observed inputs and outputs? Can these parameters help us to predict the outputs for a new given set of inputs? This is the basic problem of system identification. The X33 was supposed to have the onboard capability of evaluating the current performance and if needed to take the corrective measures to adapt to desired performance. The X33 is comprised of both rocket and aircraft vehicle design characteristics and requires, in general, analytical methods for evaluating its flight performance. Its flight consists of four phases: ascent, transition, entry and TAEM (Terminal Area Energy Management). It spends about 200 seconds in ascent phase, reaching an altitude of about 180,000 feet and a speed of about 10 to 15 Mach. During the transition phase which lasts only about 30 seconds, its altitude may increase to about 190,000 feet but its speed is reduced to about 9 Mach. At the beginning of this phase, the Main Engine is Cut Off (MECO) and the control is reconfigured with the help of aerosurfaces (four elevons, two flaps and two rudders) and reaction control system (RCS). The entry phase brings down the altitude of X33 to about 90,000 feet and its speed to about Mach 3. It spends about 250 seconds in this phase. Main engine is still cut off and the vehicle is controlled by complex maneuvers of aerosurfaces. The last phase TAEM lasts for about 450 seconds and the altitude and speed, both are reduced to zero. The present attempt, as a start, focuses only on the entry phase. Since the main engine remains cut off in this phase, there is no thrust acting on the system. This considerably simplifies the equations of motion. We introduce another simplification by assuming the system to be linear after some non-linearities are removed analytically from our consideration. Under these assumptions, the problem could be solved by Classical Statistics by employing the least sum of squares approach. Instead we chose to use the Neural Network method. This method has many advantages. It is modern, more efficient, can be adapted to work even when the assumptions are diluted. In fact, Neural Networks try to model the human brain and are capable of pattern recognition.

Aggarwal, Shiv↗

Adaptive Flight Control Research at NASA

A broad overview of current adaptive flight control research efforts at NASA is presented, as well as some more detailed discussion of selected specific approaches. The stated objective of the Integrated Resilient Aircraft Control Project, one of NASA s Aviation Safety programs, is to advance the state-of-the-art of adaptive controls as a design option to provide enhanced stability and maneuverability margins for safe landing in the presence of adverse conditions such as actuator or sensor failures. Under this project, a number of adaptive control approaches are being pursued, including neural networks and multiple models. Validation of all the adaptive control approaches will use not only traditional methods such as simulation, wind tunnel testing and manned flight tests, but will be augmented with recently developed capabilities in unmanned flight testing.

Motter, Mark A.↗

A New Operational Snow Retrieval Algorithm Applied to Historical AMSR-E Brightness Temperatures

Snow is a key element of the water and energy cycles and the knowledge of spatio-temporal distribution of snow depth and snow water equivalent (SWE) is fundamental for hydrological and climatological applications. SWE and snow depth estimates can be obtained from spaceborne microwave brightness temperatures at global scale and high temporal resolution (daily). In this regard, the data recorded by the Advanced Microwave Scanning Radiometer-Earth Orbiting System (EOS) (AMSR-E) onboard the National Aeronautics and Space Administration's (NASA) AQUA spacecraft have been used to generate operational estimates of SWE and snow depth, complementing estimates generated with other microwave sensors flying on other platforms. In this study, we report the results concerning the development and assessment of a new operational algorithm applied to historical AMSR-E data. The new algorithm here proposed makes use of climatological data, electromagnetic modeling and artificial neural networks for estimating snow depth as well as a spatio-temporal dynamic density scheme to convert snow depth to SWE. The outputs of the new algorithm are compared with those of the current AMSR-E operational algorithm as well as in-situ measurements and other operational snow products, specifically the Canadian Meteorological Center (CMC) and GlobSnow datasets. Our results show that the AMSR-E algorithm here proposed generally performs better than the operational one and addresses some major issues identified in the spatial distribution of snow depth fields associated with the evolution of effective grain size.

passive microwave↗

Deep Neural Network for Precision Multi-band Infrared Image Segmentation

Image segmentation is one of the fundamental steps in computer vision. Separating targets from background clutter with high precision is a challenging operation for both humans and computers. Currently, segmenting objects from IR images is done by tedious manual work. The implementation of a Deep Neural Network (DNN) to perform precision segmentation of multi-band IR video images is presented. A customized pix2pix DNN with multiple layers of generative encoder/decoder and discriminator architecture is used in the IR image segmentation process. Real and synthetic images and ground truths are employed to train the DNN. Iterative training is performed to achieve optimum accuracy of segmentation using a minimal number of training data. Special training images are created to enhance the missing features and to increase the segmentation accuracy of the objects. Retraining strategies are developed to minimize the DNN training time. Single pixel accuracy has been achieved in IR target boundary segmentation using DNNs. The segmentation accuracy between the customized pix2pix DNN and simple thresholding, GraphCut, simple neural network and ResNet models are compared.

Torres, Gil↗

Neural Network Atmospheric Correction of Remote Sensing Imagery Over Water Using a Synthetic Dataset

Remote sensing atmospheric correction methods have primarily focused on imagery over land. However, accurate correction over water is important for monitoring and research of aquatic environments. More research in this area is ongoing, though one of the biggest challenges is enough quality data to develop and validate correction methods. This is especially true for neural network (NN) -based models which have shown promise in this area given enough quality data. To address this deficiency of data, we are leveraging a synthetic dataset produced by a model called SWIPE that uses radiative transfer modeling to simulate the atmospheric effects on water-leaving (WL) reflectance to estimate top-of-atmosphere (TOA) reflectance. This allows us to produce almost unlimited pairs of WL reflectance and corresponding TOA reflectance for model training across a variety of atmospheric conditions. We use two approaches for our atmospheric correction model. One uses a conditional variational autoencoder (VAE) to estimate a single WL reflectance value from a single TOA reflectance value. The second is based on a UNET architecture and estimates an array of WL reflectance values from an array of TOA reflectance values. The goal of the second method is to capture atmospheric effects that occur spatially between values within the array as compared to the first method.

deep learning↗

Using Neural Networks to Improve the Performance of Radiative Transfer Modeling Used for Geometry Dependent Surface Lambertian-Equivalent Reflectivity Calculations

Surface Lambertian-equivalent reflectivity (LER) is important for trace gas retrievals in the direct calculation of cloud fractions and indirect calculation of the air mass factor. Current trace gas retrievals use climatological surface LER's. Surface properties that impact the bidirectional reflectance distribution function (BRDF) as well as varying satellite viewing geometry can be important for retrieval of trace gases. Geometry Dependent LER (GLER) captures these effects with its calculation of sun normalized radiances (I/F) and can be used in current LER algorithms (Vasilkov et al. 2016). Pixel by pixel radiative transfer calculations are computationally expensive for large datasets. Modern satellite missions such as the Tropospheric Monitoring Instrument (TROPOMI) produce very large datasets as they take measurements at much higher spatial and spectral resolutions. Look up table (LUT) interpolation improves the speed of radiative transfer calculations but complexity increases for non-linear functions. Neural networks perform fast calculations and can accurately predict both non-linear and linear functions with little effort.

Geometry Dependent LER (GLER) capture↗

A Closed-Loop Optimal Neural-Network Controller to Optimize Rotorcraft Aeromechanical Behaviour: Output from Two Sample Cases - Volume 2

A closed-loop optimal neural-network controller technique was developed to optimize rotorcraft aeromechanical behaviour. This technique utilities a neural-network scheme to provide a general non-linear model of the rotorcraft. A modem constrained optimisation method is used to determine and update the constants in the neural-network plant model as well as to determine the optimal control vector. Current data is read, weighted, and added to a sliding data window. When the specified maximum number of data sets allowed in the data window is exceeded, the oldest data set is and the remaining data sets are re-weighted. This procedure provides at least four additional degrees-of-freedom in addition to the size and geometry of the neural-network itself with which to optimize the overall operation of the controller. These additional degrees-of-freedom are: 1. the maximum length of the sliding data window, 2. the frequency of neural-network updates, 3. the weighting of the individual data sets within the sliding window, and 4. the maximum number of optimisation iterations used for the neural-network updates.

Leyland, Jane Anne↗

Prediction of Aerodynamic Coefficient using Genetic Algorithm Optimized Neural Network for Sparse Data

Wind tunnels use scale models to characterize aerodynamic coefficients, Wind tunnel testing can be slow and costly due to high personnel overhead and intensive power utilization. Although manual curve fitting can be done, it is highly efficient to use a neural network to define the complex relationship between variables. Numerical simulation of complex vehicles on the wide range of conditions required for flight simulation requires static and dynamic data. Static data at low Mach numbers and angles of attack may be obtained with simpler Euler codes. Static data of stalled vehicles where zones of flow separation are usually present at higher angles of attack require Navier-Stokes simulations which are costly due to the large processing time required to attain convergence. Preliminary dynamic data may be obtained with simpler methods based on correlations and vortex methods; however, accurate prediction of the dynamic coefficients requires complex and costly numerical simulations. A reliable and fast method of predicting complex aerodynamic coefficients for flight simulation I'S presented using a neural network. The training data for the neural network are derived from numerical simulations and wind-tunnel experiments. The aerodynamic coefficients are modeled as functions of the flow characteristics and the control surfaces of the vehicle. The basic coefficients of lift, drag and pitching moment are expressed as functions of angles of attack and Mach number. The modeled and training aerodynamic coefficients show good agreement. This method shows excellent potential for rapid development of aerodynamic models for flight simulation. Genetic Algorithms (GA) are used to optimize a previously built Artificial Neural Network (ANN) that reliably predicts aerodynamic coefficients. Results indicate that the GA provided an efficient method of optimizing the ANN model to predict aerodynamic coefficients. The reliability of the ANN using the GA includes prediction of aerodynamic coefficients to an accuracy of 110% . In our problem, we would like to get an optimized neural network architecture and minimum data set. This has been accomplished within 500 training cycles of a neural network. After removing training pairs (outliers), the GA has produced much better results. The neural network constructed is a feed forward neural network with a back propagation learning mechanism. The main goal has been to free the network design process from constraints of human biases, and to discover better forms of neural network architectures. The automation of the network architecture search by genetic algorithms seems to have been the best way to achieve this goal.

Rajkumar, T.↗

Modeling Deformable Linear Objects for Autonomous Robotic Outfitting of Lunar Surface Systems

This paper presents structural models of deformable linear objects (DLOs). DLOs are a subclass of deformable objects that encompasses common outfitting elements such as cables and ropes. Models are validated through hardware experiments, and integration in a robotic autonomy architecture for space environments is discussed. A persistent human presence on the lunar surface is one of the next major milestones in space exploration. This requires the development of robust extraplanetary construction technologies including structures and materials modeling and robotic systems. Previous robotic construction technology development has primarily focused on structural assembly, with significantly less focus on robotically performed outfitting tasks to instantiate subsystems providing power, data, life support, etc. These tasks involve manipulation of highly flexible elements, which are difficult to model, such as cable harnesses, ropes, and hoses. Robotic manipulation of DLOs, especially cable harnesses, is an active area of research as cable harnesses are essential for providing power and data to space assets. DLO models that can be used for robot manipulator trajectory generation are necessary for autonomous operation of lunar infrastructure. There are many proposed methods for modeling DLOs, and they primarily fall into three types: 1) discrete model-based, 2) continuum model-based, and 3) Neural Network-based. These types each have pros and cons, and the tradeoff between model accuracy and computational speed informs which type should be used. An understanding of this trade-off is imperative for real-time control of autonomous systems. High computational requirements reduce the speed of the model, making real-time control difficult, while accuracy is critical to preventing collisions. Discrete models, such as a mass-spring multibody representation, require relatively few calculations, and accuracy is directly tied to the step size of the discretization. Continuum models, such as a B-spline representation or a Cosserat rod model (a mix of continuous and discrete), are more informed of the structural properties of the cable and are much more accurate than a rigid body mass-spring model, but at significant computational cost. A Neural Network approach can provide an online solution with very few computational steps, but properly generating training data can be difficult and validation for an in-space application is not trivial. This paper explores the trade-off between different modeling approaches and compares accuracy and computational speed/complexity of the three types mentioned above. Model accuracy is evaluated using a cable in a static configuration. True cable shape is obtained using a depth camera for RGB images and point-cloud segmentation. The purpose of this experiment is to evaluate the trade-offs of different approaches to the DLO modeling problem. Understanding the tradeoffs between different cable modeling techniques paves the way for developing robotic control and planning architectures necessary for real-time manipulation of DLOs for lunar infrastructure outfitting. Real-time control is required for robotic systems to be able to actively manipulate a cable in a harsh environment where model and sensor errors compound, and environmental conditions can cause significant disturbances. Cable routing must be performed in areas with high density of objects/obstacles: through truss structures, near solar panels or mirror arrays, next to bundles of electrical equipment. Understanding the best way to plan and manipulate a cable without disrupting the environment or damaging the cable is imperative to robotic outfitting operations on the lunar surface.

Amy M Quartaro↗

Modeling of UH-60A Hub Accelerations with Neural Networks

Neural network relationships between the full-scale, flight test hub accelerations and the corresponding three N/rev pilot floor vibration components (vertical, lateral, and longitudinal) are studied. The present quantitative effort on the UH-60A Black Hawk hub accelerations considers the lateral and longitudinal vibrations. An earlier study had considered the vertical vibration. The NASA/Army UH-60A Airloads Program flight test database is used. A physics based "maneuver-effect-factor (MEF)", derived using the roll-angle and the pitch-rate, is used. Fundamentally, the lateral vibration data show high vibration levels (up to 0.3 g's) at low airspeeds (for example, during landing flares) and at high airspeeds (for example, during turns). The results show that the advance ratio and the gross weight together can predict the vertical and the longitudinal vibration. However, the advance ratio and the gross weight together cannot predict the lateral vibration. The hub accelerations and the advance ratio can be used to satisfactorily predict the vertical, lateral, and longitudinal vibration. The present study shows that neural network based representations of all three UH-60A pilot floor vibration components (vertical, lateral, and longitudinal) can be obtained using the hub accelerations along with the gross weight and the advance ratio. The hub accelerations are clearly a factor in determining the pilot vibration. The present conclusions potentially allow for the identification of neural network relationships between the experimental hub accelerations obtained from wind tunnel testing and the experimental pilot vibration data obtained from flight testing. A successful establishment of the above neural network based link between the wind tunnel hub accelerations and the flight test vibration data can increase the value of wind tunnel testing.

UH-60A AIRCRAFT↗

A system identification model for adaptive nonlinear control

A system identification model that combines generalized-spline function approximation with a nonlinear control system is described. The complete control system contains three main elements: a nonlinear-inverse-dynamic control law that depends on a comprehensive model of the plant, a state estimator whose outputs drive the control law, and a function approximation scheme that models the system dynamics. The system-identification task, which combines an extended Kalman filter with a function approximator modeled as an artificial neural network, is considered. The results of an application of the identification techniques to a nonlinear transport aircraft model are presented.

Linse, Dennis J.↗

Developing and Testing a Physics Guided Machine Learning NeuralNetwork to Predict Tonal Noise Emitted by a Propeller

Artificial neural networks offer a highly nonlinear and adaptive model for predicting complex interactions between input-output parameters. However, these networks require large datasets which often exceed practical considerations in modeling experimental results. To alleviate the dataset size requirement, a method known as physics guided machine learning has been applied to construct several neural networks for predicting propeller tonal noise in the time domain over a broad range of flight conditions. Three space-filling designs, namely, Latin-Hypercube, Sphere-Packing, and Grid-Space, were used to distribute points throughout the input parameter space encompassing nondimensional flight conditions and observer geometry. Each neural network’s performance was validated by conditions outside of the training set and compared to the Propeller Analysis System tool from the NASA Aircraft Noise Prediction Program. Compared to the Grid-Space input design, the Latin-Hypercube and the Sphere-Packing designs provided a better representation of the domain for training. Regarding the network archetype, a fully connected perceptron was found to outperform the partially connected perceptron in their ability to predict tonal noise for small datasets. The black-box nature of these neural networks was also explored to understand how the networks constructed the waveform and understand why some network designs produce better models.

Propeller noise↗

Deep Interacting Multiple Model Filtering

In this paper, a deep learning-based multiple model estimation framework is presented for the state estimation of hybrid dynamical systems from high dimensional observations such as camera images. A low dimensional vector which represents the measurement of the latent dynamical system and its corresponding variance are learned using a deep encoder neural network. An Interacting Multiple Model (IMM) filter is used to generate the latent state estimates and covariances using multiple dynamical models, which can be learned using backpropagation through time. The state estimates of the dynamical system and the corresponding covariance matrix are generated from the latent state estimates and covariance using a deep decoder neural network. The whole network is trained in an end-to-end manner using a loss function which minimizes the negative log-likelihood of the neural network parameters. Simulation results are presented using a 2D bouncing ball example and estimation error statistics are computed which demonstrates the accuracy and consistency of the estimation.

Ghananeel Rotithor↗