Application of Recurrent Neural Network to Modeling Earth's Global Electron Density
Explore the source record for details and available documents.
Sheng Huang↗
SEARCH · Search NASA
Results for “Neural network models”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Establishing Digital Twins for Non-Proliferation of Secure Facilities under Low Data Availability with Agent-Based Modeling, Deep Neural Network Surrogates, and Virtual Reality
Explore the source record for details and available documents.
Gunaratne, Chathika [ORNL] (ORCID:0000000225088745↗
A Statistician’s Overview of Physics-Informed Neural Networks for Spatio-Temporal Data
The recent success of deep neural network models with physical constraints (so-called, Physics-Informed Neural Networks, PINNs) has led to renewed interest in the incorporation of mechanistic information in predictive models. Statisticians and others have long been interested in this problem, which has led to several practical and innovative solutions dating back decades. In this overview, we focus on the problem of data-driven prediction and inference of dynamic spatio-temporal processes that include mechanistic information, such as would be available from partial differential equations, with a strong focus on the quantification of uncertainty associated with data, process, and parameters. Here, we give a brief review of several paradigms and focus our attention on Bayesian implementations given they naturally accommodate uncertainty quantification. We then show that it is straight-forward to include the Bayesian PINN (B-PINN) within the Bayesian hierarchical model (BHM) framework that has long been considered for modeling dynamic spatio-temporal processes. Such a BHM-PINN is illustrated via a simulation study in which a latent nonlinear Burgers’ equation PDE governs the dynamics of Poisson distributed spatio-temporal data. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.
Bayesian↗
Satellite image analysis using neural networks
The tremendous backlog of unanalyzed satellite data necessitates the development of improved methods for data cataloging and analysis. Ford Aerospace has developed an image analysis system, SIANN (Satellite Image Analysis using Neural Networks) that integrates the technologies necessary to satisfy NASA's science data analysis requirements for the next generation of satellites. SIANN will enable scientists to train a neural network to recognize image data containing scenes of interest and then rapidly search data archives for all such images. The approach combines conventional image processing technology with recent advances in neural networks to provide improved classification capabilities. SIANN allows users to proceed through a four step process of image classification: filtering and enhancement, creation of neural network training data via application of feature extraction algorithms, configuring and training a neural network model, and classification of images by application of the trained neural network. A prototype experimentation testbed was completed and applied to climatological data.
Sheldon, Roger A.↗
Neural Network and Regression Approximations Used in Aircraft Design
NASA Lewis Research Center's CometBoards Test Bed was used to create regression and neural network models for a High-Speed Civil Transport (HSCT) aircraft. Both approximation models that replaced the actual analysis tool predicted the aircraft response in a trivial computational effort. The models allow engineers to quickly study the effects of design variables on constraint and objective values for a given aircraft configuration. For example, an engineer can change the engine size by 1000 pounds of thrust and quickly see how this change affects all the output values without rerunning the entire simulation. In addition, an engineer can change a constraint and use the approximation models to quickly reoptimize the configuration. Generating the neural network and the regression models is a time-consuming process, but this exercise has to be carried out only once. Furthermore, an automated process can reduce calculations substantially.
Patnaik, Surya N.↗
Neural network based decomposition in optimal structural synthesis
The present paper describes potential applications of neural networks in the multilevel decomposition based optimal design of structural systems. The generic structural optimization problem of interest, if handled as a single problem, results in a large dimensionality problem. Decomposition strategies allow for this problem to be represented by a set of smaller, decoupled problems, for which solutions may either be obtained with greater ease or may be obtained in parallel. Neural network models derived through supervised training, are used in two distinct modes in this work. The first uses neural networks to make available efficient analysis models for use in repetitive function evaluations as required by the optimization algorithm. In the second mode, neural networks are used to represent the coupling that exists between the decomposed subproblems. The approach is illustrated by application to the multilevel decomposition-based synthesis of representative truss and frame structures.
Hajela, P.↗
Physics-Informed Recurrent Neural Networks to Predict Reactor Operations of the AGN-201 Nuclear Reactor
4 page paper submitted to ANS Student conference. Summary of paper similar to the following abstract: The ability to predict how a reactor will operate, understand when anomalous conditions arise, and ensure a reactor is being operated as expected is crucial for deploying new nuclear facilities. Digital twins serve as a unique solution to recognizing reactor behavior; however, they require data to be useful. For next-generation reactors, this data may not currently be available. To explore how synthetic physics-informed reactor data can be used to predict reactor operations, a recurrent neural network was implemented for the Idaho State University AGN-201 digital twin. The goal of this work is to determine how synthetic data can be used to train a recurrent neural network model for predicting the reactor power of the AGN-201. The recurrent neural network was validated using both synthetic and real operational data. We envision this approach will help bridge the gap between the virtual and physical sides of a digital twin, where reactor physics models based on as-built data can be corrected for actual operating parameters to ensure the virtual model mirrors reality.
98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
Convolutional Neural Network for Transition Modeling Based on Linear Stability Theory
Transition prediction is an important aspect of aerodynamic design because of its impact on skin friction and potential coupling with flow separation characteristics. Traditionally, the modeling of transition has relied on correlation-based empirical formulas based on integral quantities such as the shape factor of the boundary layer. However, in many applications of computational fluid dynamics, the shape factor is not straightforwardly available or not well-defined. We propose using the complete velocity profile along with other quantities (e.g., frequency, Reynolds number) to predict the perturbation amplification factor. While this can be achieved with regression models based on a classical fully connected neural network, such a model can be computationally more demanding. We propose a novel convolutional neural network inspired by the underlying physics as described by the stability equations. Specifically, convolutional layers are first used to extract integral quantities from the velocity profiles, and then fully connected layers are used to map the extracted integral quantities, along with frequency and Reynolds number, to the output (amplification ratio). Numerical tests on classical boundary layers clearly demonstrate the merits of the proposed method. More importantly, we demonstrate that, for Tollmien-Schlichting instabilities in two-dimensional, low-speed boundary layers, the proposed network encodes information in the boundary layer profiles into an integral quantity that is strongly correlated to a well-known, physically defined parameter – the shape factor.
Laminar-turbulent transition↗
A Natural Language Understanding Approach for Digitizing Aircraft Ground Taxi Instructions
Recent Advancements in spoken language processing technologies have enabled the development of reliable automation tools to assist air traffic control (ATC) operations. These advancements present a unique opportunity to strategically implement digital taxi instructions for aircraft movement on the ground. Digital taxi instructions issue taxiing procedures to pilots as textual or graphical instructions. There are several benefits of digital instructions, including a reduction in radio congestion, elimination of communication errors, and improved aircraft monitoring capabilities. Natural language understanding (NLU) models can extract digital taxi instructions from verbal instructions issued by air traffic controllers. This capability enables the implementation of a digital taxi communication framework with minimal changes to the existing air traffic controller operational environment. We explore a novel application for NLU: automatically generating digital taxi instructions from air traffic controller speech. We describe the development of an annotation scheme to represent (aircraft) ground traffic communications in the US National Airspace System (NAS).Our annotation scheme uses intent classification and slot filling to extract taxi instructions, enabling NLU models to leverage syntactic information. Several neural network models were trained to categorize the controller’s intent and label information relevant to his or her intent.Our research demonstrates that it is feasible to use NLU to automatically generate digitaltaxi instructions, suggesting that it is a powerful tool for the implementation of digital taxi communications.
Hillel Steinmetz↗
Modeling of photosynthesis in soybean crops using
We have developed an artificial neural network model to characterize the photosynthesis process of soybean crops under various environmental conditions.
modeling↗
DRDMannTurb: A Python package for scalable, data-driven synthetic turbulence
Synthetic turbulence models (STMs) are used in wind engineering to generate realistic flow fields and are employed as inputs to industrial wind simulations. Examples include prescribing inlet conditions in large eddy simulations that model loads on wind turbines and tall buildings. We are interested in STMs capable of generating fluctuations based on prescribed second-moment statistics since such models can simulate environmental conditions that closely resemble on-site observations. To this end, the widely used Mann model (see Mann, 1994, 1998) is the inspiration for DRDMannTurb. The Mann model is described by three physical parameters: a magnitude parameter influencing the global variance of the wind field and corresponding to the Kolmogorov constant multiplied by the rate of viscous dissipation of the turbulent kinetic energy to the two-thirds, αϵ 2/3 , a turbulence length scale parameter L, and a nondimensional parameter Γ related to the lifetime of the eddies. A number of studies, as well as international standards (e.g., those by the International Electrotechnical Commission (IEC)), include recommended values for these three parameters with the goal of standardizing wind simulations according to observed energy spectra. Yet, having only three parameters, the Mann model faces limitations in accurately representing the diversity of observable spectra. This Python package enables users to extend the Mann model and more accurately fit field measurements through flexible neural network models of the eddy lifetime function. Following Keith et al. (2021), we refer to this class of models as Deep Rapid Distortion (DRD) models. DRDMannTurb also includes a general module implementing an efficient method for synthetic turbulence generation based on a domain decomposition technique. This technique is also described in Keith et al. (2021).
17 WIND ENERGY↗
Aeroacoustic Characterization of Optimum Hovering Rotors using Artificial Neural Networks
This work illustrates the use of artificial neural network modeling in the aerodynamic and aeroacoustic characterization of optimum hovering rotors over a broad range of design and operating conditions. Design of Experiments was used to create input feature spaces over eight input factors: the number of rotor blades, rotor radius, rotor rotation rate, design thrust condition, collective pitch, airfoil camber, the location of maximum camber, and the airfoil thickness. A low-fidelity tool chain was then used at the discrete data points defined by the designed input feature spaces to analytically design optimum hovering rotors and simulate aerodynamic and aeroacoustic quantities. This allowed for the generation of data sets over which to train and test the artificial neural network prediction models. Prediction models were trained over the data sets for the actual thrust generated by the rotor, power loading, tonal thickness and loading noise at the fundamental blade passage frequency, and broadband self-noise at seventeen one-third octave bands between 1 kHz and 40 kHz. These prediction models were validated by testing over data previously unseen by the models to quantify their capability for generalization to new data within the design feature space. The models were then used to study the effect each input feature had on the aeroacoustics and aerodynamics of optimum hovering rotors and physical insights were concluded to further explain the effect of each input. This characterization study showed that tonal noise and power loading were most sensitive to the number of rotor blades and the rotor rotation rate and that broadband noise was most sensitive to collective pitch and the design thrust condition.
Christopher S Thurman↗
Inverse model based error detection in beamline optics
Optics tuning in transfer lines and LINACs can be challenging due to the fact that multiple combinations of machine settings can lead to the same diagnostic output. Moreover, the lack of a periodic solution can limit the ability to infer optics in the same way as rings from BPM signals. Model based approaches are often used to assist with the optics tuning in combination with optimization or parameter estimation. Here we have developed a novel approach using machine learning inverse models trained on a known configuration to detect variations in quadrupole settings without explicitly including them in the model. This paper shows a comparison of neural network models and linear models on both a simulation based study and experimental studies conducted at the AGS to RHIC transfer line at Brookhaven National Lab.
43 PARTICLE ACCELERATORS↗
A Data-Driven Framework for Predicting the Sorting and Screening Performance of an Integrated Biomass Feedstock Preprocessing System
The characteristics of mechanically sorted and screened lignocellulosic biomass, such as the mass contents of corn stover anatomical fractions (leaves, husks, stalks, cobs, etc.), can be used to calculate the intermediate feedstock quality attributes “yield” and “purity” that indicate the conversion efficiency of biocrude. No prior study has investigated the correlations from the characteristics of raw biomass and preprocessing unit operation parameters to those intermediate feedstock quality attributes. This work presents a data-driven framework for assessing and predicting the intermediate feedstock quality attributes in an integrated biomass feedstock preprocessing system. Our study used corn stover as a typical type of herbaceous biomass because of its abundance in the U.S. It began with data acquisition of moisture content, particle size distribution, and anatomical fractions of the materials after each unit operation in the system. The objective of this preprocessing system is to minimize husks and leaves and maximizing cobs and stalks by mechanically separating the materials into three streams via disc screen and air separator. Prototype neural network models were then developed to evaluate the feasibility of predicting process outcomes based on measurable parameters. It is found that incorporating physical constraints into these prediction models significantly enhances the accuracy of the predicted yield and purity against the ground truth data. The experimental data and model predictions indicate that decreasing throughput increases purity, while higher throughput results in lower purity. Finally, an optimization problem was introduced to search optimal combinations of feed material properties and preprocessing unit operation parameters, as the intermediate feedstock quality attributes – yield and purity, appeared to be competing factors. The study also suggests the continual need to improve the data-driven framework’s predictability by incorporating more accurate physical models to describe the dynamics in the preprocessing units such as the air separator.
09 - BIOMASS FUELS↗
Estuarine Dissolved Organic Carbon Flux From Space: With Application to Chesapeake and Delaware Bays
This study uses a neural network model trained with in situ data, combined with satellite data and hydrodynamic model products, to compute the daily estuarine export of dissolved organic carbon (DOC) at the mouths of Chesapeake Bay (CB) and Delaware Bay (DB) from 2007 to 2011. Both bays show large flux variability with highest fluxes in spring and lowest in fall as well as interannual flux variability (0.18 and 0.27 Tg C/year in 2008 and 2010 for CB; 0.04 and 0.09 Tg C/year in 2008 and 2011 for DB). Based on previous estimates of total organic carbon (TOCexp) exported by all Mid-Atlantic Bight estuaries (1.2 Tg C/year), the DOC export (CB + DB) of 0.3 Tg C/year estimated here corresponds to 25% of the TOCexp. Spatial and temporal covariations of velocity and DOC concentration provide contributions to the flux, with larger spatial influence. Differences in the discharge of fresh water into the bays (74 billion cu. m/year for CB and 21 billion cu. m/year for DB) and their geomorphologies are major drivers of the differences in DOC fluxes for these two systems. Terrestrial DOC inputs are similar to the export of DOC at the bay mouths at annual and longer time scales but diverge significantly at shorter time scales (days to months). Future efforts will expand to the Mid-Atlantic Bight and Gulf of Maine, and its major rivers and estuaries, in combination with coupled terrestrial-estuarine-ocean biogeochemical models that include effects of climate change, such as warming and CO2 increase.
Estuarine DOC export↗
Acoustic-based monitoring and machine learning of component status for microreactor applications
This report provides a description and assessment of recent efforts to couple acoustic-based experimental measurements and characterization with machine learning models in order to enhance structural health monitoring capabilities for nuclear microreactors. With resilient embedded sensors in development by others supported by programs funded by the US Department of Energy’s Office of Nuclear Energy, the work described herein builds upon ongoing efforts to improve non-destructive testing technology that relates measured acoustic signatures to component stresses and/or structural defects, using a combination of new experimental measurements and machine learning architectures. The experimental procedure remained similar to that developed for the previous year’s demonstration of damage detection by the authors, with the same damaged sample tested under similar applied stress conditions. Notably, a new mounting fixture was designed and implemented to improve measurement consistency and a more sophisticated laser Doppler vibrometer was employed to make high-fidelity vibration measurements. Two nominally identical sets of training data were collected for each experimental setup to better understand the repeatability of the experiment and to better test the generality of trained neural network models. Additionally, we obtained new high-quality 3D mode shapes of the damaged test article at various stress and excitation levels, providing greater insights into the physical response of the sample during testing. Previously, we demonstrated that a machine learning model based on a convolutional neural network can predict structural details of an artificially introduced interface (intact, rough cut, smooth cut), and the applied torque level. In this study, we have transitioned to graph-based neural network architectures to better develop and test a flexible framework that is more suitable to being transferred away from controlled benchtop experiments and into more applied settings where less-structured data inputs may be expected. In general, performance testing of a graph neural network on frequency-domain representations of the data indicates strong and consistent identification of test conditions for datasets recorded on damaged components. With goals of predicting damage location and other changing experimental conditions using limited datasets, predictive models using a graph neural network architecture correctly predicted the applied torque level with an accuracy of 85% using only a single measurement point and predicted within one torque level in 95% of test windows. Predictions of damage location had limited success due to the symmetry and minimal number of the damage scenarios presented during model training. Results were ambiguous as to whether the model could detect the location of the artificial damage, or if it was instead learning the location of a given measurement point on the part and subsequently detecting which points were closest to the location of the damage. This finding will be factored into upcoming planned work on damaged graphite components, where new experimental tests with a larger number and variety of damage scenarios are expected to provide improved validation of recent developments in monitoring methodology.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
“Understanding Robustness Lottery”: A Geometric Visual Comparative Analysis of Neural Network Pruning Approaches
Deep learning approaches have provided state-of-the-art performance in many applications by relying on large and overparameterized neural networks. However, such networks are very brittle and are difficult to deploy on resource-limited platforms. Model pruning, i.e., reducing the size of the network, is a widely adopted strategy that can lead to a more robust and compact model. Many heuristics exist for model pruning, but our understanding of the pruning process remains limited due to the black-box nature of a neural network model. Empirical studies show that some heuristics improve performance whereas others can make models more brittle. Here, this work aims to shed light on how different pruning methods alter the network’s internal feature representation and the corresponding impact on model performance. To facilitate a comprehensive comparison and characterization of the high-dimensional model feature space, we introduce a visual geometric analysis of feature representations. We evaluated a set of critical geometric concepts decomposed from the commonly adopted classification loss and used them to design a visualization system to compare and highlight the impact of pruning on model performance and feature representation. The proposed tool provides an environment for an in-depth comparison of pruning methods and a comprehensive understanding of how the model responds to common data corruption. By leveraging the proposed visualization, machine learning researchers can reveal the similarities between pruning methods and redundancy in robustness evaluation benchmarks, obtain geometric insights about the differences between pruned models that achieve superior robustness performance, and identify samples that are robust or fragile to model pruning and common data corruption.
Li, Zhimin [Univ. of Utah, Salt Lake City, UT (Uni↗
Neurodynamic oscillators
Oscillation of electrical activity has been found in many nervous systems, from invertebrates to vertebrates including man. There exists experimental evidence of very simple circuits with the capability of oscillation. Neurons with intrinsic oscillation have been found and also neural circuits where oscillation is a property of the network. These two types of oscillations coexist in many instances. It is nowadays hypothesized that behind synchronization and oscillation there is a system of coupled oscillators responsible for activities that range from locomotion and feature binding in vision to control of sleep and circadian rhythms. The huge knowledge that has been acquired on oscillators from the times of Lord Rayleigh has made the simulation of neural oscillators a very active endeavor. This has been enhanced with more recent physiological findings about small neural circuits by means of intracellular and extracellular recordings as well as imaging methods. The future of this interdisciplinary field looks very promising; some researchers are going into quantum mechanics with the idea of trying to provide a quantum description of the brain. In this work we describe some simulations using neuron models by means of which we form simple neural networks that have the capability of oscillation. We analyze the oscillatory activity with root locus method, cross-correlation histograms, and phase planes. In the more complicated neural network models there is the possibility of chaotic oscillatory activity and we study that by means of Lyapunov exponents. The companion paper shows an example of that kind.
Espinosa, Ismael↗