Search NASA⌕ Search

SEARCH · Search NASA

Results for “neural function”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Comparison of Multivariate Time Series Prediction Techniques for Emulating Noah-LSM Soil Moisture Outputs

Land surface models are crucial tools for many earth science applications including numerical weather prediction, water resource and crop monitoring, and climatological analysis. Given a set of atmospheric forcings, seasonal data, and static parameters, models like Noah-LSM solve for land surface quantities including skin temperature, sensible heat flux, and soil moisture. While these calculations are theoretically robust, they are often computationally expensive. Since artificial neural networks (ANNs) are universal function approximators, they can learn to emulate the output of a deterministic numerical model given a time series of input forcings, with the learned ANN having substantially shorter execution time. The ANN could efficiently parameterize other models, generate ensembles, and provide first-guess inputs for retrievals. As such, with the goal of developing a model that efficiently mimics the output of Noah-LSM given NLDAS2 forcings on a region covering much of the central US, we examine and compare several neural network architectures for the multi-horizon multivariate time series forecasting problem. Recent literature includes a diverse set of approaches including autoregressive architectures like LSTM and GRU, parametric and non-parametric statistical predictors (ForecastNet and MQRNN), self-attention (LSTM-attention-LSTM), and temporal convovlution (DeepTCN). We implement several of these models for the Noah-LSM prediction task, highlighting the features and challenges for each and providing practical insight on the training process.

Mitchell Dodson↗

Correlated Changes in Retinal Thickness and Visuomotor Function in Asymptomatic Plaquenil Toxicity Patients

We have previously shown that a 5-minute eye-movement test can capture a number of largely independent “oculometric” parameters of human visual/visuomotor function (Liston & Stone, 2014). This test has been successfully used to characterize mild neural impairment due to traumatic brain injury, sleep and circadian disruption, and alcohol consumption (Liston et al., 2017; Stone et al, 2019; Tyson et al, 2021). Here, we extend this approach to study patients at risk of progressive posterior-segment illness to see how oculometrics relate to standard clinical ophthalmological measures. Five female patients (<20:40 BCVA, 34-60 years old) undergoing hydroxychloroquine treatment (2-7mg/kg/day for 10-23 years for rheumatologic illness) have participated thus far. Under monocular viewing conditions in randomized order, they tracked a moving spot undergoing radial step-ramp motion in one of 90 randomized directions, at one of 5 randomized speeds, starting at random times (for details, see Stone et al, 2019). We computed nine independent oculometrics (latency, initial acceleration, steady-state gain, proportion smooth, saccadic rate, saccadic amplitude, direction noise, speed responsiveness, and speed noise). Spectral-domain optical coherence tomography (Zeiss, Dublin, CA) was used to measure the average thickness of the nine Early Treatment Diabetic Retinopathy Study macular sectors from the internal limiting membrane to the retinal pigmented epithelium. We used Pearson’s correlation between retinal thickness and our oculometrics with t-statistics to test separate one-sided hypotheses across 10 retinae. Our preliminary analysis found significant changes in several different aspects of visuomotor performance. Most notably, latency increased, initial acceleration decreased, and steady-state pursuit gain decreased as retinal thickness decreased (r2 = 0.364, 0.579, and 0.692; one-tailed P = 0.032, 0.005, and 0.001, respectively). Speed responsiveness appeared to decrease, but this effect was marginal for our current sample (r2 = 0.253, P = 0.069). Lastly, direction discrimination and saccadic behavior appeared unchanged. We conclude that oculometrics may provide sensitive measures of changes in retinal thickness. More importantly, oculometrics have the potential to detect impairment before it becomes evident with standard clinical imaging tools, while also providing insight into the behavioral implications of any resulting deficits in visual/visuomotor function.

eye movements↗

Extrapolation limitations of multilayer feedforward neural networks

The limitations of backpropagation used as a function extrapolator were investigated. Four common functions were used to investigate the network's extrapolation capability. The purpose of the experiment was to determine whether neural networks are capable of extrapolation and, if so, to determine the range for which networks can extrapolate. The authors show that neural networks cannot extrapolate and offer an explanation to support this result.

Haley, Pamela J.↗

Comparison of Prediction Modeling Methodologies for Aeroacoustic Characterization of Hovering sUAS Rotors

This work compared artificial neural network and multivariate orthogonal function modeling methodologies for the prediction and characterization of isolated hovering sUAS rotor aerodynamics and aeroacoustics. Design of Experiments was used to create input feature spaces over 9 input features: the number of rotor blades, rotor size, rotor speed, the amount of blade twist, blade taper ratio, tip chord length, collective pitch, airfoil camber, and airfoil thickness. CAMRAD~II and AARON were executed at the points defined by the input feature space to predict aerodynamic and aeroacoustic quantities. These predicted aerodynamic and aeroacoustic data were then used to generate artificial neural networks and polynomial response surface models. The two prediction model methodologies were evaluated over test data previously unseen by the models, which showed good prediction capabilities for both model types, with slightly lower prediction error for the artificial neural networks. A characterization study was performed, which showed that input features correspondent to the spanwise sectional blade lift and drag were the most significant factors to the aerodynamic thrust and power, respectively. It was also shown that the aeroacoustic quantities were highly dependent on variations in rotor speed and size, which affect the Doppler factor for tonal noise and the spanwise Reynolds number for broadband noise.

Christopher S Thurman↗

Reassessment of area postrema's role in motion sickness and conditioned taste aversion

On the basis of classical studies on the role of the area psotrema (AP) in motion-induced emesis it was generally accepted that the AP is an essential structure for the production of vomiting in response to motion. However, in more recent studies it has been demonstrated that vomiting induced by motion can still occur in animals in which the AP has been destroyed bilaterally. It was inferred from some of these more recent studies that the AP plays no role in motion-induced emesis. From the standpoint of the current understanding of central nervous system (CNS) plasticity, redundancy, remodeling, unmasking, regeneration, and recovery of function, however, it is important to realize the limitations of using ablation procedures to determine the functional role of a given neural structure in a highly integrated, adaptable central nervous system (CNS). For example, the results of our recent investigations in cat and squirrel monkey on the role of the AP in emesis and conditioned taste aversion induced by motion indicate that while AP lesions do not prevent motion-induced emesis when animals are tested 30 days or more after surgery, the lesions do change the latency to emesis. Thus, contradictory findings from lesion studies must be evaluated not only in terms of species difference, differences in lesioning techniques and extent of lesions, and in stimulus parameters, but also in terms of duration of the recovery period, during which significant recovery of function may take place. In our judgment, inadequate consideration of the foregoing factors could lead to erroneous inferences about given structure's role in the behavior of the intact, nonablated animal.

N G Daunton↗

Constrained or unconstrained? Neural-network-based equation discovery from data

Throughout many fields, practitioners often rely on differential equations to model systems. Yet, for many applications, the theoretical derivation of such equations and/or the accurate resolution of their solutions may be intractable. Instead, recently developed methods, including those based on parameter estimation, operator subset selection, and neural networks, allow for the data-driven discovery of both ordinary and partial differential equations (PDEs), on a spectrum of interpretability. The success of these strategies is often contingent upon the correct identification of representative equations from noisy observations of state variables and, as importantly and intertwined with that, the mathematical strategies utilized to enforce those equations. Specifically, the latter has been commonly addressed via unconstrained optimization strategies. Representing the PDE as a neural network, we propose to discover the PDE (or the associated operator) by solving a constrained optimization problem and using an intermediate state representation similar to a physics-informed neural network (PINN). The objective function of this constrained optimization problem promotes matching the data, while the constraints require that the discovered PDE is satisfied at a number of spatial collocation points. We present a penalty method and a widely used trust-region barrier method to solve this constrained optimization problem, and we compare these methods on numerical examples. Our results on several example problems demonstrate that the latter constrained method outperforms the penalty method, particularly for higher noise levels or fewer collocation points. This work motivates further exploration into using sophisticated constrained optimization methods in scientific machine learning, as opposed to their commonly used, penalty-method or unconstrained counterparts. For both of these methods, we solve these discovered neural network PDEs with classical methods, such as finite difference methods, as opposed to PINNs-type methods relying on automatic differentiation. Here, we briefly highlight how simultaneously fitting the data while discovering the PDE improves the robustness to noise and other small, yet crucial, implementation details.

Data-driven discovery↗

Neural Scaling Laws of Deep ReLU and Deep Operator Network: A Theoretical Study

Neural scaling laws play a pivotal role in the performance of deep neural networks and have been observed in a wide range of tasks. However, a complete theoretical framework for understanding these scaling laws remains underdeveloped. In this paper, we explore the neural scaling laws for deep operator networks, which involve learning mappings between function spaces, with a focus on the Chen and Chen style architecture. These approaches, which include the popular Deep Operator Network (DeepONet), approximate the output functions using a linear combination of learnable basis functions and coefficients that depend on the input functions. We establish a theoretical framework to quantify the neural scaling laws by analyzing its approximation and generalization errors. We articulate the relationship between the approximation and generalization errors of deep operator networks and key factors such as network model size and training data size. Moreover, we address cases where input functions exhibit low-dimensional structures, allowing us to derive tighter error bounds. These results also hold for deep ReLU networks and other similar structures. Our results offer a partial explanation of the neural scaling laws in operator learning and provide a theoretical foundation for their applications.

97 MATHEMATICS AND COMPUTING↗

Launching AI in NASA ground systems

This paper will discuss recent operational successes in implementing expert systems to support the complex functions of NASA mission control systems at the Goddard Space Flight Center, including fault detection and diagnosis for real time and engineering analysis functions in the Cosmic Background Explorer and Gamma Ray Observatory missions and automation of resource planning and scheduling functions for various missions. It will also discuss ongoing developments and prototypes that will lead to increasingly sophisticated applications of artificial intelligence. These include the use of neural networks to perform telemetry monitoring functions, the implementation of generic expert system shells that can be customized to telemetry handling functions specific to NASA control centers, the applications of AI in training and user support, the long-term potential of implementing systems based around distributed, cooperative problem solving, and the use of AI to control and assist system development activities.

Perkins, Dorothy C.↗

Unsupervised texture image segmentation by improved neural network ART2

We here propose a segmentation algorithm of texture image for a computer vision system on a space robot. An improved adaptive resonance theory (ART2) for analog input patterns is adapted to classify the image based on a set of texture image features extracted by a fast spatial gray level dependence method (SGLDM). The nonlinear thresholding functions in input layer of the neural network have been constructed by two parts: firstly, to reduce the effects of image noises on the features, a set of sigmoid functions is chosen depending on the types of the feature; secondly, to enhance the contrast of the features, we adopt fuzzy mapping functions. The cluster number in output layer can be increased by an autogrowing mechanism constantly when a new pattern happens. Experimental results and original or segmented pictures are shown, including the comparison between this approach and K-means algorithm. The system written in C language is performed on a SUN-4/330 sparc-station with an image board IT-150 and a CCD camera.

Wang, Zhiling↗

Deciphering the small-angle scattering of polydisperse hard spheres using deep learning

We introduce a deep learning approach for analyzing the scattering function of the polydisperse hard sphere system. We use a variational autoencoder-based neural network to learn the bidirectional mapping between the scattering function and the system parameters, including the volume fraction and polydispersity. Such that the trained model serves both as a generator that produces a scattering function from the system parameters and an inferrer that extracts system parameters from the scattering function. We first generate a scattering dataset by carrying out molecular dynamics simulations of the polydisperse hard spheres modeled by the truncated-shifted Lennard-Jones model, then analyze the scattering function dataset using singular value decomposition to confirm the feasibility of dimensional compression. Then, we split the dataset into training and testing sets and train our neural network on the training set only. Our generator model produces a scattering function with significantly higher accuracy compared to the traditional Percus–Yevick approximation and β correction, and the inferrer model can extract the volume fraction and polydispersity with much higher accuracy than traditional model functions.

Ding, Lijie [ORNL] (ORCID:0000000227454606)↗

SchrödingerNet: A Universal Neural Network Solver for the Schrödinger Equation

Recent advances in machine learning have facilitated numerically accurate solution of the electronic Schrödinger equation (SE) by integrating various neural network (NN)-based wave function ansatzes with variational Monte Carlo methods. Nevertheless, such NN-based methods are all based on the Born–Oppenheimer approximation (BOA) and require computationally expensive training for each nuclear configuration. In this work, we propose a novel NN architecture, SchrödingerNet, to solve the full electronic-nuclear SE by defining a loss function designed to equalize local energies across the system. This approach is based on a translationally, rotationally and permutationally symmetry-adapted total wave function ansatz that includes both nuclear and electronic coordinates. Furthermore, this strategy not only allows for an efficient and accurate generation of a continuous potential energy surface at any geometry within the well-sampled nuclear configuration space, but also incorporates non-BOA corrections, through a single training process. Comparison with benchmarks of atomic and small molecular systems demonstrates its accuracy and efficiency.

Chemical calculations↗

Finding the Pareto front for high-entropy-alloy catalysts

Finding catalysts that have both high activity and high stability presents a long-standing challenge. Since optimizing activity and stability are conflicting objectives, the best one can do is find the Pareto front that yields optimal tradeoffs between these features. On the Pareto front, there is a trade-off where a portion of catalytic activity must be sacrificed to gain further stability and vice versa . Here, we provide a method to optimize the front by designing a multi-objective genetic algorithm that combines machine learning, graph neural network calculations, and density functional calculations. The application considered is the oxygen evolution reaction catalyzed by high-entropy alloys. We find that the Pareto front generally contains alloys with diverse elements, but that enhancing stability inevitably inflicts a toll on activity. We compare the general conclusions of our work to a survey of 545 experiments.

Zhang, Chengyi [Univ. of Auckland (New Zealand)]↗

Pressure-induced structural and dielectric changes in liquid water at room temperature

Understanding the pressure-dependent dielectric properties of water is crucial for a wide range of scientific and practical applications. In this study, we employ a deep neural network trained on density functional theory data to investigate the dielectric properties of liquid water at room temperature across a pressure range of 0.1–1000 MPa. We observe a nonlinear increase in the static dielectric constant ɛ 0 with increasing pressure, a trend that is qualitatively consistent with experimental observations. This increase in ɛ 0 is primarily attributed to the increase in water density under compression, which enhances collective dipole fluctuations within the hydrogen-bonding network as well as the dielectric response. Despite the increase in ɛ 0 , our results reveal a decrease in the Kirkwood correlation factor G K with increasing pressure. Furthermore, this decrease in G K is attributed to pressure-induced structural distortions in the hydrogen-bonding network, which weaken dipolar correlations by disrupting the ideal tetrahedral arrangement of water molecules.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Model-form Error Correction using Universal Differential Equations for an Agent-Based Model of Infectious Disease

This report demonstrates universal differential equations (UDEs) as an approach to bridge the gap between ordinary differential equations (ODE) models and agent-based models (ABMs). Using UDE models as surrogates for ABMs allows us to preserve the foundational ODE that represents global disease dynamics while coupling it with a neural network model to approximate functions for the local behaviors of the ABM.

59 BASIC BIOLOGICAL SCIENCES↗

An approach to rescheduling activities based on determination of priority and disruptivity

A constraint-based scheduling system called SPIKE is being used to create long term schedules for the Hubble Space Telescope. Feedback for the spacecraft or from other ground support systems may invalidate some scheduling decisions and those activities concerned must be reconsidered. A function rescheduling priority is defined which for a given activity performs a heuristic analysis and produces a relative numerical value which is used to rank all such entities in the order that they should be rescheduled. A function disruptivity is also defined that is used to place a relative numeric value on how much a pre-existing schedule would be changed in order to reschedule an activity. Using these functions, two algorithms (a stochastic neural network approach and an exhaustive search approach) are proposed to find the best place to reschedule an activity. Prototypes were implemented and preliminary testing reveals that the exhaustive technique produces only marginally better results at much greater computational cost.

Sponsler, Jeffrey L.↗

Remote Neural Pendants In A Welding-Control System

Neural network integrated circuits enhance functionalities of both remote terminals (called "pendants") and communication links, without necessitating installation of additional wires in links. Makes possible to incorporate many features into pendant, including real-time display of critical welding parameters and other process information, capability for communication between technician at pendant and host computer or technician elsewhere in system, and switches and potentiometers through which technician at pendant exerts remote control over such critical aspects of welding process as current, voltage, rate of travel, flow of gas, starting, and stopping. Other potential manufacturing applications include control of spray coating and of curing of composite materials. Potential nonmanufacturing uses include remote control of heating, air conditioning, and lighting in electrically noisy and otherwise hostile environments.

Venable, Richard A.↗

A Rapid Aerodynamic Design Procedure Based on Artificial Neural Networks

An aerodynamic design procedure that uses neural networks to model the functional behavior of the objective function in design space has been developed. This method incorporates several improvements to an earlier method that employed a strategy called parameter-based partitioning of the design space in order to reduce the computational costs associated with design optimization. As with the earlier method, the current method uses a sequence of response surfaces to traverse the design space in search of the optimal solution. The new method yields significant reductions in computational costs by using composite response surfaces with better generalization capabilities and by exploiting synergies between the optimization method and the simulation codes used to generate the training data. These reductions in design optimization costs are demonstrated for a turbine airfoil design study where a generic shape is evolved into an optimal airfoil.

Rai, Man Mohan↗

Dynamic and kinematic strategies for head movement control

This paper describes our analysis of the complex head-neck system using a combination of experimental and modeling approaches. Dynamical analysis of head movements and EMG activation elicited by perturbation of trunk position has examined functional contributions of biomechanically and neurally generated forces in lumped systems with greatly simplified kinematics. This has revealed that visual and voluntary control of neck muscles and the dynamic and static vestibulocollic and cervicocollic reflexes preferentially govern head-neck system state in different frequency domains. It also documents redundant control, which allows the system to compensate for lesions and creates a potential for substantial variability within and between subjects. Kinematic studies have indicated the existence of reciprocal and co-contraction strategies for voluntary force generation, of a vestibulocollic strategy for stabilizing the head during body perturbations and of at least two strategies for voluntary head tracking. Each strategy appears to be executed by a specific muscle synergy that is presumably optimized to efficiently meet the demands of the task.

Non-NASA Center↗