Search NASA⌕ Search

SEARCH · Search NASA

Results for “adaptive activation function”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Deep Kronecker neural networks: A general framework for neural networks with adaptive activation functions

Here we propose a new type of neural networks, Kronecker neural networks (KNNs), that form a general framework for neural networks with adaptive activation functions. KNNs employ the Kronecker product, which provides an efficient way of constructing a very wide network while keeping the number of parameters low. Our theoretical analysis reveals that under suitable conditions, KNNs induce a faster decay of the loss than that by the feed-forward networks. This is also empirically verified through a set of computational examples. Furthermore, under certain technical assumptions, we establish global convergence of gradient descent for KNNs. As a specific case, we propose the Rowdy activation function that is designed to get rid of any saturation region by injecting sinusoidal fluctuations, which include trainable parameters. The proposed Rowdy activation function can be employed in any neural network architecture like feed-forward neural networks, Recurrent neural networks, Convolutional neural networks etc. The effectiveness of KNNs with Rowdy activation is demonstrated through various computational experiments including function approximation using feed-forward neural networks, solution inference of partial differential equations using the physics-informed neural networks, and standard deep learning benchmark problems using convolutional and fully-connected neural networks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Adaptive Interface-PINNs (AdaI-PINNs) for inverse problems: Determining material properties for heterogeneous systems

Here, we determine spatially varying discontinuous material properties using a domain-decomposition based physics-informed neural networks (PINNs) framework named the Adaptive Interface-PINNs or AdaI-PINNs (Roy et al., 2024). We propose the use of distinct neural networks for the field variables and material properties within each material, utilizing adaptive activation functions. While the neural networks across different materials share the same weights and biases, their activation functions are uniquely tailored using a hyperparameter that influences the slope of the activation function. The proposed framework is tested on several one-dimensional and two-dimensional benchmark examples, and its performance is compared with conventional PINNs and existing domain-decomposition PINNs frameworks, namely, the Multi-domain physics-informed neural network (M-PINN), and the eXtended physics-informed neural networks (XPINNs). The results demonstrate that the proposed approach can determine randomly distributed discontinuous material properties with an L 2 error of $\mathscr{O}$ (10 -3 ) for the material property and the root-mean-square error of $\mathscr{O}$ (10 -3 ) for the primary variable while the other approaches yield errors that are approximately two orders of magnitude larger (that is, $\mathscr{O}$ (10 -1 )). Moreover, the spatial distribution of material properties obtained using the proposed framework is in close agreement with the true distribution, whereas the other approaches fare much worse. Additionally, the proposed approach is approximately 40% faster than its competitors, indicating its potential as a robust alternative for solving inverse problems in heterogeneous materials.

36 MATERIALS SCIENCE↗
DOE OSTI2025

From PINNs to PIKANs: recent advances in physics-informed machine learning

Physics-Informed Neural Networks (PINNs) have emerged as a key tool in Scientific Machine Learning since their introduction in 2017, enabling the efficient solution of ordinary and partial differential equations using sparse measurements. Over the past few years, significant advancements have been made in the training and optimization of PINNs, covering aspects such as network architectures, adaptive refinement, domain decomposition, and the use of adaptive weights and activation functions. A notable recent development is the Physics-Informed Kolmogorov-Arnold Networks (PIKANS), which leverage a representation model originally proposed by Kolmogorov in 1957, offering a promising alternative to traditional PINNs. In this review, we provide a comprehensive overview of the latest advancements in PINNs, focusing on improvements in network design, feature expansion, optimization techniques, uncertainty quantification, and theoretical insights. We also survey key applications across a range of fields, including biomedicine, fluid and solid mechanics, geophysics, dynamical systems, heat transfer, chemical engineering, and beyond. Lastly, we review computational frameworks and software tools developed by both academia and industry to support PINN research and applications.

Kolmogorov-Arnold networks↗
NASA NTRS1997

Prediction of human gait parameters from temporal measures of foot-ground contact

Investigation of the influence of human physical activity on bone functional adaptation requires long-term histories of gait-related ground reaction force (GRF). Towards a simpler portable GRF measurement, we hypothesized that: 1) the reciprocal of foot-ground contact time (1/tc); or 2) the reciprocal of stride-period-normalized contact time (T/tc) predict peak vertical and horizontal GRF, loading rates, and horizontal speed during gait. GRF data were collected from 24 subjects while they walked and ran at a variety of speeds. Linear regression and ANCOVA determined the dependence of gait parameters on 1/tc and T/tc, and prediction SE. All parameters were significantly correlated to 1/tc and T/tc. The closest pooled relationship existed between peak running vertical GRF and T/tc (r2 = 0.896; SE = 3.6%) and improved with subject-specific regression (r2 = 0.970; SE = 2.2%). We conclude that temporal measures can predict force parameters of gait and may represent an alternative to direct GRF measurements for determining daily histories of habitual lower limb loading quantities necessary to quantify a bone remodeling stimulus.

NASA Center ARC↗
DOE OSTI2024

Integrating adaptive learning with post hoc model explanation and symbolic regression to build interpretable surrogate models

Abstract We develop a materials informatics workflow to build an interpretable surrogate model for micromagnetic simulations. Our goal is to predict the energy barrier of a moving isolated skyrmion in rare-earth-free $$\hbox {Mn}_4$$ Mn 4 N. Our approach integrates adaptive learning with post hoc model explanation and symbolic regression methods. We discuss an unexplored acquisition function (information condensing active learning) within the adaptive learning loop and compare it with the known standard deviation function for efficient navigation of the search space. Model-agnostic post hoc explanation techniques then uncover trends learned by the trained model, which we then leverage to constrain the expressions used for symbolic regression. Graphical abstract

Biswas, Ankita↗
NASA NTRS1973

Time and motion, experiment M151

Astronaut work performance during the preparation and execution of experiments in simulated Skylab tests was analyzed according to time and motion in order to evaluate the efficiency and consistency of performance (adaptation function) for several different types of activity over the course of the mission; to evaluate the procedures to be used by the same experiment in Skylab; to generate characteristic adaptation functions for later comparison with Skylab data; and to examine astronaut performance for any behavioral stress due to the environment. The overall results indicate that the anticipated adaptation function was obtained both for individual and for averaged data.

Kubis, J. F.↗
NASA NTRS2017

Neural Predictors of Visuomotor Adaptation Rate and Multi-Day Savings

Recent studies of sensorimotor adaptation have found that individual differences in task-based functional brain activation are associated with the rate of adaptation and savings at subsequent sessions. However, few studies to date have investigated offline neural predictors of adaptation and multi-day savings. In the present study, we explore whether individual differences in the rate of visuomotor adaptation and multi-day savings are associated with differences in resting state functional connectivity and gray matter volume. Thirty-four participants performed a manual adaptation task during two separate test sessions, on average 9 days apart. We found that resting state functional connectivity strength between sensorimotor, anterior cingulate, and temporoparietal areas of the brain was a significant predictor of adaptation rate during the early, cognitive phase of practice. In contrast, default mode network functional connectivity strength was found to predict late adaptation rate and savings on day two, which suggests that these behaviors may rely on overlapping processes. We also found that gray matter volume in temporoparietal and occipital regions was a significant predictor of early learning, whereas gray matter volume in superior posterior regions of the cerebellum was a significant predictor of late adaptation. The results from this study suggest that offline neural predictors of early adaptation facilitate the cognitive mechanisms of sensorimotor adaptation, with support from by the involvement of temporoparietal and cingulate networks. In contrast, the neural predictors of late adaptation and savings, including the default mode network and the cerebellum, likely support the storage and modification of newly acquired sensorimotor representations. These findings provide novel insights into the neural processes associated with individual differences in sensorimotor adaptation.

Cassady, Kaitlin↗
NASA NTRS2014

Physiological Observations and Omics to Develop Personalized Sensormotor Adaptability Countermeasures Using Bed Rest and Space Flight Data

Astronauts experience sensorimotor disturbances during the initial exposure to microgravity and during the re-adapation phase following a return to an earth-gravitational environment. These alterations may disrupt the ability to perform mission critical functional tasks requiring ambulation, manual control and gaze stability. Interestingly, astronauts who return from space flight show substantial differences in their abilities to readapt to a gravitational environment. The ability to predict the manner and degree to which individual astronauts would be affected would improve the effectiveness of countermeasure training programs designed to enhance sensorimotor adaptability. For such an approach to succeed, we must develop predictive measures of sensorimotor adaptability that will allow us to foresee, before actual space flight, which crewmembers are likely to experience the greatest challenges to their adaptive capacities. The goals of this project are to identify and characterize this set of predictive measures that include: 1) behavioral tests to assess sensory bias and adaptability quantified using both strategic and plastic-adaptive responses; 2) imaging to determine individual brain morphological and functional features using structural magnetic resonance imaging (MRI), diffusion tensor imaging, resting state functional connectivity MRI, and sensorimotor adaptation task-related functional brain activation; 3) genotype markers for genetic polymorphisms in Catechol-O-Methyl Transferase, Dopamine Receptor D2, Brain-derived neurotrophic factor and genetic polymorphism of alpha2-adrenergic receptor that play a role in the neural pathways underlying sensorimotor adaptation. We anticipate these predictive measures will be significantly correlated with individual differences in sensorimotor adaptability after long-duration space flight and an analog bed rest environment. We will be conducting a retrospective study leveraging data already collected from relevant ongoing/completed bed rest and space flight studies. These data will be combined with predictor metrics that will be collected prospectively - behavioral, brain imaging and genomic measures; from these returning subjects to build models for predicting post-mission (bed rest - non-astronauts or space flight - astronauts) adaptive capability as manifested in their outcome measures. Comparisons of model performance will allow us to better design and implement sensorimotor adaptability training countermeasures that are customized for each crewmember's sensory biases, adaptive capacity, brain structure and functional capacities, and genetic predispositions against decrements in post-mission adaptive capability. This ability will allow more efficient use of crew time during training and will optimize training prescriptions for astronauts to ensure expected outcomes.

Mulavara, A. P.↗
NASA NTRS2002

Effects of moderate heart failure and functional overload on rat plantaris muscle

It is thought that changes in sarco(endo)plasmic reticulum Ca(2+)-ATPase (SERCA) of skeletal muscle contribute to alterations in skeletal muscle function during congestive heart failure (CHF). It is well established that exercise training can improve muscle function. However, it is unclear whether similar adaptations will result from exercise training in a CHF patient. Therefore, the purpose of this study was to determine whether skeletal muscle during moderate CHF adapts to increased activity, utilizing the functional overload (FO) model. Significant increases in plantaris mass of the CHF-FO and sham-FO groups compared with the CHF and control (sham) groups were observed. Ca(2+) uptake rates were significantly elevated in the CHF group compared with all other groups. No differences were detected in Ca(2+) uptake rates between the CHF-FO, sham, and sham-FO groups. Increases in Ca(2+) uptake rates in moderate-CHF rats were not due to changes in SERCA isoform proportions; however, FO may have attenuated the CHF-induced increases through alterations in SERCA isoform expression. Therefore, changes in skeletal muscle Ca(2+) handling during moderate CHF may be due to alterations in regulatory mechanisms, which exercise may override, by possibly altering SERCA isoform expression.

Non-NASA Center↗
NASA NTRS2017

Behavioral, Brain Imaging and Genomic Measures to Predict Functional Outcomes Post-Bed Rest and Space Flight

Astronauts experience sensorimotor disturbances during their initial exposure to microgravity and during the re-adaptation phase following a return to an Earth-gravitational environment. These alterations may disrupt crewmembers' ability to perform mission critical functional tasks requiring ambulation, manual control and gaze stability. Interestingly, astronauts who return from spaceflight show substantial differences in their abilities to readapt to a gravitational environment. The ability to predict the manner and degree to which individual astronauts are affected will improve the effectiveness of countermeasure training programs designed to enhance sensorimotor adaptability. For such an approach to succeed, we must develop predictive measures of sensorimotor adaptability that will allow us to foresee, before actual spaceflight, which crewmembers are likely to experience greater challenges to their adaptive capacities. The goals of this project are to identify and characterize this set of predictive measures. Our approach includes: 1) behavioral tests to assess sensory bias and adaptability quantified using both strategic and plastic-adaptive responses; 2) imaging to determine individual brain morphological and functional features, using structural magnetic resonance imaging (MRI), diffusion tensor imaging, resting state functional connectivity MRI, and sensorimotor adaptation task-related functional brain activation; and 3) assessment of genetic polymorphisms in the catechol-O-methyl transferase, dopamine receptor D2, and brain-derived neurotrophic factor genes and genetic polymorphisms of alpha2-adrenergic receptors that play a role in the neural pathways underlying sensorimotor adaptation. We anticipate that these predictive measures will be significantly correlated with individual differences in sensorimotor adaptability after long-duration spaceflight and exposure to an analog bed rest environment. We will be conducting a retrospective study, leveraging data already collected from relevant ongoing or completed bed rest and spaceflight studies. This data will be combined with predictor metrics that will be collected prospectively (as described for behavioral, brain imaging and genomic measures) from these returning subjects to build models for predicting post spaceflight and bed rest adaptive capability. In this presentation we will discuss the optimized set of tests for predictive metrics to be used for evaluating post mission adaptive capability as manifested in their outcome measures. Comparisons of model performance will allow us to better design and implement sensorimotor adaptability training countermeasures against decrements in post-mission adaptive capability that are customized for each crewmember's sensory biases, adaptive ability, brain structure, brain function, and genetic predispositions. The ability to customize adaptability training will allow more efficient use of crew time during training and will optimize training prescriptions for astronauts to mitigate the deleterious effects of spaceflight.

Mulavara, A. P.↗
NASA NTRS2016

Behavioral, Brain Imaging and Genomic Measures to Predict Functional Outcomes Post - Bed Rest and Spaceflight

Astronauts experience sensorimotor disturbances during their initial exposure to microgravity and during the re-adaptation phase following a return to an Earth-gravitational environment. These alterations may disrupt crewmembers' ability to perform mission critical functional tasks requiring ambulation, manual control and gaze stability. Interestingly, astronauts who return from spaceflight show substantial differences in their abilities to readapt to a gravitational environment. The ability to predict the manner and degree to which individual astronauts would be affected would improve the effectiveness of countermeasure training programs designed to enhance sensorimotor adaptability. For such an approach to succeed, we must develop predictive measures of sensorimotor adaptability that will allow us to foresee, before actual spaceflight, which crewmembers are likely to experience the greatest challenges to their adaptive capacities. The goals of this project are to identify and characterize this set of predictive measures. Our approach includes: 1) behavioral tests to assess sensory bias and adaptability quantified using both strategic and plastic-adaptive responses; 2) imaging to determine individual brain morphological and functional features, using structural magnetic resonance imaging (MRI), diffusion tensor imaging, resting state functional connectivity MRI, and sensorimotor adaptation task-related functional brain activation; and 3) assessment of genotypic markers of genetic polymorphisms in the catechol-O-methyl transferase, dopamine receptor D2, and brain-derived neurotrophic factor genes and genetic polymorphisms of alpha2-adrenergic receptors that play a role in the neural pathways underlying sensorimotor adaptation. We anticipate that these predictive measures will be significantly correlated with individual differences in sensorimotor adaptability after long-duration spaceflight and exposure to an analog bed rest environment. We will be conducting a retrospective study, leveraging data already collected from relevant ongoing or completed bed rest and spaceflight studies. These data will be combined with predictor metrics that will be collected prospectively (as described for behavioral, brain imaging and genomic measures) from these returning subjects to build models for predicting post-mission (bed rest - non-astronauts or space flight - astronauts) adaptive capability as manifested in their outcome measures. To date we have completed a study on 15 normal subjects with all of the above measures. In this presentation we will discuss the optimized set of tests for predictive metrics to be used for evaluating post mission adaptive capability as manifested in their outcome measures. Comparisons of model performance will allow us to better design and implement sensorimotor adaptability training countermeasures against decrements in post-mission adaptive capability that are customized for each crewmember's sensory biases, adaptive capacity, brain structure and functional capacities, and genetic predispositions. The ability to customize adaptability training will allow more efficient use of crew time during training and will optimize training prescriptions for astronauts to ensure expected outcomes.

Mulavara, A. P.↗
NASA NTRS1980

Physiology of man and animals in the Tenth Five-Year Plan: Proceedings of the Thirteenth Congress of the I. P. Pavlov All-Union Physiological Society

Research in the field of animal and human physiology is reviewed. The following topics on problems of physiological science and related fields of knowledge are discussed: neurophysiology and higher nervous activity, physiology of sensory systems, physiology of visceral systems, evolutionary and ecological physiology, physiological cybernetics, computer application in physiology, information support of physiological research, history and theory of development of physiology. Also discussed were: artificial intelligence, physiological problems of reflex therapy, correlation of structure and function of the brain, adaptation and activity, microcirculation, and physiological studies in nerve and mental diseases.

Lange, K. A.↗
DOE OSTI2023

Extending Parsimonious Bayesian Inference

Parsimonious Bayesian inference is a theoretical framework for efficient data assimilation that seeks to balance increased consistency between predictions and training data against corresponding increases in model complexity. Within this framework, over-training is understood as optimization that encodes excessive information within model parameters while only achieving small improvements between predictions and training data. This project aims to develop practical methods of limiting excess model information during optimization. One key observation is that practical heuristics for parsimonious learning in high-dimensions must balance expressivity, i.e. the ability of the model to capture diverse predictions with only a few non-zero parameters, against discoverability, i.e. the ability to train the model with gradient-based optimization and drive parameters to low information states. As such, we developed logical activation functions that are able to adaptively approximate arbitrary truth tables that define Boolean logic operations within a probabilistic framework. These functions have demonstrated the ability to learn exclusive disjunction (XOR) and conditioned disjunction (if [condition] then [result_if_true] else [result_if_false]) within a single layer of a neural network. To efficiently exploit these activation functions to drive parsimonious learning required several other advances within the domain of variational inference. The most efficient form of complexity suppression is structured sparsification, driving most model parameters to zero while achieving the structural coherence among nonzeros needed for bandwidth reduction. Such models are not only far more efficient at suppressing information-theoretic complexity, they also reduce the other forms of complexity (computations, communication, storage, and the number of dependencies needed to evaluate predictions). Aiming to support enhanced sparsification, this project examined new approaches to high-dimensional variational inference that allow us to calibrate and control parameter uncertainty during optimization. By identifying which parameters can sustain sparsifying perturbations with little impact on prediction quality, we can develop better pruning strategies by framing them as approximate Bayesian inference. These advances also open paths to mitigate concerns with deploying advanced learning methods in resource-constrained environments, such as running models on power-limited or communication-limited devices.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2014

Customizing Countermeasure Prescriptions using Predictive Measures of Sensorimotor Adaptability

Astronauts experience sensorimotor disturbances during the initial exposure to microgravity and during the readapation phase following a return to a gravitational environment. These alterations may lead to disruption in the ability to perform mission critical functional tasks during and after these gravitational transitions. Astronauts show significant inter-subject variation in adaptive capability following gravitational transitions. The ability to predict the manner and degree to which each individual astronaut will be affected would improve the effectiveness of a countermeasure comprised of a training program designed to enhance sensorimotor adaptability. Due to this inherent individual variability we need to develop predictive measures of sensorimotor adaptability that will allow us to predict, before actual space flight, which crewmember will experience challenges in adaptive capacity. Thus, obtaining this information will allow us to design and implement better sensorimotor adaptability training countermeasures that will be customized for each crewmember's unique adaptive capabilities. Therefore the goals of this project are to: 1) develop a set of predictive measures capable of identifying individual differences in sensorimotor adaptability, and 2) use this information to design sensorimotor adaptability training countermeasures that are customized for each crewmember's individual sensorimotor adaptive characteristics. To achieve these goals we are currently pursuing the following specific aims: Aim 1: Determine whether behavioral metrics of individual sensory bias predict sensorimotor adaptability. For this aim, subjects perform tests that delineate individual sensory biases in tests of visual, vestibular, and proprioceptive function. Aim 2: Determine if individual capability for strategic and plastic-adaptive responses predicts sensorimotor adaptability. For this aim, each subject's strategic and plastic-adaptive motor learning abilities are assessed using a test of locomotor function designed specifically to delineate both mechanisms. Aim 3: Develop predictors of sensorimotor adaptability using brain structural and functional metrics. We will measure individual differences in regional brain volumes (structural MRI), white matter integrity (diffusion tensor imaging, or DTI), functional network integrity (resting state functional connectivity MRI), and sensorimotor adaptation task-related functional brain activation (functional MRI). We decided to complete the data collection for Specific Aims 1, 2 and 3 simultaneously on the same subjects to increase data capture. By having the same subjects perform all three specific aims we can enhance our ability to detect how a wider range of factors can predict adaptability in a specific individual. This provides a much richer database and potentially a better understanding of the predictive power of the selected factors. In this presentation I will discuss preliminary data obtained to date.

Bloomberg, J. J.↗
DOE OSTI2024

Symbiotic bacteriophages exhibit multiple adaptive strategies in activated sludge flocs and contribute to floc stability

Despite the importance of phages for the dynamics and functions of microbial communities, it remains largely unexplored how symbiotic phages adapt in activated sludge systems and influence microbial aggregate stability, which is critical for clarification and reliable performance. Here, based on 12,127 phage contigs recovered from 12 activated sludge microbiomes, the symbiotic phages exhibited broad host ranges and infected dominant prokaryotes in activated sludge. Moreover, these phage communities exhibited high lysogenicity (49% to 66% lysogenic phages) and harbored diverse auxiliary metabolic genes (AMGs) that could enhance microbial aggregate stability, such as genes coding for lipopolysaccharide, peptidoglycan, and extracellular polysaccharide biosynthesis. Additionally, prokaryotic antiviral systems were widely distributed in dominant prokaryotes, particularly the Restriction-Modification (RM) and CRISPR-Cas systems, which could mitigate potential harmful phage infections. Overall, this study reveals the contemporary beneficial relationship between phages and prokaryotic hosts in activated sludge microbiomes and the potential benefits of symbiotic phages on floc stability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1994

Skeletal muscle satellite cells

Evidence now suggests that satellite cells constitute a class of myogenic cells that differ distinctly from other embryonic myoblasts. Satellite cells arise from somites and first appear as a distinct myoblast type well before birth. Satellite cells from different muscles cannot be functionally distinguished from one another and are able to provide nuclei to all fibers without regard to phenotype. Thus, it is difficult to ascribe any significant function to establishing or stabilizing fiber type, even during regeneration. Within a muscle, satellite cells exhibit marked heterogeneity with respect to their proliferative behavior. The satellite cell population on a fiber can be partitioned into those that function as stem cells and those which are readily available for fusion. Recent studies have shown that the cells are not simply spindle shaped, but are very diverse in their morphology and have multiple branches emanating from the poles of the cells. This finding is consistent with other studies indicating that the cells have the capacity for extensive migration within, and perhaps between, muscles. Complexity of cell shape usually reflects increased cytoplasmic volume and organelles including a well developed Golgi, and is usually associated with growing postnatal muscle or muscles undergoing some form of induced adaptive change or repair. The appearance of activated satellite cells suggests some function of the cells in the adaptive process through elaboration and secretion of a product. Significant advances have been made in determining the potential secretion products that satellite cells make. The manner in which satellite cell proliferative and fusion behavior is controlled has also been studied. There seems to be little doubt that cellcell coupling is not how satellite cells and myofibers communicate. Rather satellite cell regulation is through a number of potential growth factors that arise from a number of sources. Critical to the understanding of this form of control is to determine which of the many growth factors that can alter satellite cell behavior in vitro are at work in vivo. Little work has been done to determine what controls are at work after a regeneration response has been initiated. It seems likely that, after injury, growth factors are liberated through proteolytic activity and initiate an activation process whereby cells enter into a proliferative phase. After myofibers are formed, it also seems likely that satellite cell behavior is regulated through diffusible factors arising from the fibers rather than continuous control by circulating factors.(ABSTRACT TRUNCATED AT 400 WORDS).

NASA Program Space Biology↗