Search NASA⌕ Search

SEARCH · Search NASA

Results for “long memory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Learning the Temporal Effect in Infrared Thermal Videos With Long Short-Term Memory for Quality Prediction in Resistance Spot Welding

With the advances of sensing technology, in-situ infrared thermal videos can be collected from Resistance Spot Welding (RSW) processes. Each video records the formulation process of a weld nugget. The nugget evolution creates a “temporal effect” across the frames, which can be leveraged for real-time, nondestructive evaluation (NDE) of the weld quality. Currently, quality prediction with imaging data mainly focuses on optical feature extraction with Convolutional Neural Network (CNN) but does not make the most of such temporal effect. In this study, pixels corresponding to critical locations on the weld nugget surface are extracted from a video to form multivariate time series (MTS). Multivariate Adaptive Regression Splines (MARS) is used in MTS processing to remove noisy signals related to uninformative frames. A Stacked Long Short-Term Memory (LSTM) model is developed to learn from the processed MTS and then predicts weld nugget size and thickness in real-time NDE. Results from a case study on RSW of Boron steel demonstrates the improvement in prediction accuracy and computational time with the proposed method, as compared to CNN-based weld quality prediction.

Guo, Shenghan↗

Transformers and Long Short-Term Memory Transfer Learning for GenIV Reactor Temperature Time Series Forecasting

Automated monitoring of the coolant temperature can enable autonomous operation of generation IV reactors (GenIV), thus reducing their operating and maintenance costs. Automation can be accomplished with machine learning (ML) models trained on historical sensor data. However, the performance of ML usually depends on the availability of large amount of training data, which is difficult to obtain for GenIV, as this technology is still under development. We propose the use of transfer learning (TL), which involves utilizing knowledge across different domains, to compensate for this lack of training data. TL can be used to create pre-trained ML models with data from small-scale research facilities, which can then be fine-tuned to monitor GenIV reactors. In this work, we develop pre-trained Transformer and long short-term memory (LSTM) networks by training them on temperature measurements from thermal hydraulic flow loops operating with water and Galinstan fluids at room temperature at Argonne National Laboratory. The pre-trained models are then fine-tuned and re-trained with minimal additional data to perform predictions of the time series of high temperature measurements obtained from the Engineering Test Unit (ETU) at Kairos Power. The performance of the LSTM and Transformer networks is investigated by varying the size of the lookback window and forecast horizon. The results of this study show that LSTM networks have lower prediction errors than Transformers, but LSTM errors increase more rapidly with increasing lookback window size and forecast horizon compared to the Transformer errors.

LSTM↗

Dynamic Non-Hierarchical File Systems for Exascale Storage

This constitutes the final report for “Dynamic Non-Hierarchical File Systems for Exascale Storage”. The ultimate goal of this project was to improve data management in scientific computing and high-end computing (HEC) applications, and to achieve this goal we proposed: to develop the first, HEC-targeted, file system featuring rich metadata and provenance collection, extreme scalability, and future storage hardware integration as core design goals, and to evaluate and develop a flexible non-hierarchical file system interface suitable for providing more powerful and intuitive data management interfaces to HEC and scientific computing users. Data management is swiftly becoming a serious problem in the scientific community – while copious amounts of data are good for obtaining results, finding the right data is often daunting and sometimes impossible. Scientists participating in a Department of Energy workshop noted that most of their time was spent “...finding, processing, organizing, and moving data and it’s going to get much worse”. Scientists should not be forced to become data mining experts in order to retrieve the data they want, nor should they be expected to remember the naming convention they used several years ago for a set of experiments they now wish to revisit. Ideally, locating the data you need would be as easy as browsing the web. Unfortunately, existing data management approaches are usually based on hierarchical naming, a 40 year-old technology designed to manage thousands of files, not exabytes of data. Today’s systems do not take advantage of the rich array of metadata that current high-end computing (HEC) file systems can gather, including content-based metadata and provenance1 information. As a result, current metadata search approaches are typically ad hoc and often work by providing a parallel management system to the “main” file system, as is done in Linux (the locate utility), personal computers, and enterprise search appliances. These search applications are often optimized for a single file system, making it difficult to move files and their metadata between file systems. Users have tried to solve this problem in several ways, including the use of separate databases to index file properties, the encoding of file properties into file names, and separately gathering and managing provenance data, but none of these approaches has worked well, either due to limited usefulness or scalability, or both. Our research addressed several key issues: High-performance, real-time metadata harvesting: extracting important attributes from files dynamically and immediately updating indexes used to improve search; Transparent, automatic, and secure provenance capture: recording the data inputs and processing steps used in the production of each file in the system; Scalable indexing: indexes that are optimized for integration with the file system; Dynamic file system structure: our approach provides dynamic directories similar to those in semantic file systems, but these are the native organization rather than a feature grafted onto a conventional system. In addition to these goals, our research effort will include evaluating the impact of new storage technologies on the file system design and performance. In particular, the indexing and metadata harvesting functions can potentially benefit from the performance improvements promised by new storage class memories.

42 ENGINEERING↗

Method for training honeybees to respond to olfactory stimuli and enhancement of memory retention therein

A specialized conditioning protocol for honeybees that is designed for use within a complex agricultural ecosystem. This method ensures that the conditioned bees will be less likely to exhibit a conditioned response to uninfected plants, a false positive response that would render such a biological sensor unreliable for agricultural decision support. Also described is a superboosting training regime that allows training without the aid of expensive equipment and protocols for training in out in the field. Also described is a memory enhancing cocktail that aids in long term memory retention of a vapor signature. This allows the bees to be used in the field for longer durations and with fewer bees trained overall.

59 BASIC BIOLOGICAL SCIENCES↗

Selective consolidation of learning and memory via recall-gated plasticity

In a variety of species and behavioral contexts, learning and memory formation recruits two neural systems, with initial plasticity in one system being consolidated into the other over time. Moreover, consolidation is known to be selective; that is, some experiences are more likely to be consolidated into long-term memory than others. Here, we propose and analyze a model that captures common computational principles underlying such phenomena. The key component of this model is a mechanism by which a long-term learning and memory system prioritizes the storage of synaptic changes that are consistent with prior updates to the short-term system. This mechanism, which we refer to as recall-gated consolidation, has the effect of shielding long-term memory from spurious synaptic changes, enabling it to focus on reliable signals in the environment. We describe neural circuit implementations of this model for different types of learning problems, including supervised learning, reinforcement learning, and autoassociative memory storage. These implementations involve synaptic plasticity rules modulated by factors such as prediction accuracy, decision confidence, or familiarity. We then develop an analytical theory of the learning and memory performance of the model, in comparison to alternatives relying only on synapse-local consolidation mechanisms. We find that recall-gated consolidation provides significant advantages, substantially amplifying the signal-to-noise ratio with which memories can be stored in noisy environments. We show that recall-gated consolidation gives rise to a number of phenomena that are present in behavioral learning paradigms, including spaced learning effects, task-dependent rates of consolidation, and differing neural representations in short- and long-term pathways.

59 BASIC BIOLOGICAL SCIENCES↗

Selective consolidation of learning and memory via recall-gated plasticity

In a variety of species and behavioral contexts, learning and memory formation recruits two neural systems, with initial plasticity in one system being consolidated into the other over time. Moreover, consolidation is known to be selective; that is, some experiences are more likely to be consolidated into long-term memory than others. Here, we propose and analyze a model that captures common computational principles underlying such phenomena. The key component of this model is a mechanism by which a long-term learning and memory system prioritizes the storage of synaptic changes that are consistent with prior updates to the short-term system. This mechanism, which we refer to as recall-gated consolidation, has the effect of shielding long-term memory from spurious synaptic changes, enabling it to focus on reliable signals in the environment. We describe neural circuit implementations of this model for different types of learning problems, including supervised learning, reinforcement learning, and autoassociative memory storage. These implementations involve synaptic plasticity rules modulated by factors such as prediction accuracy, decision confidence, or familiarity. We then develop an analytical theory of the learning and memory performance of the model, in comparison to alternatives relying only on synapse-local consolidation mechanisms. We find that recall-gated consolidation provides significant advantages, substantially amplifying the signal-to-noise ratio with which memories can be stored in noisy environments. We show that recall-gated consolidation gives rise to a number of phenomena that are present in behavioral learning paradigms, including spaced learning effects, task-dependent rates of consolidation, and differing neural representations in short- and long-term pathways.

Lindsey, Jack W. (ORCID:0000000309307327)↗

Later Life Changes in Hippocampal Neurogenesis and Behavioral Functions After Low-Dose Prenatal Irradiation at Early Organogenesis Stage

Purpose: To investigate long-term changes in behavioral functions of mice after exposure to low-dose prenatal radiation at an early organogenesis stage. Methods and Materials: Pregnant C57BL/6J mice were irradiated (20 cGy) at postcoitus day 5.5. The male and female offspring were subjected to different behavioral assays for affective, motor, and cognitive functions at 3, 6, and 12 months of age. Behavioral functions were further correlated with the population of CA1 and CA3 pyramidal neurons and immature neurons in hippocampal dentate gyrus. Results: Prenatally exposed mice of different age groups showed a sex-specific pattern of sustained changes in behavioral functions. Male mice showed significant changes in anxiety-like phenotypes, learning, and long-term memory at age 3 months. At 6 months of age such behavioral functions were recovered to a normal level but could not be sustained at age 12 months. Female mice showed an appreciable recovery in almost all behavioral functions at 12 months. Patterns of change in learning and long-term memory were comparable to the population of CA1 and CA3 pyramidal neurons and doublecortin-positive neurons in hippocampus. Conclusion: Our finding suggests that prenatal (early organogenesis stage) irradiation even at a lower dose level (20 cGy) is sufficient to cause potential changes in neurobehavioral function at later stages of life. Male mice showed relatively higher vulnerability to radiation-induced neurobehavioral changes as compared with female.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Chimeric SV40 virus-like particles induce specific cytotoxicity and protective immunity against influenza A virus without the need of adjuvants

Virus-like particles (VLPs) are a promising vaccine platform due to the safety and efficiency. However, it is still unclear whether polyomavirus-based VLPs are useful for this purpose. Here, we attempted to evaluate the potential of polyomavirus VLPs for the antiviral vaccine using simian virus 40 (SV40). We constructed chimeric SV40-VLPs carrying an HLA-A{sup ⁎}02:01-restricted, cytotoxic T lymphocyte (CTL) epitope derived from influenza A virus. HLA-A{sup ⁎}02:01-transgenic mice were then immunized with the chimeric SV40-VLPs. The chimeric SV40-VLPs effectively induced influenza-specific CTLs and heterosubtypic protection against influenza A viruses without the need of adjuvants. Because DNase I treatment of the chimeric SV40-VLPs did not disrupt CTL induction, the intrinsic adjuvant property may not result from DNA contaminants in the VLP preparation. In addition, immunization with the chimeric SV40-VLPs generated long-lasting memory CTLs. We here propose that the chimeric SV40-VLPs harboring an epitope may be a promising CTL-based vaccine platform with self-adjuvant properties. - Highlights: • We constructed chimeric SV40-VLPs carrying an influenza virus-derived CTL epitope. • Chimeric SV40-VLPs induce influenza-specific CTLs in mice without adjuvants. • Chimeric SV40-VLPs induce heterosubtypic protection against influenza A viruses. • Chimeric SV40-VLPs induce long-lasting memory CTLs. • Chimeric SV40-VLPs is a promising vaccine platform with self-adjuvant properties.

60 APPLIED LIFE SCIENCES↗

Multivariable degradation modeling and life prediction using multivariate fractional Brownian motion

In system prognostics and health management, multivariable degradation models have been widely developed to predict the life of complex systems using degradation data of multiple Performance Characteristics (PCs). Recent studies have detected a Long-Term Memory (LTM) effect among the degradation process of various PCs, implying a strong coupling phenomenon between the future degradation behavior and historical degradation trajectory. Although the LTM has been widely integrated into single-PC-based degradation modeling, it has not been considered in multi-PC-based scenarios. To capture LTM among multiple PCs, this article proposes a novel LTM-integrated Multivariate Degradation Model (MDM) for system life prediction based on multivariate fractional Brownian motion, which simultaneously incorporates the cross-correlation among different PCs. To estimate parameters of the LTM-integrated MDM, a maximum likelihood method is developed. Here, two likelihood-ratio hypothesis tests are developed to test the existence of the overall and individual LTM effect among multiple PCs. Both simulation studies and physical experiments on the performance degradation of solar energy conversion and storage devices are conducted to validate the proposed model. Results reveal that the proposed LTM-integrated MDM significantly outperforms existing MDMs in life prediction, while the lifetime uncertainty is heavily underestimated by those traditional approaches that neglect the LTM.

42 ENGINEERING↗

GAMMA-RAY LIGHT CURVES AND VARIABILITY OF BRIGHT FERMI-DETECTED BLAZARS

This paper presents light curves as well as the first systematic characterization of variability of the 106 objects in the high-confidence Fermi Large Area Telescope Bright AGN Sample (LBAS). Weekly light curves of this sample, obtained during the first 11 months of the Fermi survey (2008 August 4-2009 July 4), are tested for variability and their properties are quantified through autocorrelation function and structure function analysis. For the brightest sources, 3 or 4 day binned light curves are extracted in order to determine power density spectra (PDSs) and to fit the temporal structure of major flares. More than 50% of the sources are found to be variable with high significance, where high states do not exceed 1/4 of the total observation range. Variation amplitudes are larger for flat spectrum radio quasars and low/intermediate synchrotron frequency peaked BL Lac objects. Autocorrelation timescales derived from weekly light curves vary from four to a dozen of weeks. Variable sources of the sample have weekly and 3-4 day bin light curves that can be described by 1/f {sup {alpha}} PDS, and show two kinds of gamma-ray variability: (1) rather constant baseline with sporadic flaring activity characterized by flatter PDS slopes resembling flickering and red noise with occasional intermittence and (2)-measured for a few blazars showing strong activity-complex and structured temporal profiles characterized by long-term memory and steeper PDS slopes, reflecting a random walk underlying mechanism. The average slope of the PDS of the brightest 22 FSRQs and of the 6 brightest BL Lacs is 1.5 and 1.7, respectively. The study of temporal profiles of well-resolved flares observed in the 10 brightest LBAS sources shows that they generally have symmetric profiles and that their total duration vary between 10 and 100 days. Results presented here can assist in source class recognition for unidentified sources and can serve as reference for more detailed analysis of the brightest gamma-ray blazars.

79 ASTRONOMY AND ASTROPHYSICS↗

Design, Detection, and Countermeasure of Frequency Spectrum Attack and Its Impact on Long Short-Term Memory Load Forecasting and Microgrid Energy Management

This paper introduces a frequency-domain false data injection attack called Frequency Spectrum Attack (FSA) and explores its effects on load forecasting and the energy management system (EMS) in a microgrid. The FSA analyzes time-series signals in the frequency domain to identify patterns in their frequency spectrum. It learns the distribution of dominant frequencies in a dataset of healthy signals. Subsequently, it manipulates the amplitudes of dominant frequencies within this healthy distribution, ensuring a stealthy attack against statistical analysis of the signal spectrum. We evaluated the performance of FSA on LSTM, a state-of-the-art network for load forecasting. The results show that FSA can triple the Mean Absolute Error (MAE) of predictions compared to the normal case and increase it by 70% compared to noise injection attacks. Furthermore, FSA indirectly enhances battery utilization in the EMS by 45%. We then proposed a detection method that combines statistical analysis and machine-learning-based classification techniques with features. The model effectively distinguishes FSA from healthy and noisy signals, achieving an accuracy of 98.7% and an F1-score of 98.1% on a load dataset, covering healthy, FSA, and noisy load data. Finally, a countermeasure was introduced based on the statistical analysis of the frequency spectrum of healthy signals to mitigate the impact of FSA. This countermeasure successfully reduces the MAE of the attacked model from 0.135 to 0.053, validating its effectiveness in mitigating FSA.

Nazeri, Amirhossein↗