Search NASA⌕ Search

SEARCH · Search NASA

Results for “Long memory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding

As spacecraft send back increasing amounts of telemetry data, improved anomaly detection systems are needed to lessen the monitoring burden placed on operations engineers and reduce operational risk. Current spacecraft monitoring systems only target a subset of anomaly types and often require costly expert knowledge to develop and maintain due to challenges involving scale and complexity. We demonstrate the effectiveness of Long Short-Term Memory (LSTMs) networks, a type of Recurrent Neural Network (RNN), in overcoming these issues using expert-labeled telemetry anomaly data from the Soil Moisture Active Passive (SMAP) satellite and the Mars Science Laboratory (MSL) rover, Curiosity. We also propose a complementary unsupervised and nonparametric anomaly thresholding approach developed during a pilot implementation of an anomaly detection system for SMAP, and offer false positive mitigation strategies along with other key improvements and lessons learned during development.

Soderstrom, Tom↗
NASA NTRS2022

Can Machine Learning Reveal Precursors of Reversals of the Geomagnetic Axial Dipole Field?

It is well known that the axial dipole part of Earth’s magnetic field reverses polarity, so that the magnetic North Pole becomes the South Pole and vice versa. The timing of reversals is well documented for the past 160 Myr, but the conditions that lead to a reversal are still not well understood. It is not known if there are reliable ‘precursors’ of reversals (events that indicate that a reversal is upcoming) or what they might be. We investigate if machine learning (ML) techniques can reliably identify precursors of reversals based on time-series of the axial magnetic dipole field. The basic idea is to train a classifier using segments of time-series of the axial magnetic dipole. This training step requires modification of standard ML techniques to account for the fact that we are interested in rare events—a reversal is unusual, while a non-reversing field is the norm. Without our tweak, the ML classifiers lead to useless predictions. Perhaps even more importantly, the usable observational record is limited to 0–2 Ma and contains only five reversals, necessitating that we determine if the data are even sufficient to reliably train and validate an ML algorithm. To answer these questions we use several ML classifiers (linear/non-linear support vector machines and long short-term memory networks), invoke a hierarchy of numerical models (from simplified models to 3-D geodynamo simulations), and two palaeomagnetic reconstructions (PADM2M and Sint-2000). The performance of the ML classifiers varies across the models and the observational record and we provide evidence that this is not an artefact of the numerics, but rather reflects how ‘predictable’ a model or observational record is. Studying models of Earth’s magnetic field via ML classifiers thus can help with identifying shortcomings or advantages of the various models. For Earth’s magnetic field, we conclude that the ability of ML to identify precursors of reversals is limited, largely due to the small amount and low frequency resolution of data, which makes training and subsequent validation nearly impossible. Put simply: the ML techniques we tried are not currently capable of reliably identifying an axial dipole moment (ADM) precursor for geomagnetic reversals. This does not necessarily imply that such a precursor does not exist, and improvements in temporal resolution and length of ADM records may well offer better prospects in the future.

Kyle Gwirtz↗
NASA NTRS2021

A Robust Hybrid Deep Learning Model for Spatiotemporal Image Fusion

Dense time-series remote sensing data with detailed spatial information are highly desired for the monitoring of dynamic earth systems. Due to the sensor tradeoff, most remote sensing systems cannot provide images with both high spatial and temporal resolutions. Spatiotemporal image fusion models provide a feasible solution to generate such a type of satellite imagery, yet existing fusion methods are limited in predicting rapid and/or transient phenological changes. Additionally, a systematic approach to assessing and understanding how varying levels of temporal phenological changes affect fusion results is lacking in spatiotemporal fusion research. The objective of this study is to develop an innovative hybrid deep learning model that can effectively and robustly fuse the satellite imagery of various spatial and temporal resolutions. The proposed model integrates two types of network models: super-resolution convolutional neural network (SRCNN) and long short-term memory (LSTM). SRCNN can enhance the coarse images by restoring degraded spatial details, while LSTM can learn and extract the temporal changing patterns from the time-series images. To systematically assess the effects of varying levels of phenological changes, we identify image phenological transition dates and design three temporal phenological change scenarios representing rapid, moderate, and minimal phenological changes. The hybrid deep learning model, alongside three benchmark fusion models, is assessed in different scenarios of phenological changes. Results indicate the hybrid deep learning model yields significantly better results when rapid or moderate phenological changes are present. It holds great potential in generating high-quality time-series datasets of both high spatial and temporal resolutions, which can further benefit terrestrial system dynamic studies. The innovative approach to understanding phenological changes’ effect will help us better comprehend the strengths and weaknesses of current and future fusion models.

spatiotemporal fusion↗
NASA NTRS2021

Applying Machine Learning to Predict Alaskan Ionospheric Irregularities

In this work several machine-learning (ML) techniques for predicting ionospheric irregularities in the northern auroral zone were tested. The techniques include Ridge Regression, Long Short-Term Memory Neural Network (LSTM), Classification Neural Network (CNN), Autoencoder Classification Neural Network (ACNN), and LSTM Autoencoder Classification Neural Network (LACNN). These techniques were tested with the rate of total electron content (TEC) index (ROTI) data collected during 2008 and 2009 from a geodetic station in Fairbanks, Alaska (64.98°N, 147.50°W), which is in the auroral zone. Using ROTI data with the ML techniques, experiments were conducted to reach two goals: (1) examine what space weather measurements present good correlation with ROTI so that they may be helpful in ML-based prediction of ionospheric irregularities in the polar region; (2) predict ROTI hours and days ahead by training the neural network models with historical ROTI data alone. The Ridge Regression experiments indicate that a combination of measurements of local geomagnetic horizontal components, geomagnetic SYM-H index, 3-hour Kp and ap indices, and F10.7 solar flux index appears to be more correlated to the single-site ROTI measurements than other parameters. The neural network (NN) experiments show that although the LACNN model allows for predictions of non-irregularity and irregularity conditions defined by ROTI levels up to 3 hours in advance, with an overall accuracy ≥ 92%, a number of irregularity events can still be missed. Hence, further development is needed to reduce the number of missed events. In this paper, the models, data processing, model performance, prediction results, and potential applications are presented.

Pi, Xiaoqing↗
NASA NTRSDate not supplied

Predicting Lightning Initiation using Deep Learning

Lightning occurrence presents safety challenges to people and property. The main challenge with lightning safety is that the majority of guidance is reactive. In other words, lightning has to have already occurred nearby before a person will respond and take shelter. Further, most injuries or fatalities occur as the storm approaches, or as it's moving away, when rainfall may not be present at the time of the flash. Thus, this project develops a physically-based deep learning model to produce lightning probabilities out to 15 minutes. The deep learning model combines a Convolutional Neural Network (CNN) with a Long Short-Term Memory (LSTM) network to capture both the spatial and temporal evolution of storms to predict the probability that lightning initiation will occur in the next 15 minutes. The model combines radar reflectivity, correlation coefficient and differential reflectivity to inferred storm hydrometer type and precipitation phase, which aids in the identification of electrification processes. The model is trained with data from the Geostationary Lightning Mapper (GLM), which is a near infrared sensor onboard the GOES-R series of satellites that measures optical brightness from lightning. This presentation will provide an overview of the project.

Andrew T White↗
NASA NTRSDate not supplied

Predicting Air Traffic Management Initiatives Using Supervised Learning

Terminal Traffic Management Initiatives (TMIs) such as Ground Stops (GS) and Ground Delay Programs (GDP) are implemented to manage excess demand or lowered capacity at an airport. Air Traffic Flow Management (TFM) specialists identify situations such as aviation constraints, current and forecasted weather conditions, airport demand and capacity, and initiate TMIs for safe and orderly movement of air traffic. In this paper, we outline supervised learning techniques that can be used to predict and recommend TMIs at an airport based on current weather and airport conditions. Our research involves building classic Machine Learning (ML) models such as Logistic Regression, K-Nearest Neighbor, Random Forest and XGBoost, as well as Long short-term memory (LSTM) networks. We trained the models on 3-year historical data (weather, airport demand, capacity and TMIs) from Newark (EWR) airport which was selected based on its higher TMI implementation rates and varied weather conditions. Although Random Forest and XGBoost algorithms are able to predict if a TMI is needed or not, they have difficulty in predicting specific program type. For this purpose, we found that LSTM time-series forecasting models performed better as they also learn from past TMI program type sequences. This study also lays down the foundation for advanced modeling techniques and architectures to predict TMIs in advance for future periods. The ability to predict TMIs in advance will be highly beneficial to the traffic controllers and managers as this will help them to prepare for and manage TMIs more efficiently.

Manoj Agrawal↗
NASA NTRSDate not supplied

A Machine Learning Ready Dataset of Acoustic Power Maps for Detection of Active Region Emergence

The development of an accurate forecast for solar eruptive activity has become increasingly important in order to prevent any potential impact on activities in space and the Earth's environment. It is therefore crucial to detect active regions before they appear on the solar surface and create early warning capabilities for upcoming Space Weather disturbances. In this work, 9TB of solar data (SDO/HMI dopplergrams, magnetograms and continuum intensity maps) involving the emergence of 61 NOAA solar active regions since 2010 were processed using the NASA HECC capabilities. An acoustic power maps time-series dataset was created (for four different frequency ranges and processed to take into account the solar sphere geometric effect ) which can be used for understanding the dynamics of the solar surface and train a variety of ML models. The calculated acoustic power maps carry precursor information associated with the decrease in continuum intensity on the solar surface, verifying older helioseismology research. Our results show that a Long Short-Term Memory (LSTMs) model, with a modest layer depth and the right hyperparameters tuned, when trained on this solar acoustic power maps dataset can predict without false negatives a drop in intensity (associated with the emergence of the active region), up to 18 hours in advance.

SMD↗
NASA NTRSDate not supplied

Predictive Workload Model for Air Traffic Controllers during UAM Operations

The effect of airspace factors on air traffic controller (ATC) workload has been an active area of study for almost three decades due to the importance of safety considerations necessary to design and maintain operations. Existing literature has examined several traffic-related (e.g., number of aircraft under control, loss of separation) contributors to ATC workload and proposed mathematical functions to best describe controller response. However, future air traffic continues to increase in complexity with the introduction of urban air mobility (UAM) – or the transportation of humans and cargo using electric vertical takeoff and landing (eVTOL) aircraft. UAM aims to alleviate congestion for existing ground transportation systems and improve mobility within urban centers and other high-demand locations. This shift in the traditional airspace paradigm necessitates an evolved understanding of model use and development for ATC workload prediction. This study aimed to develop an ATC workload forecasting model based on human-in-the-loop (HITL) simulation data for UAM operations at large airports. Data collected from the HITL simulation served as the training and testing data for a Long Short-Term Memory recurrent neural network and enabled time-series forecasting of ATC workload from traffic characteristics. Results demonstrated the potential of LSTM models for forecasting ATC workload 40 minutes into the future and highlighted important considerations for future development.

predictive model↗
NASA NTRS2022

Revisiting the Ground Magnetic Field Perturbations Challenge: A Machine Learning Perspective

Forecasting ground magnetic field perturbations has been a long-standing goal of the space weather community. The availability of ground magnetic field data and its potential to be used in geomagnetically induced current studies, such as risk assessment, have resulted in several forecasting efforts over the past few decades. One particular community effort was the Geospace Environment Modeling (GEM) challenge of ground magnetic field perturbations that evaluated the predictive capacity of several empirical and first principles models at both mid- and high-latitudes in order to choose an operative model. In this work, we use three different deep learning models-a feed-forward neural network, a long short-term memory recurrent network and a convolutional neural network-to forecast the horizontal component of the ground magnetic field rate of change (dB H /dt) over 6 different ground magnetometer stations and to compare as directly as possible with the original GEM challenge. We find that, in general, the models are able to perform at similar levels to those obtained in the original challenge, although the performance depends heavily on the particular storm being evaluated. We then discuss the limitations of such a comparison on the basis that the original challenge was not designed with machine learning algorithms in mind.

Victor A. Pinto↗
NASA NTRSDate not supplied

Predictive Workload Model for Air Traffic Controllers during UAM Operations

The effect of airspace factors on air traffic controller (ATC) workload has been an active area of study for almost three decades due to the importance of safety considerations necessary to design and maintain operations. Existing literature has examined several traffic-related (e.g., number of aircraft under control, loss of separation) contributors to ATC workload and proposed mathematical functions to best describe controller response. However, future air traffic continues to increase in complexity with the introduction of urban air mobility (UAM) – or the transportation of humans and cargo using electric vertical takeoff and landing (eVTOL) aircraft. UAM aims to alleviate congestion for existing ground transportation systems and improve mobility within urban centers and other high-demand locations. This shift in the traditional airspace paradigm necessitates an evolved understanding of model use and development for ATC workload prediction. This study aimed to develop an ATC workload forecasting model based on human-in-the-loop (HITL) simulation data for UAM operations at large airports. Data collected from the HITL simulation served as the training and testing data for a Long Short-Term Memory recurrent neural network and enabled time-series forecasting of ATC workload from traffic characteristics. Results demonstrated the potential of LSTM models for forecasting ATC workload 40 minutes into the future and highlighted important considerations for future development.

predictive model↗
NASA NTRSDate not supplied

Fast Machine Learning Lidar Surrogate Simulator: Pristine Clear Sky

The simulations of lidar signals and retrievals rely on a range of optic-physical models, such as radiative transfer models, particle scattering and absorption models, along with the output data from atmospheric physical models. Integrating these different models to represent signals of a lidar system is computationally expensive, and performing backward retrievals can be complex and ambiguous. However, with the advantages of Machine Learning, there is a new potential for building effective lidar signal database linked to corresponding atmospheric profiles. For this project, we are developing a fast pre-trained neural network as the lidar surrogate simulator using simulated data for a CALIPSO-like lidar (355 nm, 532nm, and 1064nm), and a CO2 differential absorption lidar (DIAL) near 1571nm. Specifically, we utilize a long short-term memory (LSTM) model to map the relationships between atmospheric profiles (pressure, temperature, air density and CO2 mixing ratio) and lidar signals. This approach allows us to build machine learning based simulators that can reconstruct lidar signals at specific bands from MERRA reanalysis data, and perform retrievals of atmospheric profiles using lidar signals at various wavelengths. As a first step, the results show the potential of this method to establish a foundational model for sensor signals. This model offers the promise of enabling both accurate predictions and rapid retrievals, providing a more efficient approach to signal processing and analysis.

Shan Zeng↗
NASA NTRS2024

Evaluation of Machine Learning and Deep Learning Algorithms for Fire Prediction in Southeast Asia

Vegetation fires are prevalent in South/Southeast Asian countries, making fire prediction crucial due to their potential environmental, economic, and social impacts. Accurate predictions of fires facilitate timely interventions, helping to mitigate uncontrolled fires that can lead to biodiversity loss and air quality issues. In this study, we utilize VIIRS satellite-derived fire data alongside six machine learning and deep learning models—Simple Persistence, Multi-Layer Perceptron (MLP), Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM), CNN-LSTM, and ConvLSTM—to determine the most effective fire prediction model, using Root Mean Square Error (RMSE) as the metric. Our results indicate that the CNN model is the most reliable in regions with spatial dependencies, such as Brunei, Indonesia, Malaysia, the Philippines, Timor-Leste, and Thailand. Conversely, the ConvLSTM model excels in countries with complex spatiotemporal dynamics like Laos, Myanmar, and Vietnam. The CNN-LSTM hybrid model also performed well in Cambodia, suggesting a need for a balanced approach in areas requiring both spatial and temporal feature extraction. Furthermore, simpler models like Persistence and MLP showed limitations in capturing dynamic patterns and temporal dependencies. Our findings highlight the importance of evaluating models before implementing any decision support systems (DSS) in fire management. By tailoring models to specific regional fire data, we can enhance prediction accuracy and responsiveness, ultimately improving fire risk management in Southeast Asia and beyond.

Deep learning↗
NASA NTRSDate not supplied

Graph Representation Learning for Dengue Forecasting

In 2017, the largest recorded dengue outbreak in Sri Lanka’s history occurred. Since then, dengue has continued to threaten national health across Sri Lanka. The development of an effective Early Warning System (EWS) for dengue outbreaks is essential for Sri Lanka’s Ministry of Health to take preventative measures. We propose the use of Graph Neural Networks as EWS. Using earth observational data from NASAs global satellites and dengue incidence data from Sri Lanka s Ministry of Health, we developed a series of traditional and graph representation EWS to forecast Dengue cases across Sri Lanka’s 25 districts between 2013 and 2022. We demonstrate empirically that Graph Neural Networks which incorporate spatiotemporal relations significantly outperform traditional EWS such as Autoregressive Integrated Moving Average (ARIMA), Random Forest, and Long Short-Term Memory (LSTM). Our source code is available on GitHub and will be provided in the final submission.

Graph Neural Networks↗
NASA NTRSDate not supplied

A Neural Network Parametrization of Volumetric Cloud Fraction Profiles Using Satellite Observations and MERRA-2 Reanalysis Meteorological Data

Clouds play a crucial role in regulating the hydrologic cycle and Earth's radiative energy budget, yet they are often poorly represented in global climate models (GCMs). This study applies deep machine learning techniques to develop a physical parameterization of volumetric cloud fraction (VCF), the fraction of a 3-D grid volume occupied by clouds using satellite lidar-radar measurements. The neural network (NN) captures the complicated relationships between observed VCF profiles and collocated meteorological variables from MERRA-2 reanalysis data. Our results show that the NN model, particularly a sequence-to-sequence long short-term memory (LSTM) network with a sixfactor loss function, effectively learns the underlying cloud physical processes. The NN model outperforms MERRA-2 reanalysis in representing low-level clouds in tropical and subtropical regions and low- and middle-level clouds over midlatitude storm-track regions, and also improves VCF histograms. These improvements are reflected in the vertical distributions of zonally, meridionally, and globally averaged VCFs, geographic distributions of low-, middle-, and high-level clouds, and seasonal variations in monthly-mean VCF. Furthermore, the NN predictions effectively capture the El Niño-Southern Oscillation (ENSO) effects and other interannual variations. The NN parameterization is further evaluated through a sensitivity analysis, in which a single predictor is perturbed at a time. This reveals that relative humidity (RH) is the dominant factor influencing variations in globally averaged VCF at low and middle altitudes, followed by temperature. At higher altitudes, temperature becomes the primary driver of VCF through its effect on RH. Changes in wind components had minimal impact on globally averaged VCF.

Shan Zeng↗
NASA NTRS2026

Machine Learning for Predicting Team Functioning in HERA Missions

Team functioning is integral to success in future long term space exploration missions. Proactively detecting declines in team functioning can mitigate conflict and ensure mission success. This project developed a speech-based artificial intelligence (AI) system that unobtrusively predicts degradation in team functioning, including performance and cohesion, in the Human Exploration Research Analog (HERA) Campaigns 4 and 5. The AI system conducted automated analysis of the prosodic (tone of voice) and linguistic (language content) components of speech, modeling interpersonal dynamics at both the turn-taking and day-wide levels. We investigated team functioning via observing structured interactions (i.e., multi-mission space exploration vehicle-extra vehicular activity [MMSEV-EVA], team interaction battery [TIB]) and unstructured interactions before the MMSEV-EVA task. We developed machine learning models to predict team functioning (objective task accuracy, self reported team efficacy and self reported team cohesion) by analyzing OpenSmile acoustic features, linguistic descriptors extracted via the linguistic inquiry and word count (LIWC) dictionary, and semantic embeddings. In the TIB, static models using logistic regression and random forests were not able to predict task accuracy, but predicted team efficacy and cohesion during both the decision making and relational tasks to a moderate level (60-70%). Majority voting on the individual turns to predict day long team efficacy further increased accuracies (70-80%). Finally, long short-term memory (LSTM) models showed the best performance across all variables (80-91%), including task performance. In the MMSEV-EVA, static models achieved an accuracy of 60% with majority voting, which increased to 80% through the incorporation of mission day as a variable, accounting for the learning effect. A key finding across both tasks was the "team-dependent" nature of these interactions; models achieved much higher accuracy when trained on prior days of the same team's data rather than attempting to generalize across entirely different teams, with even 1-2 days of prior data per team achieving 5-15% improvement over team-independent models. In addition, the incorporation of pre-task data from the same team also improves model performance, e.g., incorporating data from the decision-making task of the TIB, which preceded the relational task, improved the prediction of team efficacy and cohesion during the latter. We compared model performance when trained on machine-generated data compared to data that had been further corrected by human annotators. Overall, models trained on human-corrected data exhibited a modest improvement in performance, particularly when acoustic features were used. We found no significant correlation between word error rate (WER) and model accuracy (r(55) = -0.08, p = 0.51), but model’s accuracy was significantly higher for medium/high quality transcription (0.74 (SD = 0.48)) compared to the low-quality group (0.64 (SD = 0.36)) (t(63)=2.82, p = 0.006). Based on these, several design recommendation emerge, that could inform Standards at NASA. Models predicting team functioning should incorporate at least one to two days of historical interaction data, include brief pre-task discussions, and explicitly model temporal learning effects, especially for longer operational tasks. Minimum quality standards for automated speech-processing pipelines are needed, given the performance gains observed with manually corrected acoustic data. Finally, systems should leverage both acoustic features and language embeddings in complementary ways, with modality choices and fusion strategies tailored to mission context, task demands, and data quality requirements.

Shrivatsa Mishra↗
NASA NTRS2001

Future Development of Dense Ferroelectric Memories for Space Applications

The availability of high density, radiation tolerant, nonvolatile memories is critical for space applications. Ferroelectric memories, when fabricated with radiation hardened complementary metal oxide semiconductors (CMOS), can be manufactured and packaged to provide high density replacements for Flash memory, which is not radiation tolerant. Previous work showed ferroelectric memory cells to be resistant to single event upsets and proton irradiation, and ferroelectric storage capacitors to be resistant to neutron exposure. In addition to radiation hardness, the fast programming times, virtually unlimited endurance, and low voltage, low power operation make ferroelectric memories ideal for space missions. Previously, a commercial double level metal 64-kilobit ferroelectric memory was presented. Although the capabilities of radiation hardened wafer fabrication facilities lag behind those of the most modern commercial wafer fabrication facilities, several paths to achieving radiation tolerant, dense ferroelectric memories are emerging. Both short and long term solutions are presented in this paper. Although worldwide major semiconductor companies are introducing commercial ferroelectric memories, funding limitations must be overcome to proceed with the development of high density, radiation tolerant ferroelectric memories.

Philpy, Stephen C.↗
NASA NTRS1992

The future of spaceborne altimetry. Oceans and climate change: A long-term strategy

The ocean circulation and polar ice sheet volumes provide important memory and control functions in the global climate. Their long term variations are unknown and need to be understood before meaningful appraisals of climate change can be made. Satellite altimetry is the only method for providing global information on the ocean circulation and ice sheet volume. A robust altimeter measurement program is planned which will initiate global observations of the ocean circulation and polar ice sheets. In order to provide useful data about the climate, these measurements must be continued with unbroken coverage into the next century. Herein, past results of the role of the ocean in the climate system is summarized, near term goals are outlined, and requirements and options are presented for future altimeter missions. There are three basic scientific objectives for the program: ocean circulation; polar ice sheets; and mean sea level change. The greatest scientific benefit will be achieved with a series of dedicated high precision altimeter spacecraft, for which the choice of orbit parameters and system accuracy are unencumbered by requirements of companion instruments.

Koblinsky, C. J.↗
NASA NTRS1998

Two memories for geographical slant: separation and interdependence of action and awareness

The present study extended previous findings of geographical slant perception, in which verbal judgments of the incline of hills were greatly overestimated but motoric (haptic) adjustments were much more accurate. In judging slant from memory following a brief or extended time delay, subjects' verbal judgments were greater than those given when viewing hills. Motoric estimates differed depending on the length of the delay and place of response. With a short delay, motoric adjustments made in the proximity of the hill did not differ from those evoked during perception. When given a longer delay or when taken away from the hill, subjects' motoric responses increased along with the increase in verbal reports. These results suggest two different memorial influences on action. With a short delay at the hill, memory for visual guidance is separate from the explicit memory informing the conscious response. With short or long delays away from the hill, short-term visual guidance memory no longer persists, and both motor and verbal responses are driven by an explicit representation. These results support recent research involving visual guidance from memory, where actions become influenced by conscious awareness, and provide evidence for communication between the "what" and "how" visual processing systems.

NASA Discipline Space Human Factors↗