Search NASA⌕ Search

SEARCH · Search NASA

Results for “Feature Extraction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

An Agenda for Multimodal Foundation Models for Earth Observation

Archives of remote sensing (RS) data are increasing swiftly as new sensing modalities with enhanced spatiotemporal resolution become operational. While promising new breakthroughs, the sheer volume of RS archives stretches the limits of human analysts and existing AI tools, as most models are: i) limited to single data modalities; ii) task-specific; iii) heavily reliant on labeled data. The emerging Foundation Models (FMs) have the potential to address these limitations. Trained on vast unlabeled datasets through self-supervised learning, FMs enable generic feature extraction that facilitate specialization to a wide variety of downstream tasks. This paper describes a vision towards an FM for multimodal Earth Observation data (FM4EO), discussing key building blocks and open challenges. We put particular emphasis on multimodal reasoning, a topic underexplored in EO. Our ultimate goal is a practical path toward FM4EO with capacity to unlock breakthroughs in few-shot learning scenarios, multimodal geographic knowledge integration, synthesis, and hypothesis generation.

Ambrozio Dias, Philipe↗

Persistent Acoustic Sensing for Monitoring A Reactor Facility - Oral Presentation

Measurements over the past few years, taking place within the Multi-Informatics for Nuclear Operations Scenarios (MINOS) project, show that infrasound and low-frequency acoustic monitoring can detect, and often quantify, activities that occur on-site at a large research reactor. Observable activities include: crane translation, lifting, and lowering; differentiation between loaded and unloaded crane operations; access door opening and closing; vehicle operations; and cooling tower fan operation. Advanced data analytic and spectral feature extraction methods can be used to interpret selected signatures to reach a deeper understanding of different reactor activities. These measurements are being conducted using a network of smartphones that continuously operate in conjunction with cloud-based architectures. A recent addition to the system is the development and deployment of a real-time, cloud-based analytic framework that supports near-real-time alarming which can facilitate tip-and-cue protocols. This paper will present recent research advances in this area including studies to explore the transferability of learned parameters from one smartphone to another, the detectability of events from multiple sensors at different locations simultaneously, and the feasibility of porting analytical tools directly to the smartphones to allow edge computing with optimized configurations.

42 ENGINEERING↗

Persistent Acoustic Sensing for Monitoring A Reactor Facility

Measurements over the past few years, taking place within the Multi-Informatics for Nuclear Operations Scenarios project, show that infrasound and low-frequency acoustic monitoring can detect, and often quantify, activities that occur on-site at the High Flux Isotope Reactor. Observable activities include: crane translation, lifting, and lowering; differentiation between loaded and unloaded crane operations; access door opening and closing; vehicle operations; and cooling tower fan operations. Advanced data analytic and spectral feature extraction methods can be used to interpret selected signatures to reach a deeper understanding of different reactor activities. These measurements are being conducted using a network of smartphones that continuously operate in conjunction with cloud-based architectures. A recent addition to the system is the development and deployment of a real-time, cloud-based analytic framework that supports near-real-time alarming which can facilitate tip-and-cue protocols. This paper presents recent research in this area including the use of low-frequency acoustics to tip-off transfer operations and cue a more comprehensive analysis by other sensor networks.

42 ENGINEERING↗

Impedance-Based State-of-Health Estimation for Lithium-Ion Battery Management Systems

This paper discusses an impedance-based state-of-health (SOH) estimation for lithium-ion battery management systems. Features obtained from the Nyquist plot of the electrochemical impedance spectroscopy (EIS) are utilized to estimate the SOH. Two commercial lithium-ion batteries were aged (cycled) in the laboratory to collect aging and impedance data. An algorithm for SOH estimation is presented and evaluated. The performance evaluation results show that the SOH features extracted from the Nyquist plot can be utilized for SOH estimation. Estimated SOH values can be then utilized in various battery management systems (BMS) functions such as for calibrating the available capacity, adjusting charging/discharging strategies, and protection.

Al-Smadi, Mohammad↗

Acoustic Explosion Data Archive for Machine Learning

The prompt detection of explosions is a key element of the nuclear non-proliferation mission. With traditional sensors being limited in number and scale, smartphones as compact and economical multi-modal sensors are gaining traction and are being deployed. To address the flood of heterogeneous smartphone data, our team proposes a feature extraction using standardized constant-Q frequency bands across acoustic, barometric, and accelerometer data. The work in this presentation contains data collected at Idaho National Laboratory during planned detonations.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Analysis of aircraft spectrometer data with logarithmic residuals

Spectra from airborne systems must be analyzed in terms of their mineral-related absorption features. Methods for removing backgrounds and extracting these features one at a time from reflectance spectra are discussed. Methods for converting radiance spectra into a form similar to reflectance spectra so that the feature extraction procedures can be implemented on aircraft spectrometer data are also discussed.

Green, A. A.↗

Information Theoretic Extraction of EEG Features for Monitoring Subject Attention

The goal of this project was to test the applicability of information theoretic learning (feasibility study) to develop new brain computer interfaces (BCI). The difficulty to BCI comes from several aspects: (1) the effective data collection of signals related to cognition; (2) the preprocessing of these signals to extract the relevant information; (3) the pattern recognition methodology to detect reliably the signals related to cognitive states. We only addressed the two last aspects in this research. We started by evaluating an information theoretic measure of distance (Bhattacharyya distance) for BCI performance with good predictive results. We also compared several features to detect the presence of event related desynchronization (ERD) and synchronization (ERS), and concluded that at least for now the bandpass filtering is the best compromise between simplicity and performance. Finally, we implemented several classifiers for temporal - pattern recognition. We found out that the performance of temporal classifiers is superior to static classifiers but not by much. We conclude by stating that the future of BCI should be found in alternate approaches to sense, collect and process the signals created by populations of neurons. Towards this goal, cross-disciplinary teams of neuroscientists and engineers should be funded to approach BCIs from a much more principled view point.

Principe, Jose C.↗

A procedure for the extraction of airglow features in the presence of strong background radiation

A technique is developed that can be used to derive the total intensity of band emissions from twilight airglow measurements when the basic spectral signature of the band to be considered is known. The method is designed to automatically extract total band or line intensities of a signal imbedded in background radiation several orders of magnitude greater in brightness. It is shown that the technique developed can reliably measure the intensity of both weak and strong band and line emissions in the presence of strong twilight background radiation. The method of extraction is shown as part of a general purpose spectral analysis program written in VAX FORTRAN. This extraction procedure has been used successfully on emissions of Fel, Ca(+), N2(+) (1N) (0-0) and (0-1), OH in the near UV. OI red (630nm) and green (558nm) lines in the visible, and the OH Meinel bands and O(+) (2P) 732 nm in the near IR.

Swift, W. R.↗

A Hybrid Deep Learning Architecture for Classification of Microscopic Damage on NIF Laser Optics

Accurately classifying microscopic damage helps automate the repair and recycling of National Ignition Facility optics and informs the study of damage initiation and growth. This complex 12-class problem previously required human experts to distinguish and label the various damage morphologies. Finding image analysis methods to extract and calculate distinguishing features would be time consuming and challenging, so we sought to automate this task by using convolutional neural networks (CNNs) pretrained on the ImageNet database to take advantage of its automated feature discovery and extraction. We compared three model architectures on this dataset and found the one with highest overall accuracy, 99.17%, was a novel hybrid architecture, one in which we removed the final decision-making layer of the deep learner and replaced it with an ensemble of decision trees (EDT). This combines the power of feature extraction by CNNs with the decision-making strength of EDT. The accuracy of the hybrid architecture over the deep learning alone is shown to be significantly improved. Furthermore, we applied this novel hybrid architecture to an entirely different dataset, one containing images of repaired damage sites, and improved on the previously published findings, also with a demonstrably significant increase in accuracy over using the deep learner alone.

47 OTHER INSTRUMENTATION↗

Extraction and separation of rare earth elements using LN resins in hydrochloric acid

The separation of the rare earth elements is essential for numerous scientific applications but remains a significant challenge due to the nearly identical chemical properties of the adjacent lanthanide elements. Eichrom’s LN series of extraction chromatographic resins feature organophosphorus extractants and are widely used to achieve adjacent lanthanide separations. While extensive characterization of these resins has been completed for nitric acid matrices, the use of hydrochloric acid is preferred for a variety of applications. Further, the extraction of the rare earth elements, La–Lu and Y, has been characterized on LN and LN2 resins in hydrochloric acid via batch uptake and column chromatographic studies.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Tensor Extraction of Latent Features (TELF)

Tensor ELF is a user-friendly parallel tensor decomposition Python toolbox that includes a suite of machine learning algorithms for CPU and GPU architectures for the analysis of sparse and dense data including utility tools for pre-processing and post-processing.

Eren, Maksim↗

Algorithms for Spectral Decomposition with Applications to Optical Plume Anomaly Detection

The analysis of spectral signals for features that represent physical phenomenon is ubiquitous in the science and engineering communities. There are two main approaches that can be taken to extract relevant features from these high-dimensional data streams. The first set of approaches relies on extracting features using a physics-based paradigm where the underlying physical mechanism that generates the spectra is used to infer the most important features in the data stream. We focus on a complementary methodology that uses a data-driven technique that is informed by the underlying physics but also has the ability to adapt to unmodeled system attributes and dynamics. We discuss the following four algorithms: Spectral Decomposition Algorithm (SDA), Non-Negative Matrix Factorization (NMF), Independent Component Analysis (ICA) and Principal Components Analysis (PCA) and compare their performance on a spectral emulator which we use to generate artificial data with known statistical properties. This spectral emulator mimics the real-world phenomena arising from the plume of the space shuttle main engine and can be used to validate the results that arise from various spectral decomposition algorithms and is very useful for situations where real-world systems have very low probabilities of fault or failure. Our results indicate that methods like SDA and NMF provide a straightforward way of incorporating prior physical knowledge while NMF with a tuning mechanism can give superior performance on some tests. We demonstrate these algorithms to detect potential system-health issues on data from a spectral emulator with tunable health parameters.

Srivastava, Askok N.↗

Autonomous Wireless Technology Detection in Seamless IoT Applications

The ever-increasing use of Internet of Things (IoT) devices results in the implementation of multiple wireless technologies that would not only cater their data rate requirements but also support various applications. To optimize the energy efficiency and security of the wireless transmission, it is imperative to identify the wireless technologies in various IoT implementations. Many of the existing approaches are based on measuring only the receiving signal strength indicator (RSSI). However, such approaches may not work well because of transmit power control and complex channel variations among different wireless technologies. In this article, we propose an autonomous wireless detection scheme that considers multiple distinguishable physical (PHY)-layer settings for real-time identification of wireless technologies for real-time applications. Specifically, the proposed scheme relies on the PHY-layer measurements of the targeted spectrum. Transmission settings, such as bandwidth, carrier frequency, and RSSI are estimated from the raw in-phase and quadrature-phase (I/Q) measurements. In addition, a symbol-level extraction scheme is implemented to extract unique features of modulation settings. These aforementioned features are applied to a machine learning process to identify the received wireless technologies. Compared with raw I/Q measurements, the extracted features are much simplified and, thus, the machine learning classifier can be designed with a simple structure for fast processing on IoT nodes. Finally, the proposed schemes are primarily evaluated theoretically, followed by implementing them on a USRP software-defined radio (SDR)-based hardware testbed. The evaluation results demonstrate high accuracy in the real-time detection of different wireless technologies for seamless IoT applications.

42 ENGINEERING↗

Learning Temporal and Spatial Correlations Jointly: A Unified Framework for Wind Speed Prediction

Leveraging both temporal and spatial correlations to predict wind speed remains one of the most challenging and less studied areas of wind speed prediction. In this paper, the problem of predicting wind speeds for multiple sites is investigated by using the spatio-temporal correlation. We proposed a deep architecture termed predictive spatio-temporal network (PSTN), which is a unified framework integrating a convolutional neural network (CNN) and a long short-term memory (LSTM). Initially, the spatial features are extracted from the spatial wind speed matrices (SWSMs) by the CNN at the bottom of the model. Then, the LSTM captures the temporal dependencies among the spatial features extracted from contiguous time points. Lastly, the predicted wind speeds are given by the last state of the top layer of the LSTM, which are generated by using the spatial features and temporal dependencies. Though composed of two kinds of architectures, PSTN is trained with one loss function in an end-to-end (E2E) manner, which can learn temporal and spatial correlations jointly. Experiments for short-term predictions are conducted on real-world data, whose results demonstrate that PSTN outperforms prior methods.

42 ENGINEERING↗

Higher-order neural network software for distortion invariant object recognition

The state-of-the-art in pattern recognition for such applications as automatic target recognition and industrial robotic vision relies on digital image processing. We present a higher-order neural network model and software which performs the complete feature extraction-pattern classification paradigm required for automatic pattern recognition. Using a third-order neural network, we demonstrate complete, 100 percent accurate invariance to distortions of scale, position, and in-plate rotation. In a higher-order neural network, feature extraction is built into the network, and does not have to be learned. Only the relatively simple classification step must be learned. This is key to achieving very rapid training. The training set is much smaller than with standard neural network software because the higher-order network only has to be shown one view of each object to be learned, not every possible view. The software and graphical user interface run on any Sun workstation. Results of the use of the neural software in autonomous robotic vision systems are presented. Such a system could have extensive application in robotic manufacturing.

Reid, Max B.↗

Object recognition and pose estimation of planar objects from range data

The Extravehicular Activity Helper/Retriever (EVAHR) is a robotic device currently under development at the NASA Johnson Space Center that is designed to fetch objects or to assist in retrieving an astronaut who may have become inadvertently de-tethered. The EVAHR will be required to exhibit a high degree of intelligent autonomous operation and will base much of its reasoning upon information obtained from one or more three-dimensional sensors that it will carry and control. At the highest level of visual cognition and reasoning, the EVAHR will be required to detect objects, recognize them, and estimate their spatial orientation and location. The recognition phase and estimation of spatial pose will depend on the ability of the vision system to reliably extract geometric features of the objects such as whether the surface topologies observed are planar or curved and the spatial relationships between the component surfaces. In order to achieve these tasks, three-dimensional sensing of the operational environment and objects in the environment will therefore be essential. One of the sensors being considered to provide image data for object recognition and pose estimation is a phase-shift laser scanner. The characteristics of the data provided by this scanner have been studied and algorithms have been developed for segmenting range images into planar surfaces, extracting basic features such as surface area, and recognizing the object based on the characteristics of extracted features. Also, an approach has been developed for estimating the spatial orientation and location of the recognized object based on orientations of extracted planes and their intersection points. This paper presents some of the algorithms that have been developed for the purpose of recognizing and estimating the pose of objects as viewed by the laser scanner, and characterizes the desirability and utility of these algorithms within the context of the scanner itself, considering data quality and noise.

Pendleton, Thomas W.↗