Search NASA⌕ Search

SEARCH · Search NASA

Results for “Information extraction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Landsat image interpretation aids

In the Large Area Crop Inventory Experiment, image interpretation aids were produced to assist in selecting and/or identifying representative samples of signatures in a given Landsat scene. The three methods employed are based on clustering techniques, information extraction, and aggregation of like spectral information on a two-dimensional spectral plot.

Abotteen, R. A.↗

Natural Language Processing Analysis of Notices to Airmen for Air Traffic Management Optimization

With new emerging technologies in the field of NLP, we explore their applications to digitize and analyze heritage Air Traffic Management (ATM) documents for planning and optimizing airspace operations. Specifically, this research focuses on harvesting semi-structured or un-structured information contained in Notices to Airmen (NOTAMs). Using NLP and other advanced data analytics, we will construct a data-driven framework which facilitates finding language patterns and the use of pretrained language models for classification and extraction of useful airspace constraints and restrictions. These may lead to tools that assist airspace users in understanding the constraints more efficiently, contributing to better route planning and safer execution. This paper explores three workflows entailing different NLP tasks. First, unsupervised techniques like word embedding and topic modeling are used for pattern finding and document classification. Second, a dataset is created by extracting information from the semi-structured NOTAM format as metadata for categorizing, visualizing, and extracting key entities driving NOTAM content. Third, modern pre-built deep learning based transformer models such as BERT, RoBERTa, and XLNet are evaluated on the question answering task, an even more robust approach to information extraction, as well as their respective fine-tuning tasks. In this work we include various performance metrics for the trained models to evaluate both accuracy and precision and we show that the models can be generalized for their respective tasks. The research work developed shows promise in uncovering trends in digital NOTAMs in the NAS and also offers a new framework for digitizing and inferring insights from free-form legacy NOTAMs, that are yet to be digitized.

Natural Language Processing↗

Natural Language Processing (NLP) Analysis of NOTAMs for Air Traffic Management Optimization

With new emerging technologies in the field of NLP, we explore their applications to digitize and analyze heritage Air Traffic Management (ATM) documents for planning and optimizing airspace operations. Specifically, this research focuses on harvesting semi-structured or un-structured information contained in Notices to Airmen (NOTAMs). Using NLP and other advanced data analytics, we will construct a data-driven framework which facilitates finding language patterns and the use of pretrained language models for classification and extraction of useful airspace constraints and restrictions. These may lead to tools that assist airspace users in understanding the constraints more efficiently, contributing to better route planning and safer execution. This paper explores three workflows entailing different NLP tasks. First, unsupervised techniques like word embedding and topic modeling are used for pattern finding and document classification. Second, a dataset is created by extracting information from the semi-structured NOTAM format as metadata for categorizing, visualizing, and extracting key entities driving NOTAM content. Third, modern pre-built deep learning based transformer models such as BERT, RoBERTa, and XLNet are evaluated on the question answering task, an even more robust approach to information extraction, as well as their respective fine-tuning tasks. In this work we include various performance metrics for the trained models to evaluate both accuracy and precision and we show that the models can be generalized for their respective tasks. The research work developed shows promise in uncovering trends in digital NOTAMs in the NAS and also offers a new framework for digitizing and inferring insights from free-form legacy NOTAMs, that are yet to be digitized. Video is an mp4 download, with a play time of 9 min 35 secs.

Natural Language Processing↗

Massive νs through the CNN lens: interpreting the field-level neutrino mass information in weak lensing

Modern cosmological surveys probe the Universe deep into the nonlinear regime, where massive neutrinos suppress cosmic structure. Traditional cosmological analyses, which use the 2-point correlation function to extract information, are no longer optimal in the nonlinear regime, and there is thus much interest in extracting beyond-2-point information to improve constraints on neutrino mass. Quantifying and interpreting the beyond-2-point information is thus a pressing task. We study the field-level information in weak lensing convergence maps using convolution neural networks. We find that the network performance increases as higher source redshifts and smaller scales are considered — investigating up to a source redshift of 2.5 and ℓ max ≃ 10 4 — verifying that massive neutrinos leave a distinct effect on weak lensing. However, the performance of the network significantly drops after scaling out the 2-point information from the maps, implying that most of the field-level information can be found in the 2-point correlation function alone. We quantify these findings in terms of the likelihood ratio and also use Integrated Gradient saliency maps to interpret which parts of the map the network is learning the most from. We find that, in the absence of noise, the network extracts a similar amount of information from the most overdense and underdense regions. However, upon adding noise, the information in underdense regions is distorted as noise disproportionately washes out void-like structures.

Golshan, Malika [University of California, Berkele↗

X-ray photoelectron spectroscopy of epitaxial films and heterostructures

X-ray photoelectron spectroscopy is a powerful experimental technique that yields invaluable information on a range of phenomena that occur in solids, liquids, and gasses. The binding energy and shape of a photoemission peak is sensitive not only to the atomic number, valence and orbital from which the electron is ejected, but also to complex many-body effects that accompany photoemission. Provided the influences of these different drivers of spectral line shapes can be disentangled, a great deal can be learned about the electronic structures of specific atoms in the material of interest. In addition to these largely local effects, the long-range electrostatic environment and resulting electric potential at the emitting atom have a direct effect on the measured binding energies. Furthermore, this fact opens the door to extracting information about the dependence of the valence and conduction band minima on depth below the surface, which in turn allows both vertical and lateral electrical transport data to be better understood. One purpose of this Report is to describe how the different physical forces described above impact spectral properties of complex oxide epitaxial films. This class of materials typically incorporates transition metal cations in different valences and of all the elements, these exhibit the most complex core-level spectra. A second purpose is to show how a comprehensive understanding of local physical effects in x-ray photoemission allows one to extract detailed information on internal electric fields and band edge discontinuities in heterostructures involving complex oxides from core-level line shapes.

47 OTHER INSTRUMENTATION↗

ABM Drag_Pass Report Generator

dragREPORT software was developed in parallel with abmREPORT, which is described in the preceding article. Both programs were built on the capabilities created during that process. This tool generates a drag_pass report that summarizes vital information from the MRO aerobreaking drag_pass build process to facilitate both sequence reviews and provide a high-level summarization of the sequence for mission management. The script extracts information from the ENV, SSF, FRF, SCMFmax, and OPTG files, presenting them in a single, easy-to-check report providing the majority of parameters needed for cross check and verification as part of the sequence review process. Prior to dragReport, all the needed information was spread across a number of different files, each in a different format. This software is a Perl script that extracts vital summarization information and build-process details from a number of source files into a single, concise report format used to aid the MPST sequence review process and to provide a high-level summarization of the sequence for mission management reference. This software could be adapted for future aerobraking missions to provide similar reports, review and summarization information.

Fisher, Forest↗

Proposed Test of the Two Beam BPM at RHIC

The essence of the ERL operation implies that at least two beams (accelerated and decelerated) are co-propagating in the same vacuum vessel and each beam has its own trajectory. The existing beam position monitors measure only “average” trajectory but not that of an individual beam, unless the time separation between bunches is so large that one can resolve individual bunches. It was proposed to use phase information of the pick-up signal to extract information on the orbit “difference”. We are planning to conduct experiments at RHIC to test the proposed idea. The approach and experiment set-up are described in the paper.

43 PARTICLE ACCELERATORS↗

Velocity Extraction Using Complete Time-Domain Waveform Data and Audio Machine Learning

We developed a new machine learning-based tool for extracting information from interferometry measurements: MIDWAZE (Modular Interferometry Direct Waveform AnalyZEr). This paper showcases MIDWAZE’s ability to extract an object’s velocity information from Photonic Doppler Velocimetry (PDV) data at near-human accuracy with little to no human intervention. MIDWAZE can extract velocities roughly 350 times as fast as a human analyst "rushing" to complete their extractions, with similar extraction accuracy. MIDWAZE’s most outstanding feature is that it operates directly in waveform/temporal space, freeing analysis from certain limitations imposed by traditional spectrogram-based approaches and opening the way to "phase aware" PDV analysis. MIDWAZE also has limited ability to discriminate between different solid objects, which we develop as a first step towards automated discrimination of different kinds of objects such as ejecta clouds.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Web-based wide-area monitoring platform for ringdown and clustering analytics in power systems

This paper introduces an open-source research platform for monitoring the Mexican interconnected power grid, allowing real-time processing and information extraction of the grid’s dynamic condition. Moreover, the platform is a Python-based development that embeds different ringdown and clustering analytics tools. In the case of ringdown analysis, the modal information can be extracted using some of the most known algorithms, i.e., Prony analysis, eigensystem realization algorithm (ERA), and matrix pencil (MP). For clustering analysis, the coherent behaviour of generator and non-generator buses is provided by applying recent state-of-the-art techniques such as affinity propagation, K-means, hierarchical agglomerative clustering, and typicality data analysis. The results of up to 93 PMUs show that this open-source platform suits researchers’ and engineers’ power system dynamic analysis requirements.

Clustering↗

Extracting heading and temporal range from optic flow: Human performance issues

Pilots are able to extract information about their vehicle motion and environmental structure from dynamic transformations in the out-the-window scene. In this presentation, we focus on the information in the optic flow which specifies vehicle heading and distance to objects in the environment, scaled to a temporal metric. In particular, we are concerned with modeling how the human operators extract the necessary information, and what factors impact their ability to utilize the critical information. In general, the psychophysical data suggest that the human visual system is fairly robust to degradations in the visual display, e.g., reduced contrast and resolution or restricted field of view. However, extraneous motion flow, i.e., introduced by sensor rotation, greatly compromises human performance. The implications of these models and data for enhanced/synthetic vision systems are discussed.

Kaiser, Mary K.↗

Integration of AIRSAR and AVIRIS data for Trail Canyon alluvial fan, Death Valley, California

Combining quantitative geophysical information extracted from the optical and microwave wavelengths provides complementary information about both the surface mineralogy and morphology. This study combines inversion results from two remote sensing instruments, a polarimetric synthetic aperture radar, AIRSAR, and an imaging spectrometer, AVIRIS, for Trail Canyon alluvial fan in Death Valley, California. The NASA/JPL Airborne Synthetic Aperture Radar (AIRSAR) is a quad-polarization, three frequency instrument. AIRSAR collects data at C-band = 5.66 cm, L-band = 23.98 cm, and P-band = 68.13 cm. The data are processed to four-looks and have a spatial resolution of 10 m and a swath width of 12 km. The AIRSAR data used in this study were collected as part of the Geologic Remote Sensing Field Experiment (GRSFE) over Death Valley on 9/14/89. The Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) is a NASA/JPL instrument that flies in an ER-2 aircraft at an altitude of 20 km. AVIRIS uses four spectrometers to collect data in 224 spectral channels from 0.4 micrometer to 2.45 micrometer. The width of each spectral band is approximately 10 nm. AVIRIS collects data with a swath width of 11 km and a pixel size of 20 m. The AVIRIS data used in this study were collected over Death Valley on 5/31/92.

Kierein-Young, Kathryn S.↗

Domain Adaptive Graph Neural Networks for Constraining Cosmological Parameters Across Multiple Data Sets

Deep learning models have been shown to outperform methods that rely on summary statistics, like the power spectrum, in extracting information from complex cosmological data sets. However, due to differences in the subgrid physics implementation and numerical approximations across different simulation suites, models trained on data from one cosmological simulation show a drop in performance when tested on another. Similarly, models trained on any of the simulations would also likely experience a drop in performance when applied to observational data. Training on data from two different suites of the CAMELS hydrodynamic cosmological simulations, we examine the generalization capabilities of Domain Adaptive Graph Neural Networks (DA-GNNs). By utilizing GNNs, we capitalize on their capacity to capture structured scale-free cosmological information from galaxy distributions. Moreover, by including unsupervised domain adaptation via Maximum Mean Discrepancy (MMD), we enable our models to extract domain-invariant features. We demonstrate that DA-GNN achieves higher accuracy and robustness on cross-dataset tasks. Using data visualizations, we show the effects of domain adaptation on proper latent space data alignment. This shows that DA-GNNs are a promising method for extracting domain-independent cosmological information, a vital step toward robust deep learning for real cosmic survey data.

79 ASTRONOMY AND ASTROPHYSICS↗

Bridging the Gap between Cosmological Simulations with Graph Neural Networks and Domain Adaptation

Deep learning models have been shown to outperform methods that rely on summary statistics, like the power spectrum, in extracting information from complex cosmological data sets. However, due to differences in the subgrid physics implementation and numerical approximations across different simulation suites, models trained on data from one cosmological simulation show a drop in performance when tested on another. Similarly, models trained on any of the simulations would also likely experience a drop in performance when applied to observational data. Training on data from two different suites of the CAMELS hydrodynamic cosmological simulations, we examine the generalization capabilities of Domain Adaptive Graph Neural Networks (DA-GNNs). By utilizing GNNs, we capitalize on their capacity to capture structured scale-free cosmological information from galaxy distributions. Moreover, by including unsupervised domain adaptation via Maximum Mean Discrepancy (MMD), we enable our models to extract domain-invariant features. We demonstrate that DA-GNN achieves higher accuracy and robustness on cross dataset tasks (up to 28% better relative error and up to almost an order of magnitude better χ 2 ). Using data visualizations, we show the effects of domain adaptation on proper latent space data alignment. This shows that DA-GNNs are a promising method for extracting domain-independent cosmological information, a vital step toward robust deep learning for real cosmic survey data.

97 MATHEMATICS AND COMPUTING↗

Domain Adaptive Graph Neural Networks for Constraining Cosmological Parameters Across Multiple Data Sets

Deep learning models have been shown to outperform methods that rely on summary statistics, like the power spectrum, in extracting information from complex cosmological data sets. However, due to differences in the subgrid physics implementation and numerical approximations across different simulation suites, models trained on data from one cosmological simulation show a drop in performance when tested on another. Similarly, models trained on any of the simulations would also likely experience a drop in performance when applied to observational data. Training on data from two different suites of the CAMELS hydrodynamic cosmological simulations, we examine the generalization capabilities of Domain Adaptive Graph Neural Networks (DA-GNNs). By utilizing GNNs, we capitalize on their capacity to capture structured scale-free cosmological information from galaxy distributions. Moreover, by including unsupervised domain adaptation via Maximum Mean Discrepancy (MMD), we enable our models to extract domain-invariant features. We demonstrate that DA-GNN achieves higher accuracy and robustness on cross-dataset tasks (up to $28\%$ better relative error and up to almost an order of magnitude better $\chi^2$). Using data visualizations, we show the effects of domain adaptation on proper latent space data alignment. This shows that DA-GNNs are a promising method for extracting domain-independent cosmological information, a vital step toward robust deep learning for real cosmic survey data.

79 ASTRONOMY AND ASTROPHYSICS↗

FrESCO: Framework for Exploring Scalable Computational Oncology

The National Cancer Institute (NCI) monitors population level cancer trends as part of its Surveillance, Epidemiology, and End Results (SEER) program. This program consists of state or regional level cancer registries which collect, analyze, and annotate cancer pathology reports. From these annotated pathology reports, each individual registry aggregates cancer phenotype information from electronic health records. This data is then used to create summary statistics about cancer incidence and mortality to facilitate population health monitoring. Extracting phenotypic information from these reports is a labor intensive task, requiring specialized knowledge about the reports and cancer. Automating the information extraction process from cancer pathology reports has the potential to improve data quality by extracting information in a consistent manner across registries. It can also improve patient outcomes by reducing the time from diagnosis, enabling rapid case ascertainment for clinical trials. Here we present FrESCO, a modular deep-learning natural language processing (NLP) library initially designed for extracting pathology information from clinical text documents. This repository is not solely limited to clinical medical text, but may also be used by researchers just getting started with NLP methods and those looking for a robust solution for their classification problems.

60 APPLIED LIFE SCIENCES↗

Source Authentication of Distribution Synchrophasors for Cybersecurity of Microgrids

This letter proposes a hybrid approach combining Self-Adaptive Mathematical Morphology (SAMM) and Time-Frequency (TF) techniques to authenticate the source information of Distribution Synchrophasors (DS) within near-range locations. The SAMM can adaptively regulate the synchrophasors variations which are representatives of local environmental characteristics. Subsequently, TF mapping is employed to extract informative signatures from the regulated synchrophasors variation. Finally, Random Forest Classification (RFC) is used to correlate the extracted signatures with the source information based on the derived TF mapping. Experiment results using DS collected at multiple small geographical scales validated the proposed methodology.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Applicability of Spectral Decomposition by Varimax-Rotated, Principal Component Analysis to the Surface Biology and Geology (SBG) VNIR Mission Concept

Cyanobacterial and Harmful Algal Blooms (CyanoHABs) are a growing concern in coastal and inland waters. But, spectral interference from multiple constituents in optically complex waters can hamper application of remote sensing using traditional image processing methods. The Kent State University (KSU) spectral decomposition method can be applied to multispectral and hyperspectral remote sensing images (e.g. HICO and the NASA Glenn HSI2) to partition and identify signals related to cyanobacteria, algae, pigment degradation products and suspended sediment in each pixel. Fundamental to the use of remote sensing data is the ability to extract independent signals from correlated hyperspectral VNIR data cubes. The Kent State University varimax-rotated, principal component analysis method (VPCA) is important to integrate into the SBG VNIR mission concept because it provides greater specificity, a software-based SNR boost relative to hardware performance, and can assist with Cal/Val, Modeling and Applications. We present examples of the hyperspectral application of the KSU VPCA method with relevance to SBG. The information extracted by VPCA can be validated spectrally or spatially with laboratory and/or in situ sensors, which capture spatial or time series of information at discrete points within remote sensing images. Comparisons show hyperspectral sensors extract more components than multispectral ones, but more independent information can be extracted from multispectral sensors by VPCA than traditional band ratio approaches. The spectral decomposition method is capable of enhancing the signal to noise ratio (SNR) of the NASA Glenn, second-generation hyperspectral imager by a factor of 7x to 20x, with a spectral reproducibility of ±3%. The spectral decomposition method, when compared against existing remote sensing monitoring methods exhibits both greater specificity and a lower detection limit. The method has been validated with multispectral images in Lake Erie to quantify the Microcystis CyanoHAB and from the Indian River Lagoon, Florida to quantify the Brown Tide resulting from A. lagunesnsis. Field operations in the Western Basin of Lake Erie were conducted using a bbe Fluoroprobe to collect vertical profiles and horizontal tows along a transect from the Toledo to the Detroit Lighthouse during coincident satellite overpasses. Extraction of pixel values from the MODIS Aqua sensor yields agreement between in situ field and lab-based measures of cyanobacterial, cryptophyte, diatoms and green algae, suspended sediment and pigment degradation products with R2>0.8.

hyperspectral↗

Interpretation Techniques Development

The processes, algorithms and procedures for extraction and interpretation of ERTS-1 data are discussed. Analysis of data acquired temporally is possible through geometric correction, correlation, and registration techniques. The powerful techniques in image enhancement developed for the lunar and planetary programs are valuable for Earth Resources Survey programs. There is evidence that both optical and digital methods of spatial information extraction can provide valuable sources of data information the ERTS system. The techniques available, even for a limited number of bands and limited resolution can be effectively used to extract much of the information required by resource managers.

Alford, W. L.↗