Search NASA⌕ Search

SEARCH · Search NASA

Results for “LABELLING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86

Stereo Vision Based Terrain Mapping for Off-Road Autonomous Navigation

Successful off-road autonomous navigation by an unmanned ground vehicle (UGV) requires reliable perception and representation of natural terrain. While perception algorithms are used to detect driving hazards, terrain mapping algorithms are used to represent the detected hazards in a world model a UGV can use to plan safe paths. There are two primary ways to detect driving hazards with perception sensors mounted to a UGV: binary obstacle detection and traversability cost analysis. Binary obstacle detectors label terrain as either traversable or non-traversable, whereas, traversability cost analysis assigns a cost to driving over a discrete patch of terrain. In uncluttered environments where the non-obstacle terrain is equally traversable, binary obstacle detection is sufficient. However, in cluttered environments, some form of traversability cost analysis is necessary. The Jet Propulsion Laboratory (JPL) has explored both approaches using stereo vision systems. A set of binary detectors has been implemented that detect positive obstacles, negative obstacles, tree trunks, tree lines, excessive slope, low overhangs, and water bodies. A compact terrain map is built from each frame of stereo images. The mapping algorithm labels cells that contain obstacles as no-go regions, and encodes terrain elevation, terrain classification, terrain roughness, traversability cost, and a confidence value. The single frame maps are merged into a world map where temporal filtering is applied. In previous papers, we have described our perception algorithms that perform binary obstacle detection. In this paper, we summarize the terrain mapping capabilities that JPL has implemented during several UGV programs over the last decade and discuss some challenges to building terrain maps with stereo range data.

passive perception↗

Cosmic Ray Exposure & Linear-Energy-Transfer Evaluations for the COBE Mission

Magnetospherically attenuated, orbit integrated, surface incident cosmic ray fluxes of galactic origin were determined for the COBE mission. All heavy ions up to Nickel (z=28) were considered in this, evaluation. In order to provide worst case approximations, estimates were based on solar minimum conditions. Transport and material shielding calculations were then performed for these vehicle encountered particles, for a simple spherical 3-D aluminum geometry, and the materially attenuated cosmic ray distributions emerging behind selected shield thicknesses were obtained. Finally, Linear-Energy-Transfer (LET) spectra were evaluated for the energy spectra of each ion specie and these were, in turn, integrated into the sum-total LET distribution contained in this report. The results are presented in tabular and graphical form for eight (8) different shield thicknesses from.01 to 10.0 gm/cm2 of aluminum. They show most conclusively, and not unexpectedly, that material shielding has virtually no 'effect on the final LET spectrum, at least not for aluminum shields. This was predictable. Please note that in the LET graphs, two curves were plotted. Of these, please ignore the one labeled "grazing" and use only the one labeled "normal". Again, it should be remembered that the end results contain contributions from all elements up to Nickel (z=28).

Stassinopoulos, E. G.↗

In-Situ and Remote-Sensing Data Fusion Using Machine Learning Techniques to Infer Urban and Fire Related Pollution Plumes

Airmass type characterization is key in understanding the relative contribution of various emission sources to atmospheric composition and air quality and can be useful in bottom-up model validation and emission inventories. However, classification of pollution plumes from space is often not trivial. Sub-orbital campaigns, such as SEAC4RS (Studies of Emissions, Atmospheric Composition, Clouds and Climate Coupling by Regional Surveys) give us a unique opportunity to study atmospheric composition in detail, by using a vast suite of in-situ instruments for the detection of trace gases and aerosols. These measurements allow identification of spatial and temporal atmospheric composition changes due to various pollution plumes resulting from urban, biogenic and smoke emissions. Nevertheless, to transfer the knowledge gathered from such campaigns into a global spatial and temporal context, there is a need to develop workflow that can be applicable to measurements from space. In this work we rely on sub-orbital in-situ and total column remote sensing measurements of various pollution plumes taken aboard the NASA DC-8 during 2013 SEAC4RS campaign, linking them through a neural-network (NN) algorithm to allow inference of pollution plume types by input of columnar aerosol and trace-gas measurements. In particular, we use the 4STAR (Spectrometer for Sky-Scanning, Sun-Tracking Atmospheric Research) airborne measurements of wavelength dependent aerosol optical depth (AOD), particle size proxies, O3, NO2 and water vapor to classify different pollution plumes. Our method relies on assigning a-priori ground-truth labeling to the various plumes, which include urban pollution, different fire types (i.e. forest and agriculture) and fire stage (i.e. fresh and aged) using cluster analysis of aerosol and trace-gases in-situ and auxiliary (e.g. trajectory) data and the training of a NN scheme to fit the best prediction parameters using 4STAR measurements as input. We explore our misclassification rates as related to our ground-truth labels, and with multi-layered pollution plume cases. The next step in our analysis is to optimize parameter selection for a scheme that can be applied to space-borne aerosol and trace-gas observation platforms such as OMI, and future geostationary satellites such as TEMPO and GEO-CAPE.

Neural-network↗

VR Lab ISS Graphics Models Data Package

All the ISS models are saved in AC3D model format which is a text based format that can be loaded into blender and exported to other formats from there including FBX. The models are saved in two different levels of detail, one being labeled "LOWRES" and the other labeled "HIRES". There are two ".str" files (HIRES _ scene _ load.str and LOWRES _ scene _ load.str) that give the hierarchical relationship of the different nodes and the models associated with each node for both the "HIRES" and "LOWRES" model sets. All the images used for texturing are stored in Windows ".bmp" format for easy importing.

Paddock, Eddie↗

Analyzing Cyber Security Threats on Cyber-Physical Systems Using Model-Based Systems Engineering

The spectre of cyber attacks on aerospace systems can no longer be ignored given that many of the components and vulnerabilities that have been successfully exploited by the adversary on other infrastructures are the same as those deployed and used within the aerospace environment. An important consideration with respect to the mission/safety critical infrastructure supporting space operations is that an appropriate defensive response to an attack invariably involves the need for high precision and accuracy, because an incorrect response can trigger unacceptable losses involving lives and/or significant financial damage. A highly precise defensive response, considering the typical complexity of aerospace environments, requires a detailed and well-founded understanding of the underlying system where the goal of the defensive response is to preserve critical mission objectives in the presence of adversarial activity. In this paper, a structured approach for modeling aerospace systems is described. The approach includes physical elements, network topology, software applications, system functions, and usage scenarios. We leverage Model-Based Systems Engineering methodology by utilizing the Object Management Group's Systems Modeling Language to represent the system being analyzed and also utilize model transformations to change relevant aspects of the model into specialized analyses. A novel visualization approach is utilized to visualize the entire model as a three-dimensional graph, allowing easier interaction with subject matter experts. The model provides a unifying structure for analyzing the impact of a particular attack or a particular type of attack. Two different example analysis types are demonstrated in this paper: a graph-based propagation analysis based on edge labels, and a graph-based propagation analysis based on node labels.

MBSE↗

A 3D Active Learning Application for NeMO-Net, the NASA Neural Multi-Modal Observation and Training Network for Global Coral Reef Assessment

NeMO-Net, the NASA neural multi-modal observation and training network for global coral reef assessment, is an open-source deep convolutional neural network and interactive active learning training software aiming to accurately assess the present and past dynamics of coral reef ecosystems through determination of percent living cover and morphology as well as mapping of spatial distribution. We present an interactive video game prototype for tablet and mobile devices where users interactively label morphology classifications over mm-scale 3D coral reef imagery captured using fluid lensing to create a dataset that will be used to train NeMO-Nets convolutional neural network. The application currently allows for users to classify preselected regions of coral in the Pacific and will be expanded to include additional regions captured using our NASA FluidCam instrument, presently the highest-resolution remote sensing benthic imaging technology capable of removing ocean wave distortion, as well as lower-resolution airborne remote sensing data from the ongoing NASA CORAL campaign. Active learning applications present a novel methodology for efficiently training large-scale Neural Networks wherein variances in identification can be rapidly mitigated against control data. NeMO-Net periodically checks users input against pre-classified coral imagery to gauge their accuracy and utilize in-game mechanics to provide classification training. Users actively communicate with a server and are requested to classify areas of coral for which other users had conflicting classifications and contribute their input to a larger database for ranking. In partnering with Mission Blue and IUCN, NeMO-Net leverages an international consortium of subject matter experts to classify areas of confusion identified by NeMO-Net and generate additional labels crucial for identifying decision boundary locations in coral reef assessment.

NeMO=NET↗

Radiation Chemistry of Solid Acetone in the Interstellar Medium - A New Dimension to an Old Problem

A laboratory investigation of acetone, an interstellar and cometary molecule, has produced new results concerning its decomposition in a radiation environment. Mid-infrared spectroscopy has been used to follow amorphous acetone's destruction by ionizing radiation (1 MeV protons) at 20 K. Radiation products identified are the CH4, CO, and CO2 usually made in such experiments, along with ketene, allene, and the acetonyl radical, all identified here for the first time in irradiated solid acetone. Evidence for the reduction product 2-propanol was suggestive, but a firm identification could not be made either for it or for the C2 hydrocarbons (i.e., C2H6, C2H4, C2H2). The acetyl radical was not observed as a radiation product. Isotopically labeled reagents were used to demonstrate ketene formation and to emphasize that multiple approaches are needed for robust assignments of infrared spectral features of irradiated icy solids. Results from a supporting radiation experiment with isotopically labeled acetic acid are described. Comparisons are made to a previous study of acetone's stability in extraterrestrial radiation environments, and caution is urged in measuring and interpreting CO abundances in irradiated icy solids.

cometary molecule↗

Enriching the Twitter Stream Increasing Data Mining Yield and Quality Using Machine Learning

Social media data streams are important sources of real-time and historical global information for science applications. At the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), we are exploring the Twitter data stream for its potential in augmenting the validation program of NASA Earth science missions, specifically the Global Precipitation Measurement (GPM) mission. We have implemented a tweet processing infrastructure that outputs classified precipitation tweets. Inputs are "passive" tweets, along with a smaller number of tweets from "active" participants, i.e., those knowingly contributing to our effort. The "active" tweets, presumably of higher quality, enrich the Twitter stream. "Active" sources include data scraped from other social media (e.g., public Facebook posts) and data from existing crowdsourcing programs (e.g., mPING reports). In addition, there is likely relevant precipitation information in images and documents that are the end points of links often included in tweets. Information derived from these "active" sources could then be tweeted into the Twitter stream, thus enriching its quality. The objective of our current work is to mine these tweet­ linked images and documents, using neural networks, to increase the information content and quality related to precipitation. For images, we classified them as either precipitation-related or not. For training and validation, we used images obtained via the Google custom search API. We created two models: (1) by training a simple Convolutional Neural Network and (2) by using transfer learning principles to adapt a pre-trained object recognition model. For documents, both those linked to tweets and the tweet contents, we trained Hierarchical Attention Networks to determine precipitation occurrence, type, and intensity. For training and validation, we used a keyword-filtered tweet data set labelled with ground truth data from Dark Sky (an API to retrieve weather-related labels) and the National Severe Storms Laboratory's Multi­ Radar/Multi-Sensor (MRMS) system. Our results demonstrated the efficacy of our machine learning approaches for enriching the Twitter stream, to derive information potentially useful for validation of earth science satellite data.

Albayrak, Arif↗

Carbon Nanostructures in Biological Sensors for Space and Terrestrial Applications

Biosensing devices comprised of carbon nanotubes and nanofibers have been developed for astronaut crew point-of-care. Their inherent nanometer scale, high conductivity, wide potential window, good biocompatibility and well-defined surface chemistry make them ideal candidates as biosensor electrodes. Here, we report two studies using carbon nanotube and carbon nanofiber electrodes for biomedical applications. First, a 3x3 electrode device, with each electrode containing 40,000 carbon nanofiber nanoelectrodes was fabricated on silicon using traditional microfabrication processing. The device was demonstrated as a multiplexed immunosensor for simultaneous, label-free detection of cardiac troponin-I, C-reactive protein and myoglobin. Antibodies specific to cardiac troponin-I, C-reactive protein and myoglobin were covalently bound to the CNF surface and were characterized using electrochemical impedance spectroscopy and differential pulse voltammetry. Each step of the modification process resulted in changes in resistance to charge transfer due to the changes at the electrode surface upon antibody immobilization and binding to the specific cardiac protein. The real-time label free detection of the three cardiac markers from pure components and mixtures was demonstrated with high sensitivity, down to 0.2 ng/mL, and good selectivity. Detection in human blood serum did not present false positives from non-specific protein adsorption. More recently, this detection scheme has been applied to inkjet printed carbon nanotube electrodes on Kapton and paper. Printed devices have several unique advantages including simple and inexpensive fabrication. The results demonstrate that these sensors can serve a miniaturized, low cost device for detection of proteins in complex mixtures making this platform a good candidate for early stage diagnosis of myocardial infarction. Future inkjet printed devices can be fabricated have the added advantage in their suitability to be manufactured in an in-space, microgravity environment.

carbon nanotubes↗

Carbon Nanomaterials for Biosensing Applications

Biosensing devices comprised of carbon nanotubes and nanofibers have been developed for astronaut crew point-of-care. Their inherent nanometer scale, high conductivity, wide potential window, good biocompatibility and well-defined surface chemistry make them ideal candidates as biosensor electrodes. Here, we report two studies using carbon nanotube and carbon nanofiber electrodes for biomedical applications. First, a 3x3 electrode device, with each electrode containing 40,000 carbon nanofiber nanoelectrodes was fabricated on silicon using traditional microfabrication processing. The device was demonstrated as a multiplexed immunosensor for simultaneous, label-free detection of cardiac troponin-I, C-reactive protein and myoglobin. Antibodies specific to cardiac troponin-I, C-reactive protein and myoglobin were covalently bound to the CNF surface and were characterized using electrochemical impedance spectroscopy and differential pulse voltammetry. Each step of the modification process resulted in changes in resistance to charge transfer due to the changes at the electrode surface upon antibody immobilization and binding to the specific cardiac protein. The real-time label free detection of the three cardiac markers from pure components and mixtures was demonstrated with high sensitivity, down to 0.2 ng/mL, and good selectivity. Detection in human blood serum did not present false positives from non-specific protein adsorption. More recently, this detection scheme has been applied to inkjet printed carbon nanotube electrodes on Kapton and paper. Printed devices have several unique advantages including simple and inexpensive fabrication. The results demonstrate that these sensors can serve a miniaturized, low cost device for detection of proteins in complex mixtures making this platform a good candidate for early stage diagnosis of myocardial infarction. Future inkjet printed devices can be fabricated have the added advantage in their suitability to be manufactured in an in-space, microgravity environment.

carbon nanotubes↗

GEONEX: Progressive Conditional Generative Adversarial Training Using Transfer learning

Obtaining accurate segmentation on large scale images is an open problem in deep learning. The main problem is the amount of labeled data that exists for large scale images. Traditionally, the common solution to this problem is to crop the large images into smaller images to increase the amount of available data and train a Conditional Generative Adversarial Network (CGAN). CGANs are currently the state of the art in image to image translation and provide better accuracy than the traditional method of training a encoder based conv-net architecture to minimize the loss at each pixel. This method can produce noisy and discontinuous images with inaccurate results. We seek to solve this problem by utilizing the concepts of transfer learning and progressive training to create a CGAN that can segment large scale images with a limited amount of labeled data. In transfer learning we recognize that many learned features are applicable to many classes from multiple domains. This introduces the concept of feature reusability, which is the basis for finetuning. Progressive training got its start in training models on the same images at different resolutions. In this work we instead train a GAN on increasing image scales by transferring the weights from the smaller scales to the larger scales. The learned features at the smaller scales are continually reused and applied to larger scales to create a CGAN that can perform accurate segmentation on large scale images. We apply this method to detect building footprints on very high-resolution overhead imagery (e.g Digital Globe and high resolution airborne platforms).

GEONEX↗

Improving Trust in Deep Neural Networks with Nearest Neighbors

Deep neural networks are used increasingly for perception and decision-making in UAVs. For example, they can be used to recognize objects from images and decide what actions the vehicle should take. While deep neural networks can perform very well at complex tasks, their decisions may be unintuitive to a human operator. When a human disagrees with a neural network prediction, due to the black box nature of deep neural networks, it can be unclear whether the system knows something the human does not or whether the system is malfunctioning. This uncertainty is problematic when it comes to ensuring safety. As a result, it is important to develop technologies for explaining neural network decisions for trust and safety. This paper explores a modification to the deep neural network classification layer to produce both a predicted label and an explanation to support its prediction. Specifically, at test time, we replace the final output layer of the neural network classifier by a k-nearest neighbor classifier. The nearest neighbor classifier produces 1) a predicted label through voting and 2) the nearest neighbors involved in the prediction, which represent the most similar examples from the training dataset. Because prediction and explanation are derived from the same underlying process, this approach guarantees that the explanations are always relevant to the predictions. We demonstrate the approach on a convolutional neural network for a UAV image classification task. We perform experiments using a forest trail image dataset and show empirically that the hybrid classifier can produce intuitive explanations without loss of predictive performance compared to the original neural network. We also show how the approach can be used to help identify potential issues in the network and training process.

Lee, Ritchie↗

Towards Explainability of UAV-Based Convolutional Neural Networks for Object Classification

f autonomous systems using trust and trustworthiness is the focus of Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR), a new NASA Convergent Aeronautical Solutions (CAS) Project. One critical research element of ATTRACTOR is explainability of the decision-making across relevant subsystems of an autonomous system. The ability to explain why an autonomous system makes a decision is needed to establish a basis of trustworthiness to safely complete a mission. Convolutional Neural Networks (CNNs) are popular visual object classifiers that have achieved high levels of classification performances without clear insight into the mechanisms of the internal layers and features. To explore the explainability of the internal components of CNNs, we reviewed three feature visualization methods in a layer-by-layer approach using aviation related images as inputs. Our approach to this is to analyze the key components of a classification event in order to generate component labels for features of the classified image at different layers of depths. For example, an airplane has wings, engines, and landing gear. These could possibly be identified somewhere in the hidden layers from the classification and these descriptive labels could be provided to a human or machine teammate while conducting a shared mission and to engender trust. Each descriptive feature may also be decomposed to a combination of primitives such as shapes and lines. We expect that knowing the combination of shapes and parts that create a classification will enable trust in the system and insight into creating better structures for the CNN.

Dolph, Chester V.↗

TPSAS-NF1676L-27431-DND

The Protocol Actions for Astronaut Dose Calculations were developed to provide participating agencies an opportunity to compare results best on their best practices. The results presented here were calculated using the HZETRN space radiation transport code and human response models developed for the On-Line Tool for the Assessment of Radiation in Space (OLTARIS). Two sets of results are presented: - The first set, labelled TARIS 4.0, were calculated using the latest version of the space radiation analysis tools developed for OLTARIS, but not yet incorporated into OLTARIS. - The second set, labelled OLTARIS (TARIS version 3.5), were calculated with the current version of OLTARIS and TIM participants should be able to reproduce these results.

Martha Clowdsley↗

Radiation Chemistry of Solid Acetone in the Interstellar Medium - A New Dimension to an Old Problem

A laboratory investigation of acetone, an interstellar and cometary molecule, has produced new results concerning its decomposition in a radiation environment. Mid-infrared spectroscopy has been used to follow amorphous acetone’s destruction by ionizing radiation (1 MeV protons) at 20 K. Radiation products identified are the CH4, CO, and CO2 usually made in such experiments, along with ketene, allene, and the acetonyl radical, all identified here for the first time in irradiated solid acetone. Evidence for the reduction product 2-propanol was suggestive, but a firm identification could not be made either for it or for the C2 hydrocarbons (i.e., C2H6, C2H4, C2H2). The acetyl radical was not observed as a radiation product. Isotopically labeled reagents were used to demonstrate ketene formation and to emphasize that multiple approaches are needed for robust assignments of infrared spectral features of irradiated icy solids. Results from a supporting radiation experiment with isotopically labeled acetic acid are described. Comparisons are made to a previous study of acetone’s stability in extraterrestrial radiation environments, and caution is urged in measuring and interpreting CO abundances in irradiated icy solids.

R. L. Hudson↗

Learning instrument invariant characteristics for generating high-resolution global coral reef maps

Coral reefs are one of the most biologically complex and diverse ecosystems within the shallow marine environment. Unfortunately, these underwater ecosystems are threatened by a number of anthropogenic challenges, including ocean acidification and warming, overfishing, and the continued increase of marine debris in oceans. This requires a comprehensive assessment of the world's coastal environments, including a quantitative analysis on the health and extent of coral reefs and other associated marine species, as a vital Earth Science measurement. However, limitations in observational and technological capabilities inhibit global sustained imaging of the marine environment. Harmonizing multimodal data sets acquired using different remote sensing instruments presents additional challenges, thereby limiting the availability of good quality labeled data for analysis. In this work, we develop a deep learning model for extracting domain invariant features from multimodal remote sensing imagery and creating high-resolution global maps of coral reefs by combining various sources of imagery and limited hand-labeled data available for certain regions. This framework allows us to generate, for the first time, coral reef segmentation maps at 2-meter resolution, which is a significant improvement over the kilometer-scale state-of-the-art maps. Additionally, this framework doubles accuracy and IoU metrics over baselines that do not account for domain invariance.

Domain Adaptation↗

A Machine Learning-Based Cloud Detection and Thermodynamic Phase Classification Algorithm using Passive Spectral Observations

We trained two Random Forest (RF) machine-learning models for cloud mask and cloud thermodynamic phase detection using spectral observations from VIIRS on Suomi NPP (SNPP). Observations from CALIOP were carefully selected to provide reference labels. The two RF models were trained for all-day and daytime-only conditions using a 4-year collocated VIIRS/CALIOP dataset from 2013 to 2016. Due to the orbit difference, the collocated CALIOP and SNPP VIIRS training samples cover a broad viewing zenith angle range, which is a great benefit to overall model performance. The all-day model uses 3 VIIRS infrared (IR) bands (8.6,11, and 12 μm) and the daytime model uses 5 Near-IR (NIR) and Shortwave-IR (SWIR) bands (0.86, 1.24, 1.38, 1.64 and 2.25 μm) together with the 3 IR bands to detect clear, liquid water, and ice cloud pixels. Up to 7 surface types, namely, ocean/water, forest, cropland, grassland, snow/ice, barren/desert, and shrubland, were considered separately to enhance performance for both models. Detection of cloudy pixels and thermodynamic phase with the two RF models were compared against collocated CALIOP products from 2017. It is shown that, with a conservative screening process that excludes the most challenging cloudy pixels for passive remote sensing, the two RF models have high accuracy rates in comparison with the CALIOP reference for both cloud detection and thermodynamic phase. Other existing SNPP VIIRS and Aqua MODIS cloud mask and phase products are also evaluated, with results showing that the two RF models and the MODIS MYD06 optical property phase product are the top 3 algorithms with respect to lidar observations during the daytime. During the nighttime, the RF all-day model works best for both cloud detection and phase, in particular for pixels over snow/ice surfaces. The present RF models can be extended to other similar passive instruments if training samples can be collected from CALIOP or other lidars. However, the quality of reference labels and potential sampling issues that may impact model performance would need further attention.

cloud detection↗

Expanding NeMO-Net Machine Learning Capabilities for Citizen Science

NASA NeMO-Net, the neural multi-modal observation and training network for global coral reef assessment, is an open-source deep convolutional neural network and interactive active learning training software aiming to accurately assess the present and past dynamics of coral reef ecosystems through determination of percent living cover and morphology as well as mapping of spatial distribution. We present an interactive citizen science video game, released this April, for desktop and iOS devices where users interactively label morphology classifications over mm-scale 3D coral reef imagery captured using diver photomosaic imagery, the UAV enabled NASA FluidCam instrument, and satellite datasets. To date, the application has had over 40,000 downloads and over 60,000 unique coral reef classifications, each filtered through a user-based rating and expert evaluation system. We also present results from NeMO-Net’s convolutional neural network (CNN) models used to semantically segment 2D satellite imagery as well as projections of 3D coral reconstructions using user input data as training datasets. Fusing datasets using machine learning from multiple remote sensing platforms presents novel methodologies for assessing the health of coral ecosystems, which are critically endangered by a changing climate. In partnering with Mission Blue, the National Oceanic and Atmospheric Administration (NOAA), and the Living Oceans Foundation (LOF), NeMO-Net leverages an international consortium of subject matter experts to provide both proper training for citizen scientists and the generation of a labeled datasets to ingest into machine learning algorithms for global coral reef identification.

NeMO-Net↗