Search NASA⌕ Search

SEARCH · Search NASA

Results for “visual relationship detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Detection of emetic activity in the cat by monitoring venous pressure and audio signals

To investigate the use of audio signals as a simple, noninvasive measure of emetic activity, the relationship between the somatic events and sounds associated with retching and vomiting was studied. Thoracic venous pressure obtained from an implanted external jugular catheter was shown to provide a precise measure of the somatic events associated with retching and vomiting. Changes in thoracic venous pressure monitored through an indwelling external jugular catheter with audio signals, obtained from a microphone located above the animal in a test chamber, were compared. In addition, two independent observers visually monitored emetic episodes. Retching and vomiting were induced by injection of xylazine (0.66mg/kg s.c.), or by motion. A unique audio signal at a frequency of approximately 250 Hz is produced at the time of the negative thoracic venous pressure change associated with retching. Sounds with higher frequencies (around 2500 Hz) occur in conjunction with the positive pressure changes associated with vomiting. These specific signals could be discriminated reliably by individuals reviewing the audio recordings of the sessions. Retching and those emetic episodes associated with positive venous pressure changes were detected accurately by audio monitoring, with 90 percent of retches and 100 percent of emetic episodes correctly identified. Retching was detected more accurately (p is less than .05) by audio monitoring than by direct visual observation. However, with visual observation a few incidents in which stomach contents were expelled in the absence of positive pressure changes or detectable sounds were identified. These data suggest that in emetic situations, the expulsion of stomach contents may be accomplished by more than one neuromuscular system and that audio signals can be used to detect emetic episodes associated with thoracic venous pressure changes.

A Nagahara↗

An analysis of Seasat SAR for detecting geologic linears

The value of Seasat synthetic aperture radar (SAR) imagery for detecting geologic linears was assessed in a study of an 89,000 sq km section of New York's Adirondack Mountains. A photographic print of optically processed, 1:500,000 scale SAR imagery (one look direction) was analyzed visually, and the detected linears were compared to those recorded on a 1:250,000 scale geologic map. Eighty percent of the 4,170 km of mapped, geologic linears were detected with the SAR imagery. Moreover, nearly 6,900 km of unmapped linears were also detected. Of these, an estimated 90 percent could be observed on high altitude aerial photographs. The relationship between SAR image detection of linears and the different types of indicators (e.g., straight valleys or shorelines) is reported.

Yan, S.-Y.↗

An evaluation of three-dimensional sensors for the extravehicular activity helper/retreiver

The Extravehicular Activity Retriever/Helper (EVAHR) is a robotic device currently under development at the NASA Johnson Space Center that is designed to fetch objects or to assist in retrieving an astronaut who may have become inadvertently de-tethered. The EVAHR will be required to exhibit a high degree of intelligent autonomous operation and will base much of its reasoning upon information obtained from one or more three-dimensional sensors that it will carry and control. At the highest level of visual cognition and reasoning, the EVAHR will be required to detect objects, recognize them, and estimate their spatial orientation and location. The recognition phase and estimation of spatial pose will depend on the ability of the vision system to reliably extract geometric features of the objects such as whether the surface topologies observed are planar or curved and the spatial relationships between the component surfaces. In order to achieve these tasks, accurate sensing of the operational environment and objects in the environment will therefore be critical. The qualitative and quantitative results of empirical studies of three sensors that are capable of providing three-dimensional information to the EVAHR, but using completely different hardware approaches are documented. The first of these devices is a phase shift laser with an effective operating range (ambiguity interval) of approximately 15 meters. The second sensor is a laser triangulation system designed to operate at much closer range and to provide higher resolution images. The third sensor is a dual camera stereo imaging system from which range images can also be obtained. The remainder of the report characterizes the strengths and weaknesses of each of these systems relative to quality of data extracted and how different object characteristics affect sensor operation.

Magee, Michael↗

Object recognition and pose estimation of planar objects from range data

The Extravehicular Activity Helper/Retriever (EVAHR) is a robotic device currently under development at the NASA Johnson Space Center that is designed to fetch objects or to assist in retrieving an astronaut who may have become inadvertently de-tethered. The EVAHR will be required to exhibit a high degree of intelligent autonomous operation and will base much of its reasoning upon information obtained from one or more three-dimensional sensors that it will carry and control. At the highest level of visual cognition and reasoning, the EVAHR will be required to detect objects, recognize them, and estimate their spatial orientation and location. The recognition phase and estimation of spatial pose will depend on the ability of the vision system to reliably extract geometric features of the objects such as whether the surface topologies observed are planar or curved and the spatial relationships between the component surfaces. In order to achieve these tasks, three-dimensional sensing of the operational environment and objects in the environment will therefore be essential. One of the sensors being considered to provide image data for object recognition and pose estimation is a phase-shift laser scanner. The characteristics of the data provided by this scanner have been studied and algorithms have been developed for segmenting range images into planar surfaces, extracting basic features such as surface area, and recognizing the object based on the characteristics of extracted features. Also, an approach has been developed for estimating the spatial orientation and location of the recognized object based on orientations of extracted planes and their intersection points. This paper presents some of the algorithms that have been developed for the purpose of recognizing and estimating the pose of objects as viewed by the laser scanner, and characterizes the desirability and utility of these algorithms within the context of the scanner itself, considering data quality and noise.

Pendleton, Thomas W.↗

Constructing a Knowledge Graph & Applying Graph Algorithms to Draw Insights about GES-DISC Jira Tickets

In order to assess the complexities of Jira tickets created by NASA Goddard Earth Sciences Data and Information Services Center (GES-DISC), it was beneficial to create a knowledge graph. The knowledge graph receives ticket data through the Jira API. The creation of a knowledge graph will help to answer high-level questions about internal structure, knowledge gaps, and team organization within GES-DISC. To work towards this goal, the knowledge graph was constructed in adockerizedNeo4j graph database. Once the graph had been created, graph algorithms were applied to answer high-level questions, such as exploring the role of staff in relation to projects, which qualities of a ticket contribute to the formation of communities within the graph, etc. To answer these questions, centrality and community detection algorithms were applied using Cypher querying language. The analysis of the results of the algorithms indicated that, as expected, certain individuals were more connected to some projects, while others were serving as hub nodes between two or more projects. Similarly, specific keywords are more likely to increase a Jira ticket’s centrality in the graph. In terms of community detection, when tickets in a community have certain qualities, it is more probable for them to be grouped together. To best visualize which nodes had higher centrality scores or were grouped into certain communities, interactive graphs were created in Python using Plotly and Matplotlib. Ultimately, the project was successful in creating and deploying a knowledge graph to better understand the relationships between data in GES-DISC Jira tickets

Rebecca Lipton↗

Using commercial high-resolution satellite imagery to monitor a nuisance macroalga in the largest marine protected area in the U.S.A.

Satellite imagery is a useful tool for monitoring and mapping the distribution of invasive or nuisance algal species on coral reefs over the temporal and spatial scales needed for ecosystem management. Visual inspections of high-resolution satellite imagery were used to detect the newly discovered nuisance alga, Chondria tumulosa , at Manawai (Pearl and Hermes Atoll) in combination with ground-truthing surveys. Low-albedo (“dark”) survey sites on spur habitats were associated with mean C. tumulosa cover seven times higher than adjacent high-albedo (“light”) sites. There was an inverse relationship between C. tumulosa percent cover at ground-truthing sites and mean reflectance values. Archival satellite imagery showed that areas of high C. tumulosa cover (i.e., dark patches) were not evident on or before 2015 on the northeast backreef. This case study is the first to apply satellite imagery to target a nuisance red macroalgal bloom on a coral reef. The ability to use satellites for the detection of nuisance or invasive benthic species, such as expansive mats of C. tumulosa , provides managers with a valuable tool, especially in remote regions.

Invasive↗

Proposed dynamic phase difference method for the detection of tile debonding from the space shuttle orbiter

A noncontracting, semi-global, dynamic technique was developed for detecting loose tiles on the space shuttle orbiter. In laboratory tests on a single tile, the substrate was excited into lateral motion at a constant frequency and amplitude of 2g. The phase relationship between the motions of tile and substrate was examined by noncontacting probes in order to relate the dynamic properties of the tile SIP system to its fatigue history; by a visual technique using a stroboscope and split screen video monitor for practical application in the field. When the substrate is excited at an appropriate frequency (between 30 and 60 Hz), a good tile moves in phase and a loose tile out of phase with the substrate. The out of phase motion is readily observable in the form of a "beat" between the tile and a reference marker on the substrate.

Zuckerwar, A. J.↗

Sensitivity and comparison evaluation of Saturn 5 liquid penetrants

Results of a sensitivity and comparison evaluation performed on six liquid penetrants that were used on the Saturn 5 vehicle and other space hardware to detect surface discontinuities are described. The relationship between penetrant materials and crack definition capabilities, the optimum penetrant materials evaluation method, and the optimum measurement methods for crack dimensions were investigated. A unique method of precise developer thickness control was envolved, utilizing clear radiographic film and a densitometer. The method of evaluation included five aluminum alloy, 2219-T87, specimens that were heated and then quenched in cold water to produce cracks. The six penetrants were then applied, one at a time, and the crack indications were counted and recorded for each penetrant for comparison purposes. Measurements were made by determining the visual crack indications per linear inch and then sectioning the specimens for a metallographic count of the cracks present. This method provided a numerical approach for assigning a sensitivity index number to the penetrants. Of the six penetrants evaluated, two were not satisfactory (one was not sufficiently sensitive and the other was to sensitive, giving false indications). The other four were satisfactory with approximately the same sensitivity in the range of 78 to 80.5 percent of total cracks detected.

Jones, G. H.↗

A vision architecture for the extravehicular activity retriever

The Extravehicular Activity Retriever (EVAR) is a robotic device currently being developed by the Automation and Robotics Division at the NASA Johnson Space Center to support activities in the neighborhood of the Space Shuttle or Space Station Freedom. As the name implies, the Retriever's primary function will be to provide the capability to retrieve tools, equipment or other objects which have become detached from the spacecraft, but it will also be able to rescue a crew member who may have become inadvertently de-tethered. Later goals will include cooperative operations between a crew member and the Retriever such as fetching a tool that is required for servicing or maintenance operations. This report documents a preliminary design for a Vision System Planner (VSP) for the EVAR that is capable of achieving visual objectives provided to it by a high level task planner. Typical commands which the task planner might issue to the VSP relate to object recognition, object location determination, and obstacle detection. Upon receiving a command from the task planner, the VSP then plans a sequence of actions to achieve the specified objective using a model-based reasoning approach. This sequence may involve choosing an appropriate sensor, selecting an algorithm to process the data, reorienting the sensor, adjusting the effective resolution of the image using lens zooming capability, and/or requesting the task planner to reposition the EVAR to obtain a different view of the object. An initial version of the Vision System Planner which realizes the above capabilities using simulated images has been implemented and tested. The remaining sections describe the architecture and capabilities of the VSP and its relationship to the high level task planner. In addition, typical plans that are generated to achieve visual goals for various scenarios will be discussed. Specific topics to be addressed will include object search strategies, repositioning of the EVAR to improve the quality of information obtained from the sensors, complementary usage of the sensors and redundant capabilities.

Magee, Michael↗

A vision system planner for increasing the autonomy of the Extravehicular Activity Helper/Retriever

The Extravehicular Activity Retriever (EVAR) is a robotic device currently being developed by the Automation and Robotics Division at the NASA Johnson Space Center to support activities in the neighborhood of the Space Shuttle or Space Station Freedom. As the name implies, the Retriever's primary function will be to provide the capability to retrieve tools and equipment or other objects which have become detached from the spacecraft, but it will also be able to rescue a crew member who may have become inadvertently de-tethered. Later goals will include cooperative operations between a crew member and the Retriever such as fetching a tool that is required for servicing or maintenance operations. This paper documents a preliminary design for a Vision System Planner (VSP) for the EVAR that is capable of achieving visual objectives provided to it by a high level task planner. Typical commands which the task planner might issue to the VSP relate to object recognition, object location determination, and obstacle detection. Upon receiving a command from the task planner, the VSP then plans a sequence of actions to achieve the specified objective using a model-based reasoning approach. This sequence may involve choosing an appropriate sensor, selecting an algorithm to process the data, reorienting the sensor, adjusting the effective resolution of the image using lens zooming capability, and/or requesting the task planner to reposition the EVAR to obtain a different view of the object. An initial version of the Vision System Planner which realizes the above capabilities using simulated images has been implemented and tested. The remaining sections describe the architecture and capabilities of the VSP and its relationship to the high level task planner. In addition, typical plans that are generated to achieve visual goals for various scenarios are discussed. Specific topics to be addressed will include object search strategies, repositioning of the EVAR to improve the quality of information obtained from the sensors, and complementary usage of the sensors and redundant capabilities.

Magee, Michael↗

Reflectance measurements for the detection and mapping of soil limitations

During 1971 and 1972 research was conducted on two fallow fields in the proposed Oahe Irrigation Project to investigate the relationship between the tonal variations observed on aerial photographs and the principal soil limitations of the area. A grid sampling procedure was used to collected detailed field data during the 1972 growing season. The field data was compared to imagery collected on May 14, 1971 at 3050 meters altitude. The imagery and field data were initially evaluated by a visual analysis. Correlation and regression analysis revealed a highly significant correlation and regression analysis revealed a highly significant correlation between the digitized color infrared film data and soil properties such as organic matter content, color, depth to carbonates, bulk density and reflectivity. Computer classification of the multiemulsion film data resulted in maps delineating the areas containing claypan and erosion limitations. Reflectance data from the red spectral band provided the best results.

Benson, L. A.↗

CAPS Simulation Environment Development

The final design for an effective Comet/Asteroid Protection System (CAPS) will likely come after a number of competing designs have been simulated and evaluated. Because of the large number of design parameters involved in a system capable of detecting an object, accurately determining its orbit, and diverting the impact threat, a comprehensive simulation environment will be an extremely valuable tool for the CAPS designers. A successful simulation/design tool will aid the user in identifying the critical parameters in the system and eventually allow for automatic optimization of the design once the relationships of the key parameters are understood. A CAPS configuration will consist of space-based detectors whose purpose is to scan the celestial sphere in search of objects likely to make a close approach to Earth and to determine with the greatest possible accuracy the orbits of those objects. Other components of a CAPS configuration may include systems for modifying the orbits of approaching objects, either for the purpose of preventing a collision or for positioning the object into an orbit where it can be studied or used as a mineral resource. The Synergistic Engineering Environment (SEE) is a space-systems design, evaluation, and visualization software tool being leveraged to simulate these aspects of the CAPS study. The long-term goal of the SEE is to provide capabilities to allow the user to build and compare various CAPS designs by running end-to-end simulations that encompass the scanning phase, the orbit determination phase, and the orbit modification phase of a given scenario. Herein, a brief description of the expected simulation phases is provided, the current status and available features of the SEE software system is reported, and examples are shown of how the system is used to build and evaluate a CAPS detection design. Conclusions and the roadmap for future development of the SEE are also presented.

Murphy, Douglas G.↗

Airborne Hyperspectral Sensing of Monitoring Harmful Algal Blooms in the Great Lakes Region: System Calibration and Validation

Harmful algal blooms (HABs) in Lake Erie have been prominent in recent years. The bloom in 2014 reached a severe level causing the State of Ohio to declare a state of emergency. At that time NASA Glenn Research Center was requested by stakeholders to help monitor the blooms in Lake Erie. Glenn conducted flights twice a week in August and September and assembled and distributed the HAB information to the shoreline water resource managers using its hyperspectral imaging sensor (in development since 2006), the S􀂱3 Viking aircraft, and funding resources from the NASA Headquarters Earth Science Division. Since then, the State of Ohio, National Oceanic and Atmospheric Administration (NOAA), and U.S. Environmental Protection Agency (EPA) have elevated their funding and activities for observing, monitoring, and addressing the root cause of HABs. Also, the communities and stakeholders have persistently requested NASA Glenn􀂶s participation in HAB observation. Abundant field campaigns and sample analyses have been funded by Ohio and NOAA, which provided a great opportunity for NASA to advance science and airborne hyperspectral remote sensing economically. Capitalizing on this opportunity to advance the science of algal blooms and remote sensing, NASA Glenn conducted the Airborne Hyperspectral Observation of harmful algal blooms campaign in 2015 that was, in many respects, twice as large as the 2014 campaign. Focusing mostly on Lake Erie, but also including other small inland lakes and the Ohio River, the campaign was conducted in partnership with a large number of partners specializing in marine science and remote sensing. Airborne hyperspectral observation of HABs holds promise to distinguish potential HABs from nuisance blooms, determine their concentrations, and delineate their movement in an augmented spatial and temporal resolution and under clouds􀂲all of which are excellent complements to satellite observations. Working with collaborators at several Ohio and Michigan institutions as well as one in South Dakota and one in Alabama, this effort was able to provide next-day georeferenced estimates of cyanobacteria and scum concentrations. Very prompt processing and analysis of the hyperspectral imagery is necessary for the information to be acted upon. For example, a next-day report of an overflight over the Ohio River indicated that a bloom could be present as far downstream as the Cincinnati intake, but the Ohio EPA had not received visual reports of a bloom that far downstream. Water samples were obtained at the Cincinnati water intake, based on the flight data, and detected microcystins in the source water. The flight data helped State and municipal authorities realize the potential extent of that bloom, and triggered response sampling, before the visual river-wide scums started forming. The present document describes the process that was utilized to take raw remote sensing data and create information products; this includes system calibration and validation, efforts to correct atmospheric effects, and algorithms that produce the data products. Furthermore, successful research into improved algorithms for expanding the capability to delineate in water constituents is included. Finally, comparisons that show expected relationships between ground-based measurements and hyperspectral imager version 2 (HSI2) data results are presented, giving confidence in the remote sensing products.

Hyperspectral Imaging↗

Unimodal Imaging of Monovalent Metal-Chelator Complexes and Lipids by MALDI Imaging Mass Spectrometry

Careful regulation of monovalent metal ions (M + ) is necessary to maintain a functional cellular system. Of these ions, appropriate sodium (Na + ) and potassium (K + ) concentrations are particularly integral for electrochemical signaling, as well as the secondary transport of nutrients and waste. Dysregulation of M + homeostasis can disrupt these mechanisms, potentially influencing the metabolism of downstream biomolecules such as lipids. Thus, the relationship between M + abundances and related biomolecular distributions must be elucidated to better understand the physiology of healthy and disordered tissues. Traditional techniques for imaging biological metal distributions include SIMS, LA-ICP-MS, and XRF; however, these capabilities are limited to elemental analysis or the analysis of molecular fragments and must be paired with other modalities to visualize distributions of more complex biomolecules within the same or similar samples. Conversely, matrix-assisted laser desorption/ionization imaging mass spectrometry (MALDI IMS) is a powerful tool often used for mapping such biomolecular distributions, but current methods are unable to detect metals within tissue. This study illustrates a novel methodology that adds metal detection to the MALDI IMS repertoire through which the simultaneous detection of M + metals and lipids is achievable. Using a robotic sprayer for homogeneous application, on-tissue deposition of the chelator deferiprone (DEF) enables subsequent detection of the ionizable metal-chelator complex by MALDI without hindering lipid detection. Our work provides proof-of-concept data for the simultaneous detection of K + , Na + , and intact lipids using MALDI IMS.

59 BASIC BIOLOGICAL SCIENCES↗

Vigilance and task load - In search of the inverted U

The 'Inverted-U Hypothesis' states that for a given task, there is an optimal level of workload or demand that yields the highest level of performance. A departure in either direction will result in a monotonically lower performance level, hence an inverted-U-shaped relationship between task demand and quality of performance. Most studies to date have failed to demonstrate the left-hand branch of the curve, that is, the regime in which performance presumably rises as load increases. The purpose of this study was to explore whether low-level additional demand on the monitor would result in improved performance. Four groups of subjects performed a visual monitoring task for 48 min, then two of the four groups were given additional tasks, and a third had potentially distracting information on its display. Results indicated that the two groups with additional demand detected more signals than did the control group or the control-plus-distraction group. There were no significant differences in false alarms.

Wiener, E. L.↗

Intelligent Change Detection System: Autonomous Intelligent Machine Agent Model Development

NASA’s significant role in facilitating the harmonious integration of unmanned aircraft systems (UAS), with other aerial vehicles operating in the National Airspace System (NAS), has revealed a need for more advanced technological tools than are being utilized currently. This technology would lend itself to significantly assisting Direct-Action Aviation Personnel (DAAP) with the ingress and egress of UAS operations within the NAS. Providing research findings that would reduce technical barriers, associated with UAS-NAS integration, has been a persistent effort by both NASA and the FAA. One such research effort, pursued by NASA’s Transformative Tools and Technologies – Revolutionary Aviation Mobility (T3-RAM) project, is the development of an autonomous intelligent machine (AIM) agent that would aid DAAP functioning as implemented in remote ground control stations (RGCS). This evolution of the “human-machine” symbiosis, within the aviation environment, is necessary for many reasons. For example, there are projections of large increases to the 864,000 registered UAS and 45,000 aviation operations taking place in the NAS each day. With a data output range from 1 to 20 terabytes per flight or each aerial vehicle, which is projected to have proportional rate increase to that of registered UASs. It is evident, that due to the projected increase of UASs and their generated data, the human-agent’s data managing capabilities will be quickly overwhelmed by the enormous amounts of data emanating in the NAS. The research efforts presented in this paper puts forward results from the development, assessment, and verification of a previously conceptualized AIM-Agent that combats actionable-data (information) errors resulting from the visual perception phenomenon known as “change blindness” (CB). CB has been identified as one of the main culprits of information erroring encountered within the ground control station operator (GCSO) community.

Change Blindness↗

Topological Characterization and Uncertainty Visualization of Atmospheric Rivers

Atmospheric rivers (ARs) are long, narrow regions of water vapor in the Earth's atmosphere that transport heat and moisture from the tropics to the mid-latitudes. ARs are often associated with extreme weather events in North America and contribute significantly to water supply and flood risk. However, characterizing ARs has been a major challenge due to the lack of a universal definition and their structural variations. Existing AR detection tools (ARDTs) produce distinct AR boundaries for the same event, making the risk assessment of ARs a difficult task. Understanding these uncertainties is crucial to improving the predictability of AR impacts, including their landfall areas and associated precipitation, which could cause catastrophic flooding and landslides over the coastal regions. In this work, we develop an uncertainty visualization framework that captures boundary and interior uncertainties, i.e., structural variations, of an ensemble of ARs that arise from a set of ARDTs. We first provide a statistical overview of the AR boundaries using the contour boxplots of Whitaker et al. that highlight the structural variations of AR boundaries based on their nesting relationships. We then introduce the topological skeletons of ARs based on Morse complexes that characterize the interior variation of an ensemble of ARs. We propose an uncertainty visualization of these topological skeletons, inspired by MetroSets of Jacobson et al. that emphasizes the agreements and disagreements across the ensemble members. Through case studies and expert feedback, we demonstrate that the two approaches complement each other, and together they could facilitate an effective comparative analysis process and provide a more confident outlook on an AR's shape, area, and onshore impact.

54 ENVIRONMENTAL SCIENCES↗

Advances and Challenges in Fluorescence in situ Hybridization for Visualizing Fungal Endobacteria

We report that Several bacteria have long been known to interact intimately with fungi, but molecular approaches have only recently uncovered how cosmopolitan these interactions are in nature. Currently, bacterial–fungal interactions (BFI) are inferred based on patterns of co-occurrence in amplicon sequencing investigations. However, determining the nature of these interactions, whether the bacteria are internally or externally associated, remains a grand challenge in BFI research. Fluorescence in situhybridization (FISH) is a robust method that targets unique sequences of interest which can be employed for visualizing intra-hyphal targets, such as mitochondrial organelles or, as in this study, bacteria. We evaluate the challenges and employable strategies to resolve intra-hyphal BFI to address pertinent criteria in BFI research, such as culturing media, spatial distribution of bacteria, and abundance of bacterial 16S rRNA copies for fluorescent labeling. While these experimental factors influence labeling and detection of endobacteria, we demonstrate how to overcome these challenges thorough permeabilization, appropriate media choice, and targeted amplification using hybridization chain reaction FISH. Such microscopy imaging approaches can now be utilized by the broader research community to complement sequence-based investigations and provide more conclusive evidence on the nature of specific bacterial–fungal relationships.

59 BASIC BIOLOGICAL SCIENCES↗