Search NASA⌕ Search

SEARCH · Search NASA

Results for “visual system”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Acting to gain information: Real-time reasoning meets real-time perception

Recent advances in intelligent reactive systems suggest new approaches to the problem of deriving task-relevant information from perceptual systems in real time. The author will describe work in progress aimed at coupling intelligent control mechanisms to real-time perception systems, with special emphasis on frame rate visual measurement systems. A model for integrated reasoning and perception will be discussed, and recent progress in applying these ideas to problems of sensor utilization for efficient recognition and tracking will be described.

Rosenschein, Stan↗

A Heterogeneous System for Eagle Detection, Deterrent, and Wildlife Collision Detection for Wind Turbines (Final Technical Report)

This report summarizes the design, implementation, and test of an integrated system for automated detection and deterrence of eagles, with included wind turbine blade strike detection and imaging functionality. A machine learning approach was used in conjunction with a 360° camera system for automated detection and classification of golden eagles. This was developed using footage obtained from trained golden eagles and other raptors, in collaboration with wildlife biologists and professional bird handlers. Oregon State University developed a visual deterrent system, which uses inflatable anthropomorphic sculptures with random, kinetic motion to deter eagles, and conducted limited field testing on live eagles; the deterrent can be triggered by the visual detection of eagles using the vision system. Finally, a multi-sensor module was developed that is mounted at the turbine blade root. This module measures vibration and other motions to detect blade strikes, and an integrated on-blade camera captures an image of any impacting objects. Long-term, this blade strike detection system is intended to support an automatic monitoring and certification system for the eagle detection and deterent system. Independent field testing of each system component is described. Testing of the integrated system on an operational wind turbine was conducted across three separate field tests. This includes multi-day fields tests on a General Electric 1.5MW wind turbine at the National Renewable Energy Laboratory (NREL) National Wind Technology Center (NWTC) in Boulder, CO in October 2018 and July 2019; installation procedures, test procedures, and a summary of collected data are presented. A third multi-day on-turbine field test is also presented, which was performed using a General Electric 1.5MW wind turbine at the North American Wind Research and Training Center (NAWRTC) at Mesalands Community College, Tucumcari, NM in April 2019. Across these field tests, the vision system was demonstrated using unmanned aerial vehicles (UAV), and the eagle classification algorithm was not tested; the visual deterrent system was demonstrated, including automatic, remote deployment following surrogate visual detections; and, multi-sensor on-blade data was recorded across multiple wind turbine operational conditions and through more than 100 surrogate blade strikes using soft projectiles, including the successful demonstration of automatic image capture of striking objects. This data set was also used for offline development and validation of enhanced collision detection algorithms. As summarized in this report, the development and field validation of an integrated detection, deterrent, and blade collision detection system represents a critical proof of concept for future technology development of related detection and deterrent technologies, where both deterrent as well as collision detection recording devices are needed for future siting, monitoring, and operation of wind turbine installations, both onshore and offshore.

17 WIND ENERGY↗

Spatial orientation of the vestibular system

1. A simplified three-dimensional state space model of visual vestibular interaction was formulated. Matrix and dynamical system operators representing coupling from the semicircular canals and the visual system to the velocity storage integrator were incorporated into the model. 2. It was postulated that the system matrix for a tilted position was a composition of two linear transformations of the system matrix for the upright position. One transformation modifies the eigenvalues of the system matrix while another rotates the pitch and roll eigenvectors with the head, while maintaining the yaw axis eigenvector approximately spatially invariant. Using this representation, the response characteristics of the pitch, roll, and yaw eye velocity were obtained in terms of the eigenvalues and associated eigenvectors. 3. Using OKAN data obtained from monkeys and comparing to the model predictions, the eigenvalues and eigenvectors of the system matrix were identified as a function of tilt to the side or of tilt to the prone positions, using a modification of the Marquardt algorithm. The yaw eigenvector for right-side-down tilt and for downward pitch cross-coupling was approximately 30 degrees from the spatial vertical. For the prone position, the eigenvector was computed to be approximately 20 degrees relative to the spatial vertical. For both side-down and prone positions, oblique OKN induced along eigenvector directions generated OKAN which decayed to zero along a straight line with approximately a single time constant. This was verified by a spectral analysis of the residual sequence about the straight line fit to the decaying data. The residual sequence was associated with a narrow autocorrelation function and a wide power spectrum. 4. Parameters found using the Marquardt algorithm were incorporated into the model. Diagonal matrices in a head coordinate frame were introduced to represent the direct pathway and the coupling of the visual system to the integrator. Model simulations predicted the behavior of yaw and pitch OKN and OKAN when the animal was upright, as well as the cross-coupling in the tilted position. The trajectories in velocity space were also accurately simulated. 5. There were similarities between the monkey eigenvectors and human perception of the spatial vertical. For side-down tilts and downward eye velocity cross-coupling, there was only an Aubert (A) effect. For upward eye velocity cross-coupling there were both Muller (E) and Aubert (A) effects. The mean of the eigenvectors for upward and downward eye velocities overlay human 1 x g perceptual data.(ABSTRACT TRUNCATED AT 400 WORDS).

NASA Discipline Neuroscience↗

Effects of visual and motion simulation cueing systems on pilot performance during takeoffs with engine failures

Data are presented that show the effects of visual and motion during cueing on pilot performance during takeoffs with engine failures. Four groups of USAF pilots flew a simulated KC-135 using four different cueing systems. The most basic of these systems was of the instrument-only type. Visual scene simulation and/or motion simulation was added to produce the other systems. Learning curves, mean performance, and subjective data are examined. The results show that the addition of visual cueing results in significant improvement in pilot performance, but the combined use of visual and motion cueing results in far better performance.

Parris, B. L.↗

Fault-Tolerant Control For A Robotic Inspection System

Report describes first phase of continuing program of research on fault-tolerant control subsystem of telerobotic visual-inspection system. Goal of program to develop robotic system for remotely controlled visual inspection of structures in outer space.

Tso, Kam Sing↗

Real-time tracking of objects for a KC-135 microgravity experiment

The design of a visual tracking system for use on the Extra-Vehicular Activity Helper/Retriever (EVAHR) is discussed. EVAHR is an autonomous robot designed to perform numerous tasks in an orbital microgravity environment. Since the ability to grasp a freely translating and rotating object is vital to the robot's mission, the EVAHR must analyze range image generated by the primary sensor. This allows EVAHR to locate and focus its sensors so that an accurate set of object poses can be determined and a grasp strategy planned. To test the visual tracking system being developed, a mathematical simulation was used to model the space station environment and maintain dynamics on the EVAHR and any other free floating objects. A second phase of the investigation consists of a series of experiments carried out aboard a KC-135 aircraft flying a parabolic trajectory to simulate microgravity.

Littlefield, Mark L.↗

Uncrewed Aerial System Traffic Management Beyond Visual Line of Sight Multi Operator Technology Assessment Simulation

UAS Traffic Management (UTM) is a rapidly evolving space with increasing demand for regulation surrounding more complex operations. Beyond visual line of sight (BVLOS) operations are among these complex operations. The NASA UTM BVLOS sub-project is focusing on enabling more routine BVLOS operations through data collection for support of standards formulation. The Multi Operator Technology Assessment (MOTA) simulation is one of these activities that collects data on BVLOS operations within the same geographical area while sharing operational intents through a USS. Data collected includes workload, situation awareness, and usability on nominal and off-nominal operations. Results of this study are intended to provide recommendations for standards as well as provide insight on improvements to the systems under test. NASA intends to incorporate those improvements into their operations to support and updated BVLOS waiver from the FAA’s Near-Term Approval Process (NTAP).

Bryan J Petty↗

Uncrewed Aerial System Traffic Management Beyond Visual Line of Sight Multi Operator Technology Assessment Simulation

UAS Traffic Management (UTM) is a rapidly evolving space with increasing demand for regulation surrounding more complex operations. Beyond visual line of sight (BVLOS) operations are among these complex operations. The NASA UTM BVLOS sub-project is focusing on enabling more routine BVLOS operations through data collection for support of standards formulation. The Multi Operator Technology Assessment (MOTA) simulation is one of these activities that collects data on BVLOS operations within the same geographical area while sharing operational intents through a USS. Data collected includes workload, situation awareness, and usability on nominal and off-nominal operations. Results of this study are intended to provide recommendations for standards as well as provide insight on improvements to the systems under test. NASA intends to incorporate those improvements into their operations to support and updated BVLOS waiver from the FAA’s Near-Term Approval Process (NTAP).

Bryan J Petty↗

Giovanni: A System for Rapid Access, Visualization and Analysis of Earth Science Data Online

Collecting data and understanding data structures traditionally are the first steps that a user must take, before the core investigation can begin. This is a time-consuming and challenging task, especially when science objectives require users to deal with large multi-sensor data that are usually in different formats and internal structures. The Goddard Earth Sciences Data and Information Services Center (GES DISC) has created the GES DISC Interactive Online Visualization and ANalysis Infrastructure, Giovanni, to enable Web-based visualization and analysis of satellite remotely sensed meteorological, oceanographic, and hydrologic data sets, without users having to download data. The current operational Giovanni interfaces provide the capability to process a number of important satellite measurements, such as (1) ozone and other trace gases from TOMS, OMI, HALOE, and MLS; (2) air temperature, water vapor, and geopotential height from AIRS; (3) aerosols from MODIS TerrdAqua, and GOCART model; (4) precipitation from TRMM and ground measurements; (5) chlorophyll and other ocean color products from SeaWiFS and MODIS Aqua; and (6) sea surface temperature from MODIS Aqua. Depending on the input data structure, the system provides simple statistical analysis and creates time-averaged area plot, area-averaged time series, animations, Hovmoller latitude vs. time and longitude vs. time plots, as well as vertical profiles. The inter-comparison interfaces allow a user to compare observations from different instruments, to conduct anomaly analysis, and to study basic relationships between physical parameters. Giovanni handles data with different temporal and spatial resolutions and, thus, enables both regional and global long-term climate research and short-term special events investigation, as well as data validations and assessments. Because of its simplicity of usage, Giovanni is powerful and versatile, able to assist a wide range of users, from the discipline scientists conducting preliminary research in various fields, to students in the classroom learning about weather, climate, and other natural phenomena. Giovanni can be accessed from: http://disc. esfc.nasa.gov/techlab/giovanni/index.shtml

Shen, S.↗

Dark focus of accommodation as dependent and independent variables in visual display technology

When independent stimuli are available for accommodation, as in the dark or under low contrast conditions, the lens seeks its resting position. Individual differences in resting positions are reliable, under autonomic control, and can change with visual task demands. We hypothesized that motion sickness in a flight simulator might result in dark focus changes. Method: Subjects received training flights in three different Navy flight simulators. Two were helicopter simulators entailed CRT presentation using infinity optics, one involved a dome presentation of a computer graphic visual projection system. Results: In all three experiments there were significant differences between dark focus activity before and after simulator exposure when comparisons were made between sick and not-sick pilot subjects. In two of these experiments, the average shift in dark focus for the sick subjects was toward increased myopia when each subject was compared to his own baseline. In the third experiment, the group showed an average shift outward of small amount and the subjects who were sick showed significantly less outward movement than those who were symptom free. Conclusions: Although the relationship is not a simple one, dark focus changes in simulator sickness imply parasympathetic activity. Because changes can occur in relation to endogenous and exogenous events, such measurement may have useful applications as dependent measures in studies of visually coupled systems, virtual reality systems, and space adaptation syndrome.

Jones, Sherrie↗

Using Virtual Reality to Envision Deployment of Spacesuit-Compatible Augmented Reality Displays for Lunar Surface Operations

The National Aeronautics and Space Administration (NASA) will soon land crew on the lunar surface to establish a sustainable presence and develop operational concepts for future long-duration missions. New technologies will be necessary to extend planning and execution capabilities for lunar surface activities. The Joint Augmented Reality Visual Informatics System (Joint AR) at NASA Johnson Space Center (JSC) is one such technology. Joint AR is a suit-mounted augmented reality (AR) display and compute system which facilitates unprecedented information exchange and data visualization capabilities between mission support operators and suited crew. This paper describes challenges associated with developing an AR technology for an envisioned work domain by applying a sociotechnical lens to the iterative testing and development of novel AR technology through virtual reality (VR). A foundational VR testbed was established, providing a high-fidelity approximation of the lunar surface and enabling testing of envisioned AR system features in parallel with real world product development. Using this environment, a series of human-in-the-loop experiments were conducted using VR to deploy a notional AR system supporting use cases envisioned for lunar exploration extravehicular activity (xEVA). Our findings indicate VR is a powerful and immersive tool for testing capabilities which extend beyond the limitations of current AR technology. Our VR testbed enables early testing of proposed system features, advancing identification of high-value features and driving present-day development of Joint AR. Future work directions are discussed, including lessons learned and a roadmap for an iterative research and development approach applying VR (among other testbeds) to accelerate Joint AR system maturation.

Augmented reality↗

Visualization and Analysis of Solar System Small Bodies with NASA's Solar System Treks Project

In its investigations of Vesta and Ceres, NASA’s Dawn mission has returned spectacular data detailing the surfaces of these two prominent small bodies in our Solar System’s asteroid belt. In order to greatly facilitate dissemination, visualization, and analysis of this data, and public understanding of the mission, the Dawn mission has partnered with NASA’s Solar System Treks Project (SSTP). SSTP has recently released an update to the Vesta Trek online portal (https://trek.nasa.gov/vesta/) and has released a new Ceres Trek portal (https://trek.nasa.gov/ceres/). This presentation will showcase the use of the Ceres Trek and Vesta Trek portals and demonstrate how they can be used to visualize and analyze particularly interesting landforms such as the pitted terrain on Vesta and relic cryovolcanoes on Ceres. We will also demonstrate the new VR capability that has been added to the portals, allowing users to generate their own virtual reality flyovers for any user-defined paths along the bodies’ surfaces. In addition to highlighting the portals for Ceres and Vesta, the presentation will preview additional portals being planned/developed for other small bodies. NASA and JAXA have requested the development of a portal for the asteroid Ryugu to facilitate dissemination, visualization, and analysis of data from Japan’s Hayabusa2 mission, and a portal for Mars’ moon Phobos in support of mission planning for Japan’s MMX mission. We are also planning a portal for the asteroid Bennu with data from the OSIRIS-Rex mission. All of these products are efforts in the NASA Solar System Treks Project (SSTP), available at https://trek.nasa.gov. NASA's Solar System Trek online portals provide web-based suites of interactive data visualization and analysis tools to enable mission planners, planetary scientists, students, and the general public to access mapped data products from past and current missions for a growing number of planetary bodies including the Moon, Mars, Vesta, etc. These portals are being used for site selection and analysis by NASA and a number of its international partners, supporting upcoming missions. In addition to demonstrating the capabilities of selected portals in this presentation, we will solicit input from the community for ideas for future enhancements to the portals.

Day, Brian↗

Knocksideways in plants: an inducible system for in planta visualization of protein interactions

Understanding protein-protein interactions (PPIs) is key to unlocking the secrets of various cellular processes. While many tools have been developed to detect PPIs, such as the yeast two-hybrid assay, bimolecular fluorescence complementation, and affinity purification, there is great demand for additional methods to complement existing ones. As all approaches have limitations, evidence from at least two independent assays is required to validate PPIs. In a Breakthrough Report, Joanna Winkler and colleagues present here a promising method, named “knocksideways in plants” (KSP), for inducible visualization of PPIs in planta.

59 BASIC BIOLOGICAL SCIENCES↗

The Multiplanet System TOI-421: A Warm Neptune and a Super Puffy Mini-Neptune Transiting a G9 V Star in a Visual Binary

We report the discovery of a warm Neptune and a hot sub-Neptune transiting TOI-421 (BD-14 1137, TIC 94986319), a bright (V = 9.9) G9 dwarf star in a visual binary system observed by the Transiting Exoplanet Survey Satellite (TESS) space mission in Sectors 5 and 6. We performed ground-based follow-up observations—comprised of Las Cumbres Observatory Global Telescope transit photometry, NIRC2 adaptive optics imaging, and FIbre-fed Echellé Spectrograph, CORALIE, High Accuracy Radial velocity Planet Searcher, High Resolution Échelle Spectrometer, and Planet Finder Spectrograph high-precision Doppler measurements—and confirmed the planetary nature of the 16 day transiting candidate announced by the TESS team. We discovered an additional radial velocity signal with a period of five days induced by the presence of a second planet in the system, which we also found to transit its host star. We found that the inner mini-Neptune, TOI-421 b, has an orbital period of P{sub b} = 5.19672 ± 0.00049 days, a mass of M{sub b} = 7.17 ± 0.66 M{sub ⊕}, and a radius of R{sub b} = 2.68{sub −0.18}{sup +0.19} R{sub ⊕}, whereas the outer warm Neptune, TOI-421 c, has a period of P{sub c} = 16.06819 ± 0.00035 days, a mass of M{sub c} = 16.42{sub −1.04}{sup +1.06} M{sub ⊕}, a radius of R{sub c} = 5.09{sub −0.15}{sup +0.16} R{sub ⊕}, and a density of ρ{sub c} = 0.685{sub −0.072}{sup +0.080} g cm{sup −3}. With its characteristics, the outer planet (ρ{sub c} = 0.685{sub −0.072}{sup +0.080} g cm{sup −3}) is placed in the intriguing class of the super-puffy mini-Neptunes. TOI-421 b and TOI-421 c are found to be well-suited for atmospheric characterization. Our atmospheric simulations predict significant Lyα transit absorption, due to strong hydrogen escape in both planets, as well as the presence of detectable CH{sub 4} in the atmosphere of TOI-421 c if equilibrium chemistry is assumed.

79 ASTRONOMY AND ASTROPHYSICS↗

A piloted simulator investigation of side-stick controller/stability and control augmentation system requirements for helicopter visual flight tasks

A piloted simulator experiment was conducted to assess the effects of side-stick controller characteristics and level of stability and control augmentation on handling qualities for several low-altitude control tasks. Visual flight tasks were simulated using four-window computer-generated imagery depicting either a nap-of-the-earth course or a runway with obstacles positioned to provide a slalom course. Both low speed and forward flight control laws were implemented, and a method for automatically switching control modes was developed. Variations in force-deflection characteristics and the number of axes controlled through an integrated side-stick were investigated. With high levels of stability and control augmentation, a four-axis controller with small-deflection in all four axes achieved satisfactory handling qualities for low-speed tasks.

Landis, K. H.↗

The 4-D approach to visual control of autonomous systems

Development of a 4-D approach to dynamic machine vision is described. Core elements of this method are spatio-temporal models oriented towards objects and laws of perspective projection in a foward mode. Integration of multi-sensory measurement data was achieved through spatio-temporal models as invariants for object recognition. Situation assessment and long term predictions were allowed through maintenance of a symbolic 4-D image of processes involving objects. Behavioral capabilities were easily realized by state feedback and feed-foward control.

Dickmanns, Ernst D.↗