Search NASA⌕ Search

SEARCH · Search NASA

Results for “computer vision system”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Aviation Research and the Internet

The Internet is a network of networks. It was originally funded by the Defense Advanced Research Projects Agency or DOD/DARPA and evolved in part from the connection of supercomputer sites across the United States. The National Science Foundation (NSF) made the most of their supercomputers by connecting the sites to each other. This made the supercomputers more efficient and now allows scientists, engineers and researchers to access the supercomputers from their own labs and offices. The high speed networks that connect the NSF supercomputers form the backbone of the Internet. The World Wide Web (WWW) is a menu system. It gathers Internet resources from all over the world into a series of screens that appear on your computer. The WWW is also a distributed. The distributed system stores data information on many computers (servers). These servers can go out and get data when you ask for it. Hypermedia is the base of the WWW. One can 'click' on a section and visit other hypermedia (pages). Our approach to demonstrating the importance of aviation research through the Internet began with learning how to put pages on the Internet (on-line) ourselves. We were assigned two aviation companies; Vision Micro Systems Inc. and Innovative Aerodynamic Technologies (IAT). We developed home pages for these SBIR companies. The equipment used to create the pages were the UNIX and Macintosh machines. HTML Supertext software was used to write the pages and the Sharp JX600S scanner to scan the images. As a result, with the use of the UNIX, Macintosh, Sun, PC, and AXIL machines, we were able to present our home pages to over 800,000 visitors.

Scott, Antoinette M.↗

Real-time model-based vision system for object acquisition and tracking

A machine vision system is described which is designed to acquire and track polyhedral objects moving and rotating in space by means of two or more cameras, programmable image-processing hardware, and a general-purpose computer for high-level functions. The image-processing hardware is capable of performing a large variety of operations on images and on image-like arrays of data. Acquisition utilizes image locations and velocities of the features extracted by the image-processing hardware to determine the three-dimensional position, orientation, velocity, and angular velocity of the object. Tracking correlates edges detected in the current image with edge locations predicted from an internal model of the object and its motion, continually updating velocity information to predict where edges should appear in future frames. With some 10 frames processed per second, real-time tracking is possible.

Wilcox, Brian↗

The JPL/KSC telerobotic inspection demonstration

An ASEA IRB90 robotic manipulator with attached inspection cameras was moved through a Space Shuttle Payload Assist Module (PAM) Cradle under computer control. The Operator and Operator Control Station, including graphics simulation, gross-motion spatial planning, and machine vision processing, were located at JPL. The Safety and Support personnel, PAM Cradle, IRB90, and image acquisition system, were stationed at the Kennedy Space Center (KSC). Images captured at KSC were used both for processing by a machine vision system at JPL, and for inspection by the JPL Operator. The system found collision-free paths through the PAM Cradle, demonstrated accurate knowledge of the location of both objects of interest and obstacles, and operated with a communication delay of two seconds. Safe operation of the IRB90 near Shuttle flight hardware was obtained both through the use of a gross-motion spatial planner developed at JPL using artificial intelligence techniques, and infrared beams and pressure sensitive strips mounted to the critical surfaces of the flight hardward at KSC. The Demonstration showed that telerobotics is effective for real tasks, safe for personnel and hardware, and highly productive and reliable for Shuttle payload operations and Space Station external operations.

Mittman, David↗

Automated site characterization for robotic sample acquisition systems

A mobile, semi-autonomous vehicle with multiple sensors and on-board intelligence is proposed for performing preliminary scientific investigations on extraterrestrial bodies prior to human exploration. Two technologies, a hybrid optical-digital computer system based on optical correlator technology and an image and instrument data analysis system, provide complementary capabilities which might be part of an instrument package for an intelligent robotic vehicle. The hybrid digital-optical vision system could perform real-time image classification tasks using an optical correlator with programmable matched filters under control of a digital microcomputer. The data analysis system would analyze visible and multiband imagery to extract mineral composition and textural information for geologic characterization. Together these technologies would support the site characterization needs of a robotic vehicle for both navigational and scientific purposes.

Scholl, Marija S.↗

Terrain Portrayal for Head-Down Displays Flight Test

The Synthetic Vision Systems General Aviation (SVS-GA) element of NASA's Aviation Safety Program is developing technology to eliminate low visibility induced General Aviation (GA) accidents through the application of synthetic vision techniques. SVS displays present computer generated 3-dimensional imagery of the surrounding terrain to greatly enhance pilot's situation awareness (SA), reducing or eliminating Controlled Flight into Terrain (CFIT), as well as Low-Visibility Loss of Control (LVLOC) accidents. In addition to substantial safety benefits, SVS displays have many potential operational benefits that can lead to flight in instrument meteorological conditions (IMC) resembling those conducted in visual meteorological conditions (VMC). Potential benefits could include lower landing minimums, more approach options, reduced training time, etc. SVS conducted research will develop display concepts providing the pilot with an unobstructed view of the outside terrain, regardless of weather conditions and time of day. A critical component of SVS displays is the appropriate presentation of terrain to the pilot. The relationship between the realism of the terrain presentation and resulting enhancements of pilot SA and pilot performance has been largely undefined. Comprised of coordinated simulation and flight test efforts, the terrain portrayal for head-down displays (TP-HDD) test series examined the effects of two primary elements of terrain portrayal: variations of digital elevation model (DEM) resolution and terrain texturing. Variations in DEM resolution ranged from sparsely spaced (30 arc-sec/2,953ft) to very closely spaced data (1 arc-sec/98 ft). Variations in texture involved three primary methods: constant color, elevation-based generic, and photo-realistic, along with a secondary depth cue enhancer in the form of a fishnet grid overlay. The TP-HDD test series was designed to provide comprehensive data to enable design trades to optimize all SVS applications, as well as develop requirements and recommendations to facilitate the implementation and certification of SVS displays. The TP-HDD flight experiment utilized the NASA LaRC Cessna 206 Stationaire and evaluated eight terrain portrayal concepts in an effort to confirm and extend results from the previously conducted TP-HDD simulation experiment. A total of 15 evaluation pilots, of various qualifications, accumulated over 75 hours of dedicated research flight time at Newport News (PHF) and Roanoke (ROA), VA, airports from August through October, 2002. This report will present results from the portion of testing conducted at Roanoke, VA.

Hughes, Monica F.↗

Implementing the President's Vision: JPL and NASA's Exploration Systems Mission Directorate

As part of the NASA team the Jet Propulsion Laboratory is involved in the Exploration Systems Mission Directorate (ESMD) work to implement the President's Vision for Space exploration. In this slide presentation the roles that are assigned to the various NASA centers to implement the vision are reviewed. The plan for JPL is to use the Constellation program to advance the combination of science an Constellation program objectives. JPL's current participation is to contribute systems engineering support, Command, Control, Computing and Information (C3I) architecture, Crew Exploration Vehicle, (CEV) Thermal Protection System (TPS) project support/CEV landing assist support, Ground support systems support at JSC and KSC, Exploration Communication and Navigation System (ECANS), Flight prototypes for cabin atmosphere instruments

Industry Day↗

COBALT: Development of a Platform to Flight Test Lander GN&C Technologies on Suborbital Rockets

The NASA COBALT Project (CoOperative Blending of Autonomous Landing Technologies) is developing and integrating new precision-landing Guidance, Navigation and Control (GN&C) technologies, along with developing a terrestrial fight-test platform for Technology Readiness Level (TRL) maturation. The current technologies include a third- generation Navigation Doppler Lidar (NDL) sensor for ultra-precise velocity and line- of-site (LOS) range measurements, and the Lander Vision System (LVS) that provides passive-optical Terrain Relative Navigation (TRN) estimates of map-relative position. The COBALT platform is self contained and includes the NDL and LVS sensors, blending filter, a custom compute element, power unit, and communication system. The platform incorporates a structural frame that has been designed to integrate with the payload frame onboard the new Masten Xodiac vertical take-o, vertical landing (VTVL) terrestrial rocket vehicle. Ground integration and testing is underway, and terrestrial fight testing onboard Xodiac is planned for 2017 with two flight campaigns: one open-loop and one closed-loop.

Carson, John M., III↗

Initial Flight Testing of an eXternal Vision System (XVS) for the Low Boom Flight Demonstrator (LBFD)

NASA will design an eXternal Vision System (XVS) that, with other aircraft systems and subsystems, will ensure safe and efficient operations in all phases of flight for its Low Boom Flight Demonstrator vehicle. XVS is a combination of display, sensor, and computing technologies, creating an electronic means of forward visibility for the pilot. A flight test was performed evaluating a preliminary design of an XVS to quantify, by direct comparison, the ability of a pilot using an XVS to see and recognize airborne traffic compared to that of a pilot using forward-facing windows during challenging see-and-avoid scenarios. The data showed that the XVS and forward-facing windows were essentially equivalent in detecting and recognizing incurring traffic aircraft. The data also showed that the pilot using the XVS could see and recognize the incurring traffic at no less than 0.7 nm prior to the pilot using the forward-facing windows. The performance of the XVS was dependent upon the application of image contrast enhancement. Recommendations for future improvements were captured from evaluation pilot commentary.

Kramer, Lynda J↗

A vision system for a Mars rover

A Mars rover must be able to sense its local environment with sufficient resolution and accuracy to avoid local obstacles and hazards while moving a significant distance each day. Power efficiency and reliability are extremely important considerations, making stereo correlation an attractive method of range sensing compared to laser scanning, if the computational load and correspondence errors can be handled. Techniques for treatment of these problems, including the use of more than two cameras to reduce correspondence errors and possibly to limit the computational burden of stereo processing, have been tested at JPL. Once a reliable range map is obtained, it must be transformed to a plan view and compared to a stored terrain database, in order to refine the estimated position of the rover and to improve the database. The slope and roughness of each terrain region are computed, which form the basis for a traversability map allowing local path planning. Ongoing research and field testing of such a system is described.

Wilcox, Brian H.↗

Visioning a Global Carbon Monitoring System That Can Quantify and Attribute Ocean Carbon Dioxide Removal: Where Are We Now and How Might We Get There?

As atmospheric greenhouse gas concentrations and the resulting social costs rise, it is increasingly important to conduct research on technical approaches to remove carbon dioxide from the atmosphere at the gigaton scale. One highly uncertain but perhaps plausible solution is ocean carbon dioxide (CO2) removal (CDR), which encompasses a suite of proposed techniques for increasing the net flux of CO2 from the atmosphere to the ocean. As reflected in a 2022 National Academy of Sciences report, interest in ocean CDR is rapidly growing, and new stakeholders from a wide range of fields want access to air-sea CO2 flux and ocean carbon information to understand the potential risks and benefits of ocean CDR. Moreover, there is an urgent need for research to develop a scientific basis to support these societal needs. At the same time, there is a growing need to vision a global carbon monitoring system that can quantify natural and anthropogenic perturbations in the air-sea CO2 flux to quantify and attribute the impacts of ocean CDR efforts on the ocean carbon sink. Here, we propose to present nascent efforts at the Ames Research Center to leverage NASA's unique remote sensing and computational capabilities and expertise in basic and applied Earth science to meet the needs of the ocean CDR stakeholder community as represented by the OceanVisions network. Specifically we aim to develop a global ocean CDR scenario explorer with two objectives: 1) to make quantitative estimates of the air-sea CO2 flux and its uncertainty more accessible to a wide range of users, and 2) to enable these diverse users to interactively explore the uncertain impacts on air-sea CO2 fluxes in a wide range of ocean CDR scenarios. The information would be provided to users via a public graphical user interface, and the results would be based on a new synthesis of scientific observations and knowledge in a global ocean mixed layer inverse model run on supercomputers. The proposed tool aims to fill a unique and valuable niche for users and the scientific community by balancing tradeoffs between user interests, scientific knowledge, and technical capabilities. We will conclude by visioning the potential implications for a global carbon monitoring system in a world with gigaton scale ocean CDR.

Global↗

The Influence of Future Command, Control, Communications, and Computers (C4) on Doctrine and the Operational Commander's Decision-Making Process

Future C4 systems will alter the traditional balance between force and information, having a profound influence on doctrine and the operational commander's decision making process. The Joint Staff's future vision of C4 is conceptualized in 'C4I for the Warrior' which envisions a joint C4I architecture providing timely sensor to shoot information direct to the warfighter. C4 system must manage and filter an overwhelming amount of information; deal with interoperability issues; overcome technological limitations; meet emerging security requirements; and protect against 'Information Warfare.' Severe budget constraints necessitate unified control of C4 systems under singular leadership for the common good of all the services. In addition, acquisition policy and procedures must be revamped to allow new technologies to be fielded quickly; and the commercial marketplace will become the preferred starting point for modernization. Flatter command structures are recommended in this environment where information is available instantaneously. New responsibilities for decision making at lower levels are created. Commanders will have to strike a balance between exerting greater control and allowing subordinates enough flexibility to maintain initiative. Clearly, the commander's intent remains the most important tool in striking this balance.

Mayer, Michael G.↗

Remotely manipulated and autonomous robotic welding fabrication in space

The results of a NASA sponsored study, performed in order to establish the feasibility of remotely manipulated or unmanned welding fabrication systems for space construction, are presented. Possible space welding fabrication tasks and operational modes are classified and the capabilities and limitations of human operators and machines are outlined. Human performance in remote welding tasks was experimentally tested under the sensing and actuation constraints imposed by remote manipulation in outer space environments. Proposals for the development of space welding technology are made and necessary future R&D efforts are identified. The development of improved visual sensing strategies and computer encoding of the human welding engineering expertise are identified as essential, both for human operator assistance and for autonomous operation in all phases of welding fabrication. Novel uses of machine vision for the determination of the weld joint and bead geometry are proposed, and a prototype of a rule-based expert system is described for the interpretation of the visually detected weld features and defects.

Agapakis, J. E.↗

Design and development of a Space Station proximity operations research and development mockup

Proximity operations (Prox-Ops) on-orbit refers to all activities taking place within one km of the Space Station. Designing a Prox-Ops control station calls for a comprehensive systems approach which takes into account structural constraints, orbital dynamics including approach/departure flight paths, myriad human factors and other topics. This paper describes a reconfigurable full-scale mock-up of a Prox-Ops station constructed at Ames incorporating an array of windows (with dynamic star field, target vehicle(s), and head-up symbology), head-down perspective display of manned and unmanned vehicles, voice- actuated 'electronic checklist', computer-generated voice system, expert system (to help diagnose subsystem malfunctions), and other displays and controls. The facility is used for demonstrations of selected Prox-Ops approach scenarios, human factors research (work-load assessment, determining external vision envelope requirements, head-down and head-up symbology design, voice synthesis and recognition research, etc.) and development of engineering design guidelines for future module interiors.

Haines, Richard F.↗

Zero-Trust Architecture for Autonomous Edge Computing

We are at the apex of an aviation revolution where autonomy will play a central role in enabling complex, multi-agent systems to communicate, interact, and collaborate on a myriad of applications spanning autonomous swarms to wild-fire management. Autonomy is not an absolute but rather a spectrum ranging from a system requiring significant human intervention to one requiring little to none [1]. For example, the extreme, in the case of an autonomous aircraft, is one that operates independently in the airspace interacting with all other elements (air traffic controllers, other pilots) as if it were a human pilot. Critical to this vision is an architecture that enables autonomous agents to interact with minimal latency. Edge computing is an emerging architecture where compute and storage is pushed to the ‘edge’ of the network in order to minimize the round-trip time from agent to resource thereby mitigating the latency associated with cloud-only based approaches. Additionally, services can generate massive amounts of data (e.g., video feeds), which may require analysis in near real-time. Moving this data to the cloud for further processing may not be feasible due to latency, bandwidth, and cost. Privacy, security, and reliability can also be improved by edge computing architectures. However, this geo-distributed and dynamic* architecture complicates the establishment of unambiguous network security boundaries and can lead to vulnerabilities including man in the middle attacks, replay attacks, physical security breaches of edge nodes, signal interception, etc. This motivates the need for zero-trust architectures [2–4] which de-emphasize the notion of static network perimeters and, as the name implies, do not instill any innate trust in any particular agent. It is required that all agents must be authorized and approved in every transaction. In this paper, we present a zero-trust architecture suitable for edge-computing applications that demand significant low-latency, security, privacy, and reliability.

zero trust↗

Preliminary Results Obtained in Integrated Safety Analysis of NASA Aviation Safety Program Technologies

The goal of the NASA Aviation Safety Program (AvSP) is to develop and demonstrate technologies that contribute to a reduction in the aviation fatal accident rate by a factor of 5 by the year 2007 and by a factor of 10 by the year 2022. Integrated safety analysis of day-to-day operations and risks within those operations will provide an understanding of the Aviation Safety Program portfolio. Safety benefits analyses are currently being conducted. Preliminary results for the Synthetic Vision Systems (SVS) and Weather Accident Prevention (WxAP) projects of the AvSP have been completed by the Logistics Management Institute under a contract with the NASA Glenn Research Center. These analyses include both a reliability analysis and a computer simulation model. The integrated safety analysis method comprises two principal components: a reliability model and a simulation model. In the reliability model, the results indicate how different technologies and systems will perform in normal, degraded, and failed modes of operation. In the simulation, an operational scenario is modeled. The primary purpose of the SVS project is to improve safety by providing visual-flightlike situation awareness during instrument conditions. The current analyses are an estimate of the benefits of SVS in avoiding controlled flight into terrain. The scenario modeled has an aircraft flying directly toward a terrain feature. When the flight crew determines that the aircraft is headed toward an obstruction, the aircraft executes a level turn at speed. The simulation is ended when the aircraft completes the turn.

Reveley, Mary S.↗

Hybrid Terrain Database

A prototype hybrid terrain database is being developed in conjunction with other databases and with hardware and software that constitute subsystems of aerospace cockpit display systems (known in the art as synthetic vision systems) that generate images to increase pilots' situation awareness and eliminate poor visibility as a cause of aviation accidents. The basic idea is to provide a clear view of the world around an aircraft by displaying computer-generated imagery derived from an onboard database of terrain, obstacle, and airport information.

Arthur, Trey↗

Low-Cost Space Hardware and Software

The goal of this project is to demonstrate and support the overall vision of NASA's Rocket University (RocketU) through the design of an electrical power system (EPS) monitor for implementation on RUBICS (Rocket University Broad Initiatives CubeSat), through the support for the CHREC (Center for High-Performance Reconfigurable Computing) Space Processor, and through FPGA (Field Programmable Gate Array) design. RocketU will continue to provide low-cost innovations even with continuous cuts to the budget.

hardware↗

Lunar Applications in Reconfigurable Computing

NASA s Constellation Program is developing a lunar surface outpost in which reconfigurable computing will play a significant role. Reconfigurable systems provide a number of benefits over conventional software-based implementations including performance and power efficiency, while the use of standardized reconfigurable hardware provides opportunities to reduce logistical overhead. The current vision for the lunar surface architecture includes habitation, mobility, and communications systems, each of which greatly benefit from reconfigurable hardware in applications including video processing, natural feature recognition, data formatting, IP offload processing, and embedded control systems. In deploying reprogrammable hardware, considerations similar to those of software systems must be managed. There needs to be a mechanism for discovery enabling applications to locate and utilize the available resources. Also, application interfaces are needed to provide for both configuring the resources as well as transferring data between the application and the reconfigurable hardware. Each of these topics are explored in the context of deploying reconfigurable resources as an integral aspect of the lunar exploration architecture.

Somervill, Kevin↗