Search NASA⌕ Search

SEARCH · Search NASA

Results for “Robot vision systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Orbiting Rainbows: Optical Manipulation of Aerosols and the Beginnings of Future Space Construction

Our objective is to investigate the conditions to manipulate and maintain the shape of an orbiting cloud of dust-like matter so that it can function as an ultra-lightweight surface with useful and adaptable electromagnetic characteristics, for instance, in the optical, RF, or microwave bands. Inspired by the light scattering and focusing properties of distributed optical assemblies in Nature, such as rainbows and aerosols, and by recent laboratory successes in optical trapping and manipulation, we propose a unique combination of space optics and autonomous robotic system technology, to enable a new vision of space system architecture with applications to ultra-lightweight space optics and, ultimately, in-situ space system fabrication. Typically, the cost of an optical system is driven by the size and mass of the primary aperture. The ideal system is a cloud of spatially disordered dust-like objects that can be optically manipulated: it is highly reconfigurable, fault-tolerant, and allows very large aperture sizes at low cost. See Figure 1 for a scenario of application of this concept. The solution that we propose is to construct an optical system in space in which the nonlinear optical properties of a cloud of micron-sized particles are shaped into a specific surface by light pressure, allowing it to form a very large and lightweight aperture of an optical system, hence reducing overall mass and cost. Other potential advantages offered by the cloud properties as optical system involve possible combination of properties (combined transmit/receive), variable focal length, combined refractive and reflective lens designs, and hyper-spectral imaging. A cloud of highly reflective particles of micron-size acting coherently in a specific electromagnetic band, just like an aerosol in suspension in the atmosphere, would reflect the Sun's light much like a rainbow. The only difference with an atmospheric or industrial aerosol is the absence of the supporting fluid medium. This new concept is based on recent understandings in the physics of optical manipulation of small particles in the laboratory and the engineering of distributed ensembles of spacecraft clouds to shape an orbiting cloud of micron-sized objects. In the same way that optical tweezers have revolutionized micro- and nano-manipulation of objects, our breakthrough concept will enable new large scale NASA mission applications and develop new technology in the areas of Astrophysical Imaging Systems and Remote Sensing because the cloud can operate as an adaptive optical imaging sensor. While achieving the feasibility of constructing one single aperture out of the cloud is the main topic of this work, it is clear that multiple orbiting aerosol lenses could also combine their power to synthesize a much larger aperture in space to enable challenging goals such as exoplanet detection. Furthermore, this effort could establish feasibility of key issues related to material properties, remote manipulation, and autonomy characteristics of cloud in orbit. There are several types of endeavors (science missions) that could be enabled by this type of approach, i.e. it can enable new astrophysical imaging systems, exoplanet search, large apertures allow for unprecedented high resolution to discern continents and important features of other planets, hyperspectral imaging, adaptive systems, spectroscopy imaging through limb, and stable optical systems from Lagrange-points. Future micro-miniaturization might hold promise of a further extension of our dust aperture concept to other more exciting smart dust concepts with other associated capabilities.

Space Construction↗

The use of interactive computer vision and robot hand controllers for enhancing manufacturing safety

Current available robotic systems provide limited support for CAD-based model-driven visualization, sensing algorithm development and integration, and automated graphical planning systems. This paper describes ongoing work which provides the functionality necessary to apply advanced robotics to automated manufacturing and assembly operations. An interface has been built which incorporates 6-DOF tactile manipulation, displays for three dimensional graphical models, and automated tracking functions which depend on automated machine vision. A set of tools for single and multiple focal plane sensor image processing and understanding has been demonstrated which utilizes object recognition models. The resulting tool will enable sensing and planning from computationally simple graphical objects. A synergistic interplay between human and operator vision is created from programmable feedback received from the controller. This approach can be used as the basis for implementing enhanced safety in automated robotics manufacturing, assembly, repair and inspection tasks in both ground and space applications. Thus, an interactive capability has been developed to match the modeled environment to the real task environment for safe and predictable task execution.

Marzwell, Neville I.↗

Thermal Protection Materials Technology for NASA's Exploration Systems Mission Directorate

To fulfill the President s Vision for Space Exploration - successful human and robotic missions between the Earth and other solar system bodies in order to explore their atmospheres and surfaces - NASA must reduce trip time, cost, and vehicle weight so that payload and scientific experiment capabilities are maximized. As a collaboration among NASA Centers, this project will generate products that will enable greater fidelity in mission/vehicle design trade studies, support risk reduction for material selections, assist in optimization of vehicle weights, and provide the material and process templates for development of human-rated qualification and certification Thermal Protection System (TPS) plans. Missions performing aerocapture, aerobraking, or direct aeroentry rely on technologies that reduce vehicle weight by minimizing the need for propellant. These missions use the destination planet s atmosphere to slow the spacecraft. Such mission profiles induce heating environments on the spacecraft that demand thermal protection heatshields. This program offers NASA essential advanced thermal management technologies needed to develop new lightweight nonmetallic TPS materials for critical thermal protection heatshields for future spacecraft. Discussion of this new program (a December 2004 new start) will include both initial progress made and a presentation of the work to be preformed over the four-year life of the program. Additionally, the relevant missions and environments expected for Exploration Systems vehicles will be presented, along with discussion of the candidate materials to be considered and of the types of testing to be performed (material property tests, space environmental effects tests, and Earth and Mars gases arc jet tests).

Valentine, Peter G.↗

Constructing an Educational Mars Simulation

January 14th 2004, President George Bush announces his plans to catalyst the space program into a new era of space exploration and discovery. His vision encompasses a robotics program to explore our solar system, a return to the moon, the human exploration of Mars, and to promote international prosperity towards our endeavors. We at NASA now have the task of constructing this vision in a very real timeframe. I have been chosen to begin phase 1 of making this vision a reality. I will be working on creating an Educational Mars Simulation of human exploration of Mars to stimulate interest and involvement with the project from investors and the community. GRC s Computer Services Division (CSD) in collaboration with the Office of Education Programs will be designing models, constructing terrain, and programming this simulation to create a realistic portrayal of human exploration on mars. With recent and past technological breakthroughs in computing, my primary goal can be accomplished with only the aid of 3-4 software packages. Lightwave 3D is the modeling package we have selected to use for the creation of our digital objects. This includes a Mars pressurized rover, rover cockpit, landscape/terrain, and habitat. Once we have the models completed they need textured so Photoshop and Macromedia Fireworks are handy for bringing these objects to life. Before directly importing all of this data into a simulation environment, it is necessary to first render a stunning animation of the desired final product. This animation with represent what we hope to capture out of the simulation and it will include all of the accessories like ray-tracing, fog effects, shadows, anti-aliasing, particle effects, volumetric lighting, and lens flares. Adobe Premier will more than likely be used for video editing and adding ambient noises and music. Lastly, V-Tree is the real-time 3D graphics engine which will facilitate our realistic simulation. Additional information is included in the original extended abstract.

Henke, Stephen A.↗

Real time AI expert system for robotic applications

A computer controlled multi-robot process cell to demonstrate advanced technologies for the demilitarization of obsolete chemical munitions was developed. The methods through which the vision system and other sensory inputs were used by the artificial intelligence to provide the information required to direct the robots to complete the desired task are discussed. The mechanisms that the expert system uses to solve problems (goals), the different rule data base, and the methods for adapting this control system to any device that can be controlled or programmed through a high level computer interface are discussed.

Follin, John F.↗

GSFC Information Systems Technology Developments Supporting the Vision for Space Exploration

The Vision for Space Exploration will guide NASA's future human and robotic space activities. The broad range of human and robotic missions now being planned will require the development of new system-level capabilities enabled by emerging new technologies. Goddard Space Flight Center is actively supporting the Vision for Space Exploration in a number of program management, engineering and technology areas. This paper provides a brief background on the Vision for Space Exploration and a general overview of potential key Goddard contributions. In particular, this paper focuses on describing relevant GSFC information systems capabilities in architecture development; interoperable command, control and communications; and other applied information systems technology/research activities that are applicable to support the Vision for Space Exploration goals. Current GSFC development efforts and task activities are presented together with future plans.

Hughes, Peter↗

Robotic Exploration of Moon and Mars: Thematic Education Approach

Safe, sustained, affordable human and robotic exploration of the Moon, Mars, and beyond is a major NASA goal. Robotic exploration of the Moon and Mars will help pave the way for an expanded human presence in our solar system. To help share the robotic exploration role in the Vision for Space Exploration with classrooms, informal education groups, and the public, our team researched and consolidated the thematic story components and associated education activities into a useful education materials set for educators. We developed the set of materials for a workshop combining NASA Science Mission Directorate and Exploration Systems Mission Directorate engineering, science, and technology to train informal educators on education activities that support the robotic exploration themes. A major focus is on the use of robotic spacecraft and instruments to explore and prepare for the human exploration of the Moon and Mars.

Allen, J S.↗

Microwave vision for robots

Microwave Vision (MV), a concept originally developed in 1985, could play a significant role in the solution to robotic vision problems. Originally our Microwave Vision concept was based on a pattern matching approach employing computer based stored replica correlation processing. Artificial Neural Network (ANN) processor technology offers an attractive alternative to the correlation processing approach, namely the ability to learn and to adapt to changing environments. This paper describes the Microwave Vision concept, some initial ANN-MV experiments, and the design of an ANN-MV system that has led to a second patent disclosure in the robotic vision field.

Lewandowski, Leon↗

Advanced technology for space communications, tracking, and robotic sensors

Technological advancements in tracking, communications, and robotic vision sensors are reviewed. The development of communications systems for multiple access, broadband, high data rate, and efficient operation is discussed. Consideration is given to the Tracking and Data Relay Satellite systems, GPS, and communications and tracking systems for the Space Shuttle and the Space Station. The use of television, laser, and microwave sensors for robotics and technology for autonomous rendezvous and docking operations are examined.

Krishen, Kumar↗

Development of techniques required for the application of a laser to three dimensional visual sensing

The ongoing vision research at the Center for Intelligent Robotic Systems for Space Exploration (CIRSSE) is directed toward identifying and addressing the relevant issues involved in applying visual sensing to space assembly tasks. A considerable amount of effort has been devoted to passive sensing techniques such as using multiple cameras to identify objects in a scene. To compliment the capabilities of the passive visual system in the CIRSSE robotics testbed, research is being conducted in active sensing techniques. This report is description of the research associated with the testbed's laser scanner and its application as an active sensing device. The report is comprised of five major topics. First is a brief description of the CIRSSE visual system and a summary of the active sensing research that has been conducted up to this point. Second, some of the methods currently used to calibrate CIRSSE's laser scanner are described as well as an appraisal of the effectiveness of these methods. Third, is a discussion of how the laser scanner can be employed in concert with a camera to provide a three dimensional point estimation capability. Fourth, there is a description of methods that can be used to detect the presence of the laser beam in a cluttered camera image. Finally, there is a summary of the current state of this research and a description of research planned for the future.

Ryan, Arthur M.↗

Robot and Human Surface Operations on Solar System Bodies

This paper presents a comparison of robot and human surface operations on solar system bodies. The topics include: 1) Long Range Vision of Surface Scenarios; 2) Human and Robots Complement Each Other; 3) Respective Human and Robot Strengths; 4) Need More In-Depth Quantitative Analysis; 5) Projected Study Objectives; 6) Analysis Process Summary; 7) Mission Scenarios Decompose into Primitive Tasks; 7) Features of the Projected Analysis Approach; and 8) The "Getting There Effect" is a Major Consideration. This paper is in viewgraph form.

Weisbin, C. R.↗

Vision Based Localization in Urban Environments

As part of DARPA's MARS2020 program, the Jet Propulsion Laboratory developed a vision-based system for localization in urban environments that requires neither GPS nor active sensors. System hardware consists of a pair of small FireWire cameras and a standard Pentium-based computer. The inputs to the software system consist of: 1) a crude grid-based map describing the positions of buildings, 2) an initial estimate of robot location and 3) the video streams produced by each camera. At each step during the traverse the system: captures new image data, finds image features hypothesized to lie on the outside of a building, computes the range to those features, determines an estimate of the robot's motion since the previous step and combines that data with the map to update a probabilistic representation of the robot's location. This probabilistic representation allows the system to simultaneously represent multiple possible locations, For our testing, we have derived the a priori map manually using non-orthorectified overhead imagery, although this process could be automated. The software system consists of two primary components. The first is the vision system which uses binocular stereo ranging together with a set of heuristics to identify features likely to be part of building exteriors and to compute an estimate of the robot's motion since the previous step. The resulting visual features and the associated range measurements are software component, a particle-filter based localization system. This system uses the map and the then fed to the second primary most recent results from the vision system to update the estimate of the robot's location. This report summarizes the design of both the hardware and software and will include the results of applying the system to the global localization of a robot over an approximately half-kilometer traverse across JPL'S Pasadena campus.

unmanned-ground vehicles↗

Influence of control parameters on the joint tracking performance of a coaxial weld vision system

The first phase of a series of evaluations of a vision-based welding control sensor for the Space Shuttle Main Engine Robotic Welding System is described. The robotic welding system is presently under development at the Marshall Space Flight Center. This evaluation determines the standard control response parameters necessary for proper trajectory of the welding torch along the joint.

Gangl, K. J.↗

Determining the 3-D structure and motion of objects using a scanning laser range sensor

In order for the EVAHR robot to autonomously track and grasp objects, its vision system must be able to determine the 3-D structure and motion of an object from a sequence of sensory images. This task is accomplished by the use of a laser radar range sensor which provides dense range maps of the scene. Unfortunately, the currently available laser radar range cameras use a sequential scanning approach which complicates image analysis. Although many algorithms have been developed for recognizing objects from range images, none are suited for use with single beam, scanning, time-of-flight sensors because all previous algorithms assume instantaneous acquisition of the entire image. This assumption is invalid since the EVAHR robot is equipped with a sequential scanning laser range sensor. If an object is moving while being imaged by the device, the apparent structure of the object can be significantly distorted due to the significant non-zero delay time between sampling each image pixel. If an estimate of the motion of the object can be determined, this distortion can be eliminated; but, this leads to the motion-structure paradox - most existing algorithms for 3-D motion estimation use the structure of objects to parameterize their motions. The goal of this research is to design a rigid-body motion recovery technique which overcomes this limitation. The method being developed is an iterative, linear, feature-based approach which uses the non-zero image acquisition time constraint to accurately recover the motion parameters from the distorted structure of the 3-D range maps. Once the motion parameters are determined, the structural distortion in the range images is corrected.

Nandhakumar, N.↗

A Petri-net coordination model for an intelligent mobile robot

The authors present a Petri net model of the coordination level of an intelligent mobile robot system (IMRS). The purpose of this model is to specify the integration of the individual efforts on path planning, supervisory motion control, and vision systems that are necessary for the autonomous operation of the mobile robot in a structured dynamic environment. This is achieved by analytically modeling the various units of the system as Petri net transducers and explicitly representing the task precedence and information dependence among them. The model can also be used to simulate the task processing and to evaluate the efficiency of operations and the responsibility of decisions in the coordination level of the IMRS. Some simulation results on the task processing and learning are presented.

Wang, F.-Y.↗

A vision-based end-point control for a two-link flexible manipulator

The measurement and control of the end-effector position of a large two-link flexible manipulator are investigated. The system implementation is described and an initial algorithm for static end-point positioning is discussed. Most existing robots are controlled through independent joint controllers, while the end-effector position is estimated from the joint positions using a kinematic relation. End-point position feedback can be used to compensate for uncertainty and structural deflections. Such feedback is especially important for flexible robots. Computer vision is utilized to obtain end-point position measurements. A look-and-move control structure alleviates the disadvantages of the slow and variable computer vision sampling frequency. This control structure consists of an inner joint-based loop and an outer vision-based loop. A static positioning algorithm was implemented and experimentally verified. This algorithm utilizes the manipulator Jacobian to transform a tip position error to a joint error. The joint error is then used to give a new reference input to the joint controller. The convergence of the algorithm is demonstrated experimentally under payload variation. A Landmark Tracking System (Dickerson, et al 1990) is used for vision-based end-point measurements. This system was modified and tested. A real-time control system was implemented on a PC and interfaced with the vision system and the robot.

Obergfell, Klaus↗

Investigation of weld joint detection capabilities of a coaxial weld vision system

This report describes the second phase of a series of evaluations of a vision-based welding control sensor for the Space shuttle Main Engine Robotic Welding System. The robotic welding system is presently under development at the Marshall Space Flight Center. This evaluation determines the factors influencing the minimum joint gap required for consistent detection of the weld joint.

Gangl, K. J.↗

The First Year in Review: NASA's Ares I Crew Launch Vehicle and Ares V Cargo Launch Vehicle

The U.S. Vision for Space Exploration guides NASA's challenging missions of scientific discovery.' Developing safe, reliable, and affordable space transportation systems for the human and robotic exploration of space is a key component of fulfilling the strategic goals outlined in the Vision, as well as in the U.S. Space Policy. In October 2005, the Exploration Systems Mission Directorate and its Constellation Program chartered the Exploration Launch Projects Office, located at the Marshall Space Flight Center, to design, develop, test, and field a new generation of launch vehicles that would fulfill customer and stakeholder requirements for trips to the Moon, Mars, and beyond. The Ares I crew launch vehicle is slated to loft the Orion crew exploration vehicle to orbit by 2014, while the heavy-lift Ares V cargo launch vehicle will deliver the lunar lander to orbit by 2020 (Fig. 1). These systems are being designed to empower America's return to the Moon to prepare for the first astronaut on Mars. The new launch vehicle designs now under study reflect almost 50 years of hard-won experience gained from the Saturn's missions to the Moon in the late 1960s and early 1970s, and from the venerable Space Shuttle, which is due to be retired by 2010.

Dumbacher, Daniel L.↗