Search NASA⌕ Search

SEARCH · Search NASA

Results for “Computer Vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Progress in Development of the Axel Rovers

Progress has been made in the development of a family of robotic land vehicles having modular and minimalist design features chosen to impart a combination of robustness, reliability, and versatility. These vehicles at earlier stages of development were described in two previous NASA Tech Briefs articles: "Reconfigurable Exploratory Robotic Vehicles" (NPO-20944), Vol. 25, No. 7 (July 2001), page 56; and "More About Reconfigurable Exploratory Robotic Vehicles" (NPO-30890), Vol. 33, No. 8 (August 2009), page 40. Conceived for use in exploration of the surfaces of Mars and other remote planets, these vehicles could also be adapted to terrestrial applications, including exploration of volcanic craters or other hostile terrain, military reconnaissance, inspection of hazardous sites, and searching for victims of earthquakes, landslides, avalanches, or mining accidents. In addition, simplified versions of these vehicles might be marketable as toys. The most basic module in this family of reconfigurable robots is the Axel rover, which has a cylindrical body with two main wheels and a trailing link. Inside its body are three motors and associated mechanisms for driving the two wheels and for rotating the link 360 around its symmetrical body. The actuated link serves several purposes: It is used as a lever arm to react to the wheels thrust to move Axel in multiple directions. It is used to rotate the Axel housing in order to tilt, to the desired angle, any sensors and instruments mounted on or in the Axel housing. It provides an alternative mobility mode, which is primarily used in its tethered configuration. Turn ing the link into the ground in lieu of driving the wheels causes the Axel housing and wheels to roll as a unit and thereby leads to a tumbling motion along the ground. With a tether mounted around Axel s cylindrical body, the link serves as a winch mechanism to reel and unreel the tether raising and lowering Axel over steep and vertical surfaces (Figure 1). Sensors, computation, and communication modules are also housed inside Axel s body. A pair of stereo vision cameras provides three-dimensional view for autonomous navigation and avoiding obstacles. Inertial sensors determine the tilt of the robot and are used for estimating its motion. In a fully developed version, power would be supplied by rechargeable batteries aboard Axel; at the time of reporting the information for this article, power was supplied from an external source via a cable. In and of itself, the Axel rover is fully capable of traversing and sampling terrains on planetary surfaces. By use of only the two main wheel actuators and the caster link actuator, Axel can be made to follow an arbitrary path, turn in place, and operate upside- down or right-side-up. If operated in a tethered configuration, as shown in Figure 1, it can be made to move down and up a steep crater wall, descend from an overhang to a cave, and ascend from the cave back to the overhang, all by use of the same three actuators. Such tethered operation could be useful in searching for accident victims or missing persons in mines, caves, and rubble piles. Running the tether through the caster link enhances the stability of Axel and provides a restoring force that keeps the link off the ground for the most part during operation on a steep slope. In its extended configuration, two Axel modules can dock to either side of a payload module to form the four wheeled Axel2 rover (Figure 2). Additional payload and Axel modules can dock to either side of the Axel2 to form the Axel3 rover, extending its payload capacity and its mobility capabilities.

Nesnas, Issa A.↗

Automated Camera Calibration

Automated Camera Calibration (ACAL) is a computer program that automates the generation of calibration data for camera models used in machine vision systems. Machine vision camera models describe the mapping between points in three-dimensional (3D) space in front of the camera and the corresponding points in two-dimensional (2D) space in the camera s image. Calibrating a camera model requires a set of calibration data containing known 3D-to-2D point correspondences for the given camera system. Generating calibration data typically involves taking images of a calibration target where the 3D locations of the target s fiducial marks are known, and then measuring the 2D locations of the fiducial marks in the images. ACAL automates the analysis of calibration target images and greatly speeds the overall calibration process.

Chen, Siqi↗

Video Mosaicking for Inspection of Gas Pipelines

A vision system that includes a specially designed video camera and an image-data-processing computer is under development as a prototype of robotic systems for visual inspection of the interior surfaces of pipes and especially of gas pipelines. The system is capable of providing both forward views and mosaicked radial views that can be displayed in real time or after inspection. To avoid the complexities associated with moving parts and to provide simultaneous forward and radial views, the video camera is equipped with a wide-angle (>165 ) fish-eye lens aimed along the axis of a pipe to be inspected. Nine white-light-emitting diodes (LEDs) placed just outside the field of view of the lens (see Figure 1) provide ample diffuse illumination for a high-contrast image of the interior pipe wall. The video camera contains a 2/3-in. (1.7-cm) charge-coupled-device (CCD) photodetector array and functions according to the National Television Standards Committee (NTSC) standard. The video output of the camera is sent to an off-the-shelf video capture board (frame grabber) by use of a peripheral component interconnect (PCI) interface in the computer, which is of the 400-MHz, Pentium II (or equivalent) class. Prior video-mosaicking techniques are applicable to narrow-field-of-view (low-distortion) images of evenly illuminated, relatively flat surfaces viewed along approximately perpendicular lines by cameras that do not rotate and that move approximately parallel to the viewed surfaces. One such technique for real-time creation of mosaic images of the ocean floor involves the use of visual correspondences based on area correlation, during both the acquisition of separate images of adjacent areas and the consolidation (equivalently, integration) of the separate images into a mosaic image, in order to insure that there are no gaps in the mosaic image. The data-processing technique used for mosaicking in the present system also involves area correlation, but with several notable differences: Because the wide-angle lens introduces considerable distortion, the image data must be processed to effectively unwarp the images (see Figure 2). The computer executes special software that includes an unwarping algorithm that takes explicit account of the cylindrical pipe geometry. To reduce the processing time needed for unwarping, parameters of the geometric mapping between the circular view of a fisheye lens and pipe wall are determined in advance from calibration images and compiled into an electronic lookup table. The software incorporates the assumption that the optical axis of the camera is parallel (rather than perpendicular) to the direction of motion of the camera. The software also compensates for the decrease in illumination with distance from the ring of LEDs.

Magruder, Darby↗

The Roots of Beowulf

The first Beowulf Linux commodity cluster was constructed at NASA's Goddard Space Flight Center in 1994 and its origins are a part of the folklore of high-end computing. In fact, the conditions within Goddard that brought the idea into being were shaped by rich historical roots, strategic pressures brought on by the ramp up of the Federal High-Performance Computing and Communications Program, growth of the open software movement, microprocessor performance trends, and the vision of key technologists. This multifaceted story is told here for the first time from the point of view of NASA project management.

Beowulf↗

Advanced Bayesian Method for Planetary Surface Navigation

Autonomous Exploration, Inc., has developed an advanced Bayesian statistical inference method that leverages current computing technology to produce a highly accurate surface navigation system. The method combines dense stereo vision and high-speed optical flow to implement visual odometry (VO) to track faster rover movements. The Bayesian VO technique improves performance by using all image information rather than corner features only. The method determines what can be learned from each image pixel and weighs the information accordingly. This capability improves performance in shadowed areas that yield only low-contrast images. The error characteristics of the visual processing are complementary to those of a low-cost inertial measurement unit (IMU), so the combination of the two capabilities provides highly accurate navigation. The method increases NASA mission productivity by enabling faster rover speed and accuracy. On Earth, the technology will permit operation of robots and autonomous vehicles in areas where the Global Positioning System (GPS) is degraded or unavailable.

Center, Julian↗

SHF: Symmetrical Hierarchical Forest with Pretrained Vision Transformer Encoder for High-Resolution Medical Segmentation

This paper presents a novel approach to addressing the long-sequence problem in high-resolution medical images for Vision Transformers (ViTs). Using smaller patches as tokens can enhance ViT performance, but quadratically increases computation and memory requirements. Therefore, the common practice for applying ViTs to high-resolution images is either to: (a) employ complex sub-quadratic attention schemes or (b) use large to medium-sized patches and rely on additional mechanisms within the model to capture the spatial hierarchy of details. We propose Symmetrical Hierarchical Forest (SHF), a lightweight approach that adaptively patches the input image to increase token information density and encode hierarchical spatial structures into the input embedding. We then apply a reverse depatching scheme to the output embeddings of the transformer encoder, eliminating the need for convolution-based decoders. Unlike previous methods that modify attention mechanisms or use a complex hierarchy of interacting models, SHF can be retrofitted to any ViT model to allow it to learn the hierarchical structure of details in high-resolution images without requiring architectural changes. Experimental results demonstrate significant gains in computational efficiency and performance: on the PAIP WSI dataset, we achieved a 3∼32×speedup or a 2.95%∼7.03% increase in accuracy (measured by Dice score) at a 64K2 resolution with the same computational budget, compared to state-of-the-art production models. On the 3D medical datasets BTCV and KiTS, training was 6×faster, with accuracy gains of 6.93% and 5.9%, respectively, compared to models without SHF.

Zhang, Enzhi [Hokkaido University, Japan]↗

Issues for bringing digital libraries into public use

In much the same way that the field of artificial intelligence produced a cult which fervently believed that computers would soon think like human beings, the existence of electronic books has resurrected the paperless society as a utopian vision to some, an apocalyptic horror to others. In this essay we have attempted to provide realistic notions of what digital libraries are likely to become if they are a popular success. E-books are capable of subsuming most of the media we use today and have the potential for added functionality by being interactive. The environmental impact of having millions more computers will be offset to some degree, perhaps even exceeded, by the fact that televisions, stereos, VCR's, CD players, newspapers, magazines, and books will become part of the computer system or be made redundant. On the whole, large-scale use of digital libraries is likely to be a winning proposition. Whether or not this comes to pass depends on the directions taken by today's researchers and software developers. By involving the public, the effort being put into digital libraries can be leveraged into something which is big enough to make a real change for the better. If digital libraries remain the exclusive property of government, universities, and large research firms, then large parts of the world will remain without digital libraries for years to come, just as they have remained without digital phone service for far too long. If software companies try to scuttle the project by patenting crucial algorithms and using proprietary data formats, all of us will suffer. Let us reverse the errors of the past and create a truly open digital library system.

Flater, David W.↗

COMPUTER-AIDED LATTICE DESIGN AND ADVANCED MODELING FOR THE DEVELOPMENT OF LIGHTWEIGHT STRUCTURAL MATERIALS

The notion of a “fission battery” conveys a vision focused on realizing very simple “plug-and-play” nuclear systems that can be integrated into a variety of applications requiring affordable, reliable energy in the form of electricity and/or heat and function without operations and maintenance staff. Fission batteries require lightweight structural materials to increase their mobility, and the lightweight materials must demonstrate structural resilience under various conditions. The objective of this work is to develop lattice structured lightweight structural material featuring a good combination of mechanical properties using advanced modeling and simulation together with an advanced additive manufacturing technique such as laser powder bed fusion. The preliminary results show that different lattice structures and types can be successfully meshed using nTopology software, and the lattice structure data can be successfully transformed to Multiphysics Object-Oriented Simulation (MOOSE) Environment input. Finite Element Analysis (FEA) displays that, at macro/engineering scale simulation, the weight saving design has an obvious effect on tensile behavior such as effective elastic modulus and yield stress. The novel approaches of this work are (1) development of lattice structures for improved mechanical properties using advanced simulation and modeling techniques; and (2) model predictions of the mechanical properties (e.g., strength and stress distribution) of macroscopic materials in order to preliminarily select a lattice structure for additive manufacturing.

36 MATERIALS SCIENCE↗

Synthetic Vision Displays for Planetary and Lunar Lander Vehicles

Aviation research has demonstrated that Synthetic Vision (SV) technology can substantially enhance situation awareness, reduce pilot workload, improve aviation safety, and promote flight path control precision. SV, and related flight deck technologies are currently being extended for application in planetary exploration vehicles. SV, in particular, holds significant potential for many planetary missions since the SV presentation provides a computer-generated view for the flight crew of the terrain and other significant environmental characteristics independent of the outside visibility conditions, window locations, or vehicle attributes. SV allows unconstrained control of the computer-generated scene lighting, terrain coloring, and virtual camera angles which may provide invaluable visual cues to pilots/astronauts, not available from other vision technologies. In addition, important vehicle state information may be conformally displayed on the view such as forward and down velocities, altitude, and fuel remaining to enhance trajectory control and vehicle system status. The paper accompanies a conference demonstration that introduced a prototype NASA Synthetic Vision system for lunar lander spacecraft. The paper will describe technical challenges and potential solutions to SV applications for the lunar landing mission, including the requirements for high-resolution lunar terrain maps, accurate positioning and orientation, and lunar cockpit display concepts to support projected mission challenges.

Arthur, Jarvis J., III↗

Visual End-Effector Position Error Compensation for Planetary Robotics

This paper describes a vision-guided manipulation algorithm that improves arm end-effector positioning to subpixel accuracy and meets the highly restrictive imaging and computational constraints of a planetary robotic flight system. Analytical, simulation-based, and experimental analyses of the algorithm's effectiveness and sensitivity to camera and arm model error is presented along with results on several prototype research systems and 'ground-in-the-loop' technology experiments on the Mars Exploration Rover (MER) vehicles. A computationally efficient and robust subpixel end-effector fiducial detector that is instrumental to the algorithm's ability to achieve high accuracy is also described along with its validation results on MER data.

vision-guided manipulation algorithm↗

A fuzzy structural matching scheme for space robotics vision

In this paper, we propose a new fuzzy structural matching scheme for space stereo vision which is based on the fuzzy properties of regions of images and effectively reduces the computational burden in the following low level matching process. Three dimensional distance images of a space truss structural model are estimated using this scheme from stereo images sensed by Charge Coupled Device (CCD) TV cameras.

Naka, Masao↗

A Decade of Neural Networks: Practical Applications and Prospects

The Jet Propulsion Laboratory Neural Network Workshop, sponsored by NASA and DOD, brings together sponsoring agencies, active researchers, and the user community to formulate a vision for the next decade of neural network research and application prospects. While the speed and computing power of microprocessors continue to grow at an ever-increasing pace, the demand to intelligently and adaptively deal with the complex, fuzzy, and often ill-defined world around us remains to a large extent unaddressed. Powerful, highly parallel computing paradigms such as neural networks promise to have a major impact in addressing these needs. Papers in the workshop proceedings highlight benefits of neural networks in real-world applications compared to conventional computing techniques. Topics include fault diagnosis, pattern recognition, and multiparameter optimization.

Kemeny, Sabrina E.↗

Information Systems for NASA's Aeronautics and Space Enterprises

The aerospace industry is being challenged to reduce costs and development time as well as utilize new technologies to improve product performance. Information technology (IT) is the key to providing revolutionary solutions to the challenges posed by the increasing complexity of NASA's aeronautics and space missions and the sophisticated nature of the systems that enable them. The NASA Ames vision is to develop technologies enabling the information age, expanding the frontiers of knowledge for aeronautics and space, improving America's competitive position, and inspiring future generations. Ames' missions to accomplish that vision include: 1) performing research to support the American aviation community through the unique integration of computation, experimentation, simulation and flight testing, 2) studying the health of our planet, understanding living systems in space and the origins of the universe, developing technologies for space flight, and 3) to research, develop and deliver information technologies and applications. Information technology may be defined as the use of advance computing systems to generate data, analyze data, transform data into knowledge and to use as an aid in the decision-making process. The knowledge from transformed data can be displayed in visual, virtual and multimedia environments. The decision-making process can be fully autonomous or aided by a cognitive processes, i.e., computational aids designed to leverage human capacities. IT Systems can learn as they go, developing the capability to make decisions or aid the decision making process on the basis of experiences gained using limited data inputs. In the future, information systems will be used to aid space mission synthesis, virtual aerospace system design, aid damaged aircraft during landing, perform robotic surgery, and monitor the health and status of spacecraft and planetary probes. NASA Ames through the Center of Excellence for Information Technology Office is leading the effort in pursuit of revolutionary, IT-based approaches to satisfying NASA's aeronautics and space requirements. The objective of the effort is to incorporate information technologies within each of the Agency's four Enterprises, i.e., Aeronautics and Space Transportation Technology, Earth, Science, Human Exploration and Development of Space and Space Sciences. The end results of these efforts for Enterprise programs and projects should be reduced cost, enhanced mission capability and expedited mission completion.

Kutler, Paul↗

Advancing Open Science Through Innovative Data System Solutions: The Joint ESA-NASA Multi-Mission Algorithm and Analysis Platform (MAAP)'s Data Ecosystem

Collaborative open science practices are changing the way research is conducted. These changes affect how scientists work together on data, code and information. Data systems enhance open science by offering forward thinking technological solutions, such as providing data and computation on the cloud, to enable collaboration, sharing and analysis. In this paper, we present our vision for a conceptual data system on the cloud that enables open science. We also present our work on the Multi-Mission Algorithm and Analysis Platform (MAAP)which has served as a pathfinder data system for this conceptual approach.

Kaylin Bugbee↗

Supercomputer requirements for selected disciplines important to aerospace

Speed and memory requirements placed on supercomputers by five different disciplines important to aerospace are discussed and compared with the capabilities of various existing computers and those projected to be available before the end of this century. The disciplines chosen for consideration are turbulence physics, aerodynamics, aerothermodynamics, chemistry, and human vision modeling. Example results for problems illustrative of those currently being solved in each of the disciplines are presented and discussed. Limitations imposed on physical modeling and geometrical complexity by the need to obtain solutions in practical amounts of time are identified. Computational challenges for the future, for which either some or all of the current limitations are removed, are described. Meeting some of the challenges will require computer speeds in excess of exaflop/s (10 to the 18th flop/s) and memories in excess of petawords (10 to the 15th words).

Peterson, Victor L.↗

Sustainable and Autonomic Space Exploration Missions

Visions for future space exploration have long term science missions in sight, resulting in the need for sustainable missions. Survivability is a critical property of sustainable systems and may be addressed through autonomicity, an emerging paradigm for self-management of future computer-based systems based on inspiration from the human autonomic nervous system. This paper examines some of the ongoing research efforts to realize these survivable systems visions, with specific emphasis on developments in Autonomic Policies.

Hinchey, Michael G.↗

Application Table: A Bridge Connecting the Designing “With-The-Material” and “The-Material” Paradigms

Over the last few decades, advances in high-performance computing, new material characterization methods, and, more recently, an emphasis on integrated computational materials engineering (ICME) have been a catalyst for multiscale modeling and simulation-based design of materials and structures in the aerospace industry. In 2016 NASA sponsored a 2040 Vision study (which appeared in 2018) to define the potential 25-year future state required for integrated multiscale modeling of materials and systems (e.g., load-bearing structures) to accelerate the pace and reduce the expense of innovation in future aerospace and aeronautical systems. The study envisions a cyber-physical-social ecosystem comprised of experimentally verified and validated (V & V) computational models, tools, and techniques, along with the associated digital tapestry, that impacts the entire supply chain to enable cost-effective, rapid, and revolutionary design of “fit-for-purpose” materials, components, and systems. Consequently, the development of a robust information management system that incorporates (across the full life cycle) both experimental (real data) and virtual data resulting from the application of various simulation tools (at single or multiple length scales), therefore enabling the virtual design and optimization of materials throughout their processing – internal structure – property – performance envelope, has become critical. This need is also fueled by the demands for higher efficiency in material testing; consistency, quality, and traceability of data; product design; engineering analysis; as well as control of access to proprietary or sensitive information. This is particularly true when attempting to merge ICME practices with recent additive manufacturing technology which will enable production of the resulting 2040 Vision material and structural designs. At NASA Glenn Research Center we are exploring the future of material science through the use of novel characterization methodologies, high performance computing, and recently an emphasis on integrated computational materials engineering (ICME). Herein, recent efforts to incorporate an Application Table within NASA Glenn Research Center’s ICME Granta MI database is presented. The goal is to provide a place where material and structural application information/requirements can be linked so as to marry the “design the-material” and the “design-with-material” paradigms and thereby enable application-driven design and optimization of materials and structures by providing a central location that links material processing at various length scales to the application’s performance requirements. This paper discusses the specifics of this Application Table as well as best practices and key principles for the development of a robust materials information management system to enable the 2040 Vision integrated materials and structures ecosystem. Furthermore, it presents the intended role of the Application Table in the future of ICME design of “fit-for-purpose” materials, showing the need for a well-established framework that can successfully bridge the gap between the design “the material” and design “with-the-material” paradigms.

Materials↗