Results for “landmark detection” — Page 2

NASA NTRSDate not supplied

Acoustic Emission Methods for the Health Evaluation of Integrated Pressure Components

At the request of the Pressure Systems Senior Discipline Expert, to overcome the access and detectable flaw size limitations of other nondestructive evaluation (NDE) methods for integrated components, a technique akin to seismology was advanced to perceive the earliest signs of cracking in titanium components before they escalate into serious issues. In this project we achieved a landmark in Acoustic Emission (AE) testing with the first NASA Probability of Detection (POD) study. This is an important first step to the certification of the AE method for flight components and was based on the testing of notched panels. By working closely with industry allies and employing approved methods from the boiler and pressure vessel sector, we not only met but surpassed all POD benchmarks with our test and acceptance criteria. In experiments involving solution heat-treated and aged 6Al-4V-Ti alloy tested with broadband sensors, we recorded a 96% success rate, with zero false positives reported. Our research shows that in some cases, AE testing can locate smaller cracks than other NDE methods. An industry tool for scaling results to full pressure vessels is highlighted. However, before applying our findings to NASA components, tests to validate the transfer functions are advised.

acoustic↗

NASA NTRS2003

Autonomous landmark tracking orbit determination strategy

In this paper, an orbit determination strategy is described that is fully autonomous and relies on a computer-based crater detection and identification algorithm that is suitable for both automation of the ground based navigation system and autonomous spacecraft based navigation.

landmark tracking orbit determination↗

NASA NTRS1976

Advanced Earth Observation System Instrumentation Study (AEOSIS)

The feasibility, practicality, and cost are investigated for establishing a national system or grid of artificial landmarks suitable for automated (near real time) recognition in the multispectral scanner imagery data from an earth observation satellite (EOS). The intended use of such landmarks, for orbit determination and improved mapping accuracy is reviewed. The desirability of using xenon searchlight landmarks for this purpose is explored theoretically and by means of experimental results obtained with LANDSAT 1 and LANDSAT 2. These results are used, in conjunction with the demonstrated efficiency of an automated detection scheme, to determine the size and cost of a xenon searchlight that would be suitable for an EOS Searchlight Landmark Station (SLS), and to facilitate the development of a conceptual design for an automated and environmentally protected EOS SLS.

Var, R. E.↗

NASA NTRSDate not supplied

VSLAM and Coplanar POSIT for Advanced Air Mobility Approach and Landing

Advanced Air Mobility (AAM) aircraft have many challenges for landing accurately and safely in urban, suburban, and rural environments. Localization in large and open rural environments could utilize GPS, but AAM aircraft in urban environments will encounter GPS degradation. Another challenge involves flight operation time, i.e., flying during the day or at night. There are different types of guidelines and landmarks at runways, heliports, and vertiports for daytime and nighttime applications. Tailoring feature detection methods for AAM approach and landing during the day and night pose different issues and challenges. It is easier to detect edges, lines, and other runway markers during the day than at night. Conversely, it is easier to detect landing light configurations and patterns at nighttime than daytime. Consequently, utilizing the same feature detector for daytime and nighttime operations may not be feasible. This paper focuses on vision-based precision approach and landing (PAL) and builds on previous work by comparing ORB SLAM, custom VSLAM, and coplanar pose from orthography and scaling with iterations (POSIT) for daytime and nighttime operations. Implementing high fidelity simulations with computer graphics and extracting video frames from flight test data provide promising results for AAM PAL applications.

Evan Kawamura↗

NASA NTRSDate not supplied

VSLAM and Vision-based Approach and Landing for Advanced Air Mobility

Advanced Air Mobility (AAM) aircraft have many challenges in landing accurately and safely in urban, suburban, and rural environments. Localization in large and open rural environments could utilize GPS, but AAM aircraft in urban environments will encounter GPS degradation. Another challenge involves flight operation time, i.e., flying during the day or at night. There are different guidelines, landmarks, and landing light configurations at runways, heliports, and vertiports for daytime and nighttime applications. Tailoring feature detection methods for AAM approach and landing during the day and night pose different issues and challenges. It is easier to detect edges, lines, and other runway markers during the day than at night. Conversely, it is easier to see landing light configurations and patterns at nighttime than daytime. Consequently, utilizing the same feature detector for daytime and nighttime operations may not be feasible. This paper focuses on a vision-based precision approach and landing (PAL) by comparing ORB SLAM 2, a Vision Simultaneous Localization and Mapping (VSLAM) algorithm, and a novel EKF that combines onboard IMU measurements with coplanar pose from orthography and scaling with iterations (COPOSIT). Conducting unmanned aerial system (UAS) flight tests at NASA Armstrong Flight Research Center (AFRC) with landmarks and fiducials distributed around the landing zone provides a simulated AAM approach and landing data to test vision-based PAL methods to provide Alternative Position, Navigation, and Timing (APNT) solutions for AAM PAL applications. The novel vision-based PAL EKF with IMU and COPOSIT provides accurate state estimation when distributed landmarks and fiducials are in the field of view.

distributed sensing↗

NASA NTRS2009

Processing Images of Craters for Spacecraft Navigation

A crater-detection algorithm has been conceived to enable automation of what, heretofore, have been manual processes for utilizing images of craters on a celestial body as landmarks for navigating a spacecraft flying near or landing on that body. The images are acquired by an electronic camera aboard the spacecraft, then digitized, then processed by the algorithm, which consists mainly of the following steps: 1. Edges in an image detected and placed in a database. 2. Crater rim edges are selected from the edge database. 3. Edges that belong to the same crater are grouped together. 4. An ellipse is fitted to each group of crater edges. 5. Ellipses are refined directly in the image domain to reduce errors introduced in the detection of edges and fitting of ellipses. 6. The quality of each detected crater is evaluated. It is planned to utilize this algorithm as the basis of a computer program for automated, real-time, onboard processing of crater-image data. Experimental studies have led to the conclusion that this algorithm is capable of a detection rate >93 percent, a false-alarm rate <5 percent, a geometric error <0.5 pixel, and a position error <0.3 pixel.

Cheng, Yang↗

NASA NTRS1994

Microrover research at JPL

Planetary exploration with microrovers can be extended beyond the baseline short-range capability proposed for the Mars Environmental Survey (MESUR) microrover mission. The useful range of the microrover can be increased by using local landmarks to accurately reach desired science sites with a minimal number of Earth commands. Furthermore, onboard processing can give indications of excessive sinkage or slippage, which comprise hazards which may not be detectable from imaging, as well as to improve dead reckoning performance. Lastly, it is important to estimate the mean and variance of mission parameters such as time-to-reach-goal, energy-to-reach-goal, and likelihood-of-finding landmark. The author of the paper discusses research focused on accomplishing these objectives.

Wilcox, Brian↗

NASA NTRS1990

Planning for execution monitoring on a planetary rover

A planetary rover will be traversing largely unknown and often unknowable terrain. In addition to geometric obstacles such as cliffs, rocks, and holes, it may also have to deal with non-geometric hazards such as soft soil and surface breakthroughs which often cannot be detected until rover is in imminent danger. Therefore, the rover must monitor its progress throughout a traverse, making sure to stay on course and to detect and act on any previously unseen hazards. Its onboard planning system must decide what sensors to monitor, what landmarks to take position readings from, and what actions to take if something should go wrong. The planning systems being developed for the Pathfinder Planetary Rover to perform these execution monitoring tasks are discussed. This system includes a network of planners to perform path planning, expectation generation, path analysis, sensor and reaction selection, and resource allocation.

Gat, Erann↗

NASA NTRS2010

A New Strategy to Land Precisely on the Northern Plains of Mars

During the Phoenix mission landing site selection process, the Mars Reconnaissance Orbiter (MRO) High Resolution Imaging Science Experiment (HiRISE) images revealed widely spread and dense rock fields in the northern plains. Automatic rock mapping and subsequent statistical analyses showed 30-90% CFA (cumulative fractional area) covered by rocks larger than 1 meter in dense rock fields around craters. Less dense rock fields had 5-30% rock coverage in terrain away from craters. Detectable meter-scale boulders were found nearly everywhere. These rocks present a risk to spacecraft safety during landing. However, they are the most salient topographic features in this region, and can be good landmarks for spacecraft localization during landing. In this paper we present a novel strategy that uses abundance of rocks in northern plains for spacecraft localization. The paper discusses this approach in three sections: a rock-based landmark terrain relative navigation (TRN) algorithm; the TRN algorithm feasibility; and conclusions.

pin point landing↗

NASA NTRS2016

Localization from Visual Landmarks on a Free-Flying Robot

We present the localization approach for Astrobee,a new free-flying robot designed to navigate autonomously on board the International Space Station (ISS). Astrobee will conduct experiments in microgravity, as well as assisst astronauts and ground controllers. Astrobee replaces the SPHERES robots which currently operate on the ISS, which were limited to operating in a small cube since their localization system relied on triangulation from ultrasonic transmitters. Astrobee localizes with only monocular vision and an IMU, enabling it to traverse the entire US segment of the station. Features detected on a previously-built map, optical flow information,and IMU readings are all integrated into an extended Kalman filter (EKF) to estimate the robot pose. We introduce several modifications to the filter to make it more robust to noise.Finally, we extensively evaluate the behavior of the filter on atwo-dimensional testing surface.

Coltin, Brian↗

NASA NTRS2016

Localization from Visual Landmarks on a Free-Flying Robot

We present the localization approach for Astrobee, a new free-flying robot designed to navigate autonomously on the International Space Station (ISS). Astrobee will accommodate a variety of payloads and enable guest scientists to run experiments in zero-g, as well as assist astronauts and ground controllers. Astrobee will replace the SPHERES robots which currently operate on the ISS, whose use of fixed ultrasonic beacons for localization limits them to work in a 2 meter cube. Astrobee localizes with monocular vision and an IMU, without any environmental modifications. Visual features detected on a pre-built map, optical flow information, and IMU readings are all integrated into an extended Kalman filter (EKF) to estimate the robot pose. We introduce several modifications to the filter to make it more robust to noise, and extensively evaluate the localization algorithm.

Coltin, Brian↗

NASA NTRS2022

Lunar Rover Localization Using Craters as Landmarks

Onboard localization capabilities for planetary rovers to date have used relative navigation, by integrating combinations of wheel odometry, visual odometry, and inertial measurements during each drive to track position relative to the start of each drive. At the end of each drive, a “ground-in-the-loop” (GITL) interaction is used to get a position update from human operators in a more global reference frame, such as a map frame defined by orbital reconnaissance imaging of a large region around the rover’s current position. For Mars rovers, this typically has involved downlinking imagery from the rover mast cameras and using interactive visualization tools on Earth to register such images to the orbital reconnaissance images. For safety purposes, rover mission operations typically specify “keep out zones”, which human operators recognize as being unsafe in the orbital images. Autonomous rover drives are limited in distance so that accumulated relative navigation error does not risk the possibility of the rover driving into a keep out zone. The allowable autonomous drive distance in this mode of operation depends on the distribution of keep out zones and the accuracy of relative navigation; in practice, drive limits of a few hundred meters between GITL cycles are to be expected. Several rover mission concepts have recently been studied that require much longer drives between GITL cycles, particularly for the Moon. This includes lunar rover mission concepts that involve (1) driving mostly in sunlight at low latitudes, (2) driving in permanently shadowed regions near the south pole, and (3) a mixture of day and night driving in mid-latitudes. These concepts include total traverse distance requirements of up to 1,800 km in 4 Earth years, with individual drives of several kilometers between stops for downlink. These concepts require greater autonomy to minimize GITL cycles to enable such large range; onboard global localization is a key element of such autonomy. Multiple techniques have been studied in the past for onboard rover global localization, including radio navigation aiding from an orbiter, recognizing horizon landmarks that are known in a regional elevation map, and correlating a local elevation map created onboard the rover with a regional elevation map. These techniques all have drawbacks, including requiring an expensive extra mission element (navigation orbiter), unavailability of sufficient regional elevation map data, or limited accuracy in resulting position estimates (e.g. a few hundred meters with horizon landmarks). For the Moon, the ubiquitous craters offer another possibility, which involves mapping craters from orbit, then recognizing crater landmarks with cameras and/or a lidar onboard the rover. This approach is applicable everywhere on the Moon, does not require high resolution stereo imaging from orbit as some other approaches do, and has potential to enable position knowledge with order of 10 m accuracy at all times. This paper will provide more detail on our technical approach to crater-based lunar rover localization and will present initial results on crater detection using 3-D point cloud data from onboard lidar or stereo cameras and using shading cues in monocular onboard imagery.

Ono, M.↗

NASA NTRS2011

Automatic Facial Expression Recognition and Operator Functional State

The prevalence of human error in safety-critical occupations remains a major challenge to mission success despite increasing automation in control processes. Although various methods have been proposed to prevent incidences of human error, none of these have been developed to employ the detection and regulation of Operator Functional State (OFS), or the optimal condition of the operator while performing a task, in work environments due to drawbacks such as obtrusiveness and impracticality. A video-based system with the ability to infer an individual's emotional state from facial feature patterning mitigates some of the problems associated with other methods of detecting OFS, like obtrusiveness and impracticality in integration with the mission environment. This paper explores the utility of facial expression recognition as a technology for inferring OFS by first expounding on the intricacies of OFS and the scientific background behind emotion and its relationship with an individual's state. Then, descriptions of the feedback loop and the emotion protocols proposed for the facial recognition program are explained. A basic version of the facial expression recognition program uses Haar classifiers and OpenCV libraries to automatically locate key facial landmarks during a live video stream. Various methods of creating facial expression recognition software are reviewed to guide future extensions of the program. The paper concludes with an examination of the steps necessary in the research of emotion and recommendations for the creation of an automatic facial expression recognition program for use in real-time, safety-critical missions.

Blanson, Nina↗

NASA NTRS2012

Automatic Facial Expression Recognition and Operator Functional State

The prevalence of human error in safety-critical occupations remains a major challenge to mission success despite increasing automation in control processes. Although various methods have been proposed to prevent incidences of human error, none of these have been developed to employ the detection and regulation of Operator Functional State (OFS), or the optimal condition of the operator while performing a task, in work environments due to drawbacks such as obtrusiveness and impracticality. A video-based system with the ability to infer an individual's emotional state from facial feature patterning mitigates some of the problems associated with other methods of detecting OFS, like obtrusiveness and impracticality in integration with the mission environment. This paper explores the utility of facial expression recognition as a technology for inferring OFS by first expounding on the intricacies of OFS and the scientific background behind emotion and its relationship with an individual's state. Then, descriptions of the feedback loop and the emotion protocols proposed for the facial recognition program are explained. A basic version of the facial expression recognition program uses Haar classifiers and OpenCV libraries to automatically locate key facial landmarks during a live video stream. Various methods of creating facial expression recognition software are reviewed to guide future extensions of the program. The paper concludes with an examination of the steps necessary in the research of emotion and recommendations for the creation of an automatic facial expression recognition program for use in real-time, safety-critical missions

Blanson, Nina↗

NASA NTRS2005

Automated Image Registration Using Morphological Region of Interest Feature Extraction

With the recent explosion in the amount of remotely sensed imagery and the corresponding interest in temporal change detection and modeling, image registration has become increasingly important as a necessary first step in the integration of multi-temporal and multi-sensor data for applications such as the analysis of seasonal and annual global climate changes, as well as land use/cover changes. The task of image registration can be divided into two major components: (1) the extraction of control points or features from images; and (2) the search among the extracted features for the matching pairs that represent the same feature in the images to be matched. Manual control feature extraction can be subjective and extremely time consuming, and often results in few usable points. Automated feature extraction is a solution to this problem, where desired target features are invariant, and represent evenly distributed landmarks such as edges, corners and line intersections. In this paper, we develop a novel automated registration approach based on the following steps. First, a mathematical morphology (MM)-based method is used to obtain a scale-orientation morphological profile at each image pixel. Next, a spectral dissimilarity metric such as the spectral information divergence is applied for automated extraction of landmark chips, followed by an initial approximate matching. This initial condition is then refined using a hierarchical robust feature matching (RFM) procedure. Experimental results reveal that the proposed registration technique offers a robust solution in the presence of seasonal changes and other interfering factors. Keywords-Automated image registration, multi-temporal imagery, mathematical morphology, robust feature matching.

Plaza, Antonio↗

NASA NTRS1987

Certainty grids for mobile robots

A numerical representation of uncertain and incomplete sensor knowledge called Certainty Grids has been used successfully in several mobile robot control programs, and has proven itself to be a powerful and efficient unifying solution for sensor fusion, motion planning, landmark identification, and many other central problems. Researchers propose to build a software framework running on processors onboard the new Uranus mobile robot that will maintain a probabilistic, geometric map of the robot's surroundings as it moves. The certainty grid representation will allow this map to be incrementally updated in a uniform way from various sources including sonar, stereo vision, proximity and contact sensors. The approach can correctly model the fuzziness of each reading, while at the same time combining multiple measurements to produce sharper map features, and it can deal correctly with uncertainties in the robot's motion. The map will be used by planning programs to choose clear paths, identify locations (by correlating maps), identify well-known and insufficiently sensed terrain, and perhaps identify objects by shape. The certainty grid representation can be extended in the same dimension and used to detect and track moving objects.

Moravec, H. P.↗

NASA NTRS2024

3D Scanning System to Assess Gravity-Dependent Body Shape Changes

The human body shows unique physiological and morphological changes when exposed to different gravity conditions, including muscle atrophy, fluid shift, spinal elongation, and body posture adjustments. Such changes need to be incorporated for human-system integration in the vehicle habitat, garment, and spacesuit designs, as inaccurate body measurements can result in suboptimal crew protection that can potentially decrease injury tolerance. However, the traditional linear measurements, such as stature, segment lengths or circumferences measured using a caliper or tape measure, often show limited consistency and are unable to capture the nonlinear characteristics of the human body. While 3D body scanning can provide significant advantages over linear measurements, the technologies have not been fully developed or customized for in-flight scanning. For ground laboratory use, several different scanner types are commercially available. However, in-flight scanning requires additional technical considerations, such as minimal scan time, simplified calibration, and sufficient capture volume. This work aims to develop a prototype 3-D body scanning system that is customized for in-flight use to scan crewmembers, with the configuration and performance optimized for detecting known gravity-dependent body shape and posture changes. A hardware system will be custom built using a network of commercial off-the-shelf 3D sensors. The sensor parameters and settings will be optimized to detect the targeted body shape changes, specifically using body manikins of which the shape and size are iteratively permuted to simulate the known changes by fluid shift and spinal elongation. The capture volume will be also matched for a range of body sizes from a 1st percentile female to 99th percentile male. Unintentional body motions or floating in microgravity will be also simulated and incorporated. A data acquisition software will be developed for efficient in-flight operations with minimal overhead and easy-to-use user interface. A simplified calibration procedure will be designed for robust scanning against frequent vibration or unexpected sensor position shifts. The system will be tested in the ground laboratory for accuracy and reliability against a reference scanning system. New anthropometry measurements will be also identified to sensitively capture the gravity dependent body shape changes, in addition to the traditional anthropometry measurements. A novel landmark-based technique will be tested for consistent anthropometry measurements across posture variations. If successfully developed and deployed, the new system is expected to provide previously unavailable body shape and size data from different gravitational environments, including 0-g, 1/6-g, and 1-g. Such data can improve suit fit, habitat design, exercise efficacy quantification and sizing of orthostatic intolerance garments.

K H Kim↗

NASA NTRS2024

3D Scanning System to Assess Gravity-Dependent Body Shape Changes

The human body shows unique physiological and morphological changes when exposed to different gravity conditions, including muscle atrophy, fluid shift, spinal elongation, and body posture adjustments. Such changes need to be incorporated for human-system integration in the vehicle habitat, garment, and spacesuit designs, as inaccurate body measurements can result in suboptimal crew protection that can potentially decrease injury tolerance. However, the traditional linear measurements, such as stature, segment lengths or circumferences measured using a caliper or tape measure, often show limited consistency and are unable to capture the nonlinear characteristics of the human body. While 3D body scanning can provide significant advantages over linear measurements, the technologies have not been fully developed or customized for in-flight scanning. For ground laboratory use, several different scanner types are commercially available. However, in-flight scanning requires additional technical considerations, such as minimal scan time, simplified calibration, and sufficient capture volume. This work aims to develop a prototype 3-D body scanning system that is customized for in-flight use to scan crewmembers, with the configuration and performance optimized for detecting known gravity-dependent body shape and posture changes. A hardware system will be custom built using a network of commercial off-the-shelf 3D sensors. The sensor parameters and settings will be optimized to detect the targeted body shape changes, specifically using body manikins of which the shape and size are iteratively permuted to simulate the known changes by fluid shift and spinal elongation. The capture volume will be also matched for a range of body sizes from a 1st percentile female to 99th percentile male. Unintentional body motions or floating in microgravity will be also simulated and incorporated. A data acquisition software will be developed for efficient in-flight operations with minimal overhead and easy-to-use user interface. A simplified calibration procedure will be designed for robust scanning against frequent vibration or unexpected sensor position shifts. The system will be tested in the ground laboratory for accuracy and reliability against a reference scanning system. New anthropometry measurements will be also identified to sensitively capture the gravity dependent body shape changes, in addition to the traditional anthropometry measurements. A novel landmark-based technique will be tested for consistent anthropometry measurements across posture variations. If successfully developed and deployed, the new system is expected to provide previously unavailable body shape and size data from different gravitational environments, including 0-g, 1/6-g, and 1-g. Such data can improve suit fit, habitat design, exercise efficacy quantification and sizing of orthostatic intolerance garments.

K H Kim↗