Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image Navigation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

PlasmoData.jl — A Julia framework for modeling and analyzing complex data as graphs

Datasets encountered in scientific and engineering applications appear in complex formats (e.g., images, multivariate time series, molecules, video, text strings, networks). Graph theory provides a unifying framework to model such datasets and enables the use of powerful tools that can help analyze, visualize, and extract value from data. In this work, we present PlasmoData.jl, an open-source, Julia framework that uses concepts of graph theory to facilitate the modeling and analysis of complex datasets. The core of our framework is a general data modeling abstraction, which we call a DataGraph. We show how the abstraction and software implementation can be used to represent diverse data objects as graphs and to enable the use of tools from topology, graph theory, and machine learning (e.g., graph neural networks) to conduct a variety of tasks. We illustrate the versatility of the framework by using real datasets: (i) an image classification problem using topological data analysis to extract features from the graph model to train machine learning models; (ii) a disease outbreak problem where we model multivariate time series as graphs to detect abnormal events; and (iii) a technology pathway analysis problem where we highlight how we can use graphs to navigate connectivity. Further, our discussion also highlights how PlasmoData.jl leverages native Julia capabilities to enable compact syntax, scalable computations, and interfaces with diverse packages. Overall, we show that the DataGraph abstraction and PlasmoData.jl Julia package are able to model data within graphs and enable useful analysis.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Automated site characterization for robotic sample acquisition systems

A mobile, semi-autonomous vehicle with multiple sensors and on-board intelligence is proposed for performing preliminary scientific investigations on extraterrestrial bodies prior to human exploration. Two technologies, a hybrid optical-digital computer system based on optical correlator technology and an image and instrument data analysis system, provide complementary capabilities which might be part of an instrument package for an intelligent robotic vehicle. The hybrid digital-optical vision system could perform real-time image classification tasks using an optical correlator with programmable matched filters under control of a digital microcomputer. The data analysis system would analyze visible and multiband imagery to extract mineral composition and textural information for geologic characterization. Together these technologies would support the site characterization needs of a robotic vehicle for both navigational and scientific purposes.

Scholl, Marija S.↗

An autonomous rendezvous and docking system using cruise missile technologies

In November 1990 the Autonomous Rendezvous & Docking (AR&D) system was first demonstrated for members of NASA's Strategic Avionics Technology Working Group. This simulation utilized prototype hardware from the Cruise Missile and Advanced Centaur Avionics systems. The object was to show that all the accuracy, reliability and operational requirements established for a space craft to dock with Space Station Freedom could be met by the proposed system. The rapid prototyping capabilities of the Advanced Avionics Systems Development Laboratory were used to evaluate the proposed system in a real time, hardware in the loop simulation of the rendezvous and docking reference mission. The simulation permits manual, supervised automatic and fully autonomous operations to be evaluated. It is also being upgraded to be able to test an Autonomous Approach and Landing (AA&L) system. The AA&L and AR&D systems are very similar. Both use inertial guidance and control systems supplemented by GPS. Both use an Image Processing System (IPS), for target recognition and tracking. The IPS includes a general purpose multiprocessor computer and a selected suite of sensors that will provide the required relative position and orientation data. Graphic displays can also be generated by the computer, providing the astronaut / operator with real-time guidance and navigation data with enhanced video or sensor imagery.

Jones, Ruel Edwin↗

Estimation of the absolute position of mobile systems by an optoelectronic processor

A method that determine the absolute position of a mobile system with a hybrid optoelectronic processor has been developed. Position estimates are based on an analysis of circular landmarks that are detected by a TV camera attached to the mobile system. The difference between the known shape of the landmark and its image provides the information needed to determine the absolute position of the mobile system. For robust operation, the parameters of the landmark image are extracted at high speeds using an optical processor that performs an optical Hough transform. The coordinates of the mobile system are computed from these parameters in a digital co-processor using fast algorithms. Different sources of position estimation errors have also been analyzed, and consequent algorithms to improve the navigation performance of the mobile system have been developed and evaluated by both computer simulation and experiments.

Feng, Liqiang↗

Applied Superconductivity and Superfluidity for Exploration of the Moon and Mars

The initiative for human exploration of the Moon and Mars presents great technical challenges as well as new opportunities for scientific investigations. I will discuss recent developments in superconductivity and superfluidity that can be applied to solve some of these technical challenges. This includes biomedical imaging of astronauts using an array of SQUID magnetometers; resource exploration using SQUID as well as a SQUID-based gravitational gradiometer; measurement of rotational jitter of the Moon and of Mars, for improvement in GPS using a superfluid gyroscope; and the concept of a high precision superfluid clock recently proposed for navigation at JPL. Physicists can also participate as explorers in the Moon/Mars initiative. I will discuss a proposed experiment to search for the postulated strangelet particle (a dark matter candidate) by using the Moon or Mars as a giant detector. As suggest by Nobel Laureate Sheldon Glashow, a massive (approx. 1 ton) strangelet can generate a trail of seismic waves, as it traverses a celestial body. The pristine environments of the Moon and Mars, with their very low seismic backgrounds, are ideal for such an experiment. Very sensitive SQUID-based seismometers can be deployed to increase the sensitivity of strangelet detection.

Chui, Talso↗

How do we get robots to take self-portraits on Mars? – Perseverance-Ingenuity and Curiosity selfies

The Perseverance rover landed in Jezero crater,Mars, on 18 February 2021. It carried with it a technologydemonstration, the Ingenuity helicopter, which hasdemonstrated the first controlled, powered flight on anotherplanet. This paper describes how an iconic, April 2021 imageof the Perseverance rover with the Ingenuity helicopter wasdesigned and executed as the rover was getting ready todeploy the helicopter. WATSON is a camera mounted at theend of the rover’s robotic arm and was used to acquire theself-portrait. WATSON is designed to take close up picturesof rocks and regolith on Mars but can also provide views ofthe terrain. A single image covers a small portion of thescene. In order to a create a mosaic covering the full roverand helicopter, 62 WATSON images were acquired. To allowthe images to be mosaicked together, the camera needs to bekept in the same spot. The robotic arm has five degrees offreedom for motion; small changes in orientation can requiresignificant repositioning of the robotic arm joints. Todocument this, a movie of the arm motion was acquired bythe rover’s mast-mounted left navigation camera pointed atthe WATSON and robotic arm while it was simultaneouslymoving to acquire the selfie. For the first time, we alsocaptured the sound of the arm motion as it was acquiring theselfie. In the case of the Perseverance selfie with the Ingenuity helicopter, we also had to think about how toposition the rover with respect to the helicopter and fit theselfie acquisition into the helicopter prime mission timeline.This paper also describes the history of NASA Mars roverselfies.

Beegle, Luther↗

Systems and methods for interferometric end point detection for a focused ion beam fabrication tool

Various technologies for providing an operator of a focused ion beam (FIB) system with navigational and processing data are described herein. An exemplary system includes a broadband light source and a narrowband light source that emit light to a target of the FIB. An optical detector receives reflections of the broadband light from the target and outputs data that is used to generate two-dimensional images of the target in a region near a location of incidence of the FIB at the target. An interferometer receives reflections of the narrowband light from the target and outputs data indicative of an interference pattern of the narrowband reflections. A computing device computes a thickness of one or more material layers that make up the target based upon the interference pattern. A two-dimensional image of the target and an indication of the computed thickness are then displayed to the operator of the FIB.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

The Payload and Operations of the Hera Mission

On 26 September 2022, NASA’s DART mission successfully impacted on Dimorphos, the secondary of the binary asteroid Didymos. DART released the Light Italian Cubesat for Imaging of Asteroids (LICIACube) two weeks before the impact, and LICIACube flew by the asteroids three minutes after the impact. On approach, DART took images of both asteroids, which, supported by additional imagery from LICIACube, characterized the pre-impact state of the Didymos system. DART changed the orbit of Dimorphos around Didymos, reducing its orbital period by 33 minutes. DART will be followed by a detailed investigation of the Didymos system and the outcome of the impact by ESA’s Hera mission. Hera will be launched in October 2024 and arrive at Didymos in early 2027. The presentation will focus on the payload of the Hera mission and the operations at the asteroid system. The main objectives of the Hera mission are to: - Measure the mass of Dimorphos to accurately measure the momentum transfer efficiency of the DART impact. - Characterise the change of the surface of Dimorphos by DART, including the properties (and existence!) of the DART crater, to improve our understanding of impact physics and to observe unweathered material, recently exposed at the surface. - Determine the physical properties of Dimorphos, including its internal structure, to allow scaling of the impact to different types of asteroids. - Measure the dynamical and physical state of the Didymos and Dimorphos system to constrain binary formation scenarios. Hera is equipped with the following payload: Two Asteroid Framing Cameras (AFCs) for both science and navigation. There resolution is ~10-4 rad/pixel, or 40 cm/pixel for close observations from 4 km. They will provide the target global properties as well as local geomorphology and will investigate the crater and impact site. They will also measure the mass of Dimorphos through the “wobble” motion of Didymos. The Planetary ALTimeter (PALT) will measure the distance to the target and shape and topography information complementary to that from AFC images. The Thermal InfraRed Imager (TIRI) will provide information about the thermal properties of the Didymos system and spectral information in the mid-infrared (6 bands from 7 – 14 µm). The Hyperscout-H hyperspectral imager will provide mineralogical information from 25 spectral bands between 665 and 975 nm. Milani, a 6 unit cubesat, will carry a visible to near-IR imaging spectrometer (ASPECT, 500 – 2500 nm) to derive mineralogical information on the composition of the asteroids, and a thermogravimeter (VISTA) to measure the abundance and constrain the composition of ambient dust particles. Juventas, a 6 unit cubesat, will carry a monostatic low-frequency radar (JuRa), and a gravimeter (GRASS) to derive interior and surface properties of the asteroids. The Radio Science experiment will measure the gravity field of the Didymos system. Measurements of the acceleration of the Hera spacecraft by the asteroid pair through the radio link between Earth and Hera will be used as well as the inter-satellite link between Hera and the two cubesats. We will describe how the goals of Hera will be achieved with the different payload elements.

Michael Küppers↗

Beyond Optimization: Exploring Novelty Discovery in Autonomous Experiments

Autonomous experiments (AEs) are transforming how scientific research is conducted by integrating artificial intelligence with automated experimental platforms. Current AEs primarily focus on the optimization of a predefined target; while accelerating this goal, such an approach limits the discovery of unexpected or unknown physical phenomena. Here, we introduce a novel framework, INS 2 ANE (Integrated Novelty Score−Strategic Autonomous Non-Smooth Exploration), to enhance the discovery of novel phenomena in autonomous microscopy experimentation. Our method integrates two key components: (1) a novelty scoring system that evaluates the uniqueness of experimental results and (2) a strategic sampling mechanism that promotes exploration of under-sampled regions even if they appear less promising by conventional criteria. We validate this approach on a preacquired data set with a known ground truth comprising of image−spectral pairs. We further implement the process on autonomous scanning probe microscopy experiments. INS 2 ANE significantly increases the diversity of explored phenomena in comparison to conventional optimization routines, enhancing the likelihood of discovering previously unobserved phenomena. These results demonstrate the potential for autonomous microscopy experiments to enhance the scientific discovery by navigating complex experimental spaces to uncover novel phenomena.

Materials↗

Laser-Camera Vision Sensing for Spacecraft Mobile Robot Navigation

The advent of spacecraft mobile robots-free-flyng sensor platforms and communications devices intended to accompany astronauts or remotely operate on space missions both inside and outside of a spacecraft-has demanded the development of a simple and effective navigation schema. One such system under exploration involves the use of a laser-camera arrangement to predict relative positioning of the mobile robot. By projecting laser beams from the robot, a 3D reference frame can be introduced. Thus, as the robot shifts in position, the position reference frame produced by the laser images is correspondingly altered. Using normalization and camera registration techniques presented in this paper, the relative translation and rotation of the robot in 3D are determined from these reference frame transformations.

Maluf, David A.↗

Scanner imaging systems, aircraft

The causes and effects of distortion in aircraft scanner data are reviewed and an approach to reduce distortions by modelling the effect of aircraft motion on the scanner scene is discussed. With the advent of advanced satellite borne scanner systems, the geometric and radiometric correction of aircraft scanner data has become increasingly important. Corrections are needed to reliably simulate observations obtained by such systems for purposes of evaluation. It is found that if sufficient navigational information is available, aircraft scanner coordinates may be related very precisely to planimetric ground coordinates. However, the potential for a multivalue remapping transformation (i.e., scan lines crossing each other), adds an inherent uncertainty, to any radiometric resampling scheme, which is dependent on the precise geometry of the scan and ground pattern.

Ungar, S. G.↗

Spherical Occulter Coronagraph Cubesat

The present invention relates to a space-based instrument which provides continuous coronal electron temperature and velocity images, for a predetermined period of time, thereby improving the understanding of coronal evolution and how the solar wind and Coronal Mass Ejection transients evolve from the low solar atmosphere through the heliosphere for an entire solar rotation. Specifically, the present invention relates to using a 6U spherical occulter coronagraph CubeSat, and a relative navigational system (RNS) that controls the position of the spacecraft relative to the occulting sphere. The present invention innovatively deploys a free-flying spherical occulter, and after deployment, the actively controlled CubeSat will provide an inertial formation flying with the spherical occulter and Sun.

Davila, Joseph M.↗

VR for Mars Pathfinder

Virtual reality (VR) technology has played an integral role for Mars Pathfinder mission, operations Using an automated machine vision algorithm, the 3d topography of the Martian surface was rapidly recovered fro -a the stereo images captured. by the Tender camera to produce photo-realistic 3d models, An advanced, interface was developed for visualization and interaction with. the virtual environment of the Pathfinder landing site for mission scientists at the Space Flight Operations Facility of the Jet Propulsion Laboratory. The VR aspect of the display allowed mission scientists to navigate on Mars in Bud while remaining here on Earth, thus improving their spatial awareness of the rock field that surrounds the lenders Measurements of positions, distances and angles could be easily extracted from the topographic models, providing valuable information for science analysis and mission. planning. Moreover, the VR map of Mars has also been used to assist with the archiving and planning of activities for the Sojourner rover.

Blackmon, Theodore↗

FPGA Implementation of Stereo Disparity with High Throughput for Mobility Applications

High speed stereo vision can allow unmanned robotic systems to navigate safely in unstructured terrain, but the computational cost can exceed the capacity of typical embedded CPUs. In this paper, we describe an end-to-end stereo computation co-processing system optimized for fast throughput that has been implemented on a single Virtex 4 LX160 FPGA. This system is capable of operating on images from a 1024 x 768 3CCD (true RGB) camera pair at 15 Hz. Data enters the FPGA directly from the cameras via Camera Link and is rectified, pre-filtered and converted into a disparity image all within the FPGA, incurring no CPU load. Once complete, a rectified image and the final disparity image are read out over the PCI bus, for a bandwidth cost of 68 MB/sec. Within the FPGA there are 4 distinct algorithms: Camera Link capture, Bilinear rectification, Bilateral subtraction pre-filtering and the Sum of Absolute Difference (SAD) disparity. Each module will be described in brief along with the data flow and control logic for the system. The system has been successfully fielded upon the Carnegie Mellon University's National Robotics Engineering Center (NREC) Crusher system during extensive field trials in 2007 and 2008 and is being implemented for other surface mobility systems at JPL.

Random access memory↗

Applications of Landsat imagery to a coastal inlet stability study

Polcyn and Lyzenga (1975) and Middleton and Barber (1976) have demonstrated that it is possible to correlate the radiance values of a multispectral imagery, such as Landsat imagery, with the depth related information. The present study is one more example of such an effort. Two sets of Landsat magnetic tape were obtained and displayed on the screen of an Image-100 computer. Spectral analysis was performed to produce various signatures, their extent, and location. Subsequent ground truth observations and measurements were gathered by means of hydrographic surveys and low altitude aerial photographs for interpretation and calibration of the Landsat data. Finally, a coastal engineering assessment based on the Landsat data was made. Recommendations regarding the navigational canal alignment and dredging practice are presented in the light of inlet stability.

Wang, Y.-H.↗

Computer graphics testbed to simulate and test vision systems for space applications

Artificial intelligence concepts are applied to robotics. Artificial neural networks, expert systems and laser imaging techniques for autonomous space robots are being studied. A computer graphics laser range finder simulator developed by Wu has been used by Weiland and Norwood to study use of artificial neural networks for path planning and obstacle avoidance. Interest is expressed in applications of CLIPS, NETS, and Fuzzy Control. These applications are applied to robot navigation.

Cheatham, John B.↗

Development of Biomorphic Flyers

Biomorphic flyers have recently been demonstrated that utilize the approach described earlier in "Bio-Inspired Engineering of Exploration Systems" (NPO-21142), NASA Tech Briefs, Vol. 27, No. 5 (May 2003), page 54, to distill the principles found in successful, nature-tested mechanisms of flight control. Two types of flyers are being built, corresponding to the imaging and shepherding flyers for a biomorphic mission described earlier in "Cooperative Lander- Surface/Aerial Microflyer Missions for Mars Exploration" (NPO-30286), NASA Tech Briefs, Vol. 28, No. 5 (May 2004), page 36. The common features of these two types of flyers are that both are delta-wing airplanes incorporating bio-inspired capabilities of control, navigation, and visual search for exploration. The delta-wing design is robust to approx.40 G axial load and offers ease of stowing and packaging. The prototype that we have built recently is shown in the figure. Such levels of miniaturization and autonomous navigation are essential to enable biomorphic microflyers (<1 kg) that can be deployed in large numbers for distributed measurements and exploration of difficult terrain while avoiding hazards. Individual bio-inspired sensors that will be incorporated in a biomorphic flyer have been demonstrated recently. These sensors include a robust, lightweight (~6 g), and low-power (~40 mW) horizon sensor for flight stabilization. It integrates successfully the principles of the dragonfly ocelli. The ocelli are small eyes on the dorsal and forward regions of the heads of many insects. The ocelli are distinct from the compound eyes that are most commonly associated with insect vision. In many insects, the ocelli are little more than single-point detectors of short-wavelength light and behavioral responses to ocelli stimuli are hard to observe. The notable exception is found in dragonflies, where flight control is notably degraded by any interference with the ocellar system. Our team has discovered recently that the ocelli are a dedicated horizon sensor, with substantial optical processing and multiple spectral sensitivity. To our knowledge, this is the world s first demonstrated use of a "biomorphic ocellus" as a flight-stabilization system. The advantage of the ocelli over a similarly sized system of rate gyroscopes is that both attitude control and rate damping can be realized in one device. A full inertial unit and significant processing would otherwise be required to achieve the same effect. As a prelude to full autonomy, substantial stability augmentation is provided to the pilot at very low cost in terms of space, power, and mass. The sensor is about 40 times lighter than a comparable inertial attitude reference system. Other significant features of the biomorphic flyer shown in the figure include its ability to fly at high angles of attack ~30 and a deep wing chord which allows scaling to small size and low Reynold s number situations. Furthermore, the placement of the propulsion system near the center of gravity allows continued control authority at low speeds. These attributes make such biomorphic flyers uniquely suited to planetary and terrestrial exploration where small size and autonomous airborne operation are required.

Thakoor, Sarita↗

Ionospheric Simulation System for Satellite Observations and Global Assimilative Model Experiments - ISOGAME

Modeling and imaging the Earth's ionosphere as well as understanding its structures, inhomogeneities, and disturbances is a key part of NASA's Heliophysics Directorate science roadmap. This invention provides a design tool for scientific missions focused on the ionosphere. It is a scientifically important and technologically challenging task to assess the impact of a new observation system quantitatively on our capability of imaging and modeling the ionosphere. This question is often raised whenever a new satellite system is proposed, a new type of data is emerging, or a new modeling technique is developed. The proposed constellation would be part of a new observation system with more low-Earth orbiters tracking more radio occultation signals broadcast by Global Navigation Satellite System (GNSS) than those offered by the current GPS and COSMIC observation system. A simulation system was developed to fulfill this task. The system is composed of a suite of software that combines the Global Assimilative Ionospheric Model (GAIM) including first-principles and empirical ionospheric models, a multiple- dipole geomagnetic field model, data assimilation modules, observation simulator, visualization software, and orbit design, simulation, and optimization software.

Pi, Xiaoqing↗