Search NASA⌕ Search

SEARCH · Search NASA

Results for “Imaging System Camera”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

Visual end-effector position error compensation for planetary robotics

This paper describes a vision-guided manipulation algorithm that improves arm end-effector positioning to subpixel accuracy and meets the highly restrictive imaging and computational constraints of a planetary robotic flight system. Analytical, simulation-based, and experimental analyses of the algorithm's effectiveness and sensitivity to camera and arm model error is presented along with results on several prototype research systems and ground-in-the-loop technology experiments on the Mars Exploration Rover (MER) vehicles. A computationally efficient and robust subpixel end-effector fiducial detector that is instrumental to the algorithm's ability to achieve high accuracy is also described along with its validation results on MER data.

Nickels, Kevin↗

Imagery Analysis for Space Operations

The purpose of this project is to build a prototype camera system that utilizes artificial intelligence/machine learning and computer vision to track an object in 2D and recreate it in 3D.The goal is to improve image analysis and photogrammetry function for Pad 39B operations

Robotics↗

Imagery Analysis for Space Operations

The purpose of this project is to build a prototype camera system that utilizes artificial intelligence/machine learning and computer vision to track an object in 2D and recreate it in 3D.The goal is to improve image analysis and photogrammetry function for Pad 39B operations.

Computer Programming↗

Results from InSight Robotic Arm Activities

The InSight lander carried an Instrument Deployment System (IDS) that included an Instrument Deployment Arm (IDA), scoop, five finger “claw” grapple, forearm-mounted Instrument Deployment Camera (IDC) requiring arm motion to image a target, and landermounted Instrument Context Camera (ICC), designed to image the workspace, and to place the instruments onto the surface. As originally proposed, the IDS included a previously built arm and flight spare black and white cameras and had no science objectives or requirements, or expectation to be used after instrument deployment (90 sols). During project development the detectors were upgraded to color, and it was recognized that the arm could be used to carry out a wide variety of activities that would enable both geology and physical properties investigations. During surface operations for two martian years, the IDA was used during major campaigns to image the surface around the lander, to deploy the instruments, to assist the mole in penetrating beneath the surface, to bury a portion of the seismometer tether, to clean dust from the solar arrays to increase power, and to conduct a surface geology investigation including soil mechanics and physical properties experiments. No other surface mission has engaged in such a sustained and varied campaign of arm and scoop activities directed at such a diverse suite of objectives. Images close to the surface and continuous meteorology measurements provided important constraints on the threshold friction wind speed needed to initiate aeolian saltation and surface creep. The IDA was used extensively for almost 22 months to assist the mole in penetrating into the subsurface. Soil was scraped into piles and dumped onto the seismometer tether six times in an attempt to bury the tether and ∼ 30% was entrained in the wind and dispersed downwind 1-2 m, darkening the surface. Seven solar array cleaning experiments were conducted by dumping scoops of soil from 35 cm above the lander deck during periods of high wind that dispersed the sand onto the panels that kicked dust off of the panels into suspension in the atmosphere, thereby increasing the power by ∼15% during this period. Final IDA activities included an indentation experiment that used the IDA scoop to push on the ground to measure the plastic deformation of the soil that complemented soil mechanics measurements from scoop interactions with the surface, and two experiments in which SEIS measured the tilt from the arm pressing on the ground to derive near surface elastic properties.

Mars↗

Coastal Research Imaging Spectrometer

The Coastal Research Imaging Spectrometer (CRIS) is an airborne remote sensing system designed specifically for research on the physical, chemical, and biological characteristics of coastal waters. The CRIS includes a visible-light hyperspectral imaging subsystem for measuring the color of water, which contains information on the biota, sediment, and nutrient contents of the water. The CRIS also includes an infrared imaging subsystem, which provides information on the temperature of the water. The combination of measurements enables investigation of biological effects of both natural and artificial flows of water from land into the ocean, including diffuse and point-source flows that may contain biological and/or chemical pollutants. Temperature is an important element of such measurements because temperature contrasts can often be used to distinguish among flows from different sources: for example, a sewage outflow could manifest itself in spectral images as a local high-temperature anomaly. Both the visible and infrared subsystems scan in pushbroom mode: that is, an aircraft carrying the system moves along a ground track, the system is aimed downward, and image data are acquired in across-track linear arrays of pixels. Both subsystems operate at a frame rate of 30 Hz. The infrared and visible-light optics are adjusted so that both subsystems are aimed at the same moving swath, which has across-track angular width of 15 . Data from the infrared and visible imaging subsystems are stored in the same file along with aircraft- position data acquired by a Global Positioning System receiver. The combination of the three sets of data is used to construct infrared and hyperspectral maps of scanned areas (see figure). The visible subsystem is based on a grating spectrograph and a rapid-readout charge-coupled-device camera. Images of the swatch are acquired in 256 spectral bands at wavelengths from 400 to 800 nm. The infrared subsystem, which is sensitive in a single wavelength band of 8 to 10 m, is based on a focal-plane array of HgCdTe photodetectors that are cooled to an operating temperature of 77 K by use of a closed-Stirling-cycle mechanical cooler. The nonuniformities of the HgCdTe photodetector array are small enough that the raw pixel data from the infrared subsystem can be used to recognize temperature differences on the order of 1 C. By use of a built-in blackbody calibration source that can be switched into the field of view, one can obtain bias and gain offset terms for individual pixels, making it possible to offset the effects of nonuniformities sufficiently to enable the measurement of temperature differences as small as 0.1 C.

Lucey, Paul G.↗

Optoelectronic Sensor System for Guidance in Docking

The Video Guidance Sensor (VGS) system is an optoelectronic sensor that provides automated guidance between two vehicles. In the original intended application, the two vehicles would be spacecraft docking together, but the basic principles of design and operation of the sensor are applicable to aircraft, robots, vehicles, or other objects that may be required to be aligned for docking, assembly, resupply, or precise separation. The system includes a sensor head containing a monochrome charge-coupled- device video camera and pulsed laser diodes mounted on the tracking vehicle, and passive reflective targets on the tracked vehicle. The lasers illuminate the targets, and the resulting video images of the targets are digitized. Then, from the positions of the digitized target images and known geometric relationships among the targets, the relative position and orientation of the vehicles are computed. As described thus far, the VGS system is based on the same principles as those of the system described in "Improved Video Sensor System for Guidance in Docking" (MFS-31150), NASA Tech Briefs, Vol. 21, No. 4 (April 1997), page 9a. However, the two systems differ in the details of design and operation. The VGS system is designed to operate with the target completely visible within a relative-azimuth range of +/-10.5deg and a relative-elevation range of +/-8deg. The VGS acquires and tracks the target within that field of view at any distance from 1.0 to 110 m and at any relative roll, pitch, and/or yaw angle within +/-10deg. The VGS produces sets of distance and relative-orientation data at a repetition rate of 5 Hz. The software of this system also accommodates the simultaneous operation of two sensors for redundancy

Howard, Richard T.↗

Automated generation of image products for Mars Exploration Rover Mission tactical operations

This paper will discuss, from design to implementation, the methodologies applied to MIPL's automated pipeline processing as a 'system of systems' integrated with the MER GDS. Overviews of the interconnected product generating systems will also be provided with emphasis on interdependencies, including those for a) geometric rectificationn of camera lens distortions, b) generation of stereo disparity, c) derivation of 3-dimensional coordinates in XYZ space, d) generation of unified terrain meshes, e) camera-to-target ranging (distance) and f) multi-image mosaicking.

products↗

Hyperspectral Thermal Fabry-Perot Modeling

Fabry-Perot interferometer are simple elegant, tunable filters that can be used to make compact hyperspectral thermal imaging system. To foster the development of these sensors, software tools for the design and simulation of tunable Fabry-Perot infrared imagers have been developed. The tools are provided at three levels: basic, design, and system. Basic tools describe a nearly ideal Fabry-Perot filter with perfectly flat and parallel mirrors in collimated space. Design tools that take into account non-ideal behavior such as mirror and collimation defects calculate free spectral range, finesse, and spectral width of the interferometer. System tools help analyze an integration of the Fabry-Perot filter into a camera system. They include spectral convolution, first-order optical layout, and an estimation of signal-to-noise ratio. The complete set of tools allows for simulations of system operation and performance with various illumination sources. Spectral images generated in such simulations were used to examine applicability of Fabry-Perot system in remote sensing of atmospheric gases including detection of environmental pollutants and hazardous gases. Different operating conditions and system configurations are presented.

Ryan, Robert↗

Penn State Imaging X-ray Spectrometer

The design and performance of a CCD X-ray camera developed at Penn State are described. The camera uses a frame-store CCD as the detector element. A laboratory version using a PC-based CCD controller and data-acquisition system and a thermoelectric cooler is being used for laboratory testing. This camera has been used to measure read noise of less than 1.5 e(-) with the serial clocks running backwards to suppress dark current. The energy resolution at 5.9 keV with the CCD running in its normal configuration is 120 eV. A flight version of this camera is being built to make spectrally resolved images of the Pup A SNR.

Burrows, David N.↗

High temperature measurement using very high shutter speed to avoid image saturation

This paper explores the adaptation of the two-colour principle to develop a high-speed colour temperature correlation system, which is able to cover a range of temperature that is challenging to achieve before. A colour digital camera has built in RGB filters. It is possible to measure the temperature from the ratio of intensity of the green and red pixels using the two-colour principle based on the expansion of the Plank’s radiation law. In this study, experiments were carried out using a temperature calibrated tungsten ribbon lamp which can be tuned to vary from 1300 to 2200°C. Using very high shutter speed and small aperture, the high-speed camera successfully captured the tungsten ribbon without image saturation at the full temperature scale. Tests have been carried out at different temperature and camera settings. The sensitivity and errors have been analysed, and experiment results demonstrate the potential of using very high shutter speed is available for measuring the temperature even beyond 2200°C.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A microfluidic study of transient flow states in permeable media using fluorescent particle image velocimetry

Velocity fields in flow in permeable media are of great importance to many subsurface processes such as geologic storage of CO 2 , oil and gas extraction, and geothermal systems. Steady-state flow is characterized by velocity fields that do not change significantly over time. The flow field transitions to a new steady state once it experiences a disturbance such as a change in flow rate or in pressure gradient. This transition is often assumed to be instantaneous, which justifies the expression of constitutive relations as functions of instantaneous phase saturations. This work examines the evolution of velocity fields in a surrogate quasi-2D permeable medium using a microfluidic device, a microscopy system, and a high-speed camera. Tracer particles are injected into the medium along with DI water. The evolution of the velocity field is examined by tracing these particles in the captured images using the standard high-density particle image velocimetry algorithm founded on cross-correlation. The results suggest that the transition between steady states for an incompressible fluid takes a finite and non-negligible amount of time that is independent of the magnitude of the change in pressure gradient. The existence of transient states and the nature of the response during these states are readily interpreted by the principle of least action where flow gradually establishes an optimal configuration such that energy dissipation is 2 minimized. The findings provide evidence against the applicability of the assumption that flowing phases relax instantaneously to their steady states and, hence, against the accuracy of the classical multiphase extension of Darcy's law.

42 ENGINEERING↗

Safety analysis

We are engaged in a research program in safety-critical computing that is based on two case studies. We use these case studies to provide application-specific details of the various research issues, and as targets for evaluation of research ideas. The first case study is the Magnetic Stereotaxis System (MSS), an investigational device for performing human neurosurgery being developed in a joint effort between the Department of Physics at the University of Virginia and the Department of Neurosurgery at the University of Iowa. The system operates by manipulating a small permanent magnet (known as a 'seed') within the brain using an externally applied magnetic field. By varying the magnitude and gradient of the external magnetic field, the seed can be moved along a non-linear path and positioned at a site requiring therapy, e.g., a tumor. The magnetic field required for movement through brain tissue is extremely high, and is generated by a set of six superconducting magnets located in a housing surrounding the patient's head. The system uses two X-ray cameras positioned at right angles to detect in real time the locations of the seed and of X-ray opaque markers affixed to the patient's skull. the X-ray images are used to locate the objects of interest in a canonical frame of reference. the second case study is the University of Virginia Research Nuclear Reactor (UVAR). It is a 2 MW thermal, concrete-walled pool reactor. The system operates using 20 to 25 plate-type fuel assemblies placed on a rectangular grid plate. There are three scramable safety rods, and one non-scramable regulating rod that can be put in automatic mode. It was originally constructed in 1959 as a 1 MW system, and it was upgraded to 2 MW in 1973. Though only a research reactor rather than a power reactor, the issues raised are significant and can be related to the problems faced by full-scale reactor systems.

Knight, John C.↗

SU-E-J-111: Finite Element-Based Deformable Image Registration of Pleural Cavity for Photodynamic Therapy

Purpose: The pleural volumes will deform during surgery portion of the pleural photodynamic therapy (PDT) of lung cancer when the pleural cavity is opened. This impact the delivered dose when using highly conformal treatment techniques. In this study, a finite element-based (FEM) deformable image registration is used to quantify the anatomical variation between the contours for the pleural cavities obtained in the operating room and those determined from pre-surgery computed tomography (CT) scans. Methods: An infrared camera-based navigation system (NDI) is used during PDT to track the anatomical changes and contour the lung and chest cavity. A series of CTs of the lungs, in the same patient, are also acquired before the surgery. The structure contour of lung and the CTs are processed and contoured in Matlab and MeshLab. Then, the contours are imported into COMSOL Multiphysics 5.0, where the FEM-based deformable image registration is obtained using the deformed mesh - moving mesh (ALE) model. The NDI acquired lung contour is considered as the reference contour, and the CT contour is used as the target one, which will be deformed. Results: The reconstructed three-dimensional contours from both NDI and CT can be converted to COMSOL so that a three-dimensional ALE model can be developed. The contours can be registered using COMSOL ALE moving mesh model, which takes into account the deformation along x, y and z-axes. The deformed contour has good matches to the reference contour after the dynamic matching process. The resulting 3D deformation map can be used to obtain the locations of other critical anatomic structures, e.g., heart, during surgery. Conclusion: Deformable image registration can fuse images acquired by different modalities. It provides insights into the development of phenomenon and variation in normal anatomical structures over time. The initial assessments of three-dimensional registration show good agreement.

60 APPLIED LIFE SCIENCES↗

Commercial Systems Validation Overview

The Commercial Systems Validation Laboratory (CSVL) is composed of the 1) Virtual Product Laboratory (VPL), 2) Commercial Instrument Validation Laboratory (CIVL), and 3) In-Flight Verification & Validation Network (IVVN). All three laboratories are described in this viewgraph presentation, which covers the characterization of CCD cameras, hyperspectral sensors, ground reference equipment, and the Multispectral Thermal Imager (MTI). The presentation also includes sections on thermal modeling, measurements taken from a float, and the Scientific Data Purchase (SDP) Program. The section of the SDP profiles four data providers: 1) EarthSat; 2) Intermap; 3) Positive Systems; 4) Space Imaging.

Ryan, Robert↗

Nondestructive Strain Measurement System Used to Determine Surface Strain on Fibers

Small-diameter structural fibers are being considered as reinforcements for high temperature ceramic matrix composite materials, and thus they require characterization. At the NASA Lewis Research Center, a nondestructive optical technique was used to determine surface strain on a structural fiber, in real time, as it was pulled in a tensile test machine. With this technique, interference or speckle patterns from the laser illuminated fiber test specimen are recorded. As the fiber is pulled, its speckle pattern shifts in proportion to the strain, translation, and rotation components of the sample deformation. Shifting speckle patterns are detected in real time by two linear charge-coupled discharge (CCD) camera arrays, and the images are processed by a hardware correlator. Surface strain is selectively detected on fibers with diameters on the order of 100 mm and can be resolved to 19 microstrain. This system was designed to be robust and compact and generally does not require surface preparation of the structural fibers. For strain detection, two laser beams are positioned incident on the structural fiber being tested, as shown in the photograph, where the test specimen is mounted in a tensile test machine via two coupons. As the fiber is pulled, the speckle pattern produced from each laser beam is detected by one of two CCD arrays located inside the tube on the right side of the photograph.

Tuma, Margaret L.↗

SU-F-I-50: Finite Element-Based Deformable Image Registration of Lung and Heart

Purpose: Photodynamic therapy (PDT) is used after surgical resection to treat the microscopic disease for malignant pleural mesothelioma and to increase survival rates. Although accurate light delivery is imperative to PDT efficacy, the deformation of the pleural volume during the surgery impacts the delivered light dose. To facilitate treatment planning, we use a finite-element-based (FEM) deformable image registration to quantify the anatomical variation of lung and heart volumes between CT pre-(or post-) surgery and surface contours obtained during PDT using an infrared camera-based navigation system (NDI). Methods: NDI is used during PDT to obtain the information of the cumulative light fluence on every cavity surface point that is being treated. A wand, comprised of a modified endotrachial tube filled with Intralipid and an optical fiber inside the tube, is used to deliver the light during PDT. The position of the treatment is tracked using an attachment with nine reflective passive markers that are seen by the NDI system. Then, the position points are plotted as three-dimensional volume of the pleural cavity using Matlab and Meshlab. A series of computed tomography (CT) scans of the lungs and heart, in the same patient, are also acquired before and after the surgery. The NDI and CT contours are imported into COMSOL Multiphysics, where the FEM-based deformable image registration is obtained. The NDI and CT contours acquired during and post-PDT are considered as the reference, and the Pre-PDT CT contours are used as the target, which will be deformed. Results: Anatomical variation of the lung and heart volumes, taken at different times from different imaging devices, was determined by using our model. The resulting three-dimensional deformation map along x, y and z-axes was obtained. Conclusion: Our model fuses images acquired by different modalities and provides insights into the variation in anatomical structures over time.

60 APPLIED LIFE SCIENCES↗

The Sensor Dilemma in Intelligent Transportation Systems: Evaluating Radar, Lidar and Camera: Preprint

Intelligent transportation systems (ITS) are at the forefront in advancing the way we interact with and perceive the transportation network. This revolution is fueled by the significant advancement in sensor perception technologies such as radar, lidar, and video imaging, which are the most popular modalities for ITS. Real-time perception data from these sensors allow intelligent infrastructure-side decision-making to improve the energy, efficiency, and safety at traffic intersections. As traffic departments across the United States transition from traditional loop detectors and emulators and embrace newer technologies, they are often left with a dilemma in choosing a sensor technology for infrastructure-based perception that is reliable, inexpensive, and easy to set up and that has robust performance in varying weather conditions. However, choosing a sensor that checks all these boxes is not straightforward, as every sensor type has unique benefits and drawbacks. Radar is excellent at detecting long-range vehicles and weather resistance but lacks high resolution. Lidar is expensive and weather-sensitive, while cameras provide rich visual data at a low cost but are constrained by lighting and visibility. This study examines radar, lidar, and camera sensor capabilities to ascertain whether any of these qualifies as the "best" sensor for ITS perception. While no single sensor can meet all the demands of ITS, a hybrid approach combining multiple sensor modalities like radar, lidar, and cameras offers the most robust solution for enhancing the safety and efficiency of ITS. Through this evaluation, we hope to draw attention to the necessity of the National Renewable Energy Laboratory's infrastructure perception and control framework, which presents a multisensor track data fusion engine to assimilate multiple data streams in order to provide robust and reliable perception.

33 ADVANCED PROPULSION SYSTEMS↗

The Viking Orbiter Visual Imaging Subsystem

Two Viking spacecraft each consisting of an Orbiter and a Lander are on trajectories toward Mars with arrival dates in June and August 1976. A Visual Imaging Subsystem consisting of two slow-scan television cameras forms part of the scientific payload of each Orbiter. These cameras will be used to evaluate the potential landing sites on Mars and to conduct other scientific investigations of the planet. The camera system described in this paper was subjected to an extensive test and calibration program prior to launch. Based on this calibration and subsequent analyses, absolute photometric accuracies of 8.0% may be achieved. Surface resolution exceeding 100 meters will be achieved from the periapsis portion of the Viking orbits. The inherent geometric accuracies of the Orbiter cameras supersede those of previous planetary missions. The analyses of images acquired during the cruise phase of the mission confirms that the cameras have survived the rigors of launch and are performing in a manner consistent with the prelaunch calibrations.

Wellman, J. B.↗