Search NASA⌕ Search

SEARCH · Search NASA

Results for “video processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Digital Video Measurements Of Wing Deflections In A Wind Tunnel

Solid-state cameras and computer-controlled image-acquisition system measure deformations of wind-tunnel models. Digital video model-deformation (VMD) system includes solid-state-array cameras and digital image-acquisition system controlled by personal computer. Eliminates both vibration-induced distortion associated with tube cameras and manual processing of video hardcopy images necessary in earlier version. AT-class personal computer controls two commercially available image-capture boards ganged to capture simultaneously two video images, each 752 picture elements wide and 480 picture elements high, in one-thirtieth of second. Video images digitized into 256 gray levels. Figure block diagram of system.

Burner, Alpheus W.↗

CCD sensors for interplanetary spacecraft navigation and pointing control

The applications of practical optical image sensing CCDs to interplanetary spacecraft precision science payload delivery are discussed. The increasing demand for precision and flexibility in spacecraft for proposed new missions is forcing a transition to autonomous onboard navigation and pointing control. Onboard processing of video data is a crucial element in this transition and is made possible by CCD imagers and microprocessors. The pending Halley's comet close flyby is used as an example to examine details of the sensor design and the data processing which will meet the requirements. Target body centerfinding for optical navigation, target body tracking signal processing, and CCD sensor heads are examined, and flow charts and block diagrams are given for each.

Eisenman, A. R.↗

Video Skimming and Characterization through the Combination of Image and Language Understanding Techniques

Digital video is rapidly becoming important for education, entertainment, and a host of multimedia applications. With the size of the video collections growing to thousands of hours, technology is needed to effectively browse segments in a short time without losing the content of the video. We propose a method to extract the significant audio and video information and create a "skim" video which represents a very short synopsis of the original. The goal of this work is to show the utility of integrating language and image understanding techniques for video skimming by extraction of significant information, such as specific objects, audio keywords and relevant video structure. The resulting skim video is much shorter, where compaction is as high as 20:1, and yet retains the essential content of the original segment.

IMAGE PROCESSING↗

ACE: Automatic Centroid Extractor for real time target tracking

A high performance video image processor has been implemented which is capable of grouping contiguous pixels from a raster scan image into groups and then calculating centroid information for each object in a frame. The algorithm employed to group pixels is very efficient and is guaranteed to work properly for all convex shapes as well as most concave shapes. Processing speeds are adequate for real time processing of video images having a pixel rate of up to 20 million pixels per second. Pixels may be up to 8 bits wide. The processor is designed to interface directly to a transputer serial link communications channel with no additional hardware. The full custom VLSI processor was implemented in a 1.6 mu m CMOS process and measures 7200 mu m on a side.

Cameron, K.↗

Automatic Docking System Sensor Design, Test, and Mission Performance

The Video Guidance Sensor is a key element of an automatic rendezvous and docking program administered by NASA that was flown on STS-87 in November of 1997. The system used laser illumination of a passive target in the field of view of an on-board camera and processed the video image to determine the relative position and attitude between the target and the sensor. Comparisons of mission results with theoretical models and laboratory measurements will be discussed.

Jackson, John L.↗

Docking System With Video Feedback

Video-sensor/electronic-feedback control system being developed to provide automatic control of final stage of approach of active vehicle to passive vehicle or object. No communication between vehicles necessary. Docking target, mounted on post on passive vehicle, has three reflective dots, positions of which measured in image to determine relative position and orientation of target and vehicle. Control channels process video-sensor feedback into motion-control signals (thrustor commands in spacecraft or motor commands in robot). Conceived for use aboard chasing spacecraft to control its maneuvers in docking with chased spacecraft, concept also useful in controlling coupling of aircraft in flight or vessels on water or in controlling approach of robot to object to be manipulated.

Dabrey, Richard↗

Feasibility study for automatic reduction of phase change imagery

The feasibility of automatically reducing a form of pictorial aerodynamic heating data is discussed. The imagery, depicting the melting history of a thin coat of fusible temperature indicator painted on an aerodynamically heated model, was previously reduced by manual methods. Careful examination of various lighting theories and approaches led to an experimentally verified illumination concept capable of yielding high-quality imagery. Both digital and video image processing techniques were applied to reduction of the data, and it was demonstrated that either method can be used to develop superimposed contours. Mathematical techniques were developed to find the model-to-image and the inverse image-to-model transformation using six conjugate points, and methods were developed using these transformations to determine heating rates on the model surface. A video system was designed which is able to reduce the imagery rapidly, economically and accurately. Costs for this system were estimated. A study plan was outlined whereby the mathematical transformation techniques developed to produce model coordinate heating data could be applied to operational software, and methods were discussed and costs estimated for obtaining the digital information necessary for this software.

Nossaman, G. O.↗

Single-Scale Retinex Using Digital Signal Processors

The Retinex is an image enhancement algorithm that improves the brightness, contrast and sharpness of an image. It performs a non-linear spatial/spectral transform that provides simultaneous dynamic range compression and color constancy. It has been used for a wide variety of applications ranging from aviation safety to general purpose photography. Many potential applications require the use of Retinex processing at video frame rates. This is difficult to achieve with general purpose processors because the algorithm contains a large number of complex computations and data transfers. In addition, many of these applications also constrain the potential architectures to embedded processors to save power, weight and cost. Thus we have focused on digital signal processors (DSPs) and field programmable gate arrays (FPGAs) as potential solutions for real-time Retinex processing. In previous efforts we attained a 21 (full) frame per second (fps) processing rate for the single-scale monochromatic Retinex with a TMS320C6711 DSP operating at 150 MHz. This was achieved after several significant code improvements and optimizations. Since then we have migrated our design to the slightly more powerful TMS320C6713 DSP and the fixed point TMS320DM642 DSP. In this paper we briefly discuss the Retinex algorithm, the performance of the algorithm executing on the TMS320C6713 and the TMS320DM642, and compare the results with the TMS320C6711.

Hines, Glenn↗

Eliminating Bias In Acousto-Optical Spectrum Analysis

Scheme for digital processing of video signals in acousto-optical spectrum analyzer provides real-time correction for signal-dependent spectral bias. Spectrum analyzer described in "Two-Dimensional Acousto-Optical Spectrum Analyzer" (NPO-18092), related apparatus described in "Three-Dimensional Acousto-Optical Spectrum Analyzer" (NPO-18122). Essence of correction is to average over digitized outputs of pixels in each CCD row and to subtract this from the digitized output of each pixel in row. Signal processed electro-optically with reference-function signals to form two-dimensional spectral image in CCD camera.

Ansari, Homayoon↗

SSME propellant path leak detection

Initial research established that the occurrence of a leak in the powerhead of the Space Shuttle Main Engine (SSME) is accompanied by a sudden, but sustained, change in intensity in a given region of an image. Based upon this, temporal processing of video images on a frame-by-frame basis has been used to detect leaks within a given field of view. The leak detection algorithm developed in this study consists of a digital highpass filter cascaded with a moving average filter applied at each point in the image field. The absolute value of the output is then averaged over the full frame to produce a single time-varying mean value estimate that is indicative of the intensity and extent of a leak. Recent work has included the processing of an extensive amount of data obtained from NASA MSFC to verify the performance of the leak detection system. Further research is being conducted on applying the leak detection algorithm to anomaly detection in the SSME exhaust by means of three channel color processing as opposed to single channel monochrome processing in the case of the leak detection system.

Smith, L. M.↗

Toward an AI-Powered Software Pipeline for Real-Time Tracking and Analysis of Wildfire and Smoke

Real-time tracking of wildfires and smoke is crucial for effective response, minimizing damage, protecting lives, and efficiently managing resources during fire emergencies. We develop a web-based AI-powered pipeline that detects wildfires in aerial video and estimates deployment-relevant behavior metrics, including cumulative burned area, burned-area growth rate, fire spread direction, and smoke dispersion. The system combines a YOLO-based detector with YCbCr-based fire segmentation, HSV-based smoke segmentation, Farneback optical flow, and centroid-based spatiotemporal tracking. Using ground sampling distance (GSD), pixel-level fire masks are converted to physical burned-area measurements by correlating fire pixel counts with camera altitude and tilt angle. We benchmark YOLO variants and non-YOLO baselines (GoogLeNet, CNN, DBN, Autoencoder, U-Net, and AlexNet) on the IEEE FLAME dataset and a newly created aerial frame dataset, Wildfire-DB. Cross-dataset evaluation uses a strict threshold-transfer protocol: decision thresholds are selected on FLAME validation and transferred unchanged to Wildfire-DB to quantify generalization under domain shift. YOLOv6 achieves the strongest cross-dataset frame-level fire detection on Wildfire-DB (ROC-AUC 0.8200, PR-AUC 0.8044, and transferred-threshold F1 0.7596). For tracking-oriented deployment requiring oriented localization, YOLO11-OBB provides the most reliable cross-dataset behavior among OBB-capable models while remaining computationally feasible. To analyze the feasibility of UAV deployment, we further measure inference efficiency using synchronized GPU and CPU power logs on a fixed workload of 1569 frames. YOLO-family models process the video in 5.73–12.47 seconds with net energy of 1247.28–1775.39 J, substantially lower latency and energy than heavier classification and reconstruction baselines. Overall, model optimality depends on operational objectives: YOLOv6 is best for cross-dataset detection robustness, whereas YOL...

Color segmentation↗

FPGA-accelerated SpeckleNN with SNL for real-time X-ray single-particle imaging

We present the implementation of a specialized version of our previously published unified embedding model, SpeckleNN, for real-time speckle pattern classification in X-ray Single-Particle Imaging (SPI), using the SLAC Neural Network Library (SNL) on an FPGA platform. This hardware realization transitions SpeckleNN from a prototypic model into a practical edge solution, optimized for running inference near the detector in high-throughput X-ray free-electron laser (XFEL) facilities, such as those found at the Linac Coherent Light Source (LCLS). To address the resource constraints inherent in FPGAs, we developed a more specialized version of SpeckleNN. The original model, which was designed for broader classification across multiple biological samples, comprised ~5.6 million parameters. The new implementation, while reducing the parameter count to 64.6K (a 98.8% reduction), focuses on maintaining the model's essential functionality for real-time operation, achieving an accuracy of 90%. Furthermore, we compressed the latent space from 128 to 50 dimensions. This implementation was demonstrated on the KCU1500 FPGA board, utilizing 71% of available DSPs, 75% of LUTs, and 48% of FFs, with an average power consumption of 9.4W according to the Vivado post-implementation report. The FPGA performed inference on a single image with a latency of 45.015 microseconds at a 200 MHz clock rate. In comparison, running the same inference on an NVIDIA A100 GPU resulted in an average power consumption of ~73W and an image processing latency of around 400 microseconds. Our FPGA-accelerated version of SpeckleNN demonstrated significant improvements, achieving an 8.9 × speedup and a 7.8 × reduction in power consumption compared to the GPU implementation. Key advancements include model specialization and dynamic weight loading through SNL, which eliminates the need for time-consuming FPGA design re-synthesis, allowing fast and continuous deployment of models (re)trained online. These innovations enable real-time adaptive classification and efficient vetoing of speckle patterns, making SpeckleNN more suited for deployment in XFEL facilities. This implementation has the potential to significantly accelerate SPI experiments and enhance adaptability to evolving experimental conditions.

47 OTHER INSTRUMENTATION↗

Affinity propagation clustering of full-field, high-spatial-dimensional measurements for robust output-only modal identification: A proof-of-concept study

Determination of the model order is a challenging problem in system identification, especially in output-only or operational modal identification where some modes are weakly excited. While existing methods such as the stabilization diagram method (spectral information) are effective, they do not scale to high-dimensional data, which is usually needed for high-fidelity characterization of structural dynamics and has been made available in the emerging full-field measurement techniques using optical methods such as photogrammetry and laser vibrometers. In this proof-of-concept study we present a new non-parametric, data-driven approach for robust output-only identification of high-spatial-dimensional modal parameters of basic structures by efficiently processing and interactively exploiting the full-field measurement (i.e., very dense spatial measurement points). Specifically, we first over-estimate the system model once, producing a pool of candidate modes associated with their modal frequencies and full-field, high-spatial-dimensional mode shapes. This is accomplished by a data-driven method termed affinity propagation clustering (APC), where the active clusters, which are the active modes in our formulations, emerge from the "message-passing" procedure and does not require a pre-determination of the cluster number (mode or model order). Next, rather than using the spectral information to distinguish the physical and spurious modes in the stabilization diagram method, we exploit and visualize the spatial, full-field mode shape associated with each candidate mode to do so. We conduct extensive experiments on basic structural models with comparisons to a few existing methods. The results indicate that the new method is computationally efficient for identifying high-spatial-dimensional modal parameters, and robust to identify weak modes by exploiting the full-field measurement. We also discuss its applicability and limitations for structures with complex geometry (shapes).

42 ENGINEERING↗

Towards Auto-Generated Data Systems

After decades of progress, database management systems (DBMSs) are now the backbones of many data applications that we interact with on a daily basis. Yet, with the emergence of new data types and hardware, building and optimizing new data systems remain as difficult as the heyday of relational databases. In this paper, we summarize our work towards automating the building and optimization of data systems. Drawing from our own experience, we further argue that any automation technique must address three aspects: user specification, code generation, and result validation. We conclude by discussing a case study using videos data processing, along with opportunities for future research towards designing data systems that are automatically generated.

Computer Science↗

First experimental study of multiple orientation muon tomography, with image optimization in sparse data environments

Due to the high penetrating power of cosmic ray muons, they can be used to probe very thick and dense objects. As charged particles, they can be tracked by ionization detectors, determining the position and direction of the muons. With detectors on either side of an object, particle direction changes can be used to extract scattering information within an object. This can be used to produce a scattering intensity image within the object related to density and atomic number. Such imaging is typically performed with a single detector-object orientation, taking advantage of the more intense downward flux of muons, producing planar imaging with some depth-of-field information in the third dimension. Several simulation studies have been published with multi-orientation tomography, which can form a three-dimensional representation faster than a single orientation view. In this work we present the first experimental multiple orientation muon tomography study. Experimental muon-scatter based tomography was performed using a concrete filled steel drum with several different metal wedges inside, between detector planes. Data was collected from different detector-object orientations by rotating the steel drum. The data collected from each orientation were then combined using two different tomographic methods. Results showed that using a combination of multiple depth-of-field reconstructions, rather than a traditional inverse Radon transform approach used for CT, resulted in more useful images for sparser data. As cosmic ray muon flux imaging is rate limited, the imaging techniques were compared for sparse data. Using the combined depth-of-field reconstruction technique, fewer detector-object orientations were needed to reconstruct images that could be used to differentiate the metal wedge compositions.

Applied Physics (physics.app-ph)↗

Bonanza project, 1971

Research on the application of remote sensing techniques to the mineral industry stresses photointerpretation by human interpreter experienced in the extraction of geological information from aerial color and multiband photographs and from thermal scanner imagery. Also considered are optical and digital image enhancement, multiband color additive projection, video image processing, and computer reduction and analysis of infrared spectrometry. Evaluation of those parameters which have the most contrast between adjacent rock formations and which can be remotely sensed establish the following most useful geological characteristics: Topographic landform, color, albedo, and surface temperature.

Lee, K.↗

The image-processing system for the Earth Resources Technology Satellite.

Description of the image-processing system for the Earth Resources Technology Satellite (ERTS), which will process video-tape recordings received from the satellite into imagery and digitized video data suitable for earth-resource study and analysis. The system is made up of three subsystems. The bulk processor produces 70-mm images and digitized records, corrected for systematic geometric and radiometric errors as well as for sensor-calibration and other errors. The precision processor modifies the bulk images to significantly increase geometric precision. The special processor transfers either bulk or precision data to computer-compatible tape.

Johnson, R. H.↗

Development and investigation of single-scan TV radiography for the acquisition of dynamic physiologic data

A light amplifier for large flat screen fluoroscopy was investigated which will decrease both its size and weight. The work on organ contouring was extended to yield volumes. This is a simple extension since the fluoroscopic image contains density (gray scale) information which can be translated as tissue thickness, integrated, yielding accurate volume data in an on-line situation. A number of devices were developed for analog image processing of video signals, operating on-line in real time, and with simple selection mechanisms. The results show that this approach is feasible and produces are improvement in image quality which should make diagnostic error significantly lower. These are all low cost devices, small and light in weight, thereby making them usable in a space environment, on the Ames centrifuge, and in a typical clinical situation.

Baily, N. A.↗