SEARCH · Search NASA

Results for “video processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

All sources NASA NTRS DOE OSTI

NASA NTRS1995

Effects of energy release on near field flow structure of gas jets

The primary objective is to understand how buoyancy affects the structure of the shear layer, the development of fluid dynamic instabilities, and formation of the coherent structures in the near-nozzle regions of gas jets. The secondary objectives are to study the role of buoyancy in lifting and reattachment process of diffusion flames, to evaluate the scaling behavior of diffusion flames, and to aid development and/or validation of theoretical models by providing quantitative data in the absence of buoyancy. Fast reacting hydrogen or hydrogen-inert fuels are used to isolate the effects of buoyancy on fluid dynamics without masking the flame behavior by soot and radiative heat transfer. This choice of fuel also permits an evaluation of simulating low gravity in low pressure ground experiments because the similarity constraints are relaxed for the fast reacting, nonsooting diffusion flames. The diagnostics consists primarily of a color schlieren system coupled with computer generated rainbow filters, video recording, and image analysis. The project involves (1) drop tower experiments, (2) ground experiments, and (3) theoretical analysis.

Agrawal, Ajay K.↗

NASA NTRS1995

Gravity Sensors and the Role of 3-D Visualization and Simulation in Biomedical Research

Ross 3.0 software was developed in the Biocomputation Center for semi-automated reconstruction of objects from serial thin sections. Data are captured directly from a transmission electron microscope via a video camera to a graphics workstation where the sections are mosaicked and contours are traced, registered and displayed by semi-automated methods. For the first time, macular type II cells are described completely for their innervation patterns. The purposes are to learn more about the fundamental circuitry of the macula and to demonstrate whether the terminals are altered morphologically by space flight. Current examples, from the medial part of the macula, are from maculas collected in-flight on the Space Life Sciences-2 mission, 4.5 hrs post-flight, and from a ground control. Results show that the typical type 11 cell receives processes from up to six nearby calyces or afferents. Nearly all the processes are elongated; some have bouton-like swellings and numerous vesicles. Multiple (2 to 4) processes from a single calyx to a type II cell are common, and approx. 1/3 of the processes innervate 2 type II cells of a neighboring cluster of 3 cells. About 2% of type II cells resemble type I cells morphologically and are surrounded by demicalyces. Differences in size or shape of the terminals under flight conditions could not be determined because the sample size is still too small; but it is clear that reconstruction methods provide insights into macular circuitry not obtainable by other techniques. The results demonstrate a morphological basis for interactions between adjacent receptive fields, through feedback-feedforward connections, during preprocessing of linear acceleratory information by the maculas. While the methods are currently being tested using vestibular maculas as the model system, it is clear that the technology is applicable to any tissue that can be physically or optically sectioned. ROSS software has already been implemented for reconstructing objects from tissues studied by confocal and by transmitted light microscopy, and research into magnetic resonance imaging-computational tomography combined visualization are underway.

Ross, Muriel D.↗

NASA NTRS2011

Testing of a Composite Wavelet Filter to Enhance Automated Target Recognition in SONAR

Automated Target Recognition (ATR) systems aim to automate target detection, recognition, and tracking. The current project applies a JPL ATR system to low resolution SONAR and camera videos taken from Unmanned Underwater Vehicles (UUVs). These SONAR images are inherently noisy and difficult to interpret, and pictures taken underwater are unreliable due to murkiness and inconsistent lighting. The ATR system breaks target recognition into three stages: 1) Videos of both SONAR and camera footage are broken into frames and preprocessed to enhance images and detect Regions of Interest (ROIs). 2) Features are extracted from these ROIs in preparation for classification. 3) ROIs are classified as true or false positives using a standard Neural Network based on the extracted features. Several preprocessing, feature extraction, and training methods are tested and discussed in this report.

image processing↗

DOE OSTI2021

Flame stability analysis of flame spray pyrolysis by artificial intelligence

Flame spray pyrolysis (FSP) is a process used to synthesize nanoparticles through the combustion of an atomized precursor solution; this process has applications in catalysts, battery materials, and pigments. Current limitations revolve around understanding how to consistently achieve a stable flame and the reliable production of nanoparticles. Machine learning and artificial intelligence algorithms that detect unstable flame conditions in real time may be a means of streamlining the synthesis process and improving FSP efficiency. In this study, the FSP flame stability is first quantified by analyzing the brightness of the flame's anchor point. This analysis is then used to label data for both unsupervised and supervised machine learning approaches. The unsupervised learning approach allows for autonomous labeling and classification of new data by representing data in a reduced dimensional space and identifying combinations of features that most effectively cluster it. The supervised learning approach, on the other hand, requires human labeling of training and test data but is able to classify multiple objects of interest (such as the burner and pilot flames) within the video feed. The accuracy of each of these techniques is compared against the evaluations of human experts. Both the unsupervised and supervised approaches can track and classify FSP flame conditions in real time to alert users of unstable flame conditions. This research has the potential to autonomously track and manage flame spray pyrolysis as well as other flame technologies by monitoring and classifying the flame stability.

42 ENGINEERING↗

DOE OSTI2023

Design and implementation of a prototype infrared video bolometer (IRVB) in MAST Upgrade

A prototype infrared video bolometer (IRVB) was successfully deployed in the Mega Ampere Spherical Tokamak Upgrade (MAST Upgrade or MAST-U), the first deployment of such a diagnostic in a spherical tokamak. The IRVB was designed to study the radiation around the lower x-point, another first in tokamaks, and has the potential to estimate emissivity profiles with spatial resolution beyond what is achievable with resistive bolometry. The system was fully characterized prior to installation on MAST-U, and the results are summarized here. After installation, it was verified that the actual measurement geometry in the tokamak qualitatively matches the design; this is a particularly difficult process for bolometers and was done using specific features of the plasma itself. The installed IRVB measurements are consistent both with observations from other diagnostics, including magnetic reconstruction, visible light cameras, and resistive bolometry, as well as with the IRVB-designed view. Early results show that with conventional divertor geometry and only intrinsic impurities (for example, C and He), the progression of radiative detachment follows a similar path to that observed for large aspect ratio tokamaks: The peak of the radiation moves along the separatrix from the targets to the x-point and high-field side midplane with a toroidally symmetric structure that can eventually lead to strong effects on the core plasma inside the separatrix.

47 OTHER INSTRUMENTATION↗

DOE OSTI2022

Organic matter concentration and composition of experimentally burned open air and muffle furnace vegetation chars across differing burn severity and feedstock types from Pacific Northwest, USA (v4).

This dataset represents results from an experimental study designed to compare how the chemical composition of organic matter changes across different burn conditions and feedstock materials. The dataset provides both solid and dissolved phase bulk concentration and organic matter characterization data from experimentally generated chars. Chars were created in a closed muffle furnace or on an open burn table from four different feedstock species representing vegetation commonly impacted by fire regimes across the Pacific Northwest, USA. This data can be used to compare how different burn conditions may influence resultant organic matter chemistry and help further our understanding of potential biogeochemical impacts on river corridors post-fire. This dataset is comprised of one data package readme, one data dictionary (dd), one file level metadata (flmd), fourteen burn table videos, burn table video metadata and three folders containing (A) data; (B) metadata and protocols; and (C) photos. The folder names and the file name of the data package readme include a version number which will be updated with future iterations of this data package. The data folder includes (1) solid carbon and solid nitrogen; (2) dissolved organic carbon (DOC, measured as non-purgeable organic carbon, NPOC) and total dissolved nitrogen (TN); (3) pH; (4) thermocouple time series temperature; (5) methods codes; (6) installation methods; (7) excitation emissions matrix (EEM) methods information; (8) a folder of excitation emissions matrix (EEM) fluorescence and absorbance spectra in dissolved organic matter and EEMs processing instructions; (9) solid state carbon-13 and solution state phosphorus nuclear magnetic resonance (13-C NMR and 31-P NMR) data and methods; (10) benzene polycarboxylic acid (BPCA) concentration and stable isotope data; (11) FTICR-MS methods; (12) Inductively coupled plasma (ICP) data for total calcium, magnesium, iron, aluminum, potassium, phosphorus, sodium, and sulfur along with sodium hydroxide-ethylenediaminetetraacetic acid (sodium hydroxide-EDTA) extractable calcium, magnesium, iron, aluminum, potassium, phosphorus, and sulfur; (13) a folder of phosphorus, carbon, and nitrogen X-ray absorption near edge structure (P-XANES, N-XANES, C-XANES) data for samples and standards; (14) P-XANES, N-XANES, C-XANES methods; (15) molybdate reactive phosphorus; and (16) folder of high resolution characterization of organic matter via 21 Tesla Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) generated through the Environmental Molecular Sciences Laboratory (EMSL; https://www.pnnl.gov/environmental-molecular-sciences-laboratory). The FTICR folder contains .txt data files and a subfolder containing instruments for using Formularity (https://omics.pnl.gov/software/formularity) and an R script to process the data based on the user's specific needs. The metadata and protocols folder includes (1) international geo-sample number (IGSN) mapping file (2) burn and laboratory metadata; (3) burn protocol; (4) laboratory protocol; (5) vegetation collection metadata; and (6) vegetation collection protocol. The folder contains photos of the solid chars. All files are .csv, .txt, .pdf, .jpg, .jpeg, .R, .ref, or .mp4. The data package was originally published October 2022 (v1). It was updated April 2023 (v2; new data files), September 2023 (v3; new and corrected data files), and September 2024 (v4; new and added/updated files). Metadata files were also updated to reflect these changes. See the change history section in the readme for more details.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Remote Sensing Low Signal-to-Noise-Ratio Target Detection Enhancement

In real-time remote sensing application, frames of data are continuously flowing into the processing system. The capability of detecting objects of interest and tracking them as they move is crucial to many critical surveillance and monitoring missions. Detecting small objects using remote sensors is an ongoing, challenging problem. Since object(s) are located far away from the sensor, the target’s Signal-to-Noise-Ratio (SNR) is low. The Limit of Detection (LOD) for remote sensors is bounded by what is observable on each image frame. In this paper, we present a new method, a “Multi-frame Moving Object Detection System (MMODS)”, to detect small, low SNR objects that are beyond what a human can observe in a single video frame. This is demonstrated by using simulated data where our technology-detected objects are as small as one pixel with a targeted SNR, close to 1:1. We also demonstrate a similar improvement using live data collected with a remote camera. The MMODS technology fills a major technology gap in remote sensing surveillance applications for small target detection. Our method does not require prior knowledge about the environment, pre-labeled targets, or training data to effectively detect and track slow- and fast-moving targets, regardless of the size or the distance.

47 OTHER INSTRUMENTATION↗

NASA NTRS2000

Kinetics of constant gravitropic stimulus responses in Arabidopsis roots using a feedback system

The study of gravitropism is hindered by the fact that as a root responds, the gravitational stimulus changes. Using a feedback system to connect a rotating stage platform to a video digitizer system, we were able to maintain a constant angle of gravistimulation to Arabidopsis roots for long time periods. The rate of curvature approximated the sine rule for angles of stimulation between 20 degrees and 120 degrees. For a given angle of stimulation, the rate of curvature also remained constant, with no observed diminishment of the response. Although previous reports of Arabidopsis root gravitropism suggest latent periods of approximately 30 min, using a smooth mechanical stage to reorient the root, we observed a mean time lag of approximately 10 min. This more rapid onset of curvature can, in part, be explained by reduced mechanical perturbation during the process of gravistimulation. This suggests that mechanical stimulation associated with rapid root re-orientation may confound investigations of early gravitropic events.

NASA Program Fundamental Space Biology↗

NASA NTRS2013

Conducting Research on the International Space Station Using the EXPRESS Rack Facilities

Conducting Research on the International Space Station using the EXPRESS Rack Facilities. Sean W. Thompson and Robert E. Lake. NASA Marshall Space Flight Center, Huntsville, AL, USA. Eight "Expedite the Processing of Experiments to Space Station" (EXPRESS) Rack facilities are located within the International Space Station (ISS) laboratories to provide standard resources and interfaces for the simultaneous and independent operation of multiple experiments within each rack. Each EXPRESS Rack provides eight Middeck Locker Equivalent locations and two drawer locations for powered experiment equipment, also referred to as sub-rack payloads. Payload developers may provide their own structure to occupy the equivalent volume of one, two, or four lockers as a single unit. Resources provided for each location include power (28 Vdc, 0-500 W), command and data handling (Ethernet, RS-422, 5 Vdc discrete, +/- 5 Vdc analog), video (NTSC/RS 170A), and air cooling (0-200 W). Each rack also provides water cooling (500 W) for two locations, one vacuum exhaust interface, and one gaseous nitrogen interface. Standard interfacing cables and hoses are provided on-orbit. One laptop computer is provided with each rack to control the rack and to accommodate payload application software. Four of the racks are equipped with the Active Rack Isolation System to reduce vibration between the ISS and the rack. EXPRESS Racks are operated by the Payload Operations Integration Center at Marshall Space Flight Center and the sub-rack experiments are operated remotely by the investigating organization. Payload Integration Managers serve as a focal to assist organizations developing payloads for an EXPRESS Rack. NASA provides EXPRESS Rack simulator software for payload developers to checkout payload command and data handling at the development site before integrating the payload with the EXPRESS Functional Checkout Unit for an end-to-end test before flight. EXPRESS Racks began supporting investigations onboard ISS on April 24, 2001 and will continue through the life of the ISS.

Thompson, Sean W.↗

NASA NTRS2013

Conducting Research on the International Space Station Using the EXPRESS Rack Facilities

Eight "Expedite the Processing of Experiments to Space Station" (EXPRESS) Rack facilities are located within the International Space Station (ISS) laboratories to provide standard resources and interfaces for the simultaneous and independent operation of multiple experiments within each rack. Each EXPRESS Rack provides eight Middeck Locker Equivalent locations and two drawer locations for powered experiment equipment, also referred to as sub-rack payloads. Payload developers may provide their own structure to occupy the equivalent volume of one, two, or four lockers as a single unit. Resources provided for each location include power (28 Vdc, 0-500 W), command and data handling (Ethernet, RS-422, 5 Vdc discrete, +/- 5 Vdc analog), video (NTSC/RS 170A), and air cooling (0-200 W). Each rack also provides water cooling (500 W) for two locations, one vacuum exhaust interface, and one gaseous nitrogen interface. Standard interfacing cables and hoses are provided on-orbit. One laptop computer is provided with each rack to control the rack and to accommodate payload application software. Four of the racks are equipped with the Active Rack Isolation System to reduce vibration between the ISS and the rack. EXPRESS Racks are operated by the Payload Operations Integration Center at Marshall Space Flight Center and the sub-rack experiments are operated remotely by the investigating organization. Payload Integration Managers serve as a focal to assist organizations developing payloads for an EXPRESS Rack. NASA provides EXPRESS Rack simulator software for payload developers to checkout payload command and data handling at the development site before integrating the payload with the EXPRESS Functional Checkout Unit for an end-to-end test before flight. EXPRESS Racks began supporting investigations onboard ISS on April 24, 2001 and will continue through the life of the ISS.

Thompson, Sean W.↗

NASA NTRS2016

Conducting Research on the International Space Station using the EXPRESS Rack Facilities

Eight "Expedite the Processing of Experiments to Space Station" (EXPRESS) Rack facilities are located within the International Space Station (ISS) laboratories to provide standard resources and interfaces for the simultaneous and independent operation of multiple experiments within each rack. Each EXPRESS Rack provides eight Middeck Locker Equivalent locations and two drawer locations for powered experiment equipment, also referred to as sub-rack payloads. Payload developers may provide their own structure to occupy the equivalent volume of one, two, or four lockers as a single unit. Resources provided for each location include power (28 Vdc, 0-500 W), command and data handling (Ethernet, RS-422, 5 Vdc discrete, +/- 5 Vdc analog), video (NTSC/RS 170A), and air cooling (0-200 W). Each rack also provides water cooling for two locations (500W ea.), one vacuum exhaust interface, and one gaseous nitrogen interface. Standard interfacing cables and hoses are provided on-orbit. One laptop computer is provided with each rack to control the rack and to accommodate payload application software. Four of the racks are equipped with the Active Rack Isolation System to reduce vibration between the ISS and the rack. EXPRESS Racks are operated by the Payload Operations Integration Center at Marshall Space Flight Center and the sub-rack experiments are operated remotely by the investigating organization. Payload Integration Managers serve as a focal to assist organizations developing payloads for an EXPRESS Rack. NASA provides EXPRESS Rack simulator software for payload developers to checkout payload command and data handling at the development site before integrating the payload with the EXPRESS Functional Checkout Unit for an end-to-end test before flight. EXPRESS Racks began supporting investigations onboard ISS on April 24, 2001 and will continue through the life of the ISS.

Thompson, Sean W.↗

NASA NTRSDate not supplied

Adaptive Multi-Sensor Localization Information Fusion for Autonomous Urban Air Mobility Operations

An adaptive method is developed to iteratively fuse the information provided by multiple sensors to enable autonomous urban air mobility type operations. First, noisy and bias corrupted IMU readings are processed as soon as they arrive using kinematic equations represented in the vehicle's body frame. To correct the systems drift resulting from the integration, an information content measure is introduced to decide on the environment. For the cluttered environment the information provided by environmental sensors is counted as reliable and the drift correction as accurate. For the open space, the GPS data is counted as reliable, and the drift correction is done based on the GPS readings. The measurement noise effects are minimize using Iterated Extended Kalman Filter framework. The algorithm is implemented in the in-house developed FlightDeckz simulation environment using an IMU model, simulated video recorded from a camera mounted on the vehicle (for the purpose of this study, outside scenery was generated with XPlane), which flies in an urban environment, and GPS data generated from the environment's digital map.

Onboard Perception↗

NASA NTRS1990

Potential for integrated optical circuits in advanced aircraft with fiber optic control and monitoring systems

Fiber optic technology is expected to be used in future advanced weapons platforms as well as commercial aerospace applications. Fiber optic waveguides will be used to transmit noise free, high speed data between a multitude of computers as well as audio and video information to the flight crew. Passive optical sensors connected to control computers with optical fiber interconnects will serve both control and monitoring functions. Implementation of fiber optic technology has already begun. Both the military and NASA have several programs in place. A cooperative program, called FOCSI (Fiber Optic Control System Integration), between NASA Lewis and the NAVY to build, environmentally test and flight demonstrate sensor systems for propulsion and flight control systems is currently underway. Integrated Optical Circuits (IOC's) are also being given serious consideration for use in advanced aircraft systems. IOC's will result in miniaturization and localization of components to generate, detect optical signals and process them for use by the control computers. In some complex systems IOC's may be required to perform calculations optically if the technology is ready, replacing some of the electronic systems used today. IOC's are attractive because they will result in rugged components capable of withstanding severe environments in advanced aerospace vehicles. Manufacturing technology developed for microelectronic integrated circuits applied to IOC's will result in cost effective manufacturing. This paper reviews the current FOCSI program and describes the potential role of IOC's in FOCSI applications.

Robert Baumbick↗

NASA NTRS1999

The Conductor-Dielectric Junctions in a Low Density Plasma

A conductor-dielectric junction exposed to the space environment is a frequent spacecraft design feature. Due to spacecraft charging and/or solar array operation, the conductor can acquire a high potential with respect to the surrounding plasma. If this potential is positive the insulators adjacent to exposed conductors can collect current as if they were conductors themselves. This phenomenon, called snapover, results in a substantial increase in current collection, and may even result in a glow discharge if the potential is high enough. If a conductor has a negative potential, arcing can occur at the site of a junction. Both of these phenomena negatively affect spacecraft operation. To prevent negative consequences, the physical mechanisms of snapover and arc inception require investigation. In this paper, results are presented of an experimental and theoretical study of snapover, glow discharge, and arc phenomena for different materials immersed in argon or xenon plasmas. The effect of snapover is investigated for several metal-dielectric junctions: copper-teflon, copper-Kapton, copper-glass, aluminum-teflon, aluminum-Kapton, steel-teflon, anodized aluminum with pinholes, and copper-ceramics. I-V curves are measured and snapover inception voltages, essential parameters (increase in current and collection area due to secondary electrons), and glow discharge inception thresholds are determined. Optical spectra are obtained for glow discharges in both argon and xenon plasmas. These spectra provide information regarding atomic species entrapped in the glow region. Some spectral lines can be used to estimate plasma parameters in the discharge area. A video-camera and linear array were used to confirm that snapover inception is accompanied by very low intensity visible light emission. This result seems to be important for the estimate of the light pollution around spacecraft. Optical spectra (wavelengths 380-650 nm) of arcs are also obtained on a negatively biased chromic acid anodized aluminum plate immersed in low density argon and xenon plasmas. Analysis of these spectra confirms our earlier findings that aluminum atoms are ejected from the arc site. Moreover, it is found that chromium atoms are also quite abundant in the arc plasma. It is believed that the latter results contribute considerably to the understanding of processes of plasma contamination caused by arcing.

Vayner, Boris↗

NASA NTRS2003

Solid Hydrogen Particles and Flow Rates Analyzed for Atomic Fuels

The experiments were conducted at Glenn's Small Multipurpose Research Facility (SMIRF, ref. 5). The experimental setup was placed in the facility's vacuum tank to prevent heat leaks and subsequent boiloff of the liquid helium. Supporting systems maintained the temperature and pressure of the liquid helium bath where the solid particles were created. Solid hydrogen particle formation was tested from February 23 to April 2, 2001. Millimeter-sized solid-hydrogen particles were formed in a Dewar of liquid helium as a prelude to creating atomic fuels and propellants for aerospace vehicles. Atomic fuels or propellants are created when atomic boron, carbon, or hydrogen is stored in solid hydrogen particles. The current testing characterized the solid hydrogen particles without the atomic species, as a first step to creating a feed system for the atomic fuels and propellants. This testing did not create atomic species, but only sought to understand the solid hydrogen particle formation and behavior in the liquid helium. In these tests, video images of the solid particle formation were recorded, and the total mass flow rate of the hydrogen was measured. The mass of hydrogen that went into the gaseous phase was also recorded using a commercially available residual gas analyzer. The temperatures, pressures, and flow rates of the liquids and gases in the test apparatus were recorded as well. Testing conducted in 1999 recorded particles as small as 2 to 5 mm in diameter. The current testing extended the testing conditions to a very cold Dewar ullage gas of about 20 to 90 K above the 4 K liquid helium. With the very cold Dewar gas, the hydrogen freezing process took on new dimensions, in some cases creating particles so small that they seemed to be microscopic, appearing as infinitesimally small scintillations on the videotaped images.

Palaszewski, Bryan A.↗

NASA NTRS1977

Time delay and integration array (TDI) using charge transfer device technology. Phase 2, volume 1: Technical

The 20x9 TDI array was developed to meet the LANDSAT Thematic Mapper Requirements. This array is based upon a self-aligned, transparent gate, buried channel process. The process features: (1) buried channel, four phase, overlapping gate CCD's for high transfer efficiency without fat zero; (2) self-aligned transistors to minimize clock feedthrough and parasitic capacitance; and (3) transparent tin oxide electrode for high quantum efficiency with front surface irradiation. The requirements placed on the array and the performance achieved are summarized. This data is the result of flat field measurements only, no imaging or dynamic target measurements were made during this program. Measurements were performed with two different test stands. The bench test equipment fabricated for this program operated at the 8 micro sec line time and employed simple sampling of the gated MOSFET output video signal. The second stand employed Correlated Doubled Sampling (CDS) and operated at 79.2 micro sec line time.

Source record↗

DOE OSTI2024

Automated Assembly Progress Monitoring in Modular Construction Factories Using Computer Vision-Based Instance Segmentation

Modular construction has recently gained interest as a transformative construction method. In this method, a large portion of the construction is performed inside factories, where processes are fast-paced and interdependent; therefore, any deviation from the schedule can delay the production. Such deviations are frequent in modular factories due to the labor-intensive nature of the tasks. This propagation of delays can be mitigated by continuously monitoring each process; however, current manual monitoring methods are laborious, and recently proposed contact sensor-based methods are intrusive to the work. In addition, recent computer vision-based monitoring methods inside factories are limited to detection algorithms that fail to provide the pixel-level accuracy required for assembly progress monitoring in highly occluded factory scenes, and they require a large number of manual annotations. Therefore, this paper proposes a method to monitor the installation of subassemblies in modular construction factories using mask R-CNN instance segmentation and improves the data efficiency of the model using a copy-paste augmentation method. This method was validated on the CCTV videos captured from a modular construction factory in the US, resulting in a 9% mAP improvement in segmentation.

computer vision↗

NASA NTRS2011

Method and System for Temporal Filtering in Video Compression Systems

Three related innovations combine improved non-linear motion estimation, video coding, and video compression. The first system comprises a method in which side information is generated using an adaptive, non-linear motion model. This method enables extrapolating and interpolating a visual signal, including determining the first motion vector between the first pixel position in a first image to a second pixel position in a second image; determining a second motion vector between the second pixel position in the second image and a third pixel position in a third image; determining a third motion vector between the first pixel position in the first image and the second pixel position in the second image, the second pixel position in the second image, and the third pixel position in the third image using a non-linear model; and determining a position of the fourth pixel in a fourth image based upon the third motion vector. For the video compression element, the video encoder has low computational complexity and high compression efficiency. The disclosed system comprises a video encoder and a decoder. The encoder converts the source frame into a space-frequency representation, estimates the conditional statistics of at least one vector of space-frequency coefficients with similar frequencies, and is conditioned on previously encoded data. It estimates an encoding rate based on the conditional statistics and applies a Slepian-Wolf code with the computed encoding rate. The method for decoding includes generating a side-information vector of frequency coefficients based on previously decoded source data and encoder statistics and previous reconstructions of the source frequency vector. It also performs Slepian-Wolf decoding of a source frequency vector based on the generated side-information and the Slepian-Wolf code bits. The video coding element includes receiving a first reference frame having a first pixel value at a first pixel position, a second reference frame having a second pixel value at a second pixel position, and a third reference frame having a third pixel value at a third pixel position. It determines a first motion vector between the first pixel position and the second pixel position, a second motion vector between the second pixel position and the third pixel position, and a fourth pixel value for a fourth frame based upon a linear or nonlinear combination of the first pixel value, the second pixel value, and the third pixel value. A stationary filtering process determines the estimated pixel values. The parameters of the filter may be predetermined constants.

Lu, Ligang↗