Search NASA⌕ Search

SEARCH · Search NASA

Results for “sparse optical flow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Computer-Vision-Based Vibration Tracking Using a Digital Camera: A Sparse-Optical-Flow-Based Target Tracking Method

Computer-vision-based target tracking is a technology applied to a wide range of research areas, including structural vibration monitoring. However, current target tracking methods suffer from noise in digital image processing. In this paper, a new target tracking method based on the sparse optical flow technique is introduced for improving the accuracy in tracking the target, especially when the target has a large displacement. The proposed method utilizes the Oriented FAST and Rotated BRIEF (ORB) technique which is based on FAST (Features from Accelerated Segment Test), a feature detector, and BRIEF (Binary Robust Independent Elementary Features), a binary descriptor. ORB maintains a variety of keypoints and combines the multi-level strategy with an optical flow algorithm to search the keypoints with a large motion vector for tracking. Then, an outlier removal method based on Hamming distance and interquartile range (IQR) score is introduced to minimize the error. The proposed target tracking method is verified through a lab experiment—a three-story shear building structure subjected to various harmonic excitations. It is compared with existing sparse-optical-flow-based target tracking methods and target tracking methods based on three other types of techniques, i.e., feature matching, dense optical flow, and template matching. The results show that the performance of target tracking is greatly improved through the use of a multi-level strategy and the proposed outlier removal method. The proposed sparse-optical-flow-based target tracking method achieves the best accuracy compared to other existing target tracking methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

ReLU, Sparseness, and the Encoding of Optic Flow in Neural Networks

Accurate self-motion estimation is critical for various navigational tasks in mobile robotics. Optic flow provides a means to estimate self-motion using a camera sensor and is particularly valuable in GPS- and radio-denied environments. The present study investigates the influence of different activation functions—ReLU, leaky ReLU, GELU, and Mish—on the accuracy, robustness, and encoding properties of convolutional neural networks (CNNs) and multi-layer perceptrons (MLPs) trained to estimate self-motion from optic flow. Our results demonstrate that networks with ReLU and leaky ReLU activation functions not only achieved superior accuracy in self-motion estimation from novel optic flow patterns but also exhibited greater robustness under challenging conditions. The advantages offered by ReLU and leaky ReLU may stem from their ability to induce sparser representations than GELU and Mish do. Our work characterizes the encoding of optic flow in neural networks and highlights how the sparseness induced by ReLU may enhance robust and accurate self-motion estimation from optic flow.

97 MATHEMATICS AND COMPUTING↗

Accuracy optimized neural networks do not effectively model optic flow tuning in brain area MSTd

Accuracy-optimized convolutional neural networks (CNNs) have emerged as highly effective models at predicting neural responses in brain areas along the primate ventral stream, but it is largely unknown whether they effectively model neurons in the complementary primate dorsal stream. We explored how well CNNs model the optic flow tuning properties of neurons in dorsal area MSTd and we compared our results with the Non-Negative Matrix Factorization (NNMF) model, which successfully models many tuning properties of MSTd neurons. To better understand the role of computational properties in the NNMF model that give rise to optic flow tuning that resembles that of MSTd neurons, we created additional CNN model variants that implement key NNMF constraints – non-negative weights and sparse coding of optic flow. While the CNNs and NNMF models both accurately estimate the observer's self-motion from purely translational or rotational optic flow, NNMF and the CNNs with nonnegative weights yield substantially less accurate estimates than the other CNNs when tested on more complex optic flow that combines observer translation and rotation. Despite its poor accuracy, NNMF gives rise to tuning properties that align more closely with those observed in primate MSTd than any of the accuracy-optimized CNNs. This work offers a step toward a deeper understanding of the computational properties and constraints that describe the optic flow tuning of primate area MSTd.

60 APPLIED LIFE SCIENCES↗

Textureless Macula Swelling Detection with Multiple Retinal Fundus Images

Retinal fundus images acquired with non-mydriatic digital fundus cameras are a versatile tool for the diagnosis of various retinal diseases. Because of the ease of use of newer camera models and their relatively low cost, these cameras can be employed by operators with limited training for telemedicine or Point-of-Care applications. We propose a novel technique that uses uncalibrated multiple-view fundus images to analyse the swelling of the macula. This innovation enables the detection and quantitative measurement of swollen areas by remote ophthalmologists. This capability is not available with a single image and prone to error with stereo fundus cameras. We also present automatic algorithms to measure features from the reconstructed image which are useful in Point-of-Care automated diagnosis of early macular edema, e.g., before the appearance of exudation. The technique presented is divided into three parts: first, a preprocessing technique simultaneously enhances the dark microstructures of the macula and equalises the image; second, all available views are registered using non-morphological sparse features; finally, a dense pyramidal optical flow is calculated for all the images and statistically combined to build a naiveheight- map of the macula. Results are presented on three sets of synthetic images and two sets of real world images. These preliminary tests show the ability to infer a minimum swelling of 300 microns and to correlate the reconstruction with the swollen location.

60 APPLIED LIFE SCIENCES↗

Blind identification of full-field vibration modes of output-only structures from uniformly-sampled, possibly temporally-aliased (sub-Nyquist), video measurements

Enhancing the spatial and temporal resolution of vibration measurements and modal analysis could significantly benefit dynamic modelling, analysis, and health monitoring of structures. For example, spatially high-density mode shapes are critical for accurate vibration-based damage localization. In experimental or operational modal analysis, higher (frequency) modes, which may be outside the frequency range of the measurement, contain local structural features that can improve damage localization as well as the construction and updating of the modal-based dynamic model of the structure. In general, the resolution of vibration measurements can be increased by enhanced hardware. Traditional vibration measurement sensors such as accelerometers have high-frequency sampling capacity; however, they are discrete point-wise sensors only providing sparse, low spatial sensing resolution measurements, while dense deployment to achieve high spatial resolution is expensive and results in the mass-loading effect and modification of structure's surface. Non-contact measurement methods such as scanning laser vibrometers provide high spatial and temporal resolution sensing capacity; however, they make measurements sequentially that requires considerable acquisition time. As an alternative non-contact method, digital video cameras are relatively low-cost, agile, and provide high spatial resolution, simultaneous, measurements. Combined with vision based algorithms (e.g., image correlation or template matching, optical flow, etc.), video camera based measurements have been successfully used for experimental and operational vibration measurement and subsequent modal analysis. However, the sampling frequency of most affordable digital cameras is limited to 30–60 Hz, while high-speed cameras for higher frequency vibration measurements are extremely costly. This work develops a computational algorithm capable of performing vibration measurement at a uniform sampling frequency lower than what is required by the Shannon-Nyquist sampling theorem for output-only modal analysis. In particular, the spatio-temporal uncoupling property of the modal expansion of structural vibration responses enables a direct modal decoupling of the temporally-aliased vibration measurements by existing output-only modal analysis methods, yielding (full-field) mode shapes estimation directly. Then the signal aliasing properties in modal analysis is exploited to estimate the modal frequencies and damping ratios. Furthermore, the proposed method is validated by laboratory experiments where output-only modal identification is conducted on temporally-aliased acceleration responses and particularly the temporally-aliased video measurements of bench-scale structures, including a three-story building structure and a cantilever beam.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Connect the Dots: In Situ 4-D Seismic Monitoring of CO 2 Storage With Spatio-Temporal CNNs

4-D seismic imaging has been widely used in CO 2 sequestration projects to monitor the fluid flow in the volumetric subsurface region that is not sampled by wells. Ideally, real-time monitoring and near-future forecasting would provide site operators with great insights to understand the dynamics of the subsurface reservoir and assess any potential risks. However, due to obstacles such as high deployment cost, availability of acquisition equipment, exclusion zones around surface structures, only very sparse seismic imaging data can be obtained during monitoring. That leads to an unavoidable and growing knowledge gap over time. The operator needs to understand the fluid flow throughout the project lifetime and the seismic data are only available at a limited number of times. This is insufficient for understanding reservoir behavior. To overcome those challenges, we have developed spatio-temporal neural-network-based models that can produce high-fidelity interpolated or extrapolated images effectively and efficiently. Specifically, our models are built on an autoencoder, and incorporate the long short-term memory (LSTM) structure with a new loss function regularized by optical flow. We validate the performance of our models using real 4-D post-stack seismic imaging data acquired at the Sleipner CO 2 sequestration field. We employ two different strategies in evaluating our models. Numerically, we compare our models with different baseline approaches using classic pixel-based metrics. We also conduct a blind survey and collect a total of 20 responses from domain experts to evaluate the quality of data generated by our models. Finally, via both numerical and expert evaluation, we conclude that our models can produce high-quality 2-D/3-D seismic imaging data at a reasonable cost, offering the possibility of real-time monitoring or even near-future forecasting of the CO 2 storage reservoir.

4-D seismic imaging↗

Porous Iron Electrodes Reduce Energy Consumption During Electrocoagulation of a Virus Surrogate: Insights into Performance Enhancements Using Three-Dimensional Neutron Computed Tomography

Electrocoagulation has attracted significant attention as an alternative to conventional chemical coagulation because it is capable of removing a wide range of contaminants and has several potential advantages. In contrast to most electrocoagulation research that has been performed with nonporous electrodes, in this study, we demonstrate energy-efficient iron electrocoagulation using porous electrodes. In batch operation, investigation of the external pore structures through optical microscopy suggested that a low porosity electrode with sparse connection between pores may lead to mechanical failure of the pore network during electrolysis, whereas a high porosity electrode is vulnerable to pore clogging. Electrodes with intermediate porosity, instead, only suffered a moderate surface deposition, leading to electrical energy savings of 21% and 36% in terms of electrocoagulant delivery and unit log virus reduction, respectively. Neutron computed tomography revealed the critical role of electrode porosity in utilizing the electrode’s internal surface for electrodissolution and effective delivery of electrocoagulant to the bulk. Energy savings of up to 88% in short-term operation were obtained with porous electrodes in a continuous flow-through system. Further investigation on the impact of current density and porosity in long-term operation is desired as well as the capital cost of porous electrodes.

42 ENGINEERING↗

Alfalfa discovery of the nearby gas-rich dwarf galaxy Leo P. IV. Distance measurement from LBT optical imaging

Leo P is a low-luminosity dwarf galaxy discovered through the blind H I Arecibo Legacy Fast ALFA survey. The H I and follow-up optical observations have shown that Leo P is a gas-rich dwarf galaxy with both active star formation and an underlying older population, as well as an extremely low oxygen abundance. Here, we measure the distance to Leo P by applying the tip of the red giant branch (TRGB) distance method to photometry of the resolved stellar population from new Large Binocular Telescope V and I band imaging. We measure a distance modulus of 26.19{sub −0.50}{sup +0.17} mag corresponding to a distance of 1.72{sub −0.40}{sup +0.14} Mpc. Although our photometry reaches 3 mag below the TRGB, the sparseness of the red giant branch yields higher uncertainties on the lower limit of the distance. Leo P is outside the Local Group with a distance and velocity consistent with the local Hubble flow. While located in a very low-density environment, Leo P lies within ∼0.5 Mpc of a loose association of dwarf galaxies which include NGC 3109, Antlia, Sextans A, and Sextans B, and 1.1 Mpc away from its next nearest neighbor, Leo A. Leo P is one of the lowest metallicity star-forming galaxies known in the nearby universe, comparable in metallicity to I Zw 18 and DDO 68, but with stellar characteristics similar to dwarf spheriodals (dSphs) in the Local Volume such as Carina, Sextans, and Leo II. Given its physical properties and isolation, Leo P may provide an evolutionary link between gas-rich dwarf irregular galaxies and dSphs that have fallen into a Local Group environment and been stripped of their gas.

79 ASTRONOMY AND ASTROPHYSICS↗

WE-AB-BRA-11: Development of Physiological-Based Virtual Thorax Phantoms for Evaluation of Deformable Image Registration

Purpose: To develop a methodology of constructing physiological-based virtual thorax phantom based on hyperpolarized (HP) gas tagging MRI for evaluating deformable image registration (DIR). Methods: Three healthy subjects were imaged at both the end-of-inhalation (EOI) and the end-of-exhalation (EOE) phases using a high-resolution (2.5mm isovoxel) 3D proton MRI, as well as a hybrid MRI which combines HP gas tagging MRI and a low-resolution (4.5mm isovoxel) proton MRI. A sparse tagging displacement vector field (tDVF) was derived from the HP gas tagging MRI by tracking the displacement of tagging grids between EOI and EOE. Using the tDVF and the high-resolution MR images, we determined the motion model of the entire thorax in the following two steps: 1) the DVF inside of lungs was estimated based on the sparse tDVF using a novel multi-step natural neighbor interpolation method; 2) the DVF outside of lungs was estimated from the DIR between the EOI and EOE images (Velocity AI). The derived motion model was then applied to the high-resolution EOI image to create a deformed EOE image, forming the virtual phantom where the motion model provides the ground truth of deformation. Five DIR methods were evaluated using the developed virtual phantom. Errors in DVF magnitude (Em) and angle (Ea) were determined and compared for each DIR method. Results: Among the five DIR methods, free form deformation produced DVF results that are most closely resembling the ground truth (Em=1.04mm, Ea=6.63°). The two DIR methods based on B-spline produced comparable results (Em=2.04mm, Ea=13.66°; and Em =2.62mm, Ea=17.67°), and the two optical-flow methods produced least accurate results (Em=7.8mm; Ea=53.04°; Em=4.45mm, Ea=31.02°). Conclusion: A methodology for constructing physiological-based virtual thorax phantom based on HP gas tagging MRI has been developed. Initial evaluation demonstrated its potential as an effective tool for robust evaluation of DIR in the lung.

60 APPLIED LIFE SCIENCES↗

ON THE POPULATIONS OF RADIO GALAXIES WITH EXTENDED MORPHOLOGY AT z < 0.3

Extended extragalactic radio sources have traditionally been classified into Fanaroff and Riley (FR) I and II types, based on the ratio r{sub s} of the separation S between the brightest regions on either sides of the host galaxy and the total size T of the radio source (r{sub s} {identical_to} S/T). In this paper, we examine the distribution of various physical properties as a function of r{sub s} of 1040 luminous (L {approx}> L{sub *}) extended radio galaxies (RGs) at z < 0.3 selected with well-defined criteria from the SDSS, NVSS, and FIRST surveys. About 2/3 of the RGs are lobe dominated (LD) and 1/3 have prominent jets. If we follow the original definition of the FR types, i.e., a division based solely on r{sub s} , FR I and FR II RGs overlap in their host galaxy properties. However, the rare LD sources with r{sub s} {approx}> 0.8 and [O III] {lambda}5007 line luminosity >10{sup 6} L{sub sun} are markedly different on average from the rest of the RGs, in the sense that they are hosted in lower mass galaxies, live in relatively sparse environments, and likely have higher accretion rates onto the central supermassive black hole (SMBH). Thus, these high emission line luminosity, high-r{sub s} LD RGs, and the rest of RGs form a well-defined dichotomy. Motivated by the stark differences in the nuclear emission line properties of the RG subsamples, we suggest that the accretion rate onto the SMBH may play the primary role in creating the different morphologies. At relatively high accretion rates, the accretion system may produce powerful jets that create the 'classical double' morphology (roughly corresponding to the LD sources with r{sub s} {approx}> 0.8 and emission lines); at lower accretion rates, the jets from a radiatively inefficient accretion flow generate radio lobes without apparent 'hot spots' at the edge (corresponding to the majority of LD sources). At slightly lower accretion rates and in galaxies with dense galactic structure, sources with prominent jets result. It is possible that while the high accretion rate systems could affect sub-Mpc scale environments, the jets from lower accretion rate systems may efficiently suppress activity within the host galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗

TYPE II-P SUPERNOVAE FROM THE SDSS-II SUPERNOVA SURVEY AND THE STANDARDIZED CANDLE METHOD

We apply the Standardized Candle Method (SCM) for Type II Plateau supernovae (SNe II-P), which relates the velocity of the ejecta of a SN to its luminosity during the plateau, to 15 SNe II-P discovered over the three season run of the Sloan Digital Sky Survey-II Supernova Survey. The redshifts of these SNe-0.027 < z < 0.144-cover a range hitherto sparsely sampled in the literature; in particular, our SNe II-P sample contains nearly as many SNe in the Hubble flow (z > 0.01) as all of the current literature on the SCM combined. We find that the SDSS SNe have a very small intrinsic I-band dispersion (0.22 mag), which can be attributed to selection effects. When the SCM is applied to the combined SDSS-plus-literature set of SNe II-P, the dispersion increases to 0.29 mag, larger than the scatter for either set of SNe separately. We show that the standardization cannot be further improved by eliminating SNe with positive plateau decline rates, as proposed in Poznanski et al. We thoroughly examine all potential systematic effects and conclude that for the SCM to be useful for cosmology, the methods currently used to determine the Fe II velocity at day 50 must be improved, and spectral templates able to encompass the intrinsic variations of Type II-P SNe will be needed.

79 ASTRONOMY AND ASTROPHYSICS↗