Search NASA⌕ Search

SEARCH · Search NASA

Results for “persistent image”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Robustness of topological persistence in knowledge distillation for wearable sensor data

Topological data analysis (TDA) has shown great success in various applications involving wearable sensor data. However, there are difficulties in leveraging topological features in machine learning and wearable sensors because of the large time consumption and computational resources required to extract the features. To address this problem, knowledge distillation (KD) is utilized to generate a small model and accommodate topological features with persistence image (PI) representations from the raw time series data. Deploying topological knowledge in KD enables the student to achieve better performance compared to the one trained solely on raw time series data. However, it is not yet known if there are coherent characteristics for topological features in PI, which can aid in improving the performance during KD. In this paper, we investigate the suitability and challenges of utilizing topological features in KD for wearable sensor data, thereby contributing to the advancement of the field. Our study explores the impact of transferred topological features by comparing the Teacher-to-Student framework with Multiple Teachers-to-Student where teachers utilize both time series data and persistence images obtained by TDA as inputs. Additionally, we conduct a rigorous examination of topological knowledge effects by testing under various corruptions, knowledge types, and learning strategies in the context of human activity recognition tasks. Our analysis of topological features in KD presents the optimal strategy for incorporating these features. This study includes datasets of varying scales, window lengths, and activity classes, providing a comprehensive evaluation. Our results demonstrate that leveraging topological features in KD to enhance performance across databases.

97 MATHEMATICS AND COMPUTING↗

Topological data analysis of task-based fMRI data from experiments on schizophrenia

We use methods from computational algebraic topology to study functional brain networks, in which nodes represent brain regions and weighted edges represent similarity of fMRI time series from each region. With these tools, which allow one to characterize topological invariants such as loops in high-dimensional data, we are able to gain understanding into low-dimensional structures in networks in a way that complements traditional approaches based on pairwise interactions. In the present paper, we analyze networks constructed from task-based fMRI data from schizophrenia patients, healthy controls, and healthy siblings of schizophrenia patients using persistent homology, which allows us to explore the persistence of topological structures such as loops at different scales in the networks. We use persistence landscapes, persistence images, and Betti curves to create output summaries from our persistent-homology calculations, and we study the persistence landscapes and images using k-means clustering and community detection. Based on our analysis of persistence landscapes, we find that the members of the sibling cohort have topological features (specifically, their 1-dimensional loops) that are distinct from the other two cohorts. From the persistence images, we are able to distinguish all three subject groups and to determine the brain regions in the loops (with four or more edges) that allow us to make these distinctions.

60 APPLIED LIFE SCIENCES↗

TopFusion: Using Topological Feature Space for Fusion and Imputation in Multi-Modal Data

We present a novel multi-modal data fusion technique using topological features. The method, TopFusion, leverages the flexibility of topological data analysis tools (namely persistent homology and persistence images) to map multi-modal datasets into a common feature space by forming a new multi-channel persistence image. Each channel in the image is representative of a view of the data from a modality-dependent filtration. We demonstrate that the topological perspective we take allows for more effective data reconstruction, i.e. imputation. In particular, by performing imputation in topological feature space we are able to outperform the same imputation techniques applied to raw data or alternatively derived features. We show that TopFusion representations can be used as input to downstream deep learning-based computer vision models and doing so achieves comparable performance to other fusion methods for classification on two multi-modal datasets.

Myers, Audun D.↗

Establishment of stable synthetic mutualism without co-evolution between microalgae and bacteria demonstrated by mutual transfer of metabolites (NanoSIMS isotopic imaging) and persistent physical association (Fluorescent in situ hybridization)

The demonstration of a mutualistic interaction requires evidence of benefits for both partners as well as stability of the association over multiple generations. A synthetic mutualism between the freshwater microalga Chlorella sorokiniana and the soil-derived plant growth-promoting bacterium (PGPB) Azospirillum brasilense was created when both microorganisms were co-immobilized in alginate beads. Using stable isotope enrichment experiments followed by high-resolution secondary ion mass spectrometry (SIMS) imaging of single cells, we demonstrated transfer of carbon and nitrogen compounds between the two partners. Further, using fluorescent in situ hybridization (FISH), mechanical disruption and scanning electron microscopy, we demonstrated the stability of their physical association for a period of 10 days after the aggregated cells were released from the beads. The bacteria significantly enhanced the growth of the microalgae while the microalgae supported growth of the bacteria in a medium where it could not otherwise grow. In conclusion, we propose that this microalga-bacterium association is a true synthetic mutualism independent of co-evolution. (155 words).

59 BASIC BIOLOGICAL SCIENCES↗

Constructing a Database from Multiple 2D Images for Camera Pose Estimation and Robot Localization

The LMDB (Landmark Database) Builder software identifies persistent image features (landmarks) in a scene viewed multiple times and precisely estimates the landmarks 3D world positions. The software receives as input multiple 2D images of approximately the same scene, along with an initial guess of the camera poses for each image, and a table of features matched pair-wise in each frame. LMDB Builder aggregates landmarks across an arbitrarily large collection of frames with matched features. Range data from stereo vision processing can also be passed to improve the initial guess of the 3D point estimates. The LMDB Builder aggregates feature lists across all frames, manages the process to promote selected features to landmarks, and iteratively calculates the 3D landmark positions using the current camera pose estimations (via an optimal ray projection method), and then improves the camera pose estimates using the 3D landmark positions. Finally, it extracts image patches for each landmark from auto-selected key frames and constructs the landmark database. The landmark database can then be used to estimate future camera poses (and therefore localize a robotic vehicle that may be carrying the cameras) by matching current imagery to landmark database image patches and using the known 3D landmark positions to estimate the current pose.

Wolf, Michael↗

Quantitative and interpretable order parameters for phase transitions from persistent homology

Here, we apply modern methods in computational topology to the task of discovering and characterizing phase transitions. As illustrations, we apply our method to four two-dimensional lattice spin models: the Ising, square ice, XY, and fully frustrated XY models. In particular, we use persistent homology, which computes the births and deaths of individual topological features as a coarse-graining scale or sublevel threshold is increased, to summarize multiscale and high-point correlations in a spin configuration. We employ vector representations of this information called persistence images to formulate and perform the statistical task of distinguishing phases. For the models we consider, a simple logistic regression on these images is sufficient to identify the phase transition. Interpretable order parameters are then read from the weights of the regression. This method suffices to identify magnetization, frustration, and vortex-antivortex structure as relevant features for phase transitions in our models. We also define “persistence” critical exponents and study how they are related to those critical exponents usually considered.

36 MATERIALS SCIENCE↗

A framework for activity detection in wide-area motion imagery

Wide-area persistent imaging systems are becoming increasingly cost effective and now large areas of the earth can be imaged at relatively high frame rates (1-2 fps). The efficient exploitation of the large geo-spatial-temporal datasets produced by these systems poses significant technical challenges for image and video analysis and data mining. In recent years there has been significant progress made on stabilization, moving object detection and tracking and automated systems now generate hundreds to thousands of vehicle tracks from raw data, with little human intervention. However, the tracking performance at this scale, is unreliable and average track length is much smaller than the average vehicle route. This is a limiting factor for applications which depend heavily on track identity, i.e. tracking vehicles from their points of origin to their final destination. In this paper we propose and investigate a framework for wide-area motion imagery (W AMI) exploitation that minimizes the dependence on track identity. In its current form this framework takes noisy, incomplete moving object detection tracks as input, and produces a small set of activities (e.g. multi-vehicle meetings) as output. The framework can be used to focus and direct human users and additional computation, and suggests a path towards high-level content extraction by learning from the human-in-the-loop.

99 GENERAL AND MISCELLANEOUS↗

Passive Fully Polarimetric W-Band Millimeter-Wave Imaging

We present the theory, design, and experimental results obtained from a scanning passive W-band fully polarimetric imager. Passive millimeter-wave imaging offers persistent day/nighttime imaging and the ability to penetrate dust, clouds and other obscurants, including clothing and dry soil. The single-pixel scanning imager includes both far-field and near-field fore-optics for investigation of polarization phenomena. Using both fore-optics, a variety of scenes including natural and man-made objects was imaged and these results are presented showing the utility of polarimetric imaging for anomaly detection. Analysis includes conventional Stokes-parameter based approaches as well as multivariate image analysis methods.

99 GENERAL AND MISCELLANEOUS↗

WE-G-18C-05: Characterization of Cross-Vendor, Cross-Field Strength MR Image Intensity Variations

Purpose: Variations in MR image intensity and image intensity nonuniformity (IINU) can challenge the accuracy of intensity-based image segmentation and registration algorithms commonly applied in radiotherapy. The goal of this work was to characterize MR image intensity variations across scanner vendors and field strengths commonly used in radiotherapy. Methods: ACR-MRI phantom images were acquired at 1.5T and 3.0T on GE (450w and 750, 23.1), Siemens (Espree and Verio, VB17B), and Philips (Ingenia, 4.1.3) scanners using commercial spin-echo sequences with matched parameters (TE/TR: 20/500 ms, rBW: 62.5 kHz, TH/skip: 5/5mm). Two radiofrequency (RF) coil combinations were used for each scanner: body coil alone, and combined body and phased-array head coils. Vendorspecific B1- corrections (PURE/Pre-Scan Normalize/CLEAR) were applied in all head coil cases. Images were transferred offline, corrected for IINU using the MNI N3 algorithm, and normalized. Coefficients of variation (CV=σ/μ) and peak image uniformity (PIU = 1−(Smax−Smin)/(Smax+Smin)) estimates were calculated for one homogeneous phantom slice. Kruskal-Wallis and Wilcoxon matched-pairs tests compared mean MR signal intensities and differences between original and N3 image CV and PIU. Results: Wide variations in both MR image intensity and IINU were observed across scanner vendors, field strengths, and RF coil configurations. Applying the MNI N3 correction for IINU resulted in significant improvements in both CV and PIU (p=0.0115, p=0.0235). However, wide variations in overall image intensity persisted, requiring image normalization to improve consistency across vendors, field strengths, and RF coils. These results indicate that B1- correction routines alone may be insufficient in compensating for IINU and image scaling, warranting additional corrections prior to use of MR images in radiotherapy. Conclusions: MR image intensities and IINU vary as a function of scanner vendor, field strength, and RF coil configuration. A two-step strategy consisting of MNI N3 correction followed by normalization was required to improve MR image consistency. Funding provided by Advancing a Healthier Wisconsin.

60 APPLIED LIFE SCIENCES↗

Wake in faint television meteors

The two component dustball model was used in numerical lag computation. Detached grain lag is typically less than 2 km, with expected wakes of a few hundred meters. True wake in television meteors is masked by apparent wake due to the combined effects of image persistence and blooming. To partially circumvent this problem, we modified a dual MCP intensified CID video system by addition of a rotating shutter to reduce the effective exposure time to about 2.0 ms. Preliminary observations showed that only 2 of 27 analyzed meteors displayed statistically significant wake.

Robertson, M. C.↗

New and Better Near-Infrared Detectors for JWST Near Infrared Spectrograph

ESA and NASA recently selected two 5 m cutoff Teledyne H2RG sensor chip assemblies (SCA) for flight on the James Webb Space Telescope (JWST) Near Infrared Spectrograph (NIRSpec). These HgCdTe SCAs incorporate Teledynes improved barrier layer design that eliminates the degradation that affected earlier JWST H2RGs(Rauscher et al. 2012a). The better indium barrier, together with other design changes, has improved the performance and reliability of JWSTs SCAs. In this article, we describe the measured performance characteristics that most directly affect scientific observations including read noise, total noise, dark current, quantum efficiency (QE), and image persistence. As part of measuring QE, we measured the quantum yield as a function of photon energy,, and found that it exceeds unity for photon energies E (2.65.2) Eg, where Eg is the HgCdTe bandgap energy. This corresponds to. 2 m for NIRSpecs 5 m cutoff HgCdTe. Our measurements agree well with a previous measurement by McCullough et al. (2008) for. 1.3. For 1.3, we find a slower increase in with photon energy than McCullough et al. did. However, and as McCullough et al. note, their two state model of the yield process is not valid for large 1.

New and Better↗

PERSISTENCE MAPPING USING EUV SOLAR IMAGER DATA

We describe a simple image processing technique that is useful for the visualization and depiction of gradually evolving or intermittent structures in solar physics extreme-ultraviolet imagery. The technique is an application of image segmentation, which we call “Persistence Mapping,” to isolate extreme values in a data set, and is particularly useful for the problem of capturing phenomena that are evolving in both space and time. While integration or “time-lapse” imaging uses the full sample (of size N ), Persistence Mapping rejects ( N − 1)/ N of the data set and identifies the most relevant 1/ N values using the following rule: if a pixel reaches an extreme value, it retains that value until that value is exceeded. The simplest examples isolate minima and maxima, but any quantile or statistic can be used. This paper demonstrates how the technique has been used to extract the dynamics in long-term evolution of comet tails, erupting material, and EUV dimming regions.

79 ASTRONOMY AND ASTROPHYSICS↗

Persistence Mapping Using EUV Solar Imager Data

We describe a simple image processing technique that is useful for the visualization and depiction of gradually evolving or intermittent structures in solar physics extreme-ultraviolet imagery. The technique is an application of image segmentation, which we call "Persistence Mapping," to isolate extreme values in a data set, and is particularly useful for the problem of capturing phenomena that are evolving in both space and time. While integration or "time-lapse" imaging uses the full sample (of size N ), Persistence Mapping rejects (N - 1)/N of the data set and identifies the most relevant 1/N values using the following rule: if a pixel reaches an extreme value, it retains that value until that value is exceeded. The simplest examples isolate minima and maxima, but any quantile or statistic can be used. This paper demonstrates how the technique has been used to extract the dynamics in long-term evolution of comet tails, erupting material, and EUV dimming regions.

Thompson, B. J.↗

Observing and recording instantaneous images on ATM television monitors

A persistent image-converter device was utilized to make visible to the astronaut solar images that were isolated, instantaneous flashes on the ATM TV monitors. In addition, these instantaneous images, as well as normal TV images, were recorded with a Polaroid SX-70 camera for study by the astronauts.

Patterson, N. P.↗

Subclinical Cardiac Dysfunction Detected by Strain Imaging During Breast Irradiation With Persistent Changes 6 Weeks After Treatment

Purpose: To evaluate 2-dimensional strain imaging (SI) for the detection of subclinical myocardial dysfunction during and after radiation therapy (RT). Methods and Materials: Forty women with left-sided breast cancer, undergoing only adjuvant RT to the left chest, were prospectively recruited. Standard echocardiography and SI were performed at baseline, during RT, and 6 weeks after RT. Strain (S) and strain rate (Sr) parameters were measured in the longitudinal, circumferential, and radial planes. Correlation of change in global longitudinal strain (GLS % and Δ change) and the volume of heart receiving 30 Gy (V30) and mean heart dose (MHD) were examined. Results: Left ventricular ejection fraction was unchanged; however, longitudinal systolic S and Sr and radial S were significantly reduced during RT and remained reduced at 6 weeks after treatment [longitudinal S (%) −20.44 ± 2.66 baseline vs −18.60 ± 2.70* during RT vs −18.34 ± 2.86* at 6 weeks after RT; longitudinal Sr (s{sup −1}) −1.19 ± 0.21 vs −1.06 ± 0.18* vs −1.06 ± 0.16*; radial S (%) 56.66 ± 18.57 vs 46.93 ± 14.56* vs 49.22 ± 15.81*; *P<.05 vs baseline]. Diastolic Sr were only reduced 6 weeks after RT [longitudinal E Sr (s{sup −1}) 1.47 ± 0.32 vs 1.29 ± 0.27*; longitudinal A Sr (s{sup −1}) 1.19 ± 0.31 vs 1.03 ± 0.24*; *P<.05 vs baseline], whereas circumferential strain was preserved throughout. A modest correlation between S and Sr and V30 and MHD was observed (GLS Δ change and V30 ρ = 0.314, P=.05; GLS % change and V30 ρ = 0.288, P=.076; GLS Δ change and MHD ρ = 0.348, P=.03; GLS % change and MHD ρ = 0.346, P=.031). Conclusions: Subclinical myocardial dysfunction was detected by 2-dimensional SI during RT, with changes persisting 6 weeks after treatment, though long-term effects remain unknown. Additionally, a modest correlation between strain reduction and radiation dose was observed.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Systems and methods for sensing occupancy

A computer implemented method for sensing occupancy of a workspace includes creating a difference image that represents luminance differences of pixels in past and current images of the workspace resulting from motion in the workspace, determining motion occurring in regions of the workspace based on the difference image, and altering a workspace environment based at least in part on the determined motion. The method also includes determining which pixels in the difference image represent persistent motion that can be ignored and determining which pixels representing motion in the difference image are invalid because the pixels are isolated from other pixels representing motion.

97 MATHEMATICS AND COMPUTING↗

Asymmetric Surface Brightness Structure of Caustic Crossing Arc in SDSS J1226+2152: A Case for Dark Matter Substructure

We study the highly magnified arc SGAS J122651.3+215220 caused by a star-forming galaxy at z s = 2.93 crossing the lensing caustic cast by the galaxy cluster SDSS J1226+2152 (z l = 0.43), using Hubble Space Telescope observations. We report in the arc several asymmetric surface brightness features whose angular separations are a fraction of an arcsecond from the lensing critical curve and appear to be highly but unequally magnified image pairs of underlying compact sources, with one brightest pair having clear asymmetry consistently across four filters. One explanation of unequal magnification is microlensing by intracluster stars, which induces independent flux variations in the images of individual or groups of source stars in the lensed galaxy. For a second possibility, intracluster dark matter subhaloes invisible to telescopes effectively perturb lensing magnifications near the critical curve and give rise to persistently unequal image pairs. Our modelling suggests, at least for the most prominent identified image pair, that the microlensing hypothesis is in tension with the absence of notable asymmetry variation over a six-year baseline, while subhaloes of ∼10 6 –10 8 \Mꙩ anticipated from structure formation with cold dark matter typically produce stationary and sizable asymmetries. We judge that observations at additional times and more precise lens models are necessary to stringently constrain temporal variability and robustly distinguish between the two explanations. The arc under this study is a scheduled target of a Director’s Discretionary Early Release Science program of the James Webb Space Telescope, which will provide deep images and a high-resolution view with integral field spectroscopy.

Liang Dai↗

Improved Modeling Tools Development for High Penetration Solar

One of the significant objectives of the High Penetration solar research is to help the DOE understand, anticipate, and minimize grid operation impacts as more solar resources are added to the electric power system. For Task 2.2, an effective, reliable approach to predicting solar energy availability for energy generation forecasts using the University of California, San Diego (UCSD) Sky Imager technology has been demonstrated. Granular cloud and ramp forecasts for the next 5 to 20 minutes over an area of 10 square miles were developed. Sky images taken every 30 seconds are processed to determine cloud locations and cloud motion vectors yielding future cloud shadow locations respective to distributed generation or utility solar power plants in the area. The performance of the method depends on cloud characteristics. On days with more advective cloud conditions, the developed method outperforms persistence forecasts by up to 30% (based on mean absolute error). On days with dynamic conditions, the method performs worse than persistence. Sky Imagers hold promise for ramp forecasting and ramp mitigation in conjunction with inverter controls and energy storage. The pre-commercial Sky Imager solar forecasting algorithm was documented with licensing information and was a Sunshot website highlight.

14 SOLAR ENERGY↗