Search NASA⌕ Search

SEARCH · Search NASA

Results for “RAW images”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

A comparison of neural network and fuzzy clustering techniques in segmenting magnetic resonance images of the brain

Magnetic resonance (MR) brain section images are segmented and then synthetically colored to give visual representations of the original data with three approaches: the literal and approximate fuzzy c-means unsupervised clustering algorithms and a supervised computational neural network, a dynamic multilayered perception trained with the cascade correlation learning algorithm. Initial clinical results are presented on both normal volunteers and selected patients with brain tumors surrounded by edema. Supervised and unsupervised segmentation techniques provide broadly similar results. Unsupervised fuzzy algorithms were visually observed to show better segmentation when compared with raw image data for volunteer studies. However, for a more complex segmentation problem with tumor/edema or cerebrospinal fluid boundary, where the tissues have similar MR relaxation behavior, inconsistency in rating among experts was observed.

Hall, Lawrence O.↗

Macromolecular Topography Leaps into the Digital Age

A low-cost, real-time digital topography system is under development which will replace x-ray film and nuclear emulsion plates. The imaging system is based on an inexpensive surveillance camera that offers a 1000x1000 array of 8 im square pixels, anti-blooming circuitry, and very quick read out. Currently, the system directly converts x-rays to an image with no phosphor. The system is small and light and can be easily adapted to work with other crystallographic equipment. Preliminary images have been acquired of cubic insulin at the NSLS x26c beam line. NSLS x26c was configured for unfocused monochromatic radiation. Six reflections were collected with stills spaced from 0.002 to 0.001 degrees apart across the entire oscillation range that the reflections were in diffracting condition. All of the reflections were rotated to the vertical to reduce Lorentz and beam related effects. This particular CCD is designed for short exposure applications (much less than 1 sec) and so has a relatively high dark current leading to noisy raw images. The images are processed to remove background and other system noise with a multi-step approach including the use of wavelets, histogram, and mean window filtering. After processing, animations were constructed with the corresponding reflection profile to show the diffraction of the crystal volume vs. the oscillation angle as well as composite images showing the parts of the crystal with the strongest diffraction for each reflection. The final goal is to correlate features seen in reflection profiles captured with fine phi slicing to those seen in the topography images. With this development macromolecular topography finally comes into the digital age.

Lovelace, J.↗

Unsteady Pressure-Sensitive-Paint Shot Noise Reduction

In the study of unsteady Pressure-Sensitive Paint (uPSP) image data sets, pixel intensity values collected by Phantom cameras from multiple perspectives are used to calculate the surface pressure of an experimental model. This paper focuses on mitigation of shot noise which is introduced into the image data set by the cameras. Shot noise impacts the quality of data collected, increasing the system error in its pressure value calculations. This paper characterises statistical methods to reduce shot noise within experimental data by taking an average or weighted average across an area of pixels of their respective counts. Each combined-pixel has a higher total effective intensity value and therefore exhibits reduced noise throughout its time history. This is demonstrated by calculating the standard deviations of the combined pixel values through time, which decrease as the combined pixel area increases. Finally, these methods are compared across experimental wind tunnel conditions to examine their effectiveness at different Mach numbers. Ultimately, the results are used to recommend a blur filter type and size which will be applied to the raw image data prior to processing, as well as a minimum camera resolution for future experiments. Downstream of the filter application, the software to convert the 2D image data sets into surface pressure readings on a 3D grid use a ratio of decimation that assigns multiple pixels to each 3D grid node. This decimation ratio will also be aligned with the size of the blur filter, resulting in a more manageable data set size and compromised spatial resolution. Combined with the effect of the blur filter, the resulting pixel intensity readings will exhibit significantly reduced shot noise, reducing the magnitude of uncertainty and error in the final calculated pressure. For future tests, the camera spatial resolution must be sufficient to capture small flow and model features even after the recommended blur filter is applied. The image data set is taken from a uPSP experiment of the Space Launch System Block 1 cargo vehicle model in September 2019.

Lucy Tang↗

Unsteady Pressure-Sensitive Paint (UPSP) Shot Noise Reduction

In the study of unsteady Pressure-Sensitive Paint (uPSP) image data sets, pixel intensity values collected by Phantom cameras from multiple perspectives are used to calculate the surface pressure of an experimental model. This paper focuses on mitigation of shot noise which is introduced into the image data set by the cameras. Shot noise impacts the quality of data collected, increasing the system error in its pressure value calculations. This paper characterises statistical methods to reduce shot noise within experimental data by taking an average or weighted average across an area of pixels of their respective counts. Each combined-pixel has a higher total effective intensity value and therefore exhibits reduced noise throughout its time history. This is demonstrated by calculating the standard deviations of the combined pixel values through time, which decrease as the combined pixel area increases. Finally, these methods are compared across experimental wind tunnel conditions to examine their effectiveness at different Mach numbers. Ultimately, the results are used to recommend a blur filter type and size which will be applied to the raw image data prior to processing, as well as a minimum camera resolution for future experiments. Downstream of the filter application, the software to convert the 2D image data sets into surface pressure readings on a 3D grid use a ratio of decimation that assigns multiple pixels to each 3D grid node. This decimation ratio will also be aligned with the size of the blur filter, resulting in a more manageable data set size and compromised spatial resolution. Combined with the effect of the blur filter, the resulting pixel intensity readings will exhibit significantly reduced shot noise, reducing the magnitude of uncertainty and error in the final calculated pressure. For future tests, the camera spatial resolution must be sufficient to capture small flow and model features even after the recommended blur filter is applied. The image data set is taken from a uPSP experiment of the Space Launch System Block 1 cargo vehicle model in September 2019.

Lucy Tang↗

Towards automating structural discovery in scanning transmission electron microscopy *

Abstract Scanning transmission electron microscopy is now the primary tool for exploring functional materials on the atomic level. Often, features of interest are highly localized in specific regions in the material, such as ferroelectric domain walls, extended defects, or second phase inclusions. Selecting regions to image for structural and chemical discovery via atomically resolved imaging has traditionally proceeded via human operators making semi-informed judgements on sampling locations and parameters. Recent efforts at automation for structural and physical discovery have pointed towards the use of ‘active learning’ methods that utilize Bayesian optimization with surrogate models to quickly find relevant regions of interest. Yet despite the potential importance of this direction, there is a general lack of certainty in selecting relevant control algorithms and how to balance a priori knowledge of the material system with knowledge derived during experimentation. Here we address this gap by developing the automated experiment workflows with several combinations to both illustrate the effects of these choices and demonstrate the tradeoffs associated with each in terms of accuracy, robustness, and susceptibility to hyperparameters for structural discovery. We discuss possible methods to build descriptors using the raw image data and deep learning based semantic segmentation, as well as the implementation of variational autoencoder based representation. Furthermore, each workflow is applied to a range of feature sizes including NiO pillars within a La:SrMnO 3 matrix, ferroelectric domains in BiFeO 3 , and topological defects in graphene. The code developed in this manuscript is open sourced and will be released at github.com/nccreang/AE_Workflows .

47 OTHER INSTRUMENTATION↗

Paw-Net: Stacking ensemble deep learning for segmenting scanning electron microscopy images of fine-grained shale samples

Segmentation of scanning electron microscopy (SEM) images is critical yet time-consuming for geological analyses, as it needs to differentiate the boundaries for different mineral objects to facilitate subsequent analyses, such as porosity calculation. Recently, various machine learning methods, especially convolutional neural networks (CNNs), have been explored to segment SEM images of fine-grained shale samples. However, we found that general CNNs do not yield optimal performance due to insufficient training data and imbalanced objects in SEM images. This work has revised the U-Net architecture, a popular approach for biomedical image analyses, by incorporating a loss function that addresses the imbalance issue. Furthermore, we used the ensemble learning method to train multiple models and combined the results to improve the overall performance of segmentation. We prepared 2162 sub-images from raw SEM images in our experiments and divided them into training, validation, and testing datasets. The overall results show that our method improves the average Intersection over Union (IOU) of mineral objects from 0.49 to 0.58, compared to the original U-Net model. Our method can clearly distinguish each object from others with boundaries, even in highly imbalanced images. Training our models takes less than three minutes using a single GPU, while manual labeling can take up to three hours for each image. Furthermore, the method helps geoscientists gain insights quickly and effectively by building neural network models from a small dataset of SEM images.

58 GEOSCIENCES↗

Exploring Classification of Topological Priors With Machine Learning for Feature Extraction

In many scientific endeavors, increasingly abstract representations of data allow for new interpretive methodologies and conceptualization of phenomena. For example, moving from raw imaged pixels to segmented and reconstructed objects allows researchers new insights and means to direct their studies toward relevant areas. Thus, the development of new and improved methods for segmentation remains an active area of research. With advances in machine learning and neural networks, scientists have been focused on employing deep neural networks such as U-Net to obtain pixel-level segmentations, namely, defining associations between pixels and corresponding/referent objects and gathering those objects afterward. Topological analysis, such as the use of the Morse-Smale complex to encode regions of uniform gradient flow behavior, offers an alternative approach: first, create geometric priors, and then apply machine learning to classify. This approach is empirically motivated since phenomena of interest often appear as subsets of topological priors in many applications. Using topological elements not only reduces the learning space but also introduces the ability to use learnable geometries and connectivity to aid the classification of the segmentation target. Here, in this article, we describe an approach to creating learnable topological elements, explore the application of ML techniques to classification tasks in a number of areas, and demonstrate this approach as a viable alternative to pixel-level classification, with similar accuracy, improved execution time, and requiring marginal training data.

97 MATHEMATICS AND COMPUTING↗

Providing Geospatial Intelligence through a Scalable Imagery Pipeline

This chapter describes ORNL’s (Oak Ridge National Laboratory’s) contributions to imagery preprocessing for geospatial intelligence research and development (R&D) in four sections. First, we discuss challenges involved in building an effective imagery preprocessing workflow and the world-class high-performance computing (HPC) resources at ORNL available to process petabytes of imagery data. Second, we highlight how we developed imagery preprocessing tools over three decades while paving the way for our current cutting-edge machine learning and computer vision algorithms that are impacting humanitarian and disaster response efforts. Third, we discuss how PIPE modules work together to turn raw images into analysis-ready datasets. Fourth, we look toward the future and discuss planned advancements to PIPE and computing trends that will affect geospatial intelligence R&D.

Reith, Andrew↗

UAV remote sensing imagery - Miscanthus trials 2020 - Energy Farm - UIUC

Aerial imagery utilized as input in the manuscript "Deep convolutional neural networks exploit high spatial and temporal resolution aerial imagery to predict key traits in miscanthus" . Data was collected over M. Sacchariflorus and Sinensis breeding trials at the Energy Farm, UIUC in 2020. Flights were performed using a DJI M600 mounted with a Micasense Rededge multispectral sensor at 20 m altitude around solar noon. Imagery is available as tif file by field trial and date (10). The post-processing of raw images into orthophoto was performed in Agisoft Metashape software. Each crop surface model and multispectral orthophoto was stacked into an unique raster stack by date and uploaded here. Each raster stack includes 6 layers in the following order: Layer 1 = crop surface model, Layer 2 = Blue, Layer 3 = Green, Layer 4 = Red, Layer 5 = Rededge, and Layer 6 = NIR multispectral bands. Msa raster stacks were resampled to 1.67 cm spatial resolution and Msi raster stacks were resampled to 1.41 cm spatial resolution to ease their integration into further analysis. 'MMDDYYYY' is the date of data collection, 'MSA' is M. Sacchariflorus trial, 'MSI' is Miscanthus Sinensis trial, 'CSM' is crop surface model layer, and 'MULTSP' are the five multispectral bands.

bioenergy↗

Sustainability Trait Modeling of Field-Grown Switchgrass (Panicum virgatum) Using UAV-Based Imagery

Unmanned aerial vehicles (UAVs) provide an intermediate scale of spatial and spectral data collection that yields increased accuracy and consistency in data collection for morphological and physiological traits than satellites and expanded flexibility and high-throughput compared to ground-based data collection. In this project, we used UAV-based multispectral imagery collected from MicaSense RedEdge-M on a DJI Matrice 600 Pro for automated phenotyping of field-grown switchgrass (Panicum virgatum), a leading bioenergy feedstock. The raw images were processed with Pix4D Mapper to create the reflectance data, and vegetation indices were calculated from a UAV-based multispectral camera. Statistical models were developed for rust disease caused by Puccinia novopanici, leaf chlorophyll, nitrogen, and lignin contents. For the first time, UAV remote sensing technology was used to explore the potential for multiple traits associated with sustainable production of switchgrass. One statistical model was developed for each individual trait based on the statistical correlation between vegetation indices and the corresponding trait.

CBI↗

Geometric and radiometric characterization of LANDSAT-D thematic mapper and multispectral scanner data

A geometrically raw image of Washington, D.C. was acquired and radiometrically corrected. The data show little of the detector stripping common in earlier MSS images. The radiometrically corrected data have uniform means and standard deviations for the detectors in each band; however, the data for different detectors utilize a different pattern of DN levels, resulting in ubiquitous stripping of 1 DN amplitude. Band-to-band registration was assessed using color composites and small area correlation techniques. The spectral equivalency of the first four bands of the thematic mapper with the four bands of the MSS is being examined. Geometric analysis of the Washington, D.C. scene have started and a generalized routine for examining the contents of the label files and nonvideo data files was implemented. Several discrepancies from the documentation are described. Night scenes and daytime ocean scenes required for radiometric purposes were identified and the data ordered.

Kieffer, H. H.↗

Massively parallel processor computer

An apparatus for processing multidimensional data with strong spatial characteristics, such as raw image data, characterized by a large number of parallel data streams in an ordered array is described. It comprises a large number (e.g., 16,384 in a 128 x 128 array) of parallel processing elements operating simultaneously and independently on single bit slices of a corresponding array of incoming data streams under control of a single set of instructions. Each of the processing elements comprises a bidirectional data bus in communication with a register for storing single bit slices together with a random access memory unit and associated circuitry, including a binary counter/shift register device, for performing logical and arithmetical computations on the bit slices, and an I/O unit for interfacing the bidirectional data bus with the data stream source. The massively parallel processor architecture enables very high speed processing of large amounts of ordered parallel data, including spatial translation by shifting or sliding of bits vertically or horizontally to neighboring processing elements.

Fung, L. W.↗

Estimating Doppler Shifts for Synthetic-Aperture Radar

Quality of synthetic-aperture-radar (SAR) imagery enhanced by pair of signal-processing techniques that compensate for relative motion between target and vehicle. Combining vehicle trajectory data with radar-parameter and raw image data, techniques generate Doppler estimates for use in constructing fully processed images.

Curlander, J. C.↗

ISCCP global radiance data set - A new resource for climate research

The operational data-collection phase of the International Satellite Cloud Climatology Project (ISCCP) began in July 1983 as an element of the World Climate Research Program (WCRP). Since then, raw images from an international network of operational geostationary and polar-orbiting meteorological satellites have been routinely processed to develop a global data set of calibrated radiances and derived cloud parameters for climate research. This report outlines the key steps involved in producing the basic ISCCP reduced-resolution global radiance (B3) data set, describes the main features of the data set, and indicates the principal point of contact for obtaining copies of the data tapes. A future paper will focus on the derived cloud properties and their utilization.

Schiffer, R. A.↗

A post-processing system for automated rectification and registration of spaceborne SAR imagery

An automated post-processing system has been developed that interfaces with the raw image output of the operational digital SAR correlator. This system is designed for optimal efficiency by using advanced signal processing hardware and an algorithm that requires no operator interaction, such as the determination of ground control points. The standard output is a geocoded image product (i.e. resampled to a specified map projection). The system is capable of producing multiframe mosaics for large-scale mapping by combining images in both the along-track direction and adjacent cross-track swaths from ascending and descending passes over the same target area. The output products have absolute location uncertainty of less than 50 m and relative distortion (scale factor and skew) of less than 0.1 per cent relative to local variations from the assumed geoid.

Curlander, John C.↗

Processing Of Multispectral Data For Identification Of Rocks

Linear discriminant analysis and supervised classification evaluated. Report discusses processing of multispectral remote-sensing imagery to identify kinds of sedimentary rocks by spectral signatures in geological and geographical contexts. Raw image data are spectra of picture elements in images of seven sedimentary rock units exposed on margin of Wind River Basin in Wyoming. Data acquired by Landsat Thematic Mapper (TM), Thermal Infrared Multispectral Scanner (TIMS), and NASA/JPL airborne synthetic-aperture radar (SAR).

Evans, Diane L.↗

Covisualization by computational optical-sectioning microscopy of integrin and associated proteins at the cell membrane of living onion protoplasts

Using higher-resolution wide-field computational optical-sectioning fluorescence microscopy, the distribution of antigens recognized by antibodies against animal beta 1 integrin, fibronectin, and vitronectin has been visualized at the outer surface of enzymatically protoplasted onion epidermis cells and in depectinated cell wall fragments. On the protoplast all three antigens are colocalized in an array of small spots, as seen in raw images, in Gaussian filtered images, and in images restored by two different algorithms. Fibronectin and vitronectin but not beta 1 integrin antigenicities colocalize as puncta in comparably prepared and processed images of the wall fragments. Several control visualizations suggest considerable specifity of antibody recognition. Affinity purification of onion cell extract with the same anti-integrin used for visualization has yielded protein that separates in SDS-PAGE into two bands of about 105-110 and 115-125 kDa. These bands are again recognized by the visualization antibody, which was raised against the extracellular domain of chicken beta 1 integrin, and are also recognized by an antibody against the intracellular domain of chicken beta 1 integrin. Because beta 1 integrin is a key protein in numerous animal adhesion sites, it appears that the punctate distribution of this protein in the cell membranes of onion epidermis represents the adhesion sites long known to occur in cells of this tissue. Because vitronectin and fibronection are matrix proteins that bind to integrin in animals, the punctate occurrence of antigenically similar proteins both in the wall (matrix) and on enzymatically prepared protoplasts reinforces the concept that onion cells have adhesion sites with some similarity to certain kinds of adhesion sites in animals.

NASA Discipline Plant Biology↗

Cassini-Huygens Outreach: It Takes a Village to Reach the World

The viewgraph presentation includes a Cassini-Huygens outreach overview, including discussions of educational initiatives, the Saturn observation campaign, solar system ambassadors, products for diverse communities, Cassini's web presence, and the Cassini raw image gallery,

Cassini↗