Search NASA⌕ Search

SEARCH · Search NASA

Results for “multiple input images”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Montage Version 3.0

The final version (3.0) of the Montage software has been released. To recapitulate from previous NASA Tech Briefs articles about Montage: This software generates custom, science-grade mosaics of astronomical images on demand from input files that comply with the Flexible Image Transport System (FITS) standard and contain image data registered on projections that comply with the World Coordinate System (WCS) standards. This software can be executed on single-processor computers, multi-processor computers, and such networks of geographically dispersed computers as the National Science Foundation s TeraGrid or NASA s Information Power Grid. The primary advantage of running Montage in a grid environment is that computations can be done on a remote supercomputer for efficiency. Multiple computers at different sites can be used for different parts of a computation a significant advantage in cases of computations for large mosaics that demand more processor time than is available at any one site. Version 3.0 incorporates several improvements over prior versions. The most significant improvement is that this version is accessible to scientists located anywhere, through operational Web services that provide access to data from several large astronomical surveys and construct mosaics on either local workstations or remote computational grids as needed.

Jacob, Joseph↗

IMAGE 100: The interactive multispectral image processing system

The need for rapid, cost-effective extraction of useful information from vast quantities of multispectral imagery available from aircraft or spacecraft has resulted in the design, implementation and application of a state-of-the-art processing system known as IMAGE 100. Operating on the general principle that all objects or materials possess unique spectral characteristics or signatures, the system uses this signature uniqueness to identify similar features in an image by simultaneously analyzing signatures in multiple frequency bands. Pseudo-colors, or themes, are assigned to features having identical spectral characteristics. These themes are displayed on a color CRT, and may be recorded on tape, film, or other media. The system was designed to incorporate key features such as interactive operation, user-oriented displays and controls, and rapid-response machine processing. Owing to these features, the user can readily control and/or modify the analysis process based on his knowledge of the input imagery. Effective use can be made of conventional photographic interpretation skills and state-of-the-art machine analysis techniques in the extraction of useful information from multispectral imagery. This approach results in highly accurate multitheme classification of imagery in seconds or minutes rather than the hours often involved in processing using other means.

Schaller, E. S.↗

Hardware/Software Issues for Video Guidance Systems: The Coreco Frame Grabber

The F64 frame grabber is a high performance video image acquisition and processing board utilizing the TMS320C40 and TMS34020 processors. The hardware is designed for the ISA 16 bit bus and supports multiple digital or analog cameras. It has an acquisition rate of 40 million pixels per second, with a variable sampling frequency of 510 kHz to MO MHz. The board has a 4MB frame buffer memory expandable to 32 MB, and has a simultaneous acquisition and processing capability. It supports both VGA and RGB displays, and accepts all analog and digital video input standards.

Bales, John W.↗

Economical Implementation of a Filter Engine in an FPGA

A logic design has been conceived for a field-programmable gate array (FPGA) that would implement a complex system of multiple digital state-space filters. The main innovative aspect of this design lies in providing for reuse of parts of the FPGA hardware to perform different parts of the filter computations at different times, in such a manner as to enable the timely performance of all required computations in the face of limitations on available FPGA hardware resources. The implementation of the digital state-space filter involves matrix vector multiplications, which, in the absence of the present innovation, would ordinarily necessitate some multiplexing of vector elements and/or routing of data flows along multiple paths. The design concept calls for implementing vector registers as shift registers to simplify operand access to multipliers and accumulators, obviating both multiplexing and routing of data along multiple paths. Each vector register would be reused for different parts of a calculation. Outputs would always be drawn from the same register, and inputs would always be loaded into the same register. A simple state machine would control each filter. The output of a given filter would be passed to the next filter, accompanied by a "valid" signal, which would start the state machine of the next filter. Multiple filter modules would share a multiplication/accumulation arithmetic unit. The filter computations would be timed by use of a clock having a frequency high enough, relative to the input and output data rate, to provide enough cycles for matrix and vector arithmetic operations. This design concept could prove beneficial in numerous applications in which digital filters are used and/or vectors are multiplied by coefficient matrices. Examples of such applications include general signal processing, filtering of signals in control systems, processing of geophysical measurements, and medical imaging. For these and other applications, it could be advantageous to combine compact FPGA digital filter implementations with other application-specific logic implementations on single integrated-circuit chips. An FPGA could readily be tailored to implement a variety of filters because the filter coefficients would be loaded into memory at startup.

Kowalski, James E.↗

Dark Energy Survey Y3 results: blending shear and redshift biases in image simulations

ABSTRACT As the statistical power of galaxy weak lensing reaches per cent level precision, large, realistic, and robust simulations are required to calibrate observational systematics, especially given the increased importance of object blending as survey depths increase. To capture the coupled effects of blending in both shear and photometric redshift calibration, we define the effective redshift distribution for lensing, nγ(z), and describe how to estimate it using image simulations. We use an extensive suite of tailored image simulations to characterize the performance of the shear estimation pipeline applied to the Dark Energy Survey (DES) Year 3 data set. We describe the multiband, multi-epoch simulations, and demonstrate their high level of realism through comparisons to the real DES data. We isolate the effects that generate shear calibration biases by running variations on our fiducial simulation, and find that blending-related effects are the dominant contribution to the mean multiplicative bias of approximately $-2{{\ \rm per\ cent}}$. By generating simulations with input shear signals that vary with redshift, we calibrate biases in our estimation of the effective redshift distribution, and demonstrate the importance of this approach when blending is present. We provide corrected effective redshift distributions that incorporate statistical and systematic uncertainties, ready for use in DES Year 3 weak lensing analyses.

79 ASTRONOMY AND ASTROPHYSICS↗

Gumby: Quantifying multi-modal model resiliency

With the rise of cheap data and sensors, more use cases are emerging for multi-input models. Research has shown that including multiple data modalities can improve performance, suggesting that deep learning models can successfully learn to leverage complementary information from different modalities. However, this improved predictive power comes with unanticipated costs: additional inputs change model resiliency and expand the threat space for adversarial attacks. We first provide theoretical underpinnings for how adversarial success scales with input dimension. We then characterize the performance of a suite of multispectral deep learning models with different fusion approaches, quantify their relative reliance on different input bands, and evaluate their robustness to naturalistic and adversarial image corruptions.

97 MATHEMATICS AND COMPUTING↗

Continued Development of a Global Heat Transfer Measurement System at AEDC Hypervelocity Wind Tunnel 9

Heat transfer rates are an extremely important consideration in the design of hypersonic vehicles such as atmospheric reentry vehicles. This paper describes the development of a data reduction methodology to evaluate global heat transfer rates using surface temperature-time histories measured with the temperature sensitive paint (TSP) system at AEDC Hypervelocity Wind Tunnel 9. As a part of this development effort, a scale model of the NASA Crew Exploration Vehicle (CEV) was painted with TSP and multiple sequences of high resolution images were acquired during a five run test program. Heat transfer calculation from TSP data in Tunnel 9 is challenging due to relatively long run times, high Reynolds number environment and the desire to utilize typical stainless steel wind tunnel models used for force and moment testing. An approach to reduce TSP data into convective heat flux was developed, taking into consideration the conditions listed above. Surface temperatures from high quality quantitative global temperature maps acquired with the TSP system were then used as an input into the algorithm. Preliminary comparison of the heat flux calculated using the TSP surface temperature data with the value calculated using the standard thermocouple data is reported.

Kurits, Inna↗

A Synthesis of Star Calibration Techniques for Ground-Based Narrowband Electron-Multiplying Charge-Coupled Device Imagers Used in Auroral Photometry

A technique is presented for the periodic and systematic calibration of ground-based optical imagers. It is important to have a common system of units (Rayleighs or photon flux) for cross comparison as well as self-comparison over time. With the advancement in technology, the sensitivity of these imagers has improved so that stars can be used for more precise calibration. Background subtraction, flat fielding, star mapping, and other common techniques are combined in deriving a calibration technique appropriate for a variety of ground-based imager installations. Spectral (4278, 5577, and 8446 A ) ground-based imager data with multiple fields of view (19, 47, and 180 deg) are processed and calibrated using the techniques developed. The calibration techniques applied result in intensity measurements in agreement between different imagers using identical spectral filtering, and the intensity at each wavelength observed is within the expected range of auroral measurements. The application of these star calibration techniques, which convert raw imager counts into units of photon flux, makes it possible to do quantitative photometry. The computed photon fluxes, in units of Rayleighs, can be used for the absolute photometry between instruments or as input parameters for auroral electron transport models.

Grubbs, Guy II↗

Comparative Assessment of U-Net-Based Deep Learning Models for Segmenting Microfractures and Pore Spaces in Digital Rocks

Segmentation of high-resolution X-ray microcomputed tomography (µCT) images is crucial in digital rock physics (DRP), affecting the characterization and analysis of microscale phenomena in the porous media. The complexity of geological structures and nonideal scanning conditions pose significant challenges to conventional image segmentation approaches. Motivated by the recent increasing popularity of deep learning (DL) techniques in image processing, this work undertakes a comparative study of DL models, specifically U-Net and its variants, for segmenting multiple targets with distinguished features in digital rocks, including discrete fracture networks (DFNs), pore spaces, and solid rock. Particularly, DFNs have a smaller volumetric fraction over others, bringing in a substantial challenge of imbalanced segmentation. The primary focus is to evaluate the architecture and feature enhancement strategies of various DL models, including U-Net, attention U-Net, residual U-Net, U-Net++, and residual U-Net++. The models were designed as 2.5D, utilizing a central 2D image and its two adjacent upper and lower 2D images as input to provide a pseudo-3D context. In addition, because the ground truth of segmentation was unknown for real-world digital rocks, we created a benchmark data set following the inverse operations of segmentation. The data synthesis started from the label images (i.e., solid rock, pore spaces, and DFNs), followed by simulating partial volume blurring, adding random background noise, and introducing ring artifacts to mimic real raw X-ray µCT images. The data set, which included various rock types (i.e., sandstone and artificial data), scanning resolution, and magnitudes of noise and artifacts, was divided into training and testing data sets with a 90% and 10% ratio, respectively. Moreover, in addition to the conventional pixel-wise evaluation metrics, the physics-based metric of the lattice-Boltzmann method (LBM) simulated permeability provided more comprehensive assessments. The results demonstrated that the residual connections, nested architectures, and redesigned skip connections contribute to the model performance and give the residual U-Net++ the highest accuracy. The improvements were mainly on the boundaries and small targets, especially the DFNs, which dominate the interconnectivity and therefore affect the permeability greatly. This study also rigorously evaluated the efficiency and generalization of each model, demonstrating that the sophisticated architectures achieved excellent practicability and maintained robust performance on completely unseen data, ensuring their suitability for diverse and challenging DRP applications.

58 GEOSCIENCES↗

Sparse Matrix-Based HPC Tomography

Tomographic imaging has benefited from advances in X-ray sources, detectors and optics to enable novel observations in science, engineering and medicine. These advances have come with a dramatic increase of input data in the form of faster frame rates, larger fields of view or higher resolution, so high performance solutions are currently widely used for analysis. Tomographic instruments can vary significantly from one to another, including the hardware employed for reconstruction: from single CPU workstations to large scale hybrid CPU/GPU supercomputers. Furthermore, flexibility on the software interfaces and reconstruction engines are also highly valued to allow for easy development and prototyping. This paper presents a novel software framework for tomographic analysis that tackles all aforementioned requirements. The proposed solution capitalizes on the increased performance of sparse matrix-vector multiplication and exploits multi-CPU and GPU reconstruction over MPI. Furthermore, the solution is implemented in Python and relies on CuPy for fast GPU operators and CUDA kernel integration, and on SciPy for CPU sparse matrix computation. As opposed to previous tomography solutions that are tailor-made for specific use cases or hardware, the proposed software is designed to provide flexible, portable and high-performance operators that can be used for continuous integration at different production environments, but also for prototyping new experimental settings or for algorithmic development. The experimental results demonstrate how our implementation can even outperform state-of-the-art software packages used at advanced X-ray sources worldwide.

97 MATHEMATICS AND COMPUTING↗

Characterizing natural fractures and sub-seismic faults for well completion of Marcellus shale in the MSEEL Consortium project, West Virginia, USA

The Middle Devonian Marcellus shale play has emerged as a major world-class hydrocarbon accumulation and represents one of the largest and most prolific shale plays in the world. According to many outcrop studies in the region, natural fractures are well developed in the Marcellus Shale. However, evaluating fractures in the subsurface is often a significant challenge due to a lack of sufficient data. Therefore, in the Marcellus Shale Energy and Environment Laboratory (MSEEL) consortium project, significant efforts have been made to acquire high-quality image logs in the Marcellus laterals. The project provided tremendous opportunities to characterize the natural fractures and sub-seismic faults and to evaluate their impact on well stimulation. In this study, about 70,000 ft of acquired high-resolution logging while drilling (LWD) acoustic images from five long laterals located in Monongalia County, West Virginia, were processed and interpreted. In addition, the study used high-quality micro-resistivity images from a pilot well, allowing the evaluation of natural fractures in the entire Marcellus vertical sequence. Based on the available acoustic images, the natural fractures were classified into three basic categories: high-amplitude fractures, low-amplitude fractures, and faults. Further, larger open fractures can also be determined when a low-amplitude fracture is evident on caliper images. The fractures in the Marcellus usually have a medium to high angle dip; however, multiple fracture sets in terms of strike orientation were clearly observed in all the laterals. The fracture set with a strike at NE-SW (or 60-240 deg) seems to be the predominant one in all the wells. A few other sets, including those with N-S, NWW-SEE, and E-W strikes, were also observed. Several sub-seismic faults, with mostly a low dip angle and a NE-SW strike, have also been seen in two of the laterals. The fracture density is variable across all the laterals, ranging from very low (or none) to very high (up to 5 fractures per ft). The average fracture density for all the laterals is about 1 fracture per 10 ft. In the vertical sequence, the natural fracture development showed a clear preference for shale or shaly facies over carbonate-rich or thin limestone layers. The interpreted fracture and fault data were used as input data for the stimulation design with the purpose of better understanding the fractures’ impact on well stimulation. Production data from the laterals were also used to evaluate the natural fractures’ influence on well performance. The quality image database and the consistent interpretation results for the entire project enabled a systematic approach to characterizing fractures and, more importantly, to evaluating the impact of fractures on well stimulation and production.

03 NATURAL GAS↗

Multi-Sensor Characterization of the Boreal Forest: Initial Findings

Results are presented in an initial apriori knowledge approach toward using complementary multi-sensor multi-temporal imagery in characterizing vegetated landscapes over a site in the Boreal Ecosystem-Atmosphere Study (BOREAS). Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) and Airborne Synthetic Aperture Radar (AIRSAR) data were segmented using multiple endmember spectral mixture analysis and binary decision tree approaches. Individual date/sensor land cover maps had overall accuracies between 55.0% - 69.8%. The best eight land cover layers from all dates and sensors correctly characterized 79.3% of the cover types. An overlay approach was used to create a final land cover map. An overall accuracy of 71.3% was achieved in this multi-sensor approach, a 1.5% improvement over our most accurate single scene technique, but 8% less than the original input. Black spruce was evaluated to be particularly undermapped in the final map possibly because it was also contained within jack pine and muskeg land coverages.

Reith, Ernest↗

Ultra low-noise charge coupled device

Special purpose CCD designed for ultra low-noise imaging and spectroscopy applications that require subelectron read noise floors, wherein a non-destructive output circuit operating near its 1/f noise regime is clocked in a special manner to read a single pixel multiple times. Off-chip electronics average the multiple values, reducing the random noise by the square-root of the number of samples taken. Noise floors below 0.5 electrons rms are possible in this manner. In a preferred embodiment of the invention, a three-phase CCD horizontal register is used to bring a pixel charge packet to an input gate adjacent a floating gate amplifier. The charge is then repeatedly clocked back and forth between the input gate and the floating gate. Each time the charge is injected into the potential well of the floating gate, it is sensed non-destructively. The floating gate amplifier is provided with a reference voltage of a fixed value and a pre-charge gate for resetting the amplifier between charge samples to a constant gain. After the charge is repeatedly sampled a selected number of times, it is transferred by means of output gates, back into the horizontal register, where it is clocked in a conventional manner to a diffusion MOSFET amplifier. It can then be either sampled (destructively) one more time or otherwise discarded.

Janesick, James R.↗

A synthetic Roman Space Telescope High-Latitude Time-Domain Survey: supernovae in the deep field

ABSTRACT NASA will launch the Nancy Grace Roman Space Telescope (hereafter Roman) in the second half of this decade, which will allow for a generation-defining measurement of dark energy through multiple probes, including Type Ia supernovae (SNe Ia). To improve decisions on survey strategy, we have created the first simulations of realistic Roman images that include artificial SNe Ia injected as point sources in the images. Our analysis combines work done on Roman simulations for weak gravitational lensing studies as well as catalogue-level simulations of SN Ia samples. We have created a time series of images over 2 yr containing ∼1050 SNe Ia, covering a 1 deg2 subarea of a planned 5 deg2 deep survey. We have released these images publicly for community use along with input catalogues of all injected sources. We create secondary products from these images by generating coadded images and demonstrating recovery of transient sources using image subtraction. We perform first-use analyses on these images in order to measure galaxy detection efficiency, point source detection efficiency, and host-galaxy association biases. The simulated images can be found here at https://roman.ipac.caltech.edu/sims/SN_Survey_Image_sim.html.

Astronomy & Astrophysics↗

Efficient distributed continual learning for steering experiments in real-time

Deep learning has emerged as a powerful method for extracting valuable information from large volumes of data. However, when new training data arrives continuously (i.e., is not fully available from the beginning), incremental training suffers from catastrophic forgetting (i.e., new patterns are reinforced at the expense of previously acquired knowledge). Training from scratch each time new training data becomes available would result in extremely long training times and massive data accumulation. Rehearsal-based continual learning has shown promise for addressing the catastrophic forgetting challenge, but research to date has not addressed performance and scalability. To fill this gap, we propose an approach based on a distributed rehearsal buffer that efficiently complements data-parallel training on multiple GPUs to achieve high accuracy, short runtime, and scalability. It leverages a set of buffers (local to each GPU) and uses several asynchronous techniques for updating these local buffers in an embarrassingly parallel fashion, all while handling the communication overheads necessary to augment input minibatches using unbiased, global sampling. We further propose a generalization of rehearsal buffers to support both classification and generative learning tasks, as well as more advanced rehearsal strategies (notably Dark Experience Replay, leveraging knowledge distillation). We illustrate this approach with a real-life HPC streaming application from the domain of ptychographic image reconstruction. Furthermore, we run extensive experiments on up to 128 GPUs of the ThetaGPU supercomputer to compare our approach with baselines representative of training-from-scratch (the upper bound in terms of accuracy) and incremental training (the lower bound). Results show that rehearsal-based continual learning achieves a top-5 validation accuracy close to the upper bound, while simultaneously exhibiting a runtime close to the lower bound.

Asynchronous data management↗

JPSS-1/NOAA-20 VIIRS Early On-Orbit Geometric Performance

The first NOAA/NASA Join Polar Satellite System (JPSS-1) satellite was successfully launched on November 18, 2017,becoming NOAA-20. Instruments on-board the NOAA-20 satellite include the Visible Infrared Imaging RadiometerSuite (VIIRS). This instrument is the second build of VIIRS, with the first flight instrument on-board NASA/NOAASuomi National Polar-orbiting Partnership (SNPP) satellite operating since October 2011. The purpose of these VIIRSinstruments is to continue the long-term measurements of biogeophysical variables for multiple applications includingweather forecasting, rapid response and climate research. The geometric performance of VIIRS is essential to retrievingaccurate biogeophysical variables. This paper describes the early on-orbit geometric performance of the JPSS-1/NOAA-20 VIIRS. It first discusses the on-orbit orbit and attitude performance, a key input needed for accurate geolocation. Itthen discusses the on-orbit geometric characterization and calibration of VIIRS and an initial assessment of thegeometric accuracy. It follows with a discussion of an improvement in the instrument geometric model that correctssmall geometrical artifacts that appear in the along-scan direction. Finally, this paper discusses on-orbit measurements ofthe focal length and the impact of this on the scan-to-scan underlap/overlap.

Lin, Guoqing↗

Community RNA-Seq: multi-kingdom responses to living versus decaying roots in soil

Abstract Roots are a primary source of organic carbon input in most soils. The consumption of living and detrital root inputs involves multi-trophic processes and multiple kingdoms of microbial life, but typical microbial ecology studies focus on only one or two major lineages. We used Illumina shotgun RNA sequencing to conduct PCR-independent SSU rRNA community analysis (“community RNA-Seq”) and simultaneously assess the bacteria, archaea, fungi, and microfauna surrounding both living and decomposing roots of the annual grass, Avena fatua. Plants were grown in 13CO2-labeled microcosms amended with 15N-root litter to identify the preferences of rhizosphere organisms for root exudates (13C) versus decaying root biomass (15N) using NanoSIMS microarray imaging (Chip-SIP). When litter was available, rhizosphere and bulk soil had significantly more Amoebozoa, which are potentially important yet often overlooked top-down drivers of detritusphere community dynamics and nutrient cycling. Bulk soil containing litter was depleted in Actinobacteria but had significantly more Bacteroidetes and Proteobacteria. While Actinobacteria were abundant in the rhizosphere, Chip-SIP showed Actinobacteria preferentially incorporated litter relative to root exudates, indicating this group’s more prominent role in detritus elemental cycling in the rhizosphere. Our results emphasize that decomposition is a multi-trophic process involving complex interactions, and our methodology can be used to track the trajectory of carbon through multi-kingdom soil food webs.

Nuccio, Erin E. (ORCID:000000030189183X)↗

Grayscale Optical Correlator Workbench

Grayscale Optical Correlator Workbench (GOCWB) is a computer program for use in automatic target recognition (ATR). GOCWB performs ATR with an accurate simulation of a hardware grayscale optical correlator (GOC). This simulation is performed to test filters that are created in GOCWB. Thus, GOCWB can be used as a stand-alone ATR software tool or in combination with GOC hardware for building (target training), testing, and optimization of filters. The software is divided into three main parts, denoted filter, testing, and training. The training part is used for assembling training images as input to a filter. The filter part is used for combining training images into a filter and optimizing that filter. The testing part is used for testing new filters and for general simulation of GOC output. The current version of GOCWB relies on the mathematical software tools from MATLAB binaries for performing matrix operations and fast Fourier transforms. Optimization of filters is based on an algorithm, known as OT-MACH, in which variables specified by the user are parameterized and the best filter is selected on the basis of an average result for correct identification of targets in multiple test images.

Hanan, Jay↗