Search NASA⌕ Search

SEARCH · Search NASA

Results for “data intensive computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Arithmetic Data Cube as a Data Intensive Benchmark

Data movement across computational grids and across memory hierarchy of individual grid machines is known to be a limiting factor for application involving large data sets. In this paper we introduce the Data Cube Operator on an Arithmetic Data Set which we call Arithmetic Data Cube (ADC). We propose to use the ADC to benchmark grid capabilities to handle large distributed data sets. The ADC stresses all levels of grid memory by producing 2d views of an Arithmetic Data Set of d-tuples described by a small number of parameters. We control data intensity of the ADC by controlling the sizes of the views through choice of the tuple parameters.

Frumkin, Michael A.↗

Maximum a posteriori classification of multifrequency, multilook, synthetic aperture radar intensity data

We present a maximum a posteriori (MAP) classifier for classifying multifrequency, multilook, single polarization SAR intensity data into regions or ensembles of pixels of homogeneous and similar radar backscatter characteristics. A model for the prior joint distribution of the multifrequency SAR intensity data is combined with a Markov random field for representing the interactions between region labels to obtain an expression for the posterior distribution of the region labels given the multifrequency SAR observations. The maximization of the posterior distribution yields Bayes's optimum region labeling or classification of the SAR data or its MAP estimate. The performance of the MAP classifier is evaluated by using computer-simulated multilook SAR intensity data as a function of the parameters in the classification process. Multilook SAR intensity data are shown to yield higher classification accuracies than one-look SAR complex amplitude data. The MAP classifier is extended to the case in which the radar backscatter from the remotely sensed surface varies within the SAR image because of incidence angle effects. The results obtained illustrate the practicality of the method for combining SAR intensity observations acquired at two different frequencies and for improving classification accuracy of SAR data.

Rignot, E.↗

Enabling Earth Science: The Facilities and People of the NCCS

The NCCS's mass data storage system allows scientists to store and manage the vast amounts of data generated by these computations, and its high-speed network connections allow the data to be accessed quickly from the NCCS archives. Some NCCS users perform studies that are directly related to their ability to run computationally expensive and data-intensive simulations. Because the number and type of questions scientists research often are limited by computing power, the NCCS continually pursues the latest technologies in computing, mass storage, and networking technologies. Just as important as the processors, tapes, and routers of the NCCS are the personnel who administer this hardware, create and manage accounts, maintain security, and assist the scientists, often working one on one with them.

Source record↗

GLIDE: a grid-based light-weight infrastructure for data-intensive environments

The promise of the grid is that it will enable public access and sharing of immense amounts of computational and data resources among dynamic coalitions of individuals and institutions. However, the current grid solutions make several limiting assumptions that curtail their widespread adoption. To address these limitations, we present GLIDE, a prototype light-weight, data-intensive middleware infrastructure that enables access to the robust data and computational power of the grid on DREAM platforms.

PRISM-MW↗

DeepSAT: A Deep Learning Approach to Tree-Cover Delineation in 1-m NAIP Imagery for the Continental United States

High resolution tree cover classification maps are needed to increase the accuracy of current land ecosystem and climate model outputs. Limited studies are in place that demonstrates the state-of-the-art in deriving very high resolution (VHR) tree cover products. In addition, most methods heavily rely on commercial softwares that are difficult to scale given the region of study (e.g. continents to globe). Complexities in present approaches relate to (a) scalability of the algorithm, (b) large image data processing (compute and memory intensive), (c) computational cost, (d) massively parallel architecture, and (e) machine learning automation. In addition, VHR satellite datasets are of the order of terabytes and features extracted from these datasets are of the order of petabytes. In our present study, we have acquired the National Agriculture Imagery Program (NAIP) dataset for the Continental United States at a spatial resolution of 1-m. This data comes as image tiles (a total of quarter million image scenes with ~60 million pixels) and has a total size of ~65 terabytes for a single acquisition. Features extracted from the entire dataset would amount to ~8-10 petabytes. In our proposed approach, we have implemented a novel semi-automated machine learning algorithm rooted on the principles of "deep learning" to delineate the percentage of tree cover. Using the NASA Earth Exchange (NEX) initiative, we have developed an end-to-end architecture by integrating a segmentation module based on Statistical Region Merging, a classification algorithm using Deep Belief Network and a structured prediction algorithm using Conditional Random Fields to integrate the results from the segmentation and classification modules to create per-pixel class labels. The training process is scaled up using the power of GPUs and the prediction is scaled to quarter million NAIP tiles spanning the whole of Continental United States using the NEX HPC supercomputing cluster. An initial pilot over the state of California spanning a total of 11,095 NAIP tiles covering a total geographical area of 163,696 sq. miles has produced true positive rates of around 88 percent for fragmented forests and 74 percent for urban tree cover areas, with false positive rates lower than 2 percent for both landscapes.

Imagery↗

Development of an Efficient Binaural Simulation for the Analysis of Structural Acoustic Data

Applying binaural simulation techniques to structural acoustic data can be very computationally intensive as the number of discrete noise sources can be very large. Typically, Head Related Transfer Functions (HRTFs) are used to individually filter the signals from each of the sources in the acoustic field. Therefore, creating a binaural simulation implies the use of potentially hundreds of real time filters. This paper details two methods of reducing the number of real-time computations required by: (i) using the singular value decomposition (SVD) to reduce the complexity of the HRTFs by breaking them into dominant singular values and vectors and (ii) by using equivalent source reduction (ESR) to reduce the number of sources to be analyzed in real-time by replacing sources on the scale of a structural wavelength with sources on the scale of an acoustic wavelength. The ESR and SVD reduction methods can be combined to provide an estimated computation time reduction of 99.4% for the structural acoustic data tested. In addition, preliminary tests have shown that there is a 97% correlation between the results of the combined reduction methods and the results found with the current binaural simulation techniques

Johnson, Marty E.↗

Spontaneous emission from ScF in a supersonic mixing flame

An investigation was conducted of the two reactions: Sc + F2 yields ScF(asterisk) + F and Y + Cl2 yields YCl(asterisk) + Cl. Experiments were designed for studying the reactions under the relatively high pressure conditions (5-20 torr) appropriate for chemical laser operation. A shock tube was used to provide a short duration flow through a supersonic nozzle array. Shock wave heating is used to dissociate the ScCl3 or YCl3 at temperatures of about 6000 K, before the gases are accelerated and expanded through the supersonic nozzle array. The expanded primary flow is then mixed with a secondary flow of F2 introduced through slots at the trailing edge of each nozzle blade. Graphs show the temporal behavior of the visible spontaneous emission over the range from 3000 to 9000 A for a typical test condition, a microdensitometer tracing of the visible emission over the range from 4000 to 7000 A, and the spontaneous emission from ScF(asterisk) obtained by computer image processing of intensity data.

Fischell, D. R.↗

Application of Reconfigurable Computing Technology to Multi-KiloHertz Micro-Laser Altimeter (MMLA) Data Processing

The Multi-KiloHertz Micro-Laser Altimeter (MMLA) is an aircraft based instrument developed by NASA Goddard Space Flight Center with several potential spaceflight applications. This presentation describes how reconfigurable computing technology was employed to perform MMLA signal extraction in real-time under realistic operating constraints. The MMLA is a "single-photon-counting" airborne laser altimeter that is used to measure land surface features such as topography and vegetation canopy height. This instrument has to date flown a number of times aboard the NASA P3 aircraft acquiring data at a number of sites in the Mid-Atlantic region. This instrument pulses a relatively low-powered laser at a very high rate (10 kHz) and then measures the time-of-flight of discrete returns from the target surface. The instrument then bins these measurements into a two-dimensional array (vertical height vs. horizontal ground track) and selects the most likely signal path through the array. Return data that does not correspond to the selected signal path are classified as noise returns and are then discarded. The MMLA signal extraction algorithm is very compute intensive in that a score must be computed for every possible path through the two dimensional array in order to select the most likely signal path. Given a typical array size with 50 x 6, up to 33 arrays must be processed per second. And for each of these arrays, roughly 12,000 individual paths must be scored. Furthermore, the number of paths increases exponentially with the horizontal size of the array, and linearly with the vertical size. Yet, increasing the horizontal and vertical sizes of the array offer science advantages such as improved range, resolution, and noise rejection. Due to the volume of return data and the compute intensive signal extraction algorithm, the existing PC-based MMLA data system has been unable to perform signal extraction in real-time unless the array is limited in size to one column, This limits the ability of the MMLA to operate in environments with sparse signal returns and a high number of noise return. However, under an IR&D project, an FPGA-based, reconfigurable computing data system has been developed that has been demonstrated to perform real-time signal extraction under realistic operating constraints. This reconfigurable data system is based on the commercially available Firebird Board from Annapolis Microsystems. This PCI board consists of a Xilinx Virtex 2000E FPGA along with 36 MB of SRAM arranged in five separately addressable banks. This board is housed in a rackmount PC with dual 850MHz Pentium processors running the Windows 2000 operating system. This data system performs all signal extraction in hardware on the Firebird, but also runs the existing "software based" signal extraction in tandem for comparison purposes. Using a relatively small amount of the Virtex XCV2000E resources, the reconfigurable data system has demonstrated to improve performance improvement over the existing software based data system by an order of magnitude. Performance could be further improved by employing parallelism. Ground testing and a preliminary engineering test flight aboard the NASA P3 has been performed, during which the reconfigurable data system has been demonstrated to match the results of the existing data system.

Powell, Wesley↗

Ultraviolet continuum absorption /less than about 1000 A/ above the quiet sun transition region

Lyman continuum absorption shortward of 912 A in the quiet sun solar transition region is investigated by combining spectra obtained from the Apollo Telescope Mount experiments on Skylab. The most recent atomic data are used to compute line intensities for lines that fall on both sides of the Lyman limit. Lines of O III, O IV, O V, and S IV are considered. The computed intensity ratios of most lines from O IV, O V, and S IV agree with the experimental ratios to within a factor of 2. However, the discrepancies show no apparent wavelength dependence. From this fact, it is concluded that at least part of the discrepancy between theory and observation for lines of these ions can be accounted for by uncertainties in instrumental calibration and atomic data. However, difficulties remain in reconciling observation and theory, particularly for lines of O III, and one line of S IV. The other recent results of Schmahl and Orrall (1979) are also discussed in terms of newer atomic data.

Doschek, G. A.↗

An Improved Wake Vortex Tracking Algorithm for Multiple Aircraft

The accurate tracking of vortex evolution from Large Eddy Simulation (LES) data is a complex and computationally intensive problem. The vortex tracking requires the analysis of very large three-dimensional and time-varying datasets. The complexity of the problem is further compounded by the fact that these vortices are embedded in a background turbulence field, and they may interact with the ground surface. Another level of complication can arise, if vortices from multiple aircrafts are simulated. This paper presents a new technique for post-processing LES data to obtain wake vortex tracks and wake intensities. The new approach isolates vortices by defining "regions of interest" (ROI) around each vortex and has the ability to identify vortex pairs from multiple aircraft. The paper describes the new methodology for tracking wake vortices and presents application of the technique for single and multiple aircraft.

Switzer, George F.↗

The Estimation Surface Latent Heat Flux Over the Ocean and its Relationship to Marine Atmospheric Boundary Layer (MABL) Structure

A new technique combining active and passive remote sensing instruments for the estimation of surface latent heat flux over the ocean is presented. This synergistic method utilizes aerosol lidar backscatter data, multi-channel infrared radiometer data and microwave scatterometer data acquired onboard the NASA P-3B research aircraft during an extended field campaign over the Atlantic ocean in support of the Lidar In-space Technology Experiment (LITE) in September of 1994. The 10 meter wind speed derived from the scatterometers and the lidar-radiometer inferred near-surface moisture are used to obtain an estimate of the surface flux of moisture via bulk aerodynamic formulae. The results are compared with the Special Sensor Microwave Imager (SSM/I) daily average latent heat flux and show reasonable agreement. However, the SSM/I values are biased high by about 30 W/sq m. In addition, the MABL height, entrainment zone thickness and integrated lidar backscatter intensity are computed from the lidar data and compared with the magnitude of the surface fluxes. The results show that the surface latent heat flux is most strongly correlated with entrainment zone top, bottom and the integrated MABL lidar backscatter, with corresponding correlation coefficients of 0.62, 0.67 and 0.61, respectively.

Palm, Stephen P.↗

The Estimation of Surface Latent Heat Flux over the Ocean and its Relationship to Marine Atmospheric Boundary Layer (MABL) Structure

A new technique combining active and passive remote sensing instruments for the estimation of surface latent heat flux over the ocean is presented. This synergistic method utilizes aerosol lidar backscatter data, multi-channel infrared radiometer data, and microwave scatterometer data acquired onboard the NASA P-313 research aircraft during an extended field campaign over the Atlantic ocean in support of the Lidar In-space Technology Experiment (LITE) in September of 1994. The 10 meter wind speed derived from scatterometers and lidar-radiometer inferred near-surface moisture are used to obtain an estimate of the surface flux of moisture via a bulk aerodynamic formula. The results are compared with the Special Sensor Microwave Imager (SSM/I) daily average latent heat flux and show reasonable agreement. However, the SSM/I values are biased low by about 15 W/sq m. In addition, the Marine Atmospheric Boundary Layer (MABL) height, entrainment zone thickness and integrated lidar backscatter intensity are computed from the lidar data and compared with the magnitude of the surface fluxes. The results show that the surface latent heat flux is most strongly correlated with entrainment zone depth, MABL height and the integrated MABL lidar backscatter, with corresponding correlation coefficients of 0.39, 0.43 and 0.71, respectively.

Palm, Stephen P.↗

The Estimation of Surface Latent Heat Flux Over the Ocean and its Relationship to Marine Atmospheric Boundary Layer (MABL) Structure

A new technique combining active and passive remote sensing instruments for the estimation of surface latent heat flux over the ocean is presented. This synergistic method uses aerosol lidar backscatter data, multi-channel infrared radiometer data and microwave scatterometer data acquired onboard the NASA P-3B research aircraft during an extended field campaign over the Atlantic ocean in support of the Lidar In-space Technology Experiment (LITE) in September of 1994. The 10 meter wind speed derived from the scatterometers and the lidar-radiometer inferred near-surface moisture are used to obtain an estimate of the surface flux of moisture via bulk aerodynamic formulae. The results are compared with the Special Sensor Microwave Imager (SSM/I) daily average latent heat flux and show reasonable agreement with an rms error and bias of about 50 and 25 W per square meters, respectively. In addition, the MABL height, entrainment zone thickness and integrated lidar backscatter intensity are computed from the lidar data and compared with the magnitude of the surface fluxes. The results show that the surface latent heat flux is most strongly correlated with entrainment zone top, bottom and the integrated MABL lidar backscatter, with corresponding correlation coefficients of 0.62, 0.67 and 0.61, respectively.

Palm, Stephen P.↗

Application of the Convolution Formalism to the Ocean Tide Potential: Results from the Gravity and Recovery and Climate Experiment (GRACE)

A computationally efficient approach to reducing omission errors in ocean tide potential models is derived and evaluated using data from the Gravity Recovery and Climate Experiment (GRACE) mission. Ocean tide height models are usually explicitly available at a few frequencies, and a smooth unit response is assumed to infer the response across the tidal spectrum. The convolution formalism of Munk and Cartwright (1966) models this response function with a Fourier series. This allows the total ocean tide height, and therefore the total ocean tide potential, to be modeled as a weighted sum of past, present, and future values of the tide-generating potential. Previous applications of the convolution formalism have usually been limited to tide height models, but we extend it to ocean tide potential models. We use luni-solar ephemerides to derive the required tide-generating potential so that the complete spectrum of the ocean tide potential is efficiently represented. In contrast, the traditionally adopted harmonic model of the ocean tide potential requires the explicit sum of the contributions from individual tidal frequencies. It is therefore subject to omission errors from neglected frequencies and is computationally more intensive. Intersatellite range rate data from the GRACE mission are used to compare convolution and harmonic models of the ocean tide potential. The monthly range rate residual variance is smaller by 4-5%, and the daily residual variance is smaller by as much as 15% when using the convolution model than when using a harmonic model that is defined by twice the number of parameters.

models↗

Ground-based detection of stratospheric ClO and average column density measurement over 17 days of observation

A very sensitive mm-wave heterodyne receiver of a type originally developed for radio astronomy is used in combination with a broadband filter bank spectrometer to detect and measure the 204-GHz rotational transition of stratospheric ClO. Data is acquired in the form of a dimensionless ratio and is converted to units expressing signal intensity. Computed line shapes are matched against the data for a comparison with theoretical stratospheric models and previous measurements. The ClO distribution in the stratosphere measured at 42 deg N latitude in early spring is significantly different from that expected based on existing theoretical models. There is much less ClO at latitudes below about 36 km than predicted, and average ClO column density found for 42 deg N is 20-30% less than that from existing balloon flight measurements at 32 deg N.

Dezafra, R.↗

Turbulence in planetary occultations. IV - Power spectra of phase and intensity fluctuations

Power spectra of phase and intensity scintillations during occultation by turbulent planetary atmospheres are significantly affected by the inhomogeneous background upon which the turbulence is superimposed. Such coupling is particularly pronounced in the intensity, where there is also a marked difference in spectral shape between a central and grazing occultation. While the former has its structural features smoothed by coupling to the inhomogeneous background, such features are enhanced in the latter. Indeed, the latter power spectrum peaks around the characteristic frequency that is determined by the size of the free-space Fresnel zone and the ray velocity in the atmosphere; at higher frequencies strong fringes develop in the power spectrum. A confrontation between the theoretical scintillation spectra computed here and those calculated from the Mariner 5 Venus mission by Woo et al. (1974) is inconclusive, mainly because of insufficient statistical resolution. Phase and/or intensity power spectra computed from occultation data may be used to deduce characteristics of the turbulence and to distinguish turbulence from other perturbations in the refractive index. Such determinations are facilitated if observations are made at two or more frequencies (radio occultation) or in two or more colors (stellar occultation).

Haugstad, B. S.↗

F.T. spectroscopy of OH produced in a microwave surface plasma

Emission spectra of the hydroxyl radical have been recorded between 450 and 4200/cm at 0.0027/cm unapodized resolution from an air+oxygen+water vapor plasma, using a surface microwave discharge. The characteristics of the source are described. The emission spectra were recorded with the F.T. spectrometer using a GeCu detector and KCl beams plitter. High J values were observed both for the pure rotational transition in v=0 and v=1 vibrational levels, and for the rovibrational transition in the 0-1 and 1-2 bands. The set of line intensity data will be used to compute the electric dipole moment function of OH.

Benidar, A.↗

Finite Element Analysis of Reverberation Chambers

The primary motivating factor behind the initiation of this work was to provide a deterministic means of establishing the validity of the statistical methods that are recommended for the determination of fields that interact in -an avionics system. The application of finite element analysis to reverberation chambers is the initial step required to establish a reasonable course of inquiry in this particularly data-intensive study. The use of computational electromagnetics provides a high degree of control of the "experimental" parameters that can be utilized in a simulation of reverberating structures. As the work evolved there were four primary focus areas they are: 1. The eigenvalue problem for the source free problem. 2. The development of a complex efficient eigensolver. 3. The application of a source for the TE and TM fields for statistical characterization. 4. The examination of shielding effectiveness in a reverberating environment. One early purpose of this work was to establish the utility of finite element techniques in the development of an extended low frequency statistical model for reverberation phenomena. By employing finite element techniques, structures of arbitrary complexity can be analyzed due to the use of triangular shape functions in the spatial discretization. The effects of both frequency stirring and mechanical stirring are presented. It is suggested that for the low frequency operation the typical tuner size is inadequate to provide a sufficiently random field and that frequency stirring should be used. The results of the finite element analysis of the reverberation chamber illustrate io-W the potential utility of a 2D representation for enhancing the basic statistical characteristics of the chamber when operating in a low frequency regime. The basic field statistics are verified for frequency stirring over a wide range of frequencies. Mechanical stirring is shown to provide an effective frequency deviation.

Bunting, Charles F.↗