Search NASA⌕ Search

SEARCH · Search NASA

Results for “DISTRIBUTED DATA PROCESSING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

Documentation for the machine-readable character coded version of the SKYMAP catalogue

The SKYMAP catalogue is a compilation of astronomical data prepared primarily for purposes of attitude guidance for satellites. In addition to the SKYMAP Master Catalogue data base, a software package of data base management and utility programs is available. The tape version of the SKYMAP Catalogue, as received by the Astronomical Data Center (ADC), contains logical records consisting of a combination of binary and EBCDIC data. Certain character coded data in each record are redundant in that the same data are present in binary form. In order to facilitate wider use of all SKYMAP data by the astronomical community, a formatted (character) version was prepared by eliminating all redundant character data and converting all binary data to character form. The character version of the catalogue is described. The document is intended to fully describe the formatted tape so that users can process the data problems and guess work; it should be distributed with any character version of the catalogue.

Warren, W. H., Jr.↗

The 8.3 and 12.4 micron imaging of the Galactic Center source complex with the Goddard infrared array camera

A 30 x 30 arcsec field at the Galactic Center (1.5 x 1.5 parsec) was mapped at 8.3 microns and 12.41 microns with high spatial resolution and accurate relative astrometry, using the 16 x 16 Si:Bi accumulation mode charge injection device Goddard infrared array camera. The design and performance of the array camera detector electronics system and image data processing techniques are discussed. Color temperature and dust opacity distributions derived from the spatially accurate images indicate that the compact infrared sources and the large scale ridge structure are bounded by warmer, more diffuse material. None of the objects appear to be heated appreciably by internal luminosity sources. These results are consistent with the model proposing that the complex is heated externally by a strong luminosity source at the Galactic Center, which dominates the energetics of the inner few parsecs of the galaxy.

Gezari, D. Y.↗

8.3 and 12.4 micron imaging of the Galactic Center source complex with the Goddard infrared array camera

A 30 x 30 arcsec field at the Galactic Center (1.5 x 1.5 parsec) was mapped at 8.3 microns and 12.41 microns with high spatial resolution and accurate relative astrometry, using the 16 x 16 Si:Bi accumulation mode charge injection device Goddard infrared array camera. The design and performance of the array camera detector electronics system and image data processing techniques are discussed. Color temperature and dust opacity distributions derived from the spatially accurate images indicate that the compact infrared sources and the large scale ridge structure are bounded by warmer, more diffuse material. None of the objects appear to be heated appreciably by internal luminosity sources. These results are consistent with the model proposing that the complex is heated externally by a strong luminosity source at the Galactic Center, which dominates the energetics of the inner few parsecs of the galaxy.

Gezari, D. Y.↗

A distributed data acquisition system for aeronautics test facilities

The NASA Lewis Research Center is in the process of installing a new data acquisition and display system. This new system will provide small and medium sized aeronautics test facilities with a state-of-the-art real-time data acquisition and display system. The new data system will provide for the acquisition of signals from a variety of instrumentation sources. They include analog measurements of temperatures, pressures, and other steady state voltage inputs; frequency inputs to measure speed and flow; discrete I/O for significant events, and modular instrument systems such as multiplexed pressure modules or electronic instrumentation with a IEEE 488 interface. The data system is designed to acquire data, convert it to engineering units, compute test dependent performance calculations, limit check selected channels or calculations, and display the information in alphanumeric or graphical form with a cycle time of one second for the alphanumeric data. This paper describes the system configuration, its salient features, and the expected impact on testing.

Fronek, Dennis L.↗

A distributed data acquisition system for aeronautics test facilities

The NASA Lewis Research Center is in the process of installing a new data acquisition and display system. This new system will provide small and medium sized aeronautics test facilities with a state-of-the-art real-time data acquisition and display system. The new data system will provide for the acquisition of signals from a variety of instrumentation sources. They include analog measurements of temperatures, pressures, and other steady state voltage inputs; frequency inputs to measure speed and flow; discrete I/O for significant events, and modular instrument systems such as multiplexed pressure modules or electronic instrumentation with a IEEE 488 interface. The data system is designed to acquire data, convert it to engineering units, compute test dependent performance calculations, limit check selected channels or calculations, and display the information in alphanumeric or graphical form with a cycle time of one second for the alphanumeric data. This paper describes the system configuration, its salient features, and the expected impact on testing.

Fronek, Dennis L.↗

Smart structures research program at Virginia Tech

A review of the smart structures and avionics research and teaching program that started in 1979 at Virginia Tech is described. Current smart structures research include major efforts in the development of embedded and attached optical fiber and acoustic fiber sensors for cure monitoring, in-service lifetime structural testing, nondestructive evaluation, and impact and damage detection and analysis; of gradual material degradation; sensor signal multiplexing, processing and data handling to achieve near real-time distributed structural analysis; and the integration of embedded sensors, actuators and control electronics to achieve controlled structural response. Special campus facilities used for this work include an optical fiber fabrication facility, an autoclave for composite structure fabrication and curing, and laboratories for optical fiber sensor development, materials response and nondestructive evaluation, structural control testing and computer engineering.

Claus, R. O.↗

Simultaneous mapping of the unsteady flow fields by Particle Displacement Velocimetry (PDV)

Current experimental and computational techniques must be improved in order to advance the prediction capability of the longitudinal vortical flows shed by underwater vehicles. The generation, development, and breakdown mechanisms of the shed vortices at high Reynolds numbers are not fully understood. The ability to measure hull separated vortices associated with vehicle maneuvering does not exist at present. The existing point-by-point measurement techniques can only capture approximately the large 'mean' eddies but fail to meet the dynamics of small vortices during the initial stage of generation. A new technique, which offers a previously unavailable capability to measure the unsteady cross-flow distribution in the plane of the laser light sheet, is called Particle Displacement Velocimetry (PDV). PDV consists of illuminating a thin section of the flowfield with a pulsed laser. The water is seeded with microscopic, neutrally buoyant particles containing imbedded fluorescing dye which responds with intense spontaneous fluorescence with the illuminated section. The seeded particles in the vortical flow structure shed by the underwater vehicle are illuminated by the pulse laser and the corresponding particle traces are recorded in a single photographic frame. Two distinct approaches were utilized for determining the velocity distribution from the particle traces. The first method is based on matching the traces of the same particle and measuring the distance between them. The direction of the flow can be identified by keeping one of the pulses longer than the other. The second method is based on selecting a small window within the image and finding the mean shift of all the particles within that region. The computation of the auto-correlation of the intensity distribution within the selected sample window is used to determine the mean displacement of particles. The direction of the flow is identified by varying the intensity of the laser light between pulses. Considerable computational resources are required to compute the auto-correction of the intensity distribution. Parallel processing will be employed to speed up the data reduction. A few examples of measured unsteady vortical flow structures shed by the underwater vehicles will be presented.

Huang, Thomas T.↗

Applications of AVHRR-Derived Ice Motions for the Arctic and Antarctic

Characterization and diagnosis of sea ice/atmosphere/ocean interactions require a synthesis of observations and modeling to identify the key mechanisms controlling the ice/climate system. In this project, we combined product generation, observational analyses, and modeling to define and interpret variability in ice motion in conjunction with thermodynamic factors such as surface temperature and albedo. The goals of this work were twofold: (1) to develop and test procedures to produce an integrated set of polar products from remotely-sensed and supporting data; and (2) to apply these data to understand processes at work in controlling sea ice distribution.

Maslanik, James↗

JPL Global GPS Network

The research described in this viewgraph was carried out by the Jet Propulsion Laboratory (JPL), California Institute of Technology, under a contract with the National Aeronautics and Space Administration (NASA). JPL currently operates more than 55 permanent, continuously operating GPS ground stations for NASA many in conjunction with international and regional agencies. The data are automatically uploaded from the remote stations, processed, and distributed, with a high degree of reliability.

Moore, A. W.↗

Visual Computing Environment

The Visual Computing Environment (VCE) is a NASA Lewis Research Center project to develop a framework for intercomponent and multidisciplinary computational simulations. Many current engineering analysis codes simulate various aspects of aircraft engine operation. For example, existing computational fluid dynamics (CFD) codes can model the airflow through individual engine components such as the inlet, compressor, combustor, turbine, or nozzle. Currently, these codes are run in isolation, making intercomponent and complete system simulations very difficult to perform. In addition, management and utilization of these engineering codes for coupled component simulations is a complex, laborious task, requiring substantial experience and effort. To facilitate multicomponent aircraft engine analysis, the CFD Research Corporation (CFDRC) is developing the VCE system. This system, which is part of NASA's Numerical Propulsion Simulation System (NPSS) program, can couple various engineering disciplines, such as CFD, structural analysis, and thermal analysis. The objectives of VCE are to (1) develop a visual computing environment for controlling the execution of individual simulation codes that are running in parallel and are distributed on heterogeneous host machines in a networked environment, (2) develop numerical coupling algorithms for interchanging boundary conditions between codes with arbitrary grid matching and different levels of dimensionality, (3) provide a graphical interface for simulation setup and control, and (4) provide tools for online visualization and plotting. VCE was designed to provide a distributed, object-oriented environment. Mechanisms are provided for creating and manipulating objects, such as grids, boundary conditions, and solution data. This environment includes parallel virtual machine (PVM) for distributed processing. Users can interactively select and couple any set of codes that have been modified to run in a parallel distributed fashion on a cluster of heterogeneous workstations. A scripting facility allows users to dictate the sequence of events that make up the particular simulation.

Lawrence, Charles↗

Antarctic Iceberg Tracking Based on Time Series of Aqua AMSRE Microwave Brightness Temperature Measurements

Observations of icebergs are identified as one of the requirements for the GEOSS (Global Earth Observation System of Systems) in the area of reducing loss of life and property from natural and human-induced disasters. However, iceberg observations are not included among targets in the GEOSS 10-Year Implementation Plan, and thus there is an unfulfilled need for iceberg detection and tracking in the near future. Large Antarctic icebergs have been tracked by the National Ice Center and by the academic community using a variety of satellite sensors including both passive and active microwave imagers, such as SSM/I (Special Sensor Microwave/Imager) deployed on the DMSP (Defense Meteorological Satellite Program) spacecraft. Improvements provided in recent years by NASA and non-NASA satellite radars, scatterometers, and radiometers resulted in an increased number of observed icebergs and even prompted a question: Is The Number of Antarctic Icebergs Really Increasing? [D.G. Long, J. Ballantyne, and C. Bertoia, Eos, Transactions of the American Geophysical Union 83 (42): 469 & 474, 15 October 2002]. AMSR-E (Advanced Microwave Scanning Radiometer for the Earth Observing System) represents an improvement over SSM/I, its predecessor. AMSR-E has more measurement channels and higher spatial resolution than SSM/I. For example, the instantaneous field of view of the AMSR-E s 89-GHz channels is 6 km by 4 km versus 16 km by 14 km for SSM/I s comparable 85-GHz channels. AMSR-E, deployed on the Aqua satellite, scans across a 1450-km swath and provides brightness temperature measurements with nearglobal coverage every one or two days. In polar regions, overlapping swaths generate coverage up to multiple times per day and allow for creation of image time series with high temporal resolution. Despite these advantages, only incidental usage of AMSR-E data for iceberg tracking has been reported so far, none in an operational environment. Therefore, an experiment was undertaken in the RPC (Rapid Prototyping Capability) of NASA s (National Aeronautics and Space Administration) Applied Science Program to demonstrate that passive microwave brightness temperature measurements acquired by AMSR-E can be effectively used to track iceberg movement around Antarctica. The RPC s robust computation environment enabled processing of terabytes of data products available from the NASA Distributed Active Archive Center at the National Snow and Ice Data Center. Iceberg tracking based on the AMSR-E Level 2A data product was compared with records from the National Ice Center for currently existing icebergs. Some icebergs as small as roughly 10 km in size were easily observed, but tracking of many others, even larger ones, was obscured by presence of sea ice surrounding the icebergs. The best results, such as for the large iceberg A22A, were achieved when an iceberg was in open ocean.

Blonski, Slawomir↗

Achieving Fast Operational Intelligence in NASA's Deep Space Network Through Complex Event Processing

NASA’s Deep Space Network (DSN) is a complex, global project, in which the expertise of human operators remain crucial for its successful operation. To find ways to save costs in operations and to improve its services, a number of modernization efforts are underway in the DSN. One such effort is a research and technology development task at the Jet Propulsion Laboratory that is investigating the use of complex event processing (CEP) for intelligent assessment of situations, trend analysis, and advanced automation. The technology leverages the significant business intelligence (BI) and data science advancements made in the enterprise industries over the last several years. The open source big data processing engine Apache SparkTM and the high-throughput, distributed messaging system Apache Kafka form the core of the DSN Complex Event Processing (DCEP) framework. This paper discusses the system engineering perspective of why achieving efficient, lower-cost operations in the DSN is a challenging problem, how the DCEP system handles the use cases that help realize intelligent operations, and how this solution fits into the overall model of the planned DSN Follow-the- Sun Operations (FtSO).

Choi, Joshua S.↗

Transforming Energy Through Computational Excellence: Advanced Scientific Visualization Reveals Energy Insights

The National Renewable Energy Laboratory's world-class researchers and analysts, along with the Insight Center (our state-of-the-art scientific visualization facility) make data immersion a reality, allowing users to step into and explore their data. With the rise of large, diverse, and distributed data sets, scientific visualization is now critical to the process of scientific discovery and to managing and analyzing data and extracting insights. NREL provides visualization capabilities and facilities that are supported by state-of-the-art equipment, leading-edge techniques, and expert staff.

data science↗

Improving CASINO performance for models with large number of electrons

Quantum Monte Carlo calculations have at their core algorithms based on statistical ensembles of multidimensional random walkers which are straightforward to use on parallel computers. Nevertheless some computations have reached the limit of the memory resources for models with more than 1000 electrons because of the need to store a large amount of electronic orbitals related data. Besides that, for systems with large number of electrons, it is interesting to study if the evolution of one configuration of random walkers can be done faster in parallel. We present a comparative study of two ways to solve these problems: (1) distributed orbital data done with MPI or Unix inter-process communication tools, (2) second level parallelism for configuration computation.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Field testing of modular borehole monitoring with simultaneous distributed acoustic sensing and geophone vertical seismic profiles at Citronelle, Alabama: Field testing of MBM

A modular borehole monitoring concept has been implemented to provide a suite of well-based monitoring tools that can be deployed cost effectively in a flexible and robust package. The initial modular borehole monitoring system was deployed as part of a CO 2 injection test operated by the Southeast Regional Carbon Sequestration Partnership near Citronelle, Alabama. The Citronelle modular monitoring system transmits electrical power and signals, fibre-optic light pulses, and fluids between the surface and a reservoir. Additionally, a separate multi-conductor tubing-encapsulated line was used for borehole geophones, including a specialized clamp for casing clamping with tubing deployment. The deployment of geophones and fibre-optic cables allowed comparison testing of distributed acoustic sensing. We designed a large source effort (>64 sweeps per source point) to test fibre-optic vertical seismic profile and acquired data in 2013. The native measurement in the specific distributed acoustic sensing unit used (an iDAS from Silixa Ltd) is described as a localized strain rate. Following a processing flow of adaptive noise reduction and rebalancing the signal to dimensionless strain, improvement from repeated stacking of the source was observed. Conversion of the rebalanced strain signal to equivalent velocity units, via a scaling by local apparent velocity, allows quantitative comparison of distributed acoustic sensing and geophone data in units of velocity. We see a very good match of uncorrelated time series in both amplitude and phase, demonstrating that velocity-converted distributed acoustic sensing data can be analyzed equivalent to vertical geophones. We show that distributed acoustic sensing data, when averaged over an interval comparable to typical geophone spacing, can obtain signal-to-noise ratios of 18 dB to 24 dB below clamped geophones, a result that is variable with noise spectral amplitude because the noise characteristics are not identical. With vertical seismic profile processing, we demonstrate the effectiveness of downgoing deconvolution from the large spatial sampling of distributed acoustic sensing data, along with improved upgoing reflection quality. finally, we conclude that the extra source effort currently needed for tubing-deployed distributed acoustic sensing vertical seismic profile, as part of a modular monitoring system, is well compensated by the extra spatial sampling and lower deployment cost as compared with conventional borehole geophones.

58 GEOSCIENCES↗

Geologic evidence of hotspot activity of Venus - Predictions for Magellan

A number of distinctive types of geologic features have been identified on Venus that are interpreted to be related to thermal plumes including domal rises, coronae, and major composite shield volcanoes. The basic characteristics of these features as well as their distribution are documented. The three types of features have related morphologies and are interpreted to represent a continuum of features formed by mantle plumes at scales from 100s to over 1000 km. The Artemis structure, located in Aphrodite Terra, is proposed to be a large corona. If crustal spreading processes are operating on Venus, hotspot features should form chains on the surface as seen in terrestrial ocean basins. On the basis of current data on hotspot-related feature distribution on Venus, no clear evidence exists for hotspot chains. The complete distribution of hotspot features in Magellan data will be used to understand better the relationship between interior processes and surface features, as well as to provide a test for the crustal spreading hypothesis.

Stofan, Ellen R.↗

Custom Accessors: Enabling Scalable Data Ingestion, (Re-)Organization, and Analysis on Distributed Systems

The emerging class of high velocity and high volume data analytic workflows comprise interwoven data ingestion, organization, and processing stages, with ingestion and organization steps often contributing comparable or even higher computational costs than actual processing steps. Since complex workflows consist of a variety of phases that view and use data differently, being able to construct efficient, scalable, distributed data structures (arrays, vectors, sets, maps, and multi-maps) is essential and requires custom methods to extend and shrink containers, analyze and position data, and, maintain globallyconsistent meta-data. In this paper, we propose a novel datastructure access paradigm based on the concept of Accessors. At a high level, accessors are customizable callable objects that can modify the behavior of insert, read, update, and delete operations for distributed containers while preserving atomicity guarantees. Accessors provide a very clean and natural way to implement a variety of programming patterns, e.g., conditional insertion/deletion and cascading computations, which would be otherwise hard (or even impossible) to express in parallel and distributed settings without using locks. We demonstrate the practicality and usefulness of our approach with two representative use cases and study the performance of these applications on a distributed High-Performance Computing system. Our analysis highlights that our proposed abstraction allows for an effective overlapping and concurrent execution of different workflow steps (e.g., data ingestion and analysis), which in a conventional analytics pipeline would execute sequentially, contributing cumulatively to the overall latency.

Castellana, Vito G. [BATTELLE (PACIFIC NW LAB)] (O↗

The effects of correlation on goodness of fit

Autocorrelated normal random variates were generated via computer and the effects of various levels of correlation on goodness of fit problems were studied. The results are useful in determining the distribution or estimating the parameters of populations that correlate observations such as wind speeds and temperature. The model used to generate the autocorrelated data is an autoregressive process of order 1. The Kolmogorov-Smirnov and chi-square statistics are used in the analysis. It was observed in the simulation that high positive correlations tend to shift the sample mean away from the population mean and negative correlations tend to shift the sample mean towards the population mean. In many cases, it was observed that positive and negative correlations tend to decrease the standard deviation. However, since this did not occur in all cases, no definite conclusion can be made regarding the standard deviation. Since the autoregressive process is a linear transformation, it is not surprising that normality was preserved. However, a possible extension of this problem could be to generate non-normal data and observe how the distribution is affected by correlation. Another extension might utilize another model such as autoregressive of order k or a moving average process of order k.

Kitchens, L. J.↗