Search NASA⌕ Search

SEARCH · Search NASA

Results for “Massive Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

A distributed analysis and visualization system for model and observational data

The objective of this proposal is to develop an integrated and distributed analysis and display software system which can be applied to all areas of the Earth System Science to study numerical model and earth observational data from storm to global scale. This system will be designed to be easy to use, portable, flexible and easily extensible and designed to adhere to current and emerging standards whenever possible. It will provide an environment for visualization of the massive amounts of data generated from satellites and other observational field measurements and from model simulations during or after their execution. Two- and three-dimensional animation will also be provided. This system will be based on a widely used software package from NASA called GEMPAK and prototype software for three-dimensional interactive displays built at NCSA. The underlying foundation of the system will be a set of software libraries which can be distributed across a UNIX based supercomputer and workstations.

Wilhelmson, Robert↗

Managing Complexity in Multidisciplinary Visualization

As high performance computing technology progresses, computational simulations are becoming more advanced in their capabilities. In the computational aerosciences domain, single discipline steady-state simulations computed on a single grid are far from the state-of-the-art. In their place are complex, time-dependent multidisciplinary simulations that attempt to model a given geometry more realistically. The product of these multidisciplinary simulations is a massive amount of data stored in different formats, grid topologies, units of measure, etc., as a result of the differences in the simulated physical domains. In addition to the challenges posed by setting up and performing the simulation, additional challenges exist in analyzing computational results. Visualization plays an important role in the advancement of multidisciplinary simulations. To date, visualization has been used to aid in the interpretation of large amounts of simulation data. Because the human visual system is effective in digesting a large amount of information presented graphically, visualization has helped simulation scientists to understand complex simulation results. As these simulations become even more complex, integrating several different physical domains, visualization will be critical to digest the massive amount of information. Another important role for visualization is to provide a common communication medium from which the domain scientists can use to develop, debug, and analyze their work. Multidisciplinary analyses are the next step in simulation technology, not only in computational aerosciences, but in many other areas such as global climate modeling. Visualization researchers must understand and work towards the challenges posed by multidisciplinary simulation scenarios. This paper addresses some of these challenges, describing technologies that must be investigated to create a useful visualization analysis tool for domain scientists.

Miceli, Kristina D.↗

Use of HSM with Relational Databases

Hierarchical storage management (HSM) systems have evolved to become a critical component of large information storage operations. They are built on the concept of using a hierarchy of storage technologies to provide a balance in performance and cost. In general, they migrate data from expensive high performance storage to inexpensive low performance storage based on frequency of use. The predominant usage characteristic is that frequency of use is reduced with age and in most cases quite rapidly. The result is that HSM provides an economical means for managing and storing massive volumes of data. Inherent in HSM systems is system managed storage, where the system performs most of the work with minimum operations personnel involvement. This automation is generally extended to include: backup and recovery, data duplexing to provide high availability, and catastrophic recovery through use of off-site storage.

Breeden, Randall↗

Image Stability Requirements For a Geostationary Imaging Fourier Transform Spectrometer (GIFTS)

A Geostationary Imaging Fourier Transform Spectrometer (GIFTS) has been selected for the NASA New Millennium Program (NMP) Earth Observing-3 (EO-3) mission. Our paper will discuss one of the key GIFTS measurement requirements, Field of View (FOV) stability, and its impact on required system performance. The GIFTS NMP mission is designed to demonstrate new and emerging sensor and data processing technologies with the goal of making revolutionary improvements in meteorological observational capability and forecasting accuracy. The GIFTS payload is a versatile imaging FTS with programmable spectral resolution and spatial scene selection that allows radiometric accuracy and atmospheric sounding precision to be traded in near real time for area coverage. The GIFTS sensor combines high sensitivity with a massively parallel spatial data collection scheme to allow high spatial resolution measurement of the Earth's atmosphere and rapid broad area coverage. An objective of the GIFTS mission is to demonstrate the advantages of high spatial resolution (4 km ground sample distance - gsd) on temperature and water vapor retrieval by allowing sampling in broken cloud regions. This small gsd, combined with the relatively long scan time required (approximately 10 s) to collect high resolution spectra from geostationary (GEO) orbit, may require extremely good pointing control. This paper discusses the analysis of this requirement.

Bingham, G. E.↗

Predicting the wet strength of laminates

Graphite/epoxy strengths at various moisture contents are estimated by extrapolating from small data base. With procedure, massive testing is unnecessary because advantage is taken of large data base already available for moisture content in laminates.

Bohlman, R. E.↗

System and Method for Monitoring Distributed Asset Data

A computer-based monitoring system and monitoring method implemented in computer software for detecting, estimating, and reporting the condition states, their changes, and anomalies for many assets. The assets are of same type, are operated over a period of time, and outfitted with data collection systems. The proposed monitoring method accounts for variability of working conditions for each asset by using regression model that characterizes asset performance. The assets are of the same type but not identical. The proposed monitoring method accounts for asset-to-asset variability; it also accounts for drifts and trends in the asset condition and data. The proposed monitoring system can perform distributed processing of massive amounts of historical data without discarding any useful information where moving all the asset data into one central computing system might be infeasible. The overall processing is includes distributed preprocessing data records from each asset to produce compressed data.

Gorinevsky, Dimitry↗

Archive Management of NASA Earth Observation Data to Support Cloud Analysis

NASA collects, processes and distributes petabytes of Earth Observation (EO) data from satellites, aircraft, in situ instruments and model output, with an order of magnitude increase expected by 2024. Cloud-based web object storage (WOS) of these data can simplify the execution of such an increase. More importantly, it can also facilitate user analysis of those volumes by making the data available to the massively parallel computing power in the cloud. However, storing EO data in cloud WOS has a ripple effect throughout the NASA archive system with unexpected challenges and opportunities. One challenge is modifying data servicing software (such as Web Coverage Service servers) to access and subset data that are no longer on a directly accessible file system, but rather in cloud WOS. Opportunities include refactoring of the archive software to a cloud-native architecture; virtualizing data products by computing on demand; and reorganizing data to be more analysis-friendly.

Lynnes, Christopher↗

Archive Management of NASA Earth Observation Data to Support Cloud Analysis

NASA collects, processes and distributes petabytes of Earth Observation (EO) data from satellites, aircraft, in situ instruments and model output, with an order of magnitude increase expected by 2024. Cloud-based web object storage (WOS) of these data can simplify the execution of such an increase. More importantly, it can also facilitate user analysis of those volumes by making the data available to the massively parallel computing power in the cloud. However, storing EO data in cloud WOS has a ripple effect throughout the NASA archive system with unexpected challenges and opportunities. One challenge is modifying data servicing software (such as Web Coverage Service servers) to access and subset data that are no longer on a directly accessible file system, but rather in cloud WOS. Opportunities include refactoring of the archive software to a cloud-native architecture; virtualizing data products by computing on demand; and reorganizing data to be more analysis-friendly. Reviewed by Mark McInerney ESDIS Deputy Project Manager.

Lynnes, Christopher↗

Tests of a simple data merging algorithm for the GONG project

The GONG (Global Oscillation Network Group) project proposes to reduce the impact of diurnal variations on helioseismic measurements by making long-term observations of solar images from six sites placed around the globe. The sun will be observed nearly constantly for three years, resulting in the acquisition of l+ terabyte of image data. To use the solar network to maximum advantage, the images from the sites must be combined into a single time series to determine mode frequencies, amplitudes, and line widths. Initial versions of combined, i.e., merged, time series were made using a simple weighted average of data from different sites taken simultaneously. In order to accurately assess the impact of the data merge on the helioseismic measurements, a set of artificial solar disk images was made using a standard solar model and containing a well known set of oscillation modes and frequencies. This undegraded data set and data products computed from it were used to judge the relative merits of various data merging schemes. The artificial solar disk images were subjected to various instrumental and atmospheric degradations, dependent on site and time, in order to create a set of images simulating those likely to be taken at the site. The degraded artificial solar disk images for the six observing sites were combined in various ways to form merged time series of images and mode coefficients. Various forms of a weighted average were used, including an equally-weighted average, an average with weights dependent upon air mass and averages with weights dependent on various quality assurance parameters. Both the undegraded solar disk image time series and several time series made up of various combinations of the degraded solar disk images from the six sites were subjected to standard helioseismic measurement processing. This processing consisted of coordinate remapping, detrending, spherical harmonic transformation, computation of power series for the oscillation mode coefficients, and mode frequency identification. Visual and statistical evaluation of the merged data sets themselves and differences between the merged and undegraded data set shows good agreement between the two data sets. Some slight differences in image scale and registration appear between the undegraded data set and the various merged data sets. In the set of power series made from the mode coefficients of the merged data sets, some power leakage is observed into the background and into slightly lower l-value modes, especially at higher l-value mode frequencies. The results of the comparison of time series and mode oscillation frequencies of the undegraded data with those of the data merged using weighted averages indicate that, at least for p-mode solar oscillations, a weighted average of either the detrended remapped images or the mode coefficients gives good determination of the mode frequencies and adequate-to-good determination of the amplitudes and widths of the mode frequency lines. This conclusion is most advantageous to the analysis of the massive amounts of data to be received by the GONG network.

Williams, W. E.↗

Mass storage: The key to success in high performance computing

There are numerous High Performance Computing & Communications Initiatives in the world today. All are determined to help solve some 'Grand Challenges' type of problem, but each appears to be dominated by the pursuit of higher and higher levels of CPU performance and interconnection bandwidth as the approach to success, without any regard to the impact of Mass Storage. My colleagues and I at Data Storage Technologies believe that all will have their performance against their goals ultimately measured by their ability to efficiently store and retrieve the 'deluge of data' created by end-users who will be using these systems to solve Scientific Grand Challenges problems, and that the issue of Mass Storage will become then the determinant of success or failure in achieving each projects goals. In today's world of High Performance Computing and Communications (HPCC), the critical path to success in solving problems can only be traveled by designing and implementing Mass Storage Systems capable of storing and manipulating the truly 'massive' amounts of data associated with solving these challenges. Within my presentation I will explore this critical issue and hypothesize solutions to this problem.

Lee, Richard R.↗

Hybrid Reduced Order Model for N2-N2 Interactions for Application to Dissociation and Energy Transfer Processes

Recent work in the aerothermodynamics community has focused on the development of reduced-order models for thermo-chemical non-equilibrium which avoid the restrictive assumptions of multi-temperature models and the prohibitive cost associated with State-to-State (StS) models. In the present work, this is accomplished by lumping energy states together and assuming groups of states are roughly in equilibrium. As a result, the non-equilibrium behavior of a gas can be captured at a reduced computational cost from a full StS simulation. In this work, we present a hybrid grouping model for studying energy transfer and dissociation in a mixture of nitrogen molecules due to N2-N2 reactions. This is accomplished by making use of a grouping strategy informed by data from the N2-N StS kinetic data. However, due to the massive computational cost associated with constructing StS data for the N2-N2 system, the kinetic data for the hybrid grouping model are calculated using the quasi-classical trajectory (QCT) method by sampling states for trajectory within the groups. This general framework is called the Maximum-Entropy Quasi-Classical Trajectory (ME-QCT) method. The primary challenge associated with this method is that rates for reverse grouped reactions cannot be obtained through detailed balance at a group level, due to the variation of group internal temperatures. To construct the full model for N2-N2 grouped kinetics using the ME-QCT method, detailed balance is invoked at the microscopic level, allowing for the calculation of the full kinetic data from QCT. Results will be presented using the full ME-QCT model for the N2-N2 system in an isothermal and isochoric reactor simulation. In addition, simple CFD test cases for a one-dimensional standing shock and for a quasi-one-dimensional nozzle will be used for demonstration of the ME-QCT method. This method allows for the calculation of non-equilibrium behavior for the N2-N2 system without the prohibitive cost of a full StS simulation. Moreover, it enables the construction of a unified model for the dissociating and recombining non-equilibrium flows.

nonequilibrium modeling↗

Software Development to Assist in the Processing and Analysis of Data Obtained Using Fiber Bragg Grating Interrogation Systems

A fiber Bragg grating is a portion of a core of a fiber optic strand that has been treated to affect the way light travels through the strand. Light within a certain narrow range of wavelengths will be reflected along the fiber by the grating, while light outside that range will pass through the grating mostly undisturbed. Since the range of wavelengths that can penetrate the grating depends on the grating itself as well as temperature and mechanical strain, fiber Bragg gratings can be used as temperature and strain sensors. This capability, along with the light-weight nature of the fiber optic strands in which the gratings reside, make fiber optic sensors an ideal candidate for flight testing and monitoring in which temperature and wing strain are factors. The purpose of this project is to research the availability of software capable of processing massive amounts of data in both real-time and post-flight settings, and to produce software segments that can be integrated to assist in the task as well.

Hicks, Rebecca↗

Structural Health Management for Future Aerospace Vehicles

Structural Health Management (SHM) will be of critical importance to provide the safety, reliability and affordability necessary for the future long duration space missions described in America's Vision for Space Exploration. Long duration missions to the Moon, Mars and beyond cannot be accomplished with the current paradigm of periodic, ground based structural integrity inspections. As evidenced by the Columbia tragedy, this approach is also inadequate for the current Shuttle fleet, thus leading to its initial implementation of on-board SHM sensing for impact detection as part of the return to flight effort. However, future space systems, to include both vehicles as well as structures such as habitation modules, will require an integrated array of onboard in-situ sensing systems. In addition, advanced data systems architectures will be necessary to communicate, store and process massive amounts of SHM data from large numbers of diverse sensors. Further, improved structural analysis and design algorithms will be necessary to incorporate SHM sensing into the design and construction of aerospace structures, as well as to fully utilize these sensing systems to provide both diagnosis and prognosis of structural integrity. Ultimately, structural integrity information will feed into an Integrated Vehicle Health Management (IVHM) system that will provide real-time knowledge of structural, propulsion, thermal protection and other critical systems for optimal vehicle management and mission control. This paper will provide an overview of NASA research and development in the area of SHM as well as to highlight areas of technology improvement necessary to meet these future mission requirements.

Prosser, W. H.↗

A Unique Test Facility to Measure Liner Performance with a Summary of Initial Test Results

A very ambitious study was initiated to obtain detailed acoustic and flow data with and without a liner in a duct containing a mean flow so that available theoretical models of duct liners can be validated. A unique flow-duct facility equipped with a sound source, liner box, flush-walled microphones, traversable microphones and traversable pressure and temperature probes was built. A unique set of instrumentation boxes equipped with computer controlled traverses were designed and built that allowed measurements of Mach number, temperature, SPLs and phases in two planes upstream of a liner section and two planes downstream at a large number of measurement points. Each pair of planes provided acoustic pressure gradients for use in estimating the particle velocities. Specially-built microphone probes were employed to make measurements in the presence of the flow. A microphone traverse was also designed to measure the distribution of SPLs and phases from the beginning of the liner to its end along the duct axis. All measurements were made with the help of cross-correlation techniques to reject flow noise and/or other obtrusive noise, if any. The facility was designed for future use at temperatures as high as 1500 F. In order to validate 2-D models in the presence of mean flow, the flow duct was equipped with a device to modify boundary layer flow on the smaller sides of a rectangular duct to simulate 2-D flow. A massive amount of data was acquired for use in validating duct liner models and will be provided to NASA in an electronic form. It was found that the sound in the plane-wave regime is well behaved within the duct and the results are repeatable from one run to another. At the higher frequencies corresponding to the higher-order modes, the SPLs within a duct are not repeatable from run to run. In fact, when two or more modes have the same frequency (i.e., for the degenerate modes), the SPLs in the duct varied between 2 dB to 12 dB from run to run. This made the calibration of the microphone probes extremely difficult at the higher frequencies.

Ahuja, K. K.↗

Value added data archiving

Researchers in the Molecular Sciences Research Center (MSRC) of Pacific Northwest Laboratory (PNL) currently generate massive amounts of scientific data. The amount of data that will need to be managed by the turn of the century is expected to increase significantly. Automated tools that support the management, maintenance, and sharing of this data are minimal. Researchers typically manage their own data by physically moving datasets to and from long term storage devices and recording a dataset's historical information in a laboratory notebook. Even though it is not the most efficient use of resources, researchers have tolerated the process. The solution to this problem will evolve over the next three years in three phases. PNL plans to add sophistication to existing multilevel file system (MLFS) software by integrating it with an object database management system (ODBMS). The first phase in the evolution is currently underway. A prototype system of limited scale is being used to gather information that will feed into the next two phases. This paper describes the prototype system, identifies the successes and problems/complications experienced to date, and outlines PNL's long term goals and objectives in providing a permanent solution.

Berard, Peter R.↗

Frameworks Coordinate Scientific Data Management

Jet Propulsion Laboratory computer scientists developed a unique software framework to help NASA manage its massive amounts of science data. Through a partnership with the Apache Software Foundation of Forest Hill, Maryland, the technology is now available as an open-source solution and is in use by cancer researchers and pediatric hospitals.

Source record↗

An interactive NASTRAN preprocessor

A Langley Research Center version of NASTRAN Level 15.1.0 designed to provide the analyst with an added tool for debugging massive NASTRAN input data is described. The program checks all NASTRAN input data cards and displays on a CRT the graphic representation of the undeformed structure. In addition, the program permits the display and alteration of input data and allows reexecution without physically resubmitting the job. Core requirements on the CDC 6000 computer are approximately 77,000 octal words of central memory.

Smith, W. W.↗

An analytical transformation for remote sensing of clear-column atmospheric temperature profiles

An exact analytical transformation is presented for the remote sensing of atmospheric temperature profiles in the presence of clouds. The transformation permits direct retrieval of clear-column temperature profiles without the need to predetermine the corresponding clear-column radiances. A numerical illustration is given for simulated observations in the 15 micron CO2 band in the terrestrial atmosphere. The resulting method is numerically very fast and is especially suitable for handling the massive amount of data needed for numerical weather prediction.

Chahine, M. T.↗