Reducing size and complexity of very large remote sensing data sets
Explore the source record for details and available documents.
complexity↗
SEARCH · Search NASA
Results for “Large data”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Public-Private Partnership: Joint Recommendations to Improve Downloads of Large Earth Observation Data
No abstract available
Data Systems↗
The Best Educational Tool for Interdisciplinary Earth Science Giovanni
Accessing and using NASA Earth science data has commonly presented a challenge to many educators and students, due to issues such as heterogeneous data formats, complex data structures, large volumes of data storage, special programming requirements, and diverse analytical software options that often require a significant investment in time and resources, especially for novices. By facilitating data access and evaluation, as well as promoting open access to create a more level playing field for non-funded scientists, NASA Earth observation data can be more readily used for scientific discovery and societal benefits. To advance this goal, the NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC) developed the Geospatial Interactive Online Visualization ANd aNalysis Infrastructure (Giovanni). To date, Giovanni has assisted researchers around the world publish over 1300 peer-reviewed papers in a wide range of Earth science disciplines. In this presentation, we will demonstrate how easy it is to use Giovanni for the rapid creation of many different analyses of both weather and climate events.
interdisciplinary↗
Effects of Mild Hypobaric Hypoxia on Visual Field Impairment
INTRODUCTION: The primary objective of the Exploration Atmosphere (EA) study is to validate a new prebreathe protocol necessary before exposure to a suited hypobaric environment during extravehicular activity (EVA) from a habitat ‘exploration atmosphere’ of 56.5kPa (8.2 psia), 34% O2, 66% N2. Prebreathe protocols must be time and resource efficient while also controlling Decompression Sickness (DCS) risk to within acceptable limits. The habitat hypobaric exploration atmosphere also results in a mildly hypoxic environment (piO2 = 128mmHg). As a secondary objective of the EA study, we characterized the effects of 11-day exposure to a mild hypobaric hypoxic environment on visual performance. METHODS: Two, 11-day hypobaric chamber tests were performed (EA-1and EA-2, n=8 each) in NASA’s 20-foot chamber at Johnson Space Center where subjects lived in the exploration atmosphere. Subjects also underwent simulated 6-hour EVAs at 85% O2 and 29.6 kPa during EVA on days 3, 5, 7, 9, and 11. Visual acuity (VA), a measure of spatial resolution, and contrast sensitivity (CS), a measure of ability to distinguish ever finer increments of brightness, were assessed on non-EVA days by using gapped Landolt C testing. The luminance was controlled by using a booth, a light monitor, and a lighting rheostat. EA-1 data had revealed problems in lighting control impacting consistency of the data. Procedures were subsequently updated for the EA-2 test. RESULTS: EA-1 data revealed large variance and data recording errors and was removed from the analysis. One participant left the study at Test Day 3 during EA-2. EA-2 ANOVA results showed CS (mean change=0.010 logCSWeber) and VA (mean change, -0.016 logMAR) between pre-test and 11-day test phases; however, neither VA nor CS changes were statistically significant. There were non-statistically significant declines in VA across test phases. DISCUSSION: Overall, visual field performance did not exhibit clinically significant changes (3 lines or greater change in LogMar chart) during exposure to the mild hypoxic exploration atmosphere environment compared to pre-test baseline. The consistency and stability of VA data during EA-2 suggests that the mild hypobaric hypoxic environment did not cause clinically significant negative impacts to participants’ visual field performance.
Visual Acuity↗
Effects of Mild Hypobaric Hypoxia on Visual Field Impairment
INTRODUCTION: The primary objective of the Exploration Atmosphere (EA) study is to validate a new prebreathe protocol necessary before exposure to a suited hypobaric environment during extravehicular activity (EVA) from a habitat ‘exploration atmosphere’ of 56.5kPa (8.2 psia), 34% O2, 66% N2. Prebreathe protocols must be time and resource efficient while also controlling Decompression Sickness (DCS) risk to within acceptable limits. The habitat hypobaric exploration atmosphere also results in a mildly hypoxic environment (piO2 = 128mmHg). As a secondary objective of the EA study, we characterized the effects of 11-day exposure to a mild hypobaric hypoxic environment on visual performance. METHODS: Two, 11-day hypobaric chamber tests were performed (EA-1and EA-2, n=8 each) in NASA’s 20-foot chamber at Johnson Space Center where subjects lived in the exploration atmosphere. Subjects also underwent simulated 6-hour EVAs at 85% O2 and 29.6 kPa during EVA on days 3, 5, 7, 9, and 11. Visual acuity (VA), a measure of spatial resolution, and contrast sensitivity (CS), a measure of ability to distinguish ever finer increments of brightness, were assessed on non-EVA days by using gapped Landolt C testing. The luminance was controlled by using a booth, a light monitor, and a lighting rheostat. EA-1 data had revealed problems in lighting control impacting consistency of the data. Procedures were subsequently updated for the EA-2 test. RESULTS: EA-1 data revealed large variance and data recording errors and was removed from the analysis. One participant left the study at Test Day 3 during EA-2. EA-2 ANOVA results showed CS (mean change=0.010 logCSWeber) and VA (mean change, -0.016 logMAR) between pre-test and 11-day test phases; however, neither VA nor CS changes were statistically significant. There were non-statistically significant declines in VA across test phases. DISCUSSION: Overall, visual field performance did not exhibit clinically significant changes (3 lines or greater change in LogMar chart) during exposure to the mild hypoxic exploration atmosphere environment compared to pre-test baseline. The consistency and stability of VA data during EA-2 suggests that the mild hypobaric hypoxic environment did not cause clinically significant negative impacts to participants’ visual field performance.
Visual Acuity↗
Using large-scale structure data and a halo model to constrain generalized dark matter
Explore the source record for details and available documents.
Daniel B Thomas↗
Lunar orbiter data analysis
Large Doppler residuals near pericynthion found in lunar orbiter tracking data
Lorell, J.↗
Volume server: A scalable high speed and high capacity magnetic tape archive architecture with concurrent multi-host access
A major challenge facing data processing centers today is data management. This includes the storage of large volumes of data and access to it. Current media storage for large data volumes is typically off line and frequently off site in warehouses. Access to data archived in this fashion can be subject to long delays, errors in media selection and retrieval, and even loss of data through misplacement or damage to the media. Similarly, designers responsible for architecting systems capable of continuous high-speed recording of large volumes of digital data are faced with the challenge of identifying technologies and configurations that meet their requirements. Past approaches have tended to evaluate the combination of the fastest tape recorders with the highest capacity tape media and then to compromise technology selection as a consequence of cost. This paper discusses an architecture that addresses both of these challenges and proposes a cost effective solution based on robots, high speed helical scan tape drives, and large-capacity media.
Rybczynski, Fred↗
A technique for extrapolating and validating forest cover across large regions - Calibrating AVHRR data with TM data
A method is presented for extending high-resolution forest cover information across large regions. Using Landsat TM data with AVHRR data, an empirical relationship beween AVHRR spectral signatures and forest cover is developed. The resulting regression equation is applied to an AVHRR scene covering a large area centered around southern Illinois. The map is used to estimate forest cover within a geographical information system. The results are compared with U.S. Forest Service estimates, showing good agreement.
Iverson, L. R.↗
Tools for Analysis and Visualization of Large Time-Varying CFD Data Sets
In the second year, we continued to built upon and improve our scanline-based direct volume renderer that we developed in the first year of this grant. This extremely general rendering approach can handle regular or irregular grids, including overlapping multiple grids, and polygon mesh surfaces. It runs in parallel on multi-processors. It can also be used in conjunction with a k-d tree hierarchy, where approximate models and error terms are stored in the nodes of the tree, and approximate fast renderings can be created. We have extended our software to handle time-varying data where the data changes but the grid does not. We are now working on extending it to handle more general time-varying data. We have also developed a new extension of our direct volume renderer that uses automatic decimation of the 3D grid, as opposed to an explicit hierarchy. We explored this alternative approach as being more appropriate for very large data sets, where the extra expense of a tree may be unacceptable. We also describe a new approach to direct volume rendering using hardware 3D textures and incorporates lighting effects. Volume rendering using hardware 3D textures is extremely fast, and machines capable of using this technique are becoming more moderately priced. While this technique, at present, is limited to use with regular grids, we are pursuing possible algorithms extending the approach to more general grid types. We have also begun to explore a new method for determining the accuracy of approximate models based on the light field method described at ACM SIGGRAPH '96. In our initial implementation, we automatically image the volume from 32 equi-distant positions on the surface of an enclosing tessellated sphere. We then calculate differences between these images under different conditions of volume approximation or decimation. We are studying whether this will give a quantitative measure of the effects of approximation. We have created new tools for exploring the differences between images produced by various rendering methods. Images created by our software can be stored in the SGI RGB format. Our idtools software reads in pair of images and compares them using various metrics. The differences of the images using the RGB, HSV, and HSL color models can be calculated and shown. We can also calculate the auto-correlation function and the Fourier transform of the image and image differences. We will explore how these image differences compare in order to find useful metrics for quantifying the success of various visualization approaches. In general, progress was consistent with our research plan for the second year of the grant.
Wilhelms, Jane↗
Investigation into Cloud Computing for More Robust Automated Bulk Image Geoprocessing
Geospatial resource assessments frequently require timely geospatial data processing that involves large multivariate remote sensing data sets. In particular, for disasters, response requires rapid access to large data volumes, substantial storage space and high performance processing capability. The processing and distribution of this data into usable information products requires a processing pipeline that can efficiently manage the required storage, computing utilities, and data handling requirements. In recent years, with the availability of cloud computing technology, cloud processing platforms have made available a powerful new computing infrastructure resource that can meet this need. To assess the utility of this resource, this project investigates cloud computing platforms for bulk, automated geoprocessing capabilities with respect to data handling and application development requirements. This presentation is of work being conducted by Applied Sciences Program Office at NASA-Stennis Space Center. A prototypical set of image manipulation and transformation processes that incorporate sample Unmanned Airborne System data were developed to create value-added products and tested for implementation on the "cloud". This project outlines the steps involved in creating and testing of open source software developed process code on a local prototype platform, and then transitioning this code with associated environment requirements into an analogous, but memory and processor enhanced cloud platform. A data processing cloud was used to store both standard digital camera panchromatic and multi-band image data, which were subsequently subjected to standard image processing functions such as NDVI (Normalized Difference Vegetation Index), NDMI (Normalized Difference Moisture Index), band stacking, reprojection, and other similar type data processes. Cloud infrastructure service providers were evaluated by taking these locally tested processing functions, and then applying them to a given cloud-enabled infrastructure to assesses and compare environment setup options and enabled technologies. This project reviews findings that were observed when cloud platforms were evaluated for bulk geoprocessing capabilities based on data handling and application development requirements.
Brown, Richard B.↗
Evaluation of the international reference ionosphere with the large AE-C and DE2 data bases
Empirical models such as the International Reference Ionosphere (IRI) are synthesized from large data bases. They can be viewed as analytical tools to facilitate accessing information stored in the data banks. However, in establishing the models, one has to apply smoothing and averaging procedures that in effect reduce the original information content. This study evaluates the agreement between the data base and the model at two opposite extremes of time resolution. Electron densities and temperatures in the altitude range of 300 to 400 km predicted by the IRI and measured by the AE-C and DE 2 satellites on the level of individual orbits as well as on the level of mission averages are compared. Whereas the averages show excellent agreement, the comparison for individual measurements indicates the limitations of empirical models.
Bilitza, D.↗
A Large-Grain Mapping Approach for Multiprocessor Systems Through Data Flow Model Ph.D. Thesis
A large-grain level mapping method is presented of numerical oriented applications onto multiprocessor systems. The method is based on the large-grain data flow representation of the input application and it assumes a general interconnection topology of the multiprocessor system. The large-grain data flow model was used because such representation best exhibits inherited parallelism in many important applications, e.g., CFD models based on partial differential equations can be presented in large-grain data flow format, very effectively. A generalized interconnection topology of the multiprocessor architecture is considered, including such architectural issues as interprocessor communication cost, with the aim to identify the 'best matching' between the application and the multiprocessor structure. The objective is to minimize the total execution time of the input algorithm running on the target system. The mapping strategy consists of the following: (1) large-grain data flow graph generation from the input application using compilation techniques; (2) data flow graph partitioning into basic computation blocks; and (3) physical mapping onto the target multiprocessor using a priority allocation scheme for the computation blocks.
Kim, Hwa-Soo↗
An interactive environment for the analysis of large Earth observation and model data sets
Envision is an interactive environment that provides researchers in the earth sciences convenient ways to manage, browse, and visualize large observed or model data sets. Its main features are support for the netCDF and HDF file formats, an easy to use X/Motif user interface, a client-server configuration, and portability to many UNIX workstations. The Envision package also provides new ways to view and change metadata in a set of data files. It permits a scientist to conveniently and efficiently manage large data sets consisting of many data files. It also provides links to popular visualization tools so that data can be quickly browsed. Envision is a public domain package, freely available to the scientific community. Envision software (binaries and source code) and documentation can be obtained from either of these servers: ftp://vista.atmos.uiuc.edu/pub/envision/ and ftp://csrp.tamu.edu/pub/envision/. Detailed descriptions of Envision capabilities and operations can be found in the User's Guide and Reference Manuals distributed with Envision software.
Bowman, Kenneth P.↗
Modern sampled-data control theory: Design of the Large Space Telescope
This investigation was undertaken to determine the effect of varying the sampling period on the dynamic response of the sampled-data Large Space Telescope (LST) system. A range of sampling periods was recommended based on the criterion that self-sustained oscillations are to be avoided in the LST system. The step responses of the LST system were then investigated when various sampling periods are used. For small sampling periods, the dynamic behavior of the sampled-data system is very similar to that of the continuous-data system. When T is large (but less than 0.25 sec) the overshoot of the step response of the sampled-data becomes greater. However, the dynamic behavior of the sampled-data system may be improved by redesigning the controller. It appears that a sampling period as high as 0.1 second is feasible for the LST system. However, it should be noted that the conclusions are obtained with the existing system model. Other practical considerations such as noise, coupling effects and quantization errors, may restrict the sampling period to a lower value.
Kuo, B. C.↗
Advances in systems for interactive processing and display of meteorological data
Advances in systems for interactive processing and display of meteorological data are reviewed, with particular attention given to developments in hardware and software, meteorological data base, analysis and display, and systems availability. These developments include inexpensive minicomputers which give the user almost instantaneous results for many types of jobs; image terminals with the capability to enhance, quantify, animate, and compare image and graphical data; accessibility of a large meteorological data base and the capability of merging different types of data; and sophisticated analysis and multidimensional display techniques. Critical problems still to be solved include getting quick access to historical and real time data bases from any system and making it easy to transport software from one system to another.
Hasler, A. F.↗
A Southern Hemisphere radar meteor orbit survey
A meteor radar system has been operated on a routine basis near Christchurch, New Zealand, to determine the orbits of Earth-impacting interplanetary dust and meteoroids. The system sensitivity is +13 visual magnitude, corresponding to approximately 100 micron sized meteoroids. With an orbital precision of 2 degrees in angular elements and 10 percent in orbital energy (1/a), the operation yields an average of 1500 orbits daily with a total to date in excess of 10(exp 5). The use of pc's and automated data reduction permit the large orbital data sets we collect to be routinely reduced. Some illustrative examples are presented of the signal formats/processing and the results of data reduction, giving the individual orbital elements and hence the overall distributions. Current studies include the distribution of dust in the inner solar system; the influx of meteoroids associated with near-Earth asteroids; and the orbital structure existing in comet-produced streams.
Baggaley, W. Jack↗
Automated Induction Of Rule-Based Neural Networks
Prototype expert systems implemented in software and are functionally equivalent to neural networks set up automatically and placed into operation within minutes following information-theoretic approach to automated acquisition of knowledge from large example data bases. Approach based largely on use of ITRULE computer program.
Smyth, Padhraic J.↗