Search NASA⌕ Search

SEARCH · Search NASA

Results for “Large data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Methods and apparatus for extraction and tracking of objects from multi-dimensional sequence data

An object tracking technique is provided which, given: (i) a potentially large data set; (ii) a set of dimensions along which the data has been ordered; and (iii) a set of functions for measuring the similarity between data elements, a set of objects are produced. Each of these objects is defined by a list of data elements. Each of the data elements on this list contains the probability that the data element is part of the object. The method produces these lists via an adaptive, knowledge-based search function which directs the search for high-probability data elements. This serves to reduce the number of data element combinations evaluated while preserving the most flexibility in defining the associations of data elements which comprise an object.

Hill, Matthew L.↗

LANL High-Performance Data System (HPDS)

The Los Alamos High-Performance Data System (HPDS) is being developed to meet the very large data storage and data handling requirements of a high-performance computing environment. The HPDS will consist of fast, large-capacity storage devices that are directly connected to a high-speed network and managed by software distributed in workstations. The HPDS model, the HPDS implementation approach, and experiences with a prototype disk array storage system are presented.

Collins, M. William↗

The use of large-area spectral data in wheat yield estimation

Large-area relations between satellite spectral data and end-of-season crop yield were investigated. Green Index Number (GIN) values from Landsat MSS data of sample segments throughout the U.S. Great Plains winter wheat belt in 1978 were correlated to county USDA-SRS reported yields. A linear relation between GIN and yield appeared to exist up to GIN values of 40 or 50, covering cases of severe to moderate stress. In a test on 1978 Texas winter wheat at the county level, GIN values for sample segments in the counties were used in conjunction with an agronomic-meteorological yield model. The combined fit explained significantly more of the observed yield variation at the county level than the agromet model alone.

Barnett, T. L.↗

Digital processing of radiographic images

Some techniques are presented and the software documentation for the digital enhancement of radiographs. Both image handling and image processing operations are considered. The image handling operations dealt with are: (1) conversion of format of data from packed to unpacked and vice versa; (2) automatic extraction of image data arrays; (3) transposition and 90 deg rotations of large data arrays; (4) translation of data arrays for registration; and (5) reduction of the dimensions of data arrays by integral factors. Both the frequency and the spatial domain approaches are presented for the design and implementation of the image processing operation. It is shown that spatial domain recursive implementation of filters is much faster than nonrecursive implementations using fast fourier transforms (FFT) for the cases of interest in this work. The recursive implementation of a class of matched filters for enhancing image signal to noise ratio is described. Test patterns are used to illustrate the filtering operations. The application of the techniques to radiographic images of metallic structures is demonstrated through several examples.

Bond, A. D.↗

Generic functional requirements for a NASA general-purpose data base management system

Generic functional requirements for a general-purpose, multi-mission data base management system (DBMS) for application to remotely sensed scientific data bases are detailed. The motivation for utilizing DBMS technology in this environment is explained. The major requirements include: (1) a DBMS for scientific observational data; (2) a multi-mission capability; (3) user-friendly; (4) extensive and integrated information about data; (5) robust languages for defining data structures and formats; (6) scientific data types and structures; (7) flexible physical access mechanisms; (8) ways of representing spatial relationships; (9) a high level nonprocedural interactive query and data manipulation language; (10) data base maintenance utilities; (11) high rate input/output and large data volume storage; and adaptability to a distributed data base and/or data base machine configuration. Detailed functions are specified in a top-down hierarchic fashion. Implementation, performance, and support requirements are also given.

Lohman, G. M.↗

Pilot study of the domestic information display system in state and local government

An interactive computer based system that can retrieve a wide range of data (demographic, environmental, socio-economic, etc.,) from a large data base and display these data for different geographic units in the form of choropleth maps was developed. The system was designed to display statistical information in a geographic format for national policy makers.

Source record↗

Imaging spectrometry for earth remote sensing

Initial results of the novel remote earth sensing technique of imaging spectrometry, which is technically feasible from both spacecraft and aircraft platforms, indicate that the direct identification of surface materials on a picture-element basis is possible through proper sampling of absorption features in the reflectance spectrum. Sensors of this type are able to acquire images simultaneously in 100-200 contiguous spectral bands. Computerized data reduction and storage techniques are available for the large data sets thus generated, and novel analytic techniques are under development to maximize information content extraction.

Goetz, A. F. H.↗

SAR image data compression for an on-line archive system

This paper summarizes the investigation of SAR image data compression for an on-line archive data distribution system. This system is planned for the ground processing system of Alaska SAR Facility (ASF) and Shuttle Imaging Radar (SIR-C). The objective of the SAR image data compression is to enable the data archive system to provide the remote users a large data base with good image quality, short response time, low transfer cost, and minimal decoding complexity. The requirements and limitations of the on-line archive data distribution system are presented. The effects of SAR image data characteristics on data compression are addressed. The users' survey results suggest that compression ratios between 10:1 and 20:1 appear suitable. Based on the algorithm evaluation results, the two-level tree-searched vector quantization technique has been recommended as the SAR image data compression algorithm for the on-line archive data distribution system.

Chang, C. Y.↗

Online Time Series Analysis of Land Products over Asia Monsoon Region via Giovanni

Time series analysis is critical to the study of land cover/land use changes and climate. Time series studies at local-to-regional scales require higher spatial resolution, such as 1km or less, data. MODIS land products of 250m to 1km resolution enable such studies. However, such MODIS land data files are distributed in 10ox10o tiles, due to large data volumes. Conducting a time series study requires downloading all tiles that include the study area for the time period of interest, and mosaicking the tiles spatially. This can be an extremely time-consuming process. In support of the Monsoon Asia Integrated Regional Study (MAIRS) program, NASA GES DISC (Goddard Earth Sciences Data and Information Services Center) has processed MODIS land products at 1 km resolution over the Asia monsoon region (0o-60oN, 60o-150oE) with a common data structure and format. The processed data have been integrated into the Giovanni system (Goddard Interactive Online Visualization ANd aNalysis Infrastructure) that enables users to explore, analyze, and download data over an area and time period of interest easily. Currently, the following regional MODIS land products are available in Giovanni: 8-day 1km land surface temperature and active fire, monthly 1km vegetation index, and yearly 0.05o, 500m land cover types. More data will be added in the near future. By combining atmospheric and oceanic data products in the Giovanni system, it is possible to do further analyses of environmental and climate changes associated with the land, ocean, and atmosphere. This presentation demonstrates exploring land products in the Giovanni system with sample case scenarios.

Shen, Suhung↗

Onboard Classification of Hyperspectral Data on the Earth Observing One Mission

Remote-sensed hyperspectral data represents significant challenges in downlink due to its large data volumes. This paper describes a research program designed to process hyperspectral data products onboard spacecraft to (a) reduce data downlink volumes and (b) decrease latency to provide key data products (often by enabling use of lower data rate communications systems). We describe efforts to develop onboard processing to study volcanoes, floods, and cryosphere, using the Hyperion hyperspectral imager and onboard processing for the Earth Observing One (EO-1) mission as well as preliminary work targeting the Hyperspectral Infrared Imager (HyspIRI) mission.

cryosphere↗

Advanced Analytics and Big Earth Data

NASA's Earth Science Data Systems process, archive and distribute petabytes of Earth Observation data to a variety of end users. These end users will face dramatically increased data size in the near future, bringing about new challenges and opportunities in analyzing those data. One area of particular ferment currently is Machine Learning. Many Machine Learning methods are black boxes, limiting direct insight into the data's properties. However, they can be used for a variety of data enhancement purposes, such as parameter retrieval, data fusion and image classification and segmentation. The Earth Observing System Data and Information System is also evolving to host large data volumes in the cloud, enabling data proximal analysis. As part of this effort, an Analytics framework is being developed to support and enhance user analysis of the data. By using standards based services in the framework, diverse user communities can be served, while also allowing inter-system collaboration in the analysis process.

Cloud Computing↗

SMAnalytics Automated Shape Memory Test Analysis Software User's Manual: UCFTC, UPER, and DSC Test Methods, Version 1.0.2

Over the course of 60 years of shape memory alloy research and development, the properties of these alloys have been measured using various testing methods, which are often customized by the organization performing the test. However, commercial adoption of shape memory alloys in aeronautic actuator applications requires reducing property uncertainty through standardizing test methods. Historically, differential scanning calorimetry (DSC) has been used to measure transformation temperatures under stress-free conditions. This testing method is well established, and tests are run under the applicable standard, ASTM F2004-17: Standard Test Method for Transformation Temperature of Nickel-Titanium Alloys by Thermal Analysis. Two other test methods for measuring strains and transformation temperatures under constant load or free recovery after prestraining have only recently been standardized—ASTM E3097: Standard Test Method for Mechanical Uniaxial Constant Force Thermal Cycling of SMAs (UCFTC) and ASTM E3098: Standard Test Method for Mechanical Uniaxial Pre-Strain and Thermal Free Recovery of SMAs (UPFR). These standards represent a critical step forward in producing reliable material property data for the use of these alloys in aeronautics and other commercial areas. However, no standard programs or software packages were previously available for postprocessing UCFTC- and UPFR-type test data to extract property data. Each organization that performed the testing analyzed data using its own custom manual methods, such as using a plot and a straight edge, spreadsheet plotting methods, or custom code routines, to extract the required values for strains, stresses, and transformation temperatures. SMAnalytics represents the first publicly available uniform software package for processing data generated using the DSC, UCFTC, and UPFR test methods, as well as many modifications of these methods, including loading in martensite versus austenite and performing multiple thermal cycles at stress. In doing so, it provides a tool for reducing potential error or variability in the measured values due to the precision of the technique used and person-to-person variability. It is also expected that this automated data-parsing tool can accelerate the data analysis phase of the test campaign, especially for large data files. This User’s Manual describes how the SMAnalytics software works and the method for its use.

Shape Memory Alloy↗

Principal Component Analysis of Thermographic Data

Principal Component Analysis (PCA) has been shown effective for reducing thermographic NDE data. While a reliable technique for enhancing the visibility of defects in thermal data, PCA can be computationally intense and time consuming when applied to the large data sets typical in thermography. Additionally, PCA can experience problems when very large defects are present (defects that dominate the field-of-view), since the calculation of the eigenvectors is now governed by the presence of the defect, not the "good" material. To increase the processing speed and to minimize the negative effects of large defects, an alternative method of PCA is being pursued where a fixed set of eigenvectors, generated from an analytic model of the thermal response of the material under examination, is used to process the thermal data from composite materials. This method has been applied for characterization of flaws.

Winfree, William P.↗

Fractal image compression

Fractals are geometric or data structures which do not simplify under magnification. Fractal Image Compression is a technique which associates a fractal to an image. On the one hand, the fractal can be described in terms of a few succinct rules, while on the other, the fractal contains much or all of the image information. Since the rules are described with less bits of data than the image, compression results. Data compression with fractals is an approach to reach high compression ratios for large data streams related to images. The high compression ratios are attained at a cost of large amounts of computation. Both lossless and lossy modes are supported by the technique. The technique is stable in that small errors in codes lead to small errors in image data. Applications to the NASA mission are discussed.

Barnsley, Michael F.↗

Prediction of aircraft sideline noise attenuation

A computational study is made using the recommended ground effect theory by Pao, Wenzel, and Oncley. It is shown that this theory adequately predicts the measured ground attenuation data by Parkin and Scholes, which is the only available large data set. It is also shown, however, that the ground effect theory does not predict the measured lateral attenuations from actual aircraft flyovers. There remain one or more important lateral effects on aircraft noise, such as sideline shielding of sources, which must be incorporated in the prediction methods. Experiments at low elevation angles (0 deg to 10 deg) and low-to-intermediate frequencies are recommended to further validate the ground effect theory.

Zorumski, W. E.↗

Ultraviolet O2 transmittance - AURIC implementation

A new spectrally precise approach to Schumann-Runge synthesis has been devised, employing nine (9) different spectral arrays containing polynomial coefficients. The coefficients were fit to calculated cross sections obtained from a detailed Schumann-Runge model that incorporates the most recent high resolution spectroscopic data for a temperature range between 130 and 500K. This large data base is being used to reexamine the existing parameterizations of UV transmission and photolysis. In addition, it is now possible to extend atmospheric radiance codes further into the ultraviolet. Initial implementation has been accomplished for the MODTRAN code as part of the eventual development of AURIC, the Atmospheric Ultraviolet Radiance Integrated Code.

Anderson, G. P.↗

Large-scale space use of large juvenile and adult smalltooth sawfish Pristis pectinata: implications for management

The smalltooth sawfish Pristis pectinata is an endangered species endemic to the Atlantic Ocean. The only known viable populations occur in the USA along both coasts of Florida and in the western Bahamas. Little is known about habitat use and movement ecology of large juvenile and adult smalltooth sawfish. Although Critical Habitat — a management designation in the USA — has been identified for small juveniles, it has yet to be identified for these life stages. Between May 2016 and April 2019, we used passive acoustic telemetry and 3 large data sharing networks of receivers to track movements of 43 large juvenile and adult smalltooth sawfish. During this study, 24 females and 19 males were implanted with transmitters with estimated 4 or 10 yr battery lives. These tagged individuals were detected off the southeastern USA on 461 receivers ranging from off the coast of Brunswick, Georgia, to the lower Florida Keys, and along the Gulf coast to Apalachee Bay, Florida. Seasonal migrations were undertaken by 58% (43% mature; 57% immature) of the tagged individuals, with the remainder being apparent residents of their tagging locations. Tagged sawfish from both size classes and of both sexes migrated, which indicates that neither sex nor length is a predictor of whether a sawfish will migrate or not. Although both coasts of Florida were used for migration, most individuals consistently used the same coast when they migrated. The areas surrounding Boca Grande, Cape Canaveral, and the lower Florida Keys were heavily visited sites that could be further evaluated as potential Critical Habitat for these life stages. Understanding the movement patterns of this Critically Endangered species is essential for creating policies to protect areas important for promoting growth of the population.

Pristis pectinata Habitat use · Acoustic monitorin↗

Combining LANDSAT MSS, aerial photographs and ground measurements to estimate rangeland productivity

The production of a vegetation map of over 2.2 million acres with detail down to the plant community level, and the production of estimates of rangeland productivity (pounds of usable forage per acre for cattle) for a 500,000 acre subset of area with a design goal for accuracy and precision of + or - 20% at the 80% confidence level, are considered. The data consist of five groups: maps of area, LANDSAT data, digital terrain data, large scale aerial photography, and ground plots. An outline of the data acquisition and data reduction schemes are presented.

Gialdini, M. J.↗