Search NASA⌕ Search

SEARCH · Search NASA

Results for “Large data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Arm DevSummit Keynote: Environment for Data Engineering in Virtual Reality: Ethical Considerations

Currently, the US Government is going through a large-scale data Transformation effort, where the GSA playbook is guiding all agencies to make their processes data-driven with the help of emerging technologies. To address concerns about algorithm sharing, AI adoption, and vendor lock-in, the NASA Langley Research Center Digital Transformation Group has developed the Environment for Data Engineering in Virtual Reality (EnDEVR), a data science ecosystem that allows users to command and investigate customizable data analyses from a VR environment. The system has been evaluated in the Oculus Rift S and Quest environments, two popular VR systems powered by the ARM architecture. Current and future development will employ several AI capabilities to guide research and automation within the environment and to facilitate algorithm sharing. In this talk, we will discuss the results of an initial ethical investigation and recommended considerations for the use of AI within the system.

Artificial Intelligence↗
NASA NTRS1983

Conceptual design of a data reduction system

A telemetry data processing system was defined of the Data Reduction. Data reduction activities in support of the developmental flights of the Space Shuttle were used as references against which requirements are assessed in general terms. A conceptual system design believed to offer significant throughput for the anticipated types of data reduction activities is presented. The design identifies the use of a large, intermediate data store as a key element in a complex of high speed, single purpose processors, each of which performs predesignated, repetitive operations on either raw or partially processed data. The recommended approach to implement the design concept is to adopt an established interface standard and rely heavily on mature or promising technologies which are considered main stream of the integrated circuit industry. The design system concept, is believed to be implementable without reliance on exotic devices and/or operational procedures. Numerical methods were employed to examine the feasibility of digital discrimination of FDM composite signals, and of eliminating line frequency noises in data measurements.

Source record↗
NASA NTRS1986

Buckling characteristics of hypersonic aircraft wing tubular panels

The buckling characteristics of Rene 41 tubular panels installed as wing panels on a hypersonic wing test structure (HWTS) were determined nondestructively through use of a force/stiffness technique. The nondestructive buckling tests were carried out under different combined load conditions and different temperature environments. Two panels were subsequently tested to buckling failure in a universal tension compression testing machine. In spite of some data scattering because of large extrapolations of data points resulting from termination of the test at a somewhat low applied load, the overall test data correlated fairly well with theoretically predicted buckling interaction curves. The structural efficiency of the tubular panels was slightly higher than that of the beaded panels which they replaced.

Ko, William L.↗
NASA NTRS2000

Subsetting and Formatting Landsat-7 LOR ETM+ and Data Products

The Landsat-7 Processing System (LPS) processes Landsat-7 Enhanced Thematic Mapper (ETM+) instrument data into large, contiguous segments called "subintervals" and stores them in Level OR (LOR) data files. The LPS processed subinterval products must be subsetted and reformatted before the Level I processing systems can ingest them. The initial full subintervals produced by the LPS are stored mainly in HDF Earth Observing System (HDF-EOS) format which is an extension to the Hierarchical Data Format (HDF). The final LOR products are stored in native HDF format. Primarily the EOS Core System (ECS) and alternately the DAAC Emergency System (DES) subset the subinterval data for the operational Landsat-7 data processing systems. The HDF and HDF-EOS application programming interfaces (APIs) can be used for extensive data subsetting and data reorganization. A stand-alone subsetter tool has been developed which is based on some of the DES code. This tool makes use of the HDF and HDFEOS APIs to perform Landsat-7 LOR product subsetting and demonstrates how HDF and HDFEOS can be used for creating various configurations of full LOR products. How these APIs can be used to efficiently subset, format, and organize Landsat-7 LOR data as demonstrated by the subsetter tool and the DES is discussed.

Reid, Michael R.↗
NASA NTRS2000

KDD Services at the Goddard Earth Sciences Distributed Active Archive Center

NASA's Goddard Earth Sciences Distributed Active Archive Center (GES DAAC) processes, stores and distributes earth science data from a variety of remote sensing satellites. End users of the data range from instrument scientists to global change and climate researchers to federal agencies and foreign governments. Many of these users apply data mining techniques to large volumes of data (up to 1 TB) received from the GES DAAC. However, rapid advances in processing power are enabling increases in data processing that are outpacing tape drive performance and network capacity. As a result, the proportion of data that can be distributed to users continues to decrease. As mitigation, we are migrating more data mining and mining preparation activities into the data center in order to reduce the data volume that needs to be distributed and to offer the users a more useful and manageable product. This migration of activities faces a number of technical and human-factor challenges. As data reduction and mining algorithms are normally quite specific to the user's research needs, the user's algorithm must be integrated virtually unchanged into the archive environment. Also, the archive itself is busy with everyday data archive and distribution activities and cannot be dedicated to, or even impacted by, the mining activities. Therefore, we schedule KDD 'campaigns' (similar to reprocessing campaigns), during which we schedule a wholesale retrieval of specific data products, offering users the opportunity to extract information from the data being retrieved during the campaign.

Lynnes, Christopher↗
NASA NTRS2014

Features of Point Clouds Synthesized from Multi-View ALOS/PRISM Data and Comparisons with LiDAR Data in Forested Areas

LiDAR waveform data from airborne LiDAR scanners (ALS) e.g. the Land Vegetation and Ice Sensor (LVIS) havebeen successfully used for estimation of forest height and biomass at local scales and have become the preferredremote sensing dataset. However, regional and global applications are limited by the cost of the airborne LiDARdata acquisition and there are no available spaceborne LiDAR systems. Some researchers have demonstrated thepotential for mapping forest height using aerial or spaceborne stereo imagery with very high spatial resolutions.For stereo imageswith global coverage but coarse resolution newanalysis methods need to be used. Unlike mostresearch based on digital surface models, this study concentrated on analyzing the features of point cloud datagenerated from stereo imagery. The synthesizing of point cloud data from multi-view stereo imagery increasedthe point density of the data. The point cloud data over forested areas were analyzed and compared to small footprintLiDAR data and large-footprint LiDAR waveform data. The results showed that the synthesized point clouddata from ALOSPRISM triplets produce vertical distributions similar to LiDAR data and detected the verticalstructure of sparse and non-closed forests at 30mresolution. For dense forest canopies, the canopy could be capturedbut the ground surface could not be seen, so surface elevations from other sourceswould be needed to calculatethe height of the canopy. A canopy height map with 30 m pixels was produced by subtracting nationalelevation dataset (NED) fromthe averaged elevation of synthesized point clouds,which exhibited spatial featuresof roads, forest edges and patches. The linear regression showed that the canopy height map had a good correlationwith RH50 of LVIS data with a slope of 1.04 and R2 of 0.74 indicating that the canopy height derived fromPRISM triplets can be used to estimate forest biomass at 30 m resolution.

LiDARD↗
NASA NTRS2020

Battery Health Quantification for TDRS Spacecraft by Using Signature Discriminability Measurement

The NASA/GSFC Space Network Project Office (SN) currently operates a constellation of ten geosynchronous TDRS spacecraft launched over the past 30 years. The SN project collects up to 16.5 Gigabytes of telemetry every month. Generally, the spacecraft health and functionality are obtained by the use of real-time telemetry data for the multiple spacecraft subsystems, which are transmitted to the main ground station at the White Sands Complex in Las Cruces, NM. Recently, the SN has instituted a program of Big Data to analyze the large amounts of data using a variety of tools including Machine Learning, Artificial Intelligence, development of training sets, and a variety of mathematical modeling tools. The goal is to improve spacecraft management and obtain a more accurate prediction of the spacecraft end of life. The combination of these efforts with those of the Aerospace Corporation, which has a contract with the SN to produce yearly reliability estimates for the TDRS fleet, will be performed. This paper presents a new concept called telemetry quality quantification (TQQ) and discusses the progress that has been made in battery performance estimation for the second-generation TDRS spacecraft using a signature discriminability measures (SDM) algorithm combined with the Aerospace Corp. battery life estimation models. This activity is important because many of the TDRS fleet of spacecraft have exceeded their on-orbit design lifetime and, therefore, NASA must carefully manage the spacecraft to continue operations while avoiding an end-of-mission scenario that leaves a non-functioning spacecraft in geosynchronous orbit.

Ma, Kenneth Y.↗
NASA NTRS2021

Potential impact of aerosols on convective clouds revealed by Himawari-8 observations over different terrain types in Eastern China

Convective clouds are common and play a major role in Earth’s water cycle and energy balance; they may even develop into storms and cause severe rainfall events. To understand the convective cloud development process, this study investigates the impact of aerosols on convective clouds by considering the influence of both topography and diurnal variation of radiation. By combining texture analysis, clustering and thresholding methods, we identify all convective clouds in two warm seasons (May-September, 2016-2017) in eastern China based on Himawari-8 Level 1 data. Having a large diurnally resolved cloud data together with surface meteorological and environmental measurements, we investigate convective cloud properties and their variation, stratified by elevation and diurnal change. We then analyze the potential impact of aerosol on convective clouds under different meteorological conditions and topographies. In general, convective clouds tend to occur preferentially under polluted conditions in the morning, which reverses in the afternoon. Convective cloud fraction first increases then decreases with aerosol loading, which may contribute to this phenomenon. Topography and diurnal meteorological variations may affect the strength of aerosol microphysical and radiative effects. Updraft is always stronger along the windward slopes of mountains and plateaus, especially in northern China. The prevailing southerly wind near the foothills of mountains and plateaus is likely to contribute to this windward strengthening of updraft and to bring more pollutant into the mountains, thereby strengthening the microphysical effect, invigorating convective clouds. By comparison, over plain, aerosols decrease surface heating and suppresses convection by blocking solar radiation reaching the surface.

Tianmeng Chen↗
NASA NTRS2002

An interfaces approach to TES ground data system processing design with the Science Investigator-led Processing System (SIPS)

Developing production-quality software to process the large volumes of scientific data is the responsibility of the TES Ground Data System, which is being developed at the Jet Propulsion Laboratory together with support contractor Raytheon/ITSS. The large data volume and processing requirements of the TES pose significant challenges to the design.

TES TES SIPS↗
NASA NTRS1982

Image processing applied to gravity and topography data covering the continental United States

The applicability of fairly standard image processing techniques to processing and analyzing large geologic data sets in addressed. Image filtering techniques were used to interpolate between gravity station locations to produce a regularly spaced data array that preserves detail in areas with good coverage, and that produces a continuous tone image rather than a contour map. Standard image processing techniques were used to digitally register and overlay topographic and gravity data, and the data were displayed in ways that emphasize subtle but pervasive structural features. The potential of the methods is illustrated through a discussion of linear structures that appear in the processed data between the midcontinent gravity high and the Appalachians.

Arvidson, R. E.↗
NASA NTRS2017

Reusing JPSS Ground System Components to Process Aura Ozone Monitoring Instrument Science Products

New Earth observation instruments are planned to enable advancements in Earth science research over the next decade. Diversity of Earth observing instruments and their observing platforms will continue to increase as new instrument technologies emerge and are deployed as part of National programs such as Joint Polar Satellite System (JPSS), Geostationary Operational Environmental Satellite system (GOES), Landsat as well as the potential for many CubeSat and aircraft missions. The practical use and value of these observational data often extends well beyond their original purpose. The practicing community needs intuitive and standardized tools to enable quick unfettered development of tailored products for specific applications and decision support systems. However, the associated data processing system can take years to develop and requires inherent knowledge and the ability to integrate increasingly diverse data types from multiple sources. This paper describes the adaptation of a large-scale data processing system built for supporting JPSS algorithm calibration and validation (CalVal) node to a simplified science data system for rapid application. The new configurable data system reuses scalable JAVA technologies built for the JPSS Government Resource for Algorithm Verification, Independent Test, and Evaluation (GRAVITE) system to run within a laptop environment and support product generation and data processing of AURA Ozone Monitoring Instrument (OMI) science products. Of particular interest are the root requirements necessary for integrating experimental algorithms and Hierarchical Data Format (HDF) data access libraries into a science data production system. This study demonstrates the ability to reuse existing Ground System technologies to support future missions with minimal changes.

Science Data Systems↗
NASA NTRS1973

Shuttle cryogenic supply system. Optimization study. Volume 5 B-1: Programmers manual for math models

A computer program for rapid parametric evaluation of various types of cryogenics spacecraft systems is presented. The mathematical techniques of the program provide the capability for in-depth analysis combined with rapid problem solution for the production of a large quantity of soundly based trade-study data. The program requires a large data bank capable of providing characteristics performance data for a wide variety of component assemblies used in cryogenic systems. The program data requirements are divided into: (1) the semipermanent data tables and source data for performance characteristics and (2) the variable input data which contains input parameters which may be perturbated for parametric system studies.

Source record↗
NASA NTRS1995

Visual interface for space and terrestrial analysis

The management of large geophysical and celestial data bases is now, more than ever, the most critical path to timely data analysis. With today's large volume data sets from multiple satellite missions, analysts face the task of defining useful data bases from which data and metadata (information about data) can be extracted readily in a meaningful way. Visualization, following an object-oriented design, is a fundamental method of organizing and handling data. Humans, by nature, easily accept pictorial representations of data. Therefore graphically oriented user interfaces are appealing, as long as they remain simple to produce and use. The Visual Interface for Space and Terrestrial Analysis (VISTA) system, currently under development at the Naval Research Laboratory's Backgrounds Data Center (BDC), has been designed with these goals in mind. Its graphical user interface (GUI) allows the user to perform queries, visualization, and analysis of atmospheric and celestial backgrounds data.

Dombrowski, Edmund G.↗
NASA NTRS1993

A pattern recognition system for locating small volvanoes in Magellan SAR images of Venus

The Magellan data set constitutes an example of the large volumes of data that today's instruments can collect, providing more detail of Venus than was previously available from Pioneer Venus, Venera 15/16, or ground-based radar observations put together. However, data analysis technology has not kept pace with data collection and storage technology. Due to the sheer size of the data, complete and comprehensive scientific analysis of such large volumes of image data is no longer feasible without the use of computational aids. Our progress towards developing a pattern recognition system for aiding in the detection and cataloging of small-scale natural features in large collections of images is reported. Combining classical image processing, machine learning, and a graphical user interface, the detection of the 'small-shield' volcanoes (less than 15km in diameter) that constitute the most abundant visible geologic feature in the more that 30,000 synthetic aperture radar (SAR) images of the surface of Venus are initially targeted. Our eventual goal is to provide a general, trainable tool for locating small-scale features where scientists specify what to look for simply by providing examples and attributes of interest to measure. This contrasts with the traditional approach of developing problem specific programs for detecting Specific patterns. The approach and initial results in the specific context of locating small volcanoes is reported. It is estimated, based on extrapolating from previous studies and knowledge of the underlying geologic processes, that there should be on the order of 10(exp 5) to 10(exp 6) of these volcanoes visible in the Magellan data. Identifying and studying these volcanoes is fundamental to a proper understanding of the geologic evolution of Venus. However, locating and parameterizing them in a manual manner is forbiddingly time-consuming. Hence, the development of techniques to partially automate this task were undertaken. The primary constraints for this particular problem are that the method must be reasonably robust and fast. Unlike most geological features, the small volcanoes of Venus can be ascribed to a basic process that produces features with a short list of readily defined characteristics differing significantly from other surface features on Venus. For pattern recognition purposes the relevant criteria include (1) a circular planimetric outline, (2) known diameter frequency distribution from preliminary studies, (3) a limited number of basic morphological shapes, and (4) the common occurrence of a single, circular summit pit at the center of the edifice.

Burl, M. C.↗
NASA NTRS1975

Evaluation of bead-stiffened metal panels

Potential weight efficiency for bead-stiffened panels has been demonstrated through fabrication and testing. Theoretically optimum design concepts were identified, and small specimens were tested under combined compression, shear, and bending to determine local buckling failure loads and to verify theory. Large optimized panels were then designed and tested under combined loads. Correlation of test data for large circular tubular panels with theory was conservative and consistent, and indicated reliable and acceptable design theory. Tests of fluted tubular panels indicated general instability failures at loads far below the design values due to nonlinear distortions. Further study of the fluted tubular configuration will be required if its potential weight efficiency is to be attained.

Shideler, J. L.↗
NASA NTRS2002

Progress on the Cluster Mission

Prof M. G. Kivelson and Dr. K. K. Khurana (UCLA (University of California, Los Angeles)) are co-investigators on the Cluster Magnetometer Consortium (CMC) that provided the fluxgate magnetometers and associated mission support for the Cluster Mission. The CMC designated UCLA as the site with primary responsibility for the inter-calibration of data from the four spacecraft and the production of fully corrected data critical to achieving the mission objectives. UCLA will also participate in the analysis and interpretation of the data. The UCLA group here reports its excellent progress in developing fully intra-calibrated data for large portions of the mission and an excellent start in developing inter-calibrated data for selected time intervals, especially extended intervals in August, 2001 on which a workshop held at ESTEC in March, 2002 focused. In addition, some scientific investigations were initiated and results were reported at meetings.

Kivelson, Margaret↗
NASA NTRS2010

Social Tagging of Mission Data

Mars missions will generate a large amount of data in various forms, such as daily plans, images, and scientific information. Often, there is a semantic linkage between images that cannot be captured automatically. Software is needed that will provide a method for creating arbitrary tags for this mission data so that items with a similar tag can be related to each other. The tags should be visible and searchable for all users. A new routine was written to offer a new and more flexible search option over previous applications. This software allows users of the MSLICE program to apply any number of arbitrary tags to a piece of mission data through a MSLICE search interface. The application of tags creates relationships between data that did not previously exist. These tags can be easily removed and changed, and contain enough flexibility to be specifically configured for any mission. This gives users the ability to quickly recall or draw attention to particular pieces of mission data, for example: Give a semantic and meaningful description to mission data; for example, tag all images with a rock in them with the tag "rock." Rapidly recall specific and useful pieces of data; for example, tag a plan as"driving template." Call specific data to a user s attention; for example, tag a plan as "for:User." This software is part of the MSLICE release, which was written in Java. It will run on any current Windows, Macintosh, or Linux system.

Norris, Jeffrey S.↗