Search NASA⌕ Search

SEARCH · Search NASA

Results for “Small Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS1983

RIMS: Resource Information Management System

An overview is given of the capabilities and functions of the resource management system (RIMS). It is a simple interactive DMS tool which allows users to build, modify, and maintain data management applications. The RIMS minimizes programmer support required to develop/maintain small data base applications. The RIMS also assists in bringing the United Information Services (UIS) budget system work inhouse. Information is also given on the relationship between the RIMS and the user community.

Symes, J.↗
NASA NTRS2015

Finding Atmospheric Composition (AC) Metadata

The Atmospheric Composition Portal (ACP) is an aggregator and curator of information related to remotely sensed atmospheric composition data and analysis. It uses existing tools and technologies and, where needed, enhances those capabilities to provide interoperable access, tools, and contextual guidance for scientists and value-adding organizations using remotely sensed atmospheric composition data. The initial focus is on Essential Climate Variables identified by the Global Climate Observing System CH4, CO, CO2, NO2, O3, SO2 and aerosols. This poster addresses our efforts in building the ACP Data Table, an interface to help discover and understand remotely sensed data that are related to atmospheric composition science and applications. We harvested GCMD, CWIC, GEOSS metadata catalogs using machine to machine technologies - OpenSearch, Web Services. We also manually investigated the plethora of CEOS data providers portals and other catalogs where that data might be aggregated. This poster is our experience of the excellence, variety, and challenges we encountered.Conclusions:1.The significant benefits that the major catalogs provide are their machine to machine tools like OpenSearch and Web Services rather than any GUI usability improvements due to the large amount of data in their catalog.2.There is a trend at the large catalogs towards simulating small data provider portals through advanced services. 3.Populating metadata catalogs using ISO19115 is too complex for users to do in a consistent way, difficult to parse visually or with XML libraries, and too complex for Java XML binders like CASTOR.4.The ability to search for Ids first and then for data (GCMD and ECHO) is better for machine to machine operations rather than the timeouts experienced when returning the entire metadata entry at once. 5.Metadata harvest and export activities between the major catalogs has led to a significant amount of duplication. (This is currently being addressed) 6.Most (if not all) Earth science atmospheric composition data providers store a reference to their data at GCMD.

metadata search↗
NASA NTRS2013

A Lightweight I/O Scheme to Facilitate Spatial and Temporal Queries of Scientific Data Analytics

In the era of petascale computing, more scientific applications are being deployed on leadership scale computing platforms to enhance the scientific productivity. Many I/O techniques have been designed to address the growing I/O bottleneck on large-scale systems by handling massive scientific data in a holistic manner. While such techniques have been leveraged in a wide range of applications, they have not been shown as adequate for many mission critical applications, particularly in data post-processing stage. One of the examples is that some scientific applications generate datasets composed of a vast amount of small data elements that are organized along many spatial and temporal dimensions but require sophisticated data analytics on one or more dimensions. Including such dimensional knowledge into data organization can be beneficial to the efficiency of data post-processing, which is often missing from exiting I/O techniques. In this study, we propose a novel I/O scheme named STAR (Spatial and Temporal AggRegation) to enable high performance data queries for scientific analytics. STAR is able to dive into the massive data, identify the spatial and temporal relationships among data variables, and accordingly organize them into an optimized multi-dimensional data structure before storing to the storage. This technique not only facilitates the common access patterns of data analytics, but also further reduces the application turnaround time. In particular, STAR is able to enable efficient data queries along the time dimension, a practice common in scientific analytics but not yet supported by existing I/O techniques. In our case study with a critical climate modeling application GEOS-5, the experimental results on Jaguar supercomputer demonstrate an improvement up to 73 times for the read performance compared to the original I/O method.

Temporal Queries↗
NASA NTRS1973

A description of a general use automated data reduction system

A data system developed for use in tests in arc jet facilities has the flexibility to accommodate various types of data, time resolution, and number of data signals. Data are tape-recorded, because a direct link to the IBM 360/67 computer is prohibited for safety reasons. The system is analogous to manual data reduction to promote user understanding and acceptance. Data computations may be performed in an interactive ('conversational') mode, for minimum delay in data reduction, or by card input. Reduced data are listed and also stored for plotting of further computational use. Operational costs of the system are reasonable, and both large and small data reduction tasks are handled readily.

Wakefield, R. M.↗
NASA NTRS1994

Topological analysis of chaotic orbits: Revisiting Hyperion

There is emerging interest in the possibility of chaotic evolution in astrophysical systems. To mention just one example, recent well-sampled ground-based observations of the Saturian satellite Hyperion strongly suggest that it is exhibiting chaotic behavior. We present a general technique, the method of close returns, for the analysis of data from astronomical objects believed to be exhibiting chaotic motion. The method is based on the extraction of pieces of the evolution that exhibit nearly periodic behavior-episodes during which the object stays near in phase space to some unstable periodic orbit. Such orbits generally act as skeletal features, tracing the topological organization of the manifold on which the chaotic dynamics takes place. This method does not require data sets as lengthy as other nonlinear analysis techniques do and is therefore well suited to many astronomical observing programs. Well sampled data covering between twenty and forty characteristic periods of the system have been found to be sufficient for the application of this technique. Additional strengths of this method are its robustness in the presence of noise and the ability for a user to clearly distinguish between periodic, random, and chaotic behavior by inspection of the resulting two-dimensional image. As an example of its power, we analyze close returns in a numerically generated data set, based on a model for Hyperion extensively studied in the literature, corresponding to nightly observations of the satellite. We show that with a small data set, embedded unstable periodic orbits can be extracted and that these orbits can be responsible for nearly periodic behavior lasting a substantial fraction of the observing run.

Boyd, Patricia T.↗
NASA NTRS2003

Characterizing the Siple Coast Ice Stream System using Satellite Images, Improved Topography, and Integrated Aerogeophysical Measurements

A technique for improving elevation maps of the polar ice sheets has been developed using AVHRR images. The technique is based on 'photoclinometry' or 'shape from shading', a technique used in the past for mapping planetary surfaces where little elevation information was available. The fundamental idea behind photoclinometry is using the brightness of imaged areas to infer their surface slope in the sun-illuminated direction. Our version of the method relies on a calibration of the images based on an existing lower-resolution digital elevation model (DEM), and then using the images to improve the input DEM resolution to the scale of the image data. Most current DEMs covering the ice sheets are based on Radar altimetry data, and have an inherent resolution of 10 to 25 km at best - although the grid scale of the DEM is often finer. These DEMs are highly accurate (to less than 1 meter); but they report the mean elevation of a broad area, thus erasing smaller features of glaciological interest. AVHRR image data, when accurately geolocated and calibrated, provides surface slope measurements (based on the pixel brightness under known lighting conditions) every approximately 1.1 km. The limitations of the technique are noisiness in the image data, small variations in the albedo of the snow surface, and the integration technique used to create an elevation field from the image-derived slopes. Our study applied the technique to several ice sheet areas having some elevation data; Greenland, the Amery Ice Shelf, the Institute Ice Stream, and the Siple Coast. For the latter, the input data set was laser-altimetry data collected under NSF's SOAR Facility (Support Office for Aerogeophysical Research) over the onset area of the Siple Coast. Over the course of the grant, the technique was greatly improved and modified, significantly improving accuracy and reducing noise from the images. Several publications resulted from the work, and a follow-on proposal to NASA has been submitted to apply the same method to MODIS data using ICESat and other elevation input information. This follow-on grant will explore two applications that are facilitated by the improved surface morphology characterizations of the ice sheets: accumulation and temperature variations near small undulations in the ice.

Scambos, Ted↗
NASA NTRS1999

Interdisciplinary Research Scenario Testing of EOSDIS

During the reporting period, the Principle Investigator (PI) has continued to serve on numerous review panels, task forces and committees with the goal of providing input and guidance for the Earth Observing System Data and Information System (EOSDIS) program at NASA Headquarters and NASA GSFC. In addition, the PI has worked together with personnel at the University of Virginia and the subcontractor (Simpson Weather Associates (SWA)) to continue to evaluate the latest releases of various versions of the user interfaces to the EOSDIS. Finally, as part of the subcontract, SWA has created an on-line Hierarchial Data Format (HDF) tutorial for non-HDF experts, particularly those that will be using EOSDIS and future EOS data products. A summary of these three activities is provided. The topics include: 1) Participation on EODIS Panels and Committees; 2) Evaluation and Tire Kicking of EODIS User Interfaces; and 3) An On-line HDF Tutorial. The report also includes attachments A, B, and C. Attachment A: Report From the May 1999 Science Data Panel. The topics include: 1) Summary of Data Panel Meeting; and 2) Panel's Comments/Recommendations. Attachment B: Survey Requesting Integrated Design Systems (IDS) Teams Input on the Descoping and Rescoping of the EODIS; and Attachment C: An HDF Tutorial for Beginners: EODIS Users and Small Data Providers (HTML Version). The topics include: 1) Tutorial Overview; 2) An introduction to HDF; 3) The HDF Library: Software and Hardware; 4) Methods of Working with HDF Files; 5) Scientific Data API; 6) Attributes and Metadata; 7) Writing a SDS to an HDF file; 8) Obtaining Information on Existing HDF Files; 9) Reading a Scientific Data Set from an HDF file: 10) Example Programs; 11) Browsing and Visualizing HDF Data; and 12) Laboratory (Question and Answer).

Emmitt, G. D.↗
NASA NTRS2015

Thermal Protection Test Bed Pathfinder Development Project

In order to increase thermal protection capabilities for future reentry vehicles, a method to obtain relevant test data is required. Although arc jet testing can be used to obtain some data on materials, the best method to obtain these data is to actually expose them to an atmospheric reentry. The overprediction of the Orion EFT-1 flight data is an example of how the ground test to flight traceability is not fully understood. The RED-Data small reentry capsule developed by Terminal Velocity Aerospace is critical to understanding this traceability. In order to begin to utilize this technology, ES3 needs to be ready to build and integrate heat shields onto the RED-Data vehicle. Using a heritage Shuttle tile material for the heat shield will both allow valuable insight into the environment that the RED-Data vehicle can provide and give ES3 the knowledge and capability to build and integrate future heat shields for this vehicle.

Snapp, Cooper↗
NASA NTRS1983

Use of Landsat data to predict the trophic state of Minnesota lakes

Near-concurrent Landsat Multispectral Scanner (MSS) and ground data were obtained for 60 lakes distributed in two Landsat scene areas. The ground data included measurement of secchi disk depth, chlorophyll-a, total phosphorous, turbidity, color, and total nitrogen, as well as Carlson Trophic State Index (TSI) values derived from the first three parameters. The Landsat data best correlated with the TSI values. Prediction models were developed to classify some 100 'test' lakes appearing in the two analysis scenes on the basis of TSI estimates. Clouds, wind, poor image data, small lake size, and shallow lake depth caused some problems in lake TSI prediction. Overall, however, the Landsat-predicted TSI estimates were judged to be very reliable for the secchi-derived TSI estimation, moderately reliable for prediction of the chlorophyll-a TSI, and unreliable for the phosphorous value. Numerous Landsat data extraction procedures were compared, and the success of the Landsat TSI prediction models was a strong function of the procedure employed.

Lillesand, T. M.↗
NASA NTRS2000

Interactive Computer Graphics

Aerospace data analysis tools that significantly reduce the time and effort needed to analyze large-scale computational fluid dynamics simulations have emerged this year. The current approach for most postprocessing and visualization work is to explore the 3D flow simulations with one of a dozen or so interactive tools. While effective for analyzing small data sets, this approach becomes extremely time consuming when working with data sets larger than one gigabyte. An active area of research this year has been the development of data mining tools that automatically search through gigabyte data sets and extract the salient features with little or no human intervention. With these so-called feature extraction tools, engineers are spared the tedious task of manually exploring huge amounts of data to find the important flow phenomena. The software tools identify features such as vortex cores, shocks, separation and attachment lines, recirculation bubbles, and boundary layers. Some of these features can be extracted in a few seconds; others take minutes to hours on extremely large data sets. The analysis can be performed off-line in a batch process, either during or following the supercomputer simulations. These computations have to be performed only once, because the feature extraction programs search the entire data set and find every occurrence of the phenomena being sought. Because the important questions about the data are being answered automatically, interactivity is less critical than it is with traditional approaches.

Kenwright, David↗
NASA NTRS1991

Clouds as calibration targets for AVHRR reflected-solar channels - Results from a two-year study at NOAA/NESDIS

NOAA-11 Advanced Very High Resolution Radiometer (AVHRR) and associated ground-based data have been collected at NOAA/NESDIS, on a daily basis and for 600 days, using five stations within the continental United States in the NOAA solar radiation (SOLRAD) monitoring network. The data have been filtered to include only uniformly overcast conditions and analyzed along the lines described by Paris and Justus (1988). Results from this first long-term pilot operational application of the method are presented. The method is potentially useful for establishing yearly-averaged trends in the radiometric gain of AVHRR Channels. The relatively small data base examined here suggests a precision in the 600 day mean gain of 5 percent or worse, with a significant part of this uncertainty being driven by poor knowlege of the bidirectional reflectance properties of clouds. The results suggest that the method in its present formulation has insufficient precision to be used as a primary method for the measurement of in-orbit gains of reflected-solar radiometers aboard polar orbiting satellites. Intrinsic limitations to the precision and time resolution of the method are discussed, and suggestions are offered for improving the precision of future results.

Abel, Peter↗
NASA NTRS2011

Developmental Testing of Habitability and Human Factors Tools and Methods During Neemo 15

Currently, no established methods exist to collect real-time human factors and habitability data while crewmembers are living aboard the International Space Station (ISS), traveling aboard other space vehicles, or living in remote habitats. Currently, human factors and habitability data regarding space vehicles and habitats are acquired at the end of missions during postflight crew debriefs. These debriefs occur weeks or often longer after events have occurred, which forces a significant reliance on incomplete human memory, which is imperfect. Without a means to collect real-time data, small issues may have a cumulative effect and continue to cause crew frustration and inefficiencies. Without timely and appropriate reporting methodologies, issues may be repeated or lost. TOOL DEVELOPMENT AND EVALUATION: As part of a directed research project (DRP) aiming to develop and validate tools and methods for collecting near real-time human factors and habitability data, a preliminary set of tools and methods was developed. These tools and methods were evaluated during the NASA Extreme Environments Mission Operations (NEEMO) 15 mission in October 2011. Two versions of a software tool were used to collect observational data from NEEMO crewmembers that also used targeted strategies for using video cameras to collect observations. Space habitability observation reporting tool (SHORT) was created based on a tool previously developed by NASA to capture human factors and habitability issues during spaceflight. SHORT uses a web-based interface that allows users to enter a text description of any observations they wish to report and assign a priority level if changes are needed. In addition to the web-based format, a mobile Apple (iOS) format was implemented, referred to as iSHORT. iSHORT allows users to provide text, audio, photograph, and video data to report observations. iSHORT can be deployed on an iPod Touch, iPhone, or iPad; for NEEMO 15, the app was provided on an iPad2.

Thaxton, S. S.↗
NASA NTRS1991

Radar signal categorization using a neural network

Neural networks were used to analyze a complex simulated radar environment which contains noisy radar pulses generated by many different emitters. The neural network used is an energy minimizing network (the BSB model) which forms energy minima - attractors in the network dynamical system - based on learned input data. The system first determines how many emitters are present (the deinterleaving problem). Pulses from individual simulated emitters give rise to separate stable attractors in the network. Once individual emitters are characterized, it is possible to make tentative identifications of them based on their observed parameters. As a test of this idea, a neural network was used to form a small data base that potentially could make emitter identifications.

Anderson, James A.↗
NASA NTRS2013

First Cloud-to-Ground Lightning Timing Study

NASA's LSP, GSDO and other programs use the probability of cloud-to-ground (CG) lightning occurrence issued by the 45th Weather Squadron (45 WS) in their daily and weekly lightning probability forecasts. These organizations use this information when planning potentially hazardous outdoor activities, such as working with fuels, or rolling a vehicle to a launch pad, or whenever personnel will work outside and would be at-risk from lightning. These organizations would benefit greatly if the 45 WS could provide more accurate timing of the first CG lightning strike of the day. The Applied Meteorology Unit (AMU) has made significant improvements in forecasting the probability of lightning for the day, but forecasting the time of the first CG lightning with confidence has remained a challenge. To address this issue, the 45 WS requested the AMU to determine if flow regimes, wind speed categories, or a combination of the two could be used to forecast the timing of the first strike of the day in the Kennedy Space Center (KSC)/Cape Canaveral Air Force Station (CCAFS) lightning warning circles. The data was stratified by various sea breeze flow regimes and speed categories in the surface to 5,000-ft layer. The surface to 5,000-ft layer was selected since that is the layer the 45 WS uses to predict the behavior of sea breeze fronts, which are the dominant influence on the occurrence of first lightning in Florida during the warm season. Due to small data sample sizes after stratification, the AMU could not determine a statistical relationship between flow regimes or speed categories and the time of the first CG strike.. As expected, although the amount and timing of lightning activity varies by time of day based on the flow regimes and speed categories, there are extended tails of low lightning activity making it difficult to specify times when the threat of the first lightning flash can be avoided. However, the AMU developed a graphical user interface with input from the 45 WS that allows forecasters to visualize the climatological frequencies of the timing of the first lightning strike. This tool should contribute directly to the 45 WS goal of improving lightning timing capability for its NASA, US Air Force and commercial customers.

statistical analysis↗
NASA NTRS2010

Kepler Science Operations Center Pipeline Framework

The Kepler mission is designed to continuously monitor up to 170,000 stars at a 30 minute cadence for 3.5 years searching for Earth-size planets. The data are processed at the Science Operations Center (SOC) at NASA Ames Research Center. Because of the large volume of data and the memory and CPU-intensive nature of the analysis, significant computing hardware is required. We have developed generic pipeline framework software that is used to distribute and synchronize the processing across a cluster of CPUs and to manage the resulting products. The framework is written in Java and is therefore platform-independent, and scales from a single, standalone workstation (for development and research on small data sets) to a full cluster of homogeneous or heterogeneous hardware with minimal configuration changes. A plug-in architecture provides customized control of the unit of work without the need to modify the framework itself. Distributed transaction services provide for atomic storage of pipeline products for a unit of work across a relational database and the custom Kepler DB. Generic parameter management and data accountability services are provided to record the parameter values, software versions, and other meta-data used for each pipeline execution. A graphical console allows for the configuration, execution, and monitoring of pipelines. An alert and metrics subsystem is used to monitor the health and performance of the pipeline. The framework was developed for the Kepler project based on Kepler requirements, but the framework itself is generic and could be used for a variety of applications where these features are needed.

Klaus, Todd C.↗
NASA NTRS1996

WINDII atmospheric wave airglow imaging

Preliminary WINDII nighttime airglow wave-imaging data in the UARS rolldown attitude has been analyzed with the goal to survey gravity waves near the upper boundary of the middle atmosphere. Wave analysis is performed on O[sub 2](0,0) emissions from a selected 1[sup 0] x 1[sup 0] oblique view of the airglow layer at approximately 95 km altitude, which has no direct earth background and only an atmospheric background which is optically thick for the 0[sub 2](0,0) emission. From a small data set, orbital imaging of atmospheric wave structures is demonstrated, with indication of large variations in wave activity across land and sea. Comparison ground-based imagery is discussed with respect to similarity of wave variations across land/sea boundaries and future orbital mosaic image construction.

Troposphere↗