Search NASA⌕ Search

SEARCH · Search NASA

Results for “CLOUD DATA”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Web-based visual data exploration for improved radiological source detection

Radiation detection can provide a reliable means of detecting radiological material. Such capabilities can help to prevent nuclear and/or radiological attacks, but reliable detection in uncontrolled surroundings requires algorithms that account for environmental background radiation. The Berkeley Data Cloud (BDC) facilitates the development of such methods by providing a framework to capture, store, analyze, and share data sets. In the era of big data, both the size and variety of data make it difficult to explore and find data sets of interest and manage the data. Thus, in the context of big data, visualization is critical for checking data consistency and validity, identifying gaps in data coverage, searching for data relevant to an analyst's use cases, and choosing input parameters for analysis. Downloading the data and exploring it on an analyst's desktop using traditional tools are no longer feasible due to the size of the data. This study describes the design and implementation of a visualization system that addresses the problems associated with data exploration within the context of the BDC. Finally, the visualization system is based on a JavaScript front end communicating via REST with a back end web server.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

An analysis of the first two years of GASP data

Distributions of mean ozone levels from the first two years of data from the NASA Global Atmospheric Sampling Program (GASP) show spatial and temporal variations in agreement with previous measurements. The standard deviations of these distributions reflect the large natural variability of ozone levels in the altitude range of the GASP measurements. Monthly mean levels of ozone below the tropopause show an annual cycle with a spring maximum which is believed to result from transport from the stratosphere. Correlations of ozone with independent meteorological parameters, and meteorological parameters obtained by the GASP systems show that this transport occurs primarily through cyclogenesis at mid-latitudes. The GASP water vapor data, analyzed with respect to the location of the tropopause, correlates well with the simultaneously obtained ozone and cloud data.

Holdeman, J. D.↗

A Collection of The Movies

This video contains computer-generated animation made from still data sets processed by computer to give the illusion of flying around the objects. 'Earth - The Movie' uses cloud data from satellites and geographical data from maps. 'L.A. - The Movie' was taken from Landsat data of the Los Angeles area. This was the first experimental demonstration of the technology. 'Mars - The Movie' was taken from Viking orbiter data. 'Miranda - The Movie' was made from a mosaic of 9 frames taken by Voyager of the Uranium moon, Miranda. The last movie is 'Monterey - The Bay.'

Source record↗

Towards Efficient Scientific Data Management Using Cloud Storage

A software prototype allows users to backup and restore data to/from both public and private cloud storage such as Amazon's S3 and NASA's Nebula. Unlike other off-the-shelf tools, this software ensures user data security in the cloud (through encryption), and minimizes users operating costs by using space- and bandwidth-efficient compression and incremental backup. Parallel data processing utilities have also been developed by using massively scalable cloud computing in conjunction with cloud storage. One of the innovations in this software is using modified open source components to work with a private cloud like NASA Nebula. Another innovation is porting the complex backup to- cloud software to embedded Linux, running on the home networking devices, in order to benefit more users.

He, Qiming↗

EDX Spatial: Leveraging cloud and hybrid data management resources for spatial data

In the last few years, the National Energy Technology Laboratory has started leveraging cloud-hosted services for hosting spatial data collections published on the Energy Data eXchange (EDX). Using cloud-hosted storage and compute options offers multiple benefits for visualization and tool development through utilization of spatial data resources. The transition from on-premises services to cloud-hosted services has enabled a few key features: increased accessibility of large derivative datasets, dynamic integration of external authoritative data resources directly from outside entities through representational state transfer application programming interfaces (REST API), and the ability to produce complex mapping applications, dashboards, and online maps. As a result of the shift, NETL has launched EDX Spatial, a platform that leverages on-premises resources combined with cloud compute capabilities to enable enhanced online mapping interfaces and optimize data access. In addition, a unified workflow for handling the public release of spatial data products through EDX has been developed, including standardization of data hosting practices, metadata, symbology, and application elements. This poster reviews the opportunity of leveraging cloud-hosted and hybrid data management solutions for spatial data, and discusses the benefits and lessons learned while leveraging these services through the data repository EDX.

Morkner, Paige↗

Applications and Improvement of a Coupled, Global and Cloud-Resolving Modeling System

Recently Grabowski (2001) and Khairoutdinov and Randall (2001) have proposed the use of 2D CFWs as a "super parameterization" [or multi-scale modeling framework (MMF)] to represent cloud processes within atmospheric general circulation models (GCMs). In the MMF, a fine-resolution 2D CRM takes the place of the single-column parameterization used in conventional GCMs. A prototype Goddard MMF based on the 2D Goddard Cumulus Ensemble (GCE) model and the Goddard finite volume general circulation model (fvGCM) is now being developed. The prototype includes the fvGCM run at 2.50 x 20 horizontal resolution with 32 vertical layers from the surface to 1 mb and the 2D (x-z) GCE using 64 horizontal and 32 vertical grid points with 4 km horizontal resolution and a cyclic lateral boundary. The time step for the 2D GCE would be 15 seconds, and the fvGCM-GCE coupling frequency would be 30 minutes (i.e. the fvGCM physical time step). We have successfully developed an fvGCM-GCE coupler for this prototype. Because the vertical coordinate of the fvGCM (a terrain-following floating Lagrangian coordinate) is different from that of the GCE (a z coordinate), vertical interpolations between the two coordinates are needed in the coupler. In interpolating fields from the GCE to fvGCM, we use an existing fvGCM finite- volume piecewise parabolic mapping (PPM) algorithm, which conserves the mass, momentum, and total energy. A new finite-volume PPM algorithm, which conserves the mass, momentum and moist static energy in the z coordinate, is being developed for interpolating fields from the fvGCM to the GCE. In the meeting, we will discuss the major differences between the two MMFs (i.e., the CSU MMF and the Goddard MMF). We will also present performance and critical issues related to the MMFs. In addition, we will present multi-dimensional cloud datasets (i.e., a cloud data library) generated by the Goddard MMF that will be provided to the global modeling community to help improve the representation and performance of moist processes in climate models and to improve our understanding of cloud processes globally (the software tools needed to produce cloud statistics and to identify various types of clouds and cloud systems from both high-resolution satellite and model data will be also presented).

Tao, W.-K.↗

A 'special effort' to provide improved sounding and cloud-motion wind data for FGGE

Enhancement and editing of high-density cloud motion wind assessments and research satellite soundings have been necessary to improve the quality of data used in The Global Weather Experiment. Editing operations are conducted by a man-computer interactive data access system. Editing will focus on such inputs as non-US satellite data, NOAA operational sounding and wind data sets, wind data from the Indian Ocean satellite, dropwindsonde data, and tropical mesoscale wind data. Improved techniques for deriving cloud heights and higher resolution sounding in meteorologically active areas are principal parts of the data enhancement program.

Greaves, J. R.↗

NASA Global Atmospheric Sampling Program (GASP) data report for tapes VL0010 and VL0012

The GASP atmospheric trace constituent data currently available are considered. Included on tapes are in-situ measurements of atmospheric ozone, carbon monoxide, water vapor, and clouds, data from laboratory analysis of filters exposed in flight, and related flight and meteorological data. Measurements of ozone levels within the first class cabin of these aircraft are also reported. In addition to the GASP data, tropopause pressures obtained from time and space interpolation of NMC archived data for the dates of the flights are included. Reported herein are the flight routes and dates, instrumentation, data processing procedures, data tape specifications, and analyses of the cabin ozone measurements.

Holdeman, J. D.↗

The 27-28 October 1986 FIRE IFO Cirrus Case Study: Cloud Optical Properties Determined by High Spectral Resolution Lidar

During the First ISCCP Region Experiment (FIRE) cirrus intensive field observation (IFO) the High Spectral Resolution Lidar was operated from a roof top site on the University of Wisconsin-Madison campus. Because the HSRL technique separately measures the molecular and cloud particle backscatter components of the lidar return, the optical thickness is determined independent of particle backscatter. This is accomplished by comparing the known molecular density distribution to the observed decrease in molecular backscatter signal with altitude. The particle to molecular backscatter ratio yields calibrated measurements of backscatter cross sections that can be plotted ro reveal cloud morphology without distortion due to attenuation. Changes in cloud particle size, shape, and phase affect the backscatter to extinction ratio (backscatter-phase function). The HSRL independently measures cloud particle backscatter phase function. This paper presents a quantitative analysis of the HSRL cirrus cloud data acquired over an approximate 33 hour period of continuous near zenith observations. Correlations between small scale wind structure and cirrus cloud morphology have been observed. These correlations can bias the range averaging inherent in wind profiling lidars of modest vertical resolution, leading to increased measurement errors at cirrus altitudes. Extended periods of low intensity backscatter were noted between more strongly organized cirrus cloud activity. Optical thicknesses ranging from 0.01-1.4, backscatter phase functions between 0.02-0.065 sr (exp -1) and backscatter cross sections spanning 4 orders of magnitude were observed. the altitude relationship between cloud top and bottom boundaries and the cloud optical center altitude was dependent on the type of formation observed Cirrus features were observed with characteristic wind drift estimated horizontal sizes of 5-400 km. The clouds frequently exhibited cellular structure with vertical to horizontal dimension ratios of 1:5-1:1.

Grund, C. J.↗

Accurate Satellite-Derived Estimates of Tropospheric Ozone Radiative Forcing

Estimates of the radiative forcing due to anthropogenically-produced tropospheric O3 are derived primarily from models. Here, we use tropospheric ozone and cloud data from several instruments in the A-train constellation of satellites as well as information from the GEOS-5 Data Assimilation System to accurately estimate the instantaneous radiative forcing from tropospheric O3 for January and July 2005. We improve upon previous estimates of tropospheric ozone mixing ratios from a residual approach using the NASA Earth Observing System (EOS) Aura Ozone Monitoring Instrument (OMI) and Microwave Limb Sounder (MLS) by incorporating cloud pressure information from OMI. Since we cannot distinguish between natural and anthropogenic sources with the satellite data, our estimates reflect the total forcing due to tropospheric O3. We focus specifically on the magnitude and spatial structure of the cloud effect on both the shortand long-wave radiative forcing. The estimates presented here can be used to validate present day O3 radiative forcing produced by models.

Joiner, Joanna↗

Impact of Data Placement on Resilience in Large-Scale Object Storage Systems

Distributed object storage architectures have become the de facto standard for high-performance storage in big data, cloud, and HPC computing. Object storage deployments using commodity hardware to reduce costs often employ object replication as a method to achieve data resilience. Repairing object replicas after failure is a daunting task for systems with thousands of servers and billions of objects, however, and it is increasingly difficult to evaluate such scenarios at scale on realworld systems. Resilience and availability are both compromised if objects are not repaired in a timely manner. In this work we leverage a high-fidelity discrete-event simulation model to investigate replica reconstruction on large-scale object storage systems with thousands of servers, billions of objects, and petabytes of data. We evaluate the behavior of CRUSH, a well-known object placement algorithm, and identify configuration scenarios in which aggregate rebuild performance is constrained by object placement policies. After determining the root cause of this bottleneck, we then propose enhancements to CRUSH and the usage policies atop it to enable scalable replica reconstruction. We use these methods to demonstrate a simulated aggregate rebuild rate of 410 GiB/s (within 5% of projected ideal linear scaling) on a 1,024-node commodity storage system. We also uncover an unexpected phenomenon in rebuild performance based on the characteristics of the data stored on the system.

Carns, Philip↗

Towards Automated/Semiautomated Extraction of Faults from Lidar Data

The Pajarito fault system is a complex zone of deformation and a seismically active region nestled within the Rio Grande rift in north-central New Mexico. Numerous laterally discontinuous faults and associated folds and fractures interact in a manner that has important implications for seismic hazards and risk mitigation. Previous efforts have established a foundation for the location of lineaments and structures in the Pajarito fault system; however, ensuring the completeness of the current lineament mapping is required for identifying areas for field validation, evaluating the potential for future seismic activity, and better understanding fault interaction. Assistance with this fault-mapping task via automated or semiautomated techniques as applied to lidar data over a large area of interest is highly desirable. A proof-of-concept processing flow which transforms lidar point-cloud data into a raster of surficial fault candidates is described and illustrated herein. We report these initial results hold great promise toward achieving our ultimate goal.

58 GEOSCIENCES↗

The analysis of polar clouds from AVHRR satellite data using pattern recognition techniques

The cloud cover in a set of summertime and wintertime AVHRR data from the Arctic and Antarctic regions was analyzed using a pattern recognition algorithm. The data were collected by the NOAA-7 satellite on 6 to 13 Jan. and 1 to 7 Jul. 1984 between 60 deg and 90 deg north and south latitude in 5 spectral channels, at the Global Area Coverage (GAC) resolution of approximately 4 km. This data embodied a Polar Cloud Pilot Data Set which was analyzed by a number of research groups as part of a polar cloud algorithm intercomparison study. This study was intended to determine whether the additional information contained in the AVHRR channels (beyond the standard visible and infrared bands on geostationary satellites) could be effectively utilized in cloud algorithms to resolve some of the cloud detection problems caused by low visible and thermal contrasts in the polar regions. The analysis described makes use of a pattern recognition algorithm which estimates the surface and cloud classification, cloud fraction, and surface and cloudy visible (channel 1) albedo and infrared (channel 4) brightness temperatures on a 2.5 x 2.5 deg latitude-longitude grid. In each grid box several spectral and textural features were computed from the calibrated pixel values in the multispectral imagery, then used to classify the region into one of eighteen surface and/or cloud types using the maximum likelihood decision rule. A slightly different version of the algorithm was used for each season and hemisphere because of differences in categories and because of the lack of visible imagery during winter. The classification of the scene is used to specify the optimal AVHRR channel for separating clear and cloudy pixels using a hybrid histogram-spatial coherence method. This method estimates values for cloud fraction, clear and cloudy albedos and brightness temperatures in each grid box. The choice of a class-dependent AVHRR channel allows for better separation of clear and cloudy pixels than does a global choice of a visible and/or infrared threshold. The classification also prevents erroneous estimates of large fractional cloudiness in areas of cloudfree snow and sea ice. The hybrid histogram-spatial coherence technique and the advantages of first classifying a scene in the polar regions are detailed. The complete Polar Cloud Pilot Data Set was analyzed and the results are presented and discussed.

Smith, William L.↗