Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud computing, data cloud”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Towards a program of record of inland water quality: Exploiting present and heritage multispectral sensors for maximum information extraction

Degradation of Earth’s inland water resources due to anthropogenic perturbations and climate anomalies at both local and global scales continues to place human health at substantial risk. There is now a growing necessity to develop pragmatic approaches that allow timely and effective extrapolation of local processes, to spatially resolved global products, and to promote operational and sustainable resource policy management. This research exploits recent advancements in bio-optical modeling, cloud computing, and machine learning to enhance our capacity to leverage present and heritage satellite data. Recent research suggests that sensors with low spectral resolution, such as Sentinel 2 and Landsat missions, contain enough hidden spectral variation which can be exploited using data-driven approaches. The availability of three decades of archival imagery will open doors to discover global trends of eutrophication and increased cyanobacteria dominance and provide valuable insight to the development of predictive methodologies. Preliminary efforts in synthetic emulation of global natural inland waters will be discussed and contextualized against satellite radiometric measurement uncertainty, satellite data product uncertainties and causal signal ambiguity over the visible wavelength range, supported by high quality field and image data for selected inland aquatic sites. Insights on water quality estimation via data-driven machine learning models versus matrix inversions will be discussed, and how we can exploit spectral-spatial relationships in high spatial resolution data. A cross-sensor synergistic approach with detailed uncertainty analysis based on optical water types, will allow for unprecedented global snapshots of fine scale ecological dynamics of inland waters.

Inland↗

Clouds of ammonia ice - Laboratory measurements of the single-scattering properties

A new apparatus for the growth of clouds of ammonia and water ice has been developed which represents an improvement over the one constructed by Holmes (1981). Better thermal control of the cloud chamber has been achieved so that colder temperature relevant to the outer planets' atmospheres could be reached. The angular resolution of the scattering measurements has been improved from 10 deg to about 2 deg. A rotating filter wheel combined with a much larger computer allows a complete data set to be collected in three colors once per second. This capability is important in monitoring cloud properties as they change with time and in collecting data on larger crystals which can fall through the beam in a few seconds.

Pope, Shelly K.↗

Exploring New Frontiers in Space Communications: Enhancing Delay Tolerant Networking through Cloud and Containerization

The High-rate Delay Tolerant Networking (HDTN) project at NASA Glenn Research Center has developed software that enables more flexible, reliable, and efficient space internetworking by using modern computing techniques such as cloud services, microservices, network function virtualization, software defined networking, and a distributed architecture. HDTN is built upon the Bundle Protocol and related convergence layers which have been developed to mitigate the challenges of the space networking environment including long delays, asymmetric data rates, and intermittent connectivity. The HDTN implementation employs asynchronous message processing tasks which allow for non-blocking operations as well as deployment in both centralized and distributed architectures. This paper investigates deploying HDTN in a containerized approach on the NASA Goddard’s Mission Cloud Platform using Amazon Web Services Elastic Compute Cloud (EC2). Commercial cloud computing will lower operating costs, provide flexible resource allocation, and allow for interconnectivity between multiple NASA centers as well as external partners. Containerization using Docker will enable greater portability and scalability for HDTN to be deployed into a variety of environments. We discuss possible NASA missions and use-cases such as the Laser Communications Relay Demonstration (LCRD) where the services provided by HDTN (reliable transport, high-rate message processing, and store-and-forward capabilities) will be enhanced through cloud computing and containerization. In addition, we describe the HDTN architecture and possible microservice-based networking approaches that can be obtained via HDTN’s configuration capabilities. Finally, we detail the EC2 specifications needed to achieve data rates greater than 1 Gbps to support optical communication missions such as LCRD.

Blake LaFuente↗

GeoNEX: A Geostationary Earth Observatory

The latest generation of geostationary satellites (Himawari 8/9, GOES-16/17, FY-4, GK-2A) carries sensors that closely mimic the spatial and spectral characteristics of widely used polar-orbiting, global monitoring sensors such as MODIS and VIIRS. When combined, data from various currently operating/planned geostationary platforms provide a geo-ring of hyper-temporal (5-10 minutes), multispectral observations at spatial resolutions as high as 500 m. These high frequency observations offer exciting new possibilities for monitoring our planet, including better retrievals of geophysical variables by overcoming cloud cover, enabling studies of diurnally varying phenomena in the atmosphere, land, and the oceans, and support operational decision-making in agriculture, hydrology and disaster management. The NASA Earth Exchange (NEX) team, in collaboration with scientists from JAXA, KARI, NOAA and other international institutions, created the GeoNEX (www.nasa.gov/geonex) pipeline to integrate data from all available geostationary platforms and produce and distribute spatially, temporally, and radiometrically consistent data for the earth science community. We envision various institutions adapting the Geo component (e.g., GeoNOAA, GeoKARI, GeoChiba, GeoJAXA, GeoCMA) and customizing the pipeline and downstream products to serve the local/regional research and applied science communities. To facilitate collaborative work among the partners, we have established the OpenNEX platform on the public cloud. OpenNEX provides researchers, developers, educators, and ordinary users with easy access to an integrated Earth science computational and data platform, enabling citizen scientists and application developers to realize the full value of GeoNEX data assets and software tools.

GeoNEX↗

Why NASA Earthdata Went to the Cloud

NASA earth science data will be easily accessible to all in an environment that allows the leverage of compute capabilities required for earth science visualization and analysis today and for the foreseeable future.

Doug Newman↗

TPSAS-NF1676L-12839-DND

Hyper-spectral remote sensors, such as Atmospheric Infrared Sounder (AIRS) and Infrared Atmospheric Sounding Interferometer (IASI), provides top of atmospheric radiances with high information content on atmospheric and surface properties. In order to analyze these data in real time, fast, and accurate forward and inverse models are needed. We will describe a method of simultaneously retrieving atmospheric temperature, moisture, cloud, and surface properties using all available spectral channels without sacrificing computational speed. The method has been successfully applied to AIRS, IASI, and NAST-I data. By applying the same method to the current and future hyperspectral sounders, the derived products will have less errors due to biases introduced by different retrieval methods. We have compared the retrieved products to radiosondes, aircraft measurements and other validation dataset. Simulations have done to quantify retrieval errors associated with the retrievals. The essence of the method is to convert channel radiance spectra into super-channels by an Empirical Orthogonal Function (EOF) transformation. A Principal Component-based Radiative Transfer Model (PCRTM) developed at NASA Langley Research Center is used to calculate both the super-channel magnitudes and derivatives with respect to atmospheric profiles and other properties. The inversion algorithm is based on a non-linear Levenberg-Marquardt method with climatology covariance matrices and a priori information as constraints. One advantage of this approach is that it uses all information content from the hyper-spectral data so that the retrieval is less sensitive to instrument noise and eliminates the need for selecting a subset of the channels. The PCRTM forward model has also been used to performance end-to-end sensor performance simulations of the Climate Absolute Radiance and Refractivity Observatory (CLARREO).

Xu Liu↗

The structure of the clouds distributed operating system

A novel system architecture, based on the object model, is the central structuring concept used in the Clouds distributed operating system. This architecture makes Clouds attractive over a wide class of machines and environments. Clouds is a native operating system, designed and implemented at Georgia Tech. and runs on a set of generated purpose computers connected via a local area network. The system architecture of Clouds is composed of a system-wide global set of persistent (long-lived) virtual address spaces, called objects that contain persistent data and code. The object concept is implemented at the operating system level, thus presenting a single level storage view to the user. Lightweight treads carry computational activity through the code stored in the objects. The persistent objects and threads gives rise to a programming environment composed of shared permanent memory, dispensing with the need for hardware-derived concepts such as the file systems and message systems. Though the hardware may be distributed and may have disks and networks, the Clouds provides the applications with a logically centralized system, based on a shared, structured, single level store. The current design of Clouds uses a minimalist philosophy with respect to both the kernel and the operating system. That is, the kernel and the operating system support a bare minimum of functionality. Clouds also adheres to the concept of separation of policy and mechanism. Most low-level operating system services are implemented above the kernel and most high level services are implemented at the user level. From the measured performance of using the kernel mechanisms, we are able to demonstrate that efficient implementations are feasible for the object model on commercially available hardware. Clouds provides a rich environment for conducting research in distributed systems. Some of the topics addressed in this paper include distributed programming environments, consistency of persistent data and fault-tolerance.

Dasgupta, Partha↗

Proposed Use of the NASA Ames Nebula Cloud Computing Platform for Numerical Weather Prediction and the Distribution of High Resolution Satellite Imagery

The development of the Nebula Cloud Computing Platform at NASA Ames Research Center provides an open-source solution for the deployment of scalable computing and storage capabilities relevant to the execution of real-time weather forecasts and the distribution of high resolution satellite data to the operational weather community. Two projects at Marshall Space Flight Center may benefit from use of the Nebula system. The NASA Short-term Prediction Research and Transition (SPoRT) Center facilitates the use of unique NASA satellite data and research capabilities in the operational weather community by providing datasets relevant to numerical weather prediction, and satellite data sets useful in weather analysis. SERVIR provides satellite data products for decision support, emphasizing environmental threats such as wildfires, floods, landslides, and other hazards, with interests in numerical weather prediction in support of disaster response. The Weather Research and Forecast (WRF) model Environmental Modeling System (WRF-EMS) has been configured for Nebula cloud computing use via the creation of a disk image and deployment of repeated instances. Given the available infrastructure within Nebula and the "infrastructure as a service" concept, the system appears well-suited for the rapid deployment of additional forecast models over different domains, in response to real-time research applications or disaster response. Future investigations into Nebula capabilities will focus on the development of a web mapping server and load balancing configuration to support the distribution of high resolution satellite data sets to users within the National Weather Service and international partners of SERVIR.

Limaye, Ashutosh S.↗

A self-consistency approach to improve microwave rainfall rate estimation from space

A multichannel statistical approach is used to retrieve rainfall rates from the brightness temperature T(B) observed by passive microwave radiometers flown on a high-altitude NASA aircraft. T(B) statistics are based upon data generated by a cloud radiative model. This model simulates variabilities in the underlying geophysical parameters of interest, and computes their associated T(B) in each of the available channels. By further imposing the requirement that the observed T(B) agree with the T(B) values corresponding to the retrieved parameters through the cloud radiative transfer model, the results can be made to agree quite well with coincident radar-derived rainfall rates. Some information regarding the cloud vertical structure is also obtained by such an added requirement. The applicability of this technique to satellite retrievals is also investigated. Data which might be observed by satellite-borne radiometers, including the effects of nonuniformly filled footprints, are simulated by the cloud radiative model for this purpose.

Kummerow, Christian↗

Covariance analyses of satellite-derived mesoscale wind fields

Statistical structure functions have been computed independently for nine satellite-derived mesoscale wind fields that were obtained on two different days. Small cumulus clouds were tracked at 5 min intervals, but since these clouds occurred primarily in the warm sectors of midlatitude cyclones the results cannot be considered representative of the circulations within cyclones in general. The field structure varied considerably with time and was especially affected if mesoscale features were observed. The wind fields on the 2 days studied were highly anisotropic with large gradients in structure occurring approximately normal to the mean flow. Structure function calculations for the combined set of satellite winds were used to estimate random error present in the fields. It is concluded for these data that the random error in vector winds derived from cumulus cloud tracking using high-frequency satellite data is less than 1.75 m/s. Spatial correlation functions were also computed for the nine data sets. Normalized correlation functions were considerably different for u and v components and decreased rapidly as data point separation increased for both components. The correlation functions for transverse and longitudinal components decreased less rapidly as data point separation increased.

Maddox, R. A.↗

Bidirectional reflectance of the moonlit earth.

Use of OGO-4 airglow photometer data and computed lunar spectral irradiances at the subsatellite point to examine the highest radiance over clouds and lowest radiance over open ocean near 3914, 5577, 5893, 6225, and 6300 A in terms of bidirectional reflectance. The results are compared to and are consistent with mathematical models of the atmosphere developed by Plass and Kattawar (1968, 1970) and with daytime measurements from OSO-3 by Neel et al. (1969).

Fowler, W. B.↗

Technology for large digital mosaics of Landsat data

Procedures and software for the digital mosaicking of Landsat data are discussed. It is noted that image processing in support of JPL's planetary program has furnished the software and procedures necessary to achieve digital image mosaicking of vidicon imagery using rigid projective geometry. The incorporation of ground-control points, by either manual or automatic ground-control point file identification, has yielded rms positional accuracies exceeding the National Map Accuracy Standards. Rotation to north vertical is effected at low computational cost. It is possible to cut input data frames in any arbitrary shape to remove cloud cover and accommodate terrain offset effects. In similar fashion, the final digital mosaic can be segmented arbitrarily to conform to user requirements. Information is presented on applications in Pennsylvania and Bolivia.

Zobrist, A. L.↗

SEPAC data analysis in support of the environmental interaction program

The main objective is to conduct data analyses of SEPAC data and computer modeling to investigate spacecraft environment effects associated with injection of electron beam, plasma clouds, and neutral gas clouds from the Shuttle Orbiter. To understand the dependence of spacecraft charging potential on beam density and other plasma parameters, a two dimensional electrostatic particle code was used to simulate the injection of electron beams from an infinite conductor into a plasma. The ionization effects on spacecraft charging are examined by including interactions of electrons with neutral gases. A survey of the simulation results is presented and discussed.

Lin, C. S.↗

Cloud Classification in Polar and Desert Regions and Smoke Classification from Biomass Burning Using a Hierarchical Neural Network

This research focuses on a new neural network scene classification technique. The task is to identify scene elements in Advanced Very High Resolution Radiometry (AVHRR) data from three scene types: polar, desert and smoke from biomass burning in South America (smoke). The ultimate goal of this research is to design and implement a computer system which will identify the clouds present on a whole-Earth satellite view as a means of tracking global climate changes. Previous research has reported results for rule-based systems (Tovinkere et at 1992, 1993) for standard back propagation (Watters et at. 1993) and for a hierarchical approach (Corwin et al 1994) for polar data. This research uses a hierarchical neural network with don't care conditions and applies this technique to complex scenes. A hierarchical neural network consists of a switching network and a collection of leaf networks. The idea of the hierarchical neural network is that it is a simpler task to classify a certain pattern from a subset of patterns than it is to classify a pattern from the entire set. Therefore, the first task is to cluster the classes into groups. The switching, or decision network, performs an initial classification by selecting a leaf network. The leaf networks contain a reduced set of similar classes, and it is in the various leaf networks that the actual classification takes place. The grouping of classes in the various leaf networks is determined by applying an iterative clustering algorithm. Several clustering algorithms were investigated, but due to the size of the data sets, the exhaustive search algorithms were eliminated. A heuristic approach using a confusion matrix from a lightly trained neural network provided the basis for the clustering algorithm. Once the clusters have been identified, the hierarchical network can be trained. The approach of using don't care nodes results from the difficulty in generating extremely complex surfaces in order to separate one class from all of the others. This approach finds pairwise separating surfaces and forms the more complex separating surface from combinations of simpler surfaces. This technique both reduces training time and improves accuracy over the previously reported results. Accuracies of 97.47%, 95.70%, and 99.05% were achieved for the polar, desert and smoke data sets.

Alexander, June↗

Performance Enhancement of a Computational Persistent Homology Package

In recent years, persistent homology has become an attractive method for data analysis. It captures topological features, such as connected components, holes, voids, etc., from a point cloud by finding out when these features appear and disappear in the filtration sequence. In this project, we focus on improving the performance of Eirene, a fancy computational persistent homology package. Eirene is a 5000-line opensource software implemented by using the dynamic programming language Julia. We use the Julia profiling tools to identify the performance bottlenecks and develop different methods to manage the bottlenecks, including the parallelization of some time-consuming functions on the multicore/manycore hardware. The empirical results show that the performance can be greatly improved.

Profiling↗

Cloud spatial structure during the FIRE MS IFO

The fractal properties of clouds observed during the FIRE Marine Stratocumulus Intensive Field Observations (MS IFO) and their effects on the large scale radiative properties of the atmosphere are examined. This involves three states: (1) analysis of LANDSAT Thematic Mapper (TM) cloud data to determine the scaling properties associated with various cloud types; (2) simulation of fractal clouds with realistic scaling properties; and (3) computation of mean radiative properties of fractal clouds as a function of their scaling properties. Thirty-three LANDSAT scenes were acquired as part of the FIRE Marine Stratocumulus IFO in July 1987. They exhibit a wide variety of stratocumulus structures. Analysis has so far focused upon the July 7 scene, in which the NASA ER-2, the BMO C130 and the NCAR Electra repeatedly gathered data across a stratocumulus-fair weather cumulus transition.

Cahalan, Robert F.↗

Aerosol Direct Radiative Effect at the Top of the Atmosphere Over Cloud Free Ocean Derived from Four Years of MODIS Data

A four year record of MODIS spaceborne data provides a new measurement tool to assess the aerosol direct radiative effect at the top of the atmosphere. MODIS derives the aerosol optical thickness and microphysical properties from the scattered sunlight at 0.55-2.1 microns. The monthly MODIS data used here are accumulated measurements across a wide range of view and scattering angles and represent the aerosol s spectrally resolved angular properties. We use these data consistently to compute with estimated accuracy of +/-0.6W/sq m the reflected sunlight by the aerosol over global oceans in cloud free conditions. The MODIS high spatial resolution (0.5 km) allows observation of the aerosol impact between clouds that can be missed by other sensors with larger footprints. We found that over the clear-sky global ocean the aerosol reflected 5.3+/-0.6W/sq m with an average radiative efficiency of 49+/-2W/sq m per unit optical thickness. The seasonal and regional distribution of the aerosol radiative effects are discussed. The analysis adds a new measurement perspective to a climate change problem dominated so far by models.

Remer, L. A.↗