Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud computing; data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
NASA NTRS2014

MERRA Analytic Services: Meeting the Big Data Challenges of Climate Science Through Cloud-enabled Climate Analytics-as-a-service

Climate science is a Big Data domain that is experiencing unprecedented growth. In our efforts to address the Big Data challenges of climate science, we are moving toward a notion of Climate Analytics-as-a-Service (CAaaS). We focus on analytics, because it is the knowledge gained from our interactions with Big Data that ultimately produce societal benefits. We focus on CAaaS because we believe it provides a useful way of thinking about the problem: a specialization of the concept of business process-as-a-service, which is an evolving extension of IaaS, PaaS, and SaaS enabled by Cloud Computing. Within this framework, Cloud Computing plays an important role; however, we it see it as only one element in a constellation of capabilities that are essential to delivering climate analytics as a service. These elements are essential because in the aggregate they lead to generativity, a capacity for self-assembly that we feel is the key to solving many of the Big Data challenges in this domain. MERRA Analytic Services (MERRAAS) is an example of cloud-enabled CAaaS built on this principle. MERRAAS enables MapReduce analytics over NASAs Modern-Era Retrospective Analysis for Research and Applications (MERRA) data collection. The MERRA reanalysis integrates observational data with numerical models to produce a global temporally and spatially consistent synthesis of 26 key climate variables. It represents a type of data product that is of growing importance to scientists doing climate change research and a wide range of decision support applications. MERRAAS brings together the following generative elements in a full, end-to-end demonstration of CAaaS capabilities: (1) high-performance, data proximal analytics, (2) scalable data management, (3) software appliance virtualization, (4) adaptive analytics, and (5) a domain-harmonized API. The effectiveness of MERRAAS has been demonstrated in several applications. In our experience, Cloud Computing lowers the barriers and risk to organizational change, fosters innovation and experimentation, facilitates technology transfer, and provides the agility required to meet our customers' increasing and changing needs. Cloud Computing is providing a new tier in the data services stack that helps connect earthbound, enterprise-level data and computational resources to new customers and new mobility-driven applications and modes of work. For climate science, Cloud Computing's capacity to engage communities in the construction of new capabilies is perhaps the most important link between Cloud Computing and Big Data.

Data Analytics↗
NASA NTRS1999

Sensitivity Analysis of Aerosol Retrieval Algorithms Using Two-Channel Satellite Radiance Data

We discuss the methodology of interpreting channel 1 and 2 AVHRR radiance data to retrieve tropospheric aerosol properties over the ocean and describe a detailed analysis of the sensitivity of monthly average retrievals to the assumed aerosol models. We use real AVHRR data and accurate numerical techniques for computing single and multiple scattering and spectral absorption of light in the vertically inhomogeneous atmosphere-ocean system. Our analysis shows that two-channel algorithms can provide significantly more accurate retrievals of the aerosol optical thickness than one-channel algorithms and that imperfect cloud screening is the largest source of errors in the retrieved optical thickness. Both underestimating and overestimating aerosol absorption as well as strong variability of the aerosol refractive index may lead to regional and/or seasonal biases in optical thickness retrievals. The Angstrom exponent appears to be the most invariant aerosol size characteristic and should be retrieved along with optical thickness as the second aerosol parameter.

Geogdzhayev, Igor V.↗
NASA NTRSDate not supplied

TPSAS-NF1676L-11082-DND

Analysis of one decade of radar-lidar and Geostationary Operational Environmental Satellite (GOES) observations at the Atmospheric Radiation Measurement (ARM) Program Southern Great Plains (SGP) site reveals that there is excellent agreement in the long-term mean cloud fractions (CF) derived from the surface and GOES data, and the CF is independent of temporal resolution and spatial scales for grid boxes of size 0.5o to 2.5°. When computed over a 0.5-hr (4-hr) period, cloud frequency of occurrence (FREQ) and amount when present (AWP) derived from the point surface data agree very well with the same quantities determined from GOES for a 0.5o (2.5o) region centered on the ARM SGP site. The values of FREQ (AWP) derived from the radar-lidar observations at a given altitude increase (decrease) as the averaging period increases from 5 min to 6 hours. Similarly, CF at a given altitude increases as the vertical resolution increases from 90 to 1000 m. The profiles of CF have distinct bimodal vertical distributions with a lower peak between 1 and 2 km and a higher one between 8 and 11 km. The 10-year mean total CF, 46.9%, varies seasonally from a summer minimum of 39.8% to a maximum of 54.6% during the winter. The annual mean CF is 1-2% less than that from previous studies, ~48-49%, because fewer clouds occurred during 2005 and 2006, especially during winter. The differences in single- and multi-layered CFs between this study and an earlier analysis can be explained by the different temporal resolutions used in the two studies where single-layered CFs decrease but multilayered CFs increase from a 5-min resolution to a 1-hr resolution. The vertical distribution of nighttime GOES high-cloud tops agrees well with surface observations, but during daytime, fewer high clouds are retrieved by the GOES analysis than seen from the surface observations. The frequencies of occurrence for both daytime and nighttime GOES low-cloud tops are significantly higher than surface observations, but the cloud fractions are in good agreement.

B Xi↗
NASA NTRSDate not supplied

Web-based Visualization and Analytics of Petascale Data: Equity as a Tide that Lifts All Boats

Scientists generate petabytes of data daily to help uncover environmental trends or behaviors that are hard to predict. For example, understanding climate simulations based on the long-term average of temperature, precipitation, and other environmental variables is essential to predicting and establishing root causes of future undesirable scenarios and assessing possible mitigation strategies. While supercomputer centers provide a powerful infrastructure for generating petabytes of simulation output, accessing and analyzing these datasets interactively remains challenging on multiple fronts. This paper presents an approach to managing, visualizing, and analyzing petabytes of data within a browser on equipment ranging from the top NASA supercomputer to commodity hardware like a laptop. Our novel data fabric abstraction layer allows user-friendly querying of scientific information while hid-ing the complexities of dealing with file systems or cloud services.We also optimize network utilization while streaming from petas-cale repositories through state-of-the-art progressive compression algorithms. Based on this abstraction, we provide customizable dashboards that can be accessed from any device with any inter-net connection, enabling interactive visual analysis of vast amounts of data to a wide range of users - from top scientists with access to leadership-class computing environments to undergraduate students of disadvantaged backgrounds from minority-serving institutions. We focus on NASA’s use of petascale climate datasets as an example of particular societal impact and, therefore, a case where achieving equity in science participation is critical. We validate our approach by improving the ability of climate scientists to visually explore their data via two fully interactive dashboards. We further validate our approach by deploying the dashboards and simplified training materials in the classroom at a minority-serving institution.These dashboards, released in simplified form to the general public, contribute significantly to a broader push to democratize the access and use of climate data.

Data visualization↗
NASA NTRS1976

High resolution radiometric measurements of convective storms during the GATE experiment

Using passive microwave data from the NASA CV-990 aircraft and radar data collected during the Global Atmospheric Research Program Atlantic Tropical Experiment (GATE), an empirical model was developed relating brightness temperatures sensed at 19.35 GHz to surface rainfall rates. This model agreed well with theoretical computations of the relationship between microwave radiation and precipitation in the tropics. The GATE aircraft microwave data was then used to determine the detailed structure of convective systems. The high spatial resolution of the data permitted identification of individual cells which retained unique identities throughout their lifetimes in larger cloud masses and allowed analysis of the effects of cloud merger.

Fowler, G.↗
NASA NTRS1982

Satellite measurements of cloud reflectance and optical thickness

The cloud reflectance and the optical thickness have been computed with the aid of atmospheric models from the first eleven months (April 1970-February 1971) of backscattered ultraviolet (BUV) data over the Pacific Ocean. Both the cloud and the optical thickness are derived from the 380 nm channel by assuming that the entire IFOV (200 km) is filled by stratiform clouds. The analysis shows a large variability in the cloud reflectance in both the intertropic conversion zone (ITCZ) and the high latitudes. It is also found that for 90 percent of the time in the tropics, the clouds have an optical thickness of less than 10. An analysis of clouds with optical thickness between 10 and 20 shows that in the tropics the minimum frequency coincides with the dry zone at 2.5 deg S and the maximum frequency for clouds of optical thickness 10-20 is greater in summer than in winter and irrespective of the season; 50 percent of the time the clouds have an optical thickness less than 13.

Ahmad, Z.↗
NASA NTRS2006

Detection of Ice Polar Stratospheric Clouds from Assimilation of Atmospheric Infrared Sounder Data

A novel technique is presented for detection of ice polar stratospheric clouds (PSCs) that form at extremely low temperatures in the lower polar stratosphere during winter. Temperature is a major factor in determining abundance of PSCs, which in turn provide surfaces for heterogeneous chemical reactions leading to ozone loss and radiative cooling. The technique infers the presence of ice PSCs using radiances from the Atmospheric Infrared Sounder (AIRS) in the Goddard Earth Observing System version 5 (GEOS-5) data assimilation system. Brightness temperatures are computed from short-term GEOS-5 forecasts for several hundred AIRS channels, using a radiation transfer module. The differences between collocated AIRS observations and these computed values are the observed-minus-forecast (O-F) residuals in the assimilation system. Because the radiation model assumes clear-sky conditions, we hypothesize that these O-F residuals contain quantitative information about PSCs. This is confirmed using sparse data from the Polar Ozone and Aerosol Measurement (POAM) III occultation instrument. The analysis focuses on 0-F residuals for the 6.79pm AIRS moisture channel. At coincident locations, when POAM III detects ice clouds, the AIRS O-F residuals for this channel are lower than -2K. When no ice PSCs are evident in POAM III data, the AIRS 0-F residuals are larger. Given this relationship, the high spatial density of AIRS data is used to construct maps of regions where 0-F residuals are lower than -2K, as a proxy for ice PSCs. The spatial scales and spatio-temporal variations of these PSCs in the Antarctic and Arctic are discussed on the basis of these maps.

Stajner, Ivanka↗
NASA NTRS1999

Development and Validation of a Polar Cloud Algorithm for CERES

The objectives of this project, as described in the original proposal, were to develop an algorithm for diagnosing cloud properties over snow- and ice-covered surfaces, particularly at night, using satellite radiances from the Advanced Very High Resolution Radiometer (AVHRR) and High-resolution Infrared Radiation Sounder (HIRS) sensors. Products from this algorithm include a cloud mask and additional cloud properties such as cloud phase, amount, and height. The SIVIS software package, developed as a part of the CERES project, was originally the primary tool used to develop the algorithm, but as it is no longer supported we have had to pursue a new tool to enable the combination and analysis of collocated radiances from AVHRR and HIRS. This turned out to be a much larger endeavor than we expected, but we now have the data sets collocated (with many thanks to B. Baum for the fundamental code) and we have developed a nighttime cloud detection algorithm. Using this algorithm we have also computed realistic-looking cloud fractions from AVHRR brightness temperatures. A method to identify cloud phase has also been implemented. Atmospheric information from the TIROS Operational Vertical Sounder (TOVS) Polar Pathfinder Data Set, which includes temperature and moisture profiles as well as surface information, provides information required for determining cloud-top height.

Source record↗
NASA NTRS2004

Parameter Estimation in Atmospheric Data Sets

In this study the structure tensor technique is used to estimate dynamical parameters in atmospheric data sets. The structure tensor is a common tool for estimating motion in image sequences. This technique can be extended to estimate other dynamical parameters such as diffusion constants or exponential decay rates. A general mathematical framework was developed for the direct estimation of the physical parameters that govern the underlying processes from image sequences. This estimation technique can be adapted to the specific physical problem under investigation, so it can be used in a variety of applications in trace gas, aerosol, and cloud remote sensing. As a test scenario this technique will be applied to modeled dust data. In this case vertically integrated dust concentrations were used to derive wind information. Those results can be compared to the wind vector fields which served as input to the model. Based on this analysis, a method to compute atmospheric data parameter fields will be presented. .

Wenig, Mark↗
NASA NTRS2014

The Parallel System for Integrating Impact Models and Sectors (pSIMS)

We present a framework for massively parallel climate impact simulations: the parallel System for Integrating Impact Models and Sectors (pSIMS). This framework comprises a) tools for ingesting and converting large amounts of data to a versatile datatype based on a common geospatial grid; b) tools for translating this datatype into custom formats for site-based models; c) a scalable parallel framework for performing large ensemble simulations, using any one of a number of different impacts models, on clusters, supercomputers, distributed grids, or clouds; d) tools and data standards for reformatting outputs to common datatypes for analysis and visualization; and e) methodologies for aggregating these datatypes to arbitrary spatial scales such as administrative and environmental demarcations. By automating many time-consuming and error-prone aspects of large-scale climate impacts studies, pSIMS accelerates computational research, encourages model intercomparison, and enhances reproducibility of simulation results. We present the pSIMS design and use example assessments to demonstrate its multi-model, multi-scale, and multi-sector versatility.

crop modeling↗
NASA NTRS1984

Search for solar signals in GOES imagery and cloud climatology analysis

The digitization and analysis of 16mm GOES IR imagery to identify spatial and temporal variation in clouds is discussed, along with a cloud climatology analysis. Recently added to the Interactive Graphics Package was a Computer Image Analysis System. This system allows many new imaging techniques. One of the possibilities is the analysis of overall light intensity variations in six 10 degree square boxes across the intertropical convergence zone. This technique is discussed, as is a preliminary analysis of unnormalized data.

Markson, R. J.↗
NASA NTRS2016

The Matsu Wheel: A Cloud-Based Framework for Efficient Analysis and Reanalysis of Earth Satellite Imagery

Project Matsu is a collaboration between the Open Commons Consortium and NASA focused on developing open source technology for cloud-based processing of Earth satellite imagery with practical applications to aid in natural disaster detection and relief. Project Matsu has developed an open source cloud-based infrastructure to process, analyze, and reanalyze large collections of hyperspectral satellite image data using OpenStack, Hadoop, MapReduce and related technologies. We describe a framework for efficient analysis of large amounts of data called the Matsu "Wheel." The Matsu Wheel is currently used to process incoming hyperspectral satellite data produced daily by NASA's Earth Observing-1 (EO-1) satellite. The framework allows batches of analytics, scanning for new data, to be applied to data as it flows in. In the Matsu Wheel, the data only need to be accessed and preprocessed once, regardless of the number or types of analytics, which can easily be slotted into the existing framework. The Matsu Wheel system provides a significantly more efficient use of computational resources over alternative methods when the data are large, have high-volume throughput, may require heavy preprocessing, and are typically used for many types of analysis. We also describe our preliminary Wheel analytics, including an anomaly detector for rare spectral signatures or thermal anomalies in hyperspectral data and a land cover classifier that can be used for water and flood detection. Each of these analytics can generate visual reports accessible via the web for the public and interested decision makers. The result products of the analytics are also made accessible through an Open Geospatial Compliant (OGC)-compliant Web Map Service (WMS) for further distribution. The Matsu Wheel allows many shared data services to be performed together to efficiently use resources for processing hyperspectral satellite image data and other, e.g., large environmental datasets that may be analyzed for many purposes.

0↗
NASA NTRS2002

Correlations among the Optical Properties of Cirrus-Cloud Particles: Microphysical Interpretation

Cirrus measurements obtained with a ground-based polarization Raman lidar at 67.9 deg N in January 1997 reveal a strong positive correlation between the particle optical properties, specifically depolarization ratio delta(sub par) and extinction- to-backscatter (lidar) ratio S, for delta(sub par) less than approximately 40%, and an anti-correlation for delta(sub par) greater than approximately 40%. Over the length of the measurements the particle properties vary systematically. Initially, delta (sub par) approximately equals 60% and S approximately equals 10sr are observed. Then, with decreasing delta(sub par), S first increases to approximately 27sr (delta(sub par) approximately equals 40%) before decreasing to values around 10sr again (delta(sub par) approximately equals 20%). The analysis of lidar humidity and radiosonde temperature data shows that the measured optical properties stem from scattering by dry solid ice particles, while scattering by supercooled droplets, or by wetted or subliming ice particles can be excluded. For the microphysical interpretation of the lidar measurements, ray-tracing computations of particle scattering properties have been used. The comparison with the theoretical data suggests that the observed cirrus data can be interpreted in terms of size, shape, and, under the assumption that the lidar measurements of consecutive cloud segments can be mapped on the temporal development of a single cloud parcel moving along its trajectory, growth of the cirrus particles: Near the cloud top in the early stage of cirrus development, light scattering by nearly isometric particles that have the optical characteristics of hexagonal columns (short, column-like particles) is dominant. Over time the ice particles grow, and as the cloud base height extends to lower altitudes characterized by warmer temperatures they become morphologically diverse. For large S and depolarization values of approximately 40%, the scattering contributions of column- and plate-like particles are roughly the same. In the lower ranges of the cirrus clouds, light scattering is predominantly by plate-like ice particles. This interpretation assumes random orientation of the cirrus particles. Simulations with a simple model suggest, however, that the positive correlation between S and delta(sub par) which is observed for depolarization ratios less than 40% mainly at low cloud altitudes, can be alternatively explained by horizontal alignment of a fraction of the cirrus particle population.

Reichardt, J.↗
NASA NTRS1977

Land utilization and ecological aspects in the Sylhet-Mymensingh Haor Region of Bangladesh: An analysis of LANDSAT data

The use of remote sensing data from LANDSAT (ERTS) imageries in identifying, evaluating and mapping land use patterns of the Haor area in Bangladesh was investigated. Selected cloud free imageries of the area for the period 1972-75 were studied. Imageries in bands 4, 5 and 7 were mostly used. The method of analysis involved utilization of both human and computer services of information from ground, aerial photographs taken during this period and space imageries.

Chowdhury, M. I.↗
NASA NTRS1987

Low cost, microcomputer-based interactive analysis system for direct-reception and archived remote sensing data

A hardware/software system has been developed for use in meteorological field experiments and by developing countries which need low-cost remote sensing data analysis capabilities. The system can directly receive satellite transmissions of the AVHRR, TOVS, Argos, GOES, GMS, and Meteosat systems. Also, the system can process computer tapes from Landsat. Received data are ingested directly into the computer's disk storage, eliminating the need for a wide-band analog tape drive. Data may be interpreted in terms of cloud imagery, cloudtop temperature, sea surface temperature, vegetation index, and temperature/humidity profiles with overlays of geographic boundaries and latitude/longitude grids. The image processing, enhancement functions, and modeling capabilities of the system are discussed.

Vermillion, Charles H.↗
NASA NTRS2001

Results from Global Land-Surface Data Assimilation Methods

Realistic representation of the land surface is crucial in global climate modeling (GCM). Recently, the Mosaic land-surface Model (LSM) has been driven off-line using GEOS DAS (Goddard Earth Observing System Data Assimilation System) atmospheric forcing, forming the Off-line Land-surface Global Assimilation (OLGA) system. This system provides a computationally efficient test bed for land surface data assimilation. Here, we validate the OLGA simulation of surface processes and the assimilation of ISCCP surface temperatures. Another component of this study as the incorporation of the Physical-space Statistical Analysis System (PSAS) into OLGA, in order to assimilate surface temperature observations from the International Satellite Cloud Climatology Project (ISCCP). To counteract the subsequent forcing of the analyzed skin temperature back to the initial state following the analysis. incremental bias correction (IBC) was included in the assimilation. The IBC scheme effectively removed the time mean bias, but did not remove him in the mean diurnal cycle. Therefore, a diurnal him correction (DBC) scheme was developed, where the time-dependent bias was modeled with a sine wave parameterization. In addition, quality control of the ISCCP data and anisotropic temperature correction were implemented in PSAS. Preliminary results showed a substantial impact from the inclusion of PSAS and DBC that was visible in the surface meteorology fields and energy budget. Also, the monthly mean diurnal cycle from the experiment closely matched the diurnal cycle from the observations.

Radakovich, Jon D.↗
NASA NTRSDate not supplied

Building a Bilingual Google Earth Engine Dashboard to Increase Accessibility to Long-term Time Series Remote Sensing Data for Monitoring Saline System Changes in Chile’s Atacama Desert

Saline systems, consisting of salt flats, ponds, and marshes, provide vital water resources to wildlife and communities in northern Chile’s Atacama Desert, one of the driest regions in the world. Mining is extensive in the Atacama, which contains 30% of the world’s lithium reserves and is abundant in potassium and boron. The groundwater that feeds into salt marshes and ponds is extracted in large volumes for mining operations, limiting the availability of water for ecosystems. However, identifying long-term and large-scale environmental impacts from local lithium mining on the saline systems is limited by region inaccessibility and terrain variability. Open access satellite imagery and cloud computing technology has made studying Atacama saline systems feasible and allowed for collaboration across different agencies and countries. The NASA DEVELOP Program partnered with Chile’s la Universidad de La Serena and Servicio Nacional de Geología y Minería (SERNAGEOMIN) to create the Saline Analysis Tool (SalT) in Google Earth Engine (GEE). SalT is used to analyze the extent and distribution of remote saline systems in the Atacama from 1986 to the present day. The tool filters Landsat 5 Thematic Mapper (TM) and Landsat 8 Operational Land Imager (OLI) data from GEE’s data catalog and creates a single composite image per year for analysis. Additional output analyses include land cover classification, Normalized Difference Vegetation Index (NDVI) and Normalized Difference Water Index (NDWI) raster images that can be displayed on the map interface or exported. The tool can also generate time-lapse videos and charts displaying NDVI, NDWI, and land cover over time. A key feature of the tool is the use of a bilingual graphical user interface to make analysis accessible and customizable to different users’ needs—SalT provides options to select an analysis area, analysis time period, and outputs to display or export. The tool also incorporates new Earth observations as they are added to GEE’s catalog. The ability to easily visualize and analyze long-term remote sensing imagery will enable SERNAGEOMIN and la Universidad de la Serena to continually monitor changes in these saline systems and inform future land management policy.

NASA DEVELOP↗
NASA NTRS2023

Ames Contrail Simulation Model: Modeling Aviation Induced Contrails and the Computation of Contrail Radiative Forcing Using Air Traffic Data

NASA is developing traffic flow management strategies to reduce the impact of aviation on climate and improve efficiency of aircraft routes in the presence of limited airport and airspace capacity constraints, which are partly due to convective weather and natural calamities. Development of Strategic Traffic Flow Management (STFM) requires models of aircraft emissions and contrails, and models of their effect on climate. There is extensive literature on the modeling of contrails and the Radiative Forcing (RF) associated with contrails. This report captures the latest NASA developments in this research area and describes the integrated modeling, analysis, and software development to support STFM. Aircraft contrails are long, thin and often linear clouds triggered by aircraft engine exhausts in the high-altitude ice-saturated atmosphere. Contrails, similar to that of natural cirrus clouds, can impact global climate by reflecting shortwave radiation and trapping longwave radiation. Recent studies from the Intergovernmental Panel on Climate Change (IPCC) have shown that aircraft contrails are estimated to have greater impact on global warming than aircraft CO 2 emissions. The Ames Contrail Simulation Model (ACSM) presented in this report simulates the full life cycle of aircraft contrails, including their formation, dynamic evolution, and dissipation, and calculates the associated RF with actual meteorological and air traffic data. ACSM combines models from previous studies that focus on contrail formation and persistence based on the Schmidt-Appleman theoretical criteria, and it incorporates elements of cloud dynamics, microphysics, and climate modeling found in other surveyed contrail models, while also making adjustment for improved computational efficiency. In addition, ACSM is integrated with NASA's state-of-the-art flight simulation software for rapid assessment of aircraft contrail impacts. Applications include assessments of long-term global climate impact resulting from aviation-induced contrails and the design of optimal contrail-mitigation aircraft operation strategies.

aviation contrails↗