Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud computing; data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Automatic variable selection in ecological niche modeling: A case study using Cassin’s Sparrow (Peucaea cassinii)

MERRA/Max provides a feature selection approach to dimensionality reduction that enables direct use of global climate model outputs in ecological niche modeling. The system accomplishes this reduction through a Monte Carlo optimization in which many independent MaxEnt runs, operating on a species occurrence file and a small set of randomly selected variables in a large collection of variables, converge on an estimate of the top contributing predictors in the larger collection. These top predictors can be viewed as potential candidates in the variable selection step of the ecological niche modeling process. MERRA/Max’s Monte Carlo algorithm operates on files stored in the underlying filesystem, making it scalable to large data sets. Its software components can run as parallel processes in a high-performance cloud computing environment to yield near real-time performance. In tests using Cassin’s Sparrow (Peucaea cassinii) as the target species, MERRA/Max selected a set of predictors from Worldclim’s Bioclim collection of 19 environmental variables that have been shown to be important determinants of the species’ bioclimatic niche. It also selected biologically and ecologically plausible predictors from a more diverse set of 86 environmental variables derived from NASA’s Modern-Era Retrospective Analysis for Research and Applications Version 2 (MERRA-2) reanalysis, an output product of the Goddard Earth Observing System Version 5 (GEOS-5) modeling system. We believe these results point to a technological approach that could expand the use global climate model outputs in ecological niche modeling, foster exploratory experimentation with otherwise difficult-to-use climate data sets, streamline the modeling process, and, eventually, enable automated bioclimatic modeling as a practical, readily accessible, low-cost, commercial cloud service.

John L. Schnase↗

Remote sensing of ocean currents

The author has identified the following significant results. Fourteen field experiments in support of the NOAA investigation of ocean color boundary determination using ERTS-1 data have been conducted since June 1972. The boundary between coastal waters and the Loop Current has been detected by ERTS-1 as a result of sea state changes as well as color differences. Computer enchancement of MSS data are revealing many features not shown in the NDPF product. Analysis of the 24 channel MSS data shows that a thermal IR channel is required on an ERTS MSS to distinguish between atmospheric and sea state effects. Cloud cover analysis suggests the need for daily coverage of this type sensor for routinely useful oceanographic applications.

Maul, G. A.↗

Collapse and equilibrium of rotating, adiabatic clouds

A numerical hydrodynamics computer code analysis of the collapse and establishment of equilibrium of adiabatic gas clouds restricted to axial symmetry found that the clouds are originally uniform in density and rotation. The method can compare the dynamic collapse and approach to equilibrium with the data on incompressible uniformly rotating equilibrium clouds and on equilibrium structures of differentially rotating polytropes. It is concluded that the stellar formation theory indicates that the low alpha fragments produced at the termination of the dynamic isothermal collapse phase of interstellar clouds may undergo significant dynamic collapse in an adiabatic regime leading to transitory ring formation and additional fragmentation on a smaller scale.

Boss, A. P.↗

Icing Physics Studies Using the 3D SIDRM Test Article: Aerodynamic and Supercooled Liquid Icing Analysis

In-flight icing is an important safety issue and is a factor that affects aircraft design and performance. Newer regulations are driving a need for improvements in airframe and engine icing simulation capability. Experimental data is required for development of icing physics models and simulation validation. To that end, this paper discusses analyzed data from icing tests conducted with a 3D test article in 2022 at the NASA Icing Research Tunnel. The test article, whose geometry is representative of an inter-compressor duct and strut region of a turbofan engine, has been designed and constructed to study the physics of supercooled water icing and ice crystal icing. The surfaces of the Simulated Inter-compressor Duct Research Model (SIDRM) can be heated to simulate the warm surfaces of the turbofan inter-compressor duct. The test article is instrumented with pressure taps, heaters, heat flux gauges, and thermocouples, while a 3D laser scanner, cameras, and a scale to measure ice mass were utilized to characterize the icing behavior. The aim of these tests was to generate ice accretions on the SIDRM test article under well-characterized supercooled liquid icing and ice crystal icing conditions. This paper discusses measurements related to aerodynamic tests and supercooled liquid icing tests that were conducted. Aerodynamic measurements were analyzed and compared to computational simulations and were found to be in good agreement for the range of airspeeds (50 to 230 knots) and angles of attack (0 to 4°) tested. Various parametric sweeps were conducted during the supercooled liquid icing portion of the test entry (cloud median volumetric diameter ranged from 15 to 90 µm, total air temperature from -3 to -17 °C, angle of attack from 0 to 4°, and accretion time from 5 to 20 min). These sweeps were performed to measure that parameter’s impact on ice accretion size, location, characteristics (such as glaze/rime ice and shedding behavior), and test article surface temperature. Analysis of the test data showed that clouds composed of larger drops, colder air temperatures, smaller angles of attack, and longer spray times were the primary parameters that resulted in accretions with greater ice mass. Test article angle of attack and cloud droplet size influenced the location of ice accretion as these two parameters directly impact collection efficiency. With respect to icing characteristics, total air temperature dictated icing type, and smaller cloud drop size along with warmer air temperatures resulted in greater amounts of ice shedding. Surface temperature increased during ice accretion from the release of latent (fusion) heat, where total air temperature and cloud drop size impacted the amount of surface temperature change. The icing measurements collected during the SIDRM tests will be used to develop and validate 3D computational engine icing tools, such as GlennICE, that predictively assesses the onset and growth of ice. One of the goals of the sponsoring NASA project is to develop simulation models and tools that can assist in the design and certification of engines for flight in icing conditions in a cost‑effective way.

supercooled liquid icing↗

Water droplet impingement on airfoils and aircraft engine inlets for icing analysis

This paper includes the results of a significant research program for verification of computer trajectory codes used in aircraft icing analysis. Experimental water droplet impingement data have been obtained in the NASA Lewis Research Center Icing Research Tunnel for a wide range of aircraft geometries and test conditions. The body whose impingement characteristics are required is covered at strategic locations by thin strips of moisture absorbing (blotter) paper and then exposed to an airstream containing a dyed-water spray cloud. Water droplet impingement data are extracted from the dyed blotter strips by measuring the optical reflectance of the dye deposit on the strips with an automated reflectometer. Impingement characteristics for all test geometries have also been calculated using two recently developed trajectory computer codes. Good agreement is obtained with experimental data. The experimental and analytical data show that maximum impingement efficiency and impingement limits increase with mean volumetric diameter for all geometries tested. For all inlet geometries tested, as the inlet mass flow is reduced, the maximum impingement efficiency is reduced and the location of the maximum impingement shifts toward the inlet inner cowl.

Papadakis, Michael↗

ICESat-2 Atmospheric Channel Description, Data Processing and First Results

The Advanced Topographic Laser Altimeter System (ATLAS) was launched aboard the Ice Cloud and land-Elevation Satellite-2 (ICESat-2) satellite in September 2018. ATLAS is a single wavelength (532 nm) lidar system designed to acquire high resolution measurements of the earth's surface while also obtaining atmospheric backscatter from molecules, clouds, and aerosols. Because ATLAS is optimized for altimetry, the atmospheric data acquired is unique in many respects and requires non-standard analysis techniques. For example, the high repetition rate laser limits the vertical extent of the profiles to just 14 km and causes atmospheric scattering from above 15 km to be added to the scattering in the lower 0–14 km profile. In addition, the limited vertical range of the acquired profiles renders it difficult to compute the magnitude of the solar background and hinders the application of standard calibration techniques. Despite these limitations, methods have been developed to successfully produce data products that have value to the atmospheric community for cloud and aerosol research and are currently available at the National Snow and Ice Data Center (NSIDC). In this paper we describe the ICESat-2 atmospheric channel and the methods used to process the ATLAS raw photon count data to obtain calibrated backscatter and higher level products such as layer heights and type, blowing snow, column optical depth and apparent surface reflectance.

Stephen P Palm↗

Properties of aerosols in the Martian atmosphere, as inferred from Viking Lander imaging data

Three types of aerosol were detected from observations of the Martian sky, Phobos, and the sun with the Viking imaging cameras. Atmospheric optical depths were derived from observations of the objects' brightness. Data on the absorption coefficient, mean size, and shape of aerosols were obtained from studies of the sky brightness, using a multiple-scattering computer code. The aerosol types were water ice ground fog, a higher-level ice cloud (polar hood), and soil particles suspended at heights up to 30 km. The properties of each type of aerosol are discussed. The data are subjected to thorough analysis, and the results are summarized.

Pollack, J. B.↗

TPSAS-NF1676L-10726-DND

The principal component radiative transfer model PCRTM (Xu 2006) simulates spectral longwave radiance at a 0.5cm-1 resolution over the wavelengths (50-2760cm-1) using 280 principal components. The CERES product SSF containing CERES field-of-view (FOV) cloud properties based on MODIS pixel information are used as inputs. NASA GMAO(Global Modeling and Assimilation Office)Geos-4 temperature and humidity profiles, as well as SMOBA (Stratosphere Monitoring Ozone Blended Analysis) ozone profiles allow computations for five years (Jan 2001- Dec 2006) of FOV nadir spectral radiance. The approximately twice daily FOV PCRTM simulations along with CERES broadband measurements are time-space averaged to 10deg zonal monthly data. Analysis of monthly seasonal and deseasonalized interannual variability in terms of brightness temperature are presented. Comparison of interannual variability in the portions of the spectrum seen by the AIRS instrument are shown. Comparisons of spectral integrated PCRTM simulations to CERES broadband longwave radiance measurements are made. In order to study the sensitivity of the spatially and temporally averaged TOA spectrum to various atmospheric properties, we perturbed atmospheric and surface temperatures, humidity, cloud height, cloud fraction, and particle size. The sensitivity of the spectrum to these properties depends on region and seasons. Month to month variability of the longwave spectra to these perturbations is 10 to 20% of the global monthly mean perturbation response. In addition, it depends on time period and size of the area used for averaging spectra. In this poster, the magnitude of sensitivity variability and how the sensitivity changes depending on temporal and spatial scale of averaging will be discussed.

Fred G. Rose↗

Analysis of TRMM Microphysical Measurements: Tropical Rainfall Measuring Mission (TRMM)

SPEC Incorporated participated in three of the four TRMM field campaigns (TEFLUN-A, TEFLUN-B and KWAJEX), installing and operating a cloud particle imager (CPI) and a high volume precipitation spectrometer (HVPS) on the SPEC Learjet in TEFLUN-A, the University of North Dakota Citation in TEFLUN-B and KWAJEX, and a CPI on the NASA DC-8 in KWAJEX. This report presents and discusses new software tools and algorithms that were developed to analyze microphysical data collected during these field campaigns, as well as scientific interpretations of the data themselves. Software algorithms were developed to improve the analysis of microphysical measurements collected by the TRMM aircraft during the field campaigns. Particular attention was paid to developing and/or improving algorithms used to compute particle size distributions and ice water content. Software was also developed in support of production of the TRMM Common Microphysical Product (CMP) data files. CMP data files for TEFLUN-A field campaign were produced and submitted to the DAAC. Typical microphysical properties of convective and stratiform regions from TEFLUN-A and KWAJEX clouds were produced. In general, it was found that in the upper cloud region near -20 to -25 C, stratiform clouds contain very high (greater than 1 per cubic centimeter) concentrations of small ice particles, which are suspected to be a residual from homogeneous freezing and sedimentation of small drops in a convective updraft. In the upper cloud region near -20 to -25 C, convective clouds contain aggregates, which are not found lower in the cloud. Stratiform clouds contain aggregates at all levels, with the majority in the lowest levels. Convective cloud regions contain much higher LWC and drop concentrations than stratiform regions at all levels, and higher LWC in the middle and upper regions. Stratiform clouds contain higher IWC than convective clouds only at the lowest level. Irregular shaped ice particles are found in very high concentrations throughout both convective and stratiform cloud regions. A striking difference in particle shape in cirrus formed in situ, cirrus formed from maritime anvils and cirrus formed from continental anvils. Over 50% of the mass of in situ cirrus ice particles is composed of bullet rosettes, while bullet rosettes are virtually non-existent in maritime and tropical anvils. Tropical anvils are composed of mostly singular, plates, capped columns, and blocky irregular shapes, while continental anvils have a much higher percentage of aggregates, some of which are chains of small spheroidal particles that appear to result from homogeneous freezing of drops. A correlation between high electric fields in continental anvils and the formation of aggregates is hypothesized.

Source record↗

Determination of cloud fields from analysis of HIRS2/MSU sounding data

IR and microwave remote sensing data collected with the HIRS2 and MSU sensors on the NOAA polar-orbiting satellites were evaluated for their effectiveness as bases for determining the cloud cover and cloud physical characteristics. Techniques employed to adjust for day-night alterations in the radiance fields are described, along with computational procedures applied to compare scene pixel values with reference values for clear skies. Sample results are provided for the mean cloud coverage detected over South America and Africa June 1979, with attention given to concurrent surface pressure and cloud top pressure values.

Susskind, J.↗

Altitude determination and descriptive analysis of clouds on ERTS-1 multispectral photography

A simple method to determine the approximate altitude of clouds is described, with the objective of refining their classification using only marginal data from the photographs. Results of the application of this method on photographs of the Goajira Peninsula, Paraguana Peninsula and the Central Coast of Venezuela are presented. Here, the altitudes computed are used to classify clouds and to identify the genus of others without typical form. Instability of air masses through clouds vertical development, and wind direction as well as other local climatic characteristics such as moisture content, loci of condensation, area, etc. are determined using repetitive coverage for the time interval of the photography. Applications for the regional and urban planning (including airport location and flights schedule) and natural resources evaluation are suggested.

Albrizzio, C.↗

Cloud Properties Derived from Surface-Based Near-Infrared Spectral Transmission

Surface based near-infrared cloud spectral transmission measurements from a recent precipitation/cloud physics field study are used to determine cloud physical properties and relate them to other remote sensing and in situ measurements. Asymptotic formulae provide an effective means of closely approximating the qualitative and quantitative behavior of transmission computed by more laborious detailed methods. Relationships derived from asymptotic formulae are applied to measured transmission spectra to test objectively the internal consistency of data sets acquired during the field program and they confirmed the quality of the measurements. These relationships appear to be very useful in themselves, not merely as a quality control measure, but also a potentially valuable remote-sensing technique in its own right. Additional benefits from this analysis have been the separation of condensed water (cloud) transmission and water vapor transmission and the development of a method to derive cloud liquid water content.

Pilewskie, Peter↗

Climate Analytics as a Service

Climate science is a big data domain that is experiencing unprecedented growth. In our efforts to address the big data challenges of climate science, we are moving toward a notion of Climate Analytics-as-a-Service (CAaaS). CAaaS combines high-performance computing and data-proximal analytics with scalable data management, cloud computing virtualization, the notion of adaptive analytics, and a domain-harmonized API to improve the accessibility and usability of large collections of climate data. MERRA Analytic Services (MERRA/AS) provides an example of CAaaS. MERRA/AS enables MapReduce analytics over NASA's Modern-Era Retrospective Analysis for Research and Applications (MERRA) data collection. The MERRA reanalysis integrates observational data with numerical models to produce a global temporally and spatially consistent synthesis of key climate variables. The effectiveness of MERRA/AS has been demonstrated in several applications. In our experience, CAaaS is providing the agility required to meet our customers' increasing and changing data management and data analysis needs.

big data↗

GC31G-1182: Opennex, a Private-Public Partnership in Support of the National Climate Assessment

The NASA Earth Exchange (NEX) is a collaborative computing platform that has been developed with the objective of bringing scientists together with the software tools, massive global datasets, and supercomputing resources necessary to accelerate research in Earth systems science and global change. NEX is funded as an enabling tool for sustaining the national climate assessment. Over the past five years, researchers have used the NEX platform and produced a number of data sets highly relevant to the National Climate Assessment. These include high-resolution climate projections using different downscaling techniques and trends in historical climate from satellite data. To enable a broader community in exploiting the above datasets, the NEX team partnered with public cloud providers to create the OpenNEX platform. OpenNEX provides ready access to NEX data holdings on a number of public cloud platforms along with pertinent analysis tools and workflows in the form of Machine Images and Docker Containers, lectures and tutorials by experts. We will showcase some of the applications of OpenNEX data and tools by the community on Amazon Web Services, Google Cloud and the NEX Sandbox.

datasets↗

A modified ATI technique for nowcasting convective rain volumes over areas

This paper explores the applicability of the area-time-integral (ATI) technique for the estimation of the growth portion only of a convective storm (while the rain volume is computed using the entire life history of the event) and for nowcasting the total rain volume of a convective system at the stage of its maximum development. For these purposes, the ATIs were computed from the digital radar data (for 1981-1982) from the North Dakota Cloud Modification Project, using the maximum echo area (ATIA) no less than 25 dBz, the maximum reflectivity, and the maximum echo height as the end of the growth portion of the convective event. Linear regression analysis demonstrated that correlations between total rain volume or the maximum rain volume versus ATIA were the strongest. The uncertainties obtained were comparable to the uncertainties which typically occur in rain volume estimates obtained from radar data employing Z-R conversion followed by space and time integration. This demonstrates that the total rain volume of a storm can be nowcasted at its maximum stage of development.

Makarau, Amos↗

Cloud-Based Time Series Analysis of Extremes: Use Cases and Applications

"Extreme weather events, such as hurricanes, tornadoes, floods, droughts, heatwaves, and blizzards, can cause widespread damage, disrupting ecosystems, agricultural production, and economies. The frequency and intensity of these events have been increasing, likely due to climate change, raising concerns and the need for more accurate analysis and predictions. NASA's Goddard Earth Sciences Data and Information Services Center (GES DISC) has migrated its long-term historical datasets, including precipitation data from MERRA-2 reanalysis, GLDAS land data assimilation, and IMERG satellite observations, to the cloud. This cloud-stored data enables scientists and researchers to utilize cloud computing for advanced modeling and forecasting of extreme weather events, eliminating the need to download large datasets. In this presentation, we will provide an overview of the cloud-based data and services managed by GES DISC; demonstrate methods for accessing and analyzing time series data stored in the cloud; and compare results across various datasets to address critical questions related to extreme precipitation. We will present use cases including: 1. Determining the average total precipitation in California during January and February from 2000 to 2024, and identifying anomalous precipitation in 2021. 2. Calculating the 10, 20, 50, and 100-year return periods for maximum daily rainfall based on 25 years of historical precipitation data (2000-2024) for Maryland.

time series↗

Cloud Giovanni: Reining in Costs and Improving Performance with Analytical Data Stores Using Scalable Serverless Architecture

Giovanni is the Geospatial Interactive Online Visualization ANd aNalysis Infrastructure developed at NASA GES DISC which provides a simple and intuitive way to visualize, analyze, and access vast amounts of Earth science data. It receives large number of user requests each day for a variety of analysis and visualization services, which leads to the big data challenge of serving gradually increasing large data volumes with diverse statistical algorithms. We hereby propose a multi-dimensional accumulation method which provides fast and cost-efficient cloud analysis for diverse services including both area averaging and time averaging. This method involves the weighted volume integration over multiple variable dimensions (time and space), and is implemented in AWS using Athena providing serverless and highly scalable data analysis. Compared to the standard method, this approach dramatically reduced the computational time by order of magnitude with a minimal AWS cost incurred. For example, for a benchmark of 10-year area averaging over the 1x1 degree daily variable, the computational time was reduced from minutes to seconds, and the Athena cost is only $5 for 100,000 requests.

Zhang, Hailiang↗

Adaptation of the ISCCP cloud detection algorithm to combined AVHRR and SMMR arctic data

The International Satellite Cloud Climatology Project (ISCCP) cloud detection algorithm is applied to artic data, and modifications are suggested. Both Advanced Very High Resolution Radiometer (AVHRR) and Scanning Multichannel Microwave Radiometer (SMMR) data are examined. Synthetic AVHRR and SMMR data are also generated. Modifications suggested include the use of snow and ice data sets for the estimation of surface parameters, additional AVHRR channels, and surface class characteristic values when clear sky values cannot be obtained. Greatest improvement in computed cloud fraction is realized over snow and ice surfaces; over other surfaces all versions perform similarly. Since the use of SMMR for surface analysis increases the computational burden, its use may be justified only over snow and ice-covered regions.

Key, J.↗