Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud computing, data cloud”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
NASA NTRS2016

Benchmark Comparison of Cloud Analytics Methods Applied to Earth Observations

Cloud computing has the potential to bring high performance computing capabilities to the average science researcher. However, in order to take full advantage of cloud capabilities, the science data used in the analysis must often be reorganized. This typically involves sharding the data across multiple nodes to enable relatively fine-grained parallelism. This can be either via cloud-based file systems or cloud-enabled databases such as Cassandra, Rasdaman or SciDB. Since storing an extra copy of data leads to increased cost and data management complexity, NASA is interested in determining the benefits and costs of various cloud analytics methods for real Earth Observation cases. Accordingly, NASA's Earth Science Technology Office and Earth Science Data and Information Systems project have teamed with cloud analytics practitioners to run a benchmark comparison on cloud analytics methods using the same input data and analysis algorithms. We have particularly looked at analysis algorithms that work over long time series, because these are particularly intractable for many Earth Observation datasets which typically store data with one or just a few time steps per file. This post will present side-by-side cost and performance results for several common Earth observation analysis operations.

science data management↗
NASA NTRS2018

Integrating Cloud-Based Workflows in Continental-Scale Cropland Extent Classification

Accurate information on cropland spatial distribution is required for global-scale assessments and agricultural land use policies. Cloud computing platforms such as Google Earth Engine (GEE) provide unprecedented opportunities for large-scale classifications of Landsat data. We developed a novel method to fuse pixel-based random forest classification of continental-scale Landsat data on GEE and an object-based segmentation approach known as recursive hierarchical segmentation (RHSeg). Using our fusion method, we produced a continental-scale cropland extent map for North America at 30m spatial resolution for the nominal year 2010. The total cropland area for North America was estimated at 275.18 million hectares (Mha). The overall accuracies of the map are>90% across the continent. This map also compares well with the United States Department of Agriculture (USDA) cropland data layer (CDL), Agriculture and Agri-food Canada (AAFC) annual crop inventory (ACI), and the Mexican government agency Servicio de Informacion Agroalimentaria y Pesquera (SIAP)'s agricultural boundaries. Furthermore, our map compared well with sub-country statistics including state-wise and county-wise cropland statistics in regression models resulting in R2 > 0.84. This key contribution paves the way for more detailed products such as crop intensity, crop type, and crop irrigation, and provides a method for creating high-resolution cropland extent maps for other countries where spatial information about croplands are not as prevalent.

Massey, Richard↗
NASA NTRS2022

A Deep Learning Approach to Fast Radiative Transfer

Due to the sheer volume of data, leveraging satellite instrument observations effectively in a data assimilation context for numerical weather prediction or for remote sensing requires a radiative transfer model as an observation operator that is both fast and accurate at the same time. Physics-based line-by-line radiative transfer (RT) models fulfil the requirement for accuracy, but are too slow and too costly in computational terms for operational applications. Therefore, fast methods were developed to be able to perform fast RT calculations using techniques such as spectral sampling or pre-computed look-up tables. The operational fast models currently calculate the absorption and scattering coefficients from the pre-computed regression coefficients and atmospheric state and cloud profiles. As a novel solution to this problem, this work investigates a deep learning approach to replace the regression coefficients in the fast RT models. A selection of hidden-layer neural network configurations is trained against atmospheric transmittance profile data computed by an accurate line-by-line model and their performance is evaluated and their advantages and disadvantages are discussed.

Machine learning↗
NASA NTRS1975

Analysis of cloud polarization measurements

The polarization of sunlight reflected by various cloud types was measured in the near-infrared with a polarimeter flown aboard the NASA Convair 990. The data reduction has been completed and detailed comparisons have been made between the observations and theoretical computations. The analysis presented shows that the polarization in the near-infrared can be used on a routine basis to reliably yield the cloud particle phase (water or ice) and the average particle size in the top part of water clouds (usually within + or - 25%). In some cases the polarization also yields the cloud optical thickness (or a lower limit) and a measure of the width of the particle size distribution in the top of the water clouds.

Hansen, J. E.↗
DOE OSTI2024

AEPF: Attention-Enabled Point Fusion for 3D Object Detection

Current state-of-the-art (SOTA) LiDAR-only detectors perform well for 3D object detection tasks, but point cloud data are typically sparse and lacks semantic information. Detailed semantic information obtained from camera images can be added with existing LiDAR-based detectors to create a robust 3D detection pipeline. With two different data types, a major challenge in developing multi-modal sensor fusion networks is to achieve effective data fusion while managing computational resources. With separate 2D and 3D feature extraction backbones, feature fusion can become more challenging as these modes generate different gradients, leading to gradient conflicts and suboptimal convergence during network optimization. To this end, we propose a 3D object detection method, Attention-Enabled Point Fusion (AEPF). AEPF uses images and voxelized point cloud data as inputs and estimates the 3D bounding boxes of object locations as outputs. An attention mechanism is introduced to an existing feature fusion strategy to improve 3D detection accuracy and two variants are proposed. These two variants, AEPF-Small and AEPF-Large, address different needs. AEPF-Small, with a lightweight attention module and fewer parameters, offers fast inference. AEPF-Large, with a more complex attention module and increased parameters, provides higher accuracy than baseline models. Experimental results on the KITTI validation set show that AEPF-Small maintains SOTA 3D detection accuracy while inferencing at higher speeds. AEPF-Large achieves mean average precision scores of 91.13, 79.06, and 76.15 for the car class’s easy, medium, and hard targets, respectively, in the KITTI validation set. Results from ablation experiments are also presented to support the choice of model architecture.

Chemistry↗
DOE OSTI2025

OLCF’s Advanced Computing Ecosystem (ACE): FY25 Update for Ongoing Efforts

The advent of widespread use of artificial intelligence (AI) and machine learning (ML) models in science, coupled with fast data production rates of scientific instruments strain the traditional batch-oriented high-performance computing (HPC) environment. As scientific exploration continues to require more data and faster processing and analysis, new emerging technologies and capabilities to enable cross-facility and time-sensitive workflows are required for seamless integration of HPC and experimental facilities. The Advanced Computing Ecosystem (ACE) is a strategic initiative within the Oak Ridge Leadership Computing Facility (OLCF) established in 2024 to support the development of cutting-edge technologies to advance computational research and infrastructure at OLCF and across the Department of Energy (DOE). Several DOE initiatives are spearheading the evolution of the scientific landscape by blurring facility boundaries and connecting the user facilities to advance scientific capabilities and ensure energy dominance. The DOE Integrated Research Infrastructure (IRI) program is one example that is laying a foundation to support complex cross-facility workflows. The IRI program aims to integrate diverse computational resources, data infrastructures, and scientific instruments to facilitate collaboration and accelerate scientific discovery. The Interconnected Science Ecosystem (INTERSECT) initiative at Oak Ridge National Laboratory (ORNL) is another example that aims to revolutionize scientific research through AI-driven, interconnected autonomous laboratories and research facilities. Finally, the American Science Cloud (AmSC), recently announced in the “One Big Beautiful Bill”, aims to leverage prior infrastructure efforts of the IRI and automation and AI efforts of INTERSECT (and others) to build a federated, AI-augmented AmSC platform to unify the DOE’s computing, experimental, and data resources to catalyze scientific innovation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Preparing an on-Demand Cloud Processing Workflow for NISAR Ecosystems Science Products

In preparation for the NISAR launch and data collection in 2024, the NISAR Project Science Team is building workflows for each Science Team discipline (Ecosystems, Cryosphere, and Solid Earth). This abstract focuses on the Ecosystem disciplines and the development of on-demand cloud-processing workflows for wetlands inundation, forest biomass, agricultural active crop area, and forest disturbance. The workflow simulates NISAR data using UAVSAR or ALOS-2 Single Look Complex data, which are processed to Level 2 geocoded polarimetric covariance matrix products using InSAR Scientific Computing Environment 3.0 software and to Level 3 science products using the Algorithm Theoretical Basis Documents. In this presentation, we describe these workflows and efforts to improve efficiency and data accessibility by using a cloud processing system. We present preliminary sample products from each Ecosystem discipline: inundation, forest biomass, crop area, and forest disturbance.

Christensen, Alexandra↗
NASA NTRS2017

Retrieval of Microphysical Characteristics of Particles in Atmospheres of Distant Comets from Ground-Based Polarimetry

We summarize unique aperture data on the degree of linear polarization observed for distant comets C/2010 S1, C/2010 R1, C/2011 KP36, C/2012 J1, C/2013 V4, and C/2014 A4 with heliocentric distances exceeding 3 AU. Observations have been carried out at the 6-m telescope of the Special Astrophysical Observatory of the Russian Academy of Sciences (Nizhnij Arkhyz, Russia) during the period from 2011 to 2016. The measured negative polarization proves to be significantly larger in absolute value than what is typically observed for comets close to the Sun. We compare the new observational data with the results of numerical modeling performed with the T-matrix and superposition T-matrix methods. In our computer simulations, we assume the cometary coma to be an optically thin cloud containing particles in the form of spheroids, fractal aggregates composed of spherical monomers, and mixtures of spheroids and aggregate particles. We obtain a good semi-quantitative agreement between all polarimetric data for the observed distant comets and the results of numerical modeling for the following models of the cometary dust: (i) a mixture of submicrometer water-ice oblate spheroids with aggregates composed of submicrometer silicate monomers; and (ii) a mixture of submicrometer water-ice oblate spheroids and aggregates consisting of both silicate and organic monomers. The microphysical parameters of these models are presented and discussed.

Numerical modeling↗
NASA NTRS1996

Cloud identification using genetic algorithms and massively parallel computation

As a Guest Computational Investigator under the NASA administered component of the High Performance Computing and Communication Program, we implemented a massively parallel genetic algorithm on the MasPar SIMD computer. Experiments were conducted using Earth Science data in the domains of meteorology and oceanography. Results obtained in these domains are competitive with, and in most cases better than, similar problems solved using other methods. In the meteorological domain, we chose to identify clouds using AVHRR spectral data. Four cloud speciations were used although most researchers settle for three. Results were remarkedly consistent across all tests (91% accuracy). Refinements of this method may lead to more timely and complete information for Global Circulation Models (GCMS) that are prevalent in weather forecasting and global environment studies. In the oceanographic domain, we chose to identify ocean currents from a spectrometer having similar characteristics to AVHRR. Here the results were mixed (60% to 80% accuracy). Given that one is willing to run the experiment several times (say 10), then it is acceptable to claim the higher accuracy rating. This problem has never been successfully automated. Therefore, these results are encouraging even though less impressive than the cloud experiment. Successful conclusion of an automated ocean current detection system would impact coastal fishing, naval tactics, and the study of micro-climates. Finally we contributed to the basic knowledge of GA (genetic algorithm) behavior in parallel environments. We developed better knowledge of the use of subpopulations in the context of shared breeding pools and the migration of individuals. Rigorous experiments were conducted based on quantifiable performance criteria. While much of the work confirmed current wisdom, for the first time we were able to submit conclusive evidence. The software developed under this grant was placed in the public domain. An extensive user's manual was written and distributed nationwide to scientists whose work might benefit from its availability. Several papers, including two journal articles, were produced.

Buckles, Bill P.↗
NASA NTRS1987

The role of earth radiation budget studies in climate and general circulation research

The use of earth radiation budget (ERB) data for climate and general circulation research is studied. ERB measurements obtained in the 1960's and 1970's have provided data on planetary brightness, planetary global energy balances, the greenhouse effect, solar insolation, meridional heat transport by oceans and atmospheres, regional forcing, climate feedback processes, and the computation of albedo values in low latitudes. The role of clouds in governing climate, in influencing the general circulation, and in determining the sensitivity of climate to external perturbations needs to be researched; a procedure for analyzing the ERB data, which will address these problems, is described. The approach involves estimating the clear-sky fluxes from the high spatial resolution scanner measurement and defining a cloud radiative forcing; the global average of the sum of the solar and long-wave cloud forcing yields the net radiative effect of clouds on the climate.

Ramanathan, V.↗
DOE OSTI2014

SU-D-BRD-02: A Web-Based Image Processing and Plan Evaluation Platform (WIPPEP) for Future Cloud-Based Radiotherapy

Purpose: Visualization and processing of medical images and radiation treatment plan evaluation have traditionally been constrained to local workstations with limited computation power and ability of data sharing and software update. We present a web-based image processing and planning evaluation platform (WIPPEP) for radiotherapy applications with high efficiency, ubiquitous web access, and real-time data sharing. Methods: This software platform consists of three parts: web server, image server and computation server. Each independent server communicates with each other through HTTP requests. The web server is the key component that provides visualizations and user interface through front-end web browsers and relay information to the backend to process user requests. The image server serves as a PACS system. The computation server performs the actual image processing and dose calculation. The web server backend is developed using Java Servlets and the frontend is developed using HTML5, Javascript, and jQuery. The image server is based on open source DCME4CHEE PACS system. The computation server can be written in any programming language as long as it can send/receive HTTP requests. Our computation server was implemented in Delphi, Python and PHP, which can process data directly or via a C++ program DLL. Results: This software platform is running on a 32-core CPU server virtually hosting the web server, image server, and computation servers separately. Users can visit our internal website with Chrome browser, select a specific patient, visualize image and RT structures belonging to this patient and perform image segmentation running Delphi computation server and Monte Carlo dose calculation on Python or PHP computation server. Conclusion: We have developed a webbased image processing and plan evaluation platform prototype for radiotherapy. This system has clearly demonstrated the feasibility of performing image processing and plan evaluation platform through a web browser and exhibited potential for future cloud based radiotherapy.

60 APPLIED LIFE SCIENCES↗
NASA NTRS1989

Analysis of lightning field changes during active Florida thunderstorms

A computer algorithm for deriving accurate values of lightning-caused changes in cloud electric fields under active storm conditions was developed and applied to data obtained during two thunderstorms from a network of ground-based electric field mills at the NASA Kennedy Space Center and the Cape Canaveral Air Force Station. The resulting field changes were analyzed using a least-squares optimization procedure and point-charge (Q) and point-dipole (P) models. The values and the time variations of the Q-model parameters under active storm conditions were found to be similar to those reported by Maier and Krider (1986) for small storms, when the computations were carried out with the same analysis criteria and comparable biases. The parameters of the P solutions were found to vary with time within the storm interval and from storm to storm.

Koshak, William J.↗
DOE OSTI2018

High Resolution Measurements and Modeling in the Arctic

This report details the activity of the project, "High Resolution Modeling and Measurements in the Arctic" spanning Fiscal Years 2016 - 2018 supported by the Sandia National Laboratories Laboratory Directed Research and Development (LDRD) program. The project's primary goal was to test the hypothesis that global climate model bias of low boundary layer clouds lacking liquid water in the Arctic could be improved by increasing horizontal resolution in the model. As model resolution is constrained by computational resources, four different model types were explored and compared to test the project's primary theory. Given the Arctic is a data-sparse region lacking robust data sets of liquid water in clouds, this project also obtained in situ measurements of low clouds with sensors on a tethered balloon system to constrain and compare with the models. Although other model biases remained, the liquid water path generally increased with resolution, supporting the original hypothesis.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1989

Adaptation of the ISCCP cloud detection algorithm to combined AVHRR and SMMR arctic data

The International Satellite Cloud Climatology Project (ISCCP) cloud detection algorithm is applied to artic data, and modifications are suggested. Both Advanced Very High Resolution Radiometer (AVHRR) and Scanning Multichannel Microwave Radiometer (SMMR) data are examined. Synthetic AVHRR and SMMR data are also generated. Modifications suggested include the use of snow and ice data sets for the estimation of surface parameters, additional AVHRR channels, and surface class characteristic values when clear sky values cannot be obtained. Greatest improvement in computed cloud fraction is realized over snow and ice surfaces; over other surfaces all versions perform similarly. Since the use of SMMR for surface analysis increases the computational burden, its use may be justified only over snow and ice-covered regions.

Key, J.↗
NASA NTRS1977

Properties of aerosols in the Martian atmosphere, as inferred from Viking Lander imaging data

Three types of aerosol were detected from observations of the Martian sky, Phobos, and the sun with the Viking imaging cameras. Atmospheric optical depths were derived from observations of the objects' brightness. Data on the absorption coefficient, mean size, and shape of aerosols were obtained from studies of the sky brightness, using a multiple-scattering computer code. The aerosol types were water ice ground fog, a higher-level ice cloud (polar hood), and soil particles suspended at heights up to 30 km. The properties of each type of aerosol are discussed. The data are subjected to thorough analysis, and the results are summarized.

Pollack, J. B.↗
NASA NTRS1974

Altitude determination and descriptive analysis of clouds on ERTS-1 multispectral photography

A simple method to determine the approximate altitude of clouds is described, with the objective of refining their classification using only marginal data from the photographs. Results of the application of this method on photographs of the Goajira Peninsula, Paraguana Peninsula and the Central Coast of Venezuela are presented. Here, the altitudes computed are used to classify clouds and to identify the genus of others without typical form. Instability of air masses through clouds vertical development, and wind direction as well as other local climatic characteristics such as moisture content, loci of condensation, area, etc. are determined using repetitive coverage for the time interval of the photography. Applications for the regional and urban planning (including airport location and flights schedule) and natural resources evaluation are suggested.

Albrizzio, C.↗