Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud computing, data cloud”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Simulated sulfur K-edge X-ray absorption spectroscopy database of lithium thiophosphate solid electrolytes

X-ray absorption spectroscopy (XAS) is a premier technique for materials characterization, providing key information about the local chemical environment of the absorber atom. In this work, we develop a database of sulfur K-edge XAS spectra of crystalline and amorphous lithium thiophosphate materials based on the atomic structures reported in Chem. Mater., 34, 6702 (2022). The XAS database is based on simulations using the excited electron and core-hole pseudopotential approach implemented in the Vienna Ab initio Simulation Package. Our database contains 2681 S K-edge XAS spectra for 66 crystalline and glassy structure models, making it the largest collection of first-principles computational XAS spectra for glass/ceramic lithium thiophosphates to date. This database can be used to correlate S spectral features with distinct S species based on their local coordination and short-range ordering in sulfide-based solid electrolytes. The data is openly distributed via the Materials Cloud, allowing researchers to access it for free and use it for further analysis, such as spectral fingerprinting, matching with experiments, and developing machine learning models.

36 MATERIALS SCIENCE↗
NASA NTRS1991

Airborne observations of electric fields around growing and decaying cumulus clouds

Airborne electric field data were gathered in an atmospheric electrification study near Cape Canaveral, FL. A Learjet 36A was instrumented with eight electric field meters (mills) and five different particle probes. The local electric field enhancements at each field mill site were determined under lab conditions and verified using in-flight data. The overdetermined system of eight equations (one for each field mill) was solved using a weighted least squares algorithm to compute the magnitude and direction of the ambient electric field. The signal processing system allowed the measured data to be expressed in terms of earth coordinates, regardless of the attitude of the aircraft. Thus, it was possible to take maximum advantage of the Learjet's speed and maneuverability in studying the electric field structure in the vicinity of the clouds. Data gathered while circling just outside the boundary of a growing cumulus cloud show a nonsymmetric pattern of electric field strength. Field intensity grew rapidly over a period of less than 10 minutes. The observed direction of the ambient electric field vector can be explained by an ascending motion of the charge centers of a classic tripole model of a thunderstorm.

Giori, K. L.↗
NASA NTRS1991

Automatic analysis of stereoscopic satellite image pairs for determination of cloud-top height and structure

Results are presented on an automatic stereo analysis of cloud-top heights from nearly simultaneous satellite image pairs from the GOES and NOAA satellites, using a massively parallel processor computer. Comparisons of computer-derived height fields and manually analyzed fields show that the automatic analysis technique shows promise for performing routine stereo analysis in a real-time environment, providing a useful forecasting tool by augmenting observational data sets of severe thunderstorms and hurricanes. Simulations using synthetic stereo data show that it is possible to automatically resolve small-scale features such as 4000-m-diam clouds to about 1500 m in the vertical.

Hasler, A. F.↗
DOE OSTI2020

A new framework to map fine resolution cropping intensity across the globe: Algorithm, validation, and implication

We report accurate estimation of cropping intensity (CI), an indicator of food production, is well aligned with the ongoing efforts to achieve sustainable development goals (SDGs) under diminishing natural resources. The advancement in satellite remote sensing provides unprecedented opportunities for capturing CI information in a spatially continuous manner. However, challenges remain due to the lack of generalizable algorithms for accurately and efficiently mapping global CI with a fine spatial resolution. In this study, we developed a 30-m planetary-scale CI mapping framework with the reconstructed time series of Normalized Difference Vegetation Index (NDVI) from multiple satellite images. Using a binary crop phenophase profile indicating growing and non-growing periods, we estimated pixel-by-pixel CI by enumerating the total number of valid cropping cycles during the study years. Based on the Google Earth Engine cloud computing platform, we implemented the framework to estimate CI during 2016–2018 in eight geographic regions across continents that are representative of global cropping system diversity. Comparison with PhenoCam network data in four cropland sites suggests that the proposed framework is capable of capturing the seasonal dynamics of cropping practices. Spatially, overall accuracies based on validation samples range from 80.0% to 98.9% across different regions worldwide. Regarding the CI classes, single cropping systems are associated with more robust and less biased estimations than multiple cropping systems. Finally, our CI estimates reveal high agreement with two widely used land surface phenology products, including Vegetation Index and Phenology V004 (VIP4) and Moderate Resolution Imaging Spectroradiometer Land Cover Dynamics (MCD12Q2), meanwhile providing much more spatial details. Due to its robustness, the developed CI framework can be potentially generalized to produce global fine resolution CI products for food security and other applications.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

The ATLAS Workflow Management System Evolution in the LHC Run3 and towards the High-Luminosity LHC era

The ATLAS experiment has 18+ years of experience using workload management systems to deploy and develop workflows to process and to simulate data on the distributed computing infrastructure. Simulation, processing and analysis of LHC experiment data require the coordinated work of heterogeneous computing resources. In particular, the ATLAS experiment utilizes the resources of 250 computing centers worldwide, the power of supercomputing centres, and national, academic and commercial cloud computing resources. In this contribution, we present new techniques for cost-effectively improving efficiency introduced in workflow management system software. The evolution from a mesh framework to new types of computing facilities such as cloud and HPCs is described, as well as new types of production and analysis workflows.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

IRIS-MEMFLOW: Data Flow-Enabled Portable Memory Orchestration in IRIS Runtime for Diverse Heterogeneity

Task-based programming models and execution paradigms provide a means to decompose a computation by expressing it as a graph in which each node represents a specific computation operating on memory objects and the edges define the dependencies in the execution flow. In this execution model, independent nodes in the graph can be executed concurrently in different computing devices, making it suitable for heterogeneous systems in which computing devices with different architectures coexist. However, careful memory orchestration across heterogeneous devices is needed because copies of the same memory object may reside in multiple devices during execution. Manually ensuring such an orchestration is quite challenging. Not only must an application developer guard against race conditions, but they must also optimize data movement between the host and devices because unnecessary data movement significantly impacts performance. To mitigate these challenges, we enhance the IRIS heterogeneous runtime and introduce IRIS-MEMFLOW–a data flow–enabled portable memory abstraction for seamlessly orchestrating memory in diverse heterogeneous computing environments. By using data-flow analysis, IRIS-MEMFLOW guards against race conditions while multiple heterogeneous devices access memory objects. IRIS-MEMFLOW also optimizes data movement between the host and devices without manual intervention. As a result, IRIS provides improved programming productivity, performance, and portability for multidevice heterogeneous executions in high-performance computing and cloud systems that run diverse architectures from different vendors. The efficacy of IRIS-MEMFLOW is evaluated through experiments that show its capability in terms of programming productivity, multidevice heterogeneity, portability, and low overhead versus the state of the art.

Monil, M. A. H. [ORNL] (ORCID:0000000334194037)↗
DOE OSTI2022

Microcam: A Low Power and Privacy Preserving Multi-modal Platform for Occupancy Detection (Final Report)

Heating, ventilation, and air conditioning (HVAC) consumes a significant portion of the energy used in buildings. Much of this is wasted energy, used when buildings are either not occupied at all, or occupied well under their maximum design conditions. This project has focused on residential occupancy detection to autonomously control HVAC systems and save energy. Limitations of existing occupancy sensors include one or more of the following: (i) they employ sensors or algorithms that are not able to detect stationary occupants; (ii) they cannot classify the source of the motion (such as a pet); (iii) depending on the camera resolution and employed algorithms, they do not allow for embedded or onboard computation, and require external or cloud-based processing; (iv) many algorithms developed for camera-based systems are sensitive to lighting changes, and thus prone to missed detections or false alarms; (v) Most existing systems depend on adjustment of settings for different scenarios, complicating self-commissioning; (vi) they cannot provide high enough accuracy; (vii) they are costly; (viii) they are not battery-powered, thus limiting ease of use and installation. In this project, Syracuse University and its partner SRI have developed a low-cost, high accuracy, standalone residential occupancy sensing platform, referred to as the MicroCam, to address all of the aforementioned challenges. MicroCam can operate on typical alkaline batteries without relying on the “cloud” or external computing resources, and consists of low-power, Artificial Intelligence (AI)-based, IoT platforms. Each platform has multi-modal sensors and can process motion, audio and video data, and send binary occupancy result to a lead platform. All sensor data is processed locally on platforms, and the only transmitted data is the binary occupancy state. In addition, preliminary work has been done on images wherein occupants are not discernable. Thus, MicroCam is a standalone solution preserving privacy of the occupants.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS1996

The Three-Dimensional Spatial Structure of Cirrus Clouds Determined from Lidar Satellite Observations

Simultaneous imagery from the University of Wisconsin Volume Imaging Lidar (VIL) and meteorological satellites were used to quantify the spatial structure of cirrus clouds with 60 m resolution. This data was used to determine the spatial distributions of cloud base altitude, cloud top altitude, and mid-cloud altitude. Two dimensional auto-correlation functions describing the mean shape of cirrus clouds were computed. Because cirrus clouds seldom have distinct edges, these correlation functions are derived as a function of a threshold value which defines the cloud edge.

Eloranta, E. W.↗
NASA NTRS2010

Statistics of Cloud Optical Properties from Airborne Lidar Measurements

Cloud optical properties, such as extinction-to-backscatter ratio and depolarization ratio, have a significant impact on the accuracy of cloud extinction retrievals from lidar systems because parameterizations of these variables are often used in non-ideal conditions to determine cloud type and optical depth. Statistics and trends of these optical parameters were analyzed for four years, 2003-2007, of Cloud Physics Lidar data during five projects of varying geographic locations. Extinction-to-backscatter ratio (at 532 nm) was derived by calculating the transmission loss through the cloud layer, while depolarization ratio was computed using the parallel and perpendicular polarized 1064 nm channels. The majority of the cloud layers yielded an S-ratio between 10 and 40 sr with the S-ratio frequency distribution centered at 25 sr for ice clouds, 21 sr for mixed phase clouds, and 11 sr for water clouds. On average for ice clouds, S ratio slightly decreased with decreasing temperature, while depolarization ratio increased significantly as temperatures decreased. Trends for water and mixed phase clouds were also observed. Ultimately, these observed trends in optical properties as a function of temperature and geographic location will improve current parameterizations of extinction-to-backscatter ratio, which consequently increases accuracy in cloud optical depth and radiative forcing estimates.

Yorks, John E.↗
DOE OSTI2021

Trigger-based Incremental Data Processing with Unified Sync and Async Model

In recent years, more and more applications in the cloud have needs to process large-scale on-line datasets, which evolve over time as new entries are added and existing entries are modified. Several programming frameworks, such as Percolator and Oolong, are proposed for such incremental data processing and can achieve efficient processing with an event-driven abstraction. However, these frameworks are inherently asynchronous, leaving the heavy burden of managing synchronization to applications' developers, which further significantly restricts their usabilities. In this study, we propose a trigger-based incremental computing framework in the cloud, called Domino, with both synchronous and asynchronous mechanisms to coordinate parallel triggers. With this new framework, both synchronous and asynchronous applications can be seamlessly developed. Use cases and extensive evaluation results confirm that it can deliver sufficient performance, and also is easy to use for incremental applications in large-scale distributed computing.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2015

Equation of State Model Quality Study for Ti and Ti64.

Titanium and the titanium alloy Ti64 (6% aluminum, 4% vanadium and the balance ti- tanium) are materials used in many technologically important applications. To be able to computationally investigate and design these applications, accurate Equations of State (EOS) are needed and in many cases also additional constitutive relations. This report describes what data is available for constructing EOS for these two materials, and also describes some references giving data for stress-strain constitutive models. We also give some suggestions for projects to achieve improved EOS and constitutive models. In an appendix, we present a study of the 'cloud formation' issue observed in the ALEGRA code. This issue was one of the motivating factors for this literature search of available data for constructing improved EOS for Ti and Ti64. However, the study shows that the cloud formation issue is only marginally connected to the quality of the EOS, and, in fact, is a physical behavior of the system in question. We give some suggestions for settings in, and improvements of, the ALEGRA code to address this computational di culty.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2018

How NASA is Building a Petabyte Scale Geospatial Archive in the Cloud

NASA's Earth Observing System Data and Information System (EOSDIS) is working towards a vision of a cloud-based, highly-flexible, ingest, archive, management, and distribution system for its ever-growing and evolving data holdings. This free and open source system, Cumulus, is emerging from its prototyping stages and is poised to make a huge impact on how NASA manages and disseminates its Earth science data. This talk outlines the motivation for this work, present the achievements and hurdles of the past 18 months and charts a course for the future expansion of Cumulus. We explore not just the technical, but also the socio-technical challenges that we face in evolving a system of this magnitude into the cloud. The NASA EOSDIS archive is currently at nearly 30 PBs and will grow to over 300PBs in the coming years. We've presented progress on this effort at AWS re:Invent and the American Geophysical Union (AGU) Fall Meeting in 2017 and hope to have the opportunity to share with FOSS4G attendees information on the availability of the open sourced software and how NASA intends on making its Earth Observing Geospatial data available for free to the public in the cloud.

NASA Archive↗
DOE OSTI2016

Enabling the democratization of the genomics revolution with a fully integrated web-based bioinformatics platform

Continued advancements in sequencing technologies have fueled the development of new sequencing applications and promise to flood current databases with raw data. A number of factors prevent the seamless and easy use of these data, including the breadth of project goals, the wide array of tools that individually perform fractions of any given analysis, the large number of associated software/hardware dependencies, and the detailed expertise required to perform these analyses. To address these issues, we have developed an intuitive web-based environment with a wide assortment of integrated and cutting-edge bioinformatics tools in pre-configured workflows. These workflows, coupled with the ease of use of the environment, provide even novice next-generation sequencing users with the ability to perform many complex analyses with only a few mouse clicks and, within the context of the same environment, to visualize and further interrogate their results. As a result, this bioinformatics platform is an initial attempt at Empowering the Development of Genomics Expertise (EDGE) in a wide range of applications for microbial research.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2016

Marine ARM GPCI Investigation of Clouds Bridge Display Field Campaign Report

At the beginning of the U.S. Department of Energy (DOE) Marine Atmospheric Radiation Measurement (ARM) Climate Research Facility Global Energy and Water Experiment (GEWEX) Cloud System Study (GCSS) Pacific Cross-Section Intercomparison (GPCI) Investigation of Clouds (MAGIC) experiment, we recognized that the crew on the ship’s bridge would like to see a display of the meteorological data that was being collected. While a display on the bridge would be marginally useful to the science, it was decided to make a display for the bridge. A display was programmed in Lab View and a personal computer (PC) was set up in the bridge. This remained in operation until the ship went to dry dock for upgrades and service. Part of the upgrade was a new meteorological system for the ship. After this time there was no need for the ARM display and so it was not re-installed for the remainder of the program.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

Knowledge management: Role of the the Radiation Safety Information Computational Center (RSICC)

The Radiation Safety Information Computational Center (RSICC) at Oak Ridge National Laboratory (ORNL) is an information analysis center that collects, archives, evaluates, synthesizes and distributes information, data and codes that are used in various nuclear technology applications. RSICC retains more than 2,000 software packages that have been provided by code developers from various federal and international agencies. RSICC’s customers (scientists, engineers, and students from around the world) obtain access to such computing codes (source and/or executable versions) and processed nuclear data files to promote on-going research, to ensure nuclear and radiological safety, and to advance nuclear technology. The role of such information analysis centers is critical for supporting and sustaining nuclear education and training programs both domestically and internationally, as the majority of RSICC’s customers are students attending U.S. universities. Additionally, RSICC operates a secure CLOUD computing system to provide access to sensitive export-controlled modeling and simulation (M&S) tools that support both domestic and international activities. This presentation will provide a general review of RSICC’s activities, services, and systems that support knowledge management and education and training in the nuclear field.

Valentine, Timothy↗
NASA NTRS2004

Microphysical Characterization of Ice in Hurricane Erin for Wideband Passive Microwave Comparisons

In order to better understand the characteristics of frozen hydrometeors in hurricane systems, computed brightness temperatures were compared with observations of Hurricane Erin from CAMEX-4 radiometers on the ER-2 aircraft. These wideband observations ranged from 10.7 to 183 plus or minus 10 GHz. In order to initialize the cloud profiles used in the radiative transfer calculations, radar reflectivities from an ER-2 instrument were converted to mass contents at specified height levels. Dropsonde data from the ER-2 and modeled Hurricane Andrew data were used to generate profiles of temperature, pressure, and relative humidity and to provide surface wind speed and ocean temperature. Four different ice (size and density) parameterizations were used to compute brightness temperature values. The comparisons between the calculated and observed brightness temperatures show that in general the Grenfell and Warren particle size distribution does the best job of matching the observations for most of the high frequencies. These high frequencies (greater than or equal to 85 GHz) are particularly sensitive to frozen particles. The Sehkon and Srivastava particle size distribution produced brightness temperatures that were too cold in most cases. On the other hand, the fluffy snow particle parameterizations with and without a melting layer produced brightness temperatures that were much warmer than the observations at these high frequencies. All low frequency calculations track the observations well except in the eye of Hurricane Erin where the surface wind speed and/or near surface temperatures were not properly adjusted to warm the brightness temperature calculations to values closer to the observations. Overall, this work shows that selecting a proper ice particle parameterization can be difficult and additional in situ measurements are needed to define appropriate parameterizations.

Skofronick-Jackson, G.↗
NASA NTRSDate not supplied

Implementing Atmospheric Infrared Sounder (AIRS) and Cross-Track Infrared Sounder (CrIS) Cloud-Clearing Algorithm into the NASA GEOS: Focus on the 2017 Atlantic Tropical Cyclone Season

Numerical Weather Prediction (NWP) centers assimilate cloud-free infrared (IR) radiances because the assimilation of all-sky IR radiances is not yet operationally achievable. The cloud-clearing procedure offers a simpler, but effective strategy that produces cloud-affected radiances suitable for assimilation in partially cloudy regions. Several studies conducted by this team have demonstrated that IR Cloud-Cleared Radiances (CCRs), if thinned more aggressively than clear-sky radiances, can improve analysis and forecasts, particularly in meteorologically active areas. However, CCRs are not used by operational centers due partly to the thought that the process of cloud-clearing may affect latency and introduce difficult-to-control external dependencies. This study presents the results of implementing an Atmospheric Infrared Sounder (AIRS) and Cross-Track Infrared Sounder (CrIS) cloud-clearing procedure into the NASA Goddard Earth Observing System (GEOS) to demonstrate the portability of the procedure. The AIRS and CrIS cloud-clearing algorithms have been deprived of external dependencies, made customizable to any specific model, and the computational efficiency has been improved via parallelization. The revised AIRS and CrIS cloud-clearing algorithms allow a customized choice of channel selection, the use of a user-specified model's fields as first guess, and can perform in real time. Data assimilation experiments with the hybrid 4DEnVar GEOS system were successfully performed for the 2017 tropical cyclones (TC) season with a focus on three major hurricanes (Harvey, Irma, and Maria). This study shows that assimilation of locally-generated CCRs have a positive impact on both global skill and TC representation, compared to the assimilation of AIRS and CrIS clear-sky radiances, and a comparable or slightly improved impact compared to assimilation of CCRs produced by external sources, such as NASA's Distributed Active Archive Centers and NOAA’s Comprehensive Large Array-data Stewardship System. The customization and computational efficiency of the revised procedure would enable its usability in a real-time forecast context.

Niama Boukachaba↗