Search NASA⌕ Search

SEARCH · Search NASA

Results for “CLOUD COMPUTING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Accelerating science: The usage of commercial clouds in ATLAS Distributed Computing

The ATLAS experiment at CERN is one of the largest scientific machines built to date and will have ever growing computing needs as the Large Hadron Collider collects an increasingly larger volume of data over the next 20 years. ATLAS is conducting R&D projects on Amazon Web Services and Google Cloud as complementary resources for distributed computing, focusing on some of the key features of commercial clouds: lightweight operation, elasticity and availability of multiple chip architectures. The proof of concept phases have concluded with the cloud-native, vendoragnostic integration with the experiment’s data and workload management frameworks. Google Cloud has been used to evaluate elastic batch computing, ramping up ephemeral clusters of up to O(100k) cores to process tasks requiring quick turnaround. Amazon Web Services has been exploited for the successful physics validation of the Athena simulation software on ARM processors. We have also set up an interactive facility for physics analysis allowing endusers to spin up private, on-demand clusters for parallel computing with up to 4 000 cores, or run GPU enabled notebooks and jobs for machine learning applications. The success of the proof of concept phases has led to the extension of the Google Cloud project, where ATLAS will study the total cost of ownership of a production cloud site during 15 months with 10k cores on average, fully integrated with distributed grid computing resources and continue the R&D projects.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS1985

On Wahlin's mechanism of cloud electrification

Computations were performed to explore the consequences of Wahlin's suggestion that a powerful mechanism of thundercloud electrification is provided, in the presence of a substantial updraft, by the preferential capture of negative ions on the water droplets of a cloud. The mechanism seems capable of providing, on time scales of 10-15 min, electric fields of several tens of kV/m.

Dangelo, N.↗
NASA NTRS1972

A sample computation of kinematic properties from cloud motion vectors.

Distributions of relative vorticity and balanced height have been computed from the cloud velocities associated with the cloud structure of an extratropical cyclone over the continental United States during a three-day period in March 1970. Cloud motions are assigned either to a 'mid-level,' or to a 'high level.' Derived vorticity and balanced height are compared with concurrent National Meteorological Center (NMC) analyses and also with similar kinematic quantities obtained from rawins at three constant-pressure levels. The computations of relative vorticity using mid-level cloud motion vectors show encouraging results. Patterns of computed cyclonic vorticity are related to the development, location, and movement of the surface cyclone. The analyses suggest that the 'mid-level' corresponds best to the 700-mb level. The vorticity analysis from the 'high-level' motion vectors presented difficulties.

Viezee, W.↗
DOE OSTI2016

MOLNs: A Cloud Platform for Interactive, Reproducible, and Scalable Spatial Stochastic Computational Experiments in Systems Biology Using PyURDME

Computational experiments using spatial stochastic simulations have led to important new biological insights, but they require specialized tools and a complex software stack, as well as large and scalable compute and data analysis resources due to the large computational cost associated with Monte Carlo computational workflows. The complexity of setting up and managing a large-scale distributed computation environment to support productive and reproducible modeling can be prohibitive for practitioners in systems biology. This results in a barrier to the adoption of spatial stochastic simulation tools, effectively limiting the type of biological questions addressed by quantitative modeling. In this paper, we present PyURDME, a new, user-friendly spatial modeling and simulation package, and MOLNs, a cloud computing appliance for distributed simulation of stochastic reaction-diffusion models. In conclusion, MOLNs is based on IPython and provides an interactive programming platform for development of sharable and reproducible distributed parallel computational experiments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Computer Vision on Edge Devices for the Short Term Prediction of Cloud Cover

Edge Computing and IoT are important pieces of today's technological landscape. Here, we build a low-cost IoT sensor for sky imaging and program it using AWS GreenGrass, one of the leading IoT platforms. We demonstrate remote reprogramming of this device to load software that predicts sun shading events through the linear advection method, which is a baseline algorithm that can be used to benchmark algorithmic improvements in future work. Some future directions for sky imaging research are enumerated.

14 SOLAR ENERGY↗
NASA NTRS1987

The effect of subpixel clouds on remote sensing

A method for estimating the cloud effect on remote sensing is described, and it is applied to cloudiness in several climatological conditions. The algorithm is based on the Haurwitz (1948) measurements of the cloud layer transmission of solar radiation for an overcast sky and on an empirical interpolation of data for broken cloudiness by Pochop et al. (1968). Radiances for a sunny area observed directly from space and through a cloud, and for a shady area observed from space and through a cloud are computed. Methods for detecting the cloud effect from satellite images are discussed. The relation between cloud reflectance and cloud size is studied. It is observed that the subpixel clouds affect the detected radiance and vegetation index, and the effect depends on the cloud types and the dependence of the cloud transmissivity on cloud fraction. Procedures for decreasing or eliminating cloud effect are examined.

Kaufman, Yoram J.↗
NASA NTRS2004

Microphysical Timescales in Clouds and their Application in Cloud-Resolving Modeling

Computational phenomena (i.e., spurious supersaturation and negative mixing ratio of cloud water) usually exist in cloud-resolving models when the time step for explicit integration is larger than a microphysical timescale in clouds. In this paper, the microphysical timescales in clouds are studied, showing that the timescale of water vapor condensation (or cloud water evaporation) is smaller than 10 s - the order of a typical time step for cloud-resolving models. To avoid spurious computational phenomena in cloud-resolving modeling, it is suggested that moist entropy be used as a prognostic thermodynamic variable, and temperature be diagnosed from that and other prognostic variables. A simple numerical model with moist entropy as a prognostic variable, for example, is presented to show that spurious computational phenomena are removed when moist entropy is used as a prognostic variable.

Zeng, Xi-Ping↗
DOE OSTI2021

RSE-Ops

If DevOps is the intersection of "Developer" and "Operations," then how does this concept map to high performance computing? The answer is RSE-ops, or the intersection of Research Software Engineering and Operations. Research Software Engineers (RSEs) are the individuals writing code for scientific software, and supporting researchers to use codes on high performance computing systems. RSE-ops, then, generally refers to best practices for development and operations of scientific software, which typically happens in a high performance computing environment. A comparison can be made to Cloud Native Devops, which is a similar term that has emerged around Cloud Native Computing. It refers to the application of DevOps practices to the cloud.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Recent advances in integrated hydrologic models: Integration of new domains

Over the past several decades, hydrologic models have advanced from independent models of the surface and subsurface to integrated models that can capture the terrestrial hydrologic cycle within one framework. In recent years, these coupled frameworks have seen the inclusion of biogeochemical processes, ecohydrology, sedimentation and erosion, cold region hydrology, anthropogenic activities, and atmospheric processes. This expansion is the result of increased computational, data, and modeling capabilities and capacities, as well as improved understanding of the processes that drive these integrated systems. Here, in this study, we review these recent advances to integrate new processes and systems into existing terrestrial hydrologic models and highlight the significant challenges and opportunities that remain. We identify that with so many models currently available and in development, selecting the most appropriate model is difficult, and we suggest a path for new or novice modelers to find the most appropriate code based on their needs. In addition, data required to parameterize and calibrate these models can often constrain their applicability and usefulness. However, advances in environmental sensors and measurement technology, in addition to data assimilation of non-traditional data (e.g. remote sensing, qualitative data) are providing new ways of addressing this issue. As we expand hydrologic models to integrate more processes and systems, our computational demands also increase. Recent and emerging advances in computational platforms, including cloud and quantum computing, in addition to the use of machine learning to capture some processes, will continue to support the use of increasingly larger and more complex, process-based models. Finally, we highlight that it is critical to develop state-of-the-science models that are accessible to all model users, not just those applied for research and development. We encourage continued development of diverse modeling platforms, considering the user needs, data availability, and computational resources.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

Hot gaseous atmospheres in galaxy groups and clusters are both heated and cooled by X-ray cavities

Expanding X-ray cavities observed in hot gas atmospheres of many galaxy groups and clusters generate shock waves and turbulence that are primary heating mechanisms required to avoid uninhibited radiatively cooling flows which are not observed. However, we show here that the evolution of buoyant cavities also stimulates radiative cooling of observable masses of low-temperature gas. During their early evolution, radiative cooling occurs in the wakes of buoyant cavities in two locations: in thin radial filaments parallel to the buoyant velocity and more broadly in gas compressed beneath rising cavities. Radiation from these sustained compressions removes entropy from the hot gas. Gas experiencing the largest entropy loss cools first, followed by gas with progressively less entropy loss. Most cooling occurs at late times, ∼10{sup 8}–10{sup 9} yr, long after the X-ray cavities have disrupted and are impossible to detect. During these late times, slightly denser low entropy gas sinks slowly toward the centers of the hot atmospheres where it cools intermittently, forming clouds near the cluster center. Single cavities of energy 10{sup 57}–10{sup 58} ergs in the atmosphere of the NGC 5044 group create 10{sup 8}–10{sup 9} M{sub ⊙} of cooled gas, exceeding the mass of extended molecular gas currently observed in that group. The cooled gas clouds we compute share many attributes with molecular clouds recently observed in NGC 5044 with ALMA: self-gravitationally unbound, dust-free, quasi-randomly distributed within a few kiloparsecs around the group center.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2014

Operation of the Australian Store.Synchrotron for macromolecular crystallography

The Store.Synchrotron service, a fully functional, cloud computing-based solution to raw X-ray data archiving and dissemination at the Australian Synchrotron, is described. The Store.Synchrotron service, a fully functional, cloud computing-based solution to raw X-ray data archiving and dissemination at the Australian Synchrotron, is described. The service automatically receives and archives raw diffraction data, related metadata and preliminary results of automated data-processing workflows. Data are able to be shared with collaborators and opened to the public. In the nine months since its deployment in August 2013, the service has handled over 22.4 TB of raw data (∼1.7 million diffraction images). Several real examples from the Australian crystallographic community are described that illustrate the advantages of the approach, which include real-time online data access and fully redundant, secure storage. Discoveries in biological sciences increasingly require multidisciplinary approaches. With this in mind, Store.Synchrotron has been developed as a component within a greater service that can combine data from other instruments at the Australian Synchrotron, as well as instruments at the Australian neutron source ANSTO. It is therefore envisaged that this will serve as a model implementation of raw data archiving and dissemination within the structural biology research community.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2024

Repurposing of the Run 2 CMS High Level Trigger Infrastructure as a Cloud Resource for Offline Computing

The former CMS Run 2 High Level Trigger (HLT) farm is one of the largest contributors to CMS compute resources, providing about 25k job slots for offline computing. This CPU farm was initially employed as an opportunistic resource, exploited during inter-fill periods, in the LHC Run 2. Since then, it has become a nearly transparent extension of the CMS capacity at CERN, being located on-site at the LHC interaction point 5 (P5), where the CMS detector is installed. This resource has been configured to support the execution of critical CMS tasks, such as prompt detector data reconstruction. It can therefore be used in combination with the dedicated Tier 0 capacity at CERN, in order to process and absorb peaks in the stream of data coming from the CMS detector. The initial configuration for this resource, based on statically configured VMs, provided the required level of functionality. However, regular operations of this cluster revealed certain limitations compared to the resource provisioning and use model employed in the case of WLCG sites. A new configuration, based on a vacuum-like model, has been implemented for this resource in order to solve the detected shortcomings. This paper reports about this redeployment work on the permanent cloud for an enhanced support to CMS offline computing, comparing the former and new models’ respective functionalities, along with the commissioning effort for the new setup.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗