SEARCH · Search NASA
Results for “cloud computing”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Cloud Computing Techniques for Space Mission Design
The overarching objective of space mission design is to tackle complex problems producing better results, and faster. In developing the methods and tools to fulfill this objective, the user interacts with the different layers of a computing system.
Remotely Monitoring Lake and Reservoir Area Changes Globally Using Cloud Computing
No abstract provided
Federated Cloud Challenges in NASA's Earth Science Data Systems (Why So Difficult?)
NASA is presented with a number of opportunities and challenges in federating its Earth Science Data Systems in the burgeoning world of cloud computing. Cloud hosting of Earth Science data provides a new way of bringing data together, at least from a virtual location sense, and is one of the main motives for NASA to host data there. However, NASA is also faced with a Big Data Variety challenge, brought on by the variety of the EO datasets in its archives. This diversity requires many diverse science archives to service the different science communities. As a result, nearly every major function in the Earth Observing System Data and Information System (EOSDIS) must also be federated across its data centers. This pattern is repeated with many of the outside agencies and organizations that EOSDIS federates with, such as the Committee for Earth Observing Satellites, leading to pioneering work on "deep federation" in a joint project with the European Space Agency to develop a Multi-Mission Algorithm and Analysis Platform.
MERRA Analytic Services: Meeting the Big Data Challenges of Climate Science Through Cloud-enabled Climate Analytics-as-a-service
Climate science is a Big Data domain that is experiencing unprecedented growth. In our efforts to address the Big Data challenges of climate science, we are moving toward a notion of Climate Analytics-as-a-Service (CAaaS). We focus on analytics, because it is the knowledge gained from our interactions with Big Data that ultimately produce societal benefits. We focus on CAaaS because we believe it provides a useful way of thinking about the problem: a specialization of the concept of business process-as-a-service, which is an evolving extension of IaaS, PaaS, and SaaS enabled by Cloud Computing. Within this framework, Cloud Computing plays an important role; however, we it see it as only one element in a constellation of capabilities that are essential to delivering climate analytics as a service. These elements are essential because in the aggregate they lead to generativity, a capacity for self-assembly that we feel is the key to solving many of the Big Data challenges in this domain. MERRA Analytic Services (MERRAAS) is an example of cloud-enabled CAaaS built on this principle. MERRAAS enables MapReduce analytics over NASAs Modern-Era Retrospective Analysis for Research and Applications (MERRA) data collection. The MERRA reanalysis integrates observational data with numerical models to produce a global temporally and spatially consistent synthesis of 26 key climate variables. It represents a type of data product that is of growing importance to scientists doing climate change research and a wide range of decision support applications. MERRAAS brings together the following generative elements in a full, end-to-end demonstration of CAaaS capabilities: (1) high-performance, data proximal analytics, (2) scalable data management, (3) software appliance virtualization, (4) adaptive analytics, and (5) a domain-harmonized API. The effectiveness of MERRAAS has been demonstrated in several applications. In our experience, Cloud Computing lowers the barriers and risk to organizational change, fosters innovation and experimentation, facilitates technology transfer, and provides the agility required to meet our customers' increasing and changing needs. Cloud Computing is providing a new tier in the data services stack that helps connect earthbound, enterprise-level data and computational resources to new customers and new mobility-driven applications and modes of work. For climate science, Cloud Computing's capacity to engage communities in the construction of new capabilies is perhaps the most important link between Cloud Computing and Big Data.
Present status of cloud velocity computations from the ATS I and ATS III satellites.
Cloud velocity computations from ATS 1 and 3 satellites spin-scan photographs for prediction of neph systems motion and thunderstorms
Lost in Cloud
Cloud computing can reduce cost significantly because businesses can share computing resources. In recent years Small and Medium Businesses (SMB) have used Cloud effectively for cost saving and for sharing IT expenses. With the success of SMBs, many perceive that the larger enterprises ought to move into Cloud environment as well. Government agency s stove-piped environments are being considered as candidates for potential use of Cloud either as an enterprise entity or pockets of small communities. Cloud Computing is the delivery of computing as a service rather than as a product, whereby shared resources, software, and information are provided to computers and other devices as a utility over a network. Underneath the offered services, there exists a modern infrastructure cost of which is often spread across its services or its investors. As NASA is considered as an Enterprise class organization, like other enterprises, a shift has been occurring in perceiving its IT services as candidates for Cloud services. This paper discusses market trends in cloud computing from an enterprise angle and then addresses the topic of Cloud Computing for NASA in two possible forms. First, in the form of a public Cloud to support it as an enterprise, as well as to share it with the commercial and public at large. Second, as a private Cloud wherein the infrastructure is operated solely for NASA, whether managed internally or by a third-party and hosted internally or externally. The paper addresses the strengths and weaknesses of both paradigms of public and private Clouds, in both internally and externally operated settings. The content of the paper is from a NASA perspective but is applicable to any large enterprise with thousands of employees and contractors.
Radiative Heating Rates Computed With Clouds Derived From Satellite‐Based Passive and Active Sensors and their Effects on Generation of Available Potential Energy
Radiative heating rates computed with cloud properties derived from passive and active sensors are investigated. Zonal monthly radiative heating rate anomalies computed using both active and passive sensors show that larger variability in longwave cooling exists near the tropical tropopause and near the top of the boundary layer between ~50°N to ~50°S. Aerosol variability contributes to increases in shortwave heating rate variability. When zonal monthly mean cloud effects on the radiative heating rate computed with both active and passive sensors and those computed with passive sensor only are compared, the latter shows cooling and heating peaks corresponding to cloud top and base height ranges used for separating cloud types. The difference of these two sets of cloud radiative effect on heating rates in the middle to upper troposphere is larger than the radiative heating rate uncertainty estimated based on the difference of two active sensor radiative heating rate profile data products. In addition, radiative heating rate contribution to generation of eddy available potential energy is also investigated. Although radiation contribution to generation of eddy available potential energy averaged over a year and the entire globe is small, radiation increases the eddy available potential energy in the northern hemisphere during summer. Two key elements that longwave radiation contribute to the generation of eddy potential energy are (1) longitudinal temperature gradient in the atmosphere associated with land and ocean surface temperatures contrasts and absorption of longwave radiation emitted by the surface and (2) cooling near the cloud top of stratocumulus clouds.
How to Cloud for Earth Scientists: An Introduction
This presentation is a tutorial on getting started with cloud computing for the purposes of Earth Observation datasets. We first discuss some of the main advantages that cloud computing can provide for the Earth scientist: copious processing power, immense and affordable data storage, and rapid startup time. We also talk about some of the challenges of getting the most out of cloud computing: re-organizing the way data are analyzed, handling node failures and attending.
Evaluating the Efficacy of the Cloud for Cluster Computation
Computing requirements vary by industry, and it follows that NASA and other research organizations have computing demands that fall outside the mainstream. While cloud computing made rapid inroads for tasks such as powering web applications, performance issues on highly distributed tasks hindered early adoption for scientific computation. One venture to address this problem is Nebula, NASA's homegrown cloud project tasked with delivering science-quality cloud computing resources. However, another industry development is Amazon's high-performance computing (HPC) instances on Elastic Cloud Compute (EC2) that promises improved performance for cluster computation. This paper presents results from a series of benchmarks run on Amazon EC2 and discusses the efficacy of current commercial cloud technology for running scientific applications across a cluster. In particular, a 240-core cluster of cloud instances achieved 2 TFLOPS on High-Performance Linpack (HPL) at 70% of theoretical computational performance. The cluster's local network also demonstrated sub-100 ?s inter-process latency with sustained inter-node throughput in excess of 8 Gbps. Beyond HPL, a real-world Hadoop image processing task from NASA's Lunar Mapping and Modeling Project (LMMP) was run on a 29 instance cluster to process lunar and Martian surface images with sizes on the order of tens of gigapixels. These results demonstrate that while not a rival of dedicated supercomputing clusters, commercial cloud technology is now a feasible option for moderately demanding scientific workloads.
GES DISC Data Recipes in Jupyter Notebooks
The Earth Science Data and Information System (ESDIS) Project manages twelve Distributed Active Archive Centers (DAACs) which are geographically dispersed across the United States. The DAACs are responsible for ingesting, processing, archiving, and distributing Earth science data produced from various sources (satellites, aircraft, field measurements, etc.). In response to projections of an exponential increase in data production, there has been a recent effort to prototype various DAAC activities in the cloud computing environment. This, in turn, led to the creation of an initiative, called the Cloud Analysis Toolkit to Enable Earth Science (CATEES), to develop a Python software package in order to transition Earth science data processing to the cloud. This project, in particular, supports CATEES and has two primary goals. One, to transition data recipes created by the Goddard Earth Science Data and Information Service Center (GES DISC) into an interactive and educational environment using JupyterNotebooks. Two, to acclimate Earth scientists to cloud computing. To accomplish these goals, we create JupyterNotebooks to compartmentalize the different steps of data analysis and help users obtain and parse data from the command line. We also develop a Docker container, comprised of Jupyter Notebooks, Python dependencies, and command line tools, and configure it into an easy-to-deploy package. The end result is an end-to-end product that simulates the use case of end users working in the cloud computing environment.
Cultivating an Emergent Earth Observation Analytics Ecosystem in the Cloud
A diverse set of data analytics systems for Earth Observations are sprouting up in the Earth Science community, with a wealth of processing algorithms and analysis methods. There is a similar wealth of data resources available via myriad data providers and clearinghouses, including large institutional systems like the Earth Observing System Data and Information System, Comprehensive Large Scale Array-data Stewardship System, and Federated Earth Observation Missions gateway. With Earth system science driving a need to work with more datasets together, and the community developing more analysis tools (some of them dataset-specific), how can we develop analysis workflows that incorporate far-flung datasets and leverage analysis resources from multiple organizations? Cloud computing points the way toward a solution in two different respects. Firstly, the access to and abstraction of virtually unlimited storage and computing power provides an environment that enables more straightforward means of pulling datasets and analysis resources together. Just as importantly, however, cloud computing serves as an example of an "ecosystem" of interoperating services, since the essence of cloud computing is the presentation of all resources as a service, from hardware to infrastructure to platform to software. This enables the combination of off-the-shelf, diverse services to construct entire systems that emerge out of an equally diverse community of architects and developers. This approach can be similarly applied to the data and analysis resources in the Earth Observation community. By exposing these resources via well understood services, and consuming resources in the same way, different organizations can construct bespoke analysis workflows and systems for their own purposes. The key leap the community needs to make is to develop analysis systems in components that interact with other components via services. The result would be a rich ecosystem of analytics components that can be combined to analyze datasets at scale and in conjunction with other datasets from other sources.
Cloud-Based Numerical Weather Prediction for Near Real-Time Forecasting and Disaster Response
The use of cloud computing resources continues to grow within the public and private sector components of the weather enterprise as users become more familiar with cloud‐computing concepts, and competition among service providers continues to reduce costs and other barriers to entry. Cloud resources can also provide capabilities similar to high‐performance computing environments, supporting multi‐node systems required for near real‐time, regional weather predictions. Referred to as "Infrastructure as a Service", or IaaS, the use of cloud-based computing hardware in an on‐demand payment system allows for rapid deployment of a modeling system in environments lacking access to a large, supercomputing infrastructure. Use of IaaS capabilities to support regional weather prediction may be of particular interest to developing countries that have not yet established large supercomputing resources, but would otherwise benefit from a regional weather forecasting capability. Recently, collaborators from NASA Marshall Space Flight Center and Ames Research Center have developed a scripted, on‐demand capability for launching the NOAA/NWS Science and Training Resource Center (STRC) Environmental Modeling System (EMS), which includes pre‐compiled binaries of the latest version of the Weather Research and Forecasting (WRF) model. The WRF‐EMS provides scripting for downloading appropriate initial and boundary conditions from global models, along with higher‐resolution vegetation, land surface, and sea surface temperature data sets provided by the NASA Short‐term Prediction Research and Transition (SPoRT) Center. This presentation will provide an overview of the modeling system capabilities and benchmarks performed on the Amazon Elastic Compute Cloud (EC2) environment. In addition, the presentation will discuss future opportunities to deploy the system in support of weather prediction in developing countries supported by NASA's SERVIR Project, which provides capacity building activities in environmental monitoring and prediction across a growing number of regional hubs throughout the world. Capacity‐building applications that extend numerical weather prediction to developing countries are intended to provide near real‐time applications to benefit public health, safety, and economic interests, but may have a greater impact during disaster events by providing a source for local predictions of weather‐related hazards, or impacts that local weather events may have during the recovery phase.
On radiational cooling computations in clouds.
Expressions are derived for the cooling or heating rates for clouds in which the condensed phase is either ice or water. Values are computed for ice and water clouds over a reasonable temperature range for pressures of 1000, 500, and 200 mb. The importance is shown of adequately allowing for the latent load in computations of radiative cooling or heating rates based on measurements of radiative divergence in clouds. It is shown that, other things being equal, the effect of the latent load is always greatest at low levels and higher temperatures.
Achieving Breakthroughs in Global Hydrologic Science by Unlocking the Power of Multisensor, Multidisciplinary Earth Observations
Over the last half century, remote sensing has transformed hydrologic science. Whereas early efforts were devoted to observation of discrete variables, we now consider spaceborne missions dedicated to interlinked global hydrologic processes.Furthermore, cloud computing and computational techniquesare accelerating analyses of these data. How will the hydrologic community use these new resources to better understand the world’s water and relatedchallenges facing society? In this Commentary, we suggest that optimizing the benefits of remote sensing for advancing hydrologic research will happen byintegratingmultidisciplinary and multisensor data, leveraging commercial satellite measurements, and employingdata assimilation, cloud computing, and machine learning.We provide several recommendations to these ends. Plain Language Summary Observations from satellites have transformed hydrologic science. Early efforts, five decades ago, mapped attributes like snow cover, rainfall, topography, and vegetation, but now we consider new missions specifically designed to study global hydrologic processes. We also take advantageof new technologies like cloud computing and artificial intelligence. We describe strategiesfor maximizing the benefits of remote sensing for hydrology, encouraging research across disciplines using multiple sensors, using new commercially available satellites, and combining remote sensing measurements with hydrologic models.
Climate Analytics as a Service
Exascale computing, big data, and cloud computing are driving the evolution of large-scale information systems toward a model of data-proximal analysis. In response, we are developing a concept of climate analytics as a service (CAaaS) that represents a convergence of data analytics and archive management. With this approach, high-performance compute-storage implemented as an analytic system is part of a dynamic archive comprising both static and computationally realized objects. It is a system whose capabilities are framed as behaviors over a static data collection, but where queries cause results to be created, not found and retrieved. Those results can be the product of a complex analysis, but, importantly, they also can be tailored responses to the simplest of requests. NASA's MERRA Analytic Service and associated Climate Data Services API provide a real-world example of climate analytics delivered as a service in this way. Our experiences reveal several advantages to this approach, not the least of which is orders-of-magnitude time reduction in the data assembly task common to many scientific workflows.
Shortwave Broadband Irradiance Computations Using Cloud Properties Combined from CALIPSO, CloudSat, and MODIS
In this study, cloud properties measured from the CALIPSO, CloudSat, and MODIS (CCM) are used for top-of-atmosphere (TOA) shortwave (SW) broadband (BB) irradiance computations. The CALIPSO and CloudSat active sensors provide detailed cloud vertical profiles, but these occasionally miss parts of the cloud columns due to the full attenuation of sensor signals, surface clutter, or insensitivity to a certain range of cloud particle sizes. As a result, the CCM-merged cloud extinction coefficient profiles can be underestimated. Therefore, we compare the column-integrated visible scaled cloud optical depth (VSCOD) of the CCM-merged cloud extinction coefficient profile with the MODIS-estimated VSCOD and apply a scaling factor to the CCM-merged cloud extinction profile. The VSCOD is defined as a visible cloud optical depth multiplied by (1¬–asymmetry parameter). The SW irradiances are computed using the scaled CCM-merged cloud extinction coefficient and effective radius profiles. It is shown that the multi-sensor-combined cloud profiles significantly reduce positive TOA SW BB biases, compared to those with MODIS-derived cloud properties only. The improvement is more pronounced for optically thick clouds, where MODIS ice particle effective radius is largely underestimated.