Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

NASA Space Communications and Navigation Approach to Cloud Capability Implementation

The integration of cloud services and capabilities across government and commercial sectors has continued to increase over the last several years. Cloud architectures provide on-demand process, storage, and transfer of data as a service without the need to purchase expensive hardware, infrastructure, and their associated maintenance costs. Most cloud environments charge the user for only the resources they use, making cloud implementations highly scalable and easily adjustable to the user’s changing demands.

cloud computing↗

Atlas: Navigating NASA’s Knowledge Universe with AI-Powered Natural Language Queries

NASA has a vast archive of engineering guidelines, standards, and best practices collected over decades. This encompasses a breadth of topics from rocketry and engineering standards to risk management and space-related health issues. This wealth of information, while invaluable to NASA engineers, staff, and the public, is too extensive for any individual to fully comprehend. To address this challenge, we have developed Atlas, a tool within NASA's Mission Cloud Platform that enables users to query these diverse sources effectively. Atlas allows users to ask natural language questions and receive answers grounded in factual information from source documents. The tool provides responses with direct quotations and links to original documents, ensuring transparency and accuracy. It can address a wide range of queries, from specific technical details like safe distances for rocket launches from lightning to broader topics such as crew health requirements for long-duration space missions, corrosion protection in low Earth orbit, and NASA's agreements with various entities. In developing Atlas, we encountered and overcame several technical challenges. Large Language Models often struggle with consistently providing accurate information, especially for highly specialized topics. We implemented strategies to prevent hallucinations and ensure the reliability of responses, even for complex questions on topics ranging from NASA Mission Classes to intricate rocket science concepts. Additionally, we addressed the challenges of delivering quick responses while maintaining cost-effectiveness. Our presentation will detail the innovative approaches we employed to optimize performance and efficiency, making Atlas a powerful and practical tool for accessing NASA's extensive knowledge base.

Artificial Intelligence↗

Efficient Access to MERRA-2 Reanalysis Data from the Cloud Archives

The Modern-Era Retrospective analysis for Research and Applications, Version (MERRA-2) dataset is now available in the AWS West Region-2 cloud. The free data downloading policy remains unchanged. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) offers cloud services such as OPeNDP subsetting, and time series services. This presentation will showcase use cases that testing the procedures and find the most efficiency workflows to access and process the data for finding climate extremes. The use cases include a) accessing and processing data directly in the cloud S3 bucket without downloading it, and b) downloading subset data to process on the user’s local system.

data access, cloud computing, climate extremes↗

A support architecture for reliable distributed computing systems

The Clouds project is well underway to its goal of building a unified distributed operating system supporting the object model. The operating system design uses the object concept of structuring software at all levels of the system. The basic operating system was developed and work is under progress to build a usable system.

Dasgupta, Partha↗

Low-power millimeter-wave radar observations of the atmosphere

Historically, cloud structures, dynamics, and precipitation processes have been observed and measured with sensors from two different spatial resolutions. Laser-based sensors have volume resolutions on the order of 10(exp -4) to 10(exp -2) cubic meters for a 1-s sample. Radar systems operating at wavelengths between 1 and 10 cm have resolutions on the order of 10(exp 4) to 10(exp 7) cubic meters. The resolutions of micro-wave systems depend primarily on the system RF bandwidth and antenna bandwidth. Both resolution regimes were useful in the study of cloud structures and processes - the former for determining resolution on the individual cloud particle scale and the latter for studying the coarse characteristics of cloud dynamics and structure. There are, however, cloud processes and structures that occur on scales that lie between these two regimes: the process of entrainment, where outside air is brought within the cloud boundaries; the mixing of in-cloud particles with different histories; cloud particle coalescence; and ice formation. The use of mm-wave (30- to 300-GHz) radars offers an opportunity to observe cloud processes at these scales and determine their influence on precipitation development, cloud albedos, cloud lifetimes, chemical cycling of tract substances, aircraft icing, and other meteorological phenomena. To determine the usefulness of a 35-GHz radar for observing these precipitation and cloud processes, a research program was initiated. The objectives of this program are to develop a 35-GHz radar, to measure scattering from precipitation and clouds, and to develop a model to compute scattering from clouds using the finite-difference time-domain (FDTD) technique.

Ronnau, James F.↗

Evaluating the Suitability of Commercial Clouds for NASA's High Performance Computing Applications: A Trade Study

NASA’s High-End Computing Capability (HECC) Project is periodically asked if it could be more cost effective through the use of commercial cloud resources. To answer the question, HECC’s Application Performance and Productivity (APP) team undertook a performance and cost evaluation comparing three domains: two commercial cloud providers, Amazon and Penguin, and HECC’s in-house resources—the Pleiades and Electra systems. In the study, the APP team used a combination of the NAS Parallel Benchmarks (NPB) and six full applications from NASA’s workload on Pleiades and Electra to compare performance of nodes based on three different generations of Intel Xeon processors—Haswell, Broadwell, and Skylake. Because of export control limitations, the most heavily used applications on Pleiades and Electra could not be used in the cloud; therefore, only one of the applications, OpenFOAM, represents work from the Aeronautics Research Mission Directorate and the Human and Exploration Mission Directorate. The other five applications are from the Science Mission Directorate.

High Performance↗

The Namibia Early Flood Warning System, A CEOS Pilot Project

Over the past year few years, an international collaboration has developed a pilot project under the auspices of Committee on Earth Observation Satellite (CEOS) Disasters team. The overall team consists of civilian satellite agencies. For this pilot effort, the development team consists of NASA, Canadian Space Agency, Univ. of Maryland, Univ. of Colorado, Univ. of Oklahoma, Ukraine Space Research Institute and Joint Research Center(JRC) for European Commission. This development team collaborates with regional , national and international agencies to deliver end-to-end disaster coverage. In particular, the team in collaborating on this effort with the Namibia Department of Hydrology to begin in Namibia . However, the ultimate goal is to expand the functionality to provide early warning over the South Africa region. The initial collaboration was initiated by United Nations Office of Outer Space Affairs and CEOS Working Group for Information Systems and Services (WGISS). The initial driver was to demonstrate international interoperability using various space agency sensors and models along with regional in-situ ground sensors. In 2010, the team created a preliminary semi-manual system to demonstrate moving and combining key data streams and delivering the data to the Namibia Department of Hydrology during their flood season which typically is January through April. In this pilot, a variety of moderate resolution and high resolution satellite flood imagery was rapidly delivered and used in conjunction with flood predictive models in Namibia. This was collected in conjunction with ground measurements and was used to examine how to create a customized flood early warning system. During the first year, the team made use of SensorWeb technology to gather various sensor data which was used to monitor flood waves traveling down basins originating in Angola, but eventually flooding villages in Namibia. The team made use of standardized interfaces such as those articulated under the Open Cloud Consortium (OGC) Sensor Web Enablement (SWE) set of web services was good [1][2]. However, it was discovered that in order to make a system like this functional, there were many performance issues. Data sets were large and located in a variety of location behind firewalls and had to be accessed across open networks, so security was an issue. Furthermore, the network access acted as bottleneck to transfer map products to where they are needed. Finally, during disasters, many users and computer processes act in parallel and thus it was very easy to overload the single string of computers stitched together in a virtual system that was initially developed. To address some of these performance issues, the team partnered with the Open Cloud Consortium (OCC) who supplied a Computation Cloud located at the University of Illinois at Chicago and some manpower to administer this Cloud. The Flood SensorWeb [3] system was interfaced to the Cloud to provide a high performance user interface and product development engine. Figure 1 shows the functional diagram of the Flood SensorWeb. Figure 2 shows some of the functionality of the Computation Cloud that was integrated. A significant portion of the original system was ported to the Cloud and during the past year, technical issues were resolved which included web access to the Cloud, security over the open Internet, beginning experiments on how to handle surge capacity by using the virtual machines in the cloud in parallel, using tiling techniques to render large data sets as layers on map, interfaces to allow user to customize the data processing/product chain and other performance enhancing techniques. The conclusion reached from the effort and this presentation is that defining the interoperability standards in a small fraction of the work. For example, once open web service standards were defined, many users could not make use of the standards due to security restrictions. Furthermore, once an interoperable sysm is functional, then a surge of users can render a system unusable, especially in the disaster domain.

Mandl, Daniel↗

Methods of editing cloud and atmospheric layer affected pixels from satellite data

Practical methods of computer screening cloud-contaminated pixels from data of various satellite systems are proposed. Examples are given of the location of clouds and representative landscape features in HCMM spectral space of reflectance (VIS) vs emission (IR). Methods of screening out cloud affected HCMM are discussed. The character of subvisible absorbing-emitting atmospheric layers (subvisible cirrus or SCi) in HCMM data is considered and radiosonde soundings are examined in relation to the presence of SCi. The statistical characteristics of multispectral meteorological satellite data in clear and SCi affected areas are discussed. Examples in TIROS-N and NOAA-7 data from several states and Mexico are presented. The VIS-IR cluster screening method for removing clouds is applied to a 262, 144 pixel HCMM scene from south Texas and northeast Mexico. The SCi that remain after cluster screening are sited out by applying a statistically determined IR limit.

Nixon, P. R.↗

Progress Towards a Common CERES Cloud Mask Algorithm for MODIS and VIIRS: Evaluation using CALIOP Data

For over two decades The Clouds and the Earth’s Radiant Energy System (CERES) project has endeavored to produce a long-term global climate data record for detecting changes in the Earth’s radiation budget and to improve understanding of how clouds contribute to those changes. CERES incorporates cloud information derived from passive narrowband satellite imaging radiometers, and over the course of the project different instruments have contributed to this effort, namely the Moderate Resolution Imaging Spectroradiometer (MODIS) and the Visible Infrared Imaging Radiometer Suite (VIIRS).Cloud properties have been derived from MODIS on the Aqua satellite for CERES since 2002,and VIIRS on the NOAA-20 satellite launched in 2017 will continue the cloud record once Aqua-MODIS reaches the end of its operational lifetime. However, MODIS and VIIRS have different spectral capabilities and characteristics which complicates our ability to seamlessly transition the record from MODIS to VIIRS. This study evaluates some of the recent algorithm modifications incorporated by the CERES Cloud Working Group towards developing a unified cloud mask algorithm for MODIS and VIIRS that utilizes a set of spectral bands common to both instruments. Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) data products are used to evaluate MODIS and VIIRS regional cloud fraction estimates and identify areas where improvements can be made. The cloud mask algorithm relies on computed estimates of cloud-free top-of-atmosphere radiances to differentiate cloudy and cloud-free imager pixels. The unified cloud mask algorithm currently under development uses a reduced number of spectral bands common to both MODIS and VIIRS and so relies on the accuracy of these simulated cloud-free radiances more heavily than predecessor algorithms, i.e., the CERES Edition 4 cloud mask, which use as much spectral information as available on each imager with less consideration for cross-platform consistency. Our validation strategy using CALIOP data is also described. The CALIOP observations are critical for assessing cloud detection accuracies and for independently confirming cloud-free conditions which enables a more robust evaluation of the simulated cloud-free radiances for biases due to factors such as view angle and the spectral dependence of water vapor absorption. These effects are known to differ for the two satellite instruments. Comparisons of MODIS and VIIRS cloud fractions are presented in context with estimates from CALIOP and from the CERES Edition 4 cloud mask algorithm to gauge current progress in developing accurate and consistent MODIS and VIIRS cloud properties for CERES.

CERES↗

Global, Multi-Year Analysis of Clouds and Earth's Radiant Energy System Terra Observations and Radiative Transfer Calculations

An extended record of the Terra Surface and Atmosphere Radiation Budget (SARB) computed by CERES (Clouds and Earth s Radiant Energy System) is produced in gridded form, facilitating an investigation of global scale direct aerosol forcing. The new gridded version (dubbed FSW) has a spacing of 1 at the Equator. A companion document (Rutan et al. 2005) focuses on advances to (and validation of) the ungridded, footprint scale calculations (dubbed CRS), primarily in clear-sky conditions. While mainly intended to provide observations of fluxes at the top of atmosphere (TOA), CERES (Wielicki et al. 1996) includes a program to also compute the fluxes at TOA, within the atmosphere and at the surface, and also to validate the results with independent ground based measurements (Charlock and Alberta 1996). ARM surface data has been a focus for this component of CERES. To permit the user to infer cloud forcing and direct aerosol forcing with the computed SARB, CERES includes surface and TOA fluxes that have been computed for cloud-free (clear) and aerosol free (pristine) footprints; this accounts for aerosol effects (SW scattering and absorption, and LW scattering, absorption and emission) to both clear and cloudy skies.

Charlock, T. P.↗

Estimating integrated cloud liquid water from extended time observations of solar irradiance

An analysis technique used to estimate the integrated liquid water content (LWC) from the measured solar irradiance is described. The cloud transmittance is computed by dividing the irradiance measured at some time by a clear sky value obtained at the same time on a cloudless day. From the transmittance and the zenith angle, the cloud LWC is computed using the radiative transfer parameterizations of Stephens et al., (1984). The results are compared with 17 days of mm-wave (20.6 and 31.65 GHz) radiometer measurements made during the First ISCCP Regional Experiment (FIRE) Intensive Field Observation (IFO) in July of 1987.

Fairall, C. W.↗

An eight-month climatology of marine stratocumulus cloud fraction, albedo, and integrated liquid water

As part of the FIRE/Extended Time Observations (ETO) program, extended time observations were made at San Nicolas Island (SNI) from March to October, 1987. Hourly averages of air temperature, relative humidity, wind speed and direction, solar irradiance, and downward longwave irradiance were recorded. The radiation sensors were standard Eppley pyranometers (shortwave) and pyrgeometers (longwave). The SNI data were processed in several ways to deduce properties of the stratocumulus covered marine boundary layer (MBL). For example, from the temperature and humidity the lifting condensation level, which is an estimate of the height of the cloud bottom, can be computed. A combination of longwave irradiance statistics can be used to estimate fractional cloud cover. An analysis technique used to estimate the integrated cloud liquid water content (W) and the cloud albedo from the measured solar irradiance is also described. In this approach, the cloud transmittance is computed by dividing the irradiance measured at some time by a clear sky value obtained at the same hour on a cloudless day. From the transmittance and the zenith angle, values of cloud albedo and W are computed using the radiative transfer parameterizations of Stephens (1978). These analysis algorithms were evaluated with 17 days of simultaneous and colocated mm-wave (20.6 and 31.65 GHz) radiometer measurements of W and lidar ceilometer measurements of cloud fraction and cloudbase height made during the FIRE IFO. The algorithms are then applied to the entire data set to produce a climatology of these cloud properties for the eight month period.

Fairall, C. W.↗

Parameterizing Grid-Averaged Longwave Fluxes for Inhomogeneous Marine Boundary Layer Clouds

This paper examines the relative impacts on grid-averaged longwave flux transmittance (emittance) for Marine Boundary Layer (MBL) cloud fields arising from horizontal variability of optical depth tau and cloud sides, First, using fields of Landsat-inferred tau and a Monte Carlo photon transport algorithm, it is demonstrated that mean all-sky transmittances for 3D variable MBL clouds can be computed accurately by the conventional method of linearly weighting clear and cloudy transmittances by their respective sky fractions. Then, the approximations of decoupling cloud and radiative properties and assuming independent columns are shown to be adequate for computation of mean flux transmittance. Since real clouds have nonzero geometric thicknesses, cloud fractions A'(sub c) presented to isotropic beams usually exceed the more familiar vertically projected cloud fractions A(sub c). It is shown, however, that when A(sub c)less than or equal to 0.9, biases for all-sky transmittance stemming from use of A(sub c) as opposed to A'(sub c) are roughly 2-5 times smaller than, and opposite in sign to, biases due to neglect of horizontal variability of tau. By neglecting variable tau, all-sky transmittances are underestimated often by more than 0.1 for A(sub c) near 0.75 and this translates into relative errors that can exceed 40% (corresponding errors for all-sky emittance are about 20% for most values of A(sub c). Thus, priority should be given to development of General Circulation Model (GCM) parameterizations that account for the effects of horizontal variations in unresolved tau, effects of cloud sides are of secondary importance. On this note, an efficient stochastic model for computing grid-averaged cloudy-sky flux transmittances is furnished that assumes that distributions of tau, for regions comparable in size to GCM grid cells, can be described adequately by gamma distribution functions. While the plane-parallel, homogeneous model underestimates cloud transmittance by about an order of magnitude when 3D variable cloud transmittances are less than or equal to 0.2 and by approx. 20% to 100% otherwise, the stochastic model reduces these biases often by more than 80%.

Barker, Howard W.↗

IN13B-1660: Analytics and Visualization Pipelines for Big Data on the NASA Earth Exchange (NEX) and OpenNEX

We are developing capabilities for an integrated petabyte-scale Earth science collaborative analysis and visualization environment. The ultimate goal is to deploy this environment within the NASA Earth Exchange (NEX) and OpenNEX in order to enhance existing science data production pipelines in both high-performance computing (HPC) and cloud environments. Bridging of HPC and cloud is a fairly new concept under active research and this system significantly enhances the ability of the scientific community to accelerate analysis and visualization of Earth science data from NASA missions, model outputs and other sources. We have developed a web-based system that seamlessly interfaces with both high-performance computing (HPC) and cloud environments, providing tools that enable science teams to develop and deploy large-scale analysis, visualization and QA pipelines of both the production process and the data products, and enable sharing results with the community. Our project is developed in several stages each addressing separate challenge - workflow integration, parallel execution in either cloud or HPC environments and big-data analytics or visualization. This work benefits a number of existing and upcoming projects supported by NEX, such as the Web Enabled Landsat Data (WELD), where we are developing a new QA pipeline for the 25PB system.

visualization↗

Prognostics As-A-Service: A Scalable Cloud Architecture for Prognostics

Comprehensive aircraft system health-state awareness is critical for maintaining safe, efficient growth in global operations, enabling higher levels of autonomy, and facilitating new forms of aviation. Maintainers, vehicle operators, air traffic controllers, dispatchers, pilots, autonomous systems, and other decision-makers must have reliable real-time knowledge of the vehicle health, the health of its critical composite systems, predictions of how health changes with time, and forecasts of how its capabilities change with health degradation to preserve safety and efficiency. Providing this information in a reliable manner in computationally constrained environments and across a wide range of vehicles and systems continues to be a challenge. This challenge can be partially resolved through cloud computing, where the execution of prognostic and diagnostic algorithms is performed on a network of remote servers hosted on the internet. NASA is developing a cloud computing service, Prognostics As-A-Service (PaaS), that explores the feasibility and challenges of cloud-enhanced prognostics. Though such a system has broad applicability, this research effort is focused on aviation applications.

Prognostics↗

Collapse and equilibrium of rotating, adiabatic clouds

A numerical hydrodynamics computer code analysis of the collapse and establishment of equilibrium of adiabatic gas clouds restricted to axial symmetry found that the clouds are originally uniform in density and rotation. The method can compare the dynamic collapse and approach to equilibrium with the data on incompressible uniformly rotating equilibrium clouds and on equilibrium structures of differentially rotating polytropes. It is concluded that the stellar formation theory indicates that the low alpha fragments produced at the termination of the dynamic isothermal collapse phase of interstellar clouds may undergo significant dynamic collapse in an adiabatic regime leading to transitory ring formation and additional fragmentation on a smaller scale.

Boss, A. P.↗