Search NASASearch

SEARCH · Search NASA

Results for “cloud computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

The Virtual Climate Data Server (vCDS): An iRODS-Based Data Management Software Appliance Supporting Climate Data Services and Virtualization-as-a-Service in the NASA Center for Climate Simulation

Scientific data services are becoming an important part of the NASA Center for Climate Simulation's mission. Our technological response to this expanding role is built around the concept of a Virtual Climate Data Server (vCDS), repetitive provisioning, image-based deployment and distribution, and virtualization-as-a-service. The vCDS is an iRODS-based data server specialized to the needs of a particular data-centric application. We use RPM scripts to build vCDS images in our local computing environment, our local Virtual Machine Environment, NASA s Nebula Cloud Services, and Amazon's Elastic Compute Cloud. Once provisioned into one or more of these virtualized resource classes, vCDSs can use iRODS s federation capabilities to create an integrated ecosystem of managed collections that is scalable and adaptable to changing resource requirements. This approach enables platform- or software-asa- service deployment of vCDS and allows the NCCS to offer virtualization-as-a-service: a capacity to respond in an agile way to new customer requests for data services.

Schnase, John L.

Combined Infrared Stereo and Laser Ranging Cloud Measurements from Shuttle Mission STS-85

Multi-angle remote sensing provides a wealth of information for earth and climate monitoring. And, as technology advances so do the options for developing instrumentation versatile enough to meet the demands associated with these types of measurements. In the current work, the multiangle measurement capability of the Infrared Spectral Imaging Radiometer is demonstrated. This instrument flew as part of mission STS-85 of the space shuttle Columbia in 1997 and was the first earth-observing radiometer to incorporate an uncooled microbolometer array detector as its image sensor. Specifically, a method for computing cloud-top height from the multi-spectral stereo measurements acquired during this flight has been developed and the results demonstrate that a vertical precision of 10.6 km was achieved. Further, the accuracy of these measurements is confirmed by comparison with coincident direct laser ranging measurements from the Shuttle Laser Altimeter. Mission STS-85 was the first space flight to combine laser ranging and thermal IR camera systems for cloud remote sensing.

Lancaster, Redgie S.

Solar reflection from a regular array of horizontally finite clouds

The reflected flux from a regular array of 2- and 3-D clouds has been computed to estimate the effect of fractional cloud cover on albedos and the solar flux available to heat the earth's surface. The broken clouds are represented by a regular array of identical cuboids for the 3-D problem and equally spaced, infinitely long, bars for the 2-D problem. A diffusion approximation to the radiative transfer equation is used to compute the fluxes leaving each face of the cloud. Interaction between clouds is simulated by assuming diffuse exitance from the cloud faces and applying angle factors to obtain modified boundary conditions on each cloud face.

Weinman, J. A.

Combined Infrared Stereo and Laser Ranging Cloud Measurements from Shuttle Mission STS-85

Multiangle remote sensing provides a wealth of information for earth and climate monitoring, such as the ability to measure the height of cloud tops through stereoscopic imaging. As technology advances so do the options for developing spacecraft instrumentation versatile enough to meet the demands associated with multiangle measurements. One such instrument is the infrared spectral imaging radiometer, which flew as part of mission STS-85 of the space shuttle in 1997 and was the first earth- observing radiometer to incorporate an uncooled microbolometer array detector as its image sensor. Specifically, a method for computing cloud-top height with a precision of +/- 620 m from the multispectral stereo measurements acquired during this flight has been developed, and the results are compared with coincident direct laser ranging measurements from the shuttle laser altimeter. Mission STS-85 was the first space flight to combine laser ranging and thermal IR camera systems for cloud remote sensing.

Lancaster, R. S.

Controlling Infrastructure Costs: Right-Sizing the Mission Control Facility

Johnson Space Center's Mission Control Center is a space vehicle, space program agnostic facility. The current operational design is essentially identical to the original facility architecture that was developed and deployed in the mid-90's. In an effort to streamline the support costs of the mission critical facility, the Mission Operations Division (MOD) of Johnson Space Center (JSC) has sponsored an exploratory project to evaluate and inject current state-of-the-practice Information Technology (IT) tools, processes and technology into legacy operations. The general push in the IT industry has been trending towards a data-centric computer infrastructure for the past several years. Organizations facing challenges with facility operations costs are turning to creative solutions combining hardware consolidation, virtualization and remote access to meet and exceed performance, security, and availability requirements. The Operations Technology Facility (OTF) organization at the Johnson Space Center has been chartered to build and evaluate a parallel Mission Control infrastructure, replacing the existing, thick-client distributed computing model and network architecture with a data center model utilizing virtualization to provide the MCC Infrastructure as a Service. The OTF will design a replacement architecture for the Mission Control Facility, leveraging hardware consolidation through the use of blade servers, increasing utilization rates for compute platforms through virtualization while expanding connectivity options through the deployment of secure remote access. The architecture demonstrates the maturity of the technologies generally available in industry today and the ability to successfully abstract the tightly coupled relationship between thick-client software and legacy hardware into a hardware agnostic "Infrastructure as a Service" capability that can scale to meet future requirements of new space programs and spacecraft. This paper discusses the benefits and difficulties that a migration to cloud-based computing philosophies has uncovered when compared to the legacy Mission Control Center architecture. The team consists of system and software engineers with extensive experience with the MCC infrastructure and software currently used to support the International Space Station (ISS) and Space Shuttle program (SSP).

Martin, Keith

Radiative Heating Rate Profiles over the Southeast Atlantic Ocean during the 2016 and 2017 Biomass Burning Seasons

Marine boundary layer clouds, including the transition from stratocumulus to cumulus, are poorly represented in numerical weather prediction and general circulation models. Further uncertainties in the cloud structure arise in the presence of biomass burning carbonaceous aerosol, as is the case over the southeast Atlantic Ocean where biomass burning aerosol is transported from the African continent. As the aerosol plume progresses across the southeast Atlantic Ocean, radiative heating within the aerosol layer has the potential to alter the thermodynamic environment and therefore the cloud structure; however, limited work has been done to quantify this along the trajectory of the aerosol plume in the region. The deployment of the First Atmospheric Radiation Measurement Mobile Facility in support of the Layered Atlantic Smoke Interactions with Clouds field campaign provided a unique opportunity to collect observations of cloud and aerosol properties during two consecutive biomass burning seasons during July through October of 2016 and 2017 over Ascension Island (7.96 °S, 14.35 °W). Using observed profiles of temperature, humidity, and clouds from the field campaign, alongside aerosol optical properties from MERRA-2 as input for the Rapid Radiation Transfer Model, profiles of the radiative heating rate due to aerosols and clouds were computed. Radiative heating is also assessed across the southeast Atlantic Ocean using an ensemble of back trajectories from the Hybrid Single Particle Lagrangian Integrated Trajectory Model. Idealized experiments using the Rapid Radiation Transfer Model with and without aerosols and a range of values for the single scattering albedo demonstrate that shortwave heating within the aerosol layer above Ascension Island can locally range between 2 and 8 K per day depending on the aerosol optical properties, though impacts of the aerosol can be felt elsewhere in the atmospheric column. When considered under clear conditions, the aerosol has a cooling effect at the TOA and based on the observed cloud properties at Ascension Island, the cloud albedo is not large enough to overcome this. Shortwave radiative heating due to biomass burning aerosol is not balanced by additional longwave cooling, and the net radiative impact results in a stabilization of the lower troposphere. However, these results are extremely sensitive to the single scattering albedo assumptions in models.

Allison B. Marquardt Collow

Datum: A Scientific Metadata Catalog

The data catalog market is currently flooded with a myriad of different products, but none serve the scientific community well. There are cloud-native tools like Databricks, Snowflake,to on-premise solutions like Collibra and Datahub. The common failing of all these tools however, is their inability to serve the scientific data community directly. Most catalogs are targeted towards financial, health, or user data - not sensor or scientific domain data. They also prioritize integrations that often don’t exist or are just starting to be used in the scientific realm - all while ignoring common scientific tools and file types. Datum is a catalog which targets the scientific data directly, including the tools and networks in which those tools are used. We work with the producers and consumers of the data where they are, targeting cloud and on-premise with a focus on classified networks. Datum is an Erlang/Elixir application. Technical Features Note: The features listed below are still under development and may change, slightly, upon final delivery of the product. File Formats - Datum has the ability to read additional metadata and provides processing pipelines for the following file formats: Plain Text, PDF, LaTeX, HTML, Open Document Format (.odt), XML, CSV/TSV (and other standard delimiters), OpenDocument Database and Spreadsheets, Geo-Referenced TIFF, Common Data Format, HDF/HDF5, LabView TDMS, Excel, DeltaTables, Parquet, Apache Iceberg, Apache Hudi and many others. Metadata Collection - Scanners for the local and networked file systems and cloud storage providers. Network integration with common databases such as MSSQL and MySQL. User Plugin System - Users are able to provide either file processing, metadata extraction, or sampling plugins in the programming language of their choice. Authentication/Authorization -: OIDC integration, SCIM provisioning and EntraID integration out of the box. Full user and group management system with a “least privilege” operating mode. Governance - Customizable data governance platform; dictate and enforce required metadata, enforce data embargos, and enforce user agreements and NDAs before data access. Ability to create health checks on data, rejecting abandoned or poorly curated data and automatically removing it from the search index. Ability for users to submit corrections. Search - Semantic search is a first class citizen. No licenses to expensive, external software required. Integrated use of vectors and vector-based search allows for AI agent integration at all levels of operation. Metadata Model - Display and control data’s lineage and connections to other data and data directories. Data is modeled after a filesystem - an organization instantly recognizable and navigable by most any user. CLI and SDK - Ships with a Command Line Interface (CLI) tool and with a fully-featured Python SDK. This allows for rapid and programmatic use of Datum by every level of user. Minimal Infrastructure - Datum ships as a single executable file and can be run on any operating system and most CPU architectures. Datum has no reliance on external databases, search indexing tools, or other outside services - and it runs equally well on edge computing devices, cloud services, or in a clustered HPC environment.

darrington, john

Opportunities for Accelerating Research in the Cloud

As the data holdings of the Earth Observation System Data and Information System expand over the next several years, the typical data analysis process of downloading data to local compute resources will become increasingly inefficient. However, cloud computing promises to mitigate that by allowing the user to process close to the data. These improvements will be obtained via a variety of mechanisms: 1 - improving the ability of data transformation services to reduce the data prior to analysis; 2 - providing cloud-native analysis capabilities for common analysis functions; and 3 - providing the ability to work directly with data in Web Object Storage.

data system

IRIS-MEMFLOW: Data Flow-Enabled Portable Memory Orchestration in IRIS Runtime for Diverse Heterogeneity

Task-based programming models and execution paradigms provide a means to decompose a computation by expressing it as a graph in which each node represents a specific computation operating on memory objects and the edges define the dependencies in the execution flow. In this execution model, independent nodes in the graph can be executed concurrently in different computing devices, making it suitable for heterogeneous systems in which computing devices with different architectures coexist. However, careful memory orchestration across heterogeneous devices is needed because copies of the same memory object may reside in multiple devices during execution. Manually ensuring such an orchestration is quite challenging. Not only must an application developer guard against race conditions, but they must also optimize data movement between the host and devices because unnecessary data movement significantly impacts performance. To mitigate these challenges, we enhance the IRIS heterogeneous runtime and introduce IRIS-MEMFLOW–a data flow–enabled portable memory abstraction for seamlessly orchestrating memory in diverse heterogeneous computing environments. By using data-flow analysis, IRIS-MEMFLOW guards against race conditions while multiple heterogeneous devices access memory objects. IRIS-MEMFLOW also optimizes data movement between the host and devices without manual intervention. As a result, IRIS provides improved programming productivity, performance, and portability for multidevice heterogeneous executions in high-performance computing and cloud systems that run diverse architectures from different vendors. The efficacy of IRIS-MEMFLOW is evaluated through experiments that show its capability in terms of programming productivity, multidevice heterogeneity, portability, and low overhead versus the state of the art.

Monil, M. A. H. [ORNL] (ORCID:0000000334194037)

Adaptive Computing (AC) [SWR-24-106]

The Adaptive Computing (AC) software stack supports goal-based computing, for which a simulation workload is created on the fly adapting to the results of calculations. Application-specific code defines an objective, which may be to solve an optimization problem or to train a surrogate model with minimal uncertainty. Then, the AC driver decides where in the design parameter space to run simulations to best achieve that objective. This process is iterative and online; as new data is returned from simulations, the AC driver chooses new simulations to run. The AC driver can strategically run simulations on distributed hardware resources (including high performance computing machines, cloud resources, and edge devices) to maximize throughput and obey resource constraints.

Griffin, Kevin [National Renewable Energy Laborato

Adaptive Computing (AC) (Open Source) [SWR-24-106]

The Adaptive Computing (AC) software stack supports goal-based computing, for which a simulation workload is created on the fly, adapting to the results of calculations. Application-specific code defines an objective, which may be to solve an optimization problem or to train a surrogate model with minimal uncertainty. Then, the AC driver decides where in the design parameter space to run simulations to best achieve that objective. This process is iterative and online; as new data is returned from simulations, the AC driver chooses new simulations to run. The AC driver can strategically run simulations on distributed hardware resources (including high performance computing machines, cloud resources, and edge devices) to maximize throughput and obey resource constraints.

Griffin, Kevin [National Laboratory of the Rockies

Large-scale turbulence in the Jovian atmosphere

Voyager 1 and 2 image pairs taken one rotation period (10 hr) apart are analyzed in order to compute average cloud velocities in the Jovian atmosphere, as well as to study the global energetics of the processes, in particular the sign and the magnitude of the energy transfer from the fluctuating to the mean flow. Particular attention is paid to the Great Red Spot phenomenon; it is suggested to have originated as a small vortex extracting energy from the surrounding flow. Since the eddy, presently in its near-equilibrium state, has reached a considerable size, while the mean shear lies close to that of a neutrally stable profile, it can be concluded that the presence of one large eddy precludes the growth of any others in the depleted mean shear.

Mitchell, J. L.

Turbulent dispersion of the icing cloud from spray nozzles used in icing tunnels

To correctly simulate flight in natural icing conditions, the turbulence in an icing simulator must be as low as possible. But some turbulence is required to mix the droplets from the spray nozzles and achieve an icing cloud of uniform liquid water content. The goal for any spray system is to obtain the widest possible spray cloud with the lowest possible turbulence in the test section of a icing tunnel. This investigation reports the measurement of turbulence and the three-dimensional spread of the cloud from a single spray nozzle. The task was to determine how the air turbulence and cloud width are affected by spray bars of quite different drag coefficients, by changes in the turbulence upstream of the spray, the droplet size, and the atomizing air. An ice accretion grid, located 6.3 m downstream of the single spray nozzle, was used to measure cloud spread. Both the spray bar and the grid were located in the constant velocity test section. Three spray bar shapes were tested: the short blunt spray bar used in the NASA Lewis Icing Research Tunnel, a thin 14.6 cm chord airfoil, and a 53 cm chord NACA 0012 airfoil. At the low airspeed (56 km/hr) the ice accretion pattern was axisymmetric and was not affected by the shape of the spray bar. At the high airspeed (169 km/hr) the spread was 30 percent smaller than at the low airspeed. For the widest cloud the spray bars should be located as far upstream in the low velocity plenum of the icing tunnel. Good comparison is obtained between the cloud spread data and predicitons from a two-dimensional cloud mixing computer code using the two equation turbulence (k epsilon g) model.

Marek, C. J.

Description of SAFIRE for ISES

The SAFIRE (Spectroscopy of the Atmosphere using Far Infrared Emission) is a limb emission experiment using a far-IR Fourier transform spectrometer (FTS) and a mid-IR broadband multispectral radiometer covering the range 80 to 1600/cm. The purpose of this experiment is to obtain vertical distributions of temperature and key constituents of O(y), HO(y), NO(y), ClO(y), and BrO(y) families in the stratosphere, mesosphere, and thermosphere. The spectral channels and gases within each channel are summarized. The instrument includes a 48 element (6 x 8) Ge:GA detector array operating at 4 K in the far-IR and a 105 element (7 x 15) HgCdTe array operating at 80 K in the mid-IR. The SAFIRE uses four different scan modes for vertical coverage and resolution to address various scientific requirements. The SAFIRE data reduction will start with the retrieval of temperature profile as a function of pressure using two CO2 channel data. Constituent distributions then are obtained from other channel data using the retrieved temperature profile. The SAFIRE measurements are limited to the region above the tropopause because of radiance saturation by H2O and clouds. The computational capability necessary to process at the instrument data rate is estimated to be 19 MFLOPS for FTS data and 0.02 MFLOPS for radiometer data. It seems, therefore, that the real-time applications of SAFIRE data using an onboard processing device is not feasible. Although a temperature anomaly may be detected from the two CO2 radiometer channels using an onboard processor for the stratosphere, it is not possible to distinguish between CO2 outflux and temperature anomaly. Temperature anomaly does not, therefore, offer tropospheric information useful for real-time application.

Park, Jae H.

Atmospheric Aerosol Chemical Composition Measurements for the Subsonic Aircraft: Contrail and Cloud Effects Special Study (SUCCESS)

We received funding to provide measurements of the chemical composition of aerosols aboard the NASA Ames DC-8 research aircraft during the SUCCESS mission. These measurements were successfully completed and the final data resides in the Cloud I computer archive at NASA Ames Research Center. The interpretation of the data obtained on this mission over the central United States has been published in special issues of Geophysical Research Letters. The papers with the University of New Hampshire as first author constitute this report and summarize the salient features of our data. The paper by Talbot et al. discusses the impact of vertical transport on free tropospheric chemistry over the the central USA in springtime. This transport was a dominant feature of the aerosol chemistry during SUCCESS. The paper by Dibb et al. discusses aerosol chemistry specifically as it related to free tropospheric sulfate related to jet exhaust and surface sources. Somewhat surprisingly, we found that surface sources appeared to dominant the distribution of aerosol sulfate in the free troposphere. In addition to these first authored papers, researchers from the University of New Hampshire were co-authors on numerous other companion papers in the special issues.

Talbot, Robert W.