SEARCH · Search NASA

Results for “cloud computing, data cloud”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

All sources NASA NTRS DOE OSTI

NASA NTRS1986

Observational study of ion-electron equilibration and of cloud evaporation in supernova remnants under the HEAO-2 guest investigator program

Observations of three selected supernovae remnants (Cygnus Loop, IC 443, and Puppis A) were made in the forbidden coronal iron lines (Fe X) lambda 6374 and (Fe XIV) lambda 5303. The resulting data was compared quantitatively with Einstein images of the same objects, and an attempt was made to determine (a) the process by which ion and electron energies are equilibrated behind the shock front in the ISM and (b) whether cloud evaporation occurs within the hot remnant interiors. Spatially-resolved X ray emission were modeled for Sedov-Taylor blast wave models of supernovae remnants (SNR) under conditions of non-equlibrium ionization. The computations are intended to provide results that can be directly compared with Einstein high resolution image (HRI) and imaging proportional counter (IPS) data. The computer program for predicting the spatial distribution of HRI and IPS counting rates was completed, and final testing of it had begun.

Teske, R. G.↗

NASA NTRS1996

Cloud Properties Derived from Surface-Based Near-Infrared Spectral Transmission

Surface based near-infrared cloud spectral transmission measurements from a recent precipitation/cloud physics field study are used to determine cloud physical properties and relate them to other remote sensing and in situ measurements. Asymptotic formulae provide an effective means of closely approximating the qualitative and quantitative behavior of transmission computed by more laborious detailed methods. Relationships derived from asymptotic formulae are applied to measured transmission spectra to test objectively the internal consistency of data sets acquired during the field program and they confirmed the quality of the measurements. These relationships appear to be very useful in themselves, not merely as a quality control measure, but also a potentially valuable remote-sensing technique in its own right. Additional benefits from this analysis have been the separation of condensed water (cloud) transmission and water vapor transmission and the development of a method to derive cloud liquid water content.

Pilewskie, Peter↗

DOE OSTI2016

Simple rANDom wALk simulation

SANDAL is a particle-mesh simulation mini-app. The simple simulated physics propagates a set of particles in a constant, 2D wind field with Gaussian turbulence. SANDAL demonstrates the feasibility of formulating a computational physics problem using an alternative, modern design. Specifically, it is implemented using relational tables and queries, rather than array-based data model. It also is implemented with functional language design and cloud deployment, Scala and Apache Spark, rather than Fortran and MPI+X.

Lo, Li-Ta↗

NASA NTRS1989

Cirrus optical depth retrieval from satellite-measured bidirectional reflectance

In the framework of investigating the relationship between the visible optical depth and microphysics of cirrus clouds, the doubling scheme for radiative transfer in cirrus cloudy atmospheres, as developed by Takano and Liou (1988), has been used to compute the bidirectional reflectances at the top of the atmosphere. Reflectance data taken at about the same time from GOES and AVHRR over Waussau, as well as particle distributions observed during the FIRE IFO carried out in Wisconsin (1986) were the basis of the experiment. For the cirrus microphysical model, hexagonal ice crystals and area-equivalent ice spheres are considered. The single scattering phase functions for randomly oriented hexagonal columns and area-equivalent ice spheres are computed from geometric optics and Mie theory, respectively.

Takano, Y.↗

NASA NTRS2018

GC11H _ 0998: A spatial pattern analysis of forest loss in the Madre de Dios region, Peru

Previous studies have quantified the extension of gold mining activities and associated it with forest loss in the Madre de Dios region of Peru. This study uses Spectral Mixture Analysis (SMA) in a cloud-computing platform to map forest loss within and outside key land tenure areas in this region, Landsat 7 Enhanced Thematic Mapper plus (ETM+) and Landsat 8 Operational land Imager (OLI) Surface Reflectance data were utilized spanning 2013 and 2017 and spectral unmixing was performed to identify patterns of forest loss for each year. Planet Scope and RapidEye imagery were used to conduct an accuracy assessment and to identify potential drivers.

Puzzi Nicolau, Andrea↗

NASA NTRSDate not supplied

On the use of DSCOVR EPIC to monitor the visible calibration stability of polar orbiting imagers to improve the next edition of the CERES climate data record.

The NASA CERES project has provided the climate quality observed TOA and computed surface fluxes to the scientific community. CERES instruments are onboard the Terra, Aqua, NPP, and NOAA-20 spacecraft. CERES uses MODIS and VIIRS imagers to retrieve cloud properties needed to convert CERES footprint radiance observations into fluxes using empirically derived angular directional models obtained during early CERES record. CERES utilizes geostationary sensors to infer the regional diurnal fluxes in between Terra and Aqua CERES observations. The imagers are also used to radiometrically scale the geostationary sensors (GEO) radiances to the imager calibration reference to ensure that the GEO derived cloud properties and broadband TOA fluxes are consistent in both space and time. Both the imager and GEO retrieved cloud properties are used to compute the surface fluxes. The Aqua-MODIS, SNPP-VIIRS, and NOAA-20 VIIRS afternoon imagers will also need to be radiometrically scaled to the same common calibration reference. Although all three imagers employ onboard solar diffusers, the calibration is not consistent over time due to instrument anomalies and ageing of the onboard calibrators. The CERES imager and GEO calibration group (IGCG) has been tasked to remove the imager channel calibration drifts for the next CERES reprocessing effort. The team will rely primarily on deep convective clouds, desert, and polar ice invariant targets to monitor the imager channel stability. The team uses ray-matched radiance pairs to radiometrically scale the SNPP and NOAA-20 VIIRS sensors to Aqua-MODIS. The radiometric scaling is further validated using geostationary imagers as transfer radiometers. The DSCOVR satellite was launched on February 25, 2015 and orbits around the L1 Lagrange point directly between the Earth and the sun. The EPIC instrument onboard DSCOVR employs a CCD array to image the Earth approximately every 2-hours. The EPIC sensor contains no onboard calibration systems. However, multiple inter-calibration studies have shown that the EPIC imager is very stable in time. This is likely due to the DSCOVR satellite being located about a 1.5M km from the Earth, where very little Earth reflected solar radiation degrades the optics. The excellent radiometric stability of EPIC allows the CERES IGCG to utilize the EPIC observations as a stable reference for monitoring the calibration stability of the three afternoon imagers, as well as to validate the radiometric scaling factors between them. Examples of the imager relative calibration using EPIC before and after radiometric scaling will be shown along with the results from the use of invariant targets to remove imager calibration drifts.

DSCOVR-EPIC↗

DOE OSTI2016

Simple rANDom wALk simulation

Lo, Li-Ta↗

NASA NTRS1994

Role of small ice crystals in radiative properties of cirrus: A case study, FIRE II, November 22, 1991

Aircraft observations of cirrus cloud were made near Coffeyville, Kansas, during November 1991 as part of the First ISCCP Regional Experiment II (FIRE II) project. Cloud ice particle spectra measurements were made using both a particle measuring system (PMS) 2DC probe and an ice particle replicator. Particles larger than 200 micrometers were column rosettes. The replicator shows the presence of large numbers of ice crystals smaller than 66 micrometers (two PMS size bins) that are not recorded by the PMS 2DC probe. Calculations based on the replicator data of the geometrical blocked area and absorption cross section of the cloud per unit volume show that small particles can contribute significantly to and sometimes dominate both the solar extinction and the infrared emission. Intercomparison is made of the ice particle size, area, and mass distributions determined by these different instruments. Power law relationships for area occluded by a crystal as a function of crystal maximum dimension were computed from the PMS 2DC data. The wavelength-dependent infrared absorption cross section per volume was computed using a simple model based on anomalous diffraction and area and mass dimensional relationships for the ice crystals.

Arnott, W. Patrick↗

NASA NTRS1996

The 27-28 October 1986 FIRE IFO Cirrus Case Study: Cirrus Parameter Relationships Derived from Satellite and Lidar Data

Cirrus cloud radiative and physical characteristics are determined using a combination of ground based, aircraft, and satellite measurements taken as part of the First ISCCP Region Experiment (FIRE) cirrus intensive field observations (IFO) during October and November 1986. Lidar backscatter data are used with rawinsonde data to define cloud base, center and top heights and the corresponding temperatures. Coincident GOES-4 4-km visible (0.65 micrometer) and 8-km infrared window (11.5 micrometer) radiances are analyzed to determine cloud emittances and reflectances. Infrared optical depth is computed from the emittance results. Visible optical depth is derived from reflectance using a theoretical ice crystal scattering model and an empirical bidirectional reflectance model. No clouds with visible optical depths greater than 5 or infrared optical depths less than 0.1 were used in the analysis. Average cloud thickness ranged from 0.5 km to 8.0 km for the 71 scenes. Mean vertical beam emittances derived from cloud-center temperatures were 062 for all scenes compared to 0.33 for the case study (27-28 October) reflecting the thinner clouds observed for the latter scenes. Relationships between cloud emittance , extinction coefficients, and temperature for the case study are very similar to those derived from earlier surface-based studies. The thicker clouds seen during the other IFO days yield different results. Emittances derived using cloud-top temperature wer ratioed to those determined from cloud-center temperature. A nearly linear relationship between these ratios and cloud-center temperature holds promise for determining actual cloud-top temperature and cloud thickness from visible and infrared radiance pairs. The mean ratio of the visible scattering optical depth to the infrared absorption optical depth was 2.13 for these data. This scattering efficiency ratio shows a significant dependence on cloud temperature. Values of mean scattering efficiency as high as 2.6 suggest the presence of small ice particles at temperatures below 230 K. the parameterization of visible reflectance in terms of cloud optical depth and clear sky reflectance shows promise as a simplified method for interpreting visible satellite data reflected from cirrus clouds. Large uncertainties in the optical parameters due to cloud reflectance anisotropy and shading were found by analyzing data for various solar zenith angles and for simultaneous advanced very high resolution radiometer (AVHRR) data. Inhomogeneities in the cloud fields result in uneven cloud shading that apparently causes the occurrence of anomalously dark, cloud pixels in the GOES data. These shading effects complicate the interpretation of the satellite data. The results highlight the need for additional study or cirrus cloud scattering processes and remote sensing techniques.

Minnis, Patrick↗

DOE OSTI2016

THE THEORETICAL ASTROPHYSICAL OBSERVATORY: CLOUD-BASED MOCK GALAXY CATALOGS

We introduce the Theoretical Astrophysical Observatory (TAO), an online virtual laboratory that houses mock observations of galaxy survey data. Such mocks have become an integral part of the modern analysis pipeline. However, building them requires expert knowledge of galaxy modeling and simulation techniques, significant investment in software development, and access to high performance computing. These requirements make it difficult for a small research team or individual to quickly build a mock catalog suited to their needs. To address this TAO offers access to multiple cosmological simulations and semi-analytic galaxy formation models from an intuitive and clean web interface. Results can be funnelled through science modules and sent to a dedicated supercomputer for further processing and manipulation. These modules include the ability to (1) construct custom observer light cones from the simulation data cubes; (2) generate the stellar emission from star formation histories, apply dust extinction, and compute absolute and/or apparent magnitudes; and (3) produce mock images of the sky. All of TAO’s features can be accessed without any programming requirements. The modular nature of TAO opens it up for further expansion in the future.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2019

Big Data, Cloud, and Earth Science

Given the reality of a Big Data future, we need to reevaluate our ability to quickly process immense amounts of data while maintaining our responsibility of stewarding our archives. At National Aeronautics and Space Administration (NASA), our Science Missions Directorate and Earth Science Data Systems have been exploring the commercial cloud as a potential mechanism for data ingest, archive, and distribution since 2015. This talk will discuss our timeline and strategies being employed and will discuss the process of introducing commercial cloud entities into a largely on-premise hardware-reliant approach to ingest, archive, and distribution. We will address topics such as vendor lock-in, varying compute and costing strategies, and end-user adoption. Please join us for an open and authentic conversation about the opportunities we are embracing and the risks we are undertaking as a part of this evolution.

Informatics↗

NASA NTRS2017

Harmonized Landsat/Sentinel-2 Reflectance Products for Land Monitoring (Invited)

Many land applications require more frequent observations than can be obtained from a single 'Landsat class' sensor. Agricultural monitoring, inland water quality assessment, stand-scale phenology, and numerous other applications all require near-daily imagery at better than 1ha resolution. Thus the land science community has begun expressing a desire for a '30-meter MODIS' global monitoring capability. One cost-effective way to achieve this goal is via merging data from multiple, international observatories into a single virtual constellation. The Harmonized Landsat/Sentinel-2 (HLS) project has been working to generate a seamless surface reflectance product by combining observations from USGS/NASA Landsat-8 and ESA Sentinel-2. Harmonization in this context requires a series of radiometric and geometric transforms to create a single surface reflectance time series agnostic to sensor origin. Radiometric corrections include a common atmospheric correction using the Landsat-8 LaSRC/6S approach, a simple BRDF adjustment to constant solar and nadir view angle, and spectral bandpass adjustments to fit the Landsat-8 OLI reference. Data are then resampled to a consistent 30m UTM grid, using the Sentinel-2 global tile system. Cloud and shadow masking are also implemented. Quality assurance (QA) involves comparison of the output 30m HLS products with near-simultaneous MODIS nadir-adjusted observations. Prototoype HLS products have been processed for approximately 7% of the global land area using the NASA Earth Exchange (NEX) compute environment at NASA Ames, and can be downloaded from the HLS web site (https://hls.gsfc.nasa.gov). A wall-to-wall North America data set is being prepared for 2018. This talk will review the objectives and status of the HLS project, and illustrate applications of high-density optical time series data for agriculture and ecology. We also discuss lessons learned from HLS in the general context of implementing virtual constellations.

Reflectance↗

DOE OSTI2026

Machine learning reveals strong grid-scale dependence in the satellite N d –LWP relationship

The relationship between cloud droplet number concentration ( N d ) and liquid water path (LWP) is highly uncertain yet crucial for determining the impact of aerosol-cloud interactions (ACI) on Earth's radiation budget. The N d -LWP relationship is examined using a machine learning (ML) random forest model applied to five years of satellite data at grid resolutions ranging from 10° to 0.05° in 12 distinct regions. In the subtropics, the shape of the N d -LWP relationship switches from an inverted-V at 1° grid-resolution to an “M” shape at 0.1° resolution with decreased $\frac{\textrm{dln⁡LWP}}{\textrm{dln⁡}N_d}$ sensitivity. Tropical and midlatitude regions generally show a more positive sensitivity. Cloud sampling and filtering also influence this slope, wherein the exclusion of thin clouds, as commonly performed to reduce retrieval uncertainty, leads to strongly negative sensitivity across all regions. Precipitation is primarily responsible for driving the strength of the sensitivity, with strong positive slopes in raining clouds and negative and/or neutral responses found in non-raining clouds. A new method to compute radiative forcing from the ML model shows a robust Twomey radiative forcing across all regions and grid resolutions. However, LWP and cloud fraction adjustments to the radiative forcing, which are ∼50 % or smaller than the Twomey effect, decrease to negligible values with higher spatial resolution data. As Earth system models move toward higher spatial resolutions in the future, evaluating the LWP and CF adjustment contributions to the radiative forcing budget at these finer resolutions will be essential for evaluation and model development.

Aerosol-Cloud Interactions↗

DOE OSTI2024

Haar-Like Wavelets on Hierarchical Trees

Here, discrete wavelet methods, originally formulated in the setting of regularly sampled signals, can be adapted to data defined on a point cloud if some multiresolution structure is imposed on the cloud. A wide variety of hierarchical clustering algorithms can be used for this purpose, and the multiresolution structure obtained can be encoded by a hierarchical tree of subsets of the cloud. Prior work introduced the use of Haar-like bases defined with respect to such trees for approximation and learning tasks on unstructured data. This paper builds on that work in two directions. First, we present an algorithm for constructing Haar-like bases on general discrete hierarchical trees. Second, with an eye towards data compression, we present thresholding techniques for data defined on a point cloud with error controlled in the $L$ $\infty$ norm and in a Hölder-type norm. In a concluding trio of numerical examples, we apply our methods to compress a point cloud dataset, study the tightness of the $L$ $\infty$ error bound, and use thresholding to identify MNIST classifiers with good generalizability.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

VIBES: a workflow for annotating and visualizing viral sequences integrated into bacterial genomes

Abstract Bacteriophages are viruses that infect bacteria. Many bacteriophages integrate their genomes into the bacterial chromosome and become prophages. Prophages may substantially burden or benefit host bacteria fitness, acting in some cases as parasites and in others as mutualists. Some prophages have been demonstrated to increase host virulence. The increasing ease of bacterial genome sequencing provides an opportunity to deeply explore prophage prevalence and insertion sites. Here we present VIBES (Viral Integrations in Bacterial genomES), a workflow intended to automate prophage annotation in complete bacterial genome sequences. VIBES provides additional context to prophage annotations by annotating bacterial genes and viral proteins in user-provided bacterial and viral genomes. The VIBES pipeline is implemented as a Nextflow-driven workflow, providing a simple, unified interface for execution on local, cluster and cloud computing environments. For each step of the pipeline, a container including all necessary software dependencies is provided. VIBES produces results in simple tab-separated format and generates intuitive and interactive visualizations for data exploration. Despite VIBES’s primary emphasis on prophage annotation, its generic alignment-based design allows it to be deployed as a general-purpose sequence similarity search manager. We demonstrate the utility of the VIBES prophage annotation workflow by searching for 178 Pf phage genomes across 1072 Pseudomonas spp. genomes.

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRS1975

Snowcover mapping by machine processing of Skylab and LANDSAT MSS data

Skylab and LANDSAT MSS data were analyzed using computer-aided analysis techniques (CAAT). Results indicated that the middle infrared wavelength bands of the Skylab S-192 scanner would allow effective discrimination between snowcover and water-droplet clouds, whereas the limited spectral response of the LANDSAT-1 or 2 scanners do not allow such spectral discrimination. Five spectral classes of snowcover were defined and mapped. These classes were found to be related to differences in the proportion of snow and forest cover in the individual resolution elements.

Bartolucci, L. A.↗

NASA NTRS1987

The effect of subpixel clouds on remote sensing

A method for estimating the cloud effect on remote sensing is described, and it is applied to cloudiness in several climatological conditions. The algorithm is based on the Haurwitz (1948) measurements of the cloud layer transmission of solar radiation for an overcast sky and on an empirical interpolation of data for broken cloudiness by Pochop et al. (1968). Radiances for a sunny area observed directly from space and through a cloud, and for a shady area observed from space and through a cloud are computed. Methods for detecting the cloud effect from satellite images are discussed. The relation between cloud reflectance and cloud size is studied. It is observed that the subpixel clouds affect the detected radiance and vegetation index, and the effect depends on the cloud types and the dependence of the cloud transmissivity on cloud fraction. Procedures for decreasing or eliminating cloud effect are examined.

Kaufman, Yoram J.↗

NASA NTRS1995

Clouds and the Earth's Radiant Energy System (CERES) algorithm theoretical basis document: Determination of surface and atmosphere fluxes and temporally and spatially averaged products (subsystems 5-12) - volume 4

The theoretical bases for the Release 1 algorithms that will be used to process satellite data for investigation of the Clouds and the Earth's Radiant Energy System (CERES) are described. The architecture for software implementation of the methodologies is outlined. Volume 4 details the advanced CERES techniques for computing surface and atmospheric radiative fluxes (using the coincident CERES cloud property and top-of-the-atmosphere (TOA) flux products) and for averaging the cloud properties and TOA, atmospheric, and surface radiative fluxes over various temporal and spatial scales. CERES attempts to match the observed TOA fluxes with radiative transfer calculations that use as input the CERES cloud products and NOAA National Meteorological Center analyses of temperature and humidity. Slight adjustments in the cloud products are made to obtain agreement of the calculated and observed TOA fluxes. The computed products include shortwave and longwave fluxes from the surface to the TOA. The CERES instantaneous products are averaged on a 1.25-deg latitude-longitude grid, then interpolated to produce global, synoptic maps to TOA fluxes and cloud properties by using 3-hourly, normalized radiances from geostationary meteorological satellites. Surface and atmospheric fluxes are computed by using these interpolated quantities. Clear-sky and total fluxes and cloud properties are then averaged over various scales.

Wielicki, Bruce A.↗