Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud computing, data cloud”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Analysis of aircraft microwave measurements of the ocean surface

A data system was developed to process, from calibrated brightness temperature to computation of estimated parameters, the microwave measurements obtained by the NASA CV-990 aircraft during the 1972 Meteorological Expedition. A primary objective of the study was the implementation of an integrated software system at the computing facility of NASA/GSFC, and its application to the 1972 data. A single test case involving measurements away from and over a heavy rain cell was chosen to examine the effect of clouds upon the ability to infer ocean surface parameters. The results indicate substantial agreement with those of the theoretical study; namely, that the values obtained for the surface properties are consistent with available ground-truth information, and are reproducible except within the heaviest portions of the rain cell, at which nonlinear (or saturation) effects become apparent. Finally, it is seen that uncorrected instrumental effects introduce systematic errors which may limit the accuracy of the method.

Willand, J. H.↗

Limb-darkening scans of Jupiter

Representative center-limb photometric measurements of several areas on Jupiter are presented in the form of limb-darkening scans taken through narrow-band interference filters which isolate continuum regions near the 3-0 and 4-0 hydrogen quadrupole bands (8200 and 6300 A, respectively). Results of scans measured through filters which isolate two regions dominated by methane absorption (6190 and 7250 A) are also discussed. Limb-darkening curves at all four wavelengths are computed for semiinfinite homogeneous isotropically scattering atmospheres with different values of the single-scattering albedo of the cloud particles. It is found that albedo values between 0.985 and 0.989 match the data over most of the northern component of the South Equatorial Belt. The single-scattering albedo values are used to show that the equatorial regions of Jupiter which emit at 5 microns may be relatively clear while the tropical regions may be relatively cloudy.

Pilcher, C. B.↗

A new algorithm for microwave delay estimation from water vapor radiometer data

A new algorithm has been developed for the estimation of tropospheric microwave path delays from water vapor radiometer (WVR) data, which does not require site and weather dependent empirical parameters to produce high accuracy. Instead of taking the conventional linear approach, the new algorithm first uses the observables with an emission model to determine an approximate form of the vertical water vapor distribution which is then explicitly integrated to estimate wet path delays, in a second step. The intrinsic accuracy of this algorithm has been examined for two channel WVR data using path delays and stimulated observables computed from archived radiosonde data. It is found that annual RMS errors for a wide range of sites are in the range from 1.3 mm to 2.3 mm, in the absence of clouds. This is comparable to the best overall accuracy obtainable from conventional linear algorithms, which must be tailored to site and weather conditions using large radiosonde data bases. The new algorithm's accuracy and flexibility are indications that it may be a good candidate for almost all WVR data interpretation.

Robinson, S. E.↗

Global shortwave energy budget at the earth's surface from ERBE observations

A method is proposed to compute the net solar (shortwave) irradiance at the earth's surface from Earth Radiation Budget Experiment (ERBE) data in the S4 format. The S4 data are monthly averaged broadband planetary albedo collected at selected times during the day. Net surface shortwave irradiance is obtained from the shortwave irradiance incident at the top of the atmosphere (known) by subtracting both the shortwave energy flux reflected by the earth-atmosphere system (measured) and the energy flux absorbed by the atmosphere (modeled). Precalculated atmospheric- and surface-dependent functions that characterize scattering and absorption in the atmosphere are used, which makes the method easily applicable and computationally efficient. Four surface types are distinguished, namely, ocean, vegetation, desert, and snow/ice. Over the tropical Pacific Ocean, the estimates based on ERBE data compare well with those obtained from International Satellite Cloud Climatology Project (ISCCP) B3 data. For the 9 months analyzed the linear correlation coefficient and the standard difference between the two datasets are 0.95 and 14 W/sq m (about 6% of the average shortwave irradiance), respectively, and the bias is 15 W/sq m (higher ERBE values). The bias, a strong function of ISCCP satellite viewing zenith angle, is mostly in the ISCCP-based estimates. Over snow/ice, vegetation, and desert no comparison is made with other satellite-based estimates, but theoretical calculations using the discrete ordinate method suggest that over highly reflective surfaces (snow/ice, desert) the model, which accounts crudely for multiple reflection between the surface and clouds, may substantially overestimate the absorbed solar energy flux at the surface, especially when clouds are optically thick. The monthly surface shortwave irradiance fields produced for 1986 exhibit the main features characteristic of the earth's climate. As found in other studies, our values are generally higher than Esbensen and Kushnir's by as much as 80 W/sq m in the tropical oceans. A cloud parameter, defined as the difference between clear-sky and actual irradiances normalized to top-of-atmosphere clear-sky irradiance, is also examined. This parameter, minimally affected by sun zenith angle, is higher in the midlatitude regions of storm tracks than in the intertropical convergence zone (ITCZ), suggesting that, on average, the higher cloud coverage in midlatitudes is more effective at reducing surface shortwave irradiance than opaque, convective, yet sparser clouds in the ITCZ. Surface albedo estimates are realistic, generally not exceeding 0.06 in the ocean, as high as 0.9 in polar regions, and reaching 0.5 in the Sahara and Arabian deserts.

Breon, Francois-Marie↗

Evolving HPC and Application Design Toward a Coupled Data Assimilation System at NASA Suitable for Emerging Exascale Platforms

The prediction capabilities of global models have continuously evolved from the traditional medium-range global weather prediction application to span scales in support of hourly prediction of convective scale storms to seasonal Earth system prediction. This evolution has increased the demands on the system infrastructure design and workflow to achieve the required performance on modern high-performance computing (HPC) platforms. The planned evolution of the Goddard Earth Observing System (GEOS) modeling and assimilation system will stress the capabilities of conventional HPC overwhelming the available compute cycles at the NASA Center for Climate Simulation (NCCS) at the NASA Goddard Space Flight Center in the coming 5-10 years. This has led to the re-design of key elements of the assimilation and modeling systems to achieve significant gains in performance on anticipated Exacale platforms. The transition of the assimilation system to the Joint Effort for Data assimilation Integration (JEDI) framework has positioned GEOS to exploit new efficient algorithms for data assimilation (DA) in a fully-coupled Earth system context. The suitability of the GEOS model to leverage a domain specific language (DSL) approach and artificial intelligence (AI) is being explored to accelerate computational performance and data exchange efficiency of the coupled Earth system model. The storage and processing of large data volumes produced by these advance systems is being redesigned with a data-centric cloud-based approach. We will highlight the recent efforts in these areas and emphasize the demand for further development and re-design to achieve the science objectives in support of NASA's Earth system modeling and assimilation missions.

Putman, Bill↗

A Global Land Cover Training Dataset From 1984 to 2020

State-of-the-art cloud computing platforms such as Google Earth Engine (GEE) enable regional-to-global land cover and land cover change mapping with machine learning algorithms. However, collection of high-quality training data, which is necessary for accurate land cover mapping, remains costly and labor-intensive. To address this need, we created a global database of nearly 2 million training units spanning the period from 1984 to 2020 for seven primary and nine secondary land cover classes. Our training data collection approach leveraged GEE and machine learning algorithms to ensure data quality and biogeographic representation. We sampled the spectral-temporal feature space from Landsat imagery to efficiently allocate training data across global ecoregions and incorporated publicly available and collaborator-provided datasets to our database. To reflect the underlying regional class distribution and post-disturbance landscapes, we strategically augmented the database. We used a machine learning-based cross-validation procedure to remove potentially mis-labeled training units. Our training database is relevant for a wide array of studies such as land cover change, agriculture, forestry, hydrology, urban development, among many others.

Radost Stanimirova↗

Enabling Interoperability in Earth System Digital Twins (ESDT): Integrating Observations, Models, and AI for Actionable Insights Through NASA'S Intelligent Systems Technology Program

NASA’s Intelligent Systems Technology Program (IST) is driving a paradigm shift in Earth science through the development of Earth System Digital Twins (ESDT). These integrated information systems create a dynamic "digital replica" of the Earth by harmonizing continuous, multi-source observations with high-fidelity models and state-of-the-art artificial intelligence (AI) that enable “What now?”, “What next?”, and “What if?” scenario building. These scenarios are reflected in NASA IST’s series of ESDTs, from the Coastal Zone Digital Twin that integrates complex data on the current state of the Chesapeake Bay to the Terrestrial Environmental Rapid-Replication and Assimilation Hydrometeorological (TerraHydro) AI-based ESDT that forecasts water movement across Earth’s surface, to the Agriculture Land Information System (AgLIS) which can be used to assess optimal planting dates and crop yield estimates. By bridging the gap between vast data archives and actionable insights, these projects enable a system-of-systems approach to understanding complex, interacting Earth processes. This poster will highlight recent innovations and future directions from NASA’s ESDT initiatives: Continuous Data Assimilation & Multi-Source Fusion. A core requirement of the ESDT work is the transition from static models to dynamic "living" replicas. This involves creating frameworks for the continual assimilation of near-real-time data from uncoordinated, heterogeneous sources, including satellite observations and airborne assets, and ground-based Internet of Things (IoT) sensors. These systems link design, operational status, and environmental data, ensuring the digital twin accurately reflects the current state of the physical Earth system. High-Fidelity Hybrid Modeling & Computational Acceleration to enable interactive "what-if" explorations, programs are moving beyond traditional, slow physical solvers by developing fast surrogate machine learning models and Deep Generative Models (DGMs). These hybrid approaches use neural networks to emulate complex physics, such as cloud feedback or ocean dynamics, at a fraction of the original computing cost, often leveraging advanced hardware like Graphics Processing Units (GPUs) to achieve the necessary scale. Federated Ecosystems & Interoperable Frameworks rather than building isolated tools, NASA IST is moving toward federated ESDTs and reusable analytic collaborative frameworks. This theme focuses on interoperability standards and common ontologies that allow specialized digital twins to interact and share data. This system-of-systems architecture supports multi-discipline investigations, such as analyzing how upstream watershed changes impact downstream urban flooding or how wildfire emissions affect regional air quality. By leveraging these advancements, ESDTs empower researchers and decision-makers to conduct real-time analysis and run complex hypothetical scenarios, ultimately improving our understanding of Earth’s evolving systems and informing critical real-world applications.

Earth System↗

Excitation of the low lying vibrational levels of H2O by O(3P) as measured on Spacelab 2

The data from the infrared telescope (IRT), which was flown on space shuttle Challenger Spacelab 2 mission (July 1985), were originally reported by Koch et al. (1987) as originating from near orbital emissions, primarily H2O. In this study, analysis of this data was extended to determine the collisional cross sections for the excitation of the low lying vibrational levels of H2O, present in the orbiter cloud, by atmospheric O(3P). The evaluation of the contribution to the measured signal from solar excitation and ram O excitation of outgassing H2O permits the determination of the H2O column density and the excitation cross section of the (101) level at an O(3P) velocity of approximately 7.75 km/s. Contributions to the radiation in the 1.7-3.0 micron band by transitions from the (100), (001), and multiquantum excited levels are discussed. The findings of the study are (1) the IRT data for the 4.5-9.5 micron and the nighttime data for the 1.7-3.0 micron sensors are consistent with being explained by collision excitation of H2O by O(3P), (2) diurnal variations of 4.5-9.5 micron intensities follow the model predicted O density for a full orbit, (3) daytime increases in the H2O cloud density were not evident, (4) the cross sections for the collisional excitation process are derived and compared to values computated by Johnson (1986) and Redmon et al. (1986), (5) theoretical investigation suggests greater than 60% of the radiation from H2O is a result of multiphoton emission resulting from collisional multiquanta excitation, and (6) the large daytime increase in the 1.7-3.0 micron intensity data suggests that O(+) may likely be instrumental in producing excited H2O(+) through charge exchange.

Meyerott, R. E.↗

Deep Learning System for Efficient Processing of Geostationary Satellite Imagery

Improved capabilities of Earth monitoring satellites are enabling a wide range of studies on the environmental effects of climate change, often leveraging the recent advancements in machine learning. At the same time, the new capabilities, including higher spatial resolution and temporal frequency, are expanding the amount of data generated at exponential rates. Further, a large majority of archived datasets generated by scientific processing is never used. This motivates the development of an efficient machine learning system for end-to-end processing of multi-level satellite datasets, from level 1 top of atmosphere observations to user friendly environmental variables of interest. Using current generation geostationary satellites GOES-16/17 (NOAA/NASA), and Himawari-8/9 (JAXA), we present an interchangeable set of machine models to perform spectral adjustment among sensors, physical model emulation, LEO-GEO emulation, and optical flow in a high performance computing environment. We use these tools on the NASA Earth eXchange (NEX) to generate consistent virtual observations across sensors, perform atmospheric correction and cloud detection, and estimate surface reflectance, surface temperature and atmospheric winds. This approach aims to improve the robustness of remotely sensed data processing by learning from diverse sets of observations while enabling near real-time and on-demand capabilities.

Thomas Vandal↗

Real-Time Very High-Resolution Regional 4D Assimilation in Supporting CRYSTAL-FACE Experiment

To better understand tropical cirrus cloud physical properties and formation processes with a view toward the successful modeling of the Earth's climate, the CRYSTAL-FACE (Cirrus Regional Study of Tropical Anvils and Cirrus Layers - Florida Area Cirrus Experiment) field experiment took place over southern Florida from 1 July to 29 July 2002. During the entire field campaign, a very high-resolution numerical weather prediction (NWP) and assimilation system was performed in support of the mission with supercomputing resources provided by NASA Center for Computational Sciences (NCCS). By using NOAA NCEP Eta forecast for boundary conditions and as a first guess for initial conditions assimilated with all available observations, two nested 15/3 km grids are employed over the CRYSTAL-FACE experiment area. The 15-km grid covers the southeast US domain, and is run two times daily for a 36-hour forecast starting at 0000 UTC and 1200 UTC. The nested 3-km grid covering only southern Florida is used for 9-hour and 18-hour forecasts starting at 1500 and 0600 UTC, respectively. The forecasting system provided more accurate and higher spatial and temporal resolution forecasts of 4-D atmospheric fields over the experiment area than available from standard weather forecast models. These forecasts were essential for flight planning during both the afternoon prior to a flight day and the morning of a flight day. The forecasts were used to help decide takeoff times and the most optimal flight areas for accomplishing the mission objectives. See more detailed products on the web site http://asd-www.larc.nasa.gov/mode/crystal. The model/assimilation output gridded data are archived on the NASA Center for Computational Sciences (NCCS) UniTree system in the HDF format at 30-min intervals for real-time forecasts or 5-min intervals for the post-mission case studies. Particularly, the data set includes the 3-D cloud fields (cloud liquid water, rain water, cloud ice, snow and graupe/hail).

Wang, Donghai↗

Observational study of ion-electron equilibration and of cloud evaporation in supernova remnants under the HEAO-2 guest investigator program

Observations of three selected supernovae remnants (Cygnus Loop, IC 443, and Puppis A) were made in the forbidden coronal iron lines (Fe X) lambda 6374 and (Fe XIV) lambda 5303. The resulting data was compared quantitatively with Einstein images of the same objects, and an attempt was made to determine (a) the process by which ion and electron energies are equilibrated behind the shock front in the ISM and (b) whether cloud evaporation occurs within the hot remnant interiors. Spatially-resolved X ray emission were modeled for Sedov-Taylor blast wave models of supernovae remnants (SNR) under conditions of non-equlibrium ionization. The computations are intended to provide results that can be directly compared with Einstein high resolution image (HRI) and imaging proportional counter (IPS) data. The computer program for predicting the spatial distribution of HRI and IPS counting rates was completed, and final testing of it had begun.

Teske, R. G.↗

Cloud Properties Derived from Surface-Based Near-Infrared Spectral Transmission

Surface based near-infrared cloud spectral transmission measurements from a recent precipitation/cloud physics field study are used to determine cloud physical properties and relate them to other remote sensing and in situ measurements. Asymptotic formulae provide an effective means of closely approximating the qualitative and quantitative behavior of transmission computed by more laborious detailed methods. Relationships derived from asymptotic formulae are applied to measured transmission spectra to test objectively the internal consistency of data sets acquired during the field program and they confirmed the quality of the measurements. These relationships appear to be very useful in themselves, not merely as a quality control measure, but also a potentially valuable remote-sensing technique in its own right. Additional benefits from this analysis have been the separation of condensed water (cloud) transmission and water vapor transmission and the development of a method to derive cloud liquid water content.

Pilewskie, Peter↗

Cirrus optical depth retrieval from satellite-measured bidirectional reflectance

In the framework of investigating the relationship between the visible optical depth and microphysics of cirrus clouds, the doubling scheme for radiative transfer in cirrus cloudy atmospheres, as developed by Takano and Liou (1988), has been used to compute the bidirectional reflectances at the top of the atmosphere. Reflectance data taken at about the same time from GOES and AVHRR over Waussau, as well as particle distributions observed during the FIRE IFO carried out in Wisconsin (1986) were the basis of the experiment. For the cirrus microphysical model, hexagonal ice crystals and area-equivalent ice spheres are considered. The single scattering phase functions for randomly oriented hexagonal columns and area-equivalent ice spheres are computed from geometric optics and Mie theory, respectively.

Takano, Y.↗

GC11H _ 0998: A spatial pattern analysis of forest loss in the Madre de Dios region, Peru

Previous studies have quantified the extension of gold mining activities and associated it with forest loss in the Madre de Dios region of Peru. This study uses Spectral Mixture Analysis (SMA) in a cloud-computing platform to map forest loss within and outside key land tenure areas in this region, Landsat 7 Enhanced Thematic Mapper plus (ETM+) and Landsat 8 Operational land Imager (OLI) Surface Reflectance data were utilized spanning 2013 and 2017 and spectral unmixing was performed to identify patterns of forest loss for each year. Planet Scope and RapidEye imagery were used to conduct an accuracy assessment and to identify potential drivers.

Puzzi Nicolau, Andrea↗

On the use of DSCOVR EPIC to monitor the visible calibration stability of polar orbiting imagers to improve the next edition of the CERES climate data record.

The NASA CERES project has provided the climate quality observed TOA and computed surface fluxes to the scientific community. CERES instruments are onboard the Terra, Aqua, NPP, and NOAA-20 spacecraft. CERES uses MODIS and VIIRS imagers to retrieve cloud properties needed to convert CERES footprint radiance observations into fluxes using empirically derived angular directional models obtained during early CERES record. CERES utilizes geostationary sensors to infer the regional diurnal fluxes in between Terra and Aqua CERES observations. The imagers are also used to radiometrically scale the geostationary sensors (GEO) radiances to the imager calibration reference to ensure that the GEO derived cloud properties and broadband TOA fluxes are consistent in both space and time. Both the imager and GEO retrieved cloud properties are used to compute the surface fluxes. The Aqua-MODIS, SNPP-VIIRS, and NOAA-20 VIIRS afternoon imagers will also need to be radiometrically scaled to the same common calibration reference. Although all three imagers employ onboard solar diffusers, the calibration is not consistent over time due to instrument anomalies and ageing of the onboard calibrators. The CERES imager and GEO calibration group (IGCG) has been tasked to remove the imager channel calibration drifts for the next CERES reprocessing effort. The team will rely primarily on deep convective clouds, desert, and polar ice invariant targets to monitor the imager channel stability. The team uses ray-matched radiance pairs to radiometrically scale the SNPP and NOAA-20 VIIRS sensors to Aqua-MODIS. The radiometric scaling is further validated using geostationary imagers as transfer radiometers. The DSCOVR satellite was launched on February 25, 2015 and orbits around the L1 Lagrange point directly between the Earth and the sun. The EPIC instrument onboard DSCOVR employs a CCD array to image the Earth approximately every 2-hours. The EPIC sensor contains no onboard calibration systems. However, multiple inter-calibration studies have shown that the EPIC imager is very stable in time. This is likely due to the DSCOVR satellite being located about a 1.5M km from the Earth, where very little Earth reflected solar radiation degrades the optics. The excellent radiometric stability of EPIC allows the CERES IGCG to utilize the EPIC observations as a stable reference for monitoring the calibration stability of the three afternoon imagers, as well as to validate the radiometric scaling factors between them. Examples of the imager relative calibration using EPIC before and after radiometric scaling will be shown along with the results from the use of invariant targets to remove imager calibration drifts.

DSCOVR-EPIC↗

Role of small ice crystals in radiative properties of cirrus: A case study, FIRE II, November 22, 1991

Aircraft observations of cirrus cloud were made near Coffeyville, Kansas, during November 1991 as part of the First ISCCP Regional Experiment II (FIRE II) project. Cloud ice particle spectra measurements were made using both a particle measuring system (PMS) 2DC probe and an ice particle replicator. Particles larger than 200 micrometers were column rosettes. The replicator shows the presence of large numbers of ice crystals smaller than 66 micrometers (two PMS size bins) that are not recorded by the PMS 2DC probe. Calculations based on the replicator data of the geometrical blocked area and absorption cross section of the cloud per unit volume show that small particles can contribute significantly to and sometimes dominate both the solar extinction and the infrared emission. Intercomparison is made of the ice particle size, area, and mass distributions determined by these different instruments. Power law relationships for area occluded by a crystal as a function of crystal maximum dimension were computed from the PMS 2DC data. The wavelength-dependent infrared absorption cross section per volume was computed using a simple model based on anomalous diffraction and area and mass dimensional relationships for the ice crystals.

Arnott, W. Patrick↗

The 27-28 October 1986 FIRE IFO Cirrus Case Study: Cirrus Parameter Relationships Derived from Satellite and Lidar Data

Cirrus cloud radiative and physical characteristics are determined using a combination of ground based, aircraft, and satellite measurements taken as part of the First ISCCP Region Experiment (FIRE) cirrus intensive field observations (IFO) during October and November 1986. Lidar backscatter data are used with rawinsonde data to define cloud base, center and top heights and the corresponding temperatures. Coincident GOES-4 4-km visible (0.65 micrometer) and 8-km infrared window (11.5 micrometer) radiances are analyzed to determine cloud emittances and reflectances. Infrared optical depth is computed from the emittance results. Visible optical depth is derived from reflectance using a theoretical ice crystal scattering model and an empirical bidirectional reflectance model. No clouds with visible optical depths greater than 5 or infrared optical depths less than 0.1 were used in the analysis. Average cloud thickness ranged from 0.5 km to 8.0 km for the 71 scenes. Mean vertical beam emittances derived from cloud-center temperatures were 062 for all scenes compared to 0.33 for the case study (27-28 October) reflecting the thinner clouds observed for the latter scenes. Relationships between cloud emittance , extinction coefficients, and temperature for the case study are very similar to those derived from earlier surface-based studies. The thicker clouds seen during the other IFO days yield different results. Emittances derived using cloud-top temperature wer ratioed to those determined from cloud-center temperature. A nearly linear relationship between these ratios and cloud-center temperature holds promise for determining actual cloud-top temperature and cloud thickness from visible and infrared radiance pairs. The mean ratio of the visible scattering optical depth to the infrared absorption optical depth was 2.13 for these data. This scattering efficiency ratio shows a significant dependence on cloud temperature. Values of mean scattering efficiency as high as 2.6 suggest the presence of small ice particles at temperatures below 230 K. the parameterization of visible reflectance in terms of cloud optical depth and clear sky reflectance shows promise as a simplified method for interpreting visible satellite data reflected from cirrus clouds. Large uncertainties in the optical parameters due to cloud reflectance anisotropy and shading were found by analyzing data for various solar zenith angles and for simultaneous advanced very high resolution radiometer (AVHRR) data. Inhomogeneities in the cloud fields result in uneven cloud shading that apparently causes the occurrence of anomalously dark, cloud pixels in the GOES data. These shading effects complicate the interpretation of the satellite data. The results highlight the need for additional study or cirrus cloud scattering processes and remote sensing techniques.

Minnis, Patrick↗

Big Data, Cloud, and Earth Science

Given the reality of a Big Data future, we need to reevaluate our ability to quickly process immense amounts of data while maintaining our responsibility of stewarding our archives. At National Aeronautics and Space Administration (NASA), our Science Missions Directorate and Earth Science Data Systems have been exploring the commercial cloud as a potential mechanism for data ingest, archive, and distribution since 2015. This talk will discuss our timeline and strategies being employed and will discuss the process of introducing commercial cloud entities into a largely on-premise hardware-reliant approach to ingest, archive, and distribution. We will address topics such as vendor lock-in, varying compute and costing strategies, and end-user adoption. Please join us for an open and authentic conversation about the opportunities we are embracing and the risks we are undertaking as a part of this evolution.

Informatics↗