Study of cloud patterns as seen by meteorological satellites, phase 2 Final report, Feb. 1 - Jan. 31, 1966
Data processing programs for cloud photograph interpretation
DATA PROCESSING↗
SEARCH · Search NASA
Results for “cloud computing, data cloud”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
A cloud-cover simulation procedure.
Worldwide cloud cover simulation procedure providing data for computer simulation of earth oriented space missions, describing computer program using Monte Carlo mission simulation
Brown, S. C.↗
ERS-1 scatterometer estimates of annual variations of Atlantic ITCZ and Pacific NECC
A 10 m height wind vector data set, named CMODFD, from ERS-1 Active Microwave Instrument (AMI) measurements, was compared with moored buoy wind observations. The CMODFD wind vectors compared favorably with moored buoy wind observations at about 60 sites. Satisfactory results were obtained from intercomparisons between CMODFD and moored buoy estimates of horizontal wind divergence and wind stress curl. The CMODFD positions of the Intertropical Convergence Zone (ITCZ) at 28 deg west were nearly equal to those determined from satellite images of clouds. The CMODFD data were employed to compute the Ekman vertical velocity in the region of the Pacific North Equatorial Countercurrent (NECC), and a correlative relation was found between the annual cycles and longitudinal variations of the NECC and Ekman vertical motion.
Halpern, D.↗
Advanced Information Systems Technology for NASA Earth System Digital Twins (ESDT)
ESA and NASA have both started programs to design and develop Digital Twins of the Earth and/or Earth systems. Organized around interconnected, multi-domain, high-scale modeling capabilities, the three major components of an Earth System Digital Twin are a continuously updated Digital Replica of the Earth System of interest, dynamic Forecasting models, and Impact Assessment capabilities. Earth System Digital Twins integrate diverse Earth and human activity models, continuous observations, and information system capabilities to provide unified, comprehensive representations and predictions that can be utilized for monitoring the health of the Planet, as well as for developing actionable information to support decision making. More generally, Digital Twins will help researchers better understand the fundamental Earth systems that impact everything from wildfires to climate change. This Townhall will first provide a short description of ESA’s, NASA’s and CNES’s current efforts in Digital Twins: • Destination Earth (DestinE) is the first initiative of the European Union to create a Digital Twin of the Earth, particularly focused on weather and climate, and as a coordinated effort between the European Centre for Medium-Range Weather Forecasts (ECMWF), ESA and the European Organization for the Exploitation of Meteorological Satellites (EUMETSAT). • Additionally, ESA is developing several Digital Twin Earth Precursor Activities to study some of the key scientific and technical challenges associated with building a “Digital Twin Earth”. These include forests, hydrology, Antarctica, food systems, oceans, and climate hot spots Digital Twin prototypes. • NASA Earth Science Technology Office (ESTO)’s Advanced Information Systems Technology (AIST) Program has started an initiative in Earth System Digital Twins (ESDT), with 14 current projects in this area, developing various information systems technologies and prototypes that will help prepare the development of future NASA Digital Twins. • CNES is currently developing the concept of a Digital Twin Factory (DTF), which relies on a data lake, a high computing capability using clouds and/or HPC and has thematic algorithms and methodologies able to generate registered and coherent layers of information in order to enrich a datacube from which physical indicators can be computed spatially. NASA, ESA and CNES are also currently defining science use cases that will be presented during the townhall; those and a few short discussions of current projects will serve as a starting point to engage a dialogue about Digital Twins of the Earth with the IGARSS community.
earth science remote sensing; Information systems↗
A Machine Learning Approach to Determine Surface Radiative Fluxes based on CERES Observations
The Clouds and Earth’s Radiant Energy System (CERES) projects provides satellite-based observations of the radiative fluxes and clouds systems. CERES climate quality data products typically take several months of calibration and validation before release to the public. An alternative data product, Fast Longwave and Shortwave radiative Flux (FLASHFlux), was created to provide data to the applied sciences and educational users. FLASHFlux provides Top-of-Atmosphere radiative fluxes, Clouds properties, and parameterized surface radiative fluxes within four days for footprint (Level 2) data. We investigate the use of Artificial Neural Network (ANN) using MODerate resolution Imaging Spectroradiometer (MODIS) derived clouds properties and meteorology from the Global Assimilation and Meteorology Office (GMAO) scaled to the CERES footprint from the CERES Clouds Radiative Swath (CRS) data product to compute surface radiative fluxes. We test ANN produce fluxes against surface fluxes produced from the Fu-Liou model used in CRS and the Langley Parameterized Shortwave Algorithm (LPSA) and Langley Parameterized Longwave Algorithm (LPLA) used in FLASHFlux. We also validated each model with ground-based observations. Furthermore, we investigate Leave-One-Feature-Out Importance (LOFO) to evaluate the significance of each feature in our training and provide insight for future models. Advances in machine learning, along with increases in computational capabilities and available data allow us to estimate effects of unresolved processes in our climate without direct modeling. This work evaluates the ability to create accurate data-driven models to supplement or replace current models that estimate surface radiative fluxes.
Climatology↗
TPSAS-NF1676L-11678-DND
Cloud vertical profiles retrieved from CALIPSO and CloudSat data provide additional information that greatly improves the estimate of atmospheric radiative heating rates and potentially improves the estimate of the global surface radiation budget. To utilize CALIPSO and CloudSat cloud vertical profiles, we combined their profiles and generated merged profiles. Weused the merged cloud profiles and MODIS derived cloud profiles by the CERES cloud algorithm in irradiance computations. In this study, the improvement of the irradiance by CALIPSO and CloudSat derived merged cloud vertical profiles is evaluated by comparing modeled irradiances with and without merged cloud profiles. Because of lower cloud base heights provided by the merged profiles compared with cloud base heights derived from an empirical formula using the MODIS derived cloud top height and optical thickness, the global annual mean surface longwave downward irradiance increases approximately by 7 Wm-2. While CALIPSO version 3 data have not been incorporated in the irradiance computation and the effect of the new CALIPSO data needs to be assessed, a comparison with surface observations suggests an improvement of surface downward longwave irradiance computations. The surface downward longwave irradiance computed with CALIPSO and CloudSat merged clouds agrees better with surface observations than the irradiance computed with MODIS only does. The bias difference over ARM SGP sites with 2 years of data decreases from -5 W m-2to -2 Wm-2, and it decreases from -9 Wm-2to no bias over polar validation sites. The result suggests that CALIPSO CloudSat derived merged clouds significantly improve surface longwave irradiance estimates once they are combined with MODIS derived cloud properties and with temperature and humidity profiles from reanalysis.
Seiji Kato↗
Towards A Flexible Data Fusion Tool Incorporating Model, Satellite, Regulatory Monitor and Low-Cost Sensor Data for Air Quality Estimation and Forecasting
Air quality managers, researchers, and concerned community scientists around the world have a variety of sources for air quality information, ranging from traditional regulatory monitoring networks and atmospheric chemistry models to remote sensing data products and low-cost sensor networks. However, the ability to incorporate data from these disparate sources and synthesize a comprehensive overview of the local air quality situation remains a considerable barrier for many end-users. This presentation will outline a tool, currently in development, which will address this need using a flexible data fusion approach. The tool will make use of air quality forecast model outputs (primarily from the NASA GEOS-CF composition forecast modeling system), satellite remote sensing data (from instruments including MODIS, VIIRS, TROPOMI, plus TEMPO for the US when available), and in-situ data from official regulatory and/or low-cost networks where these are available. The ability to incorporate data from low-cost sensor networks will be a key feature of the tool; it will make use of other available data sources to calibrate the low-cost sensor data on a regional scale, then use these calibrated low-cost sensor data for localized updating to resolve finer-scale air quality patterns. Development of this tool is taking place with the help of national and international partners and end-user groups, coordinated through the US EPA and the United Nations Environment Programme (UNEP). The tool is being developed on the Google Earth Engine cloud computing platform to facilitate integration of diverse data sources and free access by a broad community of end-users. Stewardship of the tool will be passed to US EPA and UNEP to support future activities with end-users in the US and around the world, and the tool itself will remain freely accessible. We hope that this tool will lower the barrier to entry for various user groups worldwide, including community scientists, who struggle to integrate disparate data sources to gain insight into their local air quality situations. This presentation will cover the early stages of the development of the tool, including the underlying methods and some pilot case studies in integrating low-cost sensor data.
global models↗
An Integrated Data Analytics Platform
An Integrated Science Data Analytics Platform is an environment that enables the confluence of resources for scientific investigation. It harmonizes data, tools and computational resources which subsequently enable the research community to focus on the investigation rather than spending time on security, data preparation, management, etc. OceanWorks is a NASA technology integration project to establish a cloud-based Integrated Ocean Science Data Analytics Platform at NASA’s Physical Oceanography Distributed Active Archive Center (PO.DAAC) for big ocean science. It focuses on advancement and maturity by bringing together several NASA open-source, big data projects for parallel analytics, anomaly detection, in-situ to satellite data matchup, quality-screened data subsetting, search relevancy, and data discovery. Our communities are relying on data distributed through data centers such as the PO.DAAC, COAPS, NCAR, and many others to conduct their research. In typical investigations, scientists would engage in: search for data, evaluate the relevance of that data, download it, and then apply algorithms to identify trends. Such workflow cannot scale if the research involves a massive amount of data or multi-variate measurements. NASA’s Surface Water and Ocean Topography (SWOT) mission is expected to produce massive amount of observational data during its 3-year nominal mission. Collections like SWOT challenges all existing Earth Science data archival, distribution and analysis paradigms. In this paper, we will discuss how OceanWorks enhances the analysis of physical ocean data where the computation is done on an elastic cloud platform next to the archive to deliver fast, web-accessible services for working with oceanographic measurements.
Yang, Chaowei↗
Derivation of the radiation budget at ground level from satellite measurements
Determination of the Earth radiaton budget and progress in measurement of the budget components and in the treatment of imaging data from satellites are described. Methods for calculating the radiation budget in a general circulation model, radiative transfer characteristics of clouds, computation of solar radiation at ground level using meteorological data and development of a 10-channel radiometer are discussed.
Raschke, E.↗
Cloud pumping in a one-dimensional photochemical model
Cloud pumping data based on tropical maritime updraft statistics are incorporated in a one-dimensional steady-state eddy diffusive photochemical model of the troposphere. It is suggested that regions with weaker convection, such as the midlatitudes, may also experience substantial effects from cloud pumping. The direct effects of cloud pumping on CO were found to be more significant than implied by sensitivity studies. The (CH3)2S profile computed with cloud pumping agrees well with previous data.
Costen, Robert C.↗
NASA Update for Unidata Stratcomm
The NASA representative to the Unidata Strategic Committee presented a semiannual update on NASAs work with and use of Unidata technologies. The talk updated Unidata on the program of cloud computing prototypes underway for the Earth Observing System Data and Information System (EOSDIS). Also discussed was a trade study on the use of the Open source Project for a Network Data Access Protocol (OPeNDAP) with Web Object Storage in the cloud.
data systems↗
Description of SAFIRE for ISES
The SAFIRE (Spectroscopy of the Atmosphere using Far Infrared Emission) is a limb emission experiment using a far-IR Fourier transform spectrometer (FTS) and a mid-IR broadband multispectral radiometer covering the range 80 to 1600/cm. The purpose of this experiment is to obtain vertical distributions of temperature and key constituents of O(y), HO(y), NO(y), ClO(y), and BrO(y) families in the stratosphere, mesosphere, and thermosphere. The spectral channels and gases within each channel are summarized. The instrument includes a 48 element (6 x 8) Ge:GA detector array operating at 4 K in the far-IR and a 105 element (7 x 15) HgCdTe array operating at 80 K in the mid-IR. The SAFIRE uses four different scan modes for vertical coverage and resolution to address various scientific requirements. The SAFIRE data reduction will start with the retrieval of temperature profile as a function of pressure using two CO2 channel data. Constituent distributions then are obtained from other channel data using the retrieved temperature profile. The SAFIRE measurements are limited to the region above the tropopause because of radiance saturation by H2O and clouds. The computational capability necessary to process at the instrument data rate is estimated to be 19 MFLOPS for FTS data and 0.02 MFLOPS for radiometer data. It seems, therefore, that the real-time applications of SAFIRE data using an onboard processing device is not feasible. Although a temperature anomaly may be detected from the two CO2 radiometer channels using an onboard processor for the stratosphere, it is not possible to distinguish between CO2 outflux and temperature anomaly. Temperature anomaly does not, therefore, offer tropospheric information useful for real-time application.
Park, Jae H.↗
A cloud physics investigation utilizing Skylab data
The author has identified the following significant results. The Lowtran 2 program, S191 spectral response, and solar spectrum were used to compute the expected absorption by 2.0 micron band for a variety of cloud pressure levels and solar zenith angles. Analysis of the three long wavelength data channels continued in which it was found necessary to impose a minimum radiance criterion. It was also found necessary to modify the computer program to permit the computation of mean values and standard deviations for selected subsets of data on a given tape. A technique for computing the integrated absorption in the A band was devised. The technique normalizes the relative maximum at approximately .78 micron to the solar irradiance curve and then adjusts the relative maximum at approximately .74 micron to fit the solar curve.
Alishouse, J.↗
A Newly Developing Community-Oriented Data System from NASA GES DISC
Data services are essential to facilitate data access and to aid efficiency of conducting research and application activities. With emerging technologies such as cloud computing and AI/ML (Artificial Intelligence/Machine Learning) leading the pace of the data world, the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), home to the permanent archive for multidisciplinary Earth Observation (EO) geospatial data to study atmospheric composition, weather and climate variability, and water and energy cycles is no exception.Interfacing directly with users as part of data center work, we understand the challenges for the required time and effort to discover, visualize, and analyze large varieties and quantities of Earth Observation information for research, monitoring, and decision-making, largely due to the existing data and information systems aim to support experienced users, but has been proved difficult for non-earth scientists and new users that are unfamiliar with the variety of formats and structures in which data, metadata, and information are stored, as well as the required methods to use them. To address these challenges, I will update our latest activities with regard to water-and energy-related products and community-oriented and user-friendly services at the GES DISC, including our plans for the emerging technologies.
Jennifer Wei↗
Cloud Computing for Mission Design and Operations
The space mission design and operations community already recognizes the value of cloud computing and virtualization. However, natural and valid concerns, like security, privacy, up-time, and vendor lock-in, have prevented a more widespread and expedited adoption into official workflows. In the interest of alleviating these concerns, we propose a series of guidelines for internally deploying a resource-oriented hub of data and algorithms. These guidelines provide a roadmap for implementing an architecture inspired in the cloud computing model: associative, elastic, semantical, interconnected, and adaptive. The architecture can be summarized as exposing data and algorithms as resource-oriented Web services, coordinated via messaging, and running on virtual machines; it is simple, and based on widely adopted standards, protocols, and tools. The architecture may help reduce common sources of complexity intrinsic to data-driven, collaborative interactions and, most importantly, it may provide the means for teams and agencies to evaluate the cloud computing model in their specific context, with minimal infrastructure changes, and before committing to a specific cloud services provider.
cloud computing↗
Software for Simulation of Hyperspectral Images
A package of software generates simulated hyperspectral images for use in validating algorithms that generate estimates of Earth-surface spectral reflectance from hyperspectral images acquired by airborne and spaceborne instruments. This software is based on a direct simulation Monte Carlo approach for modeling three-dimensional atmospheric radiative transport as well as surfaces characterized by spatially inhomogeneous bidirectional reflectance distribution functions. In this approach, 'ground truth' is accurately known through input specification of surface and atmospheric properties, and it is practical to consider wide variations of these properties. The software can treat both land and ocean surfaces and the effects of finite clouds with surface shadowing. The spectral/spatial data cubes computed by use of this software can serve both as a substitute for and a supplement to field validation data.
Richtsmeier, Steven C.↗
Simulation of Hyperspectral Images
A software package generates simulated hyperspectral imagery for use in validating algorithms that generate estimates of Earth-surface spectral reflectance from hyperspectral images acquired by airborne and spaceborne instruments. This software is based on a direct simulation Monte Carlo approach for modeling three-dimensional atmospheric radiative transport, as well as reflections from surfaces characterized by spatially inhomogeneous bidirectional reflectance distribution functions. In this approach, "ground truth" is accurately known through input specification of surface and atmospheric properties, and it is practical to consider wide variations of these properties. The software can treat both land and ocean surfaces, as well as the effects of finite clouds with surface shadowing. The spectral/spatial data cubes computed by use of this software can serve both as a substitute for, and a supplement to, field validation data.
Richsmeier, Steven C.↗
Cloud parameters from GOES visible and infrared radiances during the FIRE Cirrus IFO, October 1986
Visible (VIS, 0.65 micron) and infrared (IR, 10.5 microns) channels on geostationary satellites are the key elements of the International Satellite Cloud Climatology Project (ISCCP). All daytime ISCCP cloud parameters are derived from a combination of VIS and IR data. Validation and improvement of the ISCCP and other cloud retrieval algorithms are important components of the First ISCCP Regional Experiment (FIRE) Intensive Field Observations (IFO). Data from the Cirrus IFO (October 19 to November 2, 1986) over Wisconsin are available for validating cirrus cloud retrievals from satellites. The Geostationary Operational Environmental Satellite (GOES) located over the Equator at approximately 100 deg W provided nearly continuous measurements of VIS and IR radiances over the IFO areas. The preliminary results of cloud parameters derived from the IFO GOES data are presented. Cloud attitudes are first derived using an algorithms without corrections for cloud emissivity. These same parameters will then be computed from the same data relying on an emissivity correction algorithm based on correlative data taken during the Cirrus IFO.
Heck, Patrick W.↗