Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud data products”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS2000

Global Monitoring of Clouds and Aerosols Using a Network of Micro-Pulse Lidar Systems

Long-term global radiation programs, such as AERONET and BSRN, have shown success in monitoring column averaged cloud and aerosol optical properties. Little attention has been focused on global measurements of vertically resolved optical properties. Lidar systems are the preferred instrument for such measurements. However, global usage of lidar systems has not been achieved because of limits imposed by older systems that were large, expensive, and logistically difficult to use in the field. Small, eye-safe, and autonomous lidar systems are now currently available and overcome problems associated with older systems. The first such lidar to be developed is the Micro-pulse lidar System (MPL). The MPL has proven to be useful in the field because it can be automated, runs continuously (day and night), is eye-safe, can easily be transported and set up, and has a small field-of-view which removes multiple scattering concerns. We have developed successful protocols to operate and calibrate MPL systems. We have also developed a data analysis algorithm that produces data products such as cloud and aerosol layer heights, optical depths, extinction profiles, and the extinction-backscatter ratio. The algorithm minimizes the use of a priori assumptions and also produces error bars for all data products. Here we present an overview of our MPL protocols and data analysis techniques. We also discuss the ongoing construction of a global MPL network in conjunction with the AERONET program. Finally, we present some early results from the MPL network.

Welton, Ellsworth J.↗
NASA NTRSDate not supplied

The Crustal Dynamics Data Information System (CDDIS) – Updates and Future Developments

As earth observing services and techniques have flourished, data and products have exponentially grown, like the proliferation of GNSS stations capable of providing real-time data, SLR stations shifting to kHz lasers, and VLBI’s implementation of VGOS telescopes. The CDDIS is continually evolving to fulfill the new storage, quality check, and latency requirements that these changes bring, as well as meet new standards such as the shift toward FAIR and open science. These have shaped how the CDDIS develops new software and resources. Beginning next year, the CDDIS will begin to transition their data and products to the AWS cloud, beginning with DORIS data. This poster will highlight the CDDIS’s recently updated processing system, new data and products available, and future work.

Justine Woo↗
DOE OSTI2023

Assessing Clouds Using Satellite Observations Through Three Generations of Global Atmosphere Models

Abstract Clouds are parameterized in climate models using quantities on the model grid‐scale to approximate the cloud cover and impact on radiation. Because of the complexity of processes involved with clouds, these parameterizations are one of the key challenges in climate modeling. Differences in parameterizations of clouds are among the main contributors to the spread in climate sensitivity across models. In this work, the clouds in three generations of an atmosphere model lineage are evaluated against satellite observations. Satellite simulators are used within the model to provide an appropriate comparison with individual satellite products. In some respects, especially the top‐of‐atmosphere cloud radiative effect, the models show generational improvements. The most recent generation, represented by two distinct branches of development, exhibits some regional regressions in the cloud representation; in particular the southern ocean shows a positive bias in cloud cover. The two branches of model development show how choices during model development, both structural and parametric, lead to different cloud climatologies. Several evaluation strategies are used to quantify the spatial errors in terms of the large‐scale circulation and the cloud structure. The Earth mover's distance is proposed as a useful error metric for the passive satellite data products that provide cloud‐top pressure‐optical depth histograms. The cloud errors identified here may contribute to the high climate sensitivity in the Community Earth System Model, version 2 and in the Energy Exascale Earth System Model, version 1.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2015

Earth Science Data Fusion with Event Building Approach

Objectives of the NASA Information And Data System (NAIADS) project are to develop a prototype of a conceptually new middleware framework to modernize and significantly improve efficiency of the Earth Science data fusion, big data processing and analytics. The key components of the NAIADS include: Service Oriented Architecture (SOA) multi-lingual framework, multi-sensor coincident data Predictor, fast into-memory data Staging, multi-sensor data-Event Builder, complete data-Event streaming (a work flow with minimized IO), on-line data processing control and analytics services. The NAIADS project is leveraging CLARA framework, developed in Jefferson Lab, and integrated with the ZeroMQ messaging library. The science services are prototyped and incorporated into the system. Merging the SCIAMACHY Level-1 observations and MODIS/Terra Level-2 (Clouds and Aerosols) data products, and ECMWF re- analysis will be used for NAIADS demonstration and performance tests in compute Cloud and Cluster environments.

Lukashin, C.↗
NASA NTRS2014

OMMYDCLD: a New A-train Cloud Product that Co-locates OMI and MODIS Cloud and Radiance Parameters onto the OMI Footprint

Clouds cover approximately 60% of the earth's surface. When obscuring the satellite's field of view (FOV), clouds complicate the retrieval of ozone, trace gases and aerosols from data collected by earth observing satellites. Cloud properties associated with optical thickness, cloud pressure, water phase, drop size distribution (DSD), cloud fraction, vertical and areal extent can also change significantly over short spatio-temporal scales. The radiative transfer models used to retrieve column estimates of atmospheric constituents typically do not account for all these properties and their variations. The OMI science team is preparing to release a new data product, OMMYDCLD, which combines the cloud information from sensors on board two earth observing satellites in the NASA A-Train: Aura/OMI and Aqua/MODIS. OMMYDCLD co-locates high resolution cloud and radiance information from MODIS onto the much larger OMI pixel and combines it with parameters derived from the two other OMI cloud products: OMCLDRR and OMCLDO2. The product includes histograms for MODIS scientific data sets (SDS) provided at 1 km resolution. The statistics of key data fields - such as effective particle radius, cloud optical thickness and cloud water path - are further separated into liquid and ice categories using the optical and IR phase information. OMMYDCLD offers users of OMI data cloud information that will be useful for carrying out OMI calibration work, multi-year studies of cloud vertical structure and in the identification and classification of multi-layer clouds.

OMMYDCLD↗
NASA NTRS2008

Reducing Surface Clutter in Cloud Profiling Radar Data

An algorithm has been devised to reduce ground clutter in the data products of the CloudSat Cloud Profiling Radar (CPR), which is a nadir-looking radar instrument, in orbit around the Earth, that measures power backscattered by clouds as a function of distance from the instrument. Ground clutter contaminates the CPR data in the lowest 1 km of the atmospheric profile, heretofore making it impossible to use CPR data to satisfy the scientific interest in studying clouds and light rainfall at low altitude. The algorithm is based partly on the fact that the CloudSat orbit is such that the geodetic altitude of the CPR varies continuously over a range of approximately 25 km. As the geodetic altitude changes, the radar timing parameters are changed at intervals defined by flight software in order to keep the troposphere inside a data-collection time window. However, within each interval, the surface of the Earth continuously "scans through" (that is, it moves across) a few range bins of the data time window. For each radar profile, only few samples [one for every range-bin increment ((Delta)r = 240 m)] of the surface-clutter signature are available around the range bin in which the peak of surface return is observed, but samples in consecutive radar profiles are offset slightly (by amounts much less than (Delta)r) with respect to each other according to the relative change in geodetic altitude. As a consequence, in a case in which the surface area under examination is homogenous (e.g., an ocean surface), a sequence of consecutive radar profiles of the surface in that area contains samples of the surface response with range resolution (Delta)p much finer than the range-bin increment ((Delta)p << r). Once the high-resolution surface response has thus become available, the profile of surface clutter can be accurately estimated by use of a conventional maximum-correlation scheme: A translated and scaled version of the high-resolution surface response is fitted to the observed low-resolution profile. The translation and scaling factors that optimize the fit in a maximum-correlation sense represent (1) the true position of the surface relative to the sampled surface peak and (2) the magnitude of the surface backscatter. The performance of this algorithm has been tested on CloudSat data acquired over an ocean surface. A preliminary analysis of the test data showed a surface-clutter-rejection ratio over flat surfaces of >10 dB and a reduction of the contaminated altitude over ocean from about 1 km to about 0.5 km (over the ocean). The algorithm has been embedded in CloudSat L1B processing as of Release 04 (July 2007), and the estimated flat surface clutter is removed in L2B-GEOPROF product from the observed profile of reflectivity (see CloudSat product documentation for details and performance at http://www.cloudsat.cira.colostate.edu/ dataSpecs.php?prodid=1).

Tanelli, Simone↗
NASA NTRS2022

Automating Surface Attitude Positioning and Pointing Operations for Mars 2020

The Surface Attitude Positioning and Pointing (SAPP) subsystem of the Mars Perseverance rover keeps track of the rover’s position and attitude on the surface of Mars. The SAPP Downlink Engineering Operations team members receive data from the rover on a daily basis. They must interpret the data to make sure the rover is staying safe and to support uplink planning. The SAPP team keeps track of the error growth in the rover’s attitude estimate due to noise in the Rover Inertial Measurement Unit’s (RIMU) gyroscopes used to propagate that attitude estimate whenever the rover is moving. Whenever this error grows to a particular threshold, SAPP is responsible for updating the onboard attitude knowledge using the RIMU’s accelerometers to estimate rover roll and pitch and sun imaging to estimate rover yaw, thereby reducing this attitude estimation error. Accurate attitude estimation is required so that the rover can successfully point its High Gain Antenna (HGA) to receive information from Earth and as a backup to the Mars orbiters used for sending data from the rover to Earth, point instruments on its Remote Sensing Mast (RSM), and support safe movement and placement of instruments by the rover’s ARM relative to the Martian surface. The Mars 2020 Engineering Operations team has been working to increase the operational efficiency of the mission and eventually move to a five-hour timeline for daily operations. In pursuit of this goal, the SAPP Engineering Operations team has automated their downlink process by developing a centralized Jupyter notebook to analyze the data received daily from the rover. The SAPP downlink Jupyter notebook automatically collects the data relevant to the SAPP subsystem and visualizes this information in plots and tables that can be easily read by downlink operators to aid them in assessing the status of the subsystem. Various Application Programming Interfaces (APIs) have been incorporated into the downlink daily notebook to automate the collection and posting of data, such as gathering and posting data products to the cloud. The SAPP team has also developed a SAPP downlink software library that includes functions to aid the notebook in processing data. In addition to assessing the SAPP subsystem on a daily basis, operators need to assess the long-term trending behavior of the subsystem over time. An automated trending process has been developed to collect information from the daily notebooks in order to plot and analyze that data in a centralized place. These daily and trending processes have expedited the SAPP downlink assessment and laid the groundwork to completely automate the SAPP downlink process so that SAPP operators are unnecessary unless something unexpected occurs. This paper will provide an overview of the functions that the SAPP subsystem carries out on a daily basis, and will then dive into the automations that have been developed for daily and trending downlink assessment. An assessment of the downlink efficiency will be provided, along with a summary of lessons learned and work to go. Finally, the authors will discuss how these types of automated spacecraft health assessments could be more broadly used within mission operations.

Zarifian, Anais↗
NASA NTRSDate not supplied

Using AI/ML to Address Satellite Cloud Remote Sensing Challenges

Various AI/ML tools, employed within the Clouds and the Earth's Radiant Energy System (CERES) Satellite Cloud and Radiation Property retrieval System (SatCORPS) project, are being used to mitigate satellite radiance artifacts and thereby yield more accurate cloud and radiation data products. Neural network and K-nearest neighbor approaches have been developed that enable us to better address common passive satellite remote sensing challenges, such as corrupted imagery, day/night cloud property discontinuities, solar terminator artifacts, inadequate knowledge of the land surface emission temperature (i.e., skin temperature), and poor assumptions about vertical cloud structure, that have otherwise proven difficult to solve using more conventional methods. Fixing these problems promotes a more consistent Earth radiation budget record. These efforts demonstrate effective use of AI/ML architecture to exploit complex, multivariate predictor relationships and produce usable output at satellite spatial and temporal resolutions that would otherwise be ignored or have large biases.

Benjamin Scarino↗
NASA NTRS1975

Venus cloud models

Remote observations of Venus are reviewed. The strongest inferences of cloud properties can be drawn from polarization data which provide information about cloud particles near 68 km. Particle properties are not as well determined at higher and lower levels. If the clouds are generated photochemically from reduced sulfur species, the supply of O2 may be an important constraint on cloud production. Vapor-pressure data reviewed, and it is shown that deep clouds cannot be H2SO4-H2O aerosols unless the mixing ratios of both H2SO4 and H2O approach 0.001 below 50 km.

Wofsy, S. C.↗
NASA NTRSDate not supplied

The Surface Longwave Downward Fluxes of the NASA GEWEX SRB Release 4.0 IP Products: Validation Against the Surface-Based BSRN and PMEL Observed Data

Since the NASA Global Energy Water Exchanges (GEWEX) Surface Radiation Budget (SRB) project released its 3rd version of products in 2010, the GEWEX Data Assessments Panel (GDAP) has been working on integrating various data products to address issues in the closing of the global energy and water cycles. The 4th version of the SRB products, Rel. 4.0-IP, has integrated data products from the cloud, aerosol, atmosphere, ocean surface, and land surface projects, coordinating within GDAP, to produce a long-term time series of TOA and surface radiative estimates. The Rel. 4-IP shortwave products span 34 years continuously from July 1983 to June 2017 on a quasi-equal-area 1degree longitude by 1degree latitude grid system. The longwave products are for land only from 1983-07 to 1987-12; for both land and ocean from 1988-01 to 2009-12; and ocean only from 2010-01 to 2017-06. The data are provided at 3 hourly, 3-hourly-monthly, daily and monthly means. The ISCCP HXS clouds and radiances are the key cloud input of the current GEWEX SRB algorithms. In addition, the longwave algorithm has also made changes in cloud microphysical property, surface skin temperature input, surface emissivity, atmospheric profile, adding longwave aerosol optical properties, revising cloud overlap procedure, and so on. Details of changes in both inputs and algorithms are documented in a NASA Algorithm Theoretical Basis Document (ATBD). We have validated the surface longwave downward fluxes against the surface-based Baseline Surface Radiation Network (BSRN) and the Pacific Marine Environmental Laboratory (PMEL) buoy data. As of 2020, the BSRN archive has 12,116 site-months of observed records from 73 stations on all seven continents, and as of 2017, PMEL archive has 4389 buoy months of observed records from 64 buoys deployed in the tropics of Pacific, Atlantic and Indian Oceans. This paper presents how the SRB Rel. 4.0-IP surface longwave downward fluxes compare with these surface-based measurements and how the comparison statistics differ from that of Rel. 3.0.

GEWEX SRB↗
NASA NTRS2004

A Cloud Mask for AIRS

With the preliminary release of AIRS Level 1 and 2 data to the scientific community, there is a growing need for an accurate AIRS cloud mask for data assimilation studies and in producing products derived from cloud free radiances. Current cloud information provided with the AIRS data are limited or based on simplified threshold tests. A multispectral cloud detection approach has been developed for AIRS that utilizes the hyper-spectral capabilities to detect clouds based on specific cloud signatures across the short wave and long wave infrared window regions. This new AIRS cloud mask has been validated against the existing AIRS Level 2 cloud product and cloud information derived from MODIS. Preliminary results for both day and night applications over the continental U.S. are encouraging. Details of the cloud detection approach and validation results will be presented at the conference.

Brubaker, N.↗
NASA NTRS2021

GEWEX (Global Energy and Water Exchanges Project): Surface Radiation Budget (SRB) Release 4 Integrated Product (IP4) - Algorithm Theoretical Basis Document and Evaluation

The World Climate Research Programme’s (WCRP) Global Energy and Water Exchanges (GEWEX) program is an integrated program of research, observations, and science activities with the mission to “Observe, understand and model the hydrological cycle and energy fluxes in the Earth’s atmosphere and at the surface.” Since the public release in 2010 of SRB Release 3, GEWEX reorganized to formulate the Data and Assessments Panel (GDAP) aimed at performing community assessments of the long-term global data products with focus on integrating various data products to address issues in the closing of the global energy and water cycles. SRB Release 4 Intergrated Product (Rel4-IP) integrates data products from the cloud, aerosol, atmosphere, ocean surface, and land surface projects within GDAP to produce a long-term time series of Top-of-Atmosphere (TOA) and surface radiative estimates. This Algorithm Theoretical Basis Document (ATBD) describes the various inputs, algorithms and resulting top-of-atmosphere and surface flux products that span from July 1983 through June 2017. Comparisons of the TOA flux products are made to overlapping CERES data products when possible. The surface radiative flux products are assessed relative to the globally distribution Baseline Surface Radiation Network measurements sites. Variability of the various products are compared to ERBE and CERES during overlapping time periods. The variability of the product show excellent correspondent to CERES during overlap years and improved statistical agreement with surface measurements. This document also discusses known issues with the data products to help the user understand the uncertainty and known issues.

Surface radiation budget↗
NASA NTRSDate not supplied

Artificial Neural Network (ANN) Surface Longwave and Shortwave Fluxes Trained on CERES Observations

The Clouds and Earth’s Radiant Energy System (CERES) project provides satellite-based observations of the radiative fluxes and clouds systems. CERES climate quality data products typically take several months of calibration and validation before release to the public. The Fast Longwave and Shortwave Radiative Flux (FLASHFlux) data product was developed to provide key data for the applied sciences and educational users within a week of observation. FLASHFlux achieves this by using simplified calibration, an operational meteorological product from Global Modeling and Assimilation Office (GMAO), and its own surface parameterizations model. The CERES FLASHFlux provides two data products: 1) an hourly Level 2 Single Scanner Footprint (SSF) data separately for Terra and NOAA-20 observations, and 2) a daily Level 3 Time Interpolated and Spatially Averaged (TISA) 1o x 1o gridded data that combines Terra and NOAA-20 observations. Currently, FLASHFlux uses the Langley Parameterized Shortwave Algorithm (LPSA) and Langley Parameterized Longwave Algorithm (LPLA) to derive its surface fluxes (Kratz et al., 2010; Gupta et al, 2001). A new Machine Learning (ML) based approach using Artificial Neural Networks to derive Surface Longwave (LW) & Shortwave (SW) fluxes based on training data from the CERES Clouds Radiative Swath (CRS) product is being investigated to replace LPSA and LPLA in the SSF surface flux products. One of the biggest hurdles in training ML model is model fitting. To overcome the problem of overfitting we use feature engineering that helps in finding the important feature and remove features that are irrelevant to the model. In our training we employed the Leave-One-Feature-Out Importance (LOFO) to evaluate the significance of each feature in our training. We intercompare ANN fluxes against surface fluxes produced from the Fu-Liou model in CRS and the LPSA/LPLA in FLASHFlux SSF. Furthermore, we validated ANN derived fluxes to the Baseline Surface Radiation Network (BSRN).

P C Sawaengphokhai↗
NASA NTRS2007

Integrated Cloud-Aerosol-Radiation Product using CERES, MODIS, CALIPSO and CloudSat Data

This paper documents the development of the first integrated data set of global vertical profiles of clouds, aerosols, and radiation using the combined NASA A-Train data from the Aqua Clouds and Earth's Radiant Energy System (CERES) and Moderate Resolution Imaging Spectroradiometer (MODIS), Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO), and CloudSat. As part of this effort, cloud data from the CALIPSO lidar and the CloudSat radar are merged with the integrated column cloud properties from the CERES-MODIS analyses. The active and passive datasets are compared to determine commonalities and differences in order to facilitate the development of a 3- dimensional cloud and aerosol dataset that will then be integrated into the CERES broadband radiance footprint. Preliminary results from the comparisons for April 2007 reveal that the CERES-MODIS global cloud amounts are, on average, 0.14 less and 0.15 greater than those from CALIPSO and CloudSat, respectively. These new data will provide unprecedented ability to test and improve global cloud and aerosol models, to investigate aerosol direct and indirect radiative forcing, and to validate the accuracy of global aerosol, cloud, and radiation data sets especially in polar regions and for multi-layered cloud conditions.

Sun-Mack, Sunny↗
NASA NTRSDate not supplied

Improving Radiative Fluxes for the CERES FluxByCldTyp Data Product Using Deep Neural Network

The NASA Clouds and the Earth's Radiant Energy System (CERES) product provides over 20 years of accurately observed top-of-the-atmosphere (TOA) and surface flux data record for climate monitoring and diagnostic studies. The interaction between clouds and radiation interaction is a key factor that dominate climate feedbacks but is not well understood. To further advance our understanding of the cloud-radiation interaction, a new CERES FluxByCldTyp (FBCT) product has been developed that contains radiative fluxes by cloud-type, which can provide more stringent constraints when validating models and reveal more insight into the interactions between clouds and climate. For CERES partly cloudy and multiple cloud-type footprints, the FBCT product utilizes Moderate Resolution Imaging Spectroradiometer (MODIS) narrow-band (NB) imager channel radiances partitioned by cloud-type within a CERES footprint to estimate the cloud-type broadband fluxes. The MODIS multi-channel derived broadband fluxes were compared with the CERES observed footprint fluxes and were found to be within 1% and 2.5% for LW and SW, respectively, as well as being mostly free of cloud property dependencies. The FBCT all-sky and clear-sky monthly averaged fluxes were found to be consistent with the CERES SSF1deg product. This study takes advantage of recent progress in machine learning (ML) field by applying deep neural network algorithm to improve fluxes based on MODIS NB radiances. The preliminary study shows ML produce are an improvement over the current FBCT Edition 4 NB2BB algorithm. Furthermore, unlike Ed4 NB2BB, the new ML method convert NB radiances directly to broadband fluxes. For future Ed5, new NB radiances are proposed and used by ML to improve fluxes calculation. Preliminary results show significant LW improvement.

Sun, Moguo↗
NASA NTRS1999

Global Mapping of Underwater UV Irradiances and DNA-Weighted Exposures using TOMS and SeaWiFS Data Products

The global stratospheric ozone-layer depletion results In an increase in biologically harmful ultraviolet (UV) radiation reaching the surface and penetrating to ecologically significant depths in natural waters. Such an increase can be estimated on a global scale by combining satellite estimates of UV irradiance at the ocean surface from the Total Ozone Mapping Spectrometer (TOMS) satellite instrument with the SeaWIFS satellite ocean-color measurements in the visible spectral region. In this paper we propose a model of seawater optical properties in the UV spectral region based on the Case I water model in the visible range. The inputs to the model are standard monthly SeaWiFS products: chlorophyll concentration and the diffuse attenuation coefficient at 490nm. Penetration of solar UV radiation to different depths in open ocean waters is calculated using the RT (radiative transfer) quasi-single scattering approximation (QSSA). The accuracy of the QSSA approximation in the water is tested using more accurate codes. The sensitivity study of the underwater UV irradiance to atmospheric and oceanic optical properties have shown that the main environmental parameters controlling the absolute levels of the UVB (280-320nm) and DNA-weighted irradiance underwater are: solar-zenith angle, cloud transmittance, water optical properties, and total ozone. Weekly maps of underwater UV irradiance and DNA-weighted exposure are calculated using monthly-mean SeaWiFS chlorophyll and diffuse attenuation coefficient products, daily SeaWiFS cloud fraction data, and the TOMS-derived surface UV irradiance daily maps. The final products include global maps of weekly-average UVB irradiance and DNA-weighted daily exposures at 3m and 10m, and depths where the UVB irradiance and DNA-weighted dose rate at local noon are equal to 10% of their surface values.

Vasilkov, Alexander↗