Search NASA⌕ Search

SEARCH · Search NASA

Results for “retrieval algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,603 records · Page 89

A Time Series Approach for Soil Moisture Estimation

Soil moisture is a key parameter in understanding the global water cycle and in predicting natural hazards. Polarimetric radar measurements have been used for estimating soil moisture of bare surfaces. In order to estimate soil moisture accurately, the surface roughness effect must be compensated properly. In addition, these algorithms will not produce accurate results for vegetated surfaces. It is difficult to retrieve soil moisture of a vegetated surface since the radar backscattering cross section is sensitive to the vegetation structure and environmental conditions such as the ground slope. Therefore, it is necessary to develop a method to estimate the effect of the surface roughness and vegetation reliably. One way to remove the roughness effect and the vegetation contamination is to take advantage of the temporal variation of soil moisture. In order to understand the global hydrologic cycle, it is desirable to measure soil moisture with one- to two-days revisit. Using these frequent measurements, a time series approach can be implemented to improve the soil moisture retrieval accuracy.

soil moisture↗

SAGE II Measurements of Stratospheric Aerosol Properties at Non-Volcanic Levels

Since 2000, stratospheric aerosol levels have been relatively stable and at the lowest levels observed in the historical record. Given the challenges of making satellite measurements of aerosol properties at these levels, we have performed a study of the sensitivity of the product to the major components of the processing algorithm used in the production of SAGE II aerosol extinction measurements and the retrieval process that produces the operational surface area density (SAD) product. We find that the aerosol extinction measurements, particularly at 1020 nm, remain robust and reliable at the observed aerosol levels. On the other hand, during background periods, the SAD operational product has an uncertainty of at least a factor of 2 during due to the lack of sensitivity to particles with radii less than 100 nm.

Thomason, Larry W.↗

Next-Generation Satellite Precipitation Products for Understanding Global and Regional Water Variability

A major challenge in understanding the space-time variability of continental water fluxes is the lack of accurate precipitation estimates over complex terrains. While satellite precipitation observations can be used to complement ground-based data to obtain improved estimates, space-based and ground-based estimates come with their own sets of uncertainties, which must be understood and characterized. Quantitative estimation of uncertainties in these products also provides a necessary foundation for merging satellite and ground-based precipitation measurements within a rigorous statistical framework. Global Precipitation Measurement (GPM) is an international satellite mission that will provide next-generation global precipitation data products for research and applications. It consists of a constellation of microwave sensors provided by NASA, JAXA, CNES, ISRO, EUMETSAT, DOD, NOAA, NPP, and JPSS. At the heart of the mission is the GPM Core Observatory provided by NASA and JAXA to be launched in 2013. The GPM Core, which will carry the first space-borne dual-frequency radar and a state-of-the-art multi-frequency radiometer, is designed to set new reference standards for precipitation measurements from space, which can then be used to unify and refine precipitation retrievals from all constellation sensors. The next-generation constellation-based satellite precipitation estimates will be characterized by intercalibrated radiometric measurements and physical-based retrievals using a common observation-derived hydrometeor database. For pre-launch algorithm development and post-launch product evaluation, NASA supports an extensive ground validation (GV) program in cooperation with domestic and international partners to improve (1) physics of remote-sensing algorithms through a series of focused field campaigns, (2) characterization of uncertainties in satellite and ground-based precipitation products over selected GV testbeds, and (3) modeling of atmospheric processes and land surface hydrology through simulation, downscaling, and data assimilation. An overview of the GPM mission, science status, and synergies with HyMex activities will be presented

Hou, Arthur Y.↗

First Observations of SO2 from the Satellite Suomi NPP OMPS: Widespread Air Pollution Events Over China

Severe smog episodes over China in January 2013 received worldwide attention. This air pollution was distinguished by heavy loadings of fine particulate matter and SO2. To characterize these episodes, we employed the Ozone Mapping and Profiler Suite, Nadir Mapper (OMPS NM), an ultraviolet (UV) spectrometer flying on the Suomi National Polar-orbiting Partnership (SNPP) spacecraft since October 2011. We developed an advanced algorithm to quantify SO2 in the lower troposphere and achieved high-quality retrievals from OMPS NM, which are characterized by high precision, approx. 0.2 Dobson Units (DU; 1 DU = 2.69 x 10(exp 16) molecules/sq cm) for instantaneous field of view SO2 data and low biases (within +/-0.2 DU). Here we report SO2 retrievals and UV aerosol index data for these pollution events. The SO2 columns and the areas covered by high pollutant concentrations are quantified; the results reveal for the first time the full extent (an area of approx. 10(exp 6) sq km containing up to 60 kt of SO2) of these episodes.

Sulfur Dioxide↗

Principal Modes of Precipitation Variability from Preliminary Series of IMERG Data

The Integrated Multi-satellitE Retrievals for the Global Precipitation Measurement (GPM) mission, IMERG, is the unified U.S. algorithm that provides merged Microwave Infrared (IR) satellite precipitation product for the U.S. GPM team. Even though IMERG record is still very short, 2014-2016, it is tempting to test if it captures ENSO and NAO signals as compared to the popular, still on-going, TRMM Multi-satellite Precipitation Analysis, TMPA. El Nino Southern Oscillation (ENSO) is the most significant mode of interannual variability of tropical ocean atmosphere. North Atlantic Oscillation (NAO) impact is on monthly scales and is mostly an atmospheric mode in the North Atlantic. There exist well-defined, multivariate, indexes that represent ENSO and NAO conditions and phase.

climate variability↗

A Spatiotemporal Indexing Approach for Efficient Processing of Big Array-Based Climate Data with MapReduce

Climate observations and model simulations are producing vast amounts of array-based spatiotemporal data. Efficient processing of these data is essential for assessing global challenges such as climate change, natural disasters, and diseases. This is challenging not only because of the large data volume, but also because of the intrinsic high-dimensional nature of geoscience data. To tackle this challenge, we propose a spatiotemporal indexing approach to efficiently manage and process big climate data with MapReduce in a highly scalable environment. Using this approach, big climate data are directly stored in a Hadoop Distributed File System in its original, native file format. A spatiotemporal index is built to bridge the logical array-based data model and the physical data layout, which enables fast data retrieval when performing spatiotemporal queries. Based on the index, a data-partitioning algorithm is applied to enable MapReduce to achieve high data locality, as well as balancing the workload. The proposed indexing approach is evaluated using the National Aeronautics and Space Administration (NASA) Modern-Era Retrospective Analysis for Research and Applications (MERRA) climate reanalysis dataset. The experimental results show that the index can significantly accelerate querying and processing (10 speedup compared to the baseline test using the same computing cluster), while keeping the index-to-data ratio small (0.0328). The applicability of the indexing approach is demonstrated by a climate anomaly detection deployed on a NASA Hadoop cluster. This approach is also able to support efficient processing of general array-based spatiotemporal data in various geoscience domains without special configuration on a Hadoop cluster.

big data↗

Satellite Monitoring of Global Surface Soil Organic Carbon Dynamics Using the SMAP Level 4 Carbon Product

Soil organic carbon (SOC) is an important metric of soil health and the terrestrial carbon balance. Short‐term climate variations affect SOC through changes in temperature and moisture, which control vegetation growth and soil decomposition. We evaluated a satellite data‐driven carbon model, operating under the NASA Soil Moisture Active‐Passive (SMAP) mission, as a means of monitoring global surface SOC dynamics. The SMAP Level 4 Carbon (L4C) product estimates a daily global carbon budget including surface (0‐ to 5‐cm depth) SOC. We found that the L4C mean latitudinal SOC distribution is generally consistent with alternative assessments from static soil inventory records and dynamic global vegetation models (r ≥ 0.89). Within forest systems, based on inventory data, L4C SOC is most similar in magnitude to litterfall but is correlated with coarse woody debris ( urn:x-wiley:jgrg:media:jgrg21790:jgrg21790-math-0001) and total SOC ( urn:x-wiley:jgrg:media:jgrg21790:jgrg21790-math-0002). L4C SOC is sensitive to seasonal and annual climate variability, with mean residence times that range from 1.5 years in the wet tropics to 17 years in the cold tundra. Incorporating soil moisture retrievals from the SMAP L‐band (1.4 GHz) microwave radiometer within the L4C algorithm provides enhanced soil moisture sensitivity under low‐to‐moderate vegetation cover (<5 kg/sq.m vegetation water content). The L‐band soil moisture had the greatest impact on the L4C carbon budget in semiarid regions, which span almost 60% of the globe and account for substantial variability in the terrestrial carbon sink. The L4C operational product enables prognostic investigations into effects of recent climate trends and anomalies (e.g., droughts and pluvials) on shallow soil carbon dynamics.

K. Arthur Endsley↗

Use of Machine Learning and Principal Component Analysis to Retrieve Nitrogen Dioxide (NO 2 ) With Hyperspectral Imagers and Reduce Noise in Spectral Fitting

Nitrogen dioxide (NO 2 ) is an important trace-gas pollutant and climate agent whose presence also leads to spectral interference in ocean color retrievals. NO 2 column densities have been retrieved with satellite UV–Vis spectrometers such as the Ozone Monitoring Instrument (OMI) and the Tropospheric Monitoring Instrument (TROPOMI) that typically have spectral resolutions of the order of 0.5 nm or better and spatial footprints as small as 3.6 km × 5.6 km. These NO 2 observations are used to estimate emissions, monitor pollution trends, and study effects on human health. Here, we investigate whether it is possible to retrieve NO 2 amounts with lower-spectral-resolution hyperspectral imagers such as the Ocean Color Instrument (OCI) that will fly on the Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) satellite set for launch in early 2024. OCI will have a spectral resolution of 5 nm and a spatial resolution of ∼ 1 km with global coverage in 1–2 d. At this spectral resolution, small-scale spectral structure from NO 2 absorption is still present. We use real spectra from the OMI to simulate OCI spectra that are in turn used to estimate NO 2 slant column densities (SCDs) with an artificial neural network (NN) trained on target OMI retrievals. While we obtain good results with no noise added to the OCI simulated spectra, we find that the expected instrumental noise substantially degrades the OCI NO 2 retrievals. Nevertheless, the NO 2 information from OCI may be of value for ocean color retrievals. OCI retrievals can also be temporally averaged over timescales of the order of months to reduce noise and provide higher-spatial-resolution maps that may be useful for downscaling lower-spatial-resolution data provided by instruments such as OMI and TROPOMI; this downscaling could potentially enable higher-resolution emissions estimates and be useful for other applications. In addition, we show that NNs that use coefficients of leading modes of a principal component analysis of radiance spectra as inputs appear to enable noise reduction in NO 2 retrievals. Once trained, NNs can also substantially speed up NO 2 spectral fitting algorithms as applied to OMI, TROPOMI, and similar instruments that are flying or will soon fly in geostationary orbit.

NO2↗

Variational Assimilation of Global Microwave Rainfall Retrievals: Physical and Dynamical Impact on GEOS Analyses and Forecasts

Global microwave rainfall retrievals from a 5-satellite constellation, including TMI from TRMM, SSWI from DMSP F13, F14 and F15, and AMSR-E from EOS-AQUA, are assimilated into the NASA Goddard Earth Observing System (GEOS) Data Assimilation System (DAS) using a 1-D variational continuous assimilation (VCA) algorithm. The physical and dynamical impact of rainfall assimilation on GEOS analyses and forecasts is examined at various temporal and spatial scales. This study demonstrates that the 1-D VCA algorithm, which was originally developed and evaluated for rainfall assimilations over tropical oceans, can effectively assimilate satellite microwave rainfall retrievals and improve GEOS analyses over both the Tropics and the extratropics where the atmospheric processes are dominated by different large-scale dynamics and moist physics, and also over the land, where rainfall estimates from passive microwave radiometers are believed to be less accurate. Results show that rainfall assimilation renders the GEOS analysis physically and dynamically more consistent with the observed precipitation at the monthly-mean and 6-hour time scales. Over regions where the model precipitation tends to misbehave in distinctly different rainy regimes, the 1-D VCA algorithm, by compensating for errors in the model s moist time-tendency in a 6-h analysis window, is able to bring the rainfall analysis closer to the observed. The radiation and cloud fields also tend to be in better agreement with independent satellite observations in the rainfall-assimilation m especially over regions where rainfall analyses indicate large improvements. Assimilation experiments with and without rainfall data for a midlatitude frontal system clearly indicates that the GEOS analysis is improved through changes in the thermodynamic and dynamic fields that respond to the rainfall assimilation. The synoptic structures of temperature, moisture, winds, divergence, and vertical motion, as well as vorticity are more realistically captured across the front. Short-term forecasts using initial conditions assimilated with rainfall data also show slight improvements. 1

Lin, Xin↗

Comparison of the MODIS Collection 5 Multilayer Cloud Detection Product with CALIPSO

CALIPSO, launched in June 2006, provides global active remote sensing measurements of clouds and aerosols that can be used for validation of a variety of passive imager retrievals derived from instruments flying on the Aqua spacecraft and other A-Train platforms. The most recent processing effort for the MODIS Atmosphere Team, referred to as the Collection 5 scream, includes a research-level multilayer cloud detection algorithm that uses both thermodynamic phase information derived from a combination of solar and thermal emission bands to discriminate layers of different phases, as well as true layer separation discrimination using a moderately absorbing water vapor band. The multilayer detection algorithm is designed to provide a means of assessing the applicability of 1D cloud models used in the MODIS cloud optical and microphysical product retrieval, which are generated at a 1 km resolution. Using pixel-level collocations of MODIS Aqua, CALIOP, we investigate the global performance of multilayer cloud detection algorithms (and thermodynamic phase).

Platnick, Steven↗

Fully Automated Detection of Cloud and Aerosol Layers in the CALIPSO Lidar Measurements

Accurate knowledge of the vertical and horizontal extent of clouds and aerosols in the earth s atmosphere is critical in assessing the planet s radiation budget and for advancing human understanding of climate change issues. To retrieve this fundamental information from the elastic backscatter lidar data acquired during the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) mission, a selective, iterated boundary location (SIBYL) algorithm has been developed and deployed. SIBYL accomplishes its goals by integrating an adaptive context-sensitive profile scanner into an iterated multiresolution spatial averaging scheme. This paper provides an in-depth overview of the architecture and performance of the SIBYL algorithm. It begins with a brief review of the theory of target detection in noise-contaminated signals, and an enumeration of the practical constraints levied on the retrieval scheme by the design of the lidar hardware, the geometry of a space-based remote sensing platform, and the spatial variability of the measurement targets. Detailed descriptions are then provided for both the adaptive threshold algorithm used to detect features of interest within individual lidar profiles and the fully automated multiresolution averaging engine within which this profile scanner functions. The resulting fusion of profile scanner and averaging engine is specifically designed to optimize the trade-offs between the widely varying signal-to-noise ratio of the measurements and the disparate spatial resolutions of the detection targets. Throughout the paper, specific algorithm performance details are illustrated using examples drawn from the existing CALIPSO dataset. Overall performance is established by comparisons to existing layer height distributions obtained by other airborne and space-based lidars.

Vaughan, Mark A.↗

A database system to support image algorithm evaluation

The design is given of an interactive image database system IMDB, which allows the user to create, retrieve, store, display, and manipulate images through the facility of a high-level, interactive image query (IQ) language. The query language IQ permits the user to define false color functions, pixel value transformations, overlay functions, zoom functions, and windows. The user manipulates the images through generic functions. The user can direct images to display devices for visual and qualitative analysis. Image histograms and pixel value distributions can also be computed to obtain a quantitative analysis of images.

Lien, Y. E.↗

Short timescale stability monitoring of GOES-16 visible channels based on daily inter-calibration events with VIIRS and MODIS

The CERES project uses geostationary (GEO) imager derived broadband fluxes to estimate the diurnal flux variations between the Terra (10:30 LT) and Aqua (1:30 LT) flux obs. The GEO derived cloud properties are utilized for narrowband to broadband and angular directional model (ADM) algorithms. The GEO imager channels are first inter-calibrated to the Aqua-MODIS C6.1 calibration reference to ensure that the retrieved clouds and fluxes will be consistent. The CERES project has a 2-month latency, all GEO, MODIS and VIIRS calibration anomalies must be identified and mitigated. Convert the monthly GEO ray-matching algorithm into a daily monitoring algorithm to catch any daily calibration anomalies.

geostationary sensor calibration↗

Ice-Over-Water Cloud Properties in an Artificial Neural Network Approach

Clouds are a crucial component of the atmospheric energy system, particularly the radiative balance within, above, and below the troposphere. The vertical distribution of cloud mass and phase determines layer heating rates, the loss of radiation to space, and the amount of radiative heating at the surface. Thus, it is important to know how clouds are distributed both vertically and horizontally at all times of day. Satellite remote sensing is the only approach available to monitor clouds day and night around the globe. In this paper several artificial neural network (ANN) algorithms, employing several Aqua MODIS infrared channels, profiles of relative humidity and temperature from GMAO numerical weather analyses, and the retrieved total cloud visible optical depth, are trained to detect multilayer ice-over-water cloud systems and to retrieve some of their properties as identified by a year of 2008 Aqua MODIS data matched with CloudSat and CALIPSO (CC) cloud profiles. The CC lidar and radar profiles provide the vertical structure that serves as output truth for the multilayer algorithm. The neural networks were trained using one year (2008) of cloud top height data from the CC dataset, with correlation around 0.94 (0.95) and MAE as low as 0.82 (0.81) km for nonpolar regions during the day (night). Applying the trained ANN to independent year 2009 MODIS data resulted in a combined ML and single layer hit rate of 86.4% (85.1%) for nonpolar regions during the day (night). Since the ANN is trained using near-nadir MODIS pixels, infrared radiance corrections were developed as a function of view zenith angle from MODIS and applied to off-nadir pixels when processing MODIS swath data. The multilayer amount derived with the ANN is relatively invariant with increasing view zenith angle compared to the multilayer amount without the corrections.

MODIS↗

Retrieval of vertical moisture profiles with microwave radiometry

A statistical correlation technique is applied to the retrieval of vertical moisture profiles from downlooking radiometric measurements of atmospheric radiation at microwave wavelengths. Only an optimum subset of available radiometer channels is selected for estimating water vapor at specific pressure levels. To test its validity the algorithm was applied, in a numerical experiment, to 50 independent tropical radiosondes over a sea surface. It was also used to retrieve continuous sequences of atmospheric moisture profiles from a set of data obtained with a 4-channel microwave radiometer carried aboard an aircraft over a land surface.

Kakar, R. K.↗

Reflectance model for quantifying chlorophyll a in the presence of productivity degradation products

A reflectance model developed to estimate chlorophyll a concentrations in the presence of marine colored dissolved organic matter, pheopigments, detritus, and bacteria is presented. Nomograms and lookup tables are generated to describe the effects of different mixtures of chlorophyll a and these degradation products on the R(412):R(443) and R(443):R(565) remote-sensing reflectance or irradiance reflectance ratios. These are used to simulate the accuracy of potential ocean color satellite algorithms, assuming that atmospheric effects have been removed. For the California Current upwelling and offshore regions, with chlorophyll a not greater than 1.3 mg/cu m, the average error for chlorophyll a retrievals derived from irradiance reflectance data for degradation product-rich areas was reduced from +/-61 percent to +/-23 percent by application of an algorithm using two reflectance ratios rather than the commonly used algorithm applying a single reflectance ratio.

Carder, K. L.↗

Comparison of the MODIS Multilayer Cloud Detection and Thermodynamic Phase Products with CALIPSO and CloudSat

CALIPSO and CloudSat, launched in June 2006, provide global active remote sensing measurements of clouds and aerosols that can be used for validation of a variety of passive imager retrievals derived from instruments flying on the Aqua spacecraft and other A-Train platforms. The most recent processing effort for the MODIS Atmosphere Team, referred to as the "Collection 5" stream, includes a research-level multilayer cloud detection algorithm that uses both thermodynamic phase information derived from a combination of solar and thermal emission bands to discriminate layers of different phases, as well as true layer separation discrimination using a moderately absorbing water vapor band. The multilayer detection algorithm is designed to provide a means of assessing the applicability of 1D cloud models used in the MODIS cloud optical and microphysical product retrieval, which are generated at a 1 h resolution. Using pixel-level collocations of MODIS Aqua, CALIOP, and CloudSat radar measurements, we investigate the global performance of the thermodynamic phase and multilayer cloud detection algorithms.

Platnick, Steven↗

Integrated Active Fire Retrievals and Biomass Burning Emissions Using Complementary Near-Coincident Ground, Airborne and Spaceborne Sensor Data

Ground, airborne and spaceborne data were collected for a 450 ha prescribed fire implemented on 18 October 2011 at the Henry W. Coe State Park in California. The integration of various data elements allowed near coincident active fire retrievals to be estimated. The Autonomous Modular Sensor-Wildfire (AMS) airborne multispectral imaging system was used as a bridge between ground and spaceborne data sets providing high quality reference information to support satellite fire retrieval error analyses and fire emissions estimates. We found excellent agreement between peak fire radiant heat flux data (less than 1% error) derived from near-coincident ground radiometers and AMS. Both MODIS and GOES imager active fire products were negatively influenced by the presence of thick smoke, which was misclassified as cloud by their algorithms, leading to the omission of fire pixels beneath the smoke, and resulting in the underestimation of their retrieved fire radiative power (FRP) values for the burn plot, compared to the reference airborne data. Agreement between airborne and spaceborne FRP data improved significantly after correction for omission errors and atmospheric attenuation, resulting in as low as 5 difference between AquaMODIS and AMS. Use of in situ fuel and fire energy estimates in combination with a collection of AMS, MODIS, and GOES FRP retrievals provided a fuel consumption factor of 0.261 kg per MJ, total energy release of 14.5 x 10(exp 6) MJ, and total fuel consumption of 3.8 x 10(exp 6) kg. Fire emissions were calculated using two separate techniques, resulting in as low as 15 difference for various species

airborne scanner↗