SEARCH · Search NASA

Results for “retrieval algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

Detecting Hail from Space: Algorithms, Climatologies, and Challenges Going Forward

In addition to the myriad threats that severe hailstorms pose to society, infrastructure and agriculture, severe hail is difficult to measure in situ, and surface-based hail reporting and detection methods are inconsistent and subject to geographical or societal biases. This motivates the use of spaceborne remote-sensing platforms to retrieve hail and construct climatologies in a globally uniform way. We have developed a hail detection algorithm that leverages the sensitivity of spaceborne passive-microwave radiometers to scattering by hail, particularly in the channels from 10 to 89 GHz. We use this retrieval to construct global climatologies of severe hail using several different spaceborne sensors: the Tropical Rainfall Measuring Mission (TRMM) Microwave Imager (TMI), Global Precipitation Measurement Mission (GPM) Microwave Imager, Advanced Microwave Scanning Radiometer for EOS (AMSR-E), and Advanced Microwave Scanning Radiometer 2 (AMSR2) sensors and are working to extend into the late 1980’s using the Special Sensor Microwave Imager/Sounder (SSMI/(S)) data. Using coincident Global Precipitation Measurement (GPM) Ku-band precipitation radar, we assessed this retrieval and several others in the literature for their effectiveness and regional variability. We developed a passive-microwave algorithm that corresponds tightly to radar reflectivity and gives the least appearance of regional biases compared to other passive-microwave approaches in the literature. Satellite platforms offer consistent observations, even in remote, data-sparse, and oceanic regions that ground-based networks exclude. There are, however, potential disconnects between the processes identified aloft by the satellite and the resultant weather at the ground, leading to uncertainties in the retrievals that may propagate into satellite-based climatologies, particularly in the Tropics, where there are abundant strong - but not necessarily hailing - storms that are strongly represented in the current satellite climatologies. We will discuss ongoing efforts to assess and mitigate the contributing factors to these uncertainties, chiefly among them the effects of non-uniform beam filling in the passive-microwave footprint, and the relationships between the size distributions of hailstones aloft and the dynamic processes and environments with which they interact throughout their trajectories.

Sarah D Bang↗

DOE OSTI2023

The Role of Mesoscale Cloud Morphology in the Shortwave Cloud Feedback

A supervised neural network algorithm is used to categorize near-global satellite retrievals into three mesoscale cellular convective (MCC) cloud morphology patterns. At constant cloud amount, morphology patterns differ in brightness associated with the amount of optically thin cloud features. Environmentally driven transitions from closed MCC to other morphology patterns, typically accompanied by more optically thin cloud features, are used as a framework to quantify the morphology contribution to the optical depth component of the shortwave cloud feedback. A marine heat wave is used as an out-of-sample test of closed MCC occurrence predictions. Morphology shifts in optical depth between 65°S and 65°N under projected environmental changes (i.e., from an abrupt quadrupling of CO 2 ) assuming constant cloud cover contributes between 0.04 and 0.07 W m -2 K -1 (aggregate of 0.06) to the global mean cloud feedback.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Peak Rain Rate Sensitivity to Observed Cloud Condensation Nuclei and Turbulence in Continental Warm Shallow Clouds During CACTI

Abstract Warm clouds strongly affect Earth's energy budget but remain imperfectly represented in climate models, partly due to the complexity and covariability of relevant processes influencing warm rain. This work presents a detailed analysis of different factors affecting rain rate peak intensity (RR) in continental warm clouds. Clouds were identified with vertically pointing radar and lidar observations and categorized via a temperature‐based cloud type classification algorithm from which warm clouds were isolated. Observations and retrievals of liquid water path (LWP), cloud condensation nuclei concentration (N CCN ), cloud depth, and cloud duration of more than 3,000 separate warm clouds sampled during the Cloud, Aerosol, and Complex Terrain Interactions (CACTI) field campaign are analyzed in this work. Multiple linear regression (MLR) and random forest (RF) models are applied to assess the relative impact of these variables on RR. Overall, RR tends to increase as cloud depth, LWP, and cloud duration increase, or N CCN decreases. Cloud depth affects RR the most while N CCN impacts it the least. When considering over 170 warm clouds observed at least 1 hr in which in‐cloud turbulence is retrieved, the effect of N CCN on RR remains most likely suppressive, but it is not significant at a 75% level for MLR and is highly uncertain for RF. The impact of in‐cloud turbulence depends on the moment and location it is sampled. Cloud base turbulence around the time of RR suppresses RR, while cloud top turbulence effects are inconclusive. Possible difficulties in isolating robust CCN and turbulence effects on RR are discussed.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Updates to the ATLAS Data Carousel Project

The High Luminosity upgrade to the LHC (HL-LHC) is expected to deliver scientific data at the multi-exabyte scale. In order to address this unprecedented data storage challenge, the ATLAS experiment launched the Data Carousel project in 2018. Data Carousel is a tape-driven workflow whereby bulk production campaigns with input data resident on tape are executed by staging and promptly processing a sliding window to disk buffer such that only a small fraction of inputs are pinned on disk at any one time. Data Carousel is now in production for ATLAS in Run3. In this paper, we provide updates on recent Data Carousel R&D projects, including data-on-demand and tape smart writing. Data-on-demand removes from disk data that has not been accessed for a predefined period, when users request them, they will be either staged from tape or recreated by following the original production steps. Tape smart writing employs intelligent algorithms for file placement on tape in order to retrieve data back more efficiently, which is our long term strategy to achieve optimal tape usage in Data Carousel.

42 ENGINEERING↗

DOE OSTI2020

Efficient numerical methods to solve sparse linear equations with application to PageRank

Over the last two decades, the PageRank problem has received increased interest from the academic community as an efficient tool to estimate web-page importance in information retrieval. Despite numerous developments, the design of efficient optimization algorithms for the PageRank problem is still a challenge. Here, we propose three new algorithms with a linear time complexity for solving the problem over a bounded-degree graph. The idea behind them is to set up the PageRank as a convex minimization problem over a unit simplex, and then solve it using iterative methods with small iteration complexity. Our theoretical results are supported by an extensive empirical justification using real-world and simulated data.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2019

Atmospheric Emitted Radiance Interferometer Optimal Estimation (AERIoe) Value-Added Product Report

The Atmospheric Emitted Radiance Interferometer (AERI) Optimal Estimation (AERIoe) algorithm (Turner and Löhnert 2014, Turner and Blumberg 2019) retrieves profiles of temperature and water vapor mixing ratio, together with cloud properties for a single-layer cloud (i.e., liquid water path [LWP], effective radius), from AERI-observed infrared radiance spectrum and other measurements. The data can be used to characterize the evolution of the planetary boundary layer and boundary-layer clouds.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2019

Atmospheric Emitted Radiance Interferometer Optimal Estimation (AERIoe) Value-Added Product Report

The Atmospheric Emitted Radiance Interferometer (AERI) Optimal Estimation (AERIoe) algorithm (Turner and Löhnert 2014, Turner and Blumberg 2019) retrieves boundary-layer profiles of temperature and water vapor mixing ratio, together with cloud properties for a single-layer cloud (i.e., LWP, effective radius), from AERI-observed infrared radiance spectra and other measurements. The current AERIoe Value-Added Product (VAP) uses version 2.8 of David Turner's code, which uses additional inputs to constrain the retrieval including surface meteorology, microwave radiometer brightness temperatures at any number of frequencies (the U.S. Department of Energy Atmospheric Radiation Measurement [ARM] user facility typically used observations at 23.8 and 30.0 GHz), and Rapid Refresh numerical weather prediction model output. The method is a physical iterative retrieval that uses the optimal estimation framework (Rodgers 2000), so a full error covariance of the solution and the information content (in the form of degrees of freedom for signal) is provided for each retrieval.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1987

A method for remote sensing the emissivity, fractional cloud cover and cloud top temperature of high-level, thin clouds

A methodology for retrieving the emissivity, cloud cover and cloud top temperature of high-level, thin clouds is developed and described. In the thermal infrared windows, the outgoing radiances from the earth's atmosphere contain information about cloud emissivity and cloud top temperature. This information is clearly demonstrated in the brightness temperature difference curves of two window channels. For the purpose of illustration, two window channels centered at 810 and 930 cm are chosen to construct the brightness temperature difference curves for a range of cloud top temperatures. These curves vary for different cloud top temperatures, and along each of these curves the emissivity changes. The brightness temperature difference method is used in a simulation study to demonstrate the feasibility of retrieving the cloud top temperature and emissivity by the utilization of measurements in two window channels. As expected, a perfect retrieval is found if perfect measurements and ideal atmospheric conditions are assumed. If a random error, which has a normal distribution with a mean of zero and standard deviation of + or - 0.5 C, is imposed to the measurements, a reasonable retrieval is found for emissivity greater than 0.3. The algorithm has been applied to a limited amount of HIRS2 data, which has 3.7, 3.98 and 11 micron channels. The cloud top temperature, emissivity and cloud cover are determined by using these channels.

Wu, Man-Li C.↗

NASA NTRS1992

Inversion of snow parameters by neural network with iterative inversion

The inversion of snow parameters from passive microwave remote sensing measurements is performed with a neural network trained with a dense media multiple scattering model. A constrained iterative inversion scheme is used. Inversion of four parameters is performed from five brightness temperatures. The four parameters are: mean grain size of ice particles in snow, snow density, snow temperature, and snow depth. The five brightness temperatures are that of 19-GHz vertical polarization, 19-GHz horizontal polarization, 22-GHz vertical polarization, 37-GHz vertical polarization, and 37-GHz horizontal polarization. Based on the neural network constrained iterative inversion algorithm, synthetic mapping of the terrain is performed. The retrieval of synthetic mapping has been achieved. The incorporation of ground truth information is considered.

Chen, Zhengxiao↗

NASA NTRS2003

Bio-Optical and Remote Sensing Observations in Chesapeake Bay

The high temporal and spatial resolution of satellite ocean color observations will prove invaluable for monitoring the health of coastal ecosystems where physical and biological variability demands sampling scales beyond that possible by ship. However, ocean color remote sensing of Case 2 waters is a challenging undertaking due to the optical complexity of the water. The focus of this SIMBIOS support has been to provide in situ optical measurements from Chesapeake Bay (CB) and adjacent mid-Atlantic bight (MAB) waters for use in algorithm development and validation efforts to improve the satellite retrieval of chlorophyll (chl a) in Case 2 waters. CB provides a valuable site for validation of data from ocean color sensors for a number of reasons. First, the physical dimensions of the Bay (> 6,500 km2) make retrievals from satellites with a spatial resolution of approx. 1 km (i.e., SeaWiFS) or less (i.e., MODIS) reasonable for most of the ecosystem. Second, CB is highly influenced by freshwater flow from major rivers, making it a classic Case 2 water body with significant concentrations of chlorophyll, particulates and chromophoric dissolved organic matter (CDOM) that highly impact the shape of reflectance spectra.

Harding, Lawrence W., Jr.↗

NASA NTRS2004

Evaluation and Validation of Case 2 Algorithms in Chesapeake Bay

The high temporal and spatial resolution of satellite ocean color observations will prove invaluable for monitoring the health of coastal ecosystems where physical and biological variability demands sampling scales beyond that possible by ship. However, ocean color remote sensing of Case 2 waters is a challenging undertaking due to the optical complexity of the water. The focus of this SIMBIOS support has been to provide in situ optical measurements form Chesapeake Bay (CB) and adjacent mid-Atlantic bight (MAB) waters for use in algorithm development and validation efforts to improve the satellite retrieval of chlorophyll (chl a) in Case 2 waters. CB provides a valuable site for validation of data from ocean color sensors for a number of reasons. First, the physical dimensions of the Bay (greater than 6,500 square kilometers) make retrievals from satellites with a spatial resolution of approximately 1 kilometer (i.e., SeaWiFS) or less (i.e., MODIS) reasonable for most of the ecosystem. Second, CB is highly influenced by freshwater flow from major rivers, making it a classic Case 2 water body with significant concentrations of chlorophyll, particulates and chromophoric dissolved organic matter (CDOM) that highly impact the shape of reflectance spectra. Finally, past and ongoing research efforts provided an expensive data set of optical observations that support the goal of this project.

Harding, Lawrence W., Jr.↗

NASA NTRS2004

The Geostationary Operational Environmental Satellite (GOES) Product Generation System

The Geostationary Operational Environmental Satellite (GOES) Product Generation System (GPGS) is introduced and described. GPGS is a set of computer programs developed and maintained at the Global Hydrology and Climate Center and is designed to generate meteorological data products using visible and infrared measurements from the GOES-East Imager and Sounder instruments. The products that are produced by GPGS are skin temperature, total precipitable water, cloud top pressure, cloud albedo, surface albedo, and surface insolation. A robust cloud mask is also generated. The retrieval methodology for each product is described to include algorithm descriptions and required inputs and outputs for the programs. Validation is supplied where applicable.

Haines, S. L.↗

NASA NTRS2008

Adaptive MGS Phase Retrieval

Adaptive MGS Phase Retrieval software uses the Modified Gerchberg-Saxton (MGS) algorithm, an image-based sensing method that can turn any focal plane science instrument into a wavefront sensor, avoiding the need to use external metrology equipment. Knowledge of the wavefront enables intelligent control of active optical systems.

Basinger, Scott A.↗

NASA NTRS2010

Flash-Type Discrimination

This viewgraph presentation describes the significant progress made in the flash-type discrimination algorithm development. The contents include: 1) Highlights of Progress for GLM-R3 Flash-Type discrimination Algorithm Development; 2) Maximum Group Area (MGA) Data; 3) Retrieval Errors from Simulations; and 4) Preliminary Global-scale Retrieval.

Koshak, William J.↗

NASA NTRS2012

Calibration and Image Reconstruction for the Hurricane Imaging Radiometer (HIRAD)

The Hurricane Imaging Radiometer (HIRAD) is a new airborne passive microwave synthetic aperture radiometer designed to provide wide swath images of ocean surface wind speed under heavy precipitation and, in particular, in tropical cyclones. It operates at 4, 5, 6 and 6.6 GHz and uses interferometric signal processing to synthesize a pushbroom imager in software from a low profile planar antenna with no mechanical scanning. HIRAD participated in NASA s Genesis and Rapid Intensification Processes (GRIP) mission during Fall 2010 as its first science field campaign. HIRAD produced images of upwelling brightness temperature over a aprox 70 km swath width with approx 3 km spatial resolution. From this, ocean surface wind speed and column averaged atmospheric liquid water content can be retrieved across the swath. The calibration and image reconstruction algorithms that were used to verify HIRAD functional performance during and immediately after GRIP were only preliminary and used a number of simplifying assumptions and approximations about the instrument design and performance. The development and performance of a more detailed and complete set of algorithms are reported here.

Ruf, Christopher↗

NASA NTRS2013

Continental-Scale Mapping of Adelie Penguin Colonies from Landsat Imagery

Breeding distribution of the Adlie penguin, Pygoscelis adeliae, was surveyed with Landsat-7 Enhanced Thematic Mapper Plus (ETM+) data in an area covering approximately 330 of longitude along the coastline of Antarctica.An algorithm was designed to minimize radiometric noise and to retrieve Adlie penguin colony location and spatial extent from the ETM+data. In all, 9143 individual pixels were classified as belonging to an Adlie penguin colony class out of the entire dataset of 195 ETM+ scenes, where the dimension of each pixel is 30 m by 30 m,and each scene is approximately 180 km by 180 km. Pixel clustering identified a total of 187 individual Adlie penguin colonies, ranging in size from a single pixel (900 sq m) to a maximum of 875 pixels (0.788 sq km). Colony retrievals have a very low error of commission, on the order of 1% or less, and the error of omission was estimated to be 3% to 4% by population based on comparisons with direct observations from surveys across east Antarctica. Thus, the Landsat retrievals successfully located Adlie penguin colonies that accounted for 96 to 97% of the regional population used as ground truth. Geographic coordinates and the spatial extent of each colony retrieved from the Landsat data are available publically. Regional analysis found several areas where the Landsat retrievals suggest populations that are significantly larger than published estimates. Six Adlie penguin colonies were found that are believed to be previously unreported in the literature.

radiometric noise↗

NASA NTRS2017

SNPP VIIRS RSB Earth View Reflectance Uncertainty

The Visible Infrared Imaging Radiometer Suite (VIIRS) on the Suomi National Polar-orbiting Partnership (SNPP) satellite uses its 14 reflective solar bands to passively collect solar radiant energy reflected off the Earth. The Level 1 product is the geolocated and radiometrically calibrated top-of- the-atmosphere solar reflectance. The absolute radiometric uncertainty associated with this product includes contributions from the noise associated with measured detector digital counts and the radiometric calibration bias. Here, we provide a detailed algorithm for calculating the estimated standard deviation of the retrieved top-of-the-atmosphere spectral solar radiation reflectance.

VIIRS↗

NASA NTRS2022

Robustness of Vegetation Optical Depth Retrievals Based on L-Band Global Radiometry

Microwave vegetation optical depth (VOD) and soil moisture (SM) can be simultaneously retrieved based on L-band radiometry with polarization information. VOD is indicative of the vegetation water content (VWC) because it captures the extinction of land surface emission. If the connectivity of VOD to VWC is robust, the pair of VWC-SM observations can be viable bases for understanding soil–plant–atmosphere water relations, providing new perspectives on ecosystem science. Simultaneous SM–VOD retrievals are feasible by inverting the τ−ω model with two independent datasets in dual-channel algorithms. However, given correlated satellite vertical and horizontal brightness temperatures (TBs; TB v and TB h ), an ill-posed inverse problem arises where TB errors result in high uncertainties of retrievals. In this study, we apply the degrees-of-information (DoI) metric and propose a signal-to-noise ratio (SNR) metric to assess the “retrievability” of VOD given the Soil Moisture Active Passive (SMAP) TB v –TB h linear dependence. The application of these metrics allows determining where the VOD retrievals are robust and reliable. This is a necessary step in supporting the applications of VOD in ecology and hydrology. Results show that regions with mainly nonwoody vegetation have the best potential for VOD retrievals, though regularization is necessary. We then assess VOD time variations from two regularization products that reduce the impact of underdetermined inversions: the L3 dual-channel algorithm (L3-DCA) and the multitemporal dual-channel algorithm (MTDCA), which constrain VOD time dynamics with and without using a priori VOD climatology, respectively. Though they both reduce noise, especially in the VOD retrievals, they result in differences in VOD seasonal amplitude and coupling to SM at high frequencies as we outline here.

Microwave↗