SEARCH · Search NASA

Results for “retrieval algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,603 records · Page 89

All sources NASA NTRS DOE OSTI

NASA NTRS1995

Infrared algorithm development for ocean observations

Efforts continue under this contract to develop algorithms for the computation of sea surface temperature (SST) from MODIS infrared retrievals. This effort includes radiative transfer modeling, comparison of in situ and satellite observations, development and evaluation of processing and networking methodologies for algorithm computation and data accession, evaluation of surface validation approaches for IR radiances, and participation in MODIS (project) related activities. Efforts in this contract period have focused on radiative transfer modeling, evaluation of atmospheric correction methodologies, involvement in field studies, production and evaluation of new computer networking strategies, and objective analysis approaches.

Brown, Otis B.↗

NASA NTRS2012

Cloud Screening and Quality Control Algorithm for Star Photometer Data: Assessment with Lidar Measurements and with All-sky Images

This paper presents the development and set up of a cloud screening and data quality control algorithm for a star photometer based on CCD camera as detector. These algorithms are necessary for passive remote sensing techniques to retrieve the columnar aerosol optical depth, delta Ae(lambda), and precipitable water vapor content, W, at nighttime. This cloud screening procedure consists of calculating moving averages of delta Ae() and W under different time-windows combined with a procedure for detecting outliers. Additionally, to avoid undesirable Ae(lambda) and W fluctuations caused by the atmospheric turbulence, the data are averaged on 30 min. The algorithm is applied to the star photometer deployed in the city of Granada (37.16 N, 3.60 W, 680 ma.s.l.; South-East of Spain) for the measurements acquired between March 2007 and September 2009. The algorithm is evaluated with correlative measurements registered by a lidar system and also with all-sky images obtained at the sunset and sunrise of the previous and following days. Promising results are obtained detecting cloud-affected data. Additionally, the cloud screening algorithm has been evaluated under different aerosol conditions including Saharan dust intrusion, biomass burning and pollution events.

data quality control algorithm↗

NASA NTRS1992

A physical split window technique for the retrieval of precipitable water from satellite measurements

The split-window precipitable water algorithm developed by Jedlovec (1987) is described, and its advantages are examined. In particular, it is noted that the algorithm can be applied to multispectral imaging data, available half-hourly from VAS; it uses only limited spatial averaging and can be applied to instruments that lack sounding channels. Here, previous work is reviewed, and the procedure is extended to the Advanced Very High Resolution Radiometer (AVHRR) and GOES-NEXT using simulated data. Root mean square errors for the simulated and actual retrievals are below +/- 5.8 mm. Of the instruments examined, AVHRR appears to have the greatest potential, with the rms errors below +/- 2.3 mm.

Guillory, Anthony R.↗

DOE OSTI2023

Cycle-by-cycle Delay Estimation at Signalized Intersections by using Machine Learning and Simulated Video Detection Data

Accurate estimation of delay is crucial for efficient traffic signal operations. Estimation of delay in the real-time manner using traditional loop detectors requires advanced detectors (in addition to stop-bar detection). In cases when this detection layout is not in place, delay estimates are approximated with a lower accuracy. Video detection is one of the most frequently deployed detection systems at signalized intersections in recent years. In most cases video detection operates in the same way as traditional inductive loops. However, when coupled with computer vision algorithms, video detection systems could be used to retrieve additional information (e.g., vehicular arrivals and departures) that cannot be taken out from the conventional systems (e.g., long stop-bar loop detectors). Although present for several decades, video detection data were not frequently examined for delay estimation purposes. In this study, we proposed a novel delay estimation model which can be developed with only data from stop-bar video detectors. Relevant data were collected from a simulation model of 11 signalized intersections at downtown Chattanooga, TN and processed to create needed inputs for model development. With the use of multigene genetic programming the authors developed a delay model that outperforms accuracy of multi regression model. Furthermore, authors evaluated the developed model by comparison with the other benchmark delay models, such as HCM and approach delay model. It was found that the developed MGGP delay model outperforms benchmark models for a wide range of traffic and signal operation conditions.

Erdagi, Ismet Goksad↗

DOE OSTI2025

Replacing non-biomedical concepts improves embedding of biomedical concepts

Embeddings are semantically meaningful representations of words in a vector space, commonly used to enhance downstream machine learning applications. Traditional biomedical embedding techniques often replace all synonymous words representing biological or medical concepts with a unique token, ensuring consistent representation and improving embedding quality. However, the potential impact of replacing non-biomedical concept synonyms has received less attention. Embedding approaches often employ concept replacement to replace concepts that span multiple words, such as non-small-cell lung carcinoma, with a single concept identifier (e.g., D002289). Also, all synonyms of each concept are merged into the same identifier. Here, we additionally leveraged WordNet to identify and replace sets of non-biomedical synonyms with their most common representatives. This combined approach aimed to reduce embedding noise from non-biomedical terms while preserving the integrity of biomedical concept representations. We applied this method to 1,055 biomedical concept sets representing molecular signatures or medical categories and assessed the mean pairwise distance of embeddings with and without non-biomedical synonym replacement. A smaller mean pairwise distance was interpreted as greater intra-cluster coherence and higher embedding quality. Embeddings were generated using the Word2Vec algorithm applied to a corpus of 10 million PubMed abstracts. Our results demonstrate that the addition of non-biomedical synonym replacement reduced the mean intra-cluster distance by an average of 8%, suggesting that this complementary approach enhances embedding quality. Future work will assess its applicability to other embedding techniques and downstream tasks. Python code implementing this method is provided under an open-source license.

algorithms↗

NASA NTRS1982

Inversion of data from diffraction-limited multiwavelength remote sensors. II - Nonlinear dependence of observables on the geophysical parameters

Linear shift-invariant spatial filtering is applied to inversion of radiometric measurements of the earth in both polarizations at the following frequencies: 6.6, 10.7, 18, 21, and 37 GHz. For purposes of radiative transfer calculations at these frequencies, the state of the ocean-atmosphere system is described by a seven-parameter model. The parameters are near-surface wind speed, sea surface temperature, integrated water vapor mass, scale height of water vapor in an exponential distribution, integrated liquid water mass, height of the liquid water, and characteristic drop radius in a Best (1950) drop size distribution. Also described is a spatial filtering algorithm by means of which geophysical parameters are retrieved from measurements made over the ocean by the scanning multichannel microwave radiometer on the Nimbus 7 satellite. The parameters here are near-surface wind speed, sea surface temperature, rain rate, integrated atmospheric water vapor content, and integrated liquid water content (including rain).

Rosenkranz, P. W.↗

NASA NTRS1989

MISR - A multiangle imaging spectroradiometer for geophysical and climatological research from EOS

The scientific objectives, instrument concept, and data plan for the multiangle imaging spectroradiometer (MISR), an experiment proposed for the EOS (Earth Observing System) mission, are described. MISR is a pushbroom imaging system designed to obtain continuous imagery of the sunlit Earth at four different view angles (25.8, 45.6, 60.0, and 72.5 deg relative to the vertical at the earth's surface), in both the forward and aftward directions relative to nadir, using eight separate cameras. Observations will be acquired in four spectral bands, centered at 440, 550, 670, and 860 nm. Data analysis algorithms will be applied to MISR imagery to retrieve the optical, geometric, and radiative properties of complex, three-dimensional scenes, such as aerosol-laden atmospheres above a heterogeneously reflecting surface, nonstratified cloud systems, and vegetation canopies. The MISR investigation will address a number of scientific questions concerning the climatic and ecological consequences of many natural and anthropogenic processes, and will furnish aerosol information necessary for atmospheric corrections of surface images.

Diner, David J.↗

NASA NTRS1991

An Object-oriented Query Processor that Produces Monotonically Improving Approximate Answers

The paper describes an object-oriented query processor that makes approximate answers available if there is not enough time to produce an exact answer or if part of the database is unavailable. The accuracy of the approximate result produces improves monotonically with the amount of data retrieved to produce the result. The query processing algorithm is based on an approximate relational data model and works within a standard relational algebra framework. The query processor maintains an object-oriented view on an underlying level and can be implemented on a relational database system with little change to the relational architecture. We show how a monotone query processing strategy can be implemented, making effective use of semantic information presented by the object-oriented view.

Vrbsky, S. V.↗

NASA NTRS2002

Seasonal Characteristics of Tropical Ozone Profiles using the SHADOZ Ozonesonde Data Set: Comparisons with TOMS Tropical Ozone Climatology

Advances in tropospheric ozone data products being developed for tropical and subtropical regions using TOMS (Total Ozone Mapping Spectrometer) and other satellites are motivating efforts to renew and expand the collection of balloon-borne ozonesonde observations. The SHADOZ (Southern Hemisphere ADditional OZonesondes) project is a web-based archive established since 1998. It's goals are to support validation of TOMS and SBUV (Solar Backscatter UV) satellite ozone measurements and to improve remote sensing techniques for estimating tropical and subtropical ozone. Profile data are taken from balloon-borne ozonesondes, currently at 11 stations coordinating weekly to bi-weekly launches. Station data are publically available at a central location via the internet: . Since the start of the project, the SHADOZ archive has accumulated over 1500 ozonesonde profiles. Data also includes measurements from various SHADOZ supported field campaigns, such as, the Indian Ocean Experiment (INDOEX), Sounding of Ozone and Water in the Equatorial Region (SOWER) and Aerosols99 Atlantic Cruise. Using data from the archive, profile climatologies from selected stations will be shown to 1/characterize the variability of tropospheric tropical ozone among stations, 2/illustrate the seasonal offsets with respect to the tropical profile used in the TOMS v7 algorithm, and 3/estimate the potential error in TOMS retrieval estimates of the tropospheric portion of the atmosphere.

Witte, J. C.↗

NASA NTRS2009

Discrete Fourier Transform Analysis in a Complex Vector Space

Alternative computational strategies for the Discrete Fourier Transform (DFT) have been developed using analysis of geometric manifolds. This approach provides a general framework for performing DFT calculations, and suggests a more efficient implementation of the DFT for applications using iterative transform methods, particularly phase retrieval. The DFT can thus be implemented using fewer operations when compared to the usual DFT counterpart. The software decreases the run time of the DFT in certain applications such as phase retrieval that iteratively call the DFT function. The algorithm exploits a special computational approach based on analysis of the DFT as a transformation in a complex vector space. As such, this approach has the potential to realize a DFT computation that approaches N operations versus Nlog(N) operations for the equivalent Fast Fourier Transform (FFT) calculation.

Dean, Bruce H.↗

NASA NTRS2011

Modeling the Height of Young Forests Regenerating from Recent Disturbances in Mississippi using Landsat and ICESat data

Many forestry and earth science applications require spatially detailed forest height data sets. Among the various remote sensing technologies, lidar offers the most potential for obtaining reliable height measurement. However, existing and planned spaceborne lidar systems do not have the capability to produce spatially contiguous, fine resolution forest height maps over large areas. This paper describes a Landsat-lidar fusion approach for modeling the height of young forests by integrating historical Landsat observations with lidar data acquired by the Geoscience Laser Altimeter System (GLAS) instrument onboard the Ice, Cloud, and land Elevation (ICESat) satellite. In this approach, "young" forests refer to forests reestablished following recent disturbances mapped using Landsat time-series stacks (LTSS) and a vegetation change tracker (VCT) algorithm. The GLAS lidar data is used to retrieve forest height at sample locations represented by the footprints of the lidar data. These samples are used to establish relationships between lidar-based forest height measurements and LTSS-VCT disturbance products. The height of "young" forest is then mapped based on the derived relationships and the LTSS-VCT disturbance products. This approach was developed and tested over the state of Mississippi. Of the various models evaluated, a regression tree model predicting forest height from age since disturbance and three cumulative indices produced by the LTSS-VCT method yielded the lowest cross validation error. The R(exp 2) and root mean square difference (RMSD) between predicted and GLAS-based height measurements were 0.91 and 1.97 m, respectively. Predictions of this model had much higher errors than indicated by cross validation analysis when evaluated using field plot data collected through the Forest Inventory and Analysis Program of USDA Forest Service. Much of these errors were due to a lack of separation between stand clearing and non-stand clearing disturbances in current LTSS-VCT products and difficulty in deriving reliable forest height measurements using GLAS samples when terrain relief was present within their footprints. In addition, a systematic underestimation of about 5 m by the developed model was also observed, half of which could be explained by forest growth that occurred between field measurement year and model target year. The remaining difference suggests that tree height measurements derived using waveform lidar data could be significantly underestimated, especially for young pine forests. Options for improving the height modeling approach developed in this study were discussed.

Li, Ainong↗

NASA NTRS2011

Cloud Detection with the Earth Polychromatic Imaging Camera (EPIC)

The Earth Polychromatic Imaging Camera (EPIC) on board the Deep Space Climate Observatory (DSCOVR) would provide a unique opportunity for Earth and atmospheric research due not only to its Lagrange point sun-synchronous orbit, but also to the potential for synergistic use of spectral channels in both the UV and visible spectrum. As a prerequisite for most applications, the ability to detect the presence of clouds in a given field of view, known as cloud masking, is of utmost importance. It serves to determine both the potential for cloud contamination in clear-sky applications (e.g., land surface products and aerosol retrievals) and clear-sky contamination in cloud applications (e.g., cloud height and property retrievals). To this end, a preliminary cloud mask algorithm has been developed for EPIC that applies thresholds to reflected UV and visible radiances, as well as to reflected radiance ratios. This algorithm has been tested with simulated EPIC radiances over both land and ocean scenes, with satisfactory results. These test results, as well as algorithm sensitivity to potential instrument uncertainties, will be presented.

Meyer, Kerry↗

NASA NTRS2013

Fuzzy Reasoning to More Accurately Determine Void Areas on Optical Micrographs of Composite Structures

Accomplishing the best-performing composite matrix (resin) requires that not only the processing method but also the cure cycle generate low-void-content structures. If voids are present, the performance of the composite matrix will be significantly reduced. This is usually noticed by significant reductions in matrix-dominated properties, such as compression and shear strength. Voids in composite materials are areas that are absent of the composite components: matrix and fibers. The characteristics of the voids and their accurate estimation are critical to determine for high performance composite structures. One widely used method of performing void analysis on a composite structure sample is acquiring optical micrographs or Scanning Electron Microscope (SEM) images of lateral sides of the sample and retrieving the void areas within the micrographs/images using an image analysis technique. Segmentation for the retrieval and subsequent computation of void areas within the micrographs/images is challenging as the gray-scaled values of the void areas are close to the gray-scaled values of the matrix leading to the need of manually performing the segmentation based on the histogram of the micrographs/images to retrieve the void areas. The use of an algorithm developed by NASA and based on Fuzzy Reasoning (FR) proved to overcome the difficulty of suitably differentiate void and matrix image areas with similar gray-scaled values leading not only to a more accurate estimation of void areas on composite matrix micrographs but also to a faster void analysis process as the algorithm is fully autonomous.

Dominquez, Jesus A.↗

NASA NTRS2021

Operational Detection of Sun Glints in DSCOVR EPIC Images

Satellite images often feature sun glints caused by the specular reflection of sunlight from water surfaces or from horizontally oriented ice crystals occurring in clouds. Such glints can prevent accurate retrievals of atmospheric and surface properties using existing algorithms, but the glints can also be used to infer more about the glint-causing objects—for example about the microphysical properties and radiative effects of ice clouds. This paper introduces the recently released operational glint product of the Earth Polychromatic Camera (EPIC) onboard the Deep Space Climate Observatory (DSCOVR) spacecraft. Most importantly, the paper describes the algorithm used for generating the key component of the new product: a glint mask indicating the presence of sun glint caused by the specular reflection of sunlight from ice clouds and smooth water surfaces. After describing the glint detection algorithm and glint product, the paper shows some examples of the detected glints and discusses some basic statistics of the glint population in a yearlong dataset of EPIC images. These statistics provide insights into the performance of glint detection and point toward possibilities for using the glint product to gain scientific insights about ice clouds and water surfaces.

DSCOVR↗

NASA NTRSDate not supplied

NASA’s Prototype Spectral Water Inversion Processor and Emulator (SWIPE): Towards Global Coastal and Inland Water Quality and Algal Biodiversity Monitoring

Degradation of Earth’s inland water resources due to anthropogenic perturbations and climate anomalies at both local and global scales continues to place human health at substantial risk. There is now a growing necessity to develop pragmatic approaches that allow timely and effective extrapolation of local processes, to spatially resolved global products, and to promote operational and sustainable resource policy management. This presentation will provide updates on NASA’s prototype open-source aquatic modeling platform, Spectral Water Inversion Processor and Emulator (SWIPE), which is a comprehensive, multi-faceted modeling platform for both forward and inverse modeling of diverse aquatic ecosystems from the benthos to top-of-atmosphere (TOA). SWIPE provides a cohesive application which leverages recent advancements in particle modeling, Big Data analytics, and machine learning to develop a high-fidelity synthetic training ground for sensitivity studies and algorithm development for multispectral or upcoming hyperspectral missions. Some of the prominent features of SWIPE to be discussed include: 1. Advanced hyperspectral modeling of globally diverse algal and non-algal particles using a novel two-layer coated sphere scattering model and radiative transfer modeling, 2. Massive, highly detailed synthetic spectral libraries of Analysis-Ready-Data (ARD) which include spectral libraries of particle microphysics, water biogeophysical and optical properties, as well as surface and TOA reflectances at 1 nm resolution, 3. An ensemble of pre-built analytic, machine learning, and deep learning inversion algorithms for various water quality and biodiversity related retrieval parameters and uncertainty quantification, 4. Sensor-agnostic water quality inversion at wide ranging spatial and spectral resolutions including a codebase for seamless application in the Google Earth Engine and NASA Earth Exchange (NEX) for planetary scale analysis. SWIPE will be a fully open-source platform based in python with comprehensive documentation, tutorials, and options for distributed computing on high performance computing clusters or on single, local machines. Further, we will discuss how we envision SWIPE contributing towards a global analysis of coastal and inland water quality dynamics.

top-of-atmosphere (TOA)↗

NASA NTRSDate not supplied

Analysis of CO Transport from Australia Fires and Its Impact to Ozone, Water Vapor and Clouds Using CrIS Single-Field-of-View Sounder Products and Other Remote Sensing and MERRA-2 Reanalysis Data

Australia’s unprecedented fire disasters at the end of 2019 to early 2020 emitted huge amounts of carbon monoxide (CO) and fire aerosol particles, and the long-range transport of the smoke plumes poses great impact to climate change, such as altering the Antarctic ozone (O3) hole. Spaceborne observations from satellites have been proven successful in monitoring CO from wildfires in the past decade and can be used to examine the associated CO transport. The primary remote sensing data used in this study is the Single Field of View (SFOV) Sounder Atmospheric Product (SiFSAP) derived from the Cross-track Infrared Sounder (CrIS) on SNPP, a new product that will be generated at NASA and released to the public in a few months. SiFSAP has a high spatial resolution of ~14 km and includes atmospheric profiles of temperature, water vapor, CO, O3, as well as cloud products, and as the SiFSAP algorithm performs both day- and night-time retrievals, it provides an additional observation for night-time in comparison to the day-time-only solar polar satellite instruments such as MOPPIT, OMPS, and TROPOMI. Most recent significant improvements in the quality of this product plus its good spatial resolution (better than most global weather and climate models) enable us to conduct process-oriented analysis of CO transport, and the variation of water vapor, O3 and clouds (optical depth, effective radius and cloud height) within and around the fire plumes. The wind fields from MERRA-2 reanalysis will be used to help characterize the transport. Other remote sensing data, such as CO from AIRS, MOPPIT and TROPOMI, O3 from OMPS and TROPOMI, as well as the UV aerosol index from OMI and OMPS, will be used and compared with SiFSAP sounder products. Cross-validation of CO and O3 from these different sensors with the corresponding MERRA-2 products will also be carried out. Along the plume transport path, some enhancement of O3 and correlation between fire aerosol, cloud optical depth and water vapor have been found but need further investigation. Using the transport of fire plumes over the Southern Pacific Ocean as a unique testbed, this study will demonstrate the trace species monitoring capability of current satellite observations, in particular, for CO and O3, and hopefully, it will provide some insight on the impacts on fire emissions on air quality and climate.

Xiaozhen (Shawn) Xiong↗

NASA NTRS2011

Estimation of Smoothing Error in SBUV Profile and Total Ozone Retrieval

Data from the Nimbus-4, Nimbus-7 Solar Backscatter Ultra Violet (SBUV) and seven of the NOAA series of SBUV/2 instruments spanning 41 years are being reprocessed using V8.6 algorithm. The data are scheduled to be released by the end of August 2011. An important focus of the new algorithm is to estimate various sources of errors in the SBUV profiles and total ozone retrievals. We discuss here the smoothing errors that describe the components of the profile variability that the SBUV observing system can not measure. The SBUV(/2) instruments have a vertical resolution of 5 km in the middle stratosphere, decreasing to 8 to 10 km below the ozone peak and above 0.5 hPa. To estimate the smoothing effect of the SBUV algorithm, the actual statistics of the fine vertical structure of ozone profiles must be known. The covariance matrix of the ensemble of measured ozone profiles with the high vertical resolution would be a formal representation of the actual ozone variability. We merged the MLS (version 3) and sonde ozone profiles to calculate the covariance matrix, which in general case, for single profile retrieval, might be a function of the latitude and month. Using the averaging kernels of the SBUV(/2) measurements and calculated total covariance matrix one can estimate the smoothing errors for the SBUV ozone profiles. A method to estimate the smoothing effect of the SBUV algorithm is described and the covariance matrixes and averaging kernels are provided along with the SBUV(/2) ozone profiles. The magnitude of the smoothing error varies with altitude, latitude, season and solar zenith angle. The analysis of the smoothing errors, based on the SBUV(/2) monthly zonal mean time series, shows that the largest smoothing errors were detected in the troposphere and might be as large as 15-20% and rapidly decrease with the altitude. In the stratosphere above 40 hPa the smoothing errors are less than 5% and between 10 and 1 hPa the smoothing errors are on the order of 1%. We validate our estimated smoothing errors by comparing the SBUV ozone profiles with other ozone profiling sensors.

Kramarova, N. A.↗

NASA NTRS2003

Soil Moisture Retrieval Through Changing Corn Using Active/Passive Microwave Remote Sensing

An extensive field experiment was conducted from May-early October, 2002 at the heavily instrumented USDA-ARS (U.S. Dept. of Agriculture-Agricultural Research Service) OPE3 (Optimizing Production Inputs for Economic and Environmental Enhancement) test site in Beltsville, MD to acquire data needed to address active/passive microwave algorithm, modeling, and ground validation issues for accurate soil moisture retrieval. During the experiment, a tower-mounted 1.4 GHz radiometer (Lrad) and a truck-mounted dual-frequency (1.6 and 4.75 GHz) radar system were deployed on the northern edge of the site. The soil in this portion of the field is a sandy loam (silt 23.5%, sand 60.3%, clay 16.1%) with a measured bulk density of 1.253 g/cu cm. Vegetation cover in the experiment consisted of a corn crop which was measured from just after planting on April 17, 2002 through senescence and harvesting on October 2. Although drought conditions prevailed during the summer, the corn yield was near average, with peak biomass reached in late July.

ONeill, P. E.↗