Search NASASearch

Engineering topics

Adam Thurston

Publications and source records attributed to Adam Thurston.

Developing a Spectral Correlation based Method for mitigating Angular Mismatch Effects in Intercalibration Using a Benchmark Hyperspectral Sensor

The CLARREO Pathfinder (CPF) mission will implement a state-of-the-art intercalibration method for transferring CPF’s in-orbit Système Internationale (SI)-traceable reference to the shortwave channel of the Clouds and the Earth’s Radiance Energy System (CERES) and the reflective solar bands of the Visible Infrared Imaging Radiometer Suite (VIIRS) aboard the NOAA-20 satellite platform with a targeted intercalibration methodology uncertainty of 0.3% (k=1). In order to achieve such a high intercalibration accuracy, the CPF intercalibration measurements to be scheduled need to closely match those from CERES and VIIRS in time, space, angles, and wavelength. Despite’s CPF’s two-axis pointing capability to match its boresight line of sight to that of a target sensor, there will be finite residual differences in angular samplings of the two instruments. The potential angular mismatch between CPF and the target sensors can introduce systematic errors in the intercalibration results, and therefore needs to be corrected using a rigorously designed algorithm. The CPF intercalibration team has been developing a correction method for mitigating the impact of these angular anisotropic effects in the CPF-VIIRS and CPF-CERES intercalibration. The method explores the spectral correlation relationship between the reflected solar radiances from the same surface target that would be measured by CPF at two adjacent angles. Our studies have shown that the spectral information based on CPF measurements can be used to accurately predict the spectral radiance or reflectance difference due to a given mismatch in the viewing and solar geometry. The hyper-spectral information can also be used to provide scene stratification without using any auxiliary data, which is critical to reduce the angular correction uncertainty. The angular correction relationship can be well established using simulated CPF-like top-of-atmosphere spectral radiances observed at all sorts of viewing geometry and solar angles and for different scenes. Intensive radiative transfer simulations have been completed using a state-of-art radiative transfer model developed by the CPF team members. The implementation of the algorithm on high-fidelity event simulation data and the characterization for the angular adjustment uncertainty will be presented.

Wan Wu

Earth Science Data Processing With Nextflow

Earth science data processing tasks present many challenges. These tasks often process large input datasets and require scores of CPU-hours to generate results. All but the simplest tasks will be decomposed into a series of computational or data manipulation steps, also known as a scientific workflow. In order to reduce the burden of orchestrating and running the dependent processing steps, a workflow execution engine is required. This poster describes the lessons learned by the CLARREO Pathfinder (CPF) team while developing multiple scientific workflows and utilizing the open-source Nextflow engine to execute them in a cloud computing environment. The Nextflow engine is designed with the following stated goals: first, the engine does not dictate how individual steps in the task are implemented (i.e. it is language and interface agnostic); second, the engine supports easy configuration and modularity at the workflow level so that others can easily execute our workflows to reproduce results; lastly, the engine eases development by transparently scaling execution from local to remote environments. Nextflow was developed for the bioinformatics domain but is a good fit for other scientific workflows where the overall task is well-described by a dataflow diagram. The CPF team has developed Nextflow pipelines (i.e. scientific workflows) to simulate CLARREO radiance, generate large look-up tables for inter-calibration algorithms, and generate L4 intercalibration data products. These pipelines consume from single-digits to hundreds of thousands of CPU-hours. In the development and evolution of these pipelines we have discovered many design patterns, pitfalls, and solutions to common problems. Our goal is to demonstrate important aspects of how to design, implement, run, and ultimately share Nextflow pipelines in the domain of Earth science.

Aron D Bartle

Leveraging ­ CPF Spectral Information for Effective Angular Corrections in Sensor Inter-calibration Studies

The Climate Absolute Radiance and Refractivity Observatory Pathfinder (CPF) mission will provide a high-accuracy (0.3% radiometric uncertainty at k=1) SI-traceable on-orbit calibration reference for sensor intercalibration in reflective solar spectral region. CPF inter-calibration algorithms have been developed to address various sampling differences between CPF and target sensors, particularly in spectral, angular, spatial and temporal domains. CPF provides unique hyper-spectral measurements that allow the utilization of rich spectral information for critical inter-calibration procedures including angular correction and spectral-gap filling. The angular correction scheme of CPF mission has been constructed based on the spectral correlation relationship between CPF observed spectra and the spectra to be measured at the viewing/sun geometry angles of target sensors. The angular correction relationship is both angular and scene dependent. The scene variability issue can impose undesired uncertainties that complicates the correction for those errors. We have demonstrated that hyper-spectral radiance information can be well utilized to identify different scene types associated with CPF observations. Using spectral radiances-based scene clustering analysis can greatly reduce the uncertainty associated with the angular correction algorithm. Additionally, a reliable quality control scheme has been established, utilizing spectral similarity and regression-prediction error analyses, to ensure the successful and efficient implementation of the angular correction method.

Wan Wu

The Spectral Information Based Angular Correction Methodology for Satellite Intercalibration Applications

Satellite inter-calibration often requires collocated observations with minimized discrepancies in sun-view angles, observation times, and sensor characteristics. The collocation criteria directly impact achievable inter-calibration accuracy. Addressing potential angular mismatches in inter-calibration samples is critical but not as fully recognized and addressed as spatial-temporal mismatches in many studies. To achieve high-accuracy corrections for errors due to mismatched sun-view geometry angles, an angular correction algorithm has been developed for the Climate Absolute Radiance and Refractivity Observatory Pathfinder (CPF) mission. This algorithm uses spectral correlation relationships to estimate differences in spectral radiances measured at different angles. This methodology can be extended for inter-calibrations between sensors measuring band radiances across a broad spectral region. We demonstrate its application in reducing angular mismatch errors between collocated measurements of multi-spectral imaging sensors, using the inter-calibration between the Moderate Resolution Imaging Spectrometer (MODIS) and the Visible Infrared Imaging Radiometer Suite (VIIRS) as an example. The angular correction allows for more relaxed collocation criteria so that more satellite-based inter-calibration samples can be utilized. Furthermore, implementing the angular correction algorithm improves inter-calibration accuracy in applications where angular mismatch errors have not been explicitly addressed previously.

Wan Wu