Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical Algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

The SMAP Mission Combined Active-Passive Soil Moisture Product at 9 Km and 3 Km Spatial Resolutions

The NASA Soil Moisture Active Passive (SMAP) mission was launched on January 31st, 2015. The spacecraft was to provide high-resolution (3 km and 9 km) global soil moisture estimates at regular intervals by combining for the first time L-band radiometer and radar observations. On July 7th, 2015, a component of the SMAP radar failed and the radar ceased operation. However, before this occurred the mission was able to collect and process ~2.5 months of the SMAP high-resolution active-passive soil moisture data (L2SMAP) that coincided with the Northern Hemisphere's vegetation green-up and crop growth season. In this study, we evaluate the SMAP high-resolution soil moisture product derived from several alternative algorithms against in situ data from core calibration and validation sites (CVS), and sparse networks. The baseline algorithm had the best comparison statistics against the CVS and sparse networks. The overall unbiased root-mean-square-difference is close to the 0.04 cu. m/cu. m the SMAP mission requirement. A 3 km spatial resolution soil moisture product was also examined. This product had an unbiased root-mean-square-difference of ~0.053 cu. m/cu. m. The SMAP L2SMAP product for ~2.5 months is now validated for use in geophysical applications and research and available to the public through the NASA Distributed Active Archive Center (DAAC) at the National Snow and Ice Data Center (NSIDC). The L2SMAP product is packaged with the geo-coordinates, acquisition times, and all requisite ancillary information. Although limited in duration, SMAP has clearly demonstrated the potential of using a combined L-band radar-radiometer for proving high spatial resolution and accurate global soil moisture.

high resolution soil moisture↗

Atmospheric Correction of Satellite Ocean-Color Imagery During the PACE Era

The Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission will carry into space the Ocean Color Instrument (OCI), a spectrometer measuring at 5 nm spectral resolution in the ultraviolet (UV) to near infrared (NIR) with additional spectral bands in the shortwave infrared (SWIR), and two multi-angle polarimeters that will overlap the OCI spectral range and spatial coverage, i. e., the Spectrometer for Planetary Exploration (SPEXone) and the Hyper-Angular Rainbow Polarimeter (HARP2). These instruments, especially when used in synergy, have great potential for improving estimates of water reflectance in the post Earth Observing System (EOS) era. Extending the top-of-atmosphere (TOA) observations to the UV, where aerosol absorption is effective, adding spectral bands in the SWIR, where even the most turbid waters are black and sensitivity to the aerosol coarse mode is higher than at shorter wavelengths, and measuring in the oxygen A-band to estimate aerosol altitude will enable greater accuracy in atmospheric correction for ocean color science. The multi-angular and polarized measurements, sensitive to aerosol properties (e.g., size distribution, index of refraction), can further help to identify or constrain the aerosol model, or to retrieve directly water reflectance. Algorithms that exploit the new capabilities are presented, and their ability to improve accuracy is discussed. They embrace a modern, adapted heritage two-step algorithm and alternative schemes (deterministic, statistical) that aim at inverting the TOA signal in a single step. These schemes, by the nature of their construction, their robustness, their generalization properties, and their ability to associate uncertainties, are expected to become the new standard in the future. A strategy for atmospheric correction is presented that ensures continuity and consistency with past and present ocean-color missions while enabling full exploitation of the new dimensions and possibilities. Despite the major improvements anticipated with the PACE instruments, gaps/issues remain to be filled/tackled. They include dealing properly with whitecaps, taking into account Earth-curvature effects, correcting for adjacency effects, accounting for the coupling between scattering and absorption, modeling accurately water reflectance, and acquiring a sufficiently representative dataset of water reflectance in the UV to SWIR. Dedicated efforts, experimental and theoretical, are in order to gather the necessary information and rectify inadequacies. Ideas and solutions are put forward to address the unresolved issues. Thanks to its design and characteristics, the PACE mission will mark the beginning of a new era of unprecedented accuracy in ocean-color radiometry from space.

Robert J Frouin↗

Atmospheric Correction of Satellite Ocean-Color Imagery During the PACE Era

The Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission will carry into space the Ocean Color Instrument (OCI), a spectrometer measuring at 5 nm spectral resolution in the ultraviolet (UV) to near infrared (NIR) with additional spectral bands in the shortwave infrared (SWIR), and two multi-angle polarimeters that will overlap the OCI spectral range and spatial coverage, i. e., the Spectrometer for Planetary Exploration (SPEXone) and the Hyper-Angular Rainbow Polarimeter (HARP2). These instruments, especially when used in synergy, have great potential for improving estimates of water reflectance in the post Earth Observing System (EOS) era. Extending the top-of-atmosphere (TOA) observations to the UV, where aerosol absorption is effective, adding spectral bands in the SWIR, where even the most turbid waters are black and sensitivity to the aerosol coarse mode is higher than at shorter wavelengths, and measuring in the oxygen A-band to estimate aerosol altitude will enable greater accuracy in atmospheric correction for ocean color science. The multi-angular and polarized measurements, sensitive to aerosol properties (e.g., size distribution, index of refraction), can further help to identify or constrain the aerosol model, or to retrieve directly water reflectance. Algorithms that exploit the new capabilities are presented, and their ability to improve accuracy is discussed. They embrace a modern, adapted heritage two-step algorithm and alternative schemes (deterministic, statistical) that aim at inverting the TOA signal in a single step. These schemes, by the nature of their construction, their robustness, their generalization properties, and their ability to associate uncertainties, are expected to become the new standard in the future. A strategy for atmospheric correction is presented that ensures continuity and consistency with past and present ocean-color missions while enabling full exploitation of the new dimensions and possibilities. Despite the major improvements anticipated with the PACE instruments, gaps/issues remain to be filled/tackled. They include dealing properly with whitecaps, taking into account Earth-curvature effects, correcting for adjacency effects, accounting for the coupling between scattering and absorption, modeling accurately water reflectance, and acquiring a sufficiently representative dataset of water reflectance in the UV to SWIR. Dedicated efforts, experimental and theoretical, are in order to gather the necessary information and rectify inadequacies. Ideas and solutions are put forward to address the unresolved issues. Thanks to its design and characteristics, the PACE mission will mark the beginning of a new era of unprecedented accuracy in ocean-color radiometry from space.

ocean color↗

Merging of the Case 2 Regional Coast Colour and Maximum‑Peak Height Chlorophyll‑a Algorithms: Validation and Demonstration of Satellite‑derived Retrievals Across US Lakes

Water quality monitoring is relevant for protecting the designated, or beneficial uses, of water such as drinking, aquatic life, recreation, irrigation, and food supply that support the economy, human well-being, and aquatic ecosystem health. Managing finite water resources to support these designated uses requires information on water quality so that managers can make sustainable decisions. Chlorophyll-a (chl-a, µg L−1) concentration can serve as a proxy for phytoplankton biomass and may be used as an indicator of increased anthropogenic nutrient stress. Satellite remote sensing may present a complement to in situ measures for assessments of water quality through the retrieval of chl-a with in-water algorithms. Validation of chl-a algorithms across US lakes improves algorithm maturity relevant for monitoring applications. This study compares performance of the Case 2 Regional Coast Colour (C2RCC) chl-a retrieval algorithm, a revised version of the Maximum-Peak Height (MPH(P)) algorithm, and three scenarios merging these two approaches. Satellite data were retrieved from the MEdium Resolution Imaging Spectrometer (MERIS) and the Ocean and Land Colour Instrument (OLCI), while field observations were obtained from 181 lakes matched with U.S. Water Quality Portal chl-a data. The best performance based on mean absolute multiplicative error (MAEmult) was demonstrated by the merged algorithm referred to as C15−M10 (MAEmult = 1.8, biasmult = 0.97, n = 836). In the C15−M10 algorithm, the MPH(P) chl-a value was retained if it was > 10 µg L−1; if the MPH(P) value was ≤ 10 µg L−1, the C2RCC value was selected, as long as that value was < 15 µg L−1. Time-series and lake-wide gradients compared against independent assessments from Lake Champlain and long-term ecological research stations in Wisconsin were used as complementary examples supporting water quality reporting requirements. Trophic state assessments for Wisconsin lakes provided examples in support of inland water quality monitoring applications. This study presents and assesses merged adaptations of chl-a algorithms previously reported independently. Additionally, it contributes to the transition of chl-a algorithm maturity by quantifying error statistics for a number of locations and times.

Satellite↗

Probabilistic Processing of Asynchronous Geiger-Mode Avalanche Photodiode Arrays for Background Rate Measurements

A system-level performance evaluation of Geiger-mode avalanche photodiode (GmAPD) arrays requires accurate measurement and prediction of the background rate of the device due to dark counts and other spurious detection events. Since a GmAPD detector reports only a binary value and timestamp associated with an avalanche event, dark count rates are typically measured by averaging thousands of frames to support a statistically significant measurement. For both synchronous and asynchronous detector, the Poisson distributed background rates are referenced to the time each pixel is armed. Unlike for synchronous GmAPD imagers where all the pixels are armed to an array-wide arm signal, an asynchronous pixel operates independently from its neighboring pixels; requiring the background rates to be calculated using an interarrival histogram. For both types of imagers, the background rate is typically evaluated by fitting an exponential distribution to a fixed window within a measured histogram of time intervals between detection events However, if the statistics of the background rate are insufficient – whether that is due to low population sizes, saturation, or a large dynamic range of population size across the array, the pixel, or array-wide, performance metrics may report results with varying accuracy. This paper reports on an implementation of an algorithm that evaluates GmAPD background rates based on statistical metrics rather than fixed windows. The algorithm functions by determining the appropriate integration window within the interarrival time histogram based on a per-pixel count rate set by a predetermined tolerable measurement error. The implementation of the algorithm allows us to characterize GmAPD arrays with orders of magnitude spread in background rates across the detector using common statistical parameters.

Mumolo, J.↗

Kerr Reservoir LANDSAT experiment analysis for November 1980

An experiment was conducted on the waters of Kerr Reservoir to determine if reliable algorithms could be developed that relate water quality parameters to remotely sensed data. LANDSAT radiance data was used in the analysis since it is readily available and covers the area of interest on a regular basis. By properly designing the experiment, many of the unwanted variations due to atmosphere, solar, and hydraulic changes were minimized. The algorithms developed were constrained to satisfy rigorous statistical criteria before they could be considered dependable in predicting water quality parameters. A complete mix of different types of algorithms using the LANDSAT bands was generated to provide a thorough understanding of the relationships among the data involved. The study demonstrated that for the ranges measured, the algorithms that satisfactorily represented the data are mostly linear and only require a maximum of one or two LANDSAT bands. Rationing techniques did not improve the results since the initial design of the experiment minimized the errors that this procedure is effective against. Good correlations were established for inorganic suspended solids, iron, turbidity, and secchi depth.

Lecroy, S. R.↗

Multilayer Cloud Detection with the MODIS Near-Infrared Water Vapor Absorption Band

Data Collection 5 processing for the Moderate Resolution Imaging Spectroradiometer (MODIS) onboard the NASA Earth Observing System EOS Terra and Aqua spacecraft includes an algorithm for detecting multilayered clouds in daytime. The main objective of this algorithm is to detect multilayered cloud scenes, specifically optically thin ice cloud overlying a lower-level water cloud, that presents difficulties for retrieving cloud effective radius using single layer plane-parallel cloud models. The algorithm uses the MODIS 0.94 micron water vapor band along with CO2 bands to obtain two above-cloud precipitable water retrievals, the difference of which, in conjunction with additional tests, provides a map of where multilayered clouds might potentially exist. The presence of a multilayered cloud results in a large difference in retrievals of above-cloud properties between the CO2 and the 0.94 micron methods. In this paper the MODIS multilayered cloud algorithm is described, results of using the algorithm over example scenes are shown, and global statistics for multilayered clouds as observed by MODIS are discussed. A theoretical study of the algorithm behavior for simulated multilayered clouds is also given. Results are compared to two other comparable passive imager methods. A set of standard cloudy atmospheric profiles developed during the course of this investigation is also presented. The results lead to the conclusion that the MODIS multilayer cloud detection algorithm has some skill in identifying multilayered clouds with different thermodynamic phases

Wind, Galina↗

A cloud and radiation model-based algorithm for rainfall retrieval from SSM/I multispectral microwave measurements

A hybrid statistical-physical retrieval scheme is explored which combines a statistical approach with an approach based on the development of cloud-radiation models designed to simulate precipitating atmospheres. The algorithm employs the detailed microphysical information from a cloud model as input to a radiative transfer model which generates a cloud-radiation model database. Statistical procedures are then invoked to objectively generate an initial guess composite profile data set from the database. The retrieval algorithm has been tested for a tropical typhoon case using Special Sensor Microwave/Imager (SSM/I) data and has shown satisfactory results.

Xiang, Xuwu↗

Flexible Wing Base Micro Aerial Vehicles: Vision-Guided Flight Stability and Autonomy for Micro Air Vehicles

Substantial progress has been made recently towards design building and test-flying remotely piloted Micro Air Vehicle's (MAVs). We seek to complement this progress in overcoming the aerodynamic obstacles to.flight at very small scales with a vision stability and autonomy system. The developed system based on a robust horizon detection algorithm which we discuss in greater detail in a companion paper. In this paper, we first motivate the use of computer vision for MAV autonomy arguing that given current sensor technology, vision may he the only practical approach to the problem. We then briefly review our statistical vision-based horizon detection algorithm, which has been demonstrated at 30Hz with over 99.9% correct horizon identification. Next we develop robust schemes for the detection of extreme MAV attitudes, where no horizon is visible, and for the detection of horizon estimation errors, due to external factors such as video transmission noise. Finally, we discuss our feed-back controller for self-stabilized flight, and report results on vision autonomous flights of duration exceeding ten minutes.

Ettinger, Scott M.↗

Multi-Sensor Registration of Earth Remotely Sensed Imagery

Assuming that approximate registration is given within a few pixels by a systematic correction system, we develop automatic image registration methods for multi-sensor data with the goal of achieving sub-pixel accuracy. Automatic image registration is usually defined by three steps; feature extraction, feature matching, and data resampling or fusion. Our previous work focused on image correlation methods based on the use of different features. In this paper, we study different feature matching techniques and present five algorithms where the features are either original gray levels or wavelet-like features, and the feature matching is based on gradient descent optimization, statistical robust matching, and mutual information. These algorithms are tested and compared on several multi-sensor datasets covering one of the EOS Core Sites, the Konza Prairie in Kansas, from four different sensors: IKONOS (4m), Landsat-7/ETM+ (30m), MODIS (500m), and SeaWIFS (1000m).

LeMoigne, Jacqueline↗

Improvement of scanning radiometer performance by digital reference averaging

Most radiometers utilize a calibration technique in which measurements of a known reference are subtracted from measurements of an unknown source so that common-mode bias errors are cancelled. When a radiometer is scanned over a varying scene, it produces a sequence of outputs, each being proportional to the difference between the reference and the corresponding input. A reference averaging technique is presented that employs a simple digital algorithm which exploits the asymmetry between the time-variable scene inputs and the nominally constant reference input by averaging many reference measurements to decrease the statistical uncertainty in the reference value. This algorithm is, therefore, optimized by an asymmetric chopping sequence in which the scene is viewed for more than one-half of the duty cycle (unlike the analog Dicke technique). Reference averaging algorithms are well within the capabilities of small microprocessors. Although this paper develops the technique for microwave radiometry, it may be beneficial for any system which measures a large number of unknowns relative to a known reference in the presence of slowly varying common-mode errors.

Bremer, J. C.↗

Photon Counting Detector Array Algorithms for Deep Space Optical Communications

For deep-space optical communications systems utilizing an uplink optical beacon, a single-photon-counting detector array on the flight terminal can be used to simultaneously perform uplink tracking and communications as well as accurate downlink pointing at photon-starved (pW/sq. m) power levels. In this paper, we discuss concepts and algorithms for uplink signal acquisition, tracking, and parameter estimation using a photon-counting camera. Statistical models of detector output data and signal processing algorithms are presented, incorporating realistic effects such as Earth background and detector/readout blocking. Analysis and simulation results are validated against measured laboratory data using state-of-the-art commercial photon-counting detector arrays, demonstrating sub-microradian tracking errors under channel conditions representative of deep space optical links.

beacon tracking↗

Robust Kalman filter design for predictive wind shear detection

Severe, low-altitude wind shear is a threat to aviation safety. Airborne sensors under development measure the radial component of wind along a line directly in front of an aircraft. In this paper, optimal estimation theory is used to define a detection algorithm to warn of hazardous wind shear from these sensors. To achieve robustness, a wind shear detection algorithm must distinguish threatening wind shear from less hazardous gustiness, despite variations in wind shear structure. This paper presents statistical analysis methods to refine wind shear detection algorithm robustness. Computational methods predict the ability to warn of severe wind shear and avoid false warning. Comparative capability of the detection algorithm as a function of its design parameters is determined, identifying designs that provide robust detection of severe wind shear.

Stratton, Alexander D.↗

Ask-The-Expert: Minimizing Human Review for Big Data Analytics Through Active Learning

In this CIF project, we worked toward semi-automating knowledge discovery from anomaly detection algorithms through the use of active learning. Active learning is an area of research within machine learning that uses an "expert in the loop" to learn from large data sets that have very few annotations or labels available, and where providing such labels is expensive. In our case, the task can be defined as the identification of safety events from flight operational data. Since traditional anomaly detection algorithms cannot differentiate between operationally relevant and irrelevant statistical anomalies, Subject Matter Experts (SMEs) have a lengthy and expensive burden of investigating every example identified by the detection algorithm, classifying and labeling them as relevant or irrelevant. Active learningidentifies the unlabeled example for which a label would most improve the classifier, asks the domain expert for a label, and repeats this process until there are no more resources (time, budget) available for labeling or a minimum required performance is reached. A positive label indicates an operationally significant safety event whereas a negative label indicates otherwise. Based on these few labels we propose to build an active learning system that utilizes the SME's time in the most effective manner by iteratively asking for labels for as few informative instances as possible. Our work was proposed to be a stepping stone toward implementation and deployment of the system with user interface to be pursued by the Aviation Operations and Safety Program (AOSP) given its interest in safety monitoring and discovery of safety incidents.

aviation safety↗

Correlation approach to identify coding regions in DNA sequences

Recently, it was observed that noncoding regions of DNA sequences possess long-range power-law correlations, whereas coding regions typically display only short-range correlations. We develop an algorithm based on this finding that enables investigators to perform a statistical analysis on long DNA sequences to locate possible coding regions. The algorithm is particularly successful in predicting the location of lengthy coding regions. For example, for the complete genome of yeast chromosome III (315,344 nucleotides), at least 82% of the predictions correspond to putative coding regions; the algorithm correctly identified all coding regions larger than 3000 nucleotides, 92% of coding regions between 2000 and 3000 nucleotides long, and 79% of coding regions between 1000 and 2000 nucleotides. The predictive ability of this new algorithm supports the claim that there is a fundamental difference in the correlation property between coding and noncoding sequences. This algorithm, which is not species-dependent, can be implemented with other techniques for rapidly and accurately locating relatively long coding regions in genomic sequences.

Non-NASA Center↗

The Statistical Emulators of GGCMI Phase 2: Responses of Year-to-Year Variation of Crop Yield to CO 2 , Temperature, Water and Nitrogen Perturbations

Understanding the impact of climate change on year-to-year variation of crop yield is critical to global food stability and security. While crop model emulators are believed to be lightweight tools to replace the models, few emulators have been developed to capture such interannual variation of crop yield in response to climate variability. In this study, we developed a statistical emulator with a machine learning algorithm to reproduce the response of year-to-year variation of four crop yields to CO 2 (C), temperature (T), water (W), and nitrogen (N) perturbations defined in the Global Gridded Crop Model Intercomparison Project (GGCMI) phase 2. The emulators were able to explain more than 52 % of the variance of simulated yield and performed well in capturing the year-to-year variation of global average and gridded crop yield over current croplands in the baseline. With the changes in CO 2 –temperature–water–nitrogen (CTWN) perturbations, the emulators could reproduce the year-to-year variation of crop yield well over most current cropland. The variation of R and the mean absolute error was small under the single CTWN perturbations and dual-factor perturbations. These emulators thus provide statistical response surfaces of yield, including both its mean and interannual variability, to climate factors. They could facilitate spatiotemporal downscaling of crop model simulation, projecting the changes in crop yield variability in the future and serving as a lightweight tool for multi-model ensemble simulation. The emulators enhanced the flexibility of crop yield estimates and expanded the application of large-ensemble simulations of crop yield under climate change.

Climate change↗

F-8C adaptive flight control extensions

An adaptive concept which combines gain-scheduled control laws with explicit maximum likelihood estimation (MLE) identification to provide the scheduling values is described. The MLE algorithm was improved by incorporating attitude data, estimating gust statistics for setting filter gains, and improving parameter tracking during changing flight conditions. A lateral MLE algorithm was designed to improve true air speed and angle of attack estimates during lateral maneuvers. Relationships between the pitch axis sensors inherent in the MLE design were examined and used for sensor failure detection. Design details and simulation performance are presented for each of the three areas investigated.

Stein, G.↗

Model development and statistical investigation of turbine blade mistuning

This paper discusses the development of an efficient algorithm which calculates the individual blade response of a bladed turbine disk, the subsequent statistical investigation to establish mistuning dependencies, and procedures which reduce the increase in blade amplitudes caused by mistuning.

Griffin, J. H.↗