Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical Algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

An algorithm for using a laser anemometer to determine mean streamline patterns in a turbulent flow

The technique of tracing out a mean flow streamline with a three dimensional laser Doppler anemometer (LDA) is discussed with respect to cumulative, systematic errors that are inherent when the motion of the LDA test point is in the direction of the local measured velocity. Using simple potential flows that have variable curvature and inflection points to simulate an LDA experiment, a streamline tracing algorithm is developed that minimizes these errors. Also, the test point path remains close to the correct streamline even when simulated statistical measurement variations are included.

Orloff, K. L.↗

LANDSAT-4 image data quality analysis

Seven heterogeneous areas within the Des Moines, Iowa area test site were selected to define candidate spectral training classes using a clustering algorithm. In addition to the 91 cluster (nonsupervised) classes, three supervised training classes were defined and subsequently included in the training statistics file. The identity of all 94 candidate classes were determined using available reference data. Through analysis of the interclass separabilities, the original 94 candidate training classes were reduced to 42 spectrally separable final classes. The minimum average transformed divergence values for the 42 spectral classes and for the best subsets of TM spectral bands are shown in a table.

Anuta, P. E.↗

An evaluation and comparison of vertical profile data from the VISSR Atmospheric Sounder (VAS)

A statistical evaluation is used to compared vertical profiles of temperature and moisture derived from VISSR Atmospheric Sounder (VAS) with three different algorithms to that of corresponding rawinsonde measurements for a clear cold environment. To account for time and space discrepancies between the data sets, rawinsonde data were adjusted to be representative of the satellite sounding times. Both rawinsonde and satellite sounding data were objectively analyzed onto a mesoscale grid. These grid point values were compared at 50 mb pressure increments from the surface up to 100 mb. The data were analyed for horizontal and vertical structure, representatives of derived parameters, and significant departure (improvement) from the apriori (first guess) information. Results indicate some rather strong temperature and moisture biases exist in the satellite soundings. Temperature biases of 1 to 4 C and dewpoint biases of 2 to 6 C generally occur in layers where strong inversions are present and vary with time as these atmospheric features evolve. The biases also changes as a function retrieval scheme suggesting limitations and restrictions on the applications of the various techniques. Standard temperature deviations range from 1 to 2 C for each retrieval scheme with maximum values around 800 and 400 mb. Derived parameters (precipitable water and thickness) suffer from similar biases, though to a somewhat lesser extent. Gradients of basic and derived parameters are generally weaker but have good horizontal structure where magnitudes of the parameters are relatively strong. Integrated thermal (temperature) and moisture (precipitable water) parameters show mixed results.

Jedlovec, G. J.↗

History matching by spline approximation and regularization in single-phase areal reservoirs

An automatic history matching algorithm is developed based on bi-cubic spline approximations of permeability and porosity distributions and on the theory of regularization to estimate permeability or porosity in a single-phase, two-dimensional real reservoir from well pressure data. The regularization feature of the algorithm is used to convert the ill-posed history matching problem into a well-posed problem. The algorithm employs the conjugate gradient method as its core minimization method. A number of numerical experiments are carried out to evaluate the performance of the algorithm. Comparisons with conventional (non-regularized) automatic history matching algorithms indicate the superiority of the new algorithm with respect to the parameter estimates obtained. A quasioptimal regularization parameter is determined without requiring a priori information on the statistical properties of the observations.

Lee, T. Y.↗

An evaluation and comparison of vertical profile data from the VISSR Atmospheric Sounder (VAS)

A statistical evaluation is used to compared vertical profiles of temperature and moisture derived from VISSR Atmospheric Sounder (VAS) with three different algorithms to that of corresponding rawinsonde measurements for a clear cold environment. To account for time and space discrepancies between the data sets, rawinsonde data were adjusted to be representative of the satellite sounding times. Both rawinsonde and satellite sounding data were objectively analyzed onto a mesoscale grid. These grid point values were compared at 50 mb pressure increments from the surface up to 100 mb. The data were analyzed for horizontal and vertical structure, representatives of derived parameters, and significant departure (improvement) from the apriori (first guess) information. Results indicate some rather strong temperature and moisture biases exist in the satellite soundings. Temperature biases of 1 to 4 C and dewpoint biases of 2 to 6 C generally occur in layers where strong inversions are present and vary with time as these atmospheric features evolve. The biases also changes as a function retrieval scheme suggesting limitations and restrictions on the applications of the various techniques. Standard temperature deviations range from 1 to 2 C for each retrieval scheme with maximum values around 800 and 400 mb. Derived parameters (precipitable water and thickness) suffer from similar biases, though to a somewhat lesser extent. Gradients of basic and derived parameters are generally weaker but have good horizontal structure where magnitudes of the parameters are relatively strong. Integrated thermal (temperature) and moisture (precipitable water) parameters show mixed results.

Jedlovec, G. J.↗

The latitudinal distribution of ozone to 35 km altitude from ECC ozonesonde observations, 1982-1990

Electrochemical concentration cell (ECC) ozone-sonde observations, made in recent years at ten stations whose locations range from the Arctic to Antarctica, have yielded a self-consistent ozone data base from which mean seasonal and annual latitudinal ozone vertical distributions to 35 km have been derived. Ozone measurement uncertainties are estimated, and results are presented in the Bass-Paur (1985) ozone absorption coefficient scale adopted for use with Dobson ozone spectrophotometers January 1, 1992. The data should be useful for comparison with model calculations of the global distribution of atmospheric ozone, for serving as apriori statistical information in deriving ozone vertical distributions from satellite and Umkehr observations, and for improving the satellite and Umkehr ozone inversion algorithms. Attention is drawn to similar results based on a less comprehensive data set published in Ozone in the Atmosphere, Proceedings of the 1988 Quadrennial Ozone Symposium where errors in data tabulations occurred for three of the stations due to inadvertent transposition of ozone partial pressure and air temperature values.

Komhyr, W. D.↗

TDRS orbit determination by radio interferometry

In support of a NASA study on the application of radio interferometry to satellite orbit determination, MITRE developed a simulation tool for assessing interferometry tracking accuracy. The Orbit Determination Accuracy Estimator (ODAE) models the general batch maximum likelihood orbit determination algorithms of the Goddard Trajectory Determination System (GTDS) with the group and phase delay measurements from radio interferometry. ODAE models the statistical properties of tracking error sources, including inherent observable imprecision, atmospheric delays, clock offsets, station location uncertainty, and measurement biases, and through Monte Carlo simulation, ODAE calculates the statistical properties of errors in the predicted satellites state vector. This paper presents results from ODAE application to orbit determination of the Tracking and Data Relay Satellite (TDRS) by radio interferometry. Conclusions about optimal ground station locations for interferometric tracking of TDRS are presented, along with a discussion of operational advantages of radio interferometry.

Pavloff, Michael S.↗

NASA Tech Briefs, August 2006

Topics covered include: Measurement and Controls Data Acquisition System IMU/GPS System Provides Position and Attitude Data Using Artificial Intelligence to Inform Pilots of Weather Fast Lossless Compression of Multispectral-Image Data Developing Signal-Pattern-Recognition Programs Implementing Access to Data Distributed on Many Processors Compact, Efficient Drive Circuit for a Piezoelectric Pump; Dual Common Planes for Time Multiplexing of Dual-Color QWIPs; MMIC Power Amplifier Puts Out 40 mW From 75 to 110 GHz; 2D/3D Visual Tracker for Rover Mast; Adding Hierarchical Objects to Relational Database General-Purpose XML-Based Information Managements; Vaporizable Scaffolds for Fabricating Thermoelectric Modules; Producing Quantum Dots by Spray Pyrolysis; Mobile Robot for Exploring Cold Liquid/Solid Environments; System Would Acquire Core and Powder Samples of Rocks; Improved Fabrication of Lithium Films Having Micron Features; Manufacture of Regularly Shaped Sol-Gel Pellets; Regulating Glucose and pH, and Monitoring Oxygen in a Bioreactor; Satellite Multiangle Spectropolarimetric Imaging of Aerosols; Interferometric System for Measuring Thickness of Sea Ice; Microscale Regenerative Heat Exchanger Protocols for Handling Messages Between Simulation Computers Statistical Detection of Atypical Aircraft Flights NASA's Aviation Safety and Modeling Project Multimode-Guided-Wave Ultrasonic Scanning of Materials Algorithms for Maneuvering Spacecraft Around Small Bodies Improved Solar-Radiation-Pressure Models for GPS Satellites Measuring Attitude of a Large, Flexible, Orbiting Structure

Source record↗

Robust Algorithm for Estimating Total Suspended Solids (TSS) in Inland and Nearshore Coastal Waters

One of the challenging tasks in modern aquatic remote sensing is the retrieval of near-surface concentrations of Total Suspended Solids (TSS). This study aims to present a Statistical, inherent Optical property (IOP) -based, and muLti-conditional Inversion proceDure (SOLID) for enhanced retrievals of satellite-derived TSS under a wide range of in-water bio-optical conditions in rivers, lakes, estuaries, and coastal waters. In this study, using a large in situ database (N > 3500), the SOLID model is devised using a three-step procedure: (a) water-type classification of the input remote sensing reflectance (R(sub rs)), (b) retrieval of particulate backscattering (b(sub bp)) in the red or near-infrared (NIR) regions using semi-analytical, machine-learning, and empirical models, and (c) estimation of TSS from b(sub bp) via water-type-specific empirical models. Using an independent subset of our in situ data (N = 2729) with TSS ranging from 0.1 to 2626.8 [g/m (exp 3)], the SOLID model is thoroughly examined and compared against several state-of-the-art algorithms (Miller and McKee, 2004; Nechad et al., 2010; Novoa et al., 2017; Ondrusek et al., 2012; Petus et al., 2010). We show that SOLID outperforms all the other models to varying degrees, i.e., from 10 to > 100%, depending on the statistical attributes (e.g., global versus water-type-specific metrics). For demonstration purposes, the model is implemented for images acquired by the MultiSpectral Imager aboard Sentinel-2A/B over the Chesapeake Bay, San-Francisco-Bay-Delta Estuary, Lake Okeechobee, and Lake Taihu. To enable generating consistent, multimission TSS products, its performance is further extended to, and evaluated for, other missions, such as the Ocean and Land Color Instrument (OLCI), Moderate Resolution Imaging Spectroradiometer (MODIS), Visible Infrared Imaging Radiometer Suite (VIIRS), and Operational Land Imager (OLI). Sensitivity analyses on uncertainties induced by the atmospheric correction indicate that 10% uncertainty in Rrs leads to < 20% uncertainty in TSS retrievals from SOLID. While this study suggests that SOLID has a potential for producing TSS products in global coastal and inland waters, our statistical analysis certainly verifies that there is still a need for improving retrievals across a wide spectrum of particle loads.

Total suspended solids↗

Spatial and Temporal Distribution of Clouds as Observed by MODIS Onboard the Terra and Aqua Satellites

The Moderate Resolution Imaging Spectroradiometer (MODIS) was developed by NASA and launched onboard the Terra spacecraft on December 18,1999 and Aqua spacecraft on May 4, 2002. It achieved its final orbit and began Earth observations on February 24,2000 for Terra and June 24,2002 for Aqua. A comprehensive set of remote sensing algorithms for cloud masking and the retrieval of cloud physical and optical properties has been developed by members of the MODIS atmosphere science team. The archived products from these algorithms have applications in climate change studies, climate modeling, numerical weather prediction, and fundamental atmospheric research. In addition to an extensive cloud mask, products include cloud-top properties (temperature, pressure, effective emissivity), cloud thermodynamic phase, cloud optical and microphysical parameters (optical thickness, effective particle radius, water path), as well as derived statistics. Over the last year, extensive improvements and enhancements in the global cloud products have been implemented, and reprocessing of all MODIS data on Terra has commenced since first light in February 2000. In the cloud mask algorithm, the most extensive improvements were in distinguishing clouds at nighttime, including the challenging polar darkness regions of the world. Additional improvements have been made to properly distinguish sunglint from clouds in the tropical ocean regions, and to improve the identification of clouds from snow during daytime in Polar Regions. We will show global monthly mean cloud fraction for both Terra and Aqua, and show how similar the global daytime cloud fraction is from these morning and afternoon orbits, respectively. We will also show the zonal distribution of cloud fraction over land and ocean regions for both Terra and Aqua, and show the time series of global cloud fraction from July 2002 through June 2006.

King, Michael D.↗

Physical Validation of GPM Retrieval Algorithms Over Land: An Overview of the Mid-Latitude Continental Convective Clouds Experiment (MC3E)

The joint NASA Global Precipitation Measurement (GPM) -- DOE Atmospheric Radiation Measurement (ARM) Midlatitude Continental Convective Clouds Experiment (MC3E) was conducted from April 22-June 6, 2011, centered on the DOE-ARM Southern Great Plains Central Facility site in northern Oklahoma. GPM field campaign objectives focused on the collection of airborne and ground-based measurements of warm-season continental precipitation processes to support refinement of GPM retrieval algorithm physics over land, and to improve the fidelity of coupled cloud resolving and land-surface satellite simulator models. DOE ARM objectives were synergistically focused on relating observations of cloud microphysics and the surrounding environment to feedbacks on convective system dynamics, an effort driven by the need to better represent those interactions in numerical modeling frameworks. More specific topics addressed by MC3E include ice processes and ice characteristics as coupled to precipitation at the surface and radiometer signals measured in space, the correlation properties of rainfall and drop size distributions and impacts on dual-frequency radar retrieval algorithms, the transition of cloud water to rain water (e.g., autoconversion processes) and the vertical distribution of cloud water in precipitating clouds, and vertical draft structure statistics in cumulus convection. The MC3E observational strategy relied on NASA ER-2 high-altitude airborne multi-frequency radar (HIWRAP Ka-Ku band) and radiometer (AMPR, CoSMIR; 10-183 GHz) sampling (a GPM "proxy") over an atmospheric column being simultaneously profiled in situ by the University of North Dakota Citation microphysics aircraft, an array of ground-based multi-frequency scanning polarimetric radars (DOE Ka-W, X and C-band; NASA D3R Ka-Ku and NPOL S-bands) and wind-profilers (S/UHF bands), supported by a dense network of over 20 disdrometers and rain gauges, all nested in the coverage of a six-station mesoscale rawinsonde network. As an exploratory effort to examine land-surface emissivity impacts on retrieval algorithms, and to demonstrate airborne soil moisture retrieval capabilities, the University of Tennessee Space Institute Piper aircraft carrying the MAPIR L-band radiometer was also flown during the latter half of the experiment in coordination with the ER-2. The observational strategy provided a means to sample the atmospheric column in a redundant framework that enables inter-calibration and constraint of measured and retrieved precipitation characteristics such as particle size distributions, or water contents- all within the umbrella of "proxy" satellite measurements (i.e., the ER-2). Complimenting the precipitation sampling framework, frequent and coincident launches of atmospheric soundings (e.g., 4-8/day) then provided a much larger mesoscale view of the thermodynamic and winds environment, a data set useful for initializing cloud models. The datasets collected represent a variety cloud and precipitation types including isolated cumulus clouds, severe thunderstorms, mesoscale convective systems, and widespread regions of light to moderate stratiform precipitation. We will present the MC3E experiment design, an overview of operations, and a summary of preliminary results.

Petersen, Walter A.↗

Accelerated Depth Computation for Surface Boxplots with Deep Learning

Functional depth is a well-known technique used to derive descriptive statistics (e.g., median, quartiles, and outliers) for 1D data. Surface boxplots extend this concept to ensembles of images, helping scientists and users identify representative and outlier images. However, the computational time for surface boxplots increases cubically with the number of ensemble members, making it impractical for integration into visualization tools. In this paper, we propose a deep-learning solution for efficient depth prediction and computation of surface boxplots for time-varying ensemble data. Our deep learning framework accurately predicts member depths in a surface boxplot, achieving average speedups of 6X on a CPU and 15X on a GPU for the 2D Red Sea dataset with 50 ensemble members compared to the traditional depth computation algorithm. Our approach achieves at least a 99% level of rank preservation, with order flipping occurring only at pairs with extremely similar depth values that pose no statistical differences. This local flipping does not significantly impact the overall depth order of the ensemble members.

Han, Mengjiao↗

Km‐Scale Simulations of Mesoscale Convective Systems Over South America—A Feature Tracker Intercomparison

Mesoscale convective systems (MCSs) are clusters of thunderstorms that are important in Earth's water and energy cycle. Additionally, they are responsible for extreme events such as large hail, strong winds, and extreme precipitation. Automated object-based analyses that track MCSs have become popular since they allow us to identify and follow MCSs over their entire life cycle in a Lagrangian framework. This rise in popularity was accompanied by an increasing number of MCS tracking algorithms, however, little is known about how sensitive analyses are concerning the MCS tracker formulation. Here, we assess differences between six MCS tracking algorithms on South American MCS characteristics and evaluate MCSs in kilometer-scale simulations with observational-based MCSs over 3 years. All trackers are run with a common set of MCS classification criteria to isolate tracker formulation differences. The tracker formulation substantially impacts MCS characteristics such as frequency, size, duration, and contribution to total precipitation. The evaluation of simulated MCS characteristics is less sensitive to the tracker formulation and all trackers agree that the model can capture MCS characteristics well across different South American climate zones. Dominant sources of uncertainty are the segmentation of cloud systems in space and time and the treatment of how MCSs are linked in time. Our results highlight that comparing MCS analyses that use different tracking algorithms is challenging. We provide general guidelines on how MCS characteristics compare between trackers to facilitate a more robust assessment of MCS statistics in future studies.

54 ENVIRONMENTAL SCIENCES↗

Deriving cloud droplet number concentration from surface-based remote sensors with an emphasis on lidar measurements

Abstract. Given the importance of constraining cloud droplet number concentrations (Nd) in low-level clouds, we explore two methods for retrieving Nd from surface-based remote sensing that emphasize the information content in lidar measurements. Because Nd is the zeroth moment of the droplet size distribution (DSD), and all remote sensing approaches respond to DSD moments that are at least 2 orders of magnitude greater than the zeroth moment, deriving Nd from remote sensing measurements has significant uncertainty. At minimum, such algorithms require the extrapolation of information from two other measurements that respond to different moments of the DSD. Lidar, for instance, is sensitive to the second moment (cross-sectional area) of the DSD, while other measures from microwave sensors respond to higher-order moments. We develop methods using a simple lidar forward model that demonstrates that the depth to the maximum in lidar-attenuated backscatter (Rmax⁡) is strongly sensitive to Nd when some measure of the liquid water content vertical profile is given or assumed. Knowledge of Rmax⁡ to within 5 m can constrain Nd to within several tens of percent. However, operational lidar networks provide vertical resolutions of > 15 m, making a direct calculation of Nd from Rmax⁡ very uncertain. Therefore, we develop a Bayesian optimal estimation algorithm that brings additional information to the inversion such as lidar-derived extinction and radar reflectivity near the cloud top. This statistical approach provides reasonable characterizations of Nd and effective radius (re) to within approximately a factor of 2 and 30 %, respectively. By comparing surface-derived cloud properties with MODIS satellite and aircraft data collected during the MARCUS and CAPRICORN II campaigns, we demonstrate the utility of the methodology.

54 ENVIRONMENTAL SCIENCES↗

Photographic astrometry and overlap reduction techniques

Rigorous adjustment algorithms are discussed which extract hidden information contained in overlapping photographs of star fields. In particular, the development of adequate physical and statistical models is emphasized.

Googe, W. D.↗

Utilization of satellite data for inventorying prairie ponds and lakes. LANDSAT-1 data were used to discriminate ponds and lakes for waterfowl management

The author has identified the following significant results. The mapping of open water as an indicator of waterfowl habitat quality was carried out by using two different recognition techniques, a single waveband thresholding approach and a multiple waveband approach termed proportion estimation. The single waveband technique has proven simple to implement. Its computer algorithm was rapid and accurately recognized prairie lakes and large ponds. The resultant products of this processing technique were thematic maps and statistical tabulations describing open surface water conditions. The maps served to portray visually the location and frequency of surface water bodies but usually necessitated additional interpretation.

Gilmer, D. S.↗

The use of unsupervised clustering as a classifier for LACIE MSS data

The author has identified the following significant results. This classification method appears to give accurate field center results and to give practical, statistically consistent and accurate estimates of crop proportions. The accuracy of this method is attributable to certain qualities of the particular clustering algorithm. These qualities are freedom from assumptions about Gaussian data, and the continual updating of distribution estimates, including updating the number of modes. This method is relatively tolerant of errors in the determination of crop type, as crop identity is used only for identifying clusters, and not for computing signatures.

Pentland, A. P.↗

A stochastic atmospheric model for remote sensing applications

There are many factors which reduce the accuracy of classification of objects in the satellite remote sensing of Earth's surface. One important factor is the variability in the scattering and absorptive properties of the atmospheric components such as particulates and the variable gases. For multispectral remote sensing of the Earth's surface in the visible and infrared parts of the spectrum the atmospheric particulates are a major source of variability in the received signal. It is difficult to design a sensor which will determine the unknown atmospheric components by remote sensing methods, at least to the accuracy needed for multispectral classification. The problem of spatial and temporal variations in the atmospheric quantities which can affect the measured radiances are examined. A method based upon the stochastic nature of the atmospheric components was developed, and, using actual data the statistical parameters needed for inclusion into a radiometric model was generated. Methods are then described for an improved correction of radiances. These algorithms will then result in a more accurate and consistent classification procedure.

Turner, R. E.↗