Search NASA⌕ Search

SEARCH · Search NASA

Results for “mean squared error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Evaluation of GEOS-Simulated L-Band Microwave Brightness Temperature using Aquarius Observations over Non-Frozen Land across North America

L-band brightness temperature (T(sub b)) is one of the key remotely-sensed variables that provides information regarding surface soil moisture conditions. In order to harness the information in T(sub b) observations, a radiative transfer model (RTM) is investigated for eventual inclusion into a data assimilation framework. In this study, T(sub b) estimates from the RTM implemented in the NASA Goddard Earth Observing System (GEOS) were evaluated against the nearly four-year record of daily T(sub b) observations collected by L-band radiometers onboard the Aquarius satellite. Statistics between the modeled and observed T(sub b) were computed over North America as a function of soil hydraulic properties and vegetation types. Overall, statistics showed good agreement between the modeled and observed T(sub b) with a relatively low, domain-average bias (0.79 K (ascending) and -2.79 K (descending)), root mean squared error (11.0 K (ascending) and 11.7 K (descending)), and unbiased root mean squared error (8.14 K (ascending) and 8.28 K (descending)). In terms of soil hydraulic parameters, large porosity and large wilting point both lead to high uncertainty in modeled T(sub b) due to the large variability in dielectric constant and surface roughness used by the RTM. The performance of the RTM as a function of vegetation type suggests better agreement in regions with broadleaf deciduous and needleleaf forests while grassland regions exhibited the worst accuracy amongst the five different vegetation types.

L-band radiometry↗

Quantitative analysis of the reconstruction performance of interpolants

The analysis presented provides a quantitative measure of the reconstruction or interpolation performance of linear, shift-invariant interpolants. The performance criterion is the mean square error of the difference between the sampled and reconstructed functions. The analysis is applicable to reconstruction algorithms used in image processing and to many types of splines used in numerical analysis and computer graphics. When formulated in the frequency domain, the mean square error clearly separates the contribution of the interpolation method from the contribution of the sampled data. The equations provide a rational basis for selecting an optimal interpolant; that is, one which minimizes the mean square error. The analysis has been applied to a selection of frequently used data splines and reconstruction algorithms: parametric cubic and quintic Hermite splines, exponential and nu splines (including the special case of the cubic spline), parametric cubic convolution, Keys' fourth-order cubic, and a cubic with a discontinuous first derivative. The emphasis in this paper is on the image-dependent case in which no a priori knowledge of the frequency spectrum of the sampled function is assumed.

Lansing, Donald L.↗

Parameter Estimation for Thurstone Choice Models

We consider the estimation accuracy of individual strength parameters of a Thurstone choice model when each input observation consists of a choice of one item from a set of two or more items (so called top-1 lists). This model accommodates the well-known choice models such as the Luce choice model for comparison sets of two or more items and the Bradley-Terry model for pair comparisons. We provide a tight characterization of the mean squared error of the maximum likelihood parameter estimator. We also provide similar characterizations for parameter estimators defined by a rank-breaking method, which amounts to deducing one or more pair comparisons from a comparison of two or more items, assuming independence of these pair comparisons, and maximizing a likelihood function derived under these assumptions. We also consider a related binary classification problem where each individual parameter takes value from a set of two possible values and the goal is to correctly classify all items within a prescribed classification error. The results of this paper shed light on how the parameter estimation accuracy depends on given Thurstone choice model and the structure of comparison sets. In particular, we found that for unbiased input comparison sets of a given cardinality, when in expectation each comparison set of given cardinality occurs the same number of times, for a broad class of Thurstone choice models, the mean squared error decreases with the cardinality of comparison sets, but only marginally according to a diminishing returns relation. On the other hand, we found that there exist Thurstone choice models for which the mean squared error of the maximum likelihood parameter estimator can decrease much faster with the cardinality of comparison sets. We report empirical evaluation of some claims and key parameters revealed by theory using both synthetic and real-world input data from some popular sport competitions and online labor platforms.

97 MATHEMATICS AND COMPUTING↗

A passive microwave technique for estimating rainfall and vertical structure information from space. Part 2: Applications to SSM/I data

A multi channel physical approach for retrieving rainfall and its vertical structure from Special Sensor Microwave/Imager (SSM/I) observations is examined. While a companion paper was devoted exclusively to the description of the algorithm, its strengths, and its limitations, the main focus of this paper is to report on the results, applicability, and expected accuraciesfrom this algorithm. Some examples are given that compare retrieved results with ground-based radar data from different geographical regions to illustrate the performance and utility of the algorithm under distinct rainfall conditions. More quantitative validation is accomplished using two months of radar data from Darwin, Australia, and the radar network over Japan. Instantaneous comparisons at Darwin indicate that root-mean-square errors for 1.25 deg areas over water are 0.09 mm/h compared to the mean rainfall value of 0.224 mm/h while the correlation exceeds 0.9. Similar results are obtained over the Japanese validation site with rms errors of 0.615 mm/h compared to the mean of 0.0880 mm/h and a correlation of 0.9. Results are less encouraging over land with root-mean-square errors somewhat larger than the mean rain rates and correlations of only 0.71 and 0.62 for Darwin and Japan, respectively. These validation studies are further used in combination with the theoretical treatment of expected accuracies developed in the companion paper to define error estimates on a broader scale than individual radar sites from which the errors may be analyzed. Comparisons with simpler techniques that are based on either emission or scattering measurements are used to illustrate the fact that the current algorithm, while better correlated with the emission methods over water, cannot be reduced to either of these simpler methods.

Kummerow, Christian↗

A Canonical Ensemble Correlation Prediction Model for Seasonal Precipitation Anomaly

This report describes an optimal ensemble forecasting model for seasonal precipitation and its error estimation. Each individual forecast is based on the canonical correlation analysis (CCA) in the spectral spaces whose bases are empirical orthogonal functions (EOF). The optimal weights in the ensemble forecasting crucially depend on the mean square error of each individual forecast. An estimate of the mean square error of a CCA prediction is made also using the spectral method. The error is decomposed onto EOFs of the predictand and decreases linearly according to the correlation between the predictor and predictand. This new CCA model includes the following features: (1) the use of area-factor, (2) the estimation of prediction error, and (3) the optimal ensemble of multiple forecasts. The new CCA model is applied to the seasonal forecasting of the United States precipitation field. The predictor is the sea surface temperature.

Shen, Samuel S. P.↗

Some statistical problems inherent in measuring precipitation

A formula permitting calculation of the mean-square error of the mean value of a random variable due to periodic sampling is derived and applied to estimating the sampling error for satellite observation of the mean rainfall during the GARP Atlantic Tropical Experiment (GATE). The effects of both spatial resolution and frequency of observation on the sampling error are summarized in graphs. It is found that four observations per day are sufficient to determine the monthly mean rainfall over an area of 2.5 deg square (280km x 280km) to within a standard deviation of 5 percent of its mean value; two samples per day would yield an error with a standard deviation slightly less than 10 percent of the mean. A satellite instrument with less frequent sampling may produce significantly greater error in the estimate of monthly mean rainfall.

Flueck, J. A.↗

Advanced study of video signal processing in low signal to noise environments

The frame to frame correlation properties of the video process are utilized to reduce the mean squared error of the demodulated video where zero mean noise is a factor. An interpolative estimator is used for continuous estimation with the output process delayed in time by one frame. Theoretical development shows that for the model herein developed reduction of the mean squared error by 1.0 to 4.0 db possible for parameter ranges of interest. Interpolative estimation using inter-frame correlation properties of a video process is then applied to the Apollo 17 parameters to yield a model for application on that mission.

Carden, F.↗

Navigating the Noise: Bringing Clarity to ML Parameterization Design With O $\boldsymbol{\mathcal{O}}$(100) Ensembles

Abstract Machine‐learning (ML) parameterizations of subgrid processes (here of turbulence, convection, and radiation) may one day replace conventional parameterizations by emulating high‐resolution physics without the cost of explicit simulation. However, uncertainty about the relationship between offline and online performance (i.e., when integrated with a large‐scale general circulation model) hinders their development. Much of this uncertainty stems from limited sampling of the noisy, emergent effects of upstream ML design decisions on downstream online hybrid simulation. Our work rectifies the sampling issue via the construction of a semi‐automated, end‐to‐end pipeline for size ensembles of hybrid simulations, revealing important nuances in how systematic reductions in offline error manifest in changes to online error and online stability. For example, removing dropout and switching from a Mean Squared Error to a Mean Absolute Error loss both reduce offline error, but they have opposite effects on online error and online stability. Other design decisions, like incorporating memory, converting moisture input from specific humidity to relative humidity, using batch normalization, and training on multiple climates do not come with any such compromises. Finally, we show that ensemble sizes of may be necessary to reliably detect causally relevant differences online. By enabling rapid online experimentation at scale, we can empirically settle debates regarding subgrid ML parameterization design that would have otherwise remained unresolved in the noise.

Lin, Jerry [Department of Earth System Sciences Un↗

MO-FG-BRA-01: Development of An Image-Guided Dosimetric Planning System for Injectable Brachytherapy Using ELP Nanoparticles

Purpose: To develop, validate, and evaluate a methodology for determining dosimetry for intratumoral injections of elastin-like-polypeptide (ELP) brachytherapy nanoparticles. These organic-polymer-based nanoparticles are injectable, biodegradable, and genetically tunable. We present a genetically encoded polymer-solution, composed of novel radiolabeled-ELP nanoparticles that are custom-designed to self-assemble into a local source upon intratumoral injection. Our preliminary results of a small animal study demonstrate 100% tumor response, effective radionuclide retention-rates, strong in vivo stability, and no polymer-induced toxicities. While our approach is therefore highly promising for improved brachytherapy, the current workflow lacks a dosimetry framework. Methods: We are developing a robust software framework that provides image-guided dosimetric-planning capabilities for ELP brachytherapy. The user graphically places ELP injection sites within a µCT-planning-image, and independently defines each injection volume, concentration, and radioisotope to be used. The resulting internal dosimetry is then pre-determined by first modeling post-injection ELP advection-diffusion, and then calculating the resulting dose distribution based on a point- dose-kernel-convolution algorithm. We have experimentally measured ELP steady-state concentrations via µSPECT acquisition, and validated our dose calculation algorithm against Monte Carlo simulations of several radioactivity distributions. Finally, we have investigated potential advantages and limitations of various ELP injection parameters. Results: The µSPECT results demonstrated inhomogeneous steady-state distributions of ELP in tissue, and Monte Carlo radioactivity distributions were designed accordingly. Our algorithm yielded a root-mean-square-error of less than 2% for each distribution tested (average root-mean-square-error was 0.73%). Dose-Volume-Histogram analysis of five different plans showed how strategic injection placement, and an injection volume-tapering technique, could be used to achieve D95% target coverage. Conclusion: We have preliminarily developed a novel planning framework for ELP brachytherapy. Its dosimetry accuracy has been validated against Monte Carlo, and we have started to investigate the potential advantages of injection-based planning. This system, once fully developed, will serve as the technical foundation for our novel approach.

60 APPLIED LIFE SCIENCES↗

Error Estimation of An Ensemble Statistical Seasonal Precipitation Prediction Model

This NASA Technical Memorandum describes an optimal ensemble canonical correlation forecasting model for seasonal precipitation. Each individual forecast is based on the canonical correlation analysis (CCA) in the spectral spaces whose bases are empirical orthogonal functions (EOF). The optimal weights in the ensemble forecasting crucially depend on the mean square error of each individual forecast. An estimate of the mean square error of a CCA prediction is made also using the spectral method. The error is decomposed onto EOFs of the predictand and decreases linearly according to the correlation between the predictor and predictand. Since new CCA scheme is derived for continuous fields of predictor and predictand, an area-factor is automatically included. Thus our model is an improvement of the spectral CCA scheme of Barnett and Preisendorfer. The improvements include (1) the use of area-factor, (2) the estimation of prediction error, and (3) the optimal ensemble of multiple forecasts. The new CCA model is applied to the seasonal forecasting of the United States (US) precipitation field. The predictor is the sea surface temperature (SST). The US Climate Prediction Center's reconstructed SST is used as the predictor's historical data. The US National Center for Environmental Prediction's optimally interpolated precipitation (1951-2000) is used as the predictand's historical data. Our forecast experiments show that the new ensemble canonical correlation scheme renders a reasonable forecasting skill. For example, when using September-October-November SST to predict the next season December-January-February precipitation, the spatial pattern correlation between the observed and predicted are positive in 46 years among the 50 years of experiments. The positive correlations are close to or greater than 0.4 in 29 years, which indicates excellent performance of the forecasting model. The forecasting skill can be further enhanced when several predictors are used.

Shen, Samuel S. P.↗

Coding isotropic images

Rate distortion functions for two-dimensional homogeneous isotropic images are compared with the performance of 5 source encoders designed for such images. Both unweighted and frequency weighted mean square error distortion measures are considered. The coders considered are differential PCM (DPCM) using six previous samples in the prediction, herein called 6 pel (picutre element) DPCM; simple DPCM using single sample prediction; 6 pel DPCM followed by entropy coding; 8 x 8 discrete cosine transform coder, and 4 x 4 Hadamard transform coder. Other transform coders were studied and found to have about the same performance as the two transform coders above. With the mean square error distortion measure DPCM with entropy coding performed best. The relative performance of the coders changes slightly when the distortion measure is frequency weighted mean square error. The performance of all the coders was separated by only about 4 dB.

Oneal, J. B., Jr.↗

Uniform quantizers for noisy channels

We consider optimum uniform data quantization for noisy channels. We present a general formulation for natural encoding that results in simple expressions for the mean-square error. Specifically, we show that the optimum location of the center of the quantizer is at the mean of the distribution for all error rates. The optimum levels for quantization and the corresponding mean-square error are presented for Gaussian and uniform data. For the latter the width of the optimum quantizer for noisy channels is shown to be smaller than the entire range of probability distribution.

Murthy, B. R. N.↗

Perspectives on Prediction Variance and Bias in Developing, Assessing, and Comparing Experimental Designs

The vast majority of response surface methods used in practice to develop, assess, and compare experimental designs focus on variance properties of designs. Because response surface models only approximate the true unknown relationships, models are subject to bias errors as well as variance errors. Beginning with the seminal paper of Box and Draper (1959) and over the subsequent 50 years, methods that consider bias and mean-squared-error (variance and bias) properties of designs have been presented in the literature. However, these methods are not widely implemented in software and are not routinely used to develop, assess, and compare experimental designs in practice. Methods for developing, assessing, and comparing response surface designs that account for variance properties are reviewed. Brief synopses of publications that consider bias or mean-squared-error properties are provided. The difficulties and approaches for addressing bias properties of designs are summarized. Perspectives on experimental design methods that account for bias and/or variance properties and on future needs are presented.

97 MATHEMATICS AND COMPUTING↗

Investigation of boundary-layer wind predictions during nocturnal low-level jet events using the Weather Research and Forecasting model

Simulations of two periods featuring three consecutive low level jet (LLJ) events in the US Upper Great Plains during the autumn of 2011 were conducted to explore the impacts of various setup configurations and physical process models on simulated flow parameters within the lowest 200 m above the surface, using the Weather Research and Forecasting (WRF) model. Sensitivities of simulated flow parameters to the horizontal and vertical grid spacing, planetary boundary layer (PBL) and land surface model (LSM) physics options, were assessed. Data from a Light Detection and Ranging (lidar) system, deployed to the Weather Forecast Improvement Project (WFIP; Finley et al. 2013) were used to evaluate the accuracy of simulated wind speed and direction at 80 m above the surface, as well as their vertical distributions between 120 and 40 m, covering the typical span of contemporary tall wind turbines. All of the simulations qualitatively captured the overall diurnal cycle of wind speed and stratification, producing LLJs during each overnight period, however large discrepancies occurred at certain times for each simulation in relation to the observations. 54-member ensembles encompassing changes of the above discussed configuration parameters displayed a wide range of simulated vertical distributions of wind speed and direction, and potential temperature, reflecting highly variable representations of stratification during the weakly stable overnight conditions. Root mean square error (RMSE) statistics show that different ensemble members performed better and worse in various simulated parameters at different times, with no clearly superior configuration . Simulations using a PBL parameterization designed specifically for the stable conditions investigated herein provided superior overall simulations of wind speed at 80 m, demonstrating the efficacy of targeting improvements of physical process models in areas of known deficiencies. However, the considerable magnitudes of the RMSE values of even the best performing simulations indicate ample opportunities for further improvements.

Mirocha, Jeff D.↗

Assessing the Skill of the Improved Treatment of Riverine Freshwater in the Community Earth System Model (CESM) Relative to a New Salinity Climatology

Abstract Recent studies have explored the sensitivity of global ocean model simulations to the treatment of riverine freshwater and the representation of estuarine processes via an estuary box model applied within Community Earth System Model (CESM). This study builds on these efforts by assessing the model skill score relative to a new salinity climatology. The new climatology averages the original observational data of the World Ocean Database directly onto the CESM ocean component tracer grid cells without spatial interpolation, smoothing, or other gap‐filling techniques to mitigate coastal ocean salinity bias present in the World Ocean Atlas. The mean square error for coastal upper ocean salinity relative to climatology is reduced by up to 14%, and the mean square error of near‐surface salinity stratification is reduced by up to 28% near major river mouths in the simulations with improved treatments of river runoff. The improvement in upper ocean bulk salinity is attributed primarily to focusing runoff as point sources thereby avoiding the artificial horizontal spreading of the control run and to applying a locally varying instead of a global constant reference salinity for riverine virtual salt fluxes. The improvements in near‐surface salinity stratification are primarily attributed to adding parameterized estuarine mixing with the estuary box model. Salinity and salinity stratification skill improvements are achieved not just near large rivers but also along the global coast and skill improvements extend far offshore. Despite these improvements, many other sources of model‐climatology mismatch in coastal salinity and stratification remain and merit further attention.

58 GEOSCIENCES↗

SU-G-BRA-07: An Innovative Fiducial-Less Tracking Method for Radiation Treatment of Abdominal Tumors by Diaphragm Disparity Analysis

Purpose: To investigate the feasibility of tracking abdominal tumors without the use of gold fiducial markers Methods: In this simulation study, an abdominal 4DCT dataset, acquired previously and containing 8 phases of the breathing cycle, was used as the testing data. Two sets of DRR images (45 and 135 degrees) were generated for each phase. Three anatomical points along the lung-diaphragm interface on each of the Digital Reconstructed Radiograph(DRR) images were identified by cross-correlation. The gallbladder, which simulates the tumor, was contoured for each phase of the breathing cycle and the corresponding centroid values serve as the measured center of the tumor. A linear model was created to correlate the diaphragm’s disparity of the three identified anatomical points with the center of the tumor. To verify the established linear model, we sequentially removed one phase of the data (i.e., 3 anatomical points and the corresponding tumor center) and created new linear models with the remaining 7 phases. Then we substituted the eliminated phase data (disparities of the 3 anatomical points) into the corresponding model to compare model-generated tumor center and the measured tumor center. Results: The maximum difference between the modeled and the measured centroid values across the 8 phases were 0.72, 0.29 and 0.30 pixels in the x, y and z directions respectively, which yielded a maximum mean-squared-error value of 0.75 pixels. The outcomes of the verification process, by eliminating each phase, produced mean-squared-errors ranging from 0.41 to 1.28 pixels. Conclusion: Gold fiducial markers, requiring surgical procedures to be implanted, are conventionally used in radiation therapy. The present work shows the feasibility of a fiducial-less tracking method for localizing abdominal tumors. Through developed diaphragm disparity analysis, the established linear model was verified with clinically accepted errors. The tracking method in real time under different radiation therapy platforms will be further investigated.

60 APPLIED LIFE SCIENCES↗

Using compressive sensing to recover images from PET scanners with partial detector rings

Purpose: Most positron emission tomography/computed tomography (PET/CT) scanners consist of tightly packed discrete detector rings to improve scanner efficiency. The authors’ aim was to use compressive sensing (CS) techniques in PET imaging to investigate the possibility of decreasing the number of detector elements per ring (introducing gaps) while maintaining image quality. Methods: A CS model based on a combination of gradient magnitude and wavelet domains (wavelet-TV) was developed to recover missing observations in PET data acquisition. The model was designed to minimize the total variation (TV) and L1-norm of wavelet coefficients while constrained by the partially observed data. The CS model also incorporated a Poisson noise term that modeled the observed noise while suppressing its contribution by penalizing the Poisson log likelihood function. Three experiments were performed to evaluate the proposed CS recovery algorithm: a simulation study, a phantom study, and six patient studies. The simulation dataset comprised six disks of various sizes in a uniform background with an activity concentration of 5:1. The simulated image was multiplied by the system matrix to obtain the corresponding sinogram and then Poisson noise was added. The resultant sinogram was masked to create the effect of partial detector removal and then the proposed CS algorithm was applied to recover the missing PET data. In addition, different levels of noise were simulated to assess the performance of the proposed algorithm. For the phantom study, an IEC phantom with six internal spheres each filled with F-18 at an activity-to-background ratio of 10:1 was used. The phantom was imaged twice on a RX PET/CT scanner: once with all detectors operational (baseline) and once with four detector blocks (11%) turned off at each of 0 °, 90 °, 180 °, and 270° (partially sampled). The partially acquired sinograms were then recovered using the proposed algorithm. For the third test, PET images from six patient studies were investigated using the same strategy of the phantom study. The recovered images using WTV and TV as well as the partially sampled images from all three experiments were then compared with the fully sampled images (the baseline). Comparisons were done by calculating the mean error (%bias), root mean square error (RMSE), contrast recovery (CR), and SNR of activity concentration in regions of interest drawn in the background as well as the disks, spheres, and lesions. Results: For the simulation study, the mean error, RMSE, and CR for the WTV (TV) recovered images were 0.26% (0.48%), 2.6% (2.9%), 97% (96%), respectively, when compared to baseline. For the partially sampled images, these results were 22.5%, 45.9%, and 64%, respectively. For the simulation study, the average SNR for the baseline was 41.7 while for WTV (TV), recovered image was 44.2 (44.0). The phantom study showed similar trends with 5.4% (18.2%), 15.6% (18.8%), and 78% (60%), respectively, for the WTV (TV) images and 33%, 34.3%, and 69% for the partially sampled images. For the phantom study, the average SNR for the baseline was 14.7 while for WTV (TV) recovered image was 13.7 (11.9). Finally, the average of these values for the six patient studies for the WTV-recovered, TV, and partially sampled images was 1%, 7.2%, 92% and 1.3%, 15.1%, 87%, and 27%, 25.8%, 45%, respectively. Conclusions: CS with WTV is capable of recovering PET images with good quantitative accuracy from partially sampled data. Such an approach can be used to potentially reduce the cost of scanners while maintaining good image quality.

60 APPLIED LIFE SCIENCES↗

Combating speckle in SAR images - Vector filtering and sequential classification based on a multiplicative noise model

An adaptive vector linear minimum mean-squared error (LMMSE) filter for multichannel images with multiplicative noise is presented. It is shown theoretically that the mean-squared error in the filter output is reduced by making use of the correlation between image bands. The vector and conventional scalar LMMSE filters are applied to a three-band SIR-B SAR, and their performance is compared. Based on a mutliplicative noise model, the per-pel maximum likelihood classifier was derived. The authors extend this to the design of sequential and robust classifiers. These classifiers are also applied to the three-band SIR-B SAR image.

Lin, Qian↗