Search NASA⌕ Search

SEARCH · Search NASA

Results for “RMSE”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Using optical-microwave synergy for estimating surface energy fluxes over semi-arid rangeland

First results of the Walnut Gulch '92 (Arizona, U.S.) experiment concerning the combined use of radar backscattering (ERS-1) and thermal infrared (LANDSAT TM (Thematic Mapper)) data to estimate surface sensible heat flux are reported. The first step investigates the potential use of ERS-1 SAR (Synthetic Aperture Radar) images for surface soil moisture monitoring of the watershed using five calibrated images acquired during the year 1992 (dry to wet conditions). Results show that despite the typical low level of biomass of semi arid rangeland, an attenuation of the soil backscatter (up to 2 dB) can occur during the rainy season mainly due to the vegetation characteristics. A statistical relationship is then used to retrieve the volumetric surface soil moisture from ERS-1 backscattering (sensitivity of 0.23 dB/% moisture) with a resulting root mean square error of 1.3% of soil moisture. In a second step a semi empirical approach based on energy balance relates soil temperatures to this estimated surface soil moisture. Vegetation temperature is then deduced from soil temperatures and LANDSAT TM composite temperature in order to estimate sensible heat flux according to a two layer type model providing an RMSE of 29 W/sq m.

Troufleau, D.↗

Estimating the urban bias of surface shelter temperatures using upper-air and satellite data. Part 1: Development of models predicting surface shelter temperatures

Multiple regression techniques were used to predict surface shelter temperatures based on the time period 1986-89 using upper-air data from the European Centre for Medium-Range Weather Forecasts (ECMWF) to represent the background climate and site-specific data to represent the local landscape. Global monthly mean temperature models were developed using data from over 5000 stations available in the Global Historical Climate Network (GHCN). Monthly maximum, mean, and minimum temperature models for the United States were also developed using data from over 1000 stations available in the U.S. Cooperative (COOP) Network and comparative monthly mean temperature models were developed using over 1150 U.S. stations in the GHCN. Three-, six-, and full-variable models were developed for comparative purposes. Inferences about the variables selected for the various models were easier for the GHCN models, which displayed month-to-month consistency in which variables were selected, than for the COOP models, which were assigned a different list of variables for nearly every month. These and other results suggest that global calibration is preferred because data from the global spectrum of physical processes that control surface temperatures are incorporated in a global model. All of the models that were developed in this study validated relatively well, especially the global models. Recalibration of the models with validation data resulted in only slightly poorer regression statistics, indicating that the calibration list of variables was valid. Predictions using data from the validation dataset in the calibrated equation were better for the GHCN models, and the globally calibrated GHCN models generally provided better U.S. predictions than the U.S.-calibrated COOP models. Overall, the GHCN and COOP models explained approximately 64%-95% of the total variance of surface shelter temperatures, depending on the month and the number of model variables. In addition, root-mean-square errors (rmse's) were over 3 C for GHCN models and over 2 C for COOP models for winter months, and near 2 C for GHCN models and near 1.5 C for COOP models for summer months.

Epperson, David L.↗

Secondary Forest Age and Tropical Forest Biomass Estimation Using TM

The age of secondary forests in the Amazon will become more critical with respect to the estimation of biomass and carbon budgets as tropical forest conversion continues. Multitemporal Thematic Mapper data were used to develop land cover histories for a 33,000 Square kM area near Ariquemes, Rondonia over a 7 year period from 1989-1995. The age of the secondary forest, a surrogate for the amount of biomass (or carbon) stored above-ground, was found to be unimportant in terms of biomass budget error rates in a forested TM scene which had undergone a 20% conversion to nonforest/agricultural cover types. In such a situation, the 80% of the scene still covered by primary forest accounted for over 98% of the scene biomass. The difference between secondary forest biomass estimates developed with and without age information were inconsequential relative to the estimate of biomass for the entire scene. However, in futuristic scenarios where all of the primary forest has been converted to agriculture and secondary forest (55% and 42% respectively), the ability to age secondary forest becomes critical. Depending on biomass accumulation rate assumptions, scene biomass budget errors on the order of -10% to +30% are likely if the age of the secondary forests are not taken into account. Single-date TM imagery cannot be used to accurately age secondary forests into single-year classes. A neural network utilizing TM band 2 and three TM spectral-texture measures (bands 3 and 5) predicted secondary forest age over a range of 0-7 years with an RMSE of 1.59 years and an R(Squared) (sub actual vs predicted) = 0.37. A proposal is made, based on a literature review, to use satellite imagery to identify general secondary forest age groups which, within group, exhibit relatively constant biomass accumulation rates.

Nelson, R. F.↗

Estimation of Soil Moisture Profile using a Simple Hydrology Model and Passive Microwave Remote Sensing

Soil moisture is an important component of analysis in many Earth science disciplines. Soil moisture information can be obtained either by using microwave remote sensing or by using a hydrologic model. In this study, we combined these two approaches to increase the accuracy of profile soil moisture estimation. A hydrologic model was used to analyze the errors in the estimation of soil moisture using the data collected during Huntsville '96 microwave remote sensing experiment in Huntsville, Alabama. Root mean square errors (RMSE) in soil moisture estimation increase by 22% with increase in the model input interval from 6 hr to 12 hr for the grass-covered plot. RMSEs were reduced for given model time step by 20-50% when model soil moisture estimates were updated using remotely-sensed data. This methodology has a potential to be employed in soil moisture estimation using rainfall data collected by a space-borne sensor, such as the Tropical Rainfall Measuring Mission (TRMM) satellite, if remotely-sensed data are available to update the model estimates.

Soman, Vishwas V.↗

Use of Geostationary Satellite Data to Force Land Surface Schemes within Atmospheric Mesoscale Models

A technique has been developed for assimilating GOES-derived skin temperature tendencies and insolation into the surface energy budget equation of a mesoscale model so that the simulated rate of temperature change closely agrees with the satellite observations. A critical assumption of the technique is that the availability of moisture (either from the soil or vegetation) is the least known term in the model's surface energy budget. Therefore, the simulated latent heat flux, which is a function of surface moisture availability, is adjusted based upon differences between the modeled and satellite-observed skin temperature tendencies. An advantage of this technique is that satellite temperature tendencies are assimilated in an energetically consistent manner that avoids energy imbalances and surface stability problems that arise from direct assimilation of surface shelter temperatures. The fact that the rate of change of the satellite skin temperature is used rather than the absolute temperature means that sensor calibration is not as critical. The technique has been employed on a semi-operational basis at the GHCC within the PSU/NCAR MM5. Assimilation has been performed on a grid centered over the Southeastern US since November 1998. Results from the past year show that assimilation of the satellite data reduces both the bias and RMSE for simulations of surface air temperature and relative humidity. These findings are based on comparison of assimilation runs with a control using the simple 5-layer soil model available in MM5. A significant development in the past several months was the inclusion of the detailed Oregon State University land surface model (OSU/LSM) as an option within MM5. One of our working hypotheses has been that the assimilation technique, although simple, may provide better short-term forecasts than a detailed LSM that requires significant number initialized parameters. Preliminary results indicate that the assimilation out performs the OSU/LSM as it is incorporated in MM5. Details will be presented at the symposium.

Lapenta, William M.↗

Empirical Analysis of EEG and ERPs for Psychophysiological Adaptive Task Allocation

The present study was designed to test the efficacy of using Electroencephalogram (EEG) and Event-Related Potentials (ERPs) for making task allocation decisions. Thirty-six participants were randomly assigned to an experimental, yoked, or control group condition. Under the experimental condition, a tracking task was switched between task modes based upon the participant's EEG. The results showed that the use of adaptive aiding improved performance and lowered subjective workload under negative feedback as predicted. Additionally, participants in the adaptive group had significantly lower RMSE and NASA-TLX ratings than participants in either the yoked or control group conditions. Furthermore, the amplitudes of the N1 and P3 ERP components were significantly larger under the experimental group condition than under either the yoked or control group conditions. These results are discussed in terms of the implications for adaptive automation design.

Prinzel, Lawrence J., III↗

Land Surface Data Assimilation and the Gulf Coast Sea-Breeze

A technique has been developed for assimilating GOES-derived skin temperature tendencies and insolation into the surface energy budget equation of a mesoscale model so that the simulated rate of temperature change closely agrees with the satellite observations. A critical assumption of the technique is that the availability of moisture (either from the soil or vegetation) is the least known term in the model's surface energy budget. Therefore, the simulated latent heat flux, which is a function of surface moisture availability, is adjusted based upon differences between the modeled and satellite observed skin temperature tendencies. An advantage of this technique is that satellite temperature tendencies are assimilated in an energetically consistent manner that avoids energy imbalances and surface stability problems that arise from direct assimilation of surface shelter temperatures. The fact that the rate of change of the satellite skin temperature is used rather than the absolute temperature means that sensor calibration is not as critical. The focus of this paper is to examine how the satellite assimilation technique impacts simulations of near-surface meteorology on the 4- to 48-hour time scale. The technique is implemented within the PSU/NCAR MM5 V34 and applied on a 36-km CONUS domain and a 12-km nest centered over Oklahoma. Two Friday periods during 2000 were selected for study, one during the warm season (May-June) and the other in the cold season (Nov-Dec). Bulk verification statistics (BIAS and RMSE) of surface air temperature and dewpoint show that the assimilation technique can improve numerical simulations on both regional and continental scales. Comparison of the simulated surface energy and water fluxes with observations from Energy Balance Bowen Ratio measurements taken at CART/ARM sites in the Southern Great Plains showed the assimilation technique produces a realistic argument of the Bowen ratio in both seasons. Additional runs with the Oregon State University land surface scheme as implemented within MM5 will be made and comparisons with assimilation results will be presented at the meeting.

Lapenta, William M.↗

Filtering in Hybrid Dynamic Bayesian Networks

We demonstrate experimentally that inference in a complex hybrid Dynamic Bayesian Network (DBN) is possible using the 2 - T i e Slice DBN (2T-DBN) from [Koller & Lerner, 20001 to model fault detection in a watertank system. In [Koller & Lerner, 20001 a generic Particle Filter (PF) is used for inference. We extend the experiment and perform approximate inference using The Extended Kalman Filter (EKF) and the Unscented Kalman Filter (UKF). Furthermore, we combine these techniques in a 'non-strict' Rao-Blackwellisation framework and apply it to the watertank system. We show that UKF and UKF in a PF framework outperfom the generic PF, EKF and EKF in a PF framework with respect to accuracy and robustness in terms of estimation RMSE. Especially we demonstrate the superiority of UKF in a PF framework when our beliefs of how data was generated are wrong. We also show that the choice of network structure is very important for the performance of the generic PF and the EKF algorithms, but not for the UKF algorithms. Furthermore, we investigate the influence of data noise in the water[ank simulation. Theory and implementation is based on the theory presented.

Andersen, Morten Nonboe↗

Filtering in Hybrid Dynamic Bayesian Networks

We implement a 2-time slice dynamic Bayesian network (2T-DBN) framework and make a 1-D state estimation simulation, an extension of the experiment in (v.d. Merwe et al., 2000) and compare different filtering techniques. Furthermore, we demonstrate experimentally that inference in a complex hybrid DBN is possible by simulating fault detection in a watertank system, an extension of the experiment in (Koller & Lerner, 2000) using a hybrid 2T-DBN. In both experiments, we perform approximate inference using standard filtering techniques, Monte Carlo methods and combinations of these. In the watertank simulation, we also demonstrate the use of 'non-strict' Rao-Blackwellisation. We show that the unscented Kalman filter (UKF) and UKF in a particle filtering framework outperform the generic particle filter, the extended Kalman filter (EKF) and EKF in a particle filtering framework with respect to accuracy in terms of estimation RMSE and sensitivity with respect to choice of network structure. Especially we demonstrate the superiority of UKF in a PF framework when our beliefs of how data was generated are wrong. Furthermore, we investigate the influence of data noise in the watertank simulation using UKF and PFUKD and show that the algorithms are more sensitive to changes in the measurement noise level that the process noise level. Theory and implementation is based on (v.d. Merwe et al., 2000).

Andersen, Morten Nonboe↗

Regional Comparison and Assimilation of GOCART and MODIS Aerosol Optical Depth across the Eastern U.S.

This study compares aerosol optical depths (AOD) products from the Moderate Resolution Imaging Spectroradiometer (MODIS) and the Goddard Chemistry Aerosol Radiation and Transport (GOCART) model and their integrated products with ground measurements across the eastern U.S. from March 1, 2000 to December 31, 2001. The Terra MODIS Level-3 (collection 4) AOD at 0.55 pm has better correlation, but consistently overestimates the values of the Aerosol Robotic Network (AERONET) measurements. GOCART has small biases for a 22-month integration, and slight positive biases are appeared for the cold season. These results are also supported by the comparison with the IMPROVE (Interagency Monitoring of Protected Visual Environments) light extinction index. The optimal interpolation improves the daily-scale RMSE from either MODIS or GOCART alone. However, the regional biases in the aerosol products constitute a major constraint to the optimal estimate of AOD.

Matsui, Toshihisa↗

SSC Geopositional Assessment of the Advanced Wide Field Sensor

The objective is to provide independent verification of IRS geopositional accuracy claims and of the internal geopositional characterization provided by Lutes (2005). Six sub-scenes (quads) were assessed; Three from each AWiFS camera. Check points were manually matched to digital orthophoto quarter quadrangle (DOQQ) reference (assumed accuracy approx. 5 m, RMSE) Check points were selected to meet or exceed Federal Geographic Data Committee's guidelines. Used ESRI ArcGIS for data collection and SSC-written MATLAB scripts for data analysis.

Ross, Kenton↗

Accuracy Analysis on Large Blocks of High Resolution Images

Although high altitude frequencies effects are removed at the time of basic image generation, low altitude (Yaw) effects are still present in form of affinity/angular affinity. They are effectively removed by additional parameters. Bundle block adjustment based on properly weighted ephemeris/altitude quaternions (BBABEQ) are not enough to remove the systematic effect. Moreover, due to the narrow FOV of the HRSI, position and altitude are highly correlated making it almost impossible to separate and remove their systematic effects without extending the geometric model (Self-Calib.) The systematic effects gets evident on the increase of accuracy (in terms of RMSE at GCPs) for looser and relaxed ground control at the expense of large and strong block deformation with large residuals at check points. Systematic errors are most freely distributed and their effects propagated all over the block.

Passini, Richardo M.↗

Geopositional Statistical Methods

RMSE based methods distort circular error estimates (up to 50% overestimation). The empirical approach is the only statistically unbiased estimator offered. Ager modification to Shultz approach is nearly unbiased, but cumbersome. All methods hover around 20% uncertainty (@ 95% confidence) for low geopositional bias error estimates. This requires careful consideration in assessment of higher accuracy products.

Ross, Kenton↗

Satellite-Scale Snow Water Equivalent Assimilation into a High-Resolution Land Surface Model

An ensemble Kalman filter (EnKF) is used in a suite of synthetic experiments to assimilate coarse-scale (25 km) snow water equivalent (SWE) observations (typical of satellite retrievals) into fine-scale (1 km) model simulations. Coarse-scale observations are assimilated directly using an observation operator for mapping between the coarse and fine scales or, alternatively, after disaggregation (re-gridding) to the fine-scale model resolution prior to data assimilation. In either case observations are assimilated either simultaneously or independently for each location. Results indicate that assimilating disaggregated fine-scale observations independently (method 1D-F1) is less efficient than assimilating a collection of neighboring disaggregated observations (method 3D-Fm). Direct assimilation of coarse-scale observations is superior to a priori disaggregation. Independent assimilation of individual coarse-scale observations (method 3D-C1) can bring the overall mean analyzed field close to the truth, but does not necessarily improve estimates of the fine-scale structure. There is a clear benefit to simultaneously assimilating multiple coarse-scale observations (method 3D-Cm) even as the entire domain is observed, indicating that underlying spatial error correlations can be exploited to improve SWE estimates. Method 3D-Cm avoids artificial transitions at the coarse observation pixel boundaries and can reduce the RMSE by 60% when compared to the open loop in this study.

De Lannoy, Gabrielle J.M.↗

Verify MesoNAM Performance

The AMU conducted an objective analysis of the MesoNAM forecasts compared to observed values from sensors at specified KSC/CCAFS wind towers by calculating the following statistics to verify the performance of the model: 1) Bias (mean difference), 2) Standard deviation of Bias, 3) Root Mean Square Error (RMSE), and 4) Hypothesis test for Bias = O. The 45 WS LWOs use the MesoNAM to support launch weather operations. However, the actual performance of the model at KSC and CCAFS had not been measured objectively. The analysis compared the MesoNAM forecast winds, temperature and dew point to the observed values from the sensors on wind towers. The data were stratified by tower sensor, month and onshore/offshore wind direction based on the orientation of the coastline to each tower's location. The model's performance statistics were then calculated for each wind tower based on sensor height and model initialization time. The period of record for the data used in this task was based on the operational start of the current MesoNAM in mid-August 2006 and so the task began with the first full month of data, September 2006, through May 2010. The analysis of model performance indicated: a) The accuracy decreased as the forecast valid time from the model initialization increased, b) There was a diurnal signal in T with a cool bias during the late night and a warm bias during the afternoon, c) There was a diurnal signal in Td with a low bias during the afternoon and a high bias during the late night, and d) The model parameters at each vertical level most closely matched the observed parameters at heights closest to those vertical levels. The AMU developed a GUI that consists of a multi-level drop-down menu written in JavaScript embedded within the HTML code. This tool allows the LWO to easily and efficiently navigate among the charts and spreadsheet files containing the model performance statistics. The objective statistics give the LWOs knowledge of the model's strengths and weaknesses and the GUI allows quick access to the data which will result in improved forecasts for operations.

Bauman, William H., III↗

Effects of Spatio-Temporal Aliasing on Pilot Performance in Active Control Tasks

Spatio-temporal aliasing affects pilot performance and control behavior. For increasing refresh rates: 1) Significant change in control behavior: a) Increase in visual gain and neuromuscular frequency. b) Decrease in visual time delay. 2) Increase in tracking performance: a) Decrease in RMSe. b) Increase in crossover frequency.

Zaal, Peter↗

Measuring Effective Leaf Area Index, Foliage Profile, and Stand Height in New England Forest Stands Using a Full-Waveform Ground-Based Lidar

Effective leaf area index (LAI) retrievals from a scanning, ground-based, near-infrared (1064 nm) lidar that digitizes the full return waveform, the Echidna Validation Instrument (EVI), are in good agreement with those obtained from both hemispherical photography and the Li-Cor LAI-2000 Plant Canopy Analyzer. We conducted trials at 28 plots within six stands of hardwoods and conifers of varying height and stocking densities at Harvard Forest, Massachusetts, Bartlett Experimental Forest, New Hampshire, and Howland Experimental Forest, Maine, in July 2007. Effective LAI values retrieved by four methods, which ranged from 3.42 to 5.25 depending on the site and method, were not significantly different ( b0.1 among four methods). The LAI values also matched published values well. Foliage profiles (leaf area with height) retrieved from the lidar scans, although not independently validated, were consistent with stand structure as observed and as measured by conventional methods. Canopy mean top height, as determined from the foliage profiles, deviated from mean RH100 values obtained from the Lidar Vegetation Imaging Sensor (LVIS) airborne large-footprint lidar system at 27 plots by .0.91 m with RMSE=2.04 m, documenting the ability of the EVI to retrieve stand height. The Echidna Validation Instrument is the first realization of the Echidna lidar concept, devised by Australia's Commonwealth Scientific and Industrial Research Organization (CSIRO), for measuring forest structure using full-waveform, ground-based, scanning lidar.

Zhao, Feng↗

Utilizing In Situ Directional Hyperspectral Measurements to Validate Bio-Indicator Simulations for a Corn Crop Canopy

Two radiative transfer canopy models, SAIL and the two-layer Markov-Chain Canopy Reflectance Model (MCRM), were coupled with in situ leaf optical properties to simulate canopy-level spectral band ratio vegetation indices with the focus on the photochemical reflectance index in a cornfield. In situ hyperspectral measurements were made at both leaf and canopy levels. Leaf optical properties were obtained from both sunlit and shaded leaves. Canopy reflectance was acquired for eight different relative azimuth angles (psi) at three different view zenith angles (Theta (sub v)), and later used to validate model outputs. Field observations of photochemical reflectance index (PRI) for sunlit leaves exhibited lower values than shaded leaves, indicating higher light stress. Canopy PRI expressed obvious sensitivity to viewing geometry, as a function of both Theta (sub v) and psi . Overall, simulations from MCRM exhibited better agreements with in situ values than SAIL. When using only sunlit leaves as input, the MCRM-simulated PRI values showed satisfactory correlation and RMSE, as compared to in situ values. However, the performance of the MCRM model was significantly improved after defining a lower canopy layer comprised of shaded leaves beneath the upper sunlit leaf layer. Four other widely used band ratio vegetation indices were also studied and compared with the PRI results. MCRM simulations were able to generate satisfactory simulations for these other four indices when using only sunlit leaves as input; but unlike PRI, adding shaded leaves did not improve the performance of MCRM. These results support the hypothesis that the PRI is sensitive to physiological dynamics while the others detect static factors related to canopy structure. Sensitivity analysis was performed on MCRM in order to better understand the effects of structure related parameters on the PRI simulations. Leaf area index (LAI) showed the most significant impact on MCRM-simulated PRI among the parameters studied. This research shows the importance of hyperspectral and narrow band sensor studies, and especially the necessity of including the green wavelengths (e.g., 531 nm) on satellites proposing to monitor carbon dynamics of terrestrial ecosystems.

Cheng, Yen-Ben↗