Search NASA⌕ Search

SEARCH · Search NASA

Results for “missing data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Systematic errors in Hadamard transform optics

Error sources encountered in Hadamard transform optical instruments are discussed. Such errors are caused by factors including moving masks, incorrect mask alignment, defects in mask fabrication, missing data, drifts in background level, and diffraction. Techniques for error reduction and/or elimination are described for each of the cases considered. It is noted that the errors described occur in singly encoded spectrometers and imagers.

Sloane, N. J. A.↗

On the stellar rotation-activity connection

The relationship between rotation rates and surface activity in late-type dwarf stars is explored in a survey of recent theoretical and observational studies. Current theoretical models of stellar-magnetic-field production and coronal activity are examined, including linear kinematic dynamo theory, nonlinear dynamos using approximations, and full numerical simulations of the MHD equations; and some typical results are presented graphically. The limitations of the modeling procedures and the constraints imposed by the physics are indicated. The statistical techniques used in establishing correlations between various observational parameters are analyzed critically, and the methods developed for quasar luminosity functions by Avni et al. (1980) are used to evaluate the effects of upper detection bounds, incomplete samples, and missing data for the case of rotation and X-ray flux data.

Rosner, R.↗

Structure and evolution of the large scale solar and heliospheric magnetic fields

Structure and evolution of large scale photospheric and coronal magnetic fields in the interval 1976-1983 were studied using observations from the Stanford Solar Observatory and a potential field model. The solar wind in the heliosphere is organized into large regions in which the magnetic field has a componenet either toward or away from the sun. The model predicts the location of the current sheet separating these regions. Near solar minimum, in 1976, the current sheet lay within a few degrees of the solar equator having two extensions north and south of the equator. Soon after minimum the latitudinal extent began to increase. The sheet reached to at least 50 deg from 1978 through 1983. The complex structure near maximum occasionally included multiple current sheets. Large scale structures persist for up to two years during the entire interval. To minimize errors in determining the structure of the heliospheric field particular attention was paid to decreasing the distorting effects of rapid field evolution, finding the optimum source surface radius, determining the correction to the sun's polar field, and handling missing data. The predicted structure agrees with direct interplanetary field measurements taken near the ecliptic and with coronameter and interplanetary scintillation measurements which infer the three dimensional interplanetary magnetic structure. During most of the solar cycle the heliospheric field cannot be adequately described as a dipole.

Hoeksema, J. T.↗

An evidential approach to problem solving when a large number of knowledge systems is available

Some recent problems are no longer formulated in terms of imprecise facts, missing data or inadequate measuring devices. Instead, questions pertaining to knowledge and information itself arise and can be phrased independently of any particular area of knowledge. The problem considered in the present work is how to model a problem solver that is trying to find the answer to some query. The problem solver has access to a large number of knowledge systems that specialize in diverse features. In this context, feature means an indicator of what the possibilities for the answer are. The knowledge systems should not be accessed more than once, in order to have truly independent sources of information. Moreover, these systems are allowed to run in parallel. Since access might be expensive, it is necessary to construct a management policy for accessing these knowledge systems. To help in the access policy, some control knowledge systems are available. Control knowledge systems have knowledge about the performance parameters status of the knowledge systems. In order to carry out the double goal of estimating what units to access and to answer the given query, diverse pieces of evidence must be fused. The Dempster-Shafer Theory of Evidence is used to pool the knowledge bases.

Dekorvin, Andre↗

Empirical orthogonal function analysis of cloud-containing coastal zone color scanner images of northeastern North American coastal waters

Empirical-orthogonal-function (EOF) analyses were carried out on 36 images of the Mid-Atlantic Bight and the Gulf of Maine, obtained by the CZCS aboard Nimbus 7 for the time period from February 28 through July 9, 1979, with the purpose of determining pigment concentrations in coastal waters. The EOF procedure was modified so as to include images with significant portions of data missing due to cloud obstruction, making it possible to estimate pigment values in areas beneath clouds. The results of image analyses explained observed variances in pigment concentrations and showed a south-to-north pattern corresponding to an April Mid-Atlantic Bight bloom and a June bloom over Nantucket Shoals and Platts Bank.

Eslinger, David L.↗

ECLIPS at LMD: Preliminary results of phase 2

The LMD (Laboratoire de Meteorologie Dynamique) ground-based backscatter lidar station (48 degrees 4 N, 02 degrees 0 E) near Paris was operated daily during the phase 2 of the Experimental Closed Lidar Pilot Study (ECLIPS) from May 22 to June 19, 1991 simultaneously with a radiometric equipment recording the downward short wavelength (SW) and long wavelength (LW) fluxes. A day-by-day summary of the field measurement as a function of universal time (UT) is given. Considering a 5 days week, there are only two days of missing data (05/31 and 06/06) in our record. The nearby meteorological station (10 km away) provides rawindsounding at 00UT and 12UT. During two days, the French airborne lidar LEANDRE was flown over the ground-based station. The airborne equipment looked down while the ground based equipment looked up. The two lidars were operated at 532 nm, and the on-board radiometers were identical to the ones on the ground. The measurements were synchronized with Advanced Very High Resolution Radiometer (AVHIRR) overpasses as required. We also indicate the Meteosat data corresponding to the period of measurements. Two examples of simultaneous ground-based lidar, pygeometer and pyranometer data are displayed.

Valentin, R.↗

An improved conscan algorithm based on a Kalman filter

Conscan is commonly used by DSN antennas to allow adaptive tracking of a target whose position is not precisely known. This article describes an algorithm that is based on a Kalman filter and is proposed to replace the existing fast Fourier transform based (FFT-based) algorithm for conscan. Advantages of this algorithm include better pointing accuracy, continuous update information, and accommodation of missing data. Additionally, a strategy for adaptive selection of the conscan radius is proposed. The performance of the algorithm is illustrated through computer simulations and compared to the FFT algorithm. The results show that the Kalman filter algorithm is consistently superior.

Eldred, D. B.↗

Reducing Noise in the MSU Daily Lower-Tropospheric Global Temperature Dataset

The daily global-mean values of the lower-tropospheric temperature determined from microwave emissions measured by satellites are examined in terms of their signal, noise, and signal-to-noise ratio. Daily and 30-day average noise estimates are reduced by, almost 50% and 35%, respectively, by analyzing and adjusting (if necessary) for errors due to (1) missing data, (2) residual harmonics of the annual cycle unique to particular satellites, (3) lack of filtering, and (4) spurious trends. After adjustments, the decadal trend of the lower-tropospheric global temperature from January 1979 through February 1994 becomes -0.058 C, or about 0.03 C per decade cooler than previously calculated.

Christy, John R.↗

Reducing Noise in the MSU Daily Lower-Tropospheric Global Temperature Dataset

The daily global-mean values of the lower-tropospheric temperature determined from microwave emissions measured by satellites are examined in terms of their signal, noise, and signal-to-noise ratio. Daily and 30-day average noise estimates are reduced by almost 50% and 35%. respectively, by analyzing and adjusting (if necessary) for errors due to 1) missing data, 2) residual harmonics of the annual cycle unique to particular satellites, 3) lack of filtering, and 4) spurious trends. After adjustments, the decadal trend of the lower-tropospheric global temperature from January 1979 through February 1994 becomes -0.058 C. or about 0.03 C per decade cooler than previously calculated.

Christy, John R.↗

Validation and Improvement of SRTM Performance over Rugged Terrain

We have previously reported work related to basic technique development in phase unwrapping and generation of digital elevation models (DEM). In the final year of this work we have applied our technique work to the improvement of DEM's produced by SRTM. In particular, we have developed a rigorous mathematical algorithm and means to fill in missing data over rough terrain from other data sets. We illustrate this method by using a higher resolution, but globally less accurate, DEM produced by the TOPSAR airborne instrument over the Galapagos Islands to augment the SRTM data set in this area, We combine this data set with SRTM to use each set to fill in holes left over by the other imaging system. The infilling is done by first interpolating each data set using a prediction error filter that reproduces the same statistical characterization as exhibited by the entire data set within the interpolated region. After this procedure is implemented on each data set, the two are combined on a point by point basis with weights that reflect the accuracy of each data point in its original image. In areas that are better covered by SRTM, TOPSAR data are weighted down but still retain TOPSAR statistics. The reverse is true for regions better covered by TOPSAR. The resulting DEM passes statistical tests and appears quite feasible to the eye, but as this DEM is the best available for the region we cannot fully veri@ its accuracy. Spot checks with GPS points show that locally the technique results in a more comprehensive and accurate map than either data set alone.

Zebker, Howard A.↗

Assessment of the Short-Term Radiometric Stability between Terra MODIS and Landsat 7 ETM+ Sensors

The Landsat 7 (L7) Enhanced Thematic Mapper (ETM+) sensor was launched on April 15th, 1999 and has been in operation for over nine years. It has six reflective solar spectral bands located in the visible and shortwave infrared part of the electromagnetic spectrum (0.5 - 2.5 micron) at a spatial resolution of 30 m. The on-board calibrators are used to monitor the on-orbit sensor system changes. The ETM+ performs solar calibrations using on-board Full Aperture Solar Calibrator (FASC) and the Partial Aperture Solar Calibrator (PASC). The Internal Calibrator Lamp (IC) lamps, a blackbody and shutter optics constitute the on-orbit calibration mechanism for ETM+. On 31 May 2003, a malfunction of the scan-line corrector (SLC) mirror assembly resulted in the loss of approximately 22% of the normal scene area. The missing data affects most of the image with scan gaps varying in width from one pixel or less near the centre of the image to 14 pixels along the east and west edges of the image, creating a wedge-shaped pattern. However, the SLC failure has no impacts on the radiometric performance of the valid pixels. On December 18, 1999, the Moderate Resolution Imaging Spectroradiometer (MODIS) Proto-Flight Model (PFM) was launched on-board the NASA's EOS Terra spacecraft. Terra MODIS has 36 spectral bands with wavelengths ranging from 0.41 to 14.5 micron and collects data over a wide field of view angle (+/-55 deg) at three nadir spatial resolutions of 250 m, 500 in 1 km for bands 1 to 2, 3 to 7, and 8 to 36, respectively. It has 20 reflective solar bands (RSB) with spectral wavelengths from 0.41 to 2.1 micron. The RSB radiometric calibration is performed by using on-board solar diffuser (SD), solar diffuser stability monitor (SDSM), space-view (SV), and spectro-radiometric calibration assembly (SRCA). Through the SV port, periodic lunar observations are used to track radiometric response changes at different angles of incidence (AOI) of the scan mirror. As a part of the AM Constellation satellites, Terra MODIS flies approximately 30 minutes behind L7 ETM+ in the same orbit. The orbit of L7 is repetitive, circular, sunsynchronous, and near polar at a nominal altitude of 705 km (438 miles) at the Equator. The spacecraft crosses the Equator from north to south on a descending node between 10:00 AM and 10:15 AM. Circling the Earth at 7.5 km/sec, each orbit takes nearly 99 minutes. The spacecraft completes just over 14 orbits per day, covering the entire Earth between 81 degrees north and south latitude every 16 days. The longest continuous imaging swath that L7 sensor can collect is for a 14-minute subinterval contact period which is equivalent to 35 full WRS-2 scenes. On the other hand, Terra can provide the entire corresponding orbit with wider swath at any given ETM+ collection without contact time limitation. There are six spectral matching band pairs between MODIS (bands 3, 4, 1, 2, 6, 7) and ETM+ (bands 1, 2, 3, 4, 5, 7) sensor. MODIS has narrower spectral responses than ETM+ in all the bands. A short-term radiometric stability was evaluated using continuous ETM+ scenes within the contact period and the corresponding half orbit MODIS scenes. The near simultaneous earth observations (SNO) were limited by the smaller swath size of ETM+ (187 km) as compared to MODIS (2330 km). Two sets of continuous granules for MODIS and ETM+ were selected and mosaiced based on pixel geolocation information for non cloudy pixels over the North American continent. The Top-of- Atmosphere (TOA) reflectances were computed for the spectrally matching bands between ETM+ and MODIS over the regions of interest (ROI). The matching pixel pairs were aggregated from a finer to a coarser pixel resolution and the TOA reflectance values covering a wide dynamic range of the sensors were compared and analyzed. Considering the uncertainties of the absolute calibration of the both sensors, radiometric stability was verified for the band pairs. The Railroad Valley Playa, Nada (RVPN) was included in the path of this continuous orbit, which served as a verification point between the shortterm and the long-term trending results from previous studies. This work focuses on monitoring the short-term on-orbit stability of MODIS and the ETM+ RSB. It also provides an assessment of the absolute calibration differences between the two sensors over their wide dynamic ranges.

Choi, Taeyoung↗

Relationship Between Carbon Dioxide Levels and Reported Congestion and Headaches on the International Space Station

Congestion is commonly reported during spaceflight, and most crewmembers have reported using medications for congestion during International Space Station (ISS) missions. Although congestion has been attributed to fluid shifts during spaceflight, fluid status reaches equilibrium during the first week after launch while congestion continues to be reported throughout long duration missions. Congestion complaints have anecdotally been reported in relation to ISS CO2 levels; this evaluation was undertaken to determine whether or not an association exists. METHODS: Reported headaches, congestion symptoms, and CO2 levels were obtained for ISS expeditions 2-31, and time-weighted means and single-point maxima were determined for 24-hour (24hr) and 7-day (7d) periods prior to each weekly private medical conference. Multiple imputation addressed missing data, and logistic regression modeled the relationship between probability of reported event of congestion or headache and CO2 levels, adjusted for possible confounding covariates. The first seven days of spaceflight were not included to control for fluid shifts. Data were evaluated to determine the concentration of CO2 required to maintain the risk of congestion below 1% to allow for direct comparison with a previously published evaluation of CO2 concentrations and headache. RESULTS: This study confirmed a previously identified significant association between CO2 and headache and also found a significant association between CO2 and congestion. For each 1-mm Hg increase in CO2, the odds of a crew member reporting congestion doubled. The average 7-day CO2 would need to be maintained below 1.5 mmHg to keep the risk of congestion below 1%. The predicted probability curves of ISS headache and congestion curves appear parallel when plotted against ppCO2 levels with congestion occurring at approximately 1mmHg lower than a headache would be reported. DISCUSSION: While the cause of congestion is multifactorial, this study showed congestion is associated with CO2 levels on ISS. Data from additional expeditions could be incorporated to further assess this finding. CO2 levels are also associated with reports of headaches on ISS. While it may be expected for astronauts with congestion to also complain of headaches, these two symptoms are commonly mutually exclusive. Furthermore, it is unknown if a temporal CO2 relationship exists between congestion and headache on ISS. CO2 levels were time-weighted for 24hr and 7d, and thus the time course of congestion leading to headache was not assessed; however, congestion could be an early CO2-related symptom when compared to headache. Future studies evaluating the association of CO2-related congestion leading to headache would be difficult due to the relatively stable daily CO2 levels on ISS currently, but a systematic study could be implemented on-orbit if desired.

Cole, Robert↗

Computational Bayesian Methods Applied to Complex Problems in Bio and Astro Statistics

In this dissertation we apply computational Bayesian methods to three distinct problems. In the first chapter, we address the issue of unrealistic covariance matrices used to estimate collision probabilities. We model covariance matrices with a Bayesian Normal-Inverse-Wishart model, which we fit with Gibbs sampling. In the second chapter, we are interested in determining the sample sizes necessary to achieve a particular interval width and establish non-inferiority in the analysis of prevalences using two fallible tests. To this end, we use a third order asymptotic approximation. In the third chapter, we wish to synthesize evidence across multiple domains in measurements taken longitudinally across time, featuring a substantial amount of structurally missing data, and fit the model with Hamiltonian Monte Carlo in a simulation to analyze how estimates of a parameter of interest change across sample sizes.

Elrod, Chris↗

Satellite Remote Sensing to Assess Cyanobacterial Bloom Frequency Across the United States at Multiple Spatial Scales

Cyanobacterial blooms can have negative effects on human health and local ecosystems. Field monitoring of cyanobacterial blooms can be costly, but satellite remote sensing has shown utility for more efficient spatial and temporal monitoring across the United States. Here, satellite imagery was used to assess the annual frequency of surface cyanobacterial blooms, defined for each satellite pixel as the percentage of images for that pixel throughout the year exhibiting detectable cyanobacteria. Cyanobacterial frequency was assessed across 2,196 large lakes in 46 states across the continental United States (CONUS) using imagery from the European Space Agency’s Ocean and Land Colour Imager for the years 2017 through 2019. In 2019, across all satellite pixels considered, annual bloom frequency had a median value of 4% and a maximum value of 100%, the latter indicating that for those satellite pixels, a cyanobacterial bloom was detected by the satellite sensor for every satellite image considered. In addition to annual pixel-scale cyanobacterial frequency, results were summarized at the lake- and state-scales by averaging annual pixel-scale results across each lake and state. For 2019, average annual lake-scale frequencies also had a maximum value of 100%, and Oregon and Ohio had the highest average annual state-scale frequencies at 65% and 52%. Pixel-scale frequency results can assist in identifying portions of a lake that are more prone to cyanobacterial blooms, while lake- and state-scale frequency results can assist in the prioritization of sampling resources and mitigation efforts. Satellite imagery is limited by the presence of snow and ice, as imagery collected in these conditions are quality flagged and discarded. Thus, annual bloom frequencies within nine climate regions were investigated to determine whether missing data biased results in climate regions more prone to snow and ice, given that their annual summaries would be weighted toward the summer months when cyanobacterial blooms tend to occur. Results were unbiased by the time period selected in most climate regions, but a large bias was observed for the Northwest Rockies and Plains climate region. Moderate biases were observed for the Ohio Valley and the Southeast climate regions. Finally, a clustering analysis was used to identify areas of high and low cyanobacterial frequency across CONUS based on average annual lake-scale cyanobacterial frequencies for 2019. Several clusters were identified that transcended state, watershed, and eco-regional boundaries. Combined with additional data, results from the clustering analysis may offer insight regarding large-scale drivers of cyanobacterial blooms.

remote sensing↗

Understanding Pilot Breathing – A Case Study in Systems Engineering

This position paper assesses the Pilot Breathing Assessment’s driving requirement to collect missing data on pilot breathing pressure, flow, rate, oxygen and CO2, simultaneously with aircraft data. Repeat measures data were collected over a 2-year period from 5 NASA test-pilots flying 8 flight profiles on NASA F-15 and F/A-18 (A, B) aircraft. This Pilot Breathing Assessment Systems Engineering (PiBASE) position paper serves as a case-study of systems engineering that accommodates the human as a distinct part of the whole. It acknowledges that a successful machine design intended for human use must include human systems biology/physiology as an integral part of planning, design, and implementation.

Pilot Breathing Assessment Systems Engineering↗

Generalized Modeling of Enrichment Cascades That Include Minor Isotopes

The monitoring of enrichment operations may require innovative analysis to allow for imperfect or missing data. The presence of minor isotopes may help or hurt - they can complicate a calculation or provide additional data to corroborate a calculation. However, they must be considered in a rigorous analysis, especially in cases involving reuse. This study considers matched-abundanceratio cascades that involve at least three isotopes and allows generalized input that does not require all feed assays or the enrichment factor to be specified. Calculations are based on the equations developed for the MSTAR code but are generalized to allow input of various combinations of assays, flows, and other cascade properties. Traditional cascade models have required specification of the enrichment factor, all feed assays, and the product and waste assays of the primary enriched component. The calculation would then produce the numbers of stages in the enriching and stripping sections and the remaining assays in waste and product streams. In cases where the enrichment factor or feed assays were not known, analysis was difficult or impossible. However, if other quantities are known (e.g., additional assays in waste or product streams), a reliable calculation is still possible with the new code, but such nonstandard input may introduce additional numerical difficulties into the calculation. Thus, the minimum input requirements for a stable solution are discussed, and a sample problem with a non-unique solution is described. Both heuristic and mathematically required guidelines are given to assist the application of cascade modeling to situations involving such non-standard input. As a result, this work provides both a calculational tool and specific guidance for evaluation of enrichment cascades in which traditional input data are either flawed or unknown. It is useful for cases involving minor isotopes, especially if the minor isotope assays are desired (or required) to be important contributors to the overall analysis.

99 GENERAL AND MISCELLANEOUS↗

Nuclear Forensics Analysis with Missing and Uncertain Data

We have applied a new imputation-based method for analyzing incomplete data, called Monte Carlo Bayesian Database Generation (MCBDG), to the Spent Fuel Isotopic Composition (SFCOMPO) database. About 60% of the entries are absent for SFCOMPO. The method estimates missing values of a property from a probability distribution created from the existing data for the property, and then generates multiple instances of the completed database for training a machine learning algorithm. Uncertainty in the data is represented by an empirical or an assumed error distribution. The method makes few assumptions about the underlying data, and compares favorably against results obtained by replacing missing information with constant values.

97 MATHEMATICS AND COMPUTING↗

Imputing data that are missing at high rates using a boosting algorithm

Traditional multiple imputation approaches may perform poorly for datasets with high rates of missingness unless many m imputations are used. This paper implements an alternative machine learning-based approach to imputing data that are missing at high rates. Here, we use boosting to create a strong learner from a weak learner fitted to a dataset missing many observations. This approach may be applied to a variety of types of learners (models). The approach is demonstrated by application to a spatiotemporal dataset for predicting dengue outbreaks in India from meteorological covariates. A Bayesian spatiotemporal CAR model is boosted to produce imputations, and the overall RMSE from a k-fold cross-validation is used to assess imputation accuracy.

97 MATHEMATICS AND COMPUTING↗