Search NASA⌕ Search

SEARCH · Search NASA

Results for “missing data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

An interactive environment for the analysis of large Earth observation and model data sets

We propose to develop an interactive environment for the analysis of large Earth science observation and model data sets. We will use a standard scientific data storage format and a large capacity (greater than 20 GB) optical disk system for data management; develop libraries for coordinate transformation and regridding of data sets; modify the NCSA X Image and X DataSlice software for typical Earth observation data sets by including map transformations and missing data handling; develop analysis tools for common mathematical and statistical operations; integrate the components described above into a system for the analysis and comparison of observations and model results; and distribute software and documentation to the scientific community.

Bowman, Kenneth P.↗

Holographic interferometry of transparent media with reflection from imbedded test objects

In applying holographic interferometry, opaque objects blocking a portion of the optical beam used to form the interferogram give rise to incomplete data for standard computer tomography algorithms. An experimental technique for circumventing the problem of data blocked by opaque objects is presented. The missing data are completed by forming an interferogram using light backscattered from the opaque object, which is assumed to be diffuse. The problem of fringe localization is considered.

Prikryl, I.↗

Variance Analysis of Unevenly Spaced Time Series Data

We have investigated the effect of uneven data spacing on the computation of delta (sub chi)(gamma). Evenly spaced simulated data sets were generated for noise processes ranging from white phase modulation (PM) to random walk frequency modulation (FM). Delta(sub chi)(gamma) was then calculated for each noise type. Data were subsequently removed from each simulated data set using typical two-way satellite time and frequency transfer (TWSTFT) data patterns to create two unevenly spaced sets with average intervals of 2.8 and 3.6 days. Delta(sub chi)(gamma) was then calculated for each sparse data set using two different approaches. First the missing data points were replaced by linear interpolation and delta (sub chi)(gamma) calculated from this now full data set. The second approach ignored the fact that the data were unevenly spaced and calculated delta(sub chi)(gamma) as if the data were equally spaced with average spacing of 2.8 or 3.6 days. Both approaches have advantages and disadvantages, and techniques are presented for correcting errors caused by uneven data spacing in typical TWSTFT data sets.

Hackman, Christine↗

Potential Use of a Bayesian Network for Discriminating Flash Type from Future GOES-R Geostationary Lightning Mapper (GLM) data

Continuous monitoring of the ratio of cloud flashes to ground flashes may provide a better understanding of thunderstorm dynamics, intensification, and evolution, and it may be useful in severe weather warning. The National Lighting Detection Network TM (NLDN) senses ground flashes with exceptional detection efficiency and accuracy over most of the continental United States. A proposed Geostationary Lightning Mapper (GLM) aboard the Geostationary Operational Environmental Satellite (GOES-R) will look at the western hemisphere, and among the lightning data products to be made available will be the fundamental optical flash parameters for both cloud and ground flashes: radiance, area, duration, number of optical groups, and number of optical events. Previous studies have demonstrated that the optical flash parameter statistics of ground and cloud lightning, which are observable from space, are significantly different. This study investigates a Bayesian network methodology for discriminating lightning flash type (ground or cloud) using the lightning optical data and ancillary GOES-R data. A Directed Acyclic Graph (DAG) is set up with lightning as a "root" and data observed by GLM as the "leaves." This allows for a direct calculation of the joint probability distribution function for the lighting type and radiance, area, etc. Initially, the conditional probabilities that will be required can be estimated from the Lightning Imaging Sensor (LIS) and the Optical Transient Detector (OTD) together with NLDN data. Directly manipulating the joint distribution will yield the conditional probability that a lightning flash is a ground flash given the evidence, which consists of the observed lightning optical data [and possibly cloud data retrieved from the GOES-R Advanced Baseline Imager (ABI) in a more mature Bayesian network configuration]. Later, actual GLM and NLDN data can be used to refine the estimates of the conditional probabilities used in the model; i.e., the Bayesian network is a learning network. Methods for efficient calculation of the conditional probabilities (e.g., an algorithm using junction trees), finding data conflicts, goodness of fit, and dealing with missing data will also be addressed.

Solakiewiz, Richard↗

Using A Guided Interview to Create an Individual Exposure Profile for The Lifetime Surveillance of Astronaut Health (LSAH)

BACKGROUND To support NASA’s Lifetime Surveillance of Astronaut Health (LSAH) project, Individual Exposure Profiles (IEPs) were developed to record an astronaut’s pre-, in-, and post-NASA exposures. NASA astronauts were invited to participate in a one-time guided interview to review known hazard exposures and medical history documented in NASA records and to add new information not otherwise reported. The purpose of the IEP project was to determine if any significant information was gained from these interviews and identify potential trends in long-term health. METHODOLOGY The pre-filled exposure profile data was extracted from several sources including medical records, biographies, and LSAH records. The information that was pre-filled before the interview included occupational exposures prior to selection to the Astronaut Corps, during active astronaut career (e.g., EVA and ground-based training, on-orbit exposures), and after active career. The IEPs also contained relevant medical history (e.g., audiometry, illnesses, injuries) and significant non-occupational exposures. 189 interviews were conducted from 2012-2014. A Microsoft Access database was created to store the information collected in the IEPs before and after the interviews. The database houses the information from the IEPs to track the updates made to the original data. By analyzing which astronauts supplied additional information and which kinds of data were consistently added, potential gaps and trends in missing data may be identified. In designing the database, an efficient structure was implemented for ease of inputting data and to create variables that would generate quantifiable data. Creating standardized variables within the structure helped ease the process of inputting, organizing data, and analyzing data. Additional updates/data were denoted and were categorized by type of update. The categories identified were “Confirmed”, “Confirmed & Supplemented”, “Supplemented”, “Denied”, “Denied & Supplemented”, and “Other”. STATISTICAL ANALYSIS AND RESULTS To assess frequency of exposure updates, descriptive statistics will be generated and stratified by relevant factors such as astronaut selection decade, age at selection, and program/era. Hypothesis testing will be performed to understand the associations between updates to exposure information and population characteristics.

Astronaut health↗

Sampling, aggregation, and variance estimation for area, yield, and production in LACIE

An approximately 2% sampling error was achieved in LACIE by sampling only approximately 2% of the sampling frame. The sample design in the yardstick region for which historical data were available down to a substratum level to support missing data resulting from cloud cover provided the most accurate estimate possible. The implemented strategy provided data of sufficient quality and quantity to support required performance levels and also to satisfy the existing constraints. The allocation scheme appeared to provide the most efficient usage of the available data and gave segment coverage of major producing areas and thus improved the probability of an accurate estimate.

Hallum, C. R.↗

The International Halley Watch

The International Halley Watch has been designed to maximize the scientific value of ground-based observations of Halley's Comet. Important in their own right, such observations have also enhanced the value of space observations, setting the brief duration flyby data in the context of the overall apparition, placing the extremely high resolution encounter data into the normal scale of observations, and filling in missing data. The IHW has standardized observing techniques wherever useful and possible, coordinated the observing, and is now collecting data from publication in a comprehensive Halley Archieve. The IHW has been designed to avoid the problems of 1910 where the two major monographs on Halley were not published until 21 and 24 years later and where much data remains unpublished to this day. The Giacobini-Zinner Watch preovided support to the ICE mission and complements the IHW by using the same ground-based techniques at the same time of study another very different comet for comparison.

Newburn, R. L., Jr.↗

The VIS-AD data model: Integrating metadata and polymorphic display with a scientific programming language

The VIS-AD data model integrates metadata about the precision of values, including missing data indicators and the way that arrays sample continuous functions, with the data objects of a scientific programming language. The data objects of this data model form a lattice, ordered by the precision with which they approximate mathematical objects. We define a similar lattice of displays and study visualization processes as functions from data lattices to display lattices. Such functions can be applied to visualize data objects of all data types and are thus polymorphic.

Hibbard, William L.↗

Tropical synoptic composites in VAS, OLR and TOVS radiance data

The horizontal structure of specific tropical synoptic features are compared with the features of a zonal mean ITCZ using four different forms of satellite radiance data: daily gridded OLR data, GOES VAS water vapor imagery, brightness temperatures from TOVS water vapor channels (6.7 and 7.3 microns), and brightness temperature vectors for a complete set of TOVS channels. All of the data are composited over many events to minimize the effects of missing data, sampling errors, and system variability. The major differences between the observing systems are examined, focusing on resolution and clouds. It is found that the ITCZ exhibits a zonally symmetric convective phase and an enhanced regional convective phase (plumes), both of which can be differentiated from climatological mean behavior.

Mcguirk, James P.↗

Efficient Kriging Algorithms

More efficient versions of an interpolation method, called kriging, have been introduced in order to reduce its traditionally high computational cost. Written in C++, these approaches were tested on both synthetic and real data. Kriging is a best unbiased linear estimator and suitable for interpolation of scattered data points. Kriging has long been used in the geostatistic and mining communities, but is now being researched for use in the image fusion of remotely sensed data. This allows a combination of data from various locations to be used to fill in any missing data from any single location. To arrive at the faster algorithms, sparse SYMMLQ iterative solver, covariance tapering, Fast Multipole Methods (FMM), and nearest neighbor searching techniques were used. These implementations were used when the coefficient matrix in the linear system is symmetric, but not necessarily positive-definite.

Memarsadeghi, Nargess↗

Investigating the Impact of UV Radiation on High-Altitude Shallow Lake Habitats, Life Diversity, and Life Survival Strategies: Clues for Mars' Past Habitability Potential?

We present data and results from an ongoing project of astrobiological high-altitude expeditions investigating the highest and least explored perennial lakes on Earth in the Bolivian and Chilean Andes, including several volcanic crater lakes nearing and beyond 6,000 m in elevation. In the next five years, they will provide the first integrated long-term astrobiological characterization and monitoring of lacustrine environments and their biology for such altitude. These extreme lakes are natural laboratories. They provide the field data missing beyond 4,000 m to complete our understanding of terrestrial lakes and biota. Research on the effects of UV has been performed in lower altitude lakes and models of UV flux over time are being developed. Lakes showing a high content of dissolved organic material (DOM) shield organisms from UV. DOM acts as a natural sunscreen as it influences the water transparency, therefore is a determinant of photic zone depth. In sparsely vegetated alpine areas, lakes are clearer and offer less protection from UV to organisms living in the water. Transparent water and high UV irradiance may maximize the penetration and effect of UV radiation. Shallow-water communities in these lakes are particularly sensitive to UV radiation. The periphyton can live on various susbtrates. While on rocks, it includes immobile species that cannot seek low UV refuges unlike sediment-dwelling periphyton or alpine phytoflagellates which undergo vertical migration. Inhibition of algal photosynthesis by UV radiation has been documented in laboratory and showed that phytoplankton production is reduced by formation of nucleic acid lesions or production of peroxides and free oxygen radicals. of peroxides and free oxygen radicals. Our project is providing the field data that is missing from natural laboratories beyond 4,000 m and will complement the vision of the effects of UV on life and its adaptation modes (or lack thereof).

Cabrol, A.↗

Evaluating Failures and near Misses in Human Spaceflight History for Lessons for Future Human Spaceflight

Studies done in the past have drawn on lessons learned with regard to human loss-of-life events. However, an examination of near-fatal accidents can be equally useful, not only in detecting causes, both proximate and systemic, but also for determining what factors averted disaster, what design decisions and/or operator actions prevented catastrophe. Binary pass/fail launch history is often used for risk, but this also has limitations. A program with a number of near misses can look more reliable than a consistently healthy program with a single out-of-family failure. Augmenting reliability evaluations with this near miss data can provide insight and expand on the limitations of a strictly pass/fail evaluation. This paper intends to show how near-miss lessons learned can provide crucial data for any new human spaceflight programs that are interested in sending man into space

Barr, Stephanie↗

Monitoring Earth's Ecosystems

Partnered with Goddard Space Flight Center, Sensit Technologies Inc. developed a third-generation Portable Apparatus for Rapid Acquisitions of Bidirectional Observations of Land and Atmosphere, or PARABOLA III for short. Now commercially available, PARABOLA III is designed to measure the reflected signature of a variety of Earth surface types, from rangeland vegetation to ice and snow. It can rapidly acquire data for almost the complete sky and ground-looking hemispheres, with no missing data and sufficient dynamic range to measure direct solar radiance. The instrument was actively used in the Boreal Ecosystem- Atmosphere Study which provided useful information in designing a Multi-angle Imaging SpectroRadiometer, a small satellite being built by the Jet Propulsion Laboratory that will measure sunlight reflected by the Earth into space.

Source record↗

Informal Statistics Help Desk

Back by popular demand, the JSC Biostatistics Laboratory and LSAH statisticians are offering an opportunity to discuss your statistical challenges and needs. Take the opportunity to meet the individuals offering expert statistical support to the JSC community. Join us for an informal conversation about any questions you may have encountered with issues of experimental design, analysis, or data visualization. Get answers to common questions about sample size, repeated measures, statistical assumptions, missing data, multiple testing, time-to-event data, and when to trust the results of your analyses.

Young, M.↗

A Probabilistic Approach of Incorporating Safety and Reliability in System Designs for a Manned Mission to Mars

Conceptual stages in mission design often lack the input of quantitative safety and reliability assessments, simply because failure rates or other data are not yet available for systems that have not yet been designed. Absence of such data should not, however, prevent the development of a quantitative risk models with placeholders for missing data. Functions (that is, actions the systems must perform) in mission design will eventually require system probabilities of success, and there could be much learned from surrogate data, adequately bounded in uncertainty, used in a large event tree model of a complex mission.

Railsback, Jan W.↗

Automated Discovery and Modeling of Sequential Patterns Preceding Events of Interest

The integration of emerging data manipulation technologies has enabled a paradigm shift in practitioners' abilities to understand and anticipate events of interest in complex systems. Example events of interest include outbreaks of socio-political violence in nation-states. Rather than relying on human-centric modeling efforts that are limited by the availability of SMEs, automated data processing technologies has enabled the development of innovative automated complex system modeling and predictive analysis technologies. We introduce one such emerging modeling technology - the sequential pattern methodology. We have applied the sequential pattern methodology to automatically identify patterns of observed behavior that precede outbreaks of socio-political violence such as riots, rebellions and coups in nation-states. The sequential pattern methodology is a groundbreaking approach to automated complex system model discovery because it generates easily interpretable patterns based on direct observations of sampled factor data for a deeper understanding of societal behaviors that is tolerant of observation noise and missing data. The discovered patterns are simple to interpret and mimic human's identifications of observed trends in temporal data. Discovered patterns also provide an automated forecasting ability: we discuss an example of using discovered patterns coupled with a rich data environment to forecast various types of socio-political violence in nation-states.

Rohloff, Kurt↗

DSN telemetry system data records

The DSN telemetry system now includes the capability to provide a complete magnetic tape record, within 24 hours of reception, of all telemetry data received from a spacecraft. This record, the intermediate data record, is processed and generated almost entirely automatically, and provides a detailed accounting of any missing data.

Gatz, E. C.↗

Informal Statistics Help Desk

Back by popular demand, the JSC Biostatistics Lab is offering an opportunity for informal conversation about challenges you may have encountered with issues of experimental design, analysis, data visualization or related topics. Get answers to common questions about sample size, repeated measures, violation of distributional assumptions, missing data, multiple testing, time-to-event data, when to trust the results of your analyses (reproducibility issues) and more.

Ploutz-Snyder, R. J.↗