Search NASA⌕ Search

SEARCH · Search NASA

Results for “sparse data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Performance issues for iterative solvers in device simulation

Due to memory limitations, iterative methods have become the method of choice for large scale semiconductor device simulation. However, it is well known that these methods still suffer from reliability problems. The linear systems which appear in numerical simulation of semiconductor devices are notoriously ill-conditioned. In order to produce robust algorithms for practical problems, careful attention must be given to many implementation issues. This paper concentrates on strategies for developing robust preconditioners. In addition, effective data structures and convergence check issues are also discussed. These algorithms are compared with a standard direct sparse matrix solver on a variety of problems.

Fan, Qing↗

Enhanced Reporting of Mars Exploration Rover Telemetry

Mars Exploration Rover Enhanced Telemetry Extraction and Reporting System (METERS) is software that generates a human-readable representation of the state of the mobility and arm-related systems of the Mars Exploration Rover (MER) vehicles on each Martian solar day (sol). Data are received from the MER spacecraft in multiple streams having various formats including text messages, sparsely-sampled engineering quantities, images, and individual motor-command histories.

Maimone, Mark W.↗

Summary of Aqua, Aura, and Terra High Interest Events

Single-obs tracking Sparsely tracked objects are an unfortunate reality of CARA operations Terra vs. 32081: new track with bad data was included in OD solution for secondary object and risk became high CARA and JSpOC discussed tracking and OSAs threw out the bad data. Event no longer presented high risk based on new OD Improvement: CARA now sends JSpOC a flag indicating when a single obs is included, so OSAs can evaluate if manual update to OD is required. Missing ASW OCMsAura vs. 87178, TCA: 317 at 08:04 UTC. Post-maneuver risk (conjunction was identified in OO results)CARA confirmed with JSpOC that ASW OCMs should have been received in addition to OO OCMsJSpOC corrected the manual error in their script that prevented the data from being delivered to CARAJSpOC QAd their other scripts to ensure this error did not exist in other places.

Conjunction↗

An RFI Detection Algorithm for Microwave Radiometers Using Sparse Component Analysis

Radio Frequency Interference (RFI) is a threat to passive microwave measurements and if undetected, can corrupt science retrievals. The sparse component analysis (SCA) for blind source separation has been investigated to detect RFI in microwave radiometer data. Various techniques using SCA have been simulated to determine detection performance with continuous wave (CW) RFI.

radiometers↗

An RFI Detection Algorithm for Microwave Radiometers Using Sparse Component Analysis

Radio Frequency Interference (RFI) is a threat to passive microwave measurements and if undetected, can corrupt science retrievals. The sparse component analysis (SCA) for blind source separation has been investigated to detect RFI in microwave radiometer data. Various techniques using SCA have been simulated to determine detection performance with continuous wave (CW) RFI.

radiometers↗

Polar Dunes Resolved by the Mars Orbiter Laser Altimeter Gridded Topography and Pulse Widths

The Mars Orbiter Laser Altimeter (MOLA) polar data have been refined to the extent that many features poorly imaged by Viking Orbiters are now resolved in densely gridded altimetry. Individual linear polar dunes with spacings of 0.5 km or more can be seen as well as sparsely distributed and partially mantled dunes. The refined altimetry will enable measurements of the extent and possibly volume of the north polar ergs. MOLA pulse widths have been recalibrated using inflight data, and a robust algorithm applied to solve for the surface optical impulse response. It shows the surface root-mean-square (RMS) roughness at the 75-m-diameter MOLA footprint scale, together with a geological map. While the roughness is of vital interest for landing site safety studies, a variety of geomorphological studies may also be performed. Pulse widths corrected for regional slope clearly delineate the extent of the polar dunes. The MOLA PEDR profile data have now been re-released in their entirety (Version L). The final Mission Experiment Gridded Data Records (MEGDR's) are now provided at up to 128 pixels per degree globally. Densities as high as 512 pixels per degree are available in a polar stereographic projection. A large computational effort has been expended in improving the accuracy of the MOLA altimetry themselves, both in improved orbital modeling and in after-the-fact adjustment of tracks to improve their registration at crossovers. The current release adopts the IAU2000 rotation model and cartographic frame recommended by the Mars Cartography Working Group. Adoption of the current standard will allow registration of images and profiles globally with an uncertainty of less than 100 m. The MOLA detector is still operational and is currently collecting radiometric data at 1064 nm. Seasonal images of the reflectivity of the polar caps can be generated with a resolution of about 300 m per pixel.

Gregory A Neumann↗

The OMPS Limb Profiler Instrument: Two-Dimensional Retrieval Algorithm

The upcoming Ozone Mapper and Profiler Suite (OMPS), which will be launched on the NPOESS Preparatory Project (NPP) platform in early 2011, will continue monitoring the global distribution of the Earth's middle atmosphere ozone and aerosol. OMPS is composed of three instruments, namely the Total Column Mapper (heritage: TOMS, OMI), the Nadir Profiler (heritage: SBUV) and the Limb Profiler (heritage: SOLSE/LORE, OSIRIS, SCIAMACHY, SAGE III). The ultimate goal of the mission is to better understand and quantify the rate of stratospheric ozone recovery. The focus of the paper will be on the Limb Profiler (LP) instrument. The LP instrument will measure the Earth's limb radiance (which is due to the scattering of solar photons by air molecules, aerosol and Earth surface) in the ultra-violet (UV), visible and near infrared, from 285 to 1000 nm. The LP simultaneously images the whole vertical extent of the Earth's limb through three vertical slits, each covering a vertical tangent height range of 100 km and each horizontally spaced by 250 km in the cross-track direction. Measurements are made every 19 seconds along the orbit track, which corresponds to a distance of about 150km. Several data analysis tools are presently being constructed and tested to retrieve ozone and aerosol vertical distribution from limb radiance measurements. The primary NASA algorithm is based on earlier algorithms developed for the SOLSE/LORE and SAGE III limb scatter missions. All the existing retrieval algorithms rely on a spherical symmetry assumption for the atmosphere structure. While this assumption is reasonable in most of the stratosphere, it is no longer valid in regions of prime scientific interest, such as polar vortex and UTLS regions. The paper will describe a two-dimensional retrieval algorithm whereby the ozone distribution is simultaneously retrieved vertically and horizontally for a whole orbit. The retrieval code relies on (1) a forward 2D Radiative Transfer code (to model limb radiances within a non-uniform atmosphere and evaluate 2D analytical partial derivatives) and (2) an optimal estimator inversion routine. The algorithm uses the typically sparse nature of the kernel matrices as well as fast matrix inversion techniques to allow for fast inversion of limb data with efficient memory management (as was done for MIPAS data processing). While the method has so far only been developed in the context of Single Scatter, the paper will show how the CPU intensive Multiple Scatter modeling can be implemented using parallel CPU processing. Initial results will be presented in terms of retrieved ozone profiles and code performance.

Rault, Didier F.↗

A Reassessment of the Mars Ocean Hypothesis

Initial work on the identification and mapping of potential ancient shorelines on Mars was based on Viking Orbiter image data (Parker et al., 1987, 1989, 1993). The Viking Orbiters were designed to locate landing site for the two landers and were not specifically intended to map the entire planet. Fortunately, they mapped the entire planet. Unfortunately, they did so at an average resolution of greater than 200m/pixel. Higher resolution images, even mosaics of interesting regions, are available, but relatively sparse. Mapping of shorelines on Earth requires both high-resolution aerial photos or satellite images and good topographic information. Three significant sources of additional data from missions subsequent to Viking are useful for reassessing the ocean hypothesis. These are: MGS MOC images; MGS MOLA topography; Odyssey THEMIS IR and VIS images; and MER surface geology at Meridiani and Gusev. Okay, my mistake: Four.

Parker, T. J.↗

Synthetic Foveal Imaging Technology

Synthetic Foveal imaging Technology (SyFT) is an emerging discipline of image capture and image-data processing that offers the prospect of greatly increased capabilities for real-time processing of large, high-resolution images (including mosaic images) for such purposes as automated recognition and tracking of moving objects of interest. SyFT offers a solution to the image-data processing problem arising from the proposed development of gigapixel mosaic focal-plane image-detector assemblies for very wide field-of-view imaging with high resolution for detecting and tracking sparse objects or events within narrow subfields of view. In order to identify and track the objects or events without the means of dynamic adaptation to be afforded by SyFT, it would be necessary to post-process data from an image-data space consisting of terabytes of data. Such post-processing would be time-consuming and, as a consequence, could result in missing significant events that could not be observed at all due to the time evolution of such events or could not be observed at required levels of fidelity without such real-time adaptations as adjusting focal-plane operating conditions or aiming of the focal plane in different directions to track such events. The basic concept of foveal imaging is straightforward: In imitation of a natural eye, a foveal-vision image sensor is designed to offer higher resolution in a small region of interest (ROI) within its field of view. Foveal vision reduces the amount of unwanted information that must be transferred from the image sensor to external image-data-processing circuitry. The aforementioned basic concept is not new in itself: indeed, image sensors based on these concepts have been described in several previous NASA Tech Briefs articles. Active-pixel integrated-circuit image sensors that can be programmed in real time to effect foveal artificial vision on demand are one such example. What is new in SyFT is a synergistic combination of recent advances in foveal imaging, computing, and related fields, along with a generalization of the basic foveal-vision concept to admit a synthetic fovea that is not restricted to one contiguous region of an image.

Hoenk, Michael↗

Determining Cloud Thermodynamic Phase from Micropulse Lidar Network Data

Determining cloud thermodynamic phase is a critical factor in studies of Earth's radiation budget. Here we use observations from the NASA Micro Pulse Lidar Network (MPLNET) and thermodynamic profiles from the Goddard Earth Observing System, version 5 (GEOS-5) to distinguish liquid water, mixed-phase, and ice water clouds. The MPLNET provides sparse global, autonomous, and continuous measurements of clouds and aerosols which have been used in a number of scientific investigations to date. The use of a standardized instrument and a common suite of data processing algorithms with thorough uncertainty characterization allows for straightforward comparisons between sites. Lidars with polarization capabilities have recently been incorporated into the MPLNET project which allows, for the first time, the ability to infer a cloud thermodynamic phase. This presentation will look specifically at the occurrence of ice and mixed phase clouds in the temperature region of -10 C to -40 C for different climatological regions and seasons. We compare MPLNET occurrences of mixed-phase clouds to an historical climatology based on observations from the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) instrument aboard the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) spacecraft.

mixing layer height↗

A Structural Dynamics Approach to the Simulation of Spacecraft Control/Structure Interaction

A relatively simple approach to the analysis of linear spacecraft control/structure interaction problems is presented. The approach uses a commercially available structural system dynamic analysis package for both controller and plant dynamics, thus obviating the need to transfer data between separate programs. The unilateral coupling between components in the control system block diagram is simulated using sparse matrix stiffness and damping elements available in the structural dynamic code. The approach is illustrated with a series of simple tutorial examples of a rigid spacecraft core with flexible appendages.

Young, J. W.↗

Comparison of various techniques for calibration of AIS data

The Airborne Imaging Spectrometer (AIS) samples a region which is strongly influenced by decreasing solar irradiance at longer wavelengths and strong atmospheric absorptions. Four techniques, the Log Residual, the Least Upper Bound Residual, the Flat Field Correction and calibration using field reflectance measurements were investigated as a means for removing these two features. Of the four techniques field reflectance calibration proved to be superior in terms of noise and normalization. Of the other three techniques, the Log Residual was superior when applied to areas which did not contain one dominant cover type. In heavily vegetated areas, the Log Residual proved to be ineffective. After removing anomalously bright data values, the Least Upper Bound Residual proved to be almost as effective as the Log Residual in sparsely vegetated areas and much more effective in heavily vegetated areas. Of all the techniques, the Flat Field Correction was the noisest.

Dar A. Roberts↗

Solutocapillary Convection Effects on Polymeric Membrane Morphology

Macro voids are undesirable large pores in membranes used for purification. They form when membranes are cast as thin films on a smooth surface by evaporating solvent (acetone) from a polymer solution. There are two un-tested hypotheses explaining the growth of macro voids. One states that diffusion of the non-solvent (water) is solely responsible, while the other states that solutocapillary convection is the primary cause of macro void growth. Solutocapillary convection is flow-caused by a concentration induced surface-tension gradient. Macrovoid growth in the former hypothesis is gravity independent, while in the latter it is opposed by gravity. To distinguish between these two hypotheses, experiments were designed to cast membranes in zero-gravity. A semi-automated apparatus was designed and built for casting membranes during the 20 secs of zero-g time available in parabolic aircraft flight such as NASA's KC-135. The phase changes were monitored optically, and membrane morphology was evaluated by scanning electron microscopy (SEM). These studies appear to be the first quantitative studies of membrane casting in micro-gravity which incorporate real-time data acquisition. Morphological studies of membranes cast at 0, 1, and 1.8 g revealed the presence of numerous, sparse and no macrovoids respectively. These results are consistent with the predictions of the solutocapillary hypothesis of macrovoid growth.

Krantz, William B.↗

Object-Oriented Design for Sparse Direct Solvers

We discuss the object-oriented design of a software package for solving sparse, symmetric systems of equations (positive definite and indefinite) by direct methods. At the highest layers, we decouple data structure classes from algorithmic classes for flexibility. We describe the important structural and algorithmic classes in our design, and discuss the trade-offs we made for high performance. The kernels at the lower layers were optimized by hand. Our results show no performance loss from our object-oriented design, while providing flexibility, case of use, and extensibility over solvers using procedural design.

Dobrian, Florin↗

Comparison of GPCP Monthly and Daily Precipitation Estimates with High-Latitude Gauge Observations

It is very important to know how much rain and snow falls around the world for uses that range from crop forecasting to disaster response, drought monitoring to flood forecasting, and weather analysis to climate research. Precipitation is usually measured with rain gauges, but rain gauges don t exist in areas that are sparsely populated, which tends to be a good portion of the globe. To overcome this, meteorologists use satellite data to estimate global precipitation. However, it is difficult to estimate rain and especially snow in cold climates using most current satellites. The satellite sensors are often "confused" by a snowy or frozen surface and therefore cannot distinguish precipitation. One commonly used satellite-based precipitation data set, the Global Precipitation Climatology Project (GPCP) data, overcomes this frozen-surface problem through the innovative use of two sources of satellite data, the Television Infrared Observation Satellite Operational Vertical Sounder (TOVS) and the Atmospheric Infrared Sounder (AIRS). Though the GPCP estimates are generally considered a very reliable source of precipitation, it has been difficult to assess the quality of these estimates in cold climates due to the lack of gauges. Recently, the Finnish Meteorological Institute (FMI) has provided a 12-year span of high-quality daily rain gauge observations, covering all of Finland, that can be used to compare with the GPCP data to determine how well the satellites estimate cold-climate precipitation. Comparison of the monthly GPCP satellite-based estimates and the FMI gauge observations shows remarkably good agreement, with the GPCP estimates being 6% lower in the amount of precipitation than the FMI observations. Furthermore, the month-to-month correlation between the GPCP and FMI is very high at 0.95 (1.0 is perfect). The daily GPCP estimates replicate the FMI daily occurrences of precipitation with a correlation of 0.55 in the summer and 0.45 in the winter. The winter result indicates the GPCP estimates have skill in "seeing" snowfall, which is the most challenging situation. Thus, the GPCP data set successfully overcomes a current limitation in satellite meteorology, namely the estimation of cold-climate precipitation. The success of the GPCP data set bodes well for future missions, whose instrumentation is specifically designed to give even more information for addressing cold-climate precipitation.

Bolvin, David T.↗

Development of the Ames Global Hyperspectral Synthetic Dataset

This study develops the surface BRDF (bidirectional reflectance distribution function) product of the Ames Global Hyperspectral Synthetic Dataset (AGHSD), based on the corresponding MODIS products, to support the NASA Surface Biology and Geology mission development. A main challenge in deriving a hyperspectral dataset from the multi-band satellite products is how to identify a succinct yet robust algorithm that allow us to infer BRDF at unobserved wavelengths based on the few observed bands. Using the theories of radiative transfer in vegetation canopies, we arrive at a simple equation that accurately approximates hyperspectral surface BRDF as the weighted sum of components from the soil and the vegetation. Each of the components is modeled by the product of the spectrally-dependent optical properties of a surface element (the spectra of the soil surface reflectance, the leaf single albedo, or the canopy scattering coefficient) and a spectrally-independent bidirectional scattering function. The optical properties of the soil and the vegetation can be obtained from existing spectral libraries or model simulations. The bidirectional scattering functions are represented by the Ross-Thick-Li-Sparse BRDF model, where the linear coefficients are estimated with regression analysis from the multi-band MODIS data. We validate the algorithm with simulations by Monte Carlo Ray Tracing model experiments, and the results are highly consistent with the theoretic derivation. We apply the algorithm to generate the AGHSD BRDF product at 1km and 8-day resolutions for the year of 2019. The results are biogeochemically and physically coherent and consistent, and thus serve the goal to support the science and application development of the SBG community.

Hyperspectral↗

Missing the Reef for the Corals: Unexpected Trends Between Coral Reef Condition and the Environment at the Ecosystem Scale

It is incontrovertible that many coral reefs are in various stages of decline and may be unable to withstand the effects of global climate change, jeopardizing vital ecosystem goods and services to hundreds of millions of people around the world. An estimated 50% of the world's corals have already been lost, and those remaining may be lost by 2030 under the “business as usual” CO2 emissions scenario. However, the foundation of these predictions is a surprisingly sparse dataset, wherein ~0.01–0.1% of the world's reef area has been quantitatively surveyed. Further, the available data comprise observations at the 1–10 m scale, which are not evenly spaced across reefs, but often clustered in areas representing focused survey effort. This impedes modeling and predicting the impact of a changing environment at the ecosystem scale. Here we highlight deficiencies in our current understanding of the relationship between coral reefs and their environments. Specifically, we conduct a meta-analysis using estimates of coral cover from a variety of local surveys, quantitatively relating reef condition to a suite of biogeophysical forcing parameters. We find that readily available public data for coral cover exhibit unexpected trends (e.g., a positive correlation between coral cover and multi-year cumulative thermal stress), contrary to prevailing scientific expectations. We illustrate a significant gap in our current understanding, and thereby prediction, of coral reefs at the ecosystem scale that can only be remedied with uniform, high-density data across vast coral reef regions, such as that from remote sensing.

Eric J Hochberg↗

Validation of Soil Moisture Data Products from the NASA SMAP Mission

The National Aeronautics and Space Administration (NASA)Soil Moisture Active Passive(SMAP) mission has been validatingits soil moisture (SM) products since the start of data production onMarch 31, 2015. Prior to launch, the mission defined a set of criteria for core validation sites (CVS) that enable the testing of the key mission SM accuracy requirement(unbiased root-mean-square error <0.04 m3/m3). Thevalidation approach also includes other (“sparse network”) in situSM measurements, satellite SM products, model-based SM products, and field experiments. Over the past six years, the SMAP SM products have been analyzed with respect to thesereference data,and the analysis approaches themselves have been scrutinizedin an effort to best understand the products’ performance. Validation of themost recent SMAP Level 2 and 3 SMretrievalproducts (R17000) shows that the L-band (1.4 GHz) radiometer-based SM record continues to meet mission requirements. The products aregenerallyconsistentwith SM retrievals from the European Space Agency (ESA)Soil Moisture Ocean Salinity mission, althoughthere aredifferencesin some regions. The high-resolution (3-km) SM retrieval product,generated by combining Copernicus Sentinel-1 data with SMAP observations,performswithin expectations. Currently, however,there is limited availability of3-kmCVSdatato support extensive validation at this spatial scale. The most recent (version 5)SMAP Level4 SMdata assimilation productprovidingsurface and root-zone SM with complete spatio-temporal coverageat 9-km resolution also meets performance requirements. The SMAP SM validation program will continue throughout the mission life; futureplans include expanding ittoforestedand high-latituderegions

SMAP↗