SEARCH · Search NASA

Results for “sparse data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

All sources NASA NTRS DOE OSTI

NASA NTRS2015

Summary of Aqua, Aura, and Terra High Interest Events

Single-obs tracking Sparsely tracked objects are an unfortunate reality of CARA operations Terra vs. 32081: new track with bad data was included in OD solution for secondary object and risk became high CARA and JSpOC discussed tracking and OSAs threw out the bad data. Event no longer presented high risk based on new OD Improvement: CARA now sends JSpOC a flag indicating when a single obs is included, so OSAs can evaluate if manual update to OD is required. Missing ASW OCMsAura vs. 87178, TCA: 317 at 08:04 UTC. Post-maneuver risk (conjunction was identified in OO results)CARA confirmed with JSpOC that ASW OCMs should have been received in addition to OO OCMsJSpOC corrected the manual error in their script that prevented the data from being delivered to CARAJSpOC QAd their other scripts to ensure this error did not exist in other places.

Conjunction↗

NASA NTRS2017

An RFI Detection Algorithm for Microwave Radiometers Using Sparse Component Analysis

Radio Frequency Interference (RFI) is a threat to passive microwave measurements and if undetected, can corrupt science retrievals. The sparse component analysis (SCA) for blind source separation has been investigated to detect RFI in microwave radiometer data. Various techniques using SCA have been simulated to determine detection performance with continuous wave (CW) RFI.

radiometers↗

NASA NTRS2017

An RFI Detection Algorithm for Microwave Radiometers Using Sparse Component Analysis

radiometers↗

DOE OSTI2024

Hydrologic applicability of satellite-based precipitation estimates for irrigation water management in the data-scarce region

Reliable precipitation estimates are crucial for planning and managing water resources, monitoring hydrologic extremes, and fulfilling irrigation water requirements. Accurate precipitation estimates are particularly challenging in complex mountain terrains, where monitoring gauges are often sparsely distributed due to their remote locations, and high installation and long-term operation costs. Recent advances in satellite-based precipitation estimates offer promising opportunities to improve our understanding of hydrologic processes and their applications for irrigation water management. Several datasets are available varying considerably in terms of their data sources, quality control methods, estimation procedure, and spatiotemporal resolutions. Choosing the most suitable dataset for a particular application is a complex task. In this study, we (1) evaluate the performance of six satellite-based precipitation estimates (SPEs): i) CHIRPS v2.0, ii) CMORPH v1.0, iii) ERA5, iv) IMERG v6, v) MSWEP v2.8, and vi) PERSIANN-CDR against the gauge precipitation using continuous statistical and categorical indices, (2) integrate SPEs with a calibrated semi-distributed hydrologic model to predict streamflow, and (3) demonstrate practical implications of improved streamflow prediction for irrigation water management in the central Himalayan region, Nepal. Our results illustrate that satellite-based precipitation estimates have competitive performance in capturing a wide range of rainfall characteristics, with demonstrated variability across river basins and time scales. Further, there are no significant discrepancies observed in satellite-based precipitation estimates for estimating irrigation water requirements for the three major crops (maize, wheat, and paddy) during the cropping period across the selected river basins, showing a greater promise for irrigation water management planning and decision making.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Particle hit clustering and identification using point set transformers in liquid argon time projection chambers

Liquid argon time projection chambers are often used in neutrino physics and dark-matter searches because of their high spatial resolution. The images generated by these detectors are extremely sparse, as the energy values detected by most of the detector are equal to 0, meaning that despite their high resolution, most of the detector is unused in a particular interaction. Instead of representing all of the empty detections, the interaction is usually stored as a sparse matrix, a list of detection locations paired with their energy values. Traditional machine learning methods that have been applied to particle reconstruction such as convolutional neural networks (CNNs), however, cannot operate over data stored in this way and therefore must have the matrix fully instantiated as a dense matrix. Operating on dense matrices requires a lot of memory and computation time, in contrast to directly operating on the sparse matrix. We propose a machine learning model using a point set neural network that operates over a sparse matrix, greatly improving both processing speed and accuracy over methods that instantiate the dense matrix, as well as over other methods that operate over sparse matrices. Compared to competing state-of-the-art methods, our method improves classification performance by 14%, segmentation performance by more than 22%, while taking 80% less time and using 66% less memory. Compared to state-of-the-art CNN methods, our method improves classification performance by more than 86%, segmentation performance by more than 71%, while reducing runtime by 91% and reducing memory usage by 61%.

calibration and fitting methods↗

NASA NTRS2003

Polar Dunes Resolved by the Mars Orbiter Laser Altimeter Gridded Topography and Pulse Widths

The Mars Orbiter Laser Altimeter (MOLA) polar data have been refined to the extent that many features poorly imaged by Viking Orbiters are now resolved in densely gridded altimetry. Individual linear polar dunes with spacings of 0.5 km or more can be seen as well as sparsely distributed and partially mantled dunes. The refined altimetry will enable measurements of the extent and possibly volume of the north polar ergs. MOLA pulse widths have been recalibrated using inflight data, and a robust algorithm applied to solve for the surface optical impulse response. It shows the surface root-mean-square (RMS) roughness at the 75-m-diameter MOLA footprint scale, together with a geological map. While the roughness is of vital interest for landing site safety studies, a variety of geomorphological studies may also be performed. Pulse widths corrected for regional slope clearly delineate the extent of the polar dunes. The MOLA PEDR profile data have now been re-released in their entirety (Version L). The final Mission Experiment Gridded Data Records (MEGDR's) are now provided at up to 128 pixels per degree globally. Densities as high as 512 pixels per degree are available in a polar stereographic projection. A large computational effort has been expended in improving the accuracy of the MOLA altimetry themselves, both in improved orbital modeling and in after-the-fact adjustment of tracks to improve their registration at crossovers. The current release adopts the IAU2000 rotation model and cartographic frame recommended by the Mars Cartography Working Group. Adoption of the current standard will allow registration of images and profiles globally with an uncertainty of less than 100 m. The MOLA detector is still operational and is currently collecting radiometric data at 1064 nm. Seasonal images of the reflectivity of the polar caps can be generated with a resolution of about 300 m per pixel.

Gregory A Neumann↗

NASA NTRS2010

The OMPS Limb Profiler Instrument: Two-Dimensional Retrieval Algorithm

The upcoming Ozone Mapper and Profiler Suite (OMPS), which will be launched on the NPOESS Preparatory Project (NPP) platform in early 2011, will continue monitoring the global distribution of the Earth's middle atmosphere ozone and aerosol. OMPS is composed of three instruments, namely the Total Column Mapper (heritage: TOMS, OMI), the Nadir Profiler (heritage: SBUV) and the Limb Profiler (heritage: SOLSE/LORE, OSIRIS, SCIAMACHY, SAGE III). The ultimate goal of the mission is to better understand and quantify the rate of stratospheric ozone recovery. The focus of the paper will be on the Limb Profiler (LP) instrument. The LP instrument will measure the Earth's limb radiance (which is due to the scattering of solar photons by air molecules, aerosol and Earth surface) in the ultra-violet (UV), visible and near infrared, from 285 to 1000 nm. The LP simultaneously images the whole vertical extent of the Earth's limb through three vertical slits, each covering a vertical tangent height range of 100 km and each horizontally spaced by 250 km in the cross-track direction. Measurements are made every 19 seconds along the orbit track, which corresponds to a distance of about 150km. Several data analysis tools are presently being constructed and tested to retrieve ozone and aerosol vertical distribution from limb radiance measurements. The primary NASA algorithm is based on earlier algorithms developed for the SOLSE/LORE and SAGE III limb scatter missions. All the existing retrieval algorithms rely on a spherical symmetry assumption for the atmosphere structure. While this assumption is reasonable in most of the stratosphere, it is no longer valid in regions of prime scientific interest, such as polar vortex and UTLS regions. The paper will describe a two-dimensional retrieval algorithm whereby the ozone distribution is simultaneously retrieved vertically and horizontally for a whole orbit. The retrieval code relies on (1) a forward 2D Radiative Transfer code (to model limb radiances within a non-uniform atmosphere and evaluate 2D analytical partial derivatives) and (2) an optimal estimator inversion routine. The algorithm uses the typically sparse nature of the kernel matrices as well as fast matrix inversion techniques to allow for fast inversion of limb data with efficient memory management (as was done for MIPAS data processing). While the method has so far only been developed in the context of Single Scatter, the paper will show how the CPU intensive Multiple Scatter modeling can be implemented using parallel CPU processing. Initial results will be presented in terms of retrieved ozone profiles and code performance.

Rault, Didier F.↗

NASA NTRS2004

A Reassessment of the Mars Ocean Hypothesis

Initial work on the identification and mapping of potential ancient shorelines on Mars was based on Viking Orbiter image data (Parker et al., 1987, 1989, 1993). The Viking Orbiters were designed to locate landing site for the two landers and were not specifically intended to map the entire planet. Fortunately, they mapped the entire planet. Unfortunately, they did so at an average resolution of greater than 200m/pixel. Higher resolution images, even mosaics of interesting regions, are available, but relatively sparse. Mapping of shorelines on Earth requires both high-resolution aerial photos or satellite images and good topographic information. Three significant sources of additional data from missions subsequent to Viking are useful for reassessing the ocean hypothesis. These are: MGS MOC images; MGS MOLA topography; Odyssey THEMIS IR and VIS images; and MER surface geology at Meridiani and Gusev. Okay, my mistake: Four.

Parker, T. J.↗

NASA NTRS2009

Synthetic Foveal Imaging Technology

Synthetic Foveal imaging Technology (SyFT) is an emerging discipline of image capture and image-data processing that offers the prospect of greatly increased capabilities for real-time processing of large, high-resolution images (including mosaic images) for such purposes as automated recognition and tracking of moving objects of interest. SyFT offers a solution to the image-data processing problem arising from the proposed development of gigapixel mosaic focal-plane image-detector assemblies for very wide field-of-view imaging with high resolution for detecting and tracking sparse objects or events within narrow subfields of view. In order to identify and track the objects or events without the means of dynamic adaptation to be afforded by SyFT, it would be necessary to post-process data from an image-data space consisting of terabytes of data. Such post-processing would be time-consuming and, as a consequence, could result in missing significant events that could not be observed at all due to the time evolution of such events or could not be observed at required levels of fidelity without such real-time adaptations as adjusting focal-plane operating conditions or aiming of the focal plane in different directions to track such events. The basic concept of foveal imaging is straightforward: In imitation of a natural eye, a foveal-vision image sensor is designed to offer higher resolution in a small region of interest (ROI) within its field of view. Foveal vision reduces the amount of unwanted information that must be transferred from the image sensor to external image-data-processing circuitry. The aforementioned basic concept is not new in itself: indeed, image sensors based on these concepts have been described in several previous NASA Tech Briefs articles. Active-pixel integrated-circuit image sensors that can be programmed in real time to effect foveal artificial vision on demand are one such example. What is new in SyFT is a synergistic combination of recent advances in foveal imaging, computing, and related fields, along with a generalization of the basic foveal-vision concept to admit a synthetic fovea that is not restricted to one contiguous region of an image.

Hoenk, Michael↗

NASA NTRS2017

Determining Cloud Thermodynamic Phase from Micropulse Lidar Network Data

Determining cloud thermodynamic phase is a critical factor in studies of Earth's radiation budget. Here we use observations from the NASA Micro Pulse Lidar Network (MPLNET) and thermodynamic profiles from the Goddard Earth Observing System, version 5 (GEOS-5) to distinguish liquid water, mixed-phase, and ice water clouds. The MPLNET provides sparse global, autonomous, and continuous measurements of clouds and aerosols which have been used in a number of scientific investigations to date. The use of a standardized instrument and a common suite of data processing algorithms with thorough uncertainty characterization allows for straightforward comparisons between sites. Lidars with polarization capabilities have recently been incorporated into the MPLNET project which allows, for the first time, the ability to infer a cloud thermodynamic phase. This presentation will look specifically at the occurrence of ice and mixed phase clouds in the temperature region of -10 C to -40 C for different climatological regions and seasons. We compare MPLNET occurrences of mixed-phase clouds to an historical climatology based on observations from the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) instrument aboard the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) spacecraft.

mixing layer height↗

DOE OSTI2024

Smooth trends in fermium charge radii and the impact of shell effects

The quantum-mechanical nuclear-shell structure determines the stability and limits of the existence of the heaviest nuclides with large proton numbers Z ≳ 100. Shell effects also affect the sizes and shapes of atomic nuclei, as shown by laser spectroscopy studies in lighter nuclides. However, experimental information on the charge radii and the nuclear moments of the heavy actinide elements, which link the heaviest naturally abundant nuclides with artificially produced superheavy elements, is sparse. Here we present laser spectroscopy measurements along the fermium (Z = 100) isotopic chain and an extension of data in the nobelium isotopic chain (Z = 102) across a key region. Multiple production schemes and different advanced techniques were applied to determine the isotope shifts in atomic transitions, from which changes in the nuclear mean-square charge radii were extracted. A range of nuclear models based on energy density functionals reproduce well the observed smooth evolution of the nuclear size. Both the remarkable consistency of model prediction and the similarity of predictions for different isotopes suggest a transition to a regime in which shell effects have a diminished effect on the size compared with lighter nuclei.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2024

Experimental validation of a collision-radiation dataset for molecular hydrogen in plasmas

Quantitative spectroscopy of molecular hydrogen has generated substantial demand, leading to the accumulation of diverse elementary process data encompassing radiative transitions, electron-impact transitions, predissociations, and quenching. However, their rates currently available are still sparse, and there are inconsistencies among those proposed by different authors. In this study, we demonstrate an experimental validation of such a molecular dataset by composing a collisional-radiative model (CRM) for molecular hydrogen and comparing experimentally obtained vibronic populations across multiple levels. From the population kinetics of molecular hydrogen, the importance of each elementary process in various parameter space is studied. In low-density plasmas (electron density ne≲1017 m−3) the excitation rates from the ground states and radiative decay rates, both of which have been reported previously, determine the excited state population. The inconsistency in the excitation rates affects the population distribution the most significantly in this parameter space. However, in higher density plasmas (ne≳1018 m−3), the excitation rates from excited states become important, which have never been reported in the literature, and may need to be approximated in some way. In order to validate these molecular datasets and approximated rates, we carried out experimental observations for two different hydrogen plasmas; a low-density radio frequency heated plasma (ne≈1016 m−3) and the Large Helical Device (LHD) divertor plasma (ne≳1018 m−3). The visible emission lines from EF1Σg+, HH¯1Σg+, D1Πu±, GK1Σg+, I1Πg±, J1Δg±, h3Σg+, e3Σu+, d3Πu±,g3Σg+, i3Πg±, and j3Δg± states were observed simultaneously and their population distributions were obtained from their intensities. We compared the observed population distributions with the CRM prediction, in particular the CRM with the rates compiled by Janev et al., Miles et al., and those calculated with the molecular convergent close-coupling (MCCC) method. The MCCC prediction gives the best agreement with the experiment, particularly for the emission from the low-density plasma. However, the population distribution in the LHD divertor shows a worse agreement with the CRM than those from low-density plasma, indicating the necessity of the precise excitation rates from excited states. We also found that the rates for the electron attachment is inconsistent with experimental results. This requires further investigation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2025

A convergence metric for counting statistics in time-resolved small angle neutron scattering

Here, this work introduces a model-independent, dimensionless metric for predicting optimal measurement duration in time-resolved small-angle neutron scattering using early-time data. Built on a Gaussian process regression framework, the method reconstructs scattering profiles with quantified uncertainty, even from sparse or noisy measurements. Demonstrated on the EQ-SANS instrument at the Spallation Neutron Source, the approach generalizes to general SANS instruments with a two-dimensional detector. A key result is the discovery of a dimensionless convergence metric revealing a universal power-law scaling in profile evolution across soft matter systems. When time is normalized by a system-specific characteristic time t*, the variation in inferred profiles collapses onto a single curve with an exponent between −2 and −1. This trend emerges within the first ten time steps, enabling early prediction of measurement sufficiency. The method supports real-time experimental optimization and is especially valuable for maximizing efficiency in low-flux environments such as compact accelerator-based neutron sources.

Tung, Chi-Huan [Oak Ridge National Laboratory (ORN↗

NASA NTRS1985

A Structural Dynamics Approach to the Simulation of Spacecraft Control/Structure Interaction

A relatively simple approach to the analysis of linear spacecraft control/structure interaction problems is presented. The approach uses a commercially available structural system dynamic analysis package for both controller and plant dynamics, thus obviating the need to transfer data between separate programs. The unilateral coupling between components in the control system block diagram is simulated using sparse matrix stiffness and damping elements available in the structural dynamic code. The approach is illustrated with a series of simple tutorial examples of a rigid spacecraft core with flexible appendages.

Young, J. W.↗

NASA NTRS1986

Comparison of various techniques for calibration of AIS data

The Airborne Imaging Spectrometer (AIS) samples a region which is strongly influenced by decreasing solar irradiance at longer wavelengths and strong atmospheric absorptions. Four techniques, the Log Residual, the Least Upper Bound Residual, the Flat Field Correction and calibration using field reflectance measurements were investigated as a means for removing these two features. Of the four techniques field reflectance calibration proved to be superior in terms of noise and normalization. Of the other three techniques, the Log Residual was superior when applied to areas which did not contain one dominant cover type. In heavily vegetated areas, the Log Residual proved to be ineffective. After removing anomalously bright data values, the Least Upper Bound Residual proved to be almost as effective as the Log Residual in sparsely vegetated areas and much more effective in heavily vegetated areas. Of all the techniques, the Flat Field Correction was the noisest.

Dar A. Roberts↗

NASA NTRS1996

Solutocapillary Convection Effects on Polymeric Membrane Morphology

Macro voids are undesirable large pores in membranes used for purification. They form when membranes are cast as thin films on a smooth surface by evaporating solvent (acetone) from a polymer solution. There are two un-tested hypotheses explaining the growth of macro voids. One states that diffusion of the non-solvent (water) is solely responsible, while the other states that solutocapillary convection is the primary cause of macro void growth. Solutocapillary convection is flow-caused by a concentration induced surface-tension gradient. Macrovoid growth in the former hypothesis is gravity independent, while in the latter it is opposed by gravity. To distinguish between these two hypotheses, experiments were designed to cast membranes in zero-gravity. A semi-automated apparatus was designed and built for casting membranes during the 20 secs of zero-g time available in parabolic aircraft flight such as NASA's KC-135. The phase changes were monitored optically, and membrane morphology was evaluated by scanning electron microscopy (SEM). These studies appear to be the first quantitative studies of membrane casting in micro-gravity which incorporate real-time data acquisition. Morphological studies of membranes cast at 0, 1, and 1.8 g revealed the presence of numerous, sparse and no macrovoids respectively. These results are consistent with the predictions of the solutocapillary hypothesis of macrovoid growth.

Krantz, William B.↗

NASA NTRS1999

Object-Oriented Design for Sparse Direct Solvers

We discuss the object-oriented design of a software package for solving sparse, symmetric systems of equations (positive definite and indefinite) by direct methods. At the highest layers, we decouple data structure classes from algorithmic classes for flexibility. We describe the important structural and algorithmic classes in our design, and discuss the trade-offs we made for high performance. The kernels at the lower layers were optimized by hand. Our results show no performance loss from our object-oriented design, while providing flexibility, case of use, and extensibility over solvers using procedural design.

Dobrian, Florin↗

NASA NTRS2008

Comparison of GPCP Monthly and Daily Precipitation Estimates with High-Latitude Gauge Observations

It is very important to know how much rain and snow falls around the world for uses that range from crop forecasting to disaster response, drought monitoring to flood forecasting, and weather analysis to climate research. Precipitation is usually measured with rain gauges, but rain gauges don t exist in areas that are sparsely populated, which tends to be a good portion of the globe. To overcome this, meteorologists use satellite data to estimate global precipitation. However, it is difficult to estimate rain and especially snow in cold climates using most current satellites. The satellite sensors are often "confused" by a snowy or frozen surface and therefore cannot distinguish precipitation. One commonly used satellite-based precipitation data set, the Global Precipitation Climatology Project (GPCP) data, overcomes this frozen-surface problem through the innovative use of two sources of satellite data, the Television Infrared Observation Satellite Operational Vertical Sounder (TOVS) and the Atmospheric Infrared Sounder (AIRS). Though the GPCP estimates are generally considered a very reliable source of precipitation, it has been difficult to assess the quality of these estimates in cold climates due to the lack of gauges. Recently, the Finnish Meteorological Institute (FMI) has provided a 12-year span of high-quality daily rain gauge observations, covering all of Finland, that can be used to compare with the GPCP data to determine how well the satellites estimate cold-climate precipitation. Comparison of the monthly GPCP satellite-based estimates and the FMI gauge observations shows remarkably good agreement, with the GPCP estimates being 6% lower in the amount of precipitation than the FMI observations. Furthermore, the month-to-month correlation between the GPCP and FMI is very high at 0.95 (1.0 is perfect). The daily GPCP estimates replicate the FMI daily occurrences of precipitation with a correlation of 0.55 in the summer and 0.45 in the winter. The winter result indicates the GPCP estimates have skill in "seeing" snowfall, which is the most challenging situation. Thus, the GPCP data set successfully overcomes a current limitation in satellite meteorology, namely the estimation of cold-climate precipitation. The success of the GPCP data set bodes well for future missions, whose instrumentation is specifically designed to give even more information for addressing cold-climate precipitation.

Bolvin, David T.↗