Search NASASearch

SEARCH · Search NASA

Results for “sparse data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Quantum block encoding for one-pair semiseparable matrices

Quantum block encoding (QBE) is a crucial step in the development of most quantum algorithms, as it provides an embedding of a given matrix into a suitable larger unitary matrix. Historically, the development of efficient techniques for QBE has mostly focused on sparse matrices; less effort has been devoted to data-sparse (e.g., rank-structured) matrices. In this work we examine a particular case of rank structure, namely, one-pair semiseparable matrices. We present a new block encoding approach that relies on a suitable factorization of the given matrix as the product of triangular and diagonal factors. To encode the matrix, the algorithm needs $2\log(N)+7$ ancillary qubits. Assuming that the data input oracles can be implemented with polylogarithmic depth, or that a QRAM input model is available, our proposed method requires $\mathcal{O}({\rm polylog} (N))$ time and has an error of $\mathcal{O}(N^2)$, where $N$ is the matrix size.

Antonioli, Giacomo [Pisa U.; CERN] (ORCID:00090000

Results of a statistical approach to rainfall estimation using Nimbus 5 6.7 micrometers and 11.5 micrometers THIR data

Nimbus 5 6.7 mm and 11.5 mm temperature humidity infrared radiometer (THIR) data were used in a simple multiple regression scheme to test the feasibility of using these data to estimate hourly rainfall. Throughout the test area (85 W to 105 W and 45 N to 30 N) subareas (8 deg x 6 deg) were chosen from which point to point and areal statistics were obtained. Four subsets of data were used. The first consisted of only those surface stations indicating precipitation whose latitude and longitude coincided with the THIR grid points. A second used surface stations 0.1 degree from the THIR grid points. The third was a combination of subsets one and two. A reciprocal distance weighting scheme was used to derive precipitation values in data sparse areas. A fourth subset was made using these data combined with the data from subsets one and two. Point estimates resulted in negative correlations between estimated and grid derived "surface" precipitation. One degree areal estimates showed a slight improvement with a correlation coefficient of approximately 0.11. Single regression areal estimates resulted in correlations of approximately 0.11 and 0.20 for the 6.7 mm and 11.5 mm data respectively. These poor results were attributed to problems which are inherent in the satellite data (location errors, short temporal span of data, wavelength of sensors, etc.) and the lack of sufficient surface data to better verify the satellite estimate.

Ormsby, J. P.

Tropical cyclone track and genesis forecasting using satellite microwave sounder data

Although many dynamical and statistical prediction schemes are available to forecasters, tropical cyclone track errors are still large. One primary difficulty is that tropical cyclones exist over the data-sparse tropical oceans. Satellite sounders, however, routinely provide numerous data over these areas. Mean layer temperatures from the Scanning Microwave Spectrometer on board the Nimbus 6 satellite are decomposed using empirical orthogonal functions, and the expansion coefficients are related to deviations from the persistence forecast location, to speed change, to direction change and to intensity change. The significance of the regression equations is tested by a null hypothesis of zero correlation coefficient. It appears that significant information about tropical cyclone motion exists in the satellite-estimated mean layer temperatures, especially at upper levels. A physical interpretation of the statistical results is offered, and a one-storm-out independent test is used to test the stability of the equations. Finally, some further work is suggested.

Kidder, S. Q.

Determination of stratospheric temperature and height gradients from Nimbus 3 radiation data

To improve the specification of stratospheric, horizontal, temperature and geopotential height fields needed for high-flying aircraft, we derived a technique to estimate data between satellite tracks using interpolated infrared interferometer spectrometer 15-micron radiation data from Nimbus 3. The interpolation is based on the observed gradients of the medium resolution infrared 15-micron radiances between subsatellite tracks. The technique was verified with radiosonde data taken within 6 hr of the satellite data. Comparison indicates that the technique developed here produces analyses that are in general agreement with those from radiosonde data. In addition, this technique provides details over areas of sparse data not shown by conventional techniques.

Nicholas, G. W.

Location of Lunakhod 2 from laser ranging observations

Results of laser ranging attempts on Lunakhod 2 are presented. Laser ranging can only be accomplished at night, so only the straight-line distance between the end points of a daytime traverse can be determined. Uncertainties of positional determination are strongly dependent on the length of the tracking arc. The data, obtained in the first two lunar nights, are too sparse to yield reliable positional determinations. The results clearly illustrate the critical importance of a high-quality lunar ephemeris for the interpretation of sparse data.

Mulholland, J. D.

An initial approach to the utilization of VAS satellite sounding data

The primary objective is the development of methods to utilize satellite soundings. To achieve that, a more precise understanding of the characteristics of satellite derived soundings is required. The initial approach in the utilization of satellite soundings is to find a way to combine rawinsondes and satellite data into a unified data set. If this can be done in a meaningful way, satellite data could be integrated into existing data and interpretation would be enhanced. In this attempt, both rawinsonde and satellite soundings will be decomposed by the use of the Fourier cosine series. Then, each harmonic will be compared to get a better understanding of the representativeness of the satellite sounding data. Harmonics taken from satellite and rawinsonde soundings will be combined to provide a unified data set that can be used both over data sparse ocean areas as well as over land where rawinsonde data are available.

Shin, Kyung-Sup

Weather Intelligent Navigation Data and Models for Aviation Planning (WINDMAP)

WINDMAP addresses the emerging needs in the aviation community of providing real-time weather forecasting to improve the safety of low altitude aircraft operations. This is accomplished through the integration of real-time observations from autonomous systems, such as drones and urban air taxis, with numerical weather prediction models and flight management and safety systems. To solve this problem, several technical challenges have been identified. These include (1) developing autonomous UAS capable of conducting observations accurately and reliably; (2) determining the number and frequency of required observations and the sensitivity of these observations in data sparse regions of the lower atmosphere;(3) assimilating dense observational data into models in real-time with sufficient resolution and accuracy; (4) developing novel physics-based reduced order models capable of incorporating diverse data sets; and (5)integrating real-time forecasting into UTM and DAA (detect-and-avoid) architectures for path planning and navigation. The goal of this proposed effort is to demonstrate the value of using small UAS to collect measurements of the dynamic and thermodynamic properties of the lower atmosphere at scales that match or exceed the spatio-temporal resolution of today’s best numerical weather prediction models

Koushik Datta

A hill-sliding strategy for initialization of Gaussian clusters in the multidimensional space

A hill sliding technique was devised to extract Gaussian clusters from the multivariate probability density estimate of sample data for the first step of iterative unsupervised classification. Each cluster was assumed to posses a unimodal normal distribution. A clustering function proposed distinguished elements of a cluster under formation from the rest in the feature space. Initial clusters were extracted one by one according to the hill sliding tactics. A dimensionless cluster compactness parameter was proposed as a universal measure of cluster goodness and used satisfactorily in test runs with LANDSAT multispectral scanner data. The normalized divergence, defined by the cluster divergence divided by the entropy of the entire sample data, was utilized as a general separability measure between clusters. An overall clustering objective function was set forth in terms of cluster covariance matrices, from which the cluster compactness measure could be deduced. Minimal improvement of initial data partitioning was evaluated by this objective function in eliminating scattered sparse data points. The hill sliding clustering technique developed herein has the potential applicability to decomposition any multivariate mixture distribution into a number of unimodal distributions when an appropriate distribution function to the data set is employed.

Park, J. K.

Determining Greenland Ice Sheet Accumulation Rates from Radar Remote Sensing

An important component of NASA's Program for Arctic Regional Climate Assessment (PARCA) is a mass balance investigation of the Greenland Ice Sheet. The mass balance is calculated by taking the difference between the snow accumulation and the ice discharge of the ice sheet. Uncertainties in this calculation include the snow accumulation rate, which has traditionally been determined by interpolating data from ice core samples taken throughout the ice sheet. The sparse data associated with ice cores, coupled with the high spatial and temporal resolution provided by remote sensing, have motivated scientists to investigate relationships between accumulation rate and microwave observations.

Jezek, Kenneth C.

Determination of stratospheric temperature and height gradients from nimbus 3 radiation data

To improve the specification of stratospheric horizontal temperature and geopotential height fields from satellite radiation data, needed for high flying aircraft, a technique was derived to estimate data between satellite tracks using interpolated IRIS 15-micron data from Nimbus III. The interpolation is based on the observed gradients of the MRIR 15-micron radiances between subsatellite tracks. The technique was verified with radiosonde data taken within 6 hours of the satellite data. The sample varied from 1126 pairs at low levels to 383 pairs at 10 mb using northern hemisphere data for June 15 to July 20, 1969. The data were separated into five latitude bands. The Rms temperature differences were generally from 2 to 5 C for all levels above 300 mb. From 500 to 300 mb RMS differences vary from 4 to 9C except at high latitudes which show values near 3C. The RMS differences between radiosonde heights and those calculated hydrostatically from the surface were from 30 to 280 meters increasing from the surface to 10 mb. Integration starting at 100 mb reduced the RMS difference in the stratosphere to 20 to 120 meters from 70 to 10 mb. From a comparison with actual operational maps at 50 and 10 mb, it appears the techniques developed produce analyses in general agreement with those from radiosonde data. In addition, they are able to indicate details over areas of sparse data not shown by conventional techniques.

Nicholas, G. W.

Predictability of Malaria Transmission Intensity in the Mpumalanga Province, South Africa, Using Land Surface Climatology and Autoregressive Analysis

There has been increasing effort in recent years to employ satellite remotely sensed data to identify and map vector habitat and malaria transmission risk in data sparse environments. In the current investigation, available satellite and other land surface climatology data products are employed in short-term forecasting of infection rates in the Mpumalanga Province of South Africa, using a multivariate autoregressive approach. The climatology variables include precipitation, air temperature and other land surface states computed by the Off-line Land-Surface Global Assimilation System (OLGA) including soil moisture and surface evaporation. Satellite data products include the Normalized Difference Vegetation Index (NDVI) and other forcing data used in the Goddard Earth Observing System (GEOS-1) model. Predictions are compared to long- term monthly records of clinical and microscopic diagnoses. The approach addresses the high degree of short-term autocorrelation in the disease and weather time series. The resulting model is able to predict 11 of the 13 months that were classified as high risk during the validation period, indicating the utility of applying antecedent climatic variables to the prediction of malaria incidence for the Mpumalanga Province.

Grass, David

An algorithm for extraction of periodic signals from sparse, irregularly sampled data

Temporal gaps in discrete sampling sequences produce spurious Fourier components at the intermodulation frequencies of an oscillatory signal and the temporal gaps, thus significantly complicating spectral analysis of such sparsely sampled data. A new fast Fourier transform (FFT)-based algorithm has been developed, suitable for spectral analysis of sparsely sampled data with a relatively small number of oscillatory components buried in background noise. The algorithm's principal idea has its origin in the so-called 'clean' algorithm used to sharpen images of scenes corrupted by atmospheric and sensor aperture effects. It identifies as the signal's 'true' frequency that oscillatory component which, when passed through the same sampling sequence as the original data, produces a Fourier image that is the best match to the original Fourier space. The algorithm has generally met with succession trials with simulated data with a low signal-to-noise ratio, including those of a type similar to hourly residuals for Earth orientation parameters extracted from VLBI data. For eight oscillatory components in the diurnal and semidiurnal bands, all components with an amplitude-noise ratio greater than 0.2 were successfully extracted for all sequences and duty cycles (greater than 0.1) tested; the amplitude-noise ratios of the extracted signals were as low as 0.05 for high duty cycles and long sampling sequences. When, in addition to these high frequencies, strong low-frequency components are present in the data, the low-frequency components are generally eliminated first, by employing a version of the algorithm that searches for non-integer multiples of the discrete FET minimum frequency.

Wilcox, J. Z.

Extension of surface data by use of meteorological satellites

Ways of using meteorological satellite data to extend surface data are summarized. Temperature models are prepared from infrared data from ITOS/NOAA, NIMBUS, SMS/GOES, or future LANDSAT satellites. Using temperatures for surface meteorological stations as anchors, an adjustment is made to temperature values for each pixel in the model. The result is an image with an estimated temperature for each pixel. This provides an economical way of producing detailed temperature information for data-sparse areas, such as are found in underdeveloped countries. Related uses of these satellite data are also given, including the use of computer prepared cloud-free composites to extend climatic zones, and their use in discrimination of reflectivity-thermal regime zones.

Giddings, L. E.

An airborne meteorological data collection system using satellite relay /ASDAR/

The paper describes the aircraft to satellite data relay (ASDAR) project which processes information collected by the navigation and data systems of widebody jet aircraft which cross data-sparse areas of the tropics and southern hemisphere. The ASDAR system consists of a data acquisition and control unit to acquire, store, and format latitude, longitude, altitude, wind speed, wind direction, and outside air temperature data; a transmitter to relay the formatted data via satellite to the ground; and a clock to time the data sampling and transmission periods.

Bagwell, J. W.

Upper-Stratospheric Ozone Trends 1979-1998

Extensive analyses of ozone observations between 1978 and 1998 measured by Dobson Umkehr, Stratospheric Aerosol and Gas Experiment (SAGE) I and II, and Solar Backscattered Ultraviolet (SBUV) and (SBUV)/2 indicate continued significant ozone decline throughout the extratropical upper stratosphere from 30-45 km altitude. The maximum annual linear decline of -0.8 +/- 0.2 %/yr(2sigma) occurs at 40 km and is well described in terms of a linear decline modulated by the 11-year solar variation. The minimum decline of -0.110.1% yr-1(2o) occurs at 25 km in midlatitudes, with remarkable symmetry between the Northern and Southern Hemispheres at 40 km altitude. Midlatitude upper-stratospheric zonal trends exhibit significant seasonal variation (+/- 30% in the Northern Hemisphere, +/- 40% in the Southern Hemisphere) with the most negative trends of -1.2%/yr occurring in the winter. Significant seasonal trends of -0.7 to -0.9%/yr occur at 40 km in the tropics between April and September. Subjecting the statistical models used to calculate the ozone trends to intercomparison tests on a variety of common data sets yields results that indicate the standard deviation between trends estimated by 10 different statistical models is less than 0.1%/yr in the annual-mean trend for SAGE data and less than 0.2%/yr in the most demanding conditions (seasons with irregular, sparse data) [World Meteorological Organization (WMO), 1998]. These consistent trend results between statistical models together with extensive consistency between the independent measurement-system trend observations by Dobson Umkehr, SAGE I and II, and SBUV and SBUV/2 provide a high degree of confidence in the accuracy of the declining ozone amounts reported here. Additional details of ozone trend results from 1978 to 1996 (2 years shorter than reported here) along with lower-stratospheric and tropospheric ozone trends, extensive intercomparisons to assess relative instrument drifts, and retrieval algorithm details are given by WMO [1998].

Newchurch, M. J.

Determining Greenland Ice Sheet Accumulation Rates from Radar Remote Sensing

An important component of NASA's Program for Arctic Regional Climate Assessment (PARCA) is a mass balance investigation of the Greenland Ice Sheet. The mass balance is calculated by taking the difference between the areally Integrated snow accumulation and the net ice discharge of the ice sheet. Uncertainties in this calculation Include the snow accumulation rate, which has traditionally been determined by interpolating data from ice core samples taken from isolated spots across the ice sheet. The sparse data associated with ice cores juxtaposed against the high spatial and temporal resolution provided by remote sensing , has motivated scientists to investigate relationships between accumulation rate and microwave observations as an option for obtaining spatially contiguous estimates. The objective of this PARCA continuation proposal was to complete an estimate of surface accumulation rate on the Greenland Ice Sheet derived from C-band radar backscatter data compiled in the ERS-1 SAR mosaic of data acquired during, September-November, 1992. An empirical equation, based on elevation and latitude, is used to determine the mean annual temperature. We examine the influence of accumulation rate, and mean annual temperature on C-band radar backscatter using a forward model, which incorporates snow metamorphosis and radar backscatter components. Our model is run over a range of accumulation and temperature conditions. Based on the model results, we generate a look-up table, which uniquely maps the measured radar backscatter, and mean annual temperature to accumulation rate. Our results compare favorably with in situ accumulation rate measurements falling within our study area.

Jezek, Kenneth C.

Introducing and Evaluating the Climate Hazards Center IMERG with Stations (CHIMES) Timely Station-Enhanced Integrated Multisatellite Retrievals for Global Precipitation Measurement

As human exposure to hydroclimatic extremes increase and the number of in situ precipitation observations declines, precipitation estimates, such as those provided by the Integrated Multisatellite Retrievals for Global Precipitation Measurement (GPM) (IMERG) mission, provide a critical source of information. Here, we present a new gauge-enhanced dataset [the Climate Hazards Center IMERG with Stations (CHIMES)] designed to support global crop and hydrologic modeling and monitoring. CHIMES enhances the IMERG Late Run product using an updated Climate Hazards Center (CHC) high-resolution climatology (CHPclim) and low-latency rain gauge observations. CHPclim differs from other products because it incorporates long-term averages of satellite precipitation, which increases CHPclim ’s fidelity in data-sparse areas with complex terrain. This fidelity translates into performance increases in unbiased IMERGlate data, which we refer to as CHIME. This is augmented with gauge observations to produce CHIMES. The CHC’s curated rain gauge archive contains valuable contributions from many countries. There are two versions of CHIMES: preliminary and final. The final product has more copious and better-curated station data. Every pentad and month, bias-adjusted IMERGlate fields are combined with gauge observations to create pentadal and monthly CHIMESprelim and CHIMESfinal. Comparisons with pentadal, high-quality gridded station data show that IMERG late performs well (r = 0.75), but has some systematic biases which can be reduced. Monthly cross-validation results indicate that unbiasing increases the variance explained from 50% to 63% and decreases the mean absolute error from 48 to 39 mm month −1. Gauge enhancement then increases the variance explained to 75%, reducing the mean absolute error to 27 mm month −1.

Chris C funk

The Use of Additional GPS Frequencies to Independently Determine Tropospheric Water Vapor Profiles

It is well known that the currently employed L1 and L2 GPS/MET frequencies (1.2 - 1.6) Ghz) do not allow for the separation of water vapor and density (or temperature) from active microwave occultation measurements in regions of the troposphere warmer than 240 K Therefore, additional information must be used, from other types of measurements and weather analyses, to recover water vapor (and temperature) profiles. Thus in data sparse regions, these inferred profiles can be subject to larger errors than would result in data rich regions. The use of properly selected additional GPS frequencies enables a direct, independent measurement of the absorption associated with the water vapor profile, which may then be used in the standard GPS/MET retrievals to obtain a more accurate determination of atmospheric temperature throughout the water vapor layer. This study looks at the use of microwave crosslinks in the region of the 22 Ghz water vapor absorption line for this purpose. An added advantage of using 22 Ghz frequencies is that they are only negligibly affected by the ionosphere in contrast to the large effect at the GPS frequencies. The retrieval algorithm uses both amplitude and phase measurements to obtain profiles of atmospheric pressure, temperature and water water vapor pressure with a vertical resolution of 1 km or better. This technique also provides the cloud liquid water content along the ray path, which is in itself an important element in climate monitoring. Advantages of this method include the ability to make measurements in the presence of clouds and the use of techniques and technology proven through the GPS/MET experiment and several of NASA's planetary exploration missions. Simulations demonstrating this method will be presented for both clear and cloudy sky conditions.

Herman, B.M.