Search NASA⌕ Search

SEARCH · Search NASA

Results for “sampling algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

Using Temporal Information from Human Mobility Data to Detect Anchor Points

Spatiotemporal mobility data are available in massive quantities, but large quantities of data typically include fewer variables or data fields. Often, the only available fields are User ID, Longitude, Latitude, Timestamp (ULLT). This raises an important question: how much can we infer about human mobility patterns using only these four fields? With ULLT data, we do not know individuals' socioeconomic status information or when they are visiting their anchor points (AP) or locations (such as homes, places of employment, or schools), and it is a modern challenge to use this data to infer these characteristics. When detecting anchor locations with limited input information, verification and validation (VV) are significant challenges. This paper addresses the problem of identifying individuals' anchor locations using only temporal information from spatiotemporal datasets with limited attributes. Our approach does not explicitly use latitude and longitude during analysis. Locationbased information is only employed in the preprocessing stage to identify periods of movement (trips) and stops (dwelling). Beyond this step, all analysis is based on temporal patterns. In theory, if stops and dwell times could be detected through alternative means, our method could function entirely without location-based input. We demonstrate this methodology on the 2017 National Household Travel Survey (NHTS) data, because it includes a carefully designed and collected time use survey with representative sampling and labeled ground truth. The high-quality survey data allows us to test the accuracy of our methods because NHTS contains intended place labels and agent/user characteristics. We have also applied our validated AP identification algorithm on very large-scale GPS based trajectory data for Patterns-of-Life (PoL) assessment and other applications, but due to space limit that could not be presented here.

McBride, Liz [ORNL] (ORCID:0000000286925869)↗

Hamiltonian simulation in Zeno subspaces

Here, we investigate the quantum Zeno effect as a framework for designing and analyzing quantum algorithms for Hamiltonian simulation. We show that frequent projective measurements of an ancilla qubit register can be used to simulate quantum dynamics on a target qubit register with a circuit complexity similar to randomized approaches. The classical sampling overhead in the latter approaches is traded for ancilla qubit overhead in Zeno-based approaches. A second-order Zeno sequence is developed to improve scaling and implementations through unitary kicks are discussed. We derive rigorous error bounds that allow for identifying the associated circuit complexities for the first- and second-order Zeno sequences. We show that the circuits over the combined register can be identified as a subroutine commonly used in post-Trotter Hamiltonian simulation methods. We build on this observation to reveal connections between different Hamiltonian simulation algorithms.

Hamiltonian simulation↗

The effects of cloud inhomogeneities upon radiative fluxes, and the supply of a cloud truth validation dataset

The ASTER polar cloud mask algorithm is currently under development. Several classification techniques have been developed and implemented. The merits and accuracy of each are being examined. The classification techniques under investigation include fuzzy logic, hierarchical neural network, and a pairwise histogram comparison scheme based on sample histograms called the Paired Histogram Method. Scene adaptive methods also are being investigated as a means to improve classifier performance. The feature, arctan of Band 4 and Band 5, and the Band 2 vs. Band 4 feature space are key to separating frozen water (e.g., ice/snow, slush/wet ice, etc.) from cloud over frozen water, and land from cloud over land, respectively. A total of 82 Landsat TM circumpolar scenes are being used as a basis for algorithm development and testing. Numerous spectral features are being tested and include the 7 basic Landsat TM bands, in addition to ratios, differences, arctans, and normalized differences of each combination of bands. A technique for deriving cloud base and top height is developed. It uses 2-D cross correlation between a cloud edge and its corresponding shadow to determine the displacement of the cloud from its shadow. The height is then determined from this displacement, the solar zenith angle, and the sensor viewing angle.

Welch, Ronald M.↗

An asymptotic analysis of a general class of signal detection algorithms

For applications to the problem of radio frequency interference identification, or in the search for extraterrestrial intelligence, it is important to have a basic understanding of signal detection algorithms. A general technique for assessing the asymptotic sensitivity of a broad class of signal detection algorithms is given. In these algorithms, the decision is based on the value of X sub 1 + X sub 2...+ X sub n where the X sub 1's are obtained by sampling and preliminary processing of a physical process.

Mceliece, R. J.↗

A statistical technique for determining rainfall over land employing Nimbus-6 ESMR measurements

At 37 GHz, the frequency at which the Nimbus 6 Electrically Scanning Microwave Radiometer (ESMR 6) measures upwelling radiance, it was shown theoretically that the atmospheric scattering and the relative independence on electromagnetic polarization of the radiances emerging from hydrometers make it possible to monitor remotely active rainfall over land. In order to verify experimentally these theoretical findings and to develop an algorithm to monitor rainfall over land, the digitized ESMR 6 measurements were examined statistically. Horizontally and vertically polarized brightness temperature pairs (TH, TV) from ESMR 6 were sampled for areas of rainfall over land as determined from the rain recording stations and the WSR 57 radar, and areas of wet and dry ground (whose thermodynamic temperatures were greater than 5 C) over the Southeastern United States. These three categories of brightness temperatures were found to be significantly different in the sense that the chances that the mean vectors of any two populations coincided were less than 1 in 100.

Rodgers, E.↗

Relationships between a potential field-source surface model of the coronal magnetic field and properties of the solar wind at 1 AU

A comparison is made between the properties at the source surface of a potential field model of the solar corona and solar wind properties observed with ISEE 3 at 1 AU and extrapolated back to the sun. This is done for three consecutive Carrington rotations in the summer of 1979. The already known properties of a velocity minimum at the interplanetary current sheet and a tendency for the average velocity to increase with longitudinal distance from the current sheet are recovered. A better correlation between source surface properties and velocity is demonstrated by using the field strength on the source surface rather than longitudinal distance from the current sheet. Applying a simple algorithm to distinguish between transient and corotating interplanetary variations substantially increases the correlation. However, given a reasonable estimate of the number of degrees of freedom for the sample, only the correlation between source surface field strength and flow speed after the transients have been eliminated is statistically significant at the 1 percent level.

Suess, S. T.↗

A preliminary estimate of the EUVE cumulative distribution of exposure time on the unit sphere

A preliminary study of an all-sky coverage of the EUVE mission is given. Algorithms are provided to compute the exposure of the celestial sphere under the spinning telescopes, taking into account that during part of the exposure time the telescopes are blocked by the earth. The algorithms are used to give an estimate of exposure time at different ecliptic latitudes as a function of the angle of field of view of the telescope. Sample coverage patterns are also given for a 6-month mission.

Tang, C. C. H.↗

Computation of nonstationary strong shock diffraction by curved surfaces

A two-dimensional, high resolution shock-capturing algorithm was used on a supercomputer to solve Eulerian gasdynamic equations in order to simulate nonstationary strong shock diffraction by a circular arc model in a shock tube. The hypersonic Mach shock wave was assumed to arrive at a high angle of incidence, and attention was given to the effect of varying values of the ratio of specific heats on the shock diffraction process. Details of the conservation equations of the numerical algorithm, written in curvilinear coordinates, are provided, and model output is illustrated with the results generated for a Mach shock encountering a 15 deg circular arc. The sample graphics include isopycnics, a shock surface density profile, and pressure and Mach number contours.

Yang, J. Y.↗

Surface Soil Moisture Retrieval Using SSM/I and Its Comparison with ESTAR: A Case Study Over a Grassland Region

This study extends a previous investigation on estimating surface soil moisture using the Special Sensor Microwave/Imager (SSM/I) over a grassland region. Although SSM/I is not optimal for soil moisture retrieval, it can under some conditions provide information. Rigorous analyses over land have been difficult due to the lack of good validation data sets. A scientific objective of the Southern Great Plains 1997 (SGP97) Hydrology Experiment was to investigate whether the retrieval algorithms for surface soil moisture developed at higher spatial resolution using truck-and aircraft-based passive microwave sensors can be extended to the coarser resolutions expected from satellite platform. With the data collected for the SGP97, the objective of this study is to compare the surface soil moisture estimated from the SSM/I data with those retrieved from the L-band Electronically Scanned Thinned Array Radiometer (ESTAR) data, the core sensor for the experiment, using the same retrieval algorithm. The results indicated that an error of estimate of 7.81% could be achieved with SSM/I data as contrasted to 2.82% with ESTAR data over three intensive sampling areas of different vegetation regimes. It confirms the results of previous study that SSM/I data can be used to retrieve surface soil moisture information at a regional scale under certain conditions.

Jackson, T.↗

An Investigation into the Potential Application of Wavelets to Modal Testing and Analysis

The analysis of transient data of the type found in vibrating mechanical systems has been greatly improved through the use of modern techniques such as Fourier analysis. This is especially true when considered in conjunction with the development of the so-called Fast Fourier Transform algorithm by Cooley and the tremendous strides in computational power of the last several decades. The usefulness of the discrete Fourier Transform is its ability to transform sampled data from the "time-domain" to the "frequency domain," thereby allowing the analyst to decompose a signal into its frequency content. More recent developments have led to the wavelet transform. The strength of wavelet analysis is its ability to maintain both time and frequency information, thus making it an attractive candidate for the analysis of non-stationary signals. This report is an overview of wavelet theory and the potential use of the wavelet transform as an alternative to Fourier analysis in modal identification.

A. Fort Gwinn, Jr.↗

ICESat-2 Meltwater Depth Estimates: Application to Surface Melt on Amery Ice Shelf, East Antarctica

Surface melting occurs during summer on the Antarctic and Greenland ice sheets, but the volume of meltwater stored has been difficult to quantify due to a lack of accurate depth estimates. NASA’s ICESat-2 laser altimeter brings a new capability: photons penetrate water and are reflected from both the water and the underlying ice; the difference provides a depth estimate. ICESat-2 sampled Amery Ice Shelf on 2 January 2019 and showed double returns from surface depressions, indicating meltwater. For four melt features, we compared depth estimates from eight algorithms: six based on ICESat-2 and two from coincident Landsat-8 and Sentinel-2 imagery. All algorithms successfully identified surface water at the same locations. Algorithms based on ICESat-2 produced the most accurate depths; the image-based algorithms underestimated depths (by 30-70%). This implies that ICESat-2 depths can be used to tune image-based algorithms, moving us closer to quantifying stored meltwater volumes across Antarctica and Greenland.

ICESat-2↗

Model-Independent Time-Delay Interferometry Based on Principal Component Analysis

With a laser interferometric gravitational-wave detector in separate free flying spacecraft, the only way to achieve detection is to mitigate the dominant noise arising from the frequency fluctuations of the lasers via postprocessing. The noise can be effectively filtered out on the ground through a specific technique called time-delay interferometry (TDI), which relies on the measurements of time-delays between spacecraft and careful modeling of how laser noise enters the interferometric data. Recently, this technique has been recast into a matrix-based formalism by several authors, offering a different perspective on TDI, particularly by relating it to principal component analysis (PCA). In this work, we demonstrate that we can cancel laser frequency noise by directly applying PCA to a set of shifted data samples, without any prior knowledge of the relationship between single-link measurements and noise, nor time-delays. We show that this fully data-driven algorithm achieves a gravitational-wave sensitivity similar to classic TDI.

Quentin Baghi↗

Enhanced Ionization Charge Identification in the Short-Baseline Neutrino Program Neutrino Detectors with Deep Neural Networks

We present a deep neural net-based region of interest detection method (DNN ROI) for signal processing in the liquid argon time projection chambers of the Short-Baseline Neutrino (SBN) Program, SBND and ICARUS. DNN ROI addresses limitations of the traditional wire-by-wire thresholding algorithm by leveraging the full two-dimensional detector readout and cross-plane matching information. To account for detector performance variations, we explore training with augmented samples. We find that DNN ROI outperforms the traditional method in both low-level ROI identification performance and high-level reconstruction metrics for high-energy cosmic and accelerator neutrino interaction products, while also being more robust against detector variations, with or without sample augmentation.

Abratenko, P. [Tufts U.]↗

Curating AI-Ready Datasets for Equity and Environmental Justice: A Data-Centric AI Case Study

An equitable and environmentally just community is essentialin order to avoid disproportionate burden borne by vulnerablecommunities. This need becomes pressing in the aftermathof an extreme event such as disaster or hazard when it is diffi-cult for the governing bodies to implement resource allocationas per the need. Artificial Intelligence (AI) algorithms canhelp surface Equity and Environmental Justice (EEJ) issueswhen trained on EEJ datasets. However, curating AI-readyEEJ training datasets is challenging due to differences in fac-tors such as heterogeneity, resolution, modality, and level ofexpertise in labeling. Additionally, EEJ issues involve sensi-tive information where uncertainties and errors could degradethe performance of AI algorithms. For eg. Error in seasonalcrop yield information can highly affect the prediction of an-nual crop yield. To address these challenges, Data-centricAI (DCAI) methods are employed, which enhance AI algo-rithm performance even with limited training samples. DCAIprioritizes data quality, thereby reducing the adverse effectsof uncertainties and errors during the model training process.This research proposes a novel dataset and benchmark for an-alyzing the effect of the Maui Wildfire of 2023 for Equityand Environmental Justice (EEJ) issues. The proposed datasetaligns with the concepts of DCAI such as annotation quality,data preprocessing, privacy, feature engineering, governanceand provenance. We firmly believe that the proposed datasetwould lay a foundation to implement robust and reliable mod-ern AI algorithms for addressing EEJ issues.

Paridhi Parajuli↗

Revised estimates of NO 2 reductions during the COVID-19 lockdowns using updated TROPOMI NO 2 retrievals and model simulations

The TROPOspheric Monitoring Instrument (TROPOMI) observed unprecedented declines in NO 2 vertical column densities (VCD) over the world's most densely populated cities during the 2020 COVID-19 lockdowns. These favorable changes in NO 2 air quality were correlated with sharp reductions in traffic volume and economic activity during the lockdowns. In this comprehensive global study, we provide revised estimates of the declines in anthropogenic emissions for 36 megacities using a novel methodology for disentangling the anthropogenic emissions from the meteorological transport and natural variability. We further quantify the uncertainty associated with changes in the a priori profile shape information during the lockdowns due to reduced emissions. Satellite NO 2 retrieval techniques calculate an air mass factor that requires a priori NO 2 profile shape information representative of the local atmosphere. This information, which is typically obtained from a chemical transport model (CTM), was not available for the early studies. This study also accounts for the satellite sampling errors resulting from the selective sampling of non-cloudy scenes during the study period. For our analysis, we used CTM simulations that were generated with and without COVID-impacted emissions. We perform retrievals of tropospheric NO 2 columns with the NASA NO 2 algorithm, and then use observed and simulated data to disentangle the meteorological transport from the contribution due anthropogenic emissions. We found that the meteorological transport was most significant source of variability ranging between −35% and 22% of the change total tropospheric VCD. We also find that not accounting for changes in the a priori NO 2 profile shape information during the lockdowns resulted in systematic retrieval errors that were up to 12% of the estimated decline, and the elimination of cloud contaminated scenes resulted in sampling errors that in general ranged between varied ±15%.

NO2↗

Gradient Coding With Iterative Block Leverage Score Sampling

Gradient coding is a method for mitigating straggling servers in a centralized computing network that uses erasure-coding techniques to distributively carry out first-order optimization methods. Randomized numerical linear algebra uses randomization to develop improved algorithms for large-scale linear algebra computations. In this study, we propose a method for distributed optimization that combines gradient coding and randomized numerical linear algebra. The proposed method uses a randomized ℓ 2 -subspace embedding and a gradient coding technique to distribute blocks of data to the computational nodes of a centralized network, and at each iteration the central server only requires a small number of computations to obtain the steepest descent update. The novelty of our approach is that the data is replicated according to importance scores, called block leverage scores, in contrast to most gradient coding approaches that uniformly replicate the data blocks. Furthermore, we do not require a decoding step at each iteration, avoiding a bottleneck in previous gradient coding schemes. We show that our approach results in a valid ℓ 2 -subspace embedding, and that our resulting approximation converges to the optimal solution.

97 MATHEMATICS AND COMPUTING↗

Thermophysical Properties of Te-based II-VI Semiconductors: Reduced Algorithms for Thermal Diffusivity Determination

This paper presents methodologies for measuring the thermal diffusivity using the difference between temperatures measured at two, essentially independent, locations. A heat pulse is applied for an arbitrary time to one region of the sample; either the inner core or the outer wall. Temperature changes are then monitored versus time. The thermal diffusivity is calculated from the temperature difference versus time. No initial conditions are used directly in the final results.

Banish, R. Michael↗

Analysis of the MODIS Above-Cloud Aerosol Retrieval Algorithm Using MCARS

The Multi-sensor Cloud and Aerosol Retrieval Simulator (MCARS) presently produces synthetic radiance data from Goddard Earth Observing System version 5 (GEOS-5) model output as if the Moderate Resolution Imaging Spectroradiometer (MODIS) was viewing a combination of atmospheric column inclusive of clouds, aerosols and a variety of gases and land/ocean surface at a specific location. In this paper we use MCARS to study the MODIS Above-Cloud AEROsol retrieval algorithm (MOD06ACAERO). MOD06ACAERO is presently a regional research algorithm able to retrieve aerosol optical thickness over clouds, in particular absorbing biomass burning aerosols overlying marine boundary layer clouds in the Southeastern Atlantic Ocean. The algorithm’s ability to provide aerosol information in cloudy conditions makes it a valuable source of information for modeling and climate studies n an area where current clear sky-only operational MODIS aerosol retrievals effectively have a data gap between the months of June and October. We use MCARS for a verification and closure study of the MOD06ACAERO algorithm. The purpose of this study is to develop a set of constraints a model developer might use during assimilation of MOD06ACAERO data. Our simulations indicate that the MOD06ACAERO algorithm performs well for marine boundary layer clouds in the SE Atlantic provided some specific screening rules are observed. For the present study, a combination of five simulated MODIS data granules was used for a dataset of 13.5 million samples with known input conditions. When pixel retrieval uncertainty was less than 30%, optical thickness of the underlying cloud layer was greater than 4 and scattering angle range within the cloud bow was excluded, MOD06ACAERO retrievals agreed with the underlying ground truth (GEOS-5 cloud and aerosol profiles used to generate the synthetic radiances) with a slope of 0.913, offset of 0.06, and RMSE=0.107. When only near-nadir pixels were considered (view zenith angle within +/-20 degrees) the agreement with source data further improved (0.977, 0.051 and 0.096 respectively). Algorithm closure was examined using a single case out of the five 38 used for verification. For closure, the MOD06ACAERO code was modified to use GEOS-5 temperature and moisture profiles as ancillary. Agreement of MOD06ACAERO retrievals with source data for the closure study had a slope of 0.996 with offset -0.007 and RMSE of 0.097 at pixel uncertainty level of less than 40%, illustrating the benefits of high-quality ancillary atmospheric data for such retrievals.

MODIS↗