Search NASA⌕ Search

SEARCH · Search NASA

Results for “sampling bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Seeing through noise in power laws

Despite widespread claims of power laws across the natural and social sciences, evidence in data is often equivocal. Modern data and statistical methods reject even classic power laws such as Pareto’s law of wealth and the Gutenberg–Richter law for earthquake magnitudes. We show that the maximum-likelihood estimators and Kolmogorov–Smirnov (K-S) statistics in widespread use are unexpectedly sensitive to ubiquitous errors in data such as measurement noise, quantization noise, heaping and censorship of small values. This sensitivity causes spurious rejection of power laws and biases parameter estimates even in arbitrarily large samples, which explains inconsistencies between theory and data. We show that logarithmic binning by powers of λ > 1 attenuates these errors in a manner analogous to noise averaging in normal statistics and that λ thereby tunes a trade-off between accuracy and precision in estimation. Binning also removes potentially misleading within-scale information while preserving information about the shape of a distribution over powers of λ, and we show that some amount of binning can improve sensitivity and specificity of K-S tests without any cost, while more extreme binning tunes a trade-off between sensitivity and specificity. We therefore advocate logarithmic binning as a simple essential step in power-law inference.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Evaluation of Hanford 200 West Area Tank Farms (241-S/241-SX-/241-U tank farms) Physical Properties Data for Use in Development of West Area Tank Treatment (WATT) Processing

With the recent acceptance of West Area Tank Treatment disposition alternative for 200 West Area tanks at the Hanford Site by the State of Washington and the U.S. Department of Energy, a review was initiated to identify the physical properties data available in the literature for the Hanford 241-S, 241-SX, and 241-U tank farms. The literature reviewed indicated that there is a relatively small set of useful data on physical properties of 200 West Area tanks, and the data that do exist are biased around a narrow range of tank samples. Much of the testing between the 1990s and mid-2010s was intended to support either enhanced sludge washing or feed delivery to the Pretreatment Facility at the Hanford Waste Treatment and Immobilization Plant. As such, some physical properties of 200 West Area samples were measured under conditions that are no longer relevant. Because of the distinctly different nature of many past processes at the 200 West Area compared to the 200 East Area, insight from waste testing in the 200 East Area waste should be used with caution, as there may be significantly different qualities in the physical properties data between these two areas (both in situ and as measured in laboratory analyses). Based on this assessment, there is a need to collect additional physical property data to support planning for 200 West Area retrievals.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

The DECADE cosmic shear project II: photometric redshift calibration of the source galaxy sample

We present the photometric redshift characterization and calibration for the Dark Energy Camera All Data Everywhere (DECADE) weak lensing dataset: a catalog of 107 million galaxies observed by the Dark Energy Camera (DECam) in the northern Galactic cap. The redshifts are estimated from a combination of wide-field photometry, deep-field photometry with associated redshift estimates, and a transfer function between the wide field and deep field that is estimated using a source injection catalog. We construct four tomographic bins for the galaxy catalog, and estimate the redshift distribution, $n(z)$, within each one using the Self-organizing Map Photo-Z (SOMPZ) methodology. Our estimates include the contributions from sample variance, zeropoint calibration uncertainties, and redshift biases, as quantified for the deep-field dataset. The total uncertainties on the mean redshifts are $σ_{\langle}$$_z$$_{\rangle} ≈ 0.01$. The SOMPZ estimates are then compared to those from the clustering redshift method, obtained by cross-correlating our source galaxies with galaxies in spectroscopic surveys, and are shown to be consistent with each other.

Anbajagane, D. [Univ. of Chicago, IL (United State↗
NASA NTRS1979

Analysis of GEOS-3 altimeter data and extraction of ocean wave height and dominant wavelength

When the amplitude and timing biases are removed from the GEOS-3 Sample and Hold (S&H) gates, the mean return waveforms can be excellently fitted with a theoretical template which represents the convolution of: (1) the radar point target response; (2) the range noise (jitter) in the altimeter tracking loop; (3) the sea surface height distribution; and (4) the antenna pattern as a function of the range to mean sea level. Several techniques of varying complexity to remove the effect of the tracking loop jitter in computing the wave height are considered. They include: (1) realigning the S&H gates to their actual positions with respect to mean sea level before averaging; (2) using the observed standard deviation on the altitude measurement to remove the integrated effect of the tracking loop jitter, and (3) using a look-up table to correct for the expected value of range noise. Analysis of skewness in the GEOS return waveform demonstrates the potential of a satellite radar altimeter to determine the dominant wavelength of ocean waves.

Walsh, E. J.↗
NASA NTRS1984

A comparison of Landsat point and rectangular field training sets for land-use classification

Rectangular training fields of homogeneous spectroreflectance are commonly used in supervised pattern recognition efforts. Trial image classification with manually selected training sets gives irregular and misleading results due to statistical bias. A self-verifying, grid-sampled training point approach is proposed as a more statistically valid feature extraction technique. A systematic pixel sampling network of every ninth row and ninth column efficiently replaced the full image scene with smaller statistical vectors which preserved the necessary characteristics for classification. The composite second- and third-order average classification accuracy of 50.1 percent for 331,776 pixels in the full image substantially agreed with the 51 percent value predicted by the grid-sampled, 4,100-point training set.

Tom, C. H.↗
NASA NTRS1989

Adaptive Telemetry Multiplexer

Telemetry-data-acquisition unit adjusted remotely to produce changes in sampling rate, sampling channels, measurement scale, and output-bias level. Functional configuration adapted to changing conditions or new requirements by distant operator over telemetry link. Reconfiguration done in real time, without removing equipment from service. Bus-interface unit accepts reprogramming commands and translates them for low-rate adaptive multiplexer. Reprogrammable equipment reduces need for spare parts, since not necessary to stock variety of hardware with fixed characteristics. Adaptive multiplexer performs well in tests, amplitude errors less than 0.5 percent, distortion less than 0.25 percent, and crosstalk and common-mode rejection indiscernible.

Sinderson, R. L.↗
NASA NTRS1990

A redshift survey of IRAS galaxies. I - Sample selection

A complete all-sky sample of objects, flux-limited at 60 microns, has been extracted from the data base of the IRAS. The sample consists of 5014 objects, of which 2649 are galaxies and 13 are not yet identified. In order to study large-scale structure with this sample, it must be free of systematic biases. Corrections are applied for a major systematic effect in the flux densities listed in the IRAS Point Source Catalog: sources resolved by the IRAS beam have flux densities systematically underestimated. In addition, accurate flux densities are obtained for sources flagged as variable, or of moderate flux quality at 60 microns. The IRAS detectors suffered radiation-induced responsivity enhancement (hysteresis) due to crossings of the satellite scans across the Galactic plane; this effect is measured and is shown to be negligible.

Strauss, Michael A.↗
NASA NTRS1992

The topology of large-scale structure. V - Two-dimensional topology of sky maps

A 2D algorithm is applied to observed sky maps and numerical simulations. It is found that when topology is studied on smoothing scales larger than the correlation length, the topology is approximately in agreement with the random phase formula for the 2D genus-threshold density relation, G2(nu) varies as nu(e) exp-nu-squared/2. Some samples show small 'meatball shifts' similar to those seen in corresponding 3D observational samples and similar to those produced by biasing in cold dark matter simulations. The observational results are thus consistent with the standard model in which the structure in the universe today has grown from small fluctuations caused by random quantum noise in the early universe.

Gott, J. R., III↗
NASA NTRS2000

Application of Statistical Methods of Rain Rate Estimation to Data From The TRMM Precipitation Radar

The TRMM Precipitation Radar is well suited to statistical methods in that the measurements over any given region are sparsely sampled in time. Moreover, the instantaneous rain rate estimates are often of limited accuracy at high rain rates because of attenuation effects and at light rain rates because of receiver sensitivity. For the estimation of the time-averaged rain characteristics over an area both errors are relevant. By enlarging the space-time region over which the data are collected, the sampling error can be reduced. However. the bias and distortion of the estimated rain distribution generally will remain if estimates at the high and low rain rates are not corrected. In this paper we use the TRMM PR data to investigate the behavior of 2 statistical methods the purpose of which is to estimate the rain rate over large space-time domains. Examination of large-scale rain characteristics provides a useful starting point. The high correlation between the mean and standard deviation of rain rate implies that the conditional distribution of this quantity can be approximated by a one-parameter distribution. This property is used to explore the behavior of the area-time-integral (ATI) methods where fractional area above a threshold is related to the mean rain rate. In the usual application of the ATI method a correlation is established between these quantities. However, if a particular form of the rain rate distribution is assumed and if the ratio of the mean to standard deviation is known, then not only the mean but the full distribution can be extracted from a measurement of fractional area above a threshold. The second method is an extension of this idea where the distribution is estimated from data over a range of rain rates chosen in an intermediate range where the effects of attenuation and poor sensitivity can be neglected. The advantage of estimating the distribution itself rather than the mean value is that it yields the fraction of rain contributed by the light and heavy rain rates. This is useful in estimating the fraction of rainfall contributed by the rain rates that go undetected by the radar. The results at high rain rates provide a cross-check on the usual attenuation correction methods that are applied at the highest resolution of the instrument.

Meneghini, R.↗
NASA NTRS2010

Examining the Uppermost Surface of the Lunar Regolith

This slide presentation reviews the examination of the uppermost surface of the lunar regolith. It shows the mechanism (i.e. a Clam Shell Sampling Device) that was used to retrieve samples of the surface of the lunar soil. Samples were obtained from the devices, and they were examined in the scanning electron microscope (SEM). Using a lunar simulant, JSC-1a, test were run to ascertain if the sample from the clam shell device were biased due to the collection. The results of the test were that all the fine grains analyzed to the limit of the capabilities were found to be lunar in composition, though non-lunar contaminants may exist in the submicron population. Further work is required, though the initial study shows that the uppermost surface is enriched in fine (< 2 micron grains) compared to the bulk soil.

Noble, Sarah↗
NASA NTRS2015

CORRIGENDUM of the MJO Transition from Shallow to Deep Convection in Cloudsat-Calipso Data and GISS GCM Simulations

We have identified several errors in the calculations that were performed to create Fig. 3 of Del Genio et al. (2012). These errors affect the composite evolution of precipitation and column water vapor versus lag relative to the Madden-Julian oscillation (MJO) peak presented in that figure. The precipitation and column water vapor data for the April and November 2009 MJO events were composited incorrectly because the date of the MJO peak at a given longitude was assigned to the incorrect longitude band. In addition, the precipitation data for all MJO events were first accumulated daily and the daily accumulations averaged at each lag to create the composite, rather than the averaging of instantaneous values that was used for other composite figures in the paper. One poorly sampled day in the west Pacific therefore biases the composite precipitation in that region at several lags after the MJO peak. Finally, a 4-day running mean was mistakenly applied to the precipitation and column water vapor data rather than the intended 5-day running mean. The results of the corrections are that an anomalous west Pacific precipitation maximum510 days after the MJO peak is removed and the maximum in west Pacific precipitation one pentad before the MJO peak is now more evident; there is now a clear maximum in precipitation for the entire warm pool one pentad before the MJO peak; west Pacific column water vapor now varies more strongly as a function of lag relative to the peak; and precipitation, and to a lesser extent column water vapor, in general vary more smoothly with time. The corrections do not affect any other parts of the paper nor do they change the scientific conclusions we reached. The 4-day running mean error also affects Figs. 1 and 2 therein, with almost imperceptible impacts that do not affect any results or necessitate major changes to the text.

correction↗
DOE OSTI2026

DESI DR2 Reference Mocks: Clustering results from UCHUU ELGs and QSOs

High-redshift galaxy clustering provides a powerful probe of the growth of structure, testing models of dark matter, dark energy, and galaxy formation during the epoch when the Universe was rapidly evolving. Emission line galaxies (ELGs) and quasars (QSOs) are used as tracers of dark matter by the Dark Energy Spectroscopic Instrument (DESI) to probe this redshift regime. We present results from ELG and QSO mock catalogs created from the Uchuu N-body simulation and tuned to DESI Data Release 2 (DR2) clustering. Employing a modified subhalo abundance matching (SHAM) technique, we populate Uchuu halos and subhalos with QSOs between 0.8 < z < 2.1. For ELGs, we modify this method to select satellite galaxies with low velocities relative to their associated central halos, and populate a separate set of Uchuu halos and subhalos with ELGs between 0.8 < z < 1.6. In this paper, we reproduce the redshift evolution of number density and clustering statistics across the fitted range of scales. We also measure the large-scale clustering bias of both the data and mock samples. These results improve simulated lightcone construction from cosmological models and enhance our understanding of the galaxy-halo connection.

Vaisakh, R. [Southern Methodist U.] (ORCID:0009000↗
DOE OSTI2024

Reconstruction and Selection of Neutrino Interactions in MicroBooNE using Deep Convolutional Neural Networks

In this document, we describe a new reconstruction workflow developed for the MicroBooNE experiment. It features the use of Deep Convolutional Neural Networks trained to recognize key structures within the data sufficient for the 3D reconstruction of neutrino interactions within the detector. As a test of the reconstruction utility, the products of the reconstruction workflow are used to select inclusive charged-current (CC) $\nu_e$ and $\nu_\mu$ interactions in both simulated and real MicroBooNE data. In simulation, our $\nu_e$ and $\nu_\mu$ selections achieve an efficiency of 57% and 68\%, respectively, with a purity of 91% and 96%, respectively. We find that these selections are competitive with the inclusive selections used for the most recent MicroBooNE LEE searches. In particular, the CC-$\nu_e$ inclusive selection efficiency improves by over 20% while also improving sample purity. As a first step in quantifying potential bias, the data and Monte Carlo expectati ons are compared for both selections using the MicroBooNE open data. Within statistical and systematic uncertainties, both the electron and muon CC-inclusive event samples agree. A comparison of the real data events chosen by our work and another reconstruction framework shows that the two analyses each identify a sizeable fraction of events the other does not. This suggests that future analyses integrating the strengths of each could lead to combined gains. This work demonstrates, for the first time on real LArTPC data, state-of-the-art neutrino interaction reconstruction centered around deep learning algorithms.

43 PARTICLE ACCELERATORS↗
NASA NTRS2020

Biases in the In Situ Measurement of Particulate Organic Carbon and Its Effect on the Calibration and Validation of Ocean Color Sensors

Particulate organic carbon (POC) plays an oversize role, relative to its standing stock in the global carbon (C) cycle. Accurate measurement of POC is central to understanding the ocean C flux and its sensitivity to climate forcing. POC is a standard NASA ocean color data product, which lacks a consensus, quality-assured measurement protocol for satellite validation. Thus, algorithms based on field measurements lacking verified uncertainties have limited applicability towards climate data records. Different sampling and filtration protocols, and blank corrections, introduce biases in the magnitude of POC measured from the field. A significant filter blank attributable to dissolved organic C (DOC) adsorption that, until recently has been seldom corrected for, likely has introduced biases in POC global datasets.

Chaves, Joaquín E.↗
NASA NTRS1984

The rotation of small asteroids

The Binzel and Mulholland (1983) sample of photoelectrically determined rotational parameters for 17 main belt asteroids with diameters less than 30 km are compared with previous observations of asteroids of that size range. Rigorous statistical tests are applied to investigate bias effects and quantify results on asteroid rotation. The samples are described and compared for rotational frequency, rotational amplitude, frequency distribution, and diameter and frequency dependence. It is concluded that the observed rotational frequency distribution can be acceptably fit by two Maxwellian distributions, which is consistent with the hypothesis that there are separate populations of slow and fast rotating asteroids. The frequency distributions of main belt asteroids less than 15 km in diameter and earth and Mars crossers do not differ significantly, but the larger mean lightcurve amplitude of these crossers is statistically significant. No significant diameter dependence on rotational frequency is found among the sample asteroids.

Binzel, R. P.↗
DOE OSTI2023

Sampling synchronization through GPS signals

A method uses a distributed data acquisition system with multiple, physically unconnected, data acquisition units, that can be in wireless communication with a remote host, to timestamp measurement data with sub-microsecond time base accuracy of sampling clock relative to an absolute timeframe. A current absolute time is derived from messages received from a satellite radio beacon positioning system (GPS). Measurement data is sampled by each unit at a specified sampling rate. Using hardware logic, batches of sampled data are associated with corresponding timestamps representing the absolute time at which the data was sampled. Data and timestamps may be transmitted to the host. A time offset bias is compensated by comparing timestamps against a nominal time based on start time and nominal sampling rate. The sampling clock rate may be disciplined using time pulses from the GPS receiver. An initial start of data sampling by all units can also be synchronized.

Zhuge, James Q.↗
DOE OSTI2021

Evidence for galaxy assembly bias in BOSS CMASS redshift-space galaxy correlation function

ABSTRACT Building accurate and flexible galaxy–halo connection models is crucial in modelling galaxy clustering on non-linear scales. Recent studies have found that halo concentration by itself cannot capture the full galaxy assembly bias effect and that the local environment of the halo can be an excellent indicator of galaxy assembly bias. In this paper, we propose an extended halo occupation distribution (HOD) model that includes both a concentration-based assembly bias term and an environment-based assembly bias term. We use this model to achieve a good fit (χ2/degrees of freedom = 1.35) on the 2D redshift-space two-point correlation function (2PCF) of the Baryon Oscillation Spectroscopic Survey (BOSS) CMASS galaxy sample. We find that the inclusion of both assembly bias terms is strongly favoured by the data and the standard five-parameter HOD model is strongly rejected. More interestingly, the redshift-space 2PCF drives the assembly bias parameters in a way that preferentially assigns galaxies to lower mass haloes. This results in galaxy–galaxy lensing predictions that are within 1σ agreement with the observation, alleviating the perceived tension between galaxy clustering and lensing. We also showcase a consistent 3σ–5σ preference for a positive environment-based assembly bias that persists over variations in the fit. We speculate that the environmental dependence might be driven by underlying processes such as mergers and feedback, but might also be indicative of a larger halo boundaries such as the splashback radius. Regardless, this work highlights the importance of building flexible galaxy–halo connection models and demonstrates the extra constraining power of the redshift-space 2PCF.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Studying the Collective Functional Response of a Receptor in Alchemical Ligand Binding Free Energy Simulations with Accelerated Solvation Layer Dynamics

Ligand binding free energy simulations (LB-FES) that involve sampling of protein functional conformations have been longstanding challenges in research on molecular recognition. Particularly, modeling of the conformational transition pathway and design of the heuristic biasing mechanism are severe bottlenecks for the existing enhanced configurational sampling (ECS) methods. Inspired by the key role of hydration in regulating conformational dynamics of macromolecules, this report proposes a novel ECS approach that facilitates binding-associated structural dynamics by accelerated hydration transitions in combination with the lambda-exchange of free energy perturbation (FEP). Further, two challenging protein-ligand binding processes involving large configurational transitions of the receptor are studied, with hydration transitions at binding sites accelerated by Hamiltonian-simulated annealing of the hydration layer. Without the need for pathway analysis or ad hoc barrier flattening potential, LB-FES were performed with FEP/lambda-exchange molecular dynamics simulation at a minor overhead for annealing of the hydration layer. The LB-FES studies showed that the accelerated rehydration significantly enhances the collective conformational transitions of the receptor, and convergence of binding affinity calculations is obtained at a sweet-spot simulation time scale. Alchemical LB-FES with the proposed ECS strategy is free from the effort of trial and error for the setup and realizes efficient on-the-fly sampling for the collective functional response of the receptor and bound water and therefore presents a practical approach to high-throughput screening in drug discovery.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗