Search NASASearch

SEARCH · Search NASA

Results for “count data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Bayesian Blocks: A New Method to Analyze Photon Counting Data

A Bayesian analysis of photon-counting data leads to a new time-domain algorithm for detecting localized structures (bursts), revealing pulse shapes, and generally characterizing intensity variations. The raw counting data -- time-tag events (TTE), time-to-spill (TTS) data, or binned counts -- is converted to a maximum likelihood segmentation of the observation into time intervals during which the photon arrival rate is perceptibly constant -- i.e. has a fixed intensity without statistically significant variations. The resulting structures, Bayesian Blocks, can be thought of as bins with arbitrary spacing determined by the data. The method itself sets no lower limit to the time scale on which variability can be detected. We have applied the method to RXTE data on Cyg X-1, yielding information on this source's short-time-scale variability.

Scargle, Jeffrey D.

Performance of a Discrete Wavelet Transform for Compressing Plasma Count Data and its Application to the Fast Plasma Investigation on NASA's Magnetospheric Multiscale Mission

Plasma measurements in space are becoming increasingly faster, higher resolution, and distributed over multiple instruments. As raw data generation rates can exceed available data transfer bandwidth, data compression is becoming a critical design component. Data compression has been a staple of imaging instruments for years, but only recently have plasma measurement designers become interested in high performance data compression. Missions will often use a simple lossless compression technique yielding compression ratios of approximately 2:1, however future missions may require compression ratios upwards of 10:1. This study aims to explore how a Discrete Wavelet Transform combined with a Bit Plane Encoder (DWT/BPE), implemented via a CCSDS standard, can be used effectively to compress count information common to plasma measurements to high compression ratios while maintaining little or no compression error. The compression ASIC used for the Fast Plasma Investigation (FPI) on board the Magnetospheric Multiscale mission (MMS) is used for this study. Plasma count data from multiple sources is examined: resampled data from previous missions, randomly generated data from distribution functions, and simulations of expected regimes. These are run through the compression routines with various parameters to yield the greatest possible compression ratio while maintaining little or no error, the latter indicates that fully lossless compression is obtained. Finally, recommendations are made for future missions as to what can be achieved when compressing plasma count data and how best to do so.

Particles

Performance of a Space-Based Wavelet Compressor for Plasma Count Data on the MMS Fast Plasma Investigation

Data compression has been a staple of imaging instruments for years. Recently, plasma measurements have utilized compression with relatively low compression ratios. The Fast Plasma Investigation (FPI) on board the Magnetospheric Multiscale (MMS) mission generates data roughly 100 times faster than previous plasma instruments, requiring a higher compression ratio to fit within the telemetry allocation. This study investigates the performance of a space-based compression standard employing a Discrete Wavelet Transform and a Bit Plane Encoder (DWT/BPE) in compressing FPI plasma count data. Data from the first 6 months of FPI operation are analyzed to explore the error modes evident in the data and how to adapt to them. While approximately half of the Dual Electron Spectrometer (DES) maps had some level of loss, it was found that there is little effect on the plasma moments and that errors present in individual sky maps are typically minor. The majority of Dual Ion Spectrometer burst sky maps compressed in a lossless fashion, with no error introduced during compression. Because of induced compression error, the size limit for DES burst images has been increased for Phase 1B. Additionally, it was found that the floating point compression mode yielded better results when images have significant compression error, leading to floating point mode being used for the fast survey mode of operation for Phase 1B. Despite the suggested tweaks, it was found that wavelet-based compression, and a DWT/BPE algorithm in particular, is highly suitable to data compression for plasma measurement instruments and can be recommended for future missions.

plasma

The equivalence of three techniques for estimating ground reflectance from LANDSAT digital count data

The equivalence of three separate investigations that related LANDSAT digital count (DC) to ground measured reflectance (R) was demonstrated. One investigator related DC data to the cosZ, where Z is the solar zenith angle, for surfaces of constant R. The second investigator corrected the DC data to the solar zenith angle of 39 degrees before relating to surface R. Both of these investigators used LANDSAT 1 and 2 data from overpass dates 1972 through 1977. A third investigator calculated the relation between DC and R based on atmospheric radiative transfer theory. The equation coefficients obtained from these three investigators for all four LANDSAT MSS bands were shown to be equivalent although differences in ground reflectance measurement procedures have created coefficient variations among the three investigations. These relations should be useful for testing atmospheric radiative transfer theory.

Richardson, A. J.

Digital first order hold circuit

There is provided a digitally controlled first order hold circuit and waveform synthesizer for digitally controlling the representation of a function over an approximation interval. In accordance with the operation of the invention, the first order hold circuit and waveform generator receives a digital data input signal which contains initial condition data, up/down data, and slope data for the approximation interval. The initial condition data is loaded into an up/down counter which is incremented using counting data at a rate depending on the value of the slope data and in a direction depending on the value of the up-down data. In order to minimize delays arising from data acquistion, two frequency synthesizer circuits are provided such that one frequency synthesizer provides counting data while the other frequency synthesizer receives slope data. During alternating intervals, the other frequency synthesizer circuit provides counting data while the other circuit receives slope data. In addition, long length data input signals covering a plurality of approximation intervals are provided to reduce the demands on a main system central processing unit.

Chan, Fred N.

Multiparameter linear least-squares fitting to Poisson data one count at a time

A standard problem in gamma-ray astronomy data analysis is the decomposition of a set of observed counts, described by Poisson statistics, according to a given multicomponent linear model, with underlying physical count rates or fluxes which are to be estimated from the data. Despite its conceptual simplicity, the linear least-squares (LLSQ) method for solving this problem has generally been limited to situations in which the number n(sub i) of counts in each bin i is not too small, conventionally more than 5-30. It seems to be widely believed that the failure of the LLSQ method for small counts is due to the failure of the Poisson distribution to be even approximately normal for small numbers. The cause is more accurately the strong anticorrelation between the data and the wieghts w(sub i) in the weighted LLSQ method when square root of n(sub i) instead of square root of bar-n(sub i) is used to approximate the uncertainties, sigma(sub i), in the data, where bar-n(sub i) = E(n(sub i)), the expected value of N(sub i). We show in an appendix that, avoiding this approximation, the correct equations for the Poisson LLSQ (PLLSQ) problems are actually identical to those for the maximum likelihood estimate using the exact Poisson distribution. We apply the method to solve a problem in high-resolution gamma-ray spectroscopy for the JPL High-Resolution Gamma-Ray Spectrometer flown on HEAO 3. Systematic error in subtracting the strong, highly variable background encountered in the low-energy gamma-ray region can be significantly reduced by closely pairing source and background data in short segments. Significant results can be built up by weighted averaging of the net fluxes obtained from the subtraction of many individual source/background pairs. Extension of the approach to complex situations, with multiple cosmic sources and realistic background parameterizations, requires a means of efficiently fitting to data from single scans in the narrow (approximately = 1.2 keV, HEAO 3) energy channels of a Ge spectrometer, where the expected number of counts obtained per scan may be very low. Such an analysis system is discussed and compared to the method previously used.

Wheaton, Wm. A.

Performance Analysis of Airborne Photon-Counting Lidar Data in Preparation for the ICESat-2 Mission

Two airborne photon-counting laser altimeters have been deployed in direct support of National Aeronautics and Space Adminsitration (NASA's) upcoming Ice, Cloud, and land Elevation Satellite-2 (ICESat-2) mission. Multiple Altimeter Beam Experimental Lidar (MABEL) was developed specifically for ICESat-2 testing and development. MABEL data are used to simulate key aspects of the ICESat-2 measurement strategy and are critical to the development of the algorithms for geophysical data-product generation. Slope Imaging Multipolarization Photon-counting Lidar (SIMPL) is a NASA Goddard Space Flight Center instrument that has also been deployed in support of ICESat-2 performance discovery. Both instruments are photon-counting, small footprint laser altimeters that sample in both the 532- and 1064-nm wavelengths. And both instruments serve as a proxy for ICESat-2 operational performance and error assessment and a basis for the development of potential validation strategies. This paper provides an overview of how data from MABEL and SIMPL overflights have specifically provided the foundation for understanding the quality of ICESat-2 data and how we can plan to evaluate ICESat-2 products through comparison with other modalities of lidar data and/or groundtruth locations using ground fiducials.

MABEL

Evolution of Combustion-Generated Particles at Tropospheric Conditions

This paper describes particle evolution measurements taken in the Particulate Aerosol Laboratory (PAL). The PAL consists of a burner capable of burning jet fuel that exhausts into an altitude chamber that can simulate temperature and pressure conditions up to 13,700 m. After presenting results from initial temperature distributions inside the chamber, particle count data measured in the altitude chamber are shown. Initial particle count data show that the sampling system can have a significant effect on the measured particle distribution: both the value of particle number concentration and the shape of the radial distribution of the particle number concentration depend on whether the measurement probe is heated or unheated.

Tacina, Kathleen M.

A Frequency Analysis Approach for Categorizing Air Traffic Behavior

A method of analyzing National Air Space (NAS) air traffic that uses the Discrete Fourier Transform (DFT) is presented. The DFT is used to transform time domain traffic count data into the frequency domain where the sources of traffic in air spaces can be identified and characterized more easily. It is shown in simulation that individual traffic flows within Air Route Traffic Control Centers can be distinguished by their periodicity in the DFT plot. Next, three Traffic Management Initiatives (playbook rerouting, metered flows, and Ground Delay Programs) are implemented in simulations and their signature effects on the traffic are identified using the DFT. Finally, historical flight data is studied and the DFT is applied to sector traffic count data. It is found that in many cases, variations in traffic due to rerouting and convective weather disturbances are better highlighted in the frequency domain than in the original time domain data. Initial results of the DFT show it has potential as a tool for measuring and/or predicting NAS behavior for daily tactical planning and control purposes.

fourier transform

Characterizing the System Impulse Response Function from Photon-Counting LiDAR Data

NASA's Multiple Altimeter Beam Experimental LiDAR (MABEL) is an aircraft-based photon-counting laser altimeter designed as a simulator to test measurement techniques and algorithms for Advanced Topographic Laser Altimeter System (ATLAS), the sole instrument on NASA's Ice, Cloud, and land Elevation Satellite-2 (ICESat-2) mission. By measuring the time of flight, pointing angle, and absolute position for individual photons, ICESat-2 provides detailed elevation measurements of earth's surface. Calculating accurate and precise elevations requires an understanding of how photons interact with surfaces, and characterization of the photon distribution after returning from surfaces. Neither MABEL nor ATLAS records the transmitted laser pulse shape, relying instead on aggregating several pulses worth of photons, often using histograms, to characterize the pulse shape. In this paper, we assess the limitations of using histograms and propose a more robust method to describe MABEL's system impulse-response function using an exponentially modified Gaussian distribution. We also provide standard error estimates for the arithmetic mean and standard deviation calculations, and for exponentially modified Gaussian parameters using a Monte Carlo sensitivity analysis. We apply this method to photon returns from a sea ice lead and from a dry salt lake bed as case studies for estimating the standard error associated with sample size for the arithmetic mean and standard deviation, and for the exponentially modified Gaussian parameters. We use these standard errors to calculate the minimum number of photons required to find both Gaussian and exponentially modified Gaussian distribution parameters within 3 cm of their parent population values.

photoncounting

NASA'S Earth Science Data Stewardship Activities

NASA has been collecting Earth observation data for over 50 years using instruments on board satellites, aircraft and ground-based systems. With the inception of the Earth Observing System (EOS) Program in 1990, NASA established the Earth Science Data and Information System (ESDIS) Project and initiated development of the Earth Observing System Data and Information System (EOSDIS). A set of Distributed Active Archive Centers (DAACs) was established at locations based on science discipline expertise. Today, EOSDIS consists of 12 DAACs and 12 Science Investigator-led Processing Systems (SIPS), processing data from the EOS missions, as well as the Suomi National Polar Orbiting Partnership mission, and other satellite and airborne missions. The DAACs archive and distribute the vast majority of data from NASA’s Earth science missions, with data holdings exceeding 12 petabytes The data held by EOSDIS are available to all users consistent with NASA’s free and open data policy, which has been in effect since 1990. The EOSDIS archives consist of raw instrument data counts (level 0 data), as well as higher level standard products (e.g., geophysical parameters, products mapped to standard spatio-temporal grids, results of Earth system models using multi-instrument observations, and long time series of Earth System Data Records resulting from multiple satellite observations of a given type of phenomenon). EOSDIS data stewardship responsibilities include ensuring that the data and information content are reliable, of high quality, easily accessible, and usable for as long as they are considered to be of value.

metadata

Status of the NASA GMAO Observing System Simulation Experiment

An Observing System Simulation Experiment (OSSE) is a pure modeling study used when actual observations are too expensive or difficult to obtain. OSSEs are valuable tools for determining the potential impact of new observing systems on numerical weather forecasts and for evaluation of data assimilation systems (DAS). An OSSE has been developed at the NASA Global Modeling and Assimilation Office (GMAO, Errico et al 2013). The GMAO OSSE uses a 13-month integration of the European Centre for Medium- Range Weather Forecasts 2005 operational model at T511/L91 resolution for the Nature Run (NR). Synthetic observations have been updated so that they are based on real observations during the summer of 2013. The emulated observation types include AMSU-A, MHS, IASI, AIRS, and HIRS4 radiance data, GPS-RO, and conventional types including aircraft, rawinsonde, profiler, surface, and satellite winds. The synthetic satellite wind observations are colocated with the NR cloud fields, and the rawinsondes are advected during ascent using the NR wind fields. Data counts for the synthetic observations are matched as closely as possible to real data counts, as shown in Figure 2. Errors are added to the synthetic observations to emulate representativeness and instrument errors. The synthetic errors are calibrated so that the statistics of observation innovation and analysis increments in the OSSE are similar to the same statistics for assimilation of real observations, in an iterative method described by Errico et al (2013). The standard deviations of observation minus forecast (xo-H(xb)) are compared for the OSSE and real data in Figure 3. The synthetic errors include both random, uncorrelated errors, and an additional correlated error component for some observational types. Vertically correlated errors are included for conventional sounding data and GPS-RO, and channel correlated errors are introduced to AIRS and IASI (Figure 4). HIRS, AMSU-A, and MHS have a component of horizontally correlated error. The forecast model used by the GMAO OSSE is the Goddard Earth Observing System Model, Version 5 (GEOS-5) with Gridpoint Statistical Interpolation (GSI) DAS. The model version has been updated to v. 5.13.3, corresponding to the current operational model. Forecasts are run on a cube-sphere grid with 180 points along each edge of the cube (approximately 0.5 degree horizontal resolution) with 72 vertical levels. The DAS is cycled at 6-hour intervals, with 240 hour forecasts launched daily at 0000 UTC. Evaluation of the forecasting skill for July and August is currently underway. Prior versions of the GMAO OSSE have been found to have greater forecasting skill than real world forecasts. It is anticipated that similar forecast skill will be found in the updated OSSE.

OSSE