Search NASA⌕ Search

SEARCH · Search NASA

Results for “Streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
NASA NTRS1996

In search of cybernautics

This is a talk about the future of aviation in the information age. Ages come and go. Certainly the atomic age came and went, but the information age looks different. This talk reviews some recent experiments on navigation and control with the Global Positioning System. Vertical position accuracies within 1 foot have been demonstrated in the most recent experiments, and research emphases have shifted to issues of integrity, continuity, and availability. Inertial navigation systems (INS) contribute much to the reliability of GPS-based autoland systems. The GPS data stream can cease, and INS can still complete a precision landing from an altitude of 200 feet. The future of aviation looks like automatic airplanes communicating among each other to schedule ground assets and to avoid collisions and wake hazards. The business of the FAA will be to assure integrity of global navigation systems, to develop and maintain the software rules of the air, and to provide expert pilots to handle emergencies from the ground via radio control. The future of aviation is democratic and lends itself to personal airplanes. Some data analyses reveal that personal airplanes are just as efficient as large turbofan transports and just as fast over distances up to 1,000 miles, thanks to the decelerative influence of the hub and spoke system. Maybe by the year 2020, the airplane will rank with the automobile and computer as an agent of personal freedom.

Crow, Steven↗
NASA NTRS2012

Entry, Descent, and Landing Communications for the 2011 Mars Science Laboratory

The Mars Science Laboratory (MSL), established as the most advanced rover to land on the surface of Mars to date, launched on November 26th, 2011 and arrived to the Martian Gale Crater during the night of August 5th, 2012 (PDT). MSL will investigate whether the landing region was ever suitable to support carbon-based life, and examine rocks, soil, and the atmosphere with a sophisticated suite of tools. This paper addresses the flight system requirement by which the vehicle transmitted indications of the following events using both X-band tones and UHF telemetry to allow identification of probable root causes should a mission anomaly have occurred: Heat-Rejection System (HRS) venting, completion of the cruise stage separation, turn to entry attitude, atmospheric deceleration, bank angle reversal commanded, parachute deployment, heatshield separation, radar ground acquisition, powered descent initiation, rover separation from the descent stage, and rover release. During Entry, Descent, and Landing (EDL), the flight system transmitted a UHF telemetry stream adequate to determine the state of the spacecraft (including the presence of faults) at 8 kbps initiating from cruise stage separation through at least one minute after positive indication of rover release on the surface of Mars. The flight system also transmitted X-band semaphore tones from Entry to Landing plus one minute although since MSL was occulted, as predicted, by Mars as seen from the Earth, Direct-To-Earth (DTE) communications were interrupted at approximately is approx. 5 min after Entry ( approximately 130 prior to Landing). The primary data return paths were through the Deep Space Network (DSN) for DTE and the existing Mars network of orbiting assets for UHF, which included the Mars Reconnaissance Orbiter (MRO), Mars Odyssey (ODY), and Mars Express (MEX) elements. These orbiters recorded the telemetry data stream and returned it back to Earth via the DSN. The paper also discusses the total power received during EDL and the robustness of the telecom design strategy used to ensure EDL communications coverage.

relay operations↗
NASA NTRS1993

SPNDL: A concept for a small satellite Doppler lidar wind sounder

Given current resources and the technical challenges in developing a full coverage space-based Doppler lidar wind measuring system such as LAWS (Laser Atmospheric Wind Sounder), it is not likely that the science community will have data streams with which to work before the end of this decade. Currently, a 'fast track' demonstration mission is being seriously considered by several U.S. agencies. Such a mission would have as its primary objectives the demonstration of coherent Doppler lidar technology in space and the delivery of wind observations for science algorithm evaluation and development. However, for such a mission to be achieved at modest costs and within a short time frame, deviations from the full system design are required. Simulation models have been developed over the last decade to aide in the design of Doppler lidar missions and to provide simulated data for use in wind computation algorithm development. SWA has used both models to examine some options that might be cost-effective for a demonstration mission. Over the past few months, Simpson Weather Associates has been studying SPNDL (Spinning Platform with a Non-rotating telescope Doppler Lidar), a new concept for Doppler lidar wind observations from space. Science and Technology Corporation has an interest in participating in an engineering and shuttle accommodation study for SPNDL.

Emmitt, G. D.↗
NASA NTRS2006

Low-Complexity Adaptive Lossless Compression of Hyperspectral Imagery

A low-complexity, adaptive predictive technique for lossless compression of hyperspectral imagery is described. This technique is designed to be suitable for implementation in hardware such as a field programmable gate array (FPGA); such an implementation could be used for high-speed compression of hyperspectral imagery onboard a spacecraft. The predictive step of the technique makes use of the sign algorithm, which is a relative of the least mean square (LMS) algorithm from the field of low-complexity adaptive filtering. The compressed data stream consists of prediction residuals encoded using a method similar to that of the JPEG-LS lossless image compression standard. Compression results are presented for several datasets including some raw Airborne Visible/ Infrared Imaging Spectrometer (AVIRIS) datasets and raw Atmospheric Infrared Sounder (AIRS) datasets. The compression effectiveness obtained with the technique is competitive with that of the best of previously described techniques with similar complexity.

lossless data compression↗
NASA NTRS2012

The HYSPIRI Decadal Survey Mission: Update on the Mission Concept and Science Objectives for Global Imaging Spectroscopy and Multi-Spectral Thermal Measurements

The NASA HyspIRI mission is planned to provide global solar reflected energy spectroscopic measurement of the terrestrial and shallow water regions of the Earth every 19 days will all measurements downlinked. In addition, HyspIRI will provide multi-spectral thermal measurements with a single band in the 4 micron region and seven bands in the 8 to 12 micron region with 5 day day/night coverage. A direct broadcast capability for measurement subsets is also planned. This HyspIRI mission is one of those designated in the 2007 National Research Council (NRC) Decadal Survey: Earth Science and Applications from Space. In the Decadal Survey, HyspIRI was recognized as relevant to a range of Earth science and science applications, including climate: "A hyperspectral sensor (e.g., FLORA) combined with a multispectral thermal sensor (e.g., SAVII) in low Earth orbit (LEO) is part of an integrated mission concept [described in Parts I and II] that is relevant to several panels, especially the climate variability panel." The HyspIRI science study group was formed in 2008 to evaluate and refine the mission concept. This group has developed a series of HyspIRI science objectives: (1) Climate: Ecosystem biochemistry, condition & feedback; spectral albedo; carbon/dust on snow/ice; biomass burning; evapotranspiration (2) Ecosystems: Global plant functional types, physiological condition, and biochemistry including agricultural lands (3) Fires: Fuel status, fire frequency, severity, emissions, and patterns of recovery globally (4) Coral reef and coastal habitats: Global composition and status (5) Volcanoes: Eruptions, emissions, regional and global impact (6) Geology and resources: Global distributions of surface mineral resources and improved understanding of geology and related hazards These objectives are achieved with the following measurement capabilities. The HyspIRI imaging spectrometer provides: full spectral coverage from 380 to 2500 at 10 nm sampling; 60 m spatial sampling with a 150 km swath; and fully downlinked coverage of the Earth's terrestrial and shallow water regions every 19 days to provide seasonal cloud-free coverage of the terrestrial surface. The HyspIRI Multi-Spectral Thermal instrument provides: 8 spectral bands from 4 to 12 microns; 60 m spatial sampling with a 600 km swath; and fully downlinked coverage of the Earth's terrestrial shallow water regions every 5 days (day/night) to provide nominally cloud-free monthly coverage. The HyspIRI mission also includes an on-board processing and direct broadcast capability, referred to as the Intelligent Payload Module (IPM), which will allow users with the appropriate antenna to download a subset of the HyspIRI data stream to a local ground station. These science and science application objectives are critical today and uniquely addressed by the combined imaging spectroscopy, thermal infrared measurements, and IPM direct broadcast capability of HyspIRI. Two key objectives are: (1) The global HyspIRI spectroscopic measurements of the terrestrial biosphere including vegetation composition and function to constrain and reduce the uncertainty in climate-carbon interactions and terrestrial biosphere feedback. (2) The global 8 band thermal measurements to provide improved constraint of fire related emissions. In this paper the current HyspIRI mission concept that has been reviewed and refined to its current level of maturity with a Data Products Symposium, Science Workshop and NASA HWorkshop is presented including traceability between the measurements and the science and science application objectives.

Green, Robert O.↗
NASA NTRS2011

Prioritized LT Codes

The original Luby Transform (LT) coding scheme is extended to account for data transmissions where some information symbols in a message block are more important than others. Prioritized LT codes provide unequal error protection (UEP) of data on an erasure channel by modifying the original LT encoder. The prioritized algorithm improves high-priority data protection without penalizing low-priority data recovery. Moreover, low-latency decoding is also obtained for high-priority data due to fast encoding. Prioritized LT codes only require a slight change in the original encoding algorithm, and no changes at all at the decoder. Hence, with a small complexity increase in the LT encoder, an improved UEP and low-decoding latency performance for high-priority data can be achieved. LT encoding partitions a data stream into fixed-sized message blocks each with a constant number of information symbols. To generate a code symbol from the information symbols in a message, the Robust-Soliton probability distribution is first applied in order to determine the number of information symbols to be used to compute the code symbol. Then, the specific information symbols are chosen uniform randomly from the message block. Finally, the selected information symbols are XORed to form the code symbol. The Prioritized LT code construction includes an additional restriction that code symbols formed by a relatively small number of XORed information symbols select some of these information symbols from the pool of high-priority data. Once high-priority data are fully covered, encoding continues with the conventional LT approach where code symbols are generated by selecting information symbols from the entire message block including all different priorities. Therefore, if code symbols derived from high-priority data experience an unusual high number of erasures, Prioritized LT codes can still reliably recover both high- and low-priority data. This hybrid approach decides not only "how to encode" but also "what to encode" to achieve UEP. Another advantage of the priority encoding process is that the majority of high-priority data can be decoded sooner since only a small number of code symbols are required to reconstruct high-priority data. This approach increases the likelihood that high-priority data is decoded first over low-priority data. The Prioritized LT code scheme achieves an improvement in high-priority data decoding performance as well as overall information recovery without penalizing the decoding of low-priority data, assuming high-priority data is no more than half of a message block. The cost is in the additional complexity required in the encoder. If extra computation resource is available at the transmitter, image, voice, and video transmission quality in terrestrial and space communications can benefit from accurate use of redundancy in protecting data with varying priorities.

Woo, Simon S.↗
NASA NTRS1989

Parallel asynchronous systems and image processing algorithms

A new hardware approach to implementation of image processing algorithms is described. The approach is based on silicon devices which would permit an independent analog processing channel to be dedicated to evey pixel. A laminar architecture consisting of a stack of planar arrays of the device would form a two-dimensional array processor with a 2-D array of inputs located directly behind a focal plane detector array. A 2-D image data stream would propagate in neuronlike asynchronous pulse coded form through the laminar processor. Such systems would integrate image acquisition and image processing. Acquisition and processing would be performed concurrently as in natural vision systems. The research is aimed at implementation of algorithms, such as the intensity dependent summation algorithm and pyramid processing structures, which are motivated by the operation of natural vision systems. Implementation of natural vision algorithms would benefit from the use of neuronlike information coding and the laminar, 2-D parallel, vision system type architecture. Besides providing a neural network framework for implementation of natural vision algorithms, a 2-D parallel approach could eliminate the serial bottleneck of conventional processing systems. Conversion to serial format would occur only after raw intensity data has been substantially processed. An interesting challenge arises from the fact that the mathematical formulation of natural vision algorithms does not specify the means of implementation, so that hardware implementation poses intriguing questions involving vision science.

Coon, D. D.↗
NASA NTRS2003

Effects of a Scanning Reflectarray Antenna on Modulated Data Modeled

The ferroelectric reflectarray is a new type of scanning antenna under development for space and ground communications and radar applications at the NASA Glenn Research Center. The reflectarray offers tremendous cost, gain, and efficiency advantages in comparison to the state-of-the-art phased arrays, but there is an inherent intersymbol interference (ISI) problem with digital communication data streams processed through the array because of the way the reflectarray is operated. This interference stems from the fact that the antenna beam is formed by the superposition of reflected waves from the array elements. The delays from the elements to the observation point of each wave differ. Ferroelectric phase shifters are designed to compensate for the modulo-2p phase differences so that the waves will constructively interfere at the sinusoidal carrier level; however, the delays of the integer-number multiple of the carrier period are not compensated for. This lack of compensation causes ISI in digital modulated signals. ISI has not been a problem with analog modulations and low-rate digital modulations since the distortion (or ISI) introduced is negligible. The problem becomes acute when the data rate gets higher, and the electrical size of the array gets bigger. Moreover, there are intrinsic transient effects associated with the phase shifters and the controller that executes the algorithm to direct the beam. That is, phase shifter updates to redirect the beam may be initiated simultaneously, but nonlinearity will cause different settling times. The ISI problem and other effects ultimately limit the size (gain) and data rate of the reflectarray. An ISI analysis was required to prove or disprove the suitability of the reflectarray antenna for high-rate digitally modulated signals and to give guidance for determining antenna parameters. In this research, the nature of the ISI of the reflectarray has been mathematically modeled.

Romanofsky, Robert R.↗
NASA NTRS2010

Rapid Response Flood Water Mapping

Since the beginning of operation of the MODIS instrument on the NASA Terra satellite at the end of 1999, an exceptionally useful sensor and public data stream have been available for many applications including the rapid and precise characterization of terrestrial surface water changes. One practical application of such capability is the near-real time mapping of river flood inundation. We have developed a surface water mapping methodology based on using only bands 1 (620-672 nm) and 2 (841-890 nm). These are the two bands at 250 m, and the use of only these bands maximizes the resulting map detail. In this regard, most water bodies are strong absorbers of incoming solar radiation at the band 2 wavelength: it could be used alone, via a thresholding procedure, to separate water (dark, low radiance or reflectance pixels) from land (much brighter pixels) (1, 2). Some previous water mapping procedures have in fact used such single band data from this and other sensors that include similar wavelength channels. Adding the second channel of data (band 1), however, allows a band ratio approach which permits sediment-laden water, often relatively light at band 2 wavelengths, to still be discriminated, and, as well, provides some removal of error by reducing the number of cloud shadow pixels that would otherwise be misclassified as water.

Fritz Policelli↗
NASA NTRSDate not supplied

Uncertainty Analysis of the GeoNEX Top-of-Atmospheric Reflectance Products Generated from the Third-Generation Geostationary Satellite Sensors

The GeoNEX (Geostationary-NASA Earth eXchange) Level-1G products consist of top-of-atmosphere (TOA) bi-directional reflectance factor (BRF) and brightness temperature generated with data streams from the latest geostationary (GEO) sensors including GOES-16/17 ABI, Himawari-8/9 AHI, and GK-2A AMI on a global tiled common grid (60oN-60o and 180oW-180oE) in geographic coordinates. With their 16 spectral bands, 0.01o/0.02o nadir spatial resolution, and 10-minute temporal resolutions, these products provide exciting opportunity to monitor Earth surface processes. However, the unique Sun-Target-Satellite geometry of geostationary sensors demands special attention in analyzing/interpreting these datasets. In this study we present a systematic analysis on the relationship between the radiometric uncertainties of the GeoNEX TOA reflectance and the corresponding solar/satellite zenith angles. We show that the signal-to-noise ratio (SNR) of the BRF are positively proportional to the square roots of the cosine of solar illuminating zenith angles. That is, the BRF data are noisier earlier in the morning or later in the afternoon than in the mid of the day. The cosine of satellite viewing zenith angles do not directly influence the SNR of the TOA BRF. However, they positively regulate the relative importance of the surface component in the TOA BRF. This means that variations in surface reflectance are more difficult to detect for pixels with larger view zenith angles, even when the SNR of the TOA BRF is the same. We are developing metrics to specify such illumination-view geometry related uncertainties in the GeoNEX L1G TOA BRF products so that this key information can be easily accessed by the user community.

Geostationary satellite↗
NASA NTRS2012

Field Geologic Observation and Sample Collection Strategies for Planetary Surface Exploration: Insights from the 2010 Desert RATS Geologist Crewmembers

Observation is the primary role of all field geologists, and geologic observations put into an evolving conceptual context will be the most important data stream that will be relayed to Earth during a planetary exploration mission. Sample collection is also an important planetary field activity, and its success is closely tied to the quality of contextual observations. To test protocols for doing effective planetary geologic field- work, the Desert RATS(Research and Technology Studies) project deployed two prototype rovers for two weeks of simulated exploratory traverses in the San Francisco volcanic field of northern Arizona. The authors of this paper represent the geologist crew members who participated in the 2010 field test.We document the procedures adopted for Desert RATS 2010 and report on our experiences regarding these protocols. Careful consideration must be made of various issues that impact the interplay between field geologic observations and sample collection, including time management; strategies relatedtoduplicationofsamplesandobservations;logisticalconstraintson the volume and mass of samples and the volume/transfer of data collected; and paradigms for evaluation of mission success. We find that the 2010 field protocols brought to light important aspects of each of these issues, and we recommend best practices and modifications to training and operational protocols to address them. Underlying our recommendations is the recognition that the capacity of the crew to flexibly execute their activities is paramount. Careful design of mission parameters, especially field geologic protocols, is critical for enabling the crews to successfully meet their science objectives.

Hurtado, Jose M., Jr.↗
NASA NTRS2011

Tools and Technologies Needed for Conducting Planetary Field Geology While On EVA: Insights from the 2010 Desert RATS Geologist Crewmembers

Observation is the primary role of all field geologists, and geologic observations put into an evolving conceptual context will be the most important data stream that will be relayed to Earth during a planetary exploration mission. Sample collection is also an important planetary field activity, and its success is closely tied to the quality of contextual observations. To test protocols for doing effective planetary geologic fieldwork, the Desert RATS (Research and Technology Studies) project deployed two prototype rovers for two weeks of simulated exploratory traverses in the San Francisco volcanic field of northern Arizona. The authors of this paper represent the geologist crewmembers who participated in the 2010 field test. We document the procedures adopted for Desert RATS 2010 and report on our experiences regarding these protocols. Careful consideration must be made of various issues that impact the interplay between field geologic observations and sample collection, including time management; strategies related to duplication of samples and observations; logistical constraints on the volume and mass of samples and the volume/transfer of data collected; and paradigms for evaluation of mission success. We find that the 2010 field protocols brought to light important aspects of each of these issues, and we recommend best practices and modifications to training and operational protocols to address them. Underlying our recommendations is the recognition that the capacity of the crew to "flexibly execute" their activities is paramount. Careful design of mission parameters, especially field geologic protocols, is critical for enabling the crews to successfully meet their science objectives.

Young, Kelsey↗
NASA NTRS2012

Sensitivity of Ocean Reflectance Inversion Models for Identifying and Discriminating Between Phytoplankton Functional Groups

The daily, synoptic images provided by satellite ocean color instruments provide viable data streams for observing changes in the biogeochemistrY of marine ecosystems. Ocean reflectance inversion models (ORMs) provide a common mechanism for inverting the "color" of the water observed a satellite into marine inherent optical properties (lOPs) through a combination of empiricism and radiative transfer theory. lOPs, namely the spectral absorption and scattering characteristics of ocean water and its dissolved and particulate constituents, describe the contents of the upper ocean, information critical for furthering scientific understanding of biogeochemical oceanic processes. Many recent studies inferred marine particle sizes and discriminated between phytoplankton functional groups using remotely-sensed lOPs. While all demonstrated the viability of their approaches, few described the vertical distributions of the water column constituents under consideration and, thus, failed to report the biophysical conditions under which their model performed (e.g., the depth and thickness of the phytoplankton bloom(s)). We developed an ORM to remotely identifY Noctiluca miliaris and other phytoplankton functional types using satellite ocean color data records collected in the northern Arabian Sea. Here, we present results from analyses designed to evaluate the applicability and sensitivity of the ORM to varied biophysical conditions. Specifically, we: (1) synthesized a series of vertical profiles of spectral inherent optical properties that represent a wide variety of bio-optical conditions for the northern Arabian Sea under aN Miliaris bloom; (2) generated spectral remote-sensing reflectances from these profiles using Hydrolight; and, (3) applied the ORM to the synthesized reflectances to estimate the relative concentrations of diatoms and N Miliaris for each example. By comparing the estimates from the inversion model to those from synthesized vertical profiles, we were able to identifY those bio-optical conditions under which the inversion model performs both well and poorly.

Werdell, P. Jeremy↗
NASA NTRS2009

Real-Time Assessment of Robot Performance During Remote Exploration Operations

To ensure that robots are used effectively for exploration missions, it is important to assess their performance during operations. We are investigating the definition and computation of performance metrics for assessing remote robotic operations in real-time. Our approach is to monitor data streams from robots, compute performance metrics, and provide Web-based displays of these metrics for assessing robot performance during operations. We evaluated our approach for measuring robot performance with the K10 rovers from NASA Ames Research Center during a field test at Moses Lake Sand Dunes (WA) in June 2008. In this paper we present the results of evaluating our software for robot performance and discuss our conclusions from this evaluation for future robot operations.

SBIR TOPIC X7.02 PHASE 1↗
NASA NTRS2025

An Efficient GPU-Accelerated Multi-Source Global Fit Pipeline for LISA Data Analysis

The large-scale analysis task of deciphering gravitational wave signals in the LISA data stream will be difficult, requiring a large amount of computational resources and extensive development of computational methods. Its high dimensionality, multiple model types, and complicated noise profile require a global fit to all parameters and input models simultaneously. In this work, we detail our global fit algorithm, called “Erebor,” designed to accomplish this challenging task. It is capable of analysing current state-of-the-art datasets and then growing into the future as more pieces of the pipeline are completed and added. We describe our pipeline strategy, the algorithmic setup, and the results from our analysis of the LDC2A Sangria dataset, which contains Massive Black Hole Binaries, compact Galactic Binaries, and a parameterized noise spectrum whose parameters are unknown to the user. The Erebor algorithm includes three unique and very useful contributions: GPU acceleration for enhanced computational efficiency; ensemble MCMC sampling with multiple MCMC walkers per temperature for better mixing and parallelized sample creation; and special online updates to reversible-jump (or trans-dimensional) sampling distributions to ensure sampler mixing and accurate initial estimates for detectable sources in the data. We recover posterior distributions for all 15 (6) of the injected MBHBs in the LDC2A training (hidden) dataset. We catalog ∼12000 Galactic Binaries (∼8000 as high confidence detections) for both the training and hidden datasets. All of the sources and their posterior distributions are provided in publicly available catalogs.

LISA global fit↗
NASA NTRSDate not supplied

Development of a Global Reference Surface Reflectance and BRDF Datasets from Geostationary Satellite Observations and AERONET Measurements

Surface reflectances and their dependency on illumination-view geometries (i.e., BRDF) are the foundation of many high-level satellite products for land and water monitoring. Yet it is difficult to evaluate the quality of satellite-based surface reflectances with ground-based measurements due to the spatial scale differences. In order to fill the gap, here we develop a reference dataset of surface reflectance and BRDF at the global AERONET sites with data streams from operational geostationary sensors including Himawari 8/9 AHI, GK-2A AMI, and GOES 16/17 ABI. Taking the top-of-atmosphere (TOA) reflectance and the site measured atmospheric aerosol optical depth (AOD) as the main inputs, we apply the GeoNEX-AC algorithm to performance accurate atmospheric correction and derive 10-minute surface reflectance and daily Ross-Thick-Li-Sparse (RTLS) BRDF parameters at AERONET sites where coincident AOD measurements and TOA observations are available from 2016 (for Himawari) or 2018 (for GOES) onwards. The algorithm ensures that the retrieved surface BRDF parameters, along with the site-measured AOD, allow the atmospheric radiative transfer model, SHARM, accurately simulate the observed TOA reflectance at diurnal and longer time scales. They are our best estimates of the surface optical properties and thus can serve as the “reference” to evaluate the performance of operational atmospheric correction algorithms (where AOD is assumed unknown and needs to be retrieved). The reference BRDF also allow us to evaluate the spectral band ratios between the SWIR (e.g., 2200 nm) and the visible (e.g., 650 nm) regions, which are commonly used in operational atmospheric correction algorithms. Finally, we demonstrate that the reference dataset can be used to develop potential data synergies between different GEO satellites as well as GEO-LEO sensors.

Weile Wang↗
NASA NTRS2014

How Accurate is Land/Ocean Moisture Transport Variability in Reanalyses?

Quantifying the global hydrological cycle and its variability across various time scales remains a challenge to the climate community. Direct measurements of evaporation (E), evapotranspiration (ET), and precipitation (P) are not feasible on a global scale, nor is the transport of water vapor over the global oceans and sparsely populated land areas. Expanding satellite data streams have enabled development of various water (and energy) flux products, complementing reanalyses and facilitating observationally constrained modeling. But the evolution of the global observing system has produced additional complications--improvements in satellite sensor resolution and accuracy have resulted in "epochs" of observational quasi-uniformity that can adversely affect reanalysis trends. In this work we focus on vertically integrated moisture flux convergence (VMFC) variations within the period 1979 - present integrated over global land. We show that VMFC in recent reanalyses (e.g. ERA-I, NASA MERRA, NOAA CFSR and JRA55) suffers from observing system changes, though differently in each product. Land Surface Models (LSMs) forced with observations-based precipitation, radiation and near-surface meteorology share closely the interannual P-ET variations of the reanalyses associated with ENSO events. (VMFC over land and P-ET estimates are equivalent quantities since atmospheric storage changes are small on these scales.) But the long-term LSM trend over the period since 1979 is approximately one-fourth that of the reanalyses. Additional reduced observation reanalyses assimilating only surface pressure and /or specifying seasurface temperature also have a much smaller trend in P-ET like the LSMs. We explore the regional manifestation of the reanalysis P-ET / VMFC problems, particularly over land. Both principal component analysis and a simple time series changepoint analysis highlight problems associated with data poor regions such as Equatorial Africa and, for one reanalysis, the Equatorial Andes region. Onset of the availability of passive microwave Special Sensor Microwave Imager (SSMI) moisture data in July 1987 and the transition from the Microwave Sounder Unit (MSU) to an advanced version (AMSU) have significant impacts on VMFC variability. Simple accounting for these errors of leading importance results in modified reanalysis VMFC estimates that agree much better with the LSM results. Regional details of the modified reanalysis VMFC and LSM P-ET are related to changes in Pacific Decadal Variability as manifest in SST changes after the late 1990s.

Robertson, F. R.↗
NASA NTRS2005

Improved Compression of Wavelet-Transformed Images

A recently developed data-compression method is an adaptive technique for coding quantized wavelet-transformed data, nominally as part of a complete image-data compressor. Unlike some other approaches, this method admits a simple implementation and does not rely on the use of large code tables. A common data compression approach, particularly for images, is to perform a wavelet transform on the input data, and then losslessly compress a quantized version of the wavelet-transformed data. Under this compression approach, it is common for the quantized data to include long sequences, or runs, of zeros. The new coding method uses prefixfree codes for the nonnegative integers as part of an adaptive algorithm for compressing the quantized wavelet-transformed data by run-length coding. In the form of run-length coding used here, the data sequence to be encoded is parsed into strings consisting of some number (possibly 0) of zeros, followed by a nonzero value. The nonzero value and the length of the run of zeros are encoded. For a data stream that contains a sufficiently high frequency of zeros, this method is known to be more effective than using a single variable length code to encode each symbol. The specific prefix-free codes used are from two classes of variable-length codes: a class known as Golomb codes, and a class known as exponential-Golomb codes. The codes within each class are indexed by a single integer parameter. The present method uses exponential-Golomb codes for the lengths of the runs of zeros, and Golomb codes for the nonzero values. The code parameters within each code class are determined adaptively on the fly as compression proceeds, on the basis of statistics from previously encoded values. In particular, a simple adaptive method has been devised to select the parameter identifying the particular exponential-Golomb code to use. The method tracks the average number of bits used to encode recent runlengths, and takes the difference between this average length and the code parameter. When this difference falls outside a fixed range, the code parameter is updated (increased or decreased). The Golomb code parameter is selected based on the average magnitude of recently encoded nonzero samples. The coding method requires no floating- point operations, and more readily adapts to local statistics than other methods. The method can also accommodate arbitrarily large input values and arbitrarily long runs of zeros. In practice, this means that changes in the dynamic range or size of the input data set would not require a change to the compressor. The algorithm has been tested in computational experiments on test images. A comparison with a previously developed algorithm that uses large code tables (generated via Huffman coding on training data) suggests that the data-compression effectiveness of the present algorithm is comparable to the best performance achievable by the previously developed algorithm.

Kiely, Aaron↗