SEARCH · Search NASA

Results for “data reduction algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

All sources NASA NTRS DOE OSTI

NASA NTRS2013

Improved Data Reduction Algorithm for the Needle Probe Method Applied to In-Situ Thermal Conductivity Measurements of Lunar and Planetary Regoliths

The needle probe method (also known as the' hot wire' or 'line heat source' method) is widely used for in-situ thermal conductivity measurements on soils and marine sediments on the earth. Variants of this method have also been used (or planned) for measuring regolith on the surfaces of extra-terrestrial bodies (e.g., the Moon, Mars, and comets). In the near-vacuum condition on the lunar and planetary surfaces, the measurement method used on the earth cannot be simply duplicated, because thermal conductivity of the regolith can be approximately 2 orders of magnitude lower. In addition, the planetary probes have much greater diameters, due to engineering requirements associated with the robotic deployment on extra-terrestrial bodies. All of these factors contribute to the planetary probes requiring much longer time of measurement, several tens of (if not over a hundred) hours, while a conventional terrestrial needle probe needs only 1 to 2 minutes. The long measurement time complicates the surface operation logistics of the lander. It also negatively affects accuracy of the thermal conductivity measurement, because the cumulative heat loss along the probe is no longer negligible. The present study improves the data reduction algorithm of the needle probe method by shortening the measurement time on planetary surfaces by an order of magnitude. The main difference between the new scheme and the conventional one is that the former uses the exact mathematical solution to the thermal model on which the needle probe measurement theory is based, while the latter uses an approximate solution that is valid only for large times. The present study demonstrates the benefit of the new data reduction technique by applying it to data from a series of needle probe experiments carried out in a vacuum chamber on JSC-1A lunar regolith stimulant. The use of the exact solution has some disadvantage, however, in requiring three additional parameters, but two of them (the diameter and the volumetric heat capacity of the probe) can be measured and the other (the volumetric heat capacity of the regolith/stimulant) may be estimated from the surface geologic observation and temperature measurements. Therefore, overall, the new data reduction scheme would make in-situ thermal conductivity measurement more practical on planetary missions.

JSC-1A↗

NASA NTRS1982

Global pictures of the ozone field from high altitudes from DE-I

Detailed synoptic views of the column ozone field can be obtained by the Spin-Scan Ozone Imager (SOI) (Keating et al., 1981) aboard the Dynamics Explorer I satellite. The eccentric polar orbit with an apogee altitude of 23,000 km allows high resolution global-scale images to be obtained within 12 minutes, and allows regions to be viewed for long periods of time. At perigee, a pixel size of nadir measurements of 3 km is possible, and measurements are determined using the backscattered ultraviolet technique. A wavelength measurement of 317.5 nm is used as there are limitations in filter locations and it allows comparison with Nimbus 7 SBUV/TOMS data. Consideration of the reflectivities of this data aids in checking the SOI data reduction algorithm. SOI data show short-term (less than one day) variations in the observed ozone field, and a negative correlation (greater than 0.9) between ozone and tropopause heights. It is expected, due to this correlation, that SOI data will aid in understanding the time evolution of dynamics near the tropopause.

Keating, G. M.↗

NASA NTRS1974

Diffusion algorithms and data reduction routine for onsite launch predictions for the transport of Titan 3 C exhaust effluents

The NASA/MSFC multilayer diffusion algorithms have been specialized for the prediction of the surface impact for the dispersive transport of the exhaust effluents from the launch of a Titan 3 vehicle. This specialization permits these transport predictions to be made at the launch range in real time so that the effluent monitoring teams can optimize their monitoring grids. Basically, the data reduction routine requires just the meteorology profiles for the thermodynamics and kinematics of the atmosphere as an input. These profiles are graphed along with the resulting exhaust cloud rise history, the center line concentrations and dosages, and the hydrogen chloride isopleths.

Stephens, J. B.↗

NASA NTRS1989

Modeling and characterization of the Earth Radiation Budget Experiment (ERBE) nonscanner and scanner sensors

The Earth Radiation Budget Experiment (ERBE) is making high-absolute-accuracy measurements of the reflected solar and Earth-emitted radiation as well as the incoming solar radiation from three satellites: ERBS, NOAA-9, and NOAA-10. Each satellite has four Earth-looking nonscanning radiometers and three scanning radiometers. A fifth nonscanner, the solar monitor, measures the incoming solar radiation. The development of the ERBE sensor characterization procedures are described using the calibration data for each of the Earth-looking nonscanners and scanners. Sensor models for the ERBE radiometers are developed including the radiative exchange, conductive heat flow, and electronics processing for transient and steady state conditions. The steady state models are used to interpret the sensor outputs, resulting in the data reduction algorithms for the ERBE instruments. Both ground calibration and flight calibration procedures are treated and analyzed. The ground and flight calibration coefficients for the data reduction algorithms are presented.

Halyo, Nesim↗

NASA NTRS2012

Long-Lasting Science Returns from the Apollo Heat Flow Experiments

The Apollo astronauts deployed geothermal heat flow instruments at landing sites 15 and 17 as part of the Apollo Lunar Surface Experiments Packages (ALSEP) in July 1971 and December 1972, respectively. These instruments continuously transmitted data to the Earth until September 1977. Four decades later, the data from the two Apollo sites remain the only set of in-situ heat flow measurements obtained on an extra-terrestrial body. Researchers continue to extract additional knowledge from this dataset by utilizing new analytical techniques and by synthesizing it with data from more recent lunar orbital missions such as the Lunar Reconnaissance Orbiter. In addition, lessons learned from the Apollo experiments help contemporary researchers in designing heat flow instruments for future missions to the Moon and other planetary bodies. For example, the data from both Apollo sites showed gradual warming trends in the subsurface from 1971 to 1977. The cause of this warming has been debated in recent years. It may have resulted from fluctuation in insolation associated with the 18.6-year-cycle precession of the Moon, or sudden changes in surface thermal environment/properties resulting from the installation of the instruments and the astronauts' activities. These types of reanalyses of the Apollo data have lead a panel of scientists to recommend that a heat flow probe carried on a future lunar mission reach 3 m into the subsurface, approx 0.6 m deeper than the depths reached by the Apollo 17 experiment. This presentation describes the authors current efforts for (1) restoring a part of the Apollo heat flow data that were left unprocessed by the original investigators and (2) designing a compact heat flow instrument for future robotic missions to the Moon. First, at the conclusion of the ALSEP program in 1977, heat flow data obtained at the two Apollo sites after December 1974 were left unprocessed and not properly archived through NASA. In the following decades, heat flow data from January 1975 through February 1976, as well as the metadata necessary for processing the data (the data reduction algorithm, instrument calibration data, etc.), were somehow lost. In 2010, we located 450 original master archival tapes of unprocessed data from all the ALSEP instruments for a period of April through June 1975 at the Washington National Records Center. We are currently extracting the heat flow data packets from these tapes and processing them. Second, on future lunar missions, heat flow probes will likely be deployed by a network of small robotic landers, as recommended by the latest Decadal Survey of the National Academy of Science. In such a scenario, the heat flow probe must be a compact system, and that precludes use of heavy excavation equipment such as a rotary drill for reaching the 3-m target depth. The new heat flow system under development uses a pneumatically driven penetrator. It utilizes a stem that winds out of a reel and pushes its conical tip into the regolith. Simultaneously, gas jets, emitted from the cone tip, loosen and blow away the soil. Lab experiments have demonstrated its effectiveness in lunar vacuum.

Nagihara, S.↗

NASA NTRS1976

Diffusion algorithms and data reduction routine for onsite real-time launch predictions for the transport of Delta-Thor exhaust effluents

The National Aeronautics and Space Administration/Marshall Space Flight Center multilayer diffusion algorithms have been specialized for the prediction of the surface impact for the dispersive transport of the exhaust effluents from the launch of a Delta-Thor vehicle. This specialization permits these transport predictions to be made at the launch range in real time so that the effluent monitoring teams can optimize their monitoring grids. Basically, the data reduction routine requires only the meteorology profiles for the thermodynamics and kinematics of the atmosphere as an input. These profiles are graphed along with the resulting exhaust cloud rise history, the centerline concentrations and dosages, and the hydrogen chloride isopleths.

Stephens, J. B.↗

NASA NTRS1984

Nimbus-Earth radiation budget instrument analysis

The Wide Field Of View (WFOV) Earth Flux Channels of the Nimbus Earth Radiation Budget (ERB) instrument are studied with the objective of improving the understanding and confidence in the data. Laboratory tests on flight space Earth flux subassemblies followed by a set of in flight verification procedures are examined to see if the laboratory derived correction factors produced consistent results. Intercomparisons between the WFOV data and integrated scanner data as well as other truth are used in these verificaton procedures. The main source of errors are temperature and temperature gradient related offsets. The findings led to construction of a model for the short wave WFOV channel which use instrument temperatures and temperature differences to predict or establish offsets which need to be applied to data reduction algorithms for maximum final data product accuracy.

Maschhoff, R. M.↗

NASA NTRS2003

Data Access Tools And Services At The Goddard Distributed Active Archive Center (GDAAC)

As one of the largest providers of Earth Science data from the Earth Observing System, GDAAC provides the latest data from the Moderate Resolution Imaging Spectroradiometer (MODIS), Atmospheric Infrared Sounder (AIRS), Solar Radiation and Climate Experiment (SORCE) data products via GDAAC's data pool (50TB of disk cache). In order to make this huge volume of data more accessible to the public and science communities, the GDAAC offers multiple data access tools and services: Open Source Project for Network Data Access Protocol (OPeNDAP), Grid Analysis and Display System (GrADS/DODS) (GDS), Live Access Server (LAS), OpenGlS Web Map Server (WMS) and Near Archive Data Mining (NADM). The objective is to assist users in retrieving electronically a smaller, usable portion of data for further analysis. The OPeNDAP server, formerly known as the Distributed Oceanographic Data System (DODS), allows the user to retrieve data without worrying about the data format. OPeNDAP is capable of server-side subsetting of HDF, HDF-EOS, netCDF, JGOFS, ASCII, DSP, FITS and binary data formats. The GrADS/DODS server is capable of serving the same data formats as OPeNDAP. GDS has an additional feature of server-side analysis. Users can analyze the data on the server there by decreasing the computational load on their client's system. The LAS is a flexible server that allows user to graphically visualize data on the fly, to request different file formats and to compare variables from distributed locations. Users of LAS have options to use other available graphics viewers such as IDL, Matlab or GrADS. WMS is based on the OPeNDAP for serving geospatial information. WMS supports OpenGlS protocol to provide data in GIs-friendly formats for analysis and visualization. NADM is another access to the GDAAC's data pool. NADM gives users the capability to use a browser to upload their C, FORTRAN or IDL algorithms, test the algorithms, and mine data in the data pool. With NADM, the GDAAC provides an environment physically close to the data source. NADM will benefit users with mining or offer data reduction algorithms by reducing large volumes of data before transmission over the network to the user.

Pham, Long↗

NASA NTRS1987

Data volume reduction for imaging radar polarimetry

Two data reduction algorithms developed using the scattering and phase matrix approaches are described. In the scattering matrix approach, the scattering matrices of four consecutive along-track pixels are averaged and in the phase matrix approach, the phase matrices of four consecutive along-track pixels are averaged. The basic procedures necessary to generate a synthetic polarization image from original data sets are discussed. The two algorithms are evaluated in terms of data volume reduction and the number of errors introduced in the synthesized images. It is observed that the reduced data set produced by the scattering matrix algorithm is smaller than that generated by the phase matrix algorithm; however, greater errors are introduced into the data set by the scattering matrix algorithm than the phase algorithm. Flowcharts for the scattering and phase matrix approaches and for synthesis of uncompressible data are presented.

Dubois, Pascale C.↗

NASA NTRS1987

A proposed Applications Information System - Concept, implementation, and growth

This paper describes a newly developed concept within NASA for an Applications Information System (AIS). The AIS would provide the opportunity to the public and private sectors of shared participation in a remote sensing research program directed to a particular set of land-use or environmental problems. Towards this end, the AIS would offer the technological framework and information system resources to overcome many of the deficiencies that end-users have faced over the years such as limited access to data, delay in data delivery, and a limited access to data reduction algorithms and models to convert data to geophysical measurements. In addition, the AIS will take advantage of NASA developments in networking among information systems and use of state of the art technology, such as CD Roms and optical disks for the purpose of increasing the scientific benefits of applied environmental research. The rationale for the establishment of an AIS, a methodology for a step-wise, modular implementation, and the relationship of the AIS to other NASA information systems are discussed.

Mcconnell, Dudley G.↗

NASA NTRS1997

Experimental Characterization of Hysteresis in a Revolute Joint for Precision Deployable Structures

Recent studies of the micro-dynamic behavior of a deployable telescope metering truss have identified instabilities in the equilibrium shape of the truss in response to low-energy dynamic loading. Analyses indicate that these micro-dynamic instabilities arise from stick-slip friction within the truss joints (e.g., hinges and latches). The present study characterizes the low-magnitude quasi-static load cycle response of the precision revolute joints incorporated in the deployable telescope metering truss, and specifically, the hysteretic response of these joints caused by stick-slip friction within the joint. Detailed descriptions are presented of the test setup and data reduction algorithms, including discussions of data-error sources and data-filtering techniques. Test results are presented from thirteen specimens, and the effects of joint preload and manufacturing tolerances are investigated. Using a simplified model of stick-slip friction, a relationship is made between joint load-cycle behavior and micro-dynamic dimensional instabilities in the deployable telescope metering truss.

Lake, Mark S.↗

NASA NTRS2007

Photogrammetric Metrology for the James Webb Space Telescope Integrated Science Instrument Module

The James Webb Space Telescope (JWST) is a 6.6m diameter, segmented, deployable telescope for cryogenic IR space astronomy (approximately 40K). The JWST Observatory architecture includes the Optical Telescope Element and the Integrated Science Instrument Module (ISIM) element that contains four science instruments (SI) including a Guider. The ISM optical metering structure is a roughly 2.2x1.7x2.2m, asymmetric frame that is composed of carbon fiber and resin tubes bonded to invar end fittings and composite gussets and clips. The structure supports the SIs, isolates the SIs from the OTE, and supports thermal and electrical subsystems. The structure is attached to the OTE structure via strut-like kinematic mounts. The ISIM structure must meet its requirements at the approximately 40K cryogenic operating temperature. The SIs are aligned to the structure's coordinate system under ambient, clean room conditions using laser tracker and theodolite metrology. The ISIM structure is thermally cycled for stress relief and in order to measure temperature-induced mechanical, structural changes. These ambient-to-cryogenic changes in the alignment of SI and OTE-related interfaces are an important component in the JWST Observatory alignment plan and must be verified. We report on the planning for and preliminary testing of a cryogenic metrology system for ISIM based on photogrammetry. Photogrammetry is the measurement of the location of custom targets via triangulation using images obtained at a suite of digital camera locations and orientations. We describe metrology system requirements, plans, and ambient photogrammetric measurements of a mock-up of the ISIM structure to design targeting and obtain resolution estimates. We compare these measurements with those taken from a well known ambient metrology system, namely, the Leica laser tracker system. We also describe the data reduction algorithm planned to interpret cryogenic data from the Flight structure. Photogrammetry was selected from an informal trade study of cryogenic metrology systems because its resolution meets sub-allocations to ISIM alignment requirements and it is a non-contact method that can in principle measure six degrees of freedom changes in target location. In addition, photogrammetry targets can be readily related to targets used for ambient surveys of the structure. By thermally isolating the photogrammetry camera during testing, metrology can be performed in situ during thermal cycling. Photogrammetry also has a small but significant cryogenic heritage in astronomical instrumentation metrology. It was used to validate the displacement/deformation predictions of the reflectors and the feed horns during thermal/vacuum testing (90K) for the Microwave Anisotropy Probe (MAP). It also was used during thermal vacuum testing (100K) to verify shape and component alignment at operational temperature of the High Gain Antenna for New Horizons. With tighter alignment requirements and lower operating temperatures than the aforementioned observatories, ISIM presents new challenges in the development of this metrology system.

Nowak, Maria↗

NASA NTRSDate not supplied

Methodology for Validation of Unsteady Pressure-Sensitive Paint Measurements using Pressure Transducers

Unsteady Pressure-Sensitive Paint (uPSP) technology provides simultaneously high-frequency and high-spatial resolution surface pressure fluctuation measurements. It has demonstrated value in wind tunnel test facilities to evaluate aerospace vehicle unsteady aerodynamics. The calibration of measurements from digital pixel counts into corresponding physical units relies on both lab-based and in-situ calibration steps, and its validation is both challenging and critical to adoption of the technology. We present a rigorous methodology for direct comparison of uPSP-derived surface pressure measurements to reference pressure transducer data based on a model of the camera-based measurement error, a model of the flow field pressure signal, and their propagation through the uPSP data reduction algorithm. The methodology is demonstrated on data collected in a small-scale, subsonic wind tunnel test as well as data collected from a Space Launch System unsteady aerodynamics characterization test at the NASA Ames Research Center Unitary Plan Wind Tunnel Complex.

Pressure-Sensitive Paint↗

NASA NTRSDate not supplied

Validating uPSP with Transducers

Pressure-Sensitive Paint↗

NASA NTRS2012

Quantifying Pilot Visual Attention in Low Visibility Terminal Operations

Quantifying pilot visual behavior allows researchers to determine not only where a pilot is looking and when, but holds implications for specific behavioral tracking when these data are coupled with flight technical performance. Remote eye tracking systems have been integrated into simulators at NASA Langley with effectively no impact on the pilot environment. This paper discusses the installation and use of a remote eye tracking system. The data collection techniques from a complex human-in-the-loop (HITL) research experiment are discussed; especially, the data reduction algorithms and logic to transform raw eye tracking data into quantified visual behavior metrics, and analysis methods to interpret visual behavior. The findings suggest superior performance for Head-Up Display (HUD) and improved attentional behavior for Head-Down Display (HDD) implementations of Synthetic Vision System (SVS) technologies for low visibility terminal area operations. Keywords: eye tracking, flight deck, NextGen, human machine interface, aviation

Ellis, Kyle K.↗

DOE OSTI2025

HPDR: High-Performance Portable Scientific Data Reduction Framework

The rapid growth in scientific data generation is outpacing advancements in computing systems necessary for efficient storage, transfer, and analysis, particularly in the context of exascale computing. With the deployment of first-generation exascale computing systems and next-generation experimental facilities, this gap is widening and necessitates effective data reduction techniques to manage enormous data volumes. Over the past decade, various data reduction methods, including lossless compression, error-controlled lossy compression, and data refactoring, have been developed to accelerate I/O in scientific workflows. Despite significant reductions in data volume, these methods introduce considerable computational overhead, which can become the new bottleneck in data processing. To mitigate this, GPU-accelerated data reduction algorithms have been introduced. However, challenges remain in their integration into exascale workflows, including limited portability across different GPU architectures, substantial memory transfer overhead, and reduced scalability on dense multi-GPU systems. To address these challenges, we propose HPDR, a high-performance and portable data reduction framework. HPDR is designed to enable the execution of state-of-the-art reduction algorithms across diverse processor architectures while reducing memory transfer overhead to 2.3 % of the original, resulting in up to 3.5× faster throughput compared to existing solutions. It also achieves up to 96% of the theoretical speedup in multi-GPU settings. In addition, evaluations on accelerating I/O operations at scale up to 1,024 nodes of the Frontier supercomputer demonstrate that HPDR can achieve up to 103 TB/s reduction throughput, providing up to 4× acceleration in parallel I/O performance compared to existing data reduction routines. This work highlights the potential of HPDR to significantly enhance data reduction efficiency in exascale computing environments.

Chen, Jieyang [University of Oregon]↗

NASA NTRS2000

Condition Monitoring for Helicopter Data

In this paper the classical "Westland" set of empirical accelerometer helicopter data is analyzed with the aim of condition monitoring for diagnostic purposes. The goal is to determine features for failure events from these data, via a proprietary signal processing toolbox, and to weigh these according to a variety of classification algorithms. As regards signal processing, it appears that the autoregressive (AR) coefficients from a simple linear model encapsulate a great deal of information in a relatively few measurements; it has also been found that augmentation of these by harmonic and other parameters can improve classification significantly. As regards classification, several techniques have been explored, among these restricted Coulomb energy (RCE) networks, learning vector quantization (LVQ), Gaussian mixture classifiers and decision trees. A problem with these approaches, and in common with many classification paradigms, is that augmentation of the feature dimension can degrade classification ability. Thus, we also introduce the Bayesian data reduction algorithm (BDRA), which imposes a Dirichlet prior on training data and is thus able to quantify probability of error in an exact manner, such that features may be discarded or coarsened appropriately.

Wen, Fang↗

NASA NTRS2001

Analysis of the Westland Data Set

The "Westland" set of empirical accelerometer helicopter data with seeded and labeled faults is analyzed with the aim of condition monitoring. The autoregressive (AR) coefficients from a simple linear model encapsulate a great deal of information in a relatively few measurements; and it has also been found that augmentation of these by harmonic and other parameters call improve classification significantly. Several techniques have been explored, among these restricted Coulomb energy (RCE) networks, learning vector quantization (LVQ), Gaussian mixture classifiers and decision trees. A problem with these approaches, and in common with many classification paradigms, is that augmentation of the feature dimension can degrade classification ability. Thus, we also introduce the Bayesian data reduction algorithm (BDRA), which imposes a Dirichlet prior oil training data and is thus able to quantify probability of error in all exact manner, such that features may be discarded or coarsened appropriately.

Wen, Fang↗