Search NASA⌕ Search

SEARCH · Search NASA

Results for “data reduction algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
NASA NTRS1979

On adaptive modal control of large flexible spacecraft

A recently developed strategy for adaptive sampled-data control of distributed parameter systems based on a plant modal expansion description and modal simultaneous identification and regulation algorithms is presented with frequent reference to the annular momentum control device (AMCD) test example. The requirements of observation spillover reduction and modal eigenvector shape prespecification, which are especially crucial to the proposed adaptive control strategy, are addressed. Individual low pass time filtering of sensed AMCD particle displacements is proposed for observation spillover reduction. A layered scheme incorporating 'eigenvector' shape improvement is outlined to combat the expansion basis prespecification requirement.

Johnson, C. R., Jr.↗
NASA NTRS1981

Evaluation of large area crop estimation techniques

The performance of the USDAs EDITOR system is evaluated. The system processes Landsat imagery and estimates crop hectarage for large areas based on a regression estimator developed on a sample with known ground truth. It is found that use of multitemporal data over unitemporal significantly improves the hectarage estimates, and a 15% reduction in the r-squared of the regression occurs when independent and jackknifed test sets are used to evaluate the performance of the estimator. When an alternative clustering algorithm, CLASSY, is substituted for the current EDITOR method, estimator performance is improved with reduced need for analyst decisions. It is recommended that the CLASSY clustering algorithm and some form of jackknifing be implemented on EDITOR.

Amis, M. L.↗
NASA NTRS1987

State-space formulation of multi-shaker modal analysis

As modal testing techniques have improved in recent years, the demands placed on the accuracy of modal test results have increased. This paper describes a new multi-input, multi-output modal parameter estimation algorithm suitable for the identification of reduced-order models of structures. The method described is a frequency-domain method based on excitation and response spectra. The principal features of the algorithm are: (1) applicability to general linear, time-invariant systems, (2) direct use of multiple input and multiple response data, (3) identification of reduced-order models with minimum user interaction through the use of two automatic model-reduction techniques, (4) identification of a consistent set of modal parameters through the use of numerically stable least-squares techniques, and (5) complete user documentation.

Craig, Roy R., Jr.↗
NASA NTRS2000

Evaluation of Various Radar Data Quality Control Algorithms Based on Accumulated Radar Rainfall Statistics

The primary function of the TRMM Ground Validation (GV) Program is to create GV rainfall products that provide basic validation of satellite-derived precipitation measurements for select primary sites. A fundamental and extremely important step in creating high-quality GV products is radar data quality control. Quality control (QC) processing of TRMM GV radar data is based on some automated procedures, but the current QC algorithm is not fully operational and requires significant human interaction to assure satisfactory results. Moreover, the TRMM GV QC algorithm, even with continuous manual tuning, still can not completely remove all types of spurious echoes. In an attempt to improve the current operational radar data QC procedures of the TRMM GV effort, an intercomparison of several QC algorithms has been conducted. This presentation will demonstrate how various radar data QC algorithms affect accumulated radar rainfall products. In all, six different QC algorithms will be applied to two months of WSR-88D radar data from Melbourne, Florida. Daily, five-day, and monthly accumulated radar rainfall maps will be produced for each quality-controlled data set. The QC algorithms will be evaluated and compared based on their ability to remove spurious echoes without removing significant precipitation. Strengths and weaknesses of each algorithm will be assessed based on, their abilit to mitigate both erroneous additions and reductions in rainfall accumulation from spurious echo contamination and true precipitation removal, respectively. Contamination from individual spurious echo categories will be quantified to further diagnose the abilities of each radar QC algorithm. Finally, a cost-benefit analysis will be conducted to determine if a more automated QC algorithm is a viable alternative to the current, labor-intensive QC algorithm employed by TRMM GV.

Robinson, Michael↗
NASA NTRS1988

Spatial compression of Seasat SAR imagery

The results of a study of techniques for spatial compression of synthetic-aperture-radar (SAR) imagery are summarized. Emphasis is on image-data volume reduction for archive and online storage applications while preserving the image resolution and radiometric fidelity. A quantitative analysis of various techniques, including vector quantization (VQ) and adaptive discrete cosine transform (ADCT), is presented. Various factors such as compression ratio, algorithm complexity, and image quality are considered in determining the optimal algorithm. The compression system requirements are established for electronic access of an online archive system based on the results of a survey of the science community. The various algorithms are presented and their results evaluated considering the effects of speckle noise and the wide dynamic range inherent in SAR imagery. The conclusion is that although the ADCT produces the best signal-to-distortion-noise ratio for a given compression ratio, the two-level tree-searched VQ technique is preferred due to its simplicity of decoding and near-optimal performance.

Chang, C. Y.↗
NASA NTRS2010

The Geostationary Lightning Mapper (GLM) for the GOES-R Series Next Generation Operational Environmental Satellite Constellation

The next generation Geostationary Operational Environmental Satellite (GOES-R) series with a planned launch in 2015 is a follow on to the existing GOES system currently operating over the Western Hemisphere. The system will aid in forecasting severe storms and tornado activity, and convective weather impacts on aviation safety and efficiency. The system provides products including lightning, cloud properties, rainfall rate, volcanic ash, air quality, hurricane intensity, and fire/hot spot characterization. Advancements over current GOES include a new capability for total lightning detection (cloud and cloud-to-ground flashes) from the Geostationary Lightning Mapper (GLM), and improved spectral, spatial, and temporal resolution for the 16-channel Advanced Baseline Imager (ABI). The Geostationary Lightning Mapper (GLM), an optical transient detector will map total (in-cloud and cloud-to-ground) lightning flashes continuously day and night with near-uniform spatial resolution of 8 km with a product refresh rate of less than 20 sec over the Americas and adjacent oceanic regions, from the west coast of Africa (GOES-E) to New Zealand (GOES-W) when the constellation is fully operational. In parallel with the instrument development, a GOES-R Risk Reduction Team and Algorithm Working Group Lightning Applications Team have begun to develop the higher level algorithms and applications using the GLM alone and decision aids incorporating information from the ABI, ground-based weather radar, and numerical models. Proxy total lightning data from the NASA Lightning Imaging Sensor on the Tropical Rainfall Measuring Mission (TRMM) satellite and regional lightning networks are being used to develop the pre-launch algorithms and applications, and also improve our knowledge of thunderstorm initiation and evolution. Real time total lightning mapping data are also being provided in an experimental mode to selected National Weather Service (NWS) national centers and forecast offices via the GOES-R Proving Ground to help improve our understanding of the application of these data in operational settings and facilitate early on-orbit user readiness for this new capability.

Goodman, Steven J.↗
NASA NTRS2017

Data Reduction Pipeline for the CHARIS Integral-Field Spectrograph I: Detector Readout Calibration and Data Cube Extraction

We present the data reduction pipeline for CHARIS, a high-contrast integral-field spectrograph for the Subaru Telescope. The pipeline constructs a ramp from the raw reads using the measured nonlinear pixel response and reconstructs the data cube using one of three extraction algorithms: aperture photometry, optimal extraction, or chi-squared fitting. We measure and apply both a detector flatfield and a lenslet flatfield and reconstruct the wavelength- and position-dependent lenslet point-spread function (PSF) from images taken with a tunable laser. We use these measured PSFs to implement a chi-squared-based extraction of the data cube, with typical residuals of approximately 5 percent due to imperfect models of the under-sampled lenslet PSFs. The full two-dimensional residual of the chi-squared extraction allows us to model and remove correlated read noise, dramatically improving CHARIS's performance. The chi-squared extraction produces a data cube that has been deconvolved with the line-spread function and never performs any interpolations of either the data or the individual lenslet spectra. The extracted data cube also includes uncertainties for each spatial and spectral measurement. CHARIS's software is parallelized, written in Python and Cython, and freely available on github with a separate documentation page. Astrometric and spectrophotometric calibrations of the data cubes and PSF subtraction will be treated in a forthcoming paper.

Brandt, Timothy D.↗
NASA NTRS2023

The Impact of Dimensionality Reduction of Ion Counts Distributions on Preserving Moments, With Applications to Data Compression

The field of space physics has a long history of utilizing dimensionality reduction methods to distill data, including but not limited to spherical harmonics, the Fourier Transform, and the wavelet transform. Here, we present a technique for performing dimensionality reduction on ion counts distributions from the Multiscale Mission/Fast Plasma Investigation (MMS/FPI) instrument using a data-adaptive method powered by neural networks. This has applications to both feeding low-dimensional parameterizations of the counts distributions into other machine learning algorithms, and the problem of data compression to reduce transmission volume for space missions. The algorithm presented here is lossy, and in this work, we present the technique of validating the reconstruction performance with calculated plasma moments under the argument that preserving the moments also preserves fluid-level physics, and in turn a degree of scientific validity. The method presented here is an improvement over other lossy compressions in loss-tolerant scenarios like the Multiscale Mission/Fast Plasma Investigation Fast Survey or in non-research space weather applications.

D. da Silva↗
NASA NTRS1989

Compression Of Data In Imaging Radar Polarimetry

Algorithms developed to reduce number of radar polarimetric data processed to synthesize image of arbitrary combination of transmitting and receiving polarizations. Brings image-processing requirements within computing capabilities of typical users, without degrading images excessively. In scattering-matrix approach to reduction of image data, four adjacent picture elements combined into one by synthesizing new scattering matrix from scattering matrices of four elements. In phase-matrix approach, phase matrices generated from scattering matrices of four adjacent picture elements, and four phase matrices added to combine four picture elements into one.

Zebker, H. A.↗
NASA NTRS2014

JPSS Science Data Services for the Direct Readout Community

The Suomi National Polar-orbiting Partnership (S-NPP) and Joint Polar Satellite System (JPSS) High Rate Data (HRD) link provides Direct Broadcast data to users in real-time, utilizing their own remote field terminals. The Field Terminal Support (FTS) provides the resources needed to support the Direct Readout communities by providing software, documentation, and periodic updates to enable them to produce data products from SNPP and JPSS. The FTS distribution server will also provide the necessary ancillary and auxiliary data needed for processing the broadcasts, as well as making orbital data available to assist in locating the satellites of interest. In addition, the FTS provides development support for the algorithm and software through GSFC Direct Readout Laboratory (DRL) International Polar Orbiter Processing Package (IPOPP) and University of Wisconsin (UWISC) Community Satellite Processing Package (CSPP), to enable users to integrate the algorithms into their remote terminals. The support the JPSS Program provides to the institutions developing and maintaining these two software packages, will demonstrate the ability to produce ready-to-use products from the HRD link and provide risk reduction effort at a minimal cost. This paper discusses the key functions and system architecture of FTS.

Data Processing↗
NASA NTRS1984

An algorithm for maximum likelihood estimation using an efficient method for approximating sensitivities

An algorithm for maximum likelihood (ML) estimation is developed primarily for multivariable dynamic systems. The algorithm relies on a new optimization method referred to as a modified Newton-Raphson with estimated sensitivities (MNRES). The method determines sensitivities by using slope information from local surface approximations of each output variable in parameter space. The fitted surface allows sensitivity information to be updated at each iteration with a significant reduction in computational effort compared with integrating the analytically determined sensitivity equations or using a finite-difference method. Different surface-fitting methods are discussed and demonstrated. Aircraft estimation problems are solved by using both simulated and real-flight data to compare MNRES with commonly used methods; in these solutions MNRES is found to be equally accurate and substantially faster. MNRES eliminates the need to derive sensitivity equations, thus producing a more generally applicable algorithm.

Murphy, P. C.↗
NASA NTRS2013

Mars Entry Atmospheric Data System Trajectory Reconstruction Algorithms and Flight Results

The Mars Entry Atmospheric Data System is a part of the Mars Science Laboratory, Entry, Descent, and Landing Instrumentation project. These sensors are a system of seven pressure transducers linked to ports on the entry vehicle forebody to record the pressure distribution during atmospheric entry. These measured surface pressures are used to generate estimates of atmospheric quantities based on modeled surface pressure distributions. Specifically, angle of attack, angle of sideslip, dynamic pressure, Mach number, and freestream atmospheric properties are reconstructed from the measured pressures. Such data allows for the aerodynamics to become decoupled from the assumed atmospheric properties, allowing for enhanced trajectory reconstruction and performance analysis as well as an aerodynamic reconstruction, which has not been possible in past Mars entry reconstructions. This paper provides details of the data processing algorithms that are utilized for this purpose. The data processing algorithms include two approaches that have commonly been utilized in past planetary entry trajectory reconstruction, and a new approach for this application that makes use of the pressure measurements. The paper describes assessments of data quality and preprocessing, and results of the flight data reduction from atmospheric entry, which occurred on August 5th, 2012.

Karlgaard, Christopher D.↗
NASA NTRS1986

A data reduction package for multiple object spectroscopy

Experience with fiber-optic spectrometers has demonstrated improvements in observing efficiency for clusters of 30 or more objects that must in turn be matched by data reduction capability increases. The Medusa Automatic Reduction System reduces data generated by multiobject spectrometers in the form of two-dimensional images containing 44 to 66 individual spectra, using both software and hardware improvements to efficiently extract the one-dimensional spectra. Attention is given to the ridge-finding algorithm for automatic location of the spectra in the CCD frame. A simultaneous extraction of calibration frames allows an automatic wavelength calibration routine to determine dispersion curves, and both line measurements and cross-correlation techniques are used to determine galaxy redshifts.

Hill, J. M.↗
NASA NTRS1999

Flight Test of an Adaptive Configuration Optimization System for Transport Aircraft

A NASA Dryden Flight Research Center program explores the practical application of real-time adaptive configuration optimization for enhanced transport performance on an L-1011 aircraft. This approach is based on calculation of incremental drag from forced-response, symmetric, outboard aileron maneuvers. In real-time operation, the symmetric outboard aileron deflection is directly optimized, and the horizontal stabilator and angle of attack are indirectly optimized. A flight experiment has been conducted from an onboard research engineering test station, and flight research results are presented herein. The optimization system has demonstrated the capability of determining the minimum drag configuration of the aircraft in real time. The drag-minimization algorithm is capable of identifying drag to approximately a one-drag-count level. Optimizing the symmetric outboard aileron position realizes a drag reduction of 2-3 drag counts (approximately 1 percent). Algorithm analysis of maneuvers indicate that two-sided raised-cosine maneuvers improve definition of the symmetric outboard aileron drag effect, thereby improving analysis results and consistency. Ramp maneuvers provide a more even distribution of data collection as a function of excitation deflection than raised-cosine maneuvers provide. A commercial operational system would require airdata calculations and normal output of current inertial navigation systems; engine pressure ratio measurements would be optional.

Gilyard, Glenn B.↗
NASA NTRS1999

Data Assimilation in the Presence of Forecast Bias: The GEOS Moisture Analysis

We describe the application of the unbiased sequential analysis algorithm developed by Dee and da Silva (1998) to the GEOS DAS moisture analysis. The algorithm estimates the persistent component of model error using rawinsonde observations and adjusts the first-guess moisture field accordingly. Results of two seasonal data assimilation cycles show that moisture analysis bias is almost completely eliminated in all observed regions. The improved analyses cause a sizable reduction in the 6h-forecast bias and a marginal improvement in the error standard deviations.

Dee, Dick P.↗
NASA NTRS1983

Algorithm development for the control design of flexible structures

The critical problems associated with the control of highly damped flexible structures are outlined. The practical problems include: high performance; assembly in space, configuration changes; on-line controller software design; and lack of test data. Underlying all of these problems is the central problem of modeling errors. To justify the expense of a space structure, the performance requirements will necessarily be very severe. On the other hand, the absence of economical tests precludes the availability of reliable data before flight. A design algorithm is offered which: (1) provides damping for a larger number of modes than the optimal attitude controller controls; (2) coordinates the rate of feedback design with the attitude control design by use of a similar cost function; and (3) provides model reduction and controller reduction decisions which are systematically connected to the mathematical statement of the control objectives and the disturbance models.

Skelton, R. E.↗
NASA NTRSDate not supplied

Jet Noise Prediction for Chevron Nozzle Flows with Wall-Modeled Large-Eddy Simulation

This paper presents results from ongoing research on jet noise prediction with wall-modeled large eddy simulations (WMLES) performed with the LAVA computational framework. In particular the focus of this study is on mixing enhancements from a single stream chevron nozzle at Reynolds number of 1×10(exp 6). Although the concept of chevron nozzles to reduce jet noise is not new, our understanding of its impact on the overall noise is still not well understood. As a first step towards predicting noise reduction due to mixing enhancement concepts from first principles with WMLES, we simulate the noise generated by a single stream chevron nozzle SMC001 as well as its equivalent axisymmetric round jet nozzle SMC000. Detailed comparisons are made with a dedicated experiment conducted at NASA’s Glenn Research Center and good agreement was achieved. Two different approaches to introduce a turbulent boundary layer were compared but show no major impact on the results. This is especially important given future work were multi-stream nozzles are considered and extended costs of resolving the internal BL would have a bigger cost impact. A permeable Ffowcs Williams Hawkings (FWH) surface enclosing the jet is used to predict far-field noise from the simulated flow-field and excellent comparison to microphone array measurements is achieved within the resolved frequency band. Sensitivity of far-field noise predictions to grid resolution is systematically documented. Near-field comparisons to PIV data shows great agreement for both velocity and normal stresses, however a systematic TKE overshoot at the nozzle exit is seen in the shear-layer. The paper shows a cost reduction of an order of magnitude compared to an earlier study of this configuration due to algorithmic and software improvements and demonstrates that WMLES can be used as a cost-competitive approach for jet noise predictions.

CST↗
NASA NTRSDate not supplied

Proposition to Optimize Fire Stations for Wildfires

The rising trend in wildfire occurrence and severity has put a strain on wildfire management organizations by spreading out limited resources to meet increasing demand. There has been extensive prior research and data collection to determine the areas of highest risk and to predict regional wildfire damages based on historical trends. Our group aims to utilize this data to best determine fire station placement, optimizing where resources are allocated to reduce the time and investment needed to effectively mitigate wildfires. Using existing research, we are able to calculate optimal fire station locations by utilizing a single-objective facility location problem algorithm incentivized for cost reduction. Further work would be needed to refine the algorithm to accommodate for more realistic factors including access to water and roadways as well as better accounting for the costs involved, but our work serves as a proof of concept and lays the foundation for future research. Implementation of this algorithm would allow public fire planning agencies (such as CAL FIRE and Forest Service) to shift resources to where they would be most effective.

Wildfires↗