Search NASA⌕ Search

SEARCH · Search NASA

Results for “data reduction algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
NASA NTRS2008

Reducing Surface Clutter in Cloud Profiling Radar Data

An algorithm has been devised to reduce ground clutter in the data products of the CloudSat Cloud Profiling Radar (CPR), which is a nadir-looking radar instrument, in orbit around the Earth, that measures power backscattered by clouds as a function of distance from the instrument. Ground clutter contaminates the CPR data in the lowest 1 km of the atmospheric profile, heretofore making it impossible to use CPR data to satisfy the scientific interest in studying clouds and light rainfall at low altitude. The algorithm is based partly on the fact that the CloudSat orbit is such that the geodetic altitude of the CPR varies continuously over a range of approximately 25 km. As the geodetic altitude changes, the radar timing parameters are changed at intervals defined by flight software in order to keep the troposphere inside a data-collection time window. However, within each interval, the surface of the Earth continuously "scans through" (that is, it moves across) a few range bins of the data time window. For each radar profile, only few samples [one for every range-bin increment ((Delta)r = 240 m)] of the surface-clutter signature are available around the range bin in which the peak of surface return is observed, but samples in consecutive radar profiles are offset slightly (by amounts much less than (Delta)r) with respect to each other according to the relative change in geodetic altitude. As a consequence, in a case in which the surface area under examination is homogenous (e.g., an ocean surface), a sequence of consecutive radar profiles of the surface in that area contains samples of the surface response with range resolution (Delta)p much finer than the range-bin increment ((Delta)p << r). Once the high-resolution surface response has thus become available, the profile of surface clutter can be accurately estimated by use of a conventional maximum-correlation scheme: A translated and scaled version of the high-resolution surface response is fitted to the observed low-resolution profile. The translation and scaling factors that optimize the fit in a maximum-correlation sense represent (1) the true position of the surface relative to the sampled surface peak and (2) the magnitude of the surface backscatter. The performance of this algorithm has been tested on CloudSat data acquired over an ocean surface. A preliminary analysis of the test data showed a surface-clutter-rejection ratio over flat surfaces of >10 dB and a reduction of the contaminated altitude over ocean from about 1 km to about 0.5 km (over the ocean). The algorithm has been embedded in CloudSat L1B processing as of Release 04 (July 2007), and the estimated flat surface clutter is removed in L2B-GEOPROF product from the observed profile of reflectivity (see CloudSat product documentation for details and performance at http://www.cloudsat.cira.colostate.edu/ dataSpecs.php?prodid=1).

Tanelli, Simone↗
NASA NTRS2015

PISCES High Contrast Integral Field Spectrograph Simulations and Data Reduction Pipeline

The PISCES (Prototype Imaging Spectrograph for Coronagraphic Exoplanet Studies) is a lenslet array based integral field spectrograph (IFS) designed to advance the technology readiness of the WFIRST (Wide Field Infrared Survey Telescope)-AFTA (Astrophysics Focused Telescope Assets) high contrast Coronagraph Instrument. We present the end to end optical simulator and plans for the data reduction pipeline (DRP). The optical simulator was created with a combination of the IDL (Interactive Data Language)-based PROPER (optical propagation) library and Zemax (a MatLab script), while the data reduction pipeline is a modified version of the Gemini Planet Imager's (GPI) IDL pipeline. The simulations of the propagation of light through the instrument are based on Fourier transform algorithms. The DRP enables transformation of the PISCES IFS data to calibrated spectral data cubes.

The PISCES (Prototype Imaging Spectrograph for Cor↗
NASA NTRS1990

Kalman filter based range estimation for autonomous navigation using imaging sensors

The ability to detect and locate obstacles using on-board sensors and modify the nominal trajectory is necessary for safe landing of an autonomous lander on Mars. This paper examines some of the issues in the location of objects using a sequence of images from a passive sensor, and describes a Kalman filter approach to improve the range estimation to obstacles. The filter is also used to track features in the images leading to a significant reduction of search effort in the feature extraction step of the algorithm. The lack of suitable flight imagery data presents a problem in the verification of concepts for obstacle detection. An experiment is designed to acquire a sequence of images along with sensor motion parameters and the range estimation results using this imagery are presented.

Sridhar, B.↗
NASA NTRS1987

Algorithm Sorts Groups Of Data

For efficient sorting, algorithm finds set containing minimum or maximum most significant data. Sets of data sorted as desired. Sorting process simplified by reduction of each multielement set of data to single representative number. First, each set of data expressed as polynomial with suitably chosen base, using elements of set as coefficients. Most significant element placed in term containing largest exponent. Base selected by examining range in value of data elements. Resulting series summed to yield single representative number. Numbers easily sorted, and each such number converted back to original set of data by successive division. Program written in BASIC.

Evans, J. D.↗
NASA NTRS1986

Data inversion algorithm development for the hologen occultation experiment

The successful retrieval of atmospheric parameters from radiometric measurement requires not only the ability to do ideal radiometric calculations, but also a detailed understanding of instrument characteristics. Therefore a considerable amount of time was spent in instrument characterization in the form of test data analysis and mathematical formulation. Analyses of solar-to-reference interference (electrical cross-talk), detector nonuniformity, instrument balance error, electronic filter time-constants and noise character were conducted. A second area of effort was the development of techniques for the ideal radiometric calculations required for the Halogen Occultation Experiment (HALOE) data reduction. The computer code for these calculations must be extremely complex and fast. A scheme for meeting these requirements was defined and the algorithms needed form implementation are currently under development. A third area of work included consulting on the implementation of the Emissivity Growth Approximation (EGA) method of absorption calculation into a HALOE broadband radiometer channel retrieval algorithm.

Gordley, Larry L.↗
NASA NTRS2008

1D-VAR Retrieval Using Superchannels

Since modern ultra-spectral remote sensors have thousands of channels, it is difficult to include all of them in a 1D-var retrieval system. We will describe a physical inversion algorithm, which includes all available channels for the atmospheric temperature, moisture, cloud, and surface parameter retrievals. Both the forward model and the inversion algorithm compress the channel radiances into super channels. These super channels are obtained by projecting the radiance spectra onto a set of pre-calculated eigenvectors. The forward model provides both super channel properties and jacobian in EOF space directly. For ultra-spectral sensors such as Infrared Atmospheric Sounding Interferometer (IASI) and the NPOESS Airborne Sounder Testbed Interferometer (NAST), a compression ratio of more than 80 can be achieved, leading to a significant reduction in computations involved in an inversion process. Results will be shown applying the algorithm to real IASI and NAST data.

Liu, Xu↗
NASA NTRS2018

Traction Control Design and Integration Onboard the Mars Science Laboratory Curiosity Rover

The Mars Science Laboratory (MSL) Curiosity rover experienced increasing wheel damage beginning in October 2013. While the wheels were designed to operate with considerable damage, the rate at which damage was occurring was unexpected and raised concerns regarding wheel lifetime. The Jet Propulsion Laboratory (JPL) has now developed and deployed new software on Curiosity that reduces the forces acting on the wheels. Our new Traction Control algorithm adapts each wheel’s speed to fit the terrain it drives over. It does not rely on any a priori knowledge of the terrain, and instead leverages the rover’s measured attitude rates and suspension angles, together with a rigid-body kinematics model, to estimate the real-time wheel-terrain contact angles and ideal, no-slip wheel angular rates. In addition, free-floating “wheelies” are detected and autonomously corrected. In this paper, we describe the algorithm, its ground testing campaign and associated challenges, and finally its validation and performance in flight. Ground test data demonstrates reductions in the forces acting on the wheels and validates the wheelie-damping capability. Secondary benefits in some terrains include a reduction in heading deviations while climbing rocks, with a reduction in slip in certain sandy terrains. Preliminary validation from flight data confirms these findings.

Maimone, Mark↗
NASA NTRS1993

Scattered light in the echelle modes of the Goddard High Resolution Spectrograph aboard the Hubble Space Telescope. II - Analysis of in-flight spectroscopic observations

We report on an analysis of observations made with the GHRS aboard the HST for the purpose of calibrating the effects of scattered light. The data were obtained during the first 2 years of flight operations as part of the Science Verification, Science Assessment Observations, and Guaranteed Time Observations programs. Both the general level of background light near the spectra and the filling-in of the cores of saturated interstellar absorption lines have been determined as functions of grating, order, wavelength, and aperture. The behavior is in accordance with our detailed analysis of prelaunch laboratory data and validates both the observing procedures and the data reduction developed on the basis of that experience. We present and discuss the use of a background (scattered light) removal algorithm designed to produce net spectra properly corrected for the effects of grating scattered light. The coefficients of the scattered light removal algorithm have been determined, and recommended numerical values are presented.

Cardelli, Jason A.↗
NASA NTRS2010

The Geostationary Lighting Mapper (GLM) for GOES-R: A New Operational Capability to Improve Storm Forecasts and Warnings

The next generation Geostationary Operational Environmental Satellite (GOES-R) series is a follow on to the existing GOES system currently operating over the Western Hemisphere. Superior spacecraft and instrument technology will support expanded detection of environmental phenomena, resulting in more timely and accurate forecasts and warnings. Advancements over current GOES capabilities include a new capability for total lightning detection (cloud and cloud-to-ground flashes) from the Geostationary Lightning Mapper (GLM), and improved spectral (3x), spatial (4x), and temporal (5x) resolution for the Advanced Baseline Imager (ABI). The GLM, an optical transient detector and imager operating in the near-IR at 777.4 nm will map all (in-cloud and cloud-to-ground) lighting flashes continuously day and night with near-uniform spatial resolution of 8 km with a product refresh rate of less than 20 sec over the Americas and adjacent oceanic regions, from the west coast of Africa (GOES-E) to New Zealand (GOES-W) when the constellation is fully operational. This will aid in forecasting severe storms and tornado activity, and convective weather impacts on aviation safety and efficiency. In parallel with the instrument development (a prototype and 4 flight models), a GOES-R Risk Reduction Team and Algorithm Working Group Lightning Applications Team have begun to develop the Level 2 algorithms and applications. Proxy total lightning data from the NASA Lightning Imaging Sensor on the Tropical Rainfall Measuring Mission (TRMM) satellite and regional test beds are being used to develop the pre-launch algorithms and applications, and also improve our knowledge of thunderstorm initiation and evolution. Real time lightning mapping data are being provided in an experimental mode to selected National Weather Service (NWS) national centers and forecast offices via the GOES-R Proving Ground to help improve our understanding of the application of these data in operational settings and facilitate Day-1 user readiness for this new capability.

Goodman, Steven J.↗
NASA NTRS2001

The Role of Clear Sky Identification in the Study of Cloud Radiative Effects: Combine Analysis from ISCCP and the Scanner of Radiation Budget (ScaRaB)

Since the effect of clouds on the earth's radiation balance is often estimated as the difference of net radiative fluxes at the top of the atmosphere between all situations and monthly averaged clear sky situations of the same regions, a reliable identification of clear sky is important for the study of cloud radiative effects. The Scanner for Radiation Balance (ScaRaB) radiometer on board the Russian Meteor-3/7 satellite provided earth radiation budget observations from March 1994 to February 1995 with two ERBE-Re broad-band longwave and shortwave channels. Two narrow-band channels, in the infrared atmospheric window and in the visible band, have been added to the ScaRaB instrument to improve the cloud scene identification. The International Satellite Cloud Climatology Project (ISCCP) method for cloud detection and determination of cloud and surface properties uses the same narrow-band channels as ScaRaB, but is employed to a collection of measurements at a better spatial resolution of about 5 km. By applying the original ISCCP algorithms to the ScaRaB data, the clear sky frequency is about 5% lower than the one over quasi-simultaneous original ISCCP data, an indication that the ISCCP cloud detection is quite stable. However, one would expect an about 10 to 20% smaller clear sky occurrence over the larger ScaRaB pixels. Adapting the ISCCP algorithms to the reduced spatial resolution of 60 km and to the different time sampling of the ScaRaB data leads therefore to a reduction of a residual cloud contamination. A sensitivity study with time-space collocated ScaRaB and original ISCCP data at a spatial resolution of 1deg longitude x 1deg latitude shows that the effect of clear sky identification method plays a higher role on the clear sky frequency and therefore on the statistics than on the zonal mean values of the clear sky fluxes. Nevertheless, the zonal outgoing longwave fluxes corresponding to ERBE clear sky are in general about 2 to 10 W/sq m higher than those obtained from the ScaRaB adapted ISCCP clear sky identifications. The latter are close to (about 1 W/sq m higher) fluxes corresponding to clear sky regions from original ISCCP data, whereas ScaRaB clear sky LW fluxes obtained with the original ISCCP identification lie about 1 to 2 W/sq m below. Especially in the tropics where water vapor abundance is high, the ERBE clear sky LW fluxes seem to be systematically overestimated by about 4 W/sq m, and SW fluxes are lower by about 5 to 10 W/sq m. However, the uncertainty in the analysis of monthly mean zonal cloud radiative effects is also produced by the low frequency of clear sky occurrence, illustrated when averaging over pixels or even over regions of 4deg longitude x 5deg latitude, corresponding to the spatial resolution of General Circulation Models. The systematic bias in the clear sky fluxes is not reflected in the zonal cloud radiative effects, because the clear sky regions selected by the different algorithms can occur in different geographic regions with different cloud properties.

Rossow, W. B.↗
NASA NTRS1985

Theoretical and software considerations for general dynamic analysis using multilevel substructured models

The dynamic analysis of complex structural systems using the finite element method and multilevel substructured models is presented. The fixed-interface method is selected for substructure reduction because of its efficiency, accuracy, and adaptability to restart and reanalysis. This method is extended to reduction of substructures which are themselves composed of reduced substructures. The implementation and performance of the method in a general purpose software system is emphasized. Solution algorithms consistent with the chosen data structures are presented. It is demonstrated that successful finite element software requires the use of software executives to supplement the algorithmic language. The complexity of the implementation of restart and reanalysis porcedures illustrates the need for executive systems to support the noncomputational aspects of the software. It is shown that significant computational efficiencies can be achieved through proper use of substructuring and reduction technbiques without sacrificing solution accuracy. The restart and reanalysis capabilities and the flexible procedures for multilevel substructured modeling gives economical yet accurate analyses of complex structural systems.

Schmidt, R. J.↗
NASA NTRS2016

NASADEM Global Elevation Model: Methods and Progress

NASADEM (NASA Digital Elevation Model) is a near-global elevation model that is being produced primarily by completely reprocessing the Shuttle Radar Topography Mission (SRTM) radar data and then merging it with refined ASTER (Advanced Spaceborne Thermal Emission and Reflection Radiometer) GDEM (Global Digital Elevation Model) elevations. The new and improved SRTM elevations in NASADEM result from better vertical control of each SRTM data swath via reference to ICESat (Ice, Cloud, and land Elevation Satellite) elevations and from SRTM void reductions using advanced interferometric unwrapping algorithms. Remnant voids will be filled primarily by GDEM3, but with reduction of GDEM glitches (mostly related to clouds) and therefore with only minor need for secondary sources of fill.

GDEM↗
NASA NTRS1993

An analytic modeling and system identification study of rotor/fuselage dynamics at hover

A combination of analytic modeling and system identification methods have been used to develop an improved dynamic model describing the response of articulated rotor helicopters to control inputs. A high-order linearized model of coupled rotor/body dynamics including flap and lag degrees of freedom and inflow dynamics with literal coefficients is compared to flight test data from single rotor helicopters in the near hover trim condition. The identification problem was formulated using the maximum likelihood function in the time domain. The dynamic model with literal coefficients was used to generate the model states, and the model was parametrized in terms of physical constants of the aircraft rather than the stability derivatives resulting in a significant reduction in the number of quantities to be identified. The likelihood function was optimized using the genetic algorithm approach. This method proved highly effective in producing an estimated model from flight test data which included coupled fuselage/rotor dynamics. Using this approach it has been shown that blade flexibility is a significant contributing factor to the discrepancies between theory and experiment shown in previous studies. Addition of flexible modes, properly incorporating the constraint due to the lag dampers, results in excellent agreement between flight test and theory, especially in the high frequency range.

Hong, Steven W.↗
NASA NTRS1993

An analytic modeling and system identification study of rotor/fuselage dynamics at hover

A combination of analytic modeling and system identification methods have been used to develop an improved dynamic model describing the response of articulated rotor helicopters to control inputs. A high-order linearized model of coupled rotor/body dynamics including flap and lag degrees of freedom and inflow dynamics with literal coefficients is compared to flight test data from single rotor helicopters in the near hover trim condition. The identification problem was formulated using the maximum likelihood function in the time domain. The dynamic model with literal coefficients was used to generate the model states, and the model was parametrized in terms of physical constants of the aircraft rather than the stability derivatives, resulting in a significant reduction in the number of quantities to be identified. The likelihood function was optimized using the genetic algorithm approach. This method proved highly effective in producing an estimated model from flight test data which included coupled fuselage/rotor dynamics. Using this approach it has been shown that blade flexibility is a significant contributing factor to the discrepancies between theory and experiment shown in previous studies. Addition of flexible modes, properly incorporating the constraint due to the lag dampers, results in excellent agreement between flight test and theory, especially in the high frequency range.

Hong, Steven W.↗
NASA NTRS1994

Implementation of a fully-balanced periodic tridiagonal solver on a parallel distributed memory architecture

While parallel computers offer significant computational performance, it is generally necessary to evaluate several programming strategies. Two programming strategies for a fairly common problem - a periodic tridiagonal solver - are developed and evaluated. Simple model calculations as well as timing results are presented to evaluate the various strategies. The particular tridiagonal solver evaluated is used in many computational fluid dynamic simulation codes. The feature that makes this algorithm unique is that these simulation codes usually require simultaneous solutions for multiple right-hand-sides (RHS) of the system of equations. Each RHS solutions is independent and thus can be computed in parallel. Thus a Gaussian elimination type algorithm can be used in a parallel computation and the more complicated approaches such as cyclic reduction are not required. The two strategies are a transpose strategy and a distributed solver strategy. For the transpose strategy, the data is moved so that a subset of all the RHS problems is solved on each of the several processors. This usually requires significant data movement between processor memories across a network. The second strategy attempts to have the algorithm allow the data across processor boundaries in a chained manner. This usually requires significantly less data movement. An approach to accomplish this second strategy in a near-perfect load-balanced manner is developed. In addition, an algorithm will be shown to directly transform a sequential Gaussian elimination type algorithm into the parallel chained, load-balanced algorithm.

Eidson, T. M.↗
NASA NTRS1995

Knowledge-Based Scheduling of Arrival Aircraft in the Terminal Area

A knowledge based method for scheduling arrival aircraft in the terminal area has been implemented and tested in real time simulation. The scheduling system automatically sequences, assigns landing times, and assign runways to arrival aircraft by utilizing continuous updates of aircraft radar data and controller inputs. The scheduling algorithm is driven by a knowledge base which was obtained in over two thousand hours of controller-in-the-loop real time simulation. The knowledge base contains a series of hierarchical 'rules' and decision logic that examines both performance criteria, such as delay reductions, as well as workload reduction criteria, such as conflict avoidance. The objective of the algorithm is to devise an efficient plan to land the aircraft in a manner acceptable to the air traffic controllers. This paper describes the scheduling algorithms, gives examples of their use, and presents data regarding their potential benefits to the air traffic system.

Krzeczowski, K. J.↗
NASA NTRS2016

New Methods for Retrieval of Chlorophyll Red Fluorescence from Hyperspectral Satellite Instruments: Simulations and Application to GOME-2 and SCIAMACHY

Global satellite measurements of solar-induced fluorescence (SIF) from chlorophyll over land and ocean have proven useful for a number of different applications related to physiology, phenology, and productivity of plants and phytoplankton. Terrestrial chlorophyll fluorescence is emitted throughout the red and far-red spectrum, producing two broad peaks near 683 and 736nm. From ocean surfaces, phytoplankton fluorescence emissions are entirely from the red region (683nm peak). Studies using satellite-derived SIF over land have focused almost exclusively on measurements in the far red (wavelengths greater than 712nm), since those are the most easily obtained with existing instrumentation. Here, we examine new ways to use existing hyperspectral satellite data sets to retrieve red SIF (wavelengths less than 712nm) over both land and ocean. Red SIF is thought to provide complementary information to that from the far red for terrestrial vegetation. The satellite instruments that we use were designed to make atmospheric trace-gas measurements and are therefore not optimal for observing SIF; they have coarse spatial resolution and only moderate spectral resolution (0.5nm). Nevertheless, these instruments, the Global Ozone Monitoring Instrument 2 (GOME-2) and the SCanning Imaging Absorption spectroMeter for Atmospheric CHartographY (SCIAMACHY), offer a unique opportunity to compare red and far-red terrestrial SIF at regional spatial scales. Terrestrial SIF has been estimated with ground-, aircraft-, or satellite-based instruments by measuring the filling-in of atmospheric andor solar absorption spectral features by SIF. Our approach makes use of the oxygen (O2) gamma band that is not affected by SIF. The SIF-free O2 gamma band helps to estimate absorption within the spectrally variable O2 B band, which is filled in by red SIF. SIF also fills in the spectrally stable solar Fraunhofer lines (SFLs) at wavelengths both inside and just outside the O2 B band, which further helps to estimate red SIF emission. Our approach is then an extension of previous approaches applied to satellite data that utilized only the filling-in of SFLs by red SIF. We conducted retrievals of red SIF using an extensive database of simulated radiances covering a wide range of conditions. Our new algorithm produces good agreement between the simulated truth and retrievals and shows the potential of the O2 bands for noise reduction in red SIF retrievals as compared with approaches that rely solely on SFL filling. Biases seen with existing satellite data, most likely due to instrumental artifacts that vary in time, space, and with instrument, must be addressed in order to obtain reasonable results. Our 8-year record of red SIF observations over land with the GOME-2 allows for the first time reliable global mapping of monthly anomalies. These anomalies are shown to have similar spatiotemporal structure as those in the far red, particularly for drought-prone regions. There is a somewhat larger percentage response in the red as compared with the far red for these areas that are drought sensitive. We also demonstrate that good-quality ocean fluorescence line height retrievals can be achieved with GOME-2, SCIAMACHY, and similar instruments by utilizing the full complement of radiance measurements that span the red SIF emission feature.

spatiotemporal structure↗
NASA NTRS1995

Knowledge-based scheduling of arrival aircraft

A knowledge-based method for scheduling arrival aircraft in the terminal area has been implemented and tested in real-time simulation. The scheduling system automatically sequences, assigns landing times, and assigns runways to arrival aircraft by utilizing continuous updates of aircraft radar data and controller inputs. The scheduling algorithms is driven by a knowledge base which was obtained in over two thousand hours of controller-in-the-loop real-time simulation. The knowledge base contains a series of hierarchical 'rules' and decision logic that examines both performance criteria, such as delay reduction, as well as workload reduction criteria, such as conflict avoidance. The objective of the algorithms is to devise an efficient plan to land the aircraft in a manner acceptable to the air traffic controllers. This paper will describe the scheduling algorithms, give examples of their use, and present data regarding their potential benefits to the air traffic system.

Krzeczowski, K.↗