Search NASA⌕ Search

SEARCH · Search NASA

Results for “data processing steps”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Optimal Signal Processing of Frequency-Stepped CW Radar Data

An optimal signal processing algorithm is derived for estimating the time delay and amplitude of each scatterer reflection using a frequency-stepped CW system. The channel is assumed to be composed of abrupt changes in the reflection coefficient profile. The optimization technique is intended to maximize the target range resolution achievable from any set of frequency-stepped CW radar measurements made in such an environment. The algorithm is composed of an iterative two-step procedure. First, the amplitudes of the echoes are optimized by solving an overdetermined least squares set of equations. Then, a nonlinear objective function is scanned in an organized fashion to find its global minimum. The result is a set of echo strengths and time delay estimates. Although this paper addresses the specific problem of resolving the time delay between the two echoes, the derivation is general in the number of echoes. Performance of the optimization approach is illustrated using measured data obtained from an HP-851O network analyzer. It is demonstrated that the optimization approach offers a significant resolution enhancement over the standard processing approach that employs an IFFT. Degradation in the performance of the algorithm due to suboptimal model order selection and the effects of additive white Gaussion noise are addressed.

Ybarra, Gary A.↗

Optimal Signal Processing of Frequency-Stepped CW Radar Data

An optimal signal processing algorithm is derived for estimating the time delay and amplitude of each scatterer reflection using a frequency-stepped CW system. The channel is assumed to be composed of abrupt changes in the reflection coefficient profile. The optimization technique is intended to maximize the target range resolution achievable from any set of frequency-stepped CW radar measurements made in such an environment. The algorithm is composed of an iterative two-step procedure. First, the amplitudes of the echoes are optimized by solving an overdetermined least squares set of equations. Then, a nonlinear objective function is scanned in an organized fashion to find its global minimum. The result is a set of echo strengths and time delay estimates. Although this paper addresses the specific problem of resolving the time delay between the first two echoes, the derivation is general in the number of echoes. Performance of the optimization approach is illustrated using measured data obtained from an HP-X510 network analyzer. It is demonstrated that the optimization approach offers a significant resolution enhancement over the standard processing approach that employs an IFFT. Degradation in the performance of the algorithm due to suboptimal model order selection and the effects of additive white Gaussion noise are addressed.

Ybarra, Gary A.↗

Learjet Acoustics Flight Test – An Initial Look

The motivation for the work is the need for an improved ability to predict takeoff noise of future commercial supersonic aircraft. The overall objective is to validate as well as improve the conversion of facility scale-model data and semi-empirical jet-noise predictions to flight noise. As a first step, the processing of data and results from an acoustics flight test are described. The next step involves the comparison of the flight acoustic data and complementary rig-test results. This will be presented in future reports. Ultimately, the goal is improved noise-prediction methods for system studies of future commercial supersonic aircraft.

aeroacoustics, jet noise, flyover noise↗

Data reduction, management, and analysis software for CID

In an overview of the Data Reduction System, three major steps are examined. First, the raw data tapes were selected from the onboard recorders. These tapes should provide the best quality data for the data reduction software system. These tapes contained 352 channels of data, plus the monitor channels recorded in 8 bit Pulsed Coded Modulation (PCM) words. The next step consists of transcribing the PCM tapes from 8 bit serial digital data to 8 bit parallel digital data. This puts the data in the correct format for processing. The transcription process was accomplished here at LaRC in the Central Data Transportation Facility (CDTF). The last step in this 3 step process is to process the data through the reduction system developed for the Impact Dynamic Research Facility in the early part of 1980. Processing system criteria, system interface routines, and engineering units program that reads digitized data from tapes, and file management programs are discussed.

Davis, C. W.↗

Modern Scientific Data Governance Framework

Science has entered the era of Big Data with new challenges related to data governance, stewardship, and management. The existing data governance practices must catch up to ensure proper data management. Existing data governance policies and stewardship best practices tend to be disconnected from operational data management practices and enforcement and mainly exist in well-meaning documents or reports. These governance policies are, at best, partially implemented and rarely monitored or audited. In addition, existing governance policies keep adding additional data management steps that require a human, ‘a data steward’, in the loop, and the cost of data management can no longer scale proportionately with the current and future increased data volume and complexity. The goal for developing an updated data governance framework is to modernize scientific data governance to the reality of Big data and align it with the current technology trends such as cloud computing and AI. The goals of this framework are two folds. One is to ensure thoroughness that the governance adequately covers the entire data life cycle. Two, provide a practical approach that offers a consistent and repeatable process for different projects. Three core principles ground this framework. First, focus on just enough governance and prevent data governance from becoming a roadblock toward the scientific process. Remove any unnecessary processes and steps. Second, automate data management steps where possible. Actively remove steps that require ‘human in the loop’ within the management process to be efficient and scale with increasing data. Third, all the processes should continually be optimized using quantified metrics to streamline the monitoring and auditing workflows.

Rahul Ramachandran↗

An Empirical Method for Determining the Lunar Gravity Field

A method has been devised to determine the spherical harmonic coefficients of the lunar gravity field. This method consists of a two-step data reduction and estimation process. In the first step, a weighted least-squares empirical orbit determination scheme is applied to Doppler tracking data from lunar orbits to estimate long-period Kepler elements and rates. Each of the Kepler elements is represented by an independent function of time. The long-period perturbing effects of the earth, sun, and solar radiation are explicitly modeled in this scheme. Kepler element variations estimated by this empirical processor are ascribed to the non-central lunar gravitation features. Doppler data are reduced in this manner for as many orbits as are available. In the second step, the Kepler element rates are used as input to a second least-squares processor that estimates lunar gravity coefficients using the long-period Lagrange perturbation equations.

Ferrari, A. J.↗

Lunar gravity derived from long-period satellite motion - A proposed method.

A new method has been devised to determine the spherical harmonic coefficients of the lunar gravity field. This method consists of a two-step data reduction and estimation process. In the first step, a weighted least-squares empirical orbit determination scheme is applied to Doppler tracking data from lunar orbits to estimate long-period Kepler elements and rates. Each of the Kepler elements is represented by an independent function of time. The long-period perturbing effects of the earth, sun, and solar radiation are explicitly modeled in this scheme. Kepler element variations estimated by this empirical processor are then ascribed to the non-central lunar gravitation features. Doppler data are reduced in this manner for as many orbits as are available. In the second step, the Kepler element rates are used as input to a second least-squares processor that estimates lunar gravity coefficients using the long-period Lagrange perturbation equations.

Ferrari, A. J.↗

The Development of Two Science Investigator-led Processing Systems (SIPS) for NASA's Earth Observation System (EOS)

In 2001, NASA Goddard Space Flight Center's Laboratory for Terrestrial Physics started the construction of a science Investigator-led Processing System (SIPS) for processing data from the Ozone Monitoring Instrument (OMI) which will launch on the Aura platform in mid 2004. The Ozone Monitoring Instrument (OMI) is a contribution of the Netherlands Agency for Aerospace Programs (NIVR) in collaboration with the Finnish Meteorological Institute (FMI) to the Earth Observing System (EOS) Aura mission. It will continue the Total Ozone Monitoring System (TOMS) record for total ozone and other atmospheric parameters related to ozone chemistry and climate. OMI measurements will be highly synergistic with the other instruments on the EOS Aura platform. The LTP previously developed the Moderate Resolution Imaging Spectrometer (MODIS) Data Processing System (MODAPS), which has been in full operations since the launches of the Terra and Aqua spacecrafts in December, 1999 and May, 2002 respectively. During that time, it has continually evolved to better support the needs of the MODIS team. We now run multiple instances of the system managing faster than real time reprocessings of the data as well as continuing forward processing. The new OMI Data Processing System (OMIDAPS) was adapted from the MODAPS. It will ingest raw data from the satellite ground station and process it to produce calibrated, geolocated higher level data products. These data products will be transmitted to the Goddard Distributed Active Archive Center (GDAAC) instance of the Earth Observing System (EOS) Data and Information System (EOSDIS) for long term archive and distribution to the public. The OMIDAPS will also provide data distribution to the OMI Science Team for quality assessment, algorithm improvement, calibration, etc. We have taken advantage of lessons learned from the MODIS experience and software already developed for MODIS. We made some changes in the hardware system organization, database and software to adapt the system for OMI. We replaced the fundamental database system, Sybase, with an Open Source RDBMS called PostgreSQL, and based the entire OMIDAPS on a cluster of Linux based commodity computers rather than the large SGI servers that MODAPS uses. Rather than relying on a central I/O server host, the new system distributes its data archive among multiple server hosts in the cluster. OMI is also customizing the graphical user interfaces and reporting structure to more closely meet the needs of the OMI Science Team. Prior to 2003, simulated OMI data and the science algorithms were not ready for production testing. We initially constructed a prototype system and tested using a 25 year dataset of Total Ozone Mapping Spectrometer (TOMS) and Solar Backscatter Ultraviolet Instrument (SBUV) data. This prototype system provided a platform to support the adaptation of the algorithms for OMI, and provided reprocessing of the historical data aiding in its analysis. In a recent reanalysis of the TOMS data, the OMIDAPS processed 108,000 full orbits of data through 4 processing steps per orbit, producing about 800,000 files (400 GiB) of level 2 and greater data files. More recently we have installed two instances of the OMIDAPS for integration and testing of OM1 science processes as they get delivered from the Science Team. A Test instance of the OMIDAPS has also supported a series of "Interface Confidence Tests" (ICTs) and End-to-End Ground System tests to ensure the launch readiness of the system. This paper will discuss the high-level hardware, software, and database organization of the OMIDAPS and how it builds on the MODAPS heritage system. It will also provide an overview of the testing and implementation of the production OMIDAPS.

Tilmes, Curt↗

User's guide to image processing applications of the NOAA satellite HRPT/AVHRR data. Part 1: Introduction to the satellite system and its applications. Part 2: Processing and analysis of AVHRR imagery

The use of NOAA Advanced Very High Resolution Radar/High Resolution Picture Transmission (AVHRR/HRPT) imagery for earth resource applications is provided for the applications scientist for use within the various Earth science, resource, and agricultural disciplines. A guide to processing NOAA AVHRR data using the hardware and software systems integrated for this NASA project is provided. The processing steps from raw data on computer compatible tapes (1B data format) through usable qualitative and quantitative products for applications are given. The manual is divided into two parts. The first section describes the NOAA satellite system, its sensors, and the theoretical basis for using these data for environmental applications. Part 2 is a hands-on description of how to use a specific image processing system, the International Imaging Systems, Inc. (I2S) Model 75 Array Processor and S575 software, to process these data.

Huh, Oscar Karl↗

Phase I for the Use of TOPEX-Poseidon and Jason-1 Radar Altimetry to Monitor Coastal Wetland Inundation and Sea Level Rise in Coastal Louisiana

The objective of the first phase of this project was to determine the feasibility of applying satellite altimetry data to monitor sea level rise and inundation within coastal Louisiana. Global sea level is rising, and coastal Louisiana is subsiding. Therefore, there is a need to monitor these trends over time for coastal restoration and hazard mitigation efforts. TOPEX/POSEIDON and Jason-data are used for global sea level estimates and have also been demonstrated successfully in water level studies of lakes, river basins, and floodplains throughout the world. To employ TOPEX/POSEIDON and Jason-1 data in coastal regions, the numerous steps involved in processing the data over non-open ocean areas must be assessed. This project outlined the appropriate methodology for processing non-open ocean data, including retracking and atmospheric corrections. It also inventoried the many factors in coastal land loss including subsidence, sea level rise, coastal geomorphology, and salinity levels, among others, through a review of remote sensing and field methods. In addition, the project analyzed the socioeconomic factors within the Coastal Zone as compared to the rest of Louisiana. While sensor data uncertainty must be addressed, it was determined that it is feasible to apply radar altimetry data from TOPEX/POSEIDON and Jason 1 to see trends in change within Coastal Louisiana since

Brozen, Madeline↗

OCI Geolocation Evaluation and Refinement Using Landsat Control Points

The Plankton, Aerosol, Cloud, and ocean Ecosystem (PACE) mission is NASA’s next investment in ocean biology, clouds, and aerosol data records. A key feature of PACE is the inclusion of an advanced satellite radiometer, Ocean Color Instrument (OCI), a global mapping radiometer that combines multispectral and hyperspectral remote sensing. The geolocation processing is performed for OCI using spacecraft navigation data and an instrument geometry model. To evaluate the geolocation accuracy for OCI and develop refinements to the processing methods, control point matching using Landsat data has been implemented as a step in the operational processing of OCI data at the Science Data Segment. This processing provides between 200 and 300 high-quality matchups per day with good global and geometric distribution, allowing rapid evaluation of the OCI geolocation accuracy. The results provided an early indication of the overall quality of the geolocation processing and of specific aspects needing improvement. A standard set of granules was identified to support rapid implementation and testing of geolocation refinements, and this approach has been highly successful in improving the geolocation processing accuracy to meet the science requirements. The evaluation will continue throughout the mission to ensure the ongoing accuracy of geolocation. This paper describes the control point matching methodology, the approach to development of the geolocation processing refinements, and the recent results.

PACE↗

OCI Geolocation Evaluation and Refinement Using Landsat Control Points

The Plankton, Aerosol, Cloud, and ocean Ecosystem (PACE) mission is NASA’s next investment in ocean biology, clouds, and aerosol data records. A key feature of PACE is the inclusion of an advanced satellite radiometer, Ocean Color Instrument (OCI), a global mapping radiometer that combines multispectral and hyperspectral remote sensing. The geolocation processing is performed for OCI using spacecraft navigation data and an instrument geometry model. To evaluate the geolocation accuracy for OCI and develop refinements to the processing methods, control point matching using Landsat data has been implemented as a step in the operational processing of OCI data at the Science Data Segment. This processing provides between 200 and 300 high-quality matchups per day with good global and geometric distribution, allowing rapid evaluation of the OCI geolocation accuracy. The results provided an early indication of the overall quality of the geolocation processing and of specific aspects needing improvement. A standard set of granules was identified to support rapid implementation and testing of geolocation refinements, and this approach has been highly successful in improving the geolocation processing accuracy to meet the science requirements. The evaluation will continue throughout the mission to ensure the ongoing accuracy of geolocation. This paper describes the control point matching methodology, the approach to development of the geolocation processing refinements, and the recent results.

PACE↗

Issues in knowledge representation to support maintainability: A case study in scientific data preparation

Scientific data preparation is the process of extracting usable scientific data from raw instrument data. This task involves noise detection (and subsequent noise classification and flagging or removal), extracting data from compressed forms, and construction of derivative or aggregate data (e.g. spectral densities or running averages). A software system called PIPE provides intelligent assistance to users developing scientific data preparation plans using a programming language called Master Plumber. PIPE provides this assistance capability by using a process description to create a dependency model of the scientific data preparation plan. This dependency model can then be used to verify syntactic and semantic constraints on processing steps to perform limited plan validation. PIPE also provides capabilities for using this model to assist in debugging faulty data preparation plans. In this case, the process model is used to focus the developer's attention upon those processing steps and data elements that were used in computing the faulty output values. Finally, the dependency model of a plan can be used to perform plan optimization and runtime estimation. These capabilities allow scientists to spend less time developing data preparation procedures and more time on scientific analysis tasks. Because the scientific data processing modules (called fittings) evolve to match scientists' needs, issues regarding maintainability are of prime importance in PIPE. This paper describes the PIPE system and describes how issues in maintainability affected the knowledge representation used in PIPE to capture knowledge about the behavior of fittings.

Chien, Steve↗

RFI at L-band in Synthetic Aperture Radiometers

The spectral window at 1.413 GHz (L-band), set aside for passive use only, is critical for passive remote sensing of the earth from space. It is the largest spectral window available in the long wavelength end of the microwave spectrum where measurements are needed to monitor parameters of the surface such as soil moisture and sea surface salinity. The sensitivity to these parameters is rapidly lost at higher frequencies and is compromised by the ionosphere and antenna size at lower frequencies. Instruments for remote sensing from space in this spectral window are being developed by NASA (Aquarius) and ESA (SMOS) and are expected to be in orbit in a few years (2006). Although the band at 1.413 GHz is protected for passive use, RFI is a common problem. For example, the synthetic aperture radiometer, ESTAR (L-band, Horizontal polarization), has frequently experienced problems with RFI. During the Southern Great Plains Experiments (1997 and 1999), ESTAR experienced RFI significant enough to warrant changes in flight lines. The largest sources of RFI were identified as originating in airports and a likely source is air traffic control radar. In experiments in the vicinity of Richmond, VA, RFI in the form of periodic spikes was recorded, again suggestive of radar. However, in most cases the sources of the RFI are unknown. RFI is a sufficiently common problem that the first step in processing ESTAR data is a screening for RFI (a filter is used to detect large, rapid changes in brightness). Recently, measurements have been made with a new synthetic aperture radiometer, 2D-STAR. Examples of RFI observed simultaneously with ESTAR and the new synthetic aperture radiometer will be presented. 2D-STAR is an airborne instrument designed to develop the technology of aperture synthesis in two dimensions. It employs dual polarized patch antennas arranged in a cross configuration (+). Synthesis in two dimensions offers the potential for optimal thinning, but because of the wide field of view of the individual antennas it is potentially more susceptible to RFI. The 2D-STAR instrument was flown together with ESTAR in a series of test flights on the NASA P-3 aircraft near the Wallops Flight Facility during the summer of 2002. Both instruments experienced RFI over common locations. Examples will be presented and a comparison between instruments presented.

LeVine, David M.↗

Intelligent assistance in scientific data preparation

Scientific data preparation is the process of extracting usable scientific data from raw instrument data. This task involves noise detection (and subsequent noise classification and flagging or removal), extracting data from compressed forms, and construction of derivative or aggregate data (e.g. spectral densities or running averages). A software system called PIPE provides intelligent assistance to users developing scientific data preparation plans using a programming language called Master Plumber. PIPE provides this assistance capability by using a process description to create a dependency model of the scientific data preparation plan. This dependency model can then be used to verify syntactic and semantic constraints on processing steps to perform limited plan validation. PIPE also provides capabilities for using this model to assist in debugging faulty data preparation plans. In this case, the process model is used to focus the developer's attention upon those processing steps and data elements that were used in computing the faulty output values. Finally, the dependency model of a plan can be used to perform plan optimization and run time estimation. These capabilities allow scientists to spend less time developing data preparation procedures and more time on scientific analysis tasks.

Chien, Steve↗

Systems analysis - Key to NASA's data system planning

Critical steps in the systems analysis process for NASA's data system planning are: (1) compilation of future user/mission requirements, (2) development of alternative overall data system concepts which satisfy requirements, (3) assessment of future development and availability of data system technology, and (4) cost/performance tradeoff studies of the alternative concepts for systems optimization. Tasks within the NEEDS (NASA End-to-End Data System) Program, which correspond to the critical steps in this systems analysis process are examined.

Nelson, R. W.↗

Functional Fault Modeling of a Cryogenic System for Real-Time Fault Detection and Isolation

The purpose of this paper is to present the model development process used to create a Functional Fault Model (FFM) of a liquid hydrogen (L H2) system that will be used for realtime fault isolation in a Fault Detection, Isolation and Recover (FDIR) system. The paper explains th e steps in the model development process and the data products required at each step, including examples of how the steps were performed fo r the LH2 system. It also shows the relationship between the FDIR req uirements and steps in the model development process. The paper concl udes with a description of a demonstration of the LH2 model developed using the process and future steps for integrating the model in a live operational environment.

Ferrell, Bob↗

Investigation of correlation classification techniques

A two-step classification algorithm for processing multispectral scanner data was developed and tested. The first step is a single pass clustering algorithm that assigns each pixel, based on its spectral signature, to a particular cluster. The output of that step is a cluster tape in which a single integer is associated with each pixel. The cluster tape is used as the input to the second step, where ground truth information is used to classify each cluster using an iterative method of potentials. Once the clusters have been assigned to classes the cluster tape is read pixel-by-pixel and an output tape is produced in which each pixel is assigned to its proper class. In addition to the digital classification programs, a method of using correlation clustering to process multispectral scanner data in real time by means of an interactive color video display is also described.

Haskell, R. E.↗