Search NASA⌕ Search

SEARCH · Search NASA

Results for “preprocessing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS1993

Adaptive median filtering for preprocessing of time series measurements

A median (L1-norm) filtering program using polynomials was developed. This program was used in automatic recycling data screening. Additionally, a special adaptive program to work with asymmetric distributions was developed. Examples of adaptive median filtering of satellite laser range observations and TV satellite time measurements are given. The program proved to be versatile and time saving in data screening of time series measurements.

Paunonen, Matti↗
NASA NTRS1994

Geometric and radiometric preprocessing of airborne visible/infrared imaging spectrometer (AVIRIS) data in rugged terrain for quantitative data analysis

A geocoding procedure for remotely sensed data of airborne systems in rugged terrain is affected by several factors: buffeting of the aircraft by turbulence, variations in ground speed, changes in altitude, attitude variations, and surface topography. The current investigation was carried out with an Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) scene of central Switzerland (Rigi) from NASA's Multi Aircraft Campaign (MAC) in Europe (1991). The parametric approach reconstructs for every pixel the observation geometry based on the flight line, aircraft attitude, and surface topography. To utilize the data for analysis of materials on the surface, the AVIRIS data are corrected to apparent reflectance using algorithms based on MODTRAN (moderate resolution transfer code).

Meyer, Peter↗
NASA NTRS2001

Preprocessing for Eddy Dissipation Rate and TKE Profile Generation

The Aircraft Vortex Spacing System (AVOSS), a set of algorithms to determine aircraft spacing according to wake vortex behavior prediction, requires turbulence profiles to appropriately determine arrival and departure aircraft spacing. The ambient atmospheric turbulence profile must always be produced, even if the result is an arbitrary (canned) profile. The original turbulence profile code was generated By North Carolina State University and used in a non-real-time environment in the past. All the input parameters could be carefully selected and screened prior to input. Since this code must run in real-time using actual measurements in the field as input, it became imperative to begin a data checking and screening process as part of the real-time implementation. The process described herein is a step towards ensuring that the best possible turbulence profile is always provided to AVOSS. Data fill-ins, constant profiles and arbitrary profiles are used only as a last resort, but are essential to ensure uninterrupted application of AVOSS.

Zak, J. Allen↗
NASA NTRS2002

Intelligent Text Retrieval and Knowledge Acquisition from Texts for NASA Applications: Preprocessing Issues

A system that retrieves problem reports from a NASA database is described. The database is queried with natural language questions. Part-of-speech tags are first assigned to each word in the question using a rule based tagger. A partial parse of the question is then produced with independent sets of deterministic finite state a utomata. Using partial parse information, a look up strategy searches the database for problem reports relevant to the question. A bigram stemmer and irregular verb conjugates have been incorporated into the system to improve accuracy. The system is evaluated by a set of fifty five questions posed by NASA engineers. A discussion of future research is also presented.

Source record↗
NASA NTRS2011

Preprocessing Inconsistent Linear System for a Meaningful Least Squares Solution

Mathematical models of many physical/statistical problems are systems of linear equations. Due to measurement and possible human errors/mistakes in modeling/data, as well as due to certain assumptions to reduce complexity, inconsistency (contradiction) is injected into the model, viz. the linear system. While any inconsistent system irrespective of the degree of inconsistency has always a least-squares solution, one needs to check whether an equation is too much inconsistent or, equivalently too much contradictory. Such an equation will affect/distort the least-squares solution to such an extent that renders it unacceptable/unfit to be used in a real-world application. We propose an algorithm which (i) prunes numerically redundant linear equations from the system as these do not add any new information to the model, (ii) detects contradictory linear equations along with their degree of contradiction (inconsistency index), (iii) removes those equations presumed to be too contradictory, and then (iv) obtain the minimum norm least-squares solution of the acceptably inconsistent reduced linear system. The algorithm presented in Matlab reduces the computational and storage complexities and also improves the accuracy of the solution. It also provides the necessary warning about the existence of too much contradiction in the model. In addition, we suggest a thorough relook into the mathematical modeling to determine the reason why unacceptable contradiction has occurred thus prompting us to make necessary corrections/modifications to the models - both mathematical and, if necessary, physical.

Sen, Syamal K.↗
NASA NTRS2011

Preprocessing in Matlab Inconsistent Linear System for a Meaningful Least Squares Solution

Mathematical models of many physical/statistical problems are systems of linear equations~ Due to measurement and possible human errors/mistakes in modeling/data, as well as due to certain assumptions to reduce complexity, inconsistency (contradiction) is injected into the model, viz. the linear system. While any inconsistent system irrespective of the degree of inconsistency has always a least-squares solution, one needs to check whether an equation is too much inconsistent or, equivalently too much contradictory. Such an equation will affect/distort the least-squares solution to such an extent that renders it unacceptable/unfit to be used in a real-world application. We propose an algorithm which (i) prunes numerically redundant linear equations from the system as these do not add any new information to the model, (ii) detects contradictory linear equations along with their degree of contradiction (inconsistency index), (iii) removes those equations presumed to be too contradictory, and then (iv) obtain the . minimum norm least-squares solution of the acceptably inconsistent reduced linear system. The algorithm presented in Matlab reduces the computational and storage complexities and also improves the accuracy of the solution. It also provides the necessary warning about the existence of too much contradiction in the model. In addition, we suggest a thorough relook into the mathematical modeling to determine the reason why unacceptable contradiction has occurred thus prompting us to make necessary corrections/modifications to the models - both mathematical and, if necessary, physical.

Sen, Symal K.↗
NASA NTRS2018

Independent Component Analysis for Preprocessing Optical Signals in Support of Multi-User Communication

In an effort to construct an optical transceiver for supporting multi-point communication, researchers developed large field-of-view FSO transceivers with wide apertures for facilitating rapid acquisition and optical signal tracking. The design is constructed from fiber-bundle(s) intelligently arranged to provide multiple optical pathways within a single transceiver, with each pathway limited to a particular optical directionality. Because designs with wide apertures are susceptible to receiving several optical signals simultaneously from multiple transmitters, accurately decoding individual signals and achieving true multi-user communication can be difficult. The work detailed in this paper investigated the use of blind source separation techniques, mainly independent component analysis (ICA), to estimate transmitted signals from their observed, combined mixtures sans information. Effects of signal power, format, data rate, wavelength, and turbulence severity on signal separation, as well as signal demodulation accuracy was also analyzed using experimental optical signals and corresponding mixtures. Signal generators, laser sources, turbulence emulator, beam profiler, photodiodes, and oscilloscopes comprised the experiment setup. Optical signals with varying power, format, and wavelength were generated and propagated through turbulence with varying degree severity, and finally received by the fiber-bundle-based optical transceiver. Results demonstrate that an ICA technique can accurately process the combined signals into corresponding individual components. The investigation further identified signal characteristics (e.g., power levels, format, data rate) and turbulence severity under which ICA is unable to accurately perform signal separations.

Optics↗
NASA NTRS2018

Summary of the 1st AIAA Geometry and Mesh Generation Workshop (GMGW-1) and Future Plans

The 1st AIAA Geometry and Mesh Generation Workshop (GMGW-1) was held in conjunction with the AIAA Aviation Forum and Exposition 2017 and in collaboration with the 3rd AIAA Computational Fluid Dynamics (CFD) High Lift Prediction Workshop (HiLiftPW-3). As the first AIAA workshop on these topics, GMGW-1's broad objectives were to assess the current state-of-the art in geometry preprocessing and mesh generation technology as well as software as applied to aircraft and spacecraft systems. The workshop was intended to identify and develop understanding of areas of needed improvement in terms of performance, accuracy, and applicability. It was also to provide a foundation for documenting best practices for geometry preprocessing and mesh generation. The genesis of GMGW-1 is found in the indictments levied against geometry preprocessing and mesh generation - not undeservedly - by the NASA CFD Vision 2030 Study. In order to create a reference against which future progress in geometry preprocessing and mesh generation can be measured, the organizers of GMGW-1, with the assistance of the organizers of HiLiftPW- 3, focused GMGW-1 on generation of meshes of the NASA High Lift Common Research Model (HL-CRM). Some of the generated meshes were provided for use by the participants in HiLiftPW-3. All meshes and the processes by which they were generated were analyzed by GMGW-1 as a first assessment of state of the art practices. The results of GMGW-1 added quantitative detail to known problem areas including geometry modeling, data interoperability, and amount of human intervention. They do provide a clear path toward a vision of geometry preprocessing and mesh generation in the year 2030. The next milepost along this path will be a second workshop.

Chawner, John R.↗
NASA NTRS2019

Analysis Ready Data in Analytics Optimized Data Stores for Analysis of Big Earth Data in the Cloud

Cloud computing offers the possibility of making the analysis of Big Data approachable for a wider community due to affordable access to computing power, an ecosystem of usable tools for parallel processing, and migration of many large datasets to archives in the cloud, allowing data-proximal computing. Generally, data analysis acceleration in the cloud comes from running multiple nodes in a split-combine-apply strategy. Data systems such as the Earth Observing System Data and Information System are in a position to "pre-split" the data by storing them in a data store that is optimized for data parallel computing, i.e., an Analytics-Optimized Data Store (AODS). A variety of approaches to AODS are possible, from highly scalable databases to scalable filesystems to data formats optimized for cloud access (e.g., zarr and cloud-optimized datasets), with the optimal choice dependent on both the types of analysis and the geospatial structure of the data. A key question is how much preprocessing of the data to do, both before splitting and as the first part of the apply step. Again, the geospatial structure of the data and the analysis type influence the decision, with the added complexity of the user type. Trans-disciplinary users who are not well-versed in the nuances of quality-filtering and georeferencing of remote sensing orbit/swath/scene data tend to ask for more highly processed data, relying on the data provider to make sensible decisions on preprocessing parameters. (This accounts for the popularity of "Level 3" gridded data, despite the lower spatial resolution it provides.) In this case, data can be preprocessed before the split, resulting in higher performance in the rest of the "apply" step, which can be transformative for use cases such as interactive data exploration at scale. Discipline researchers who are experienced with remote sensing data often prefer more flexibility in customizing the preprocessing data into Analysis Ready Data, resulting in more need for on-the-fly preprocessing.

Lynnes, Christopher↗
NASA NTRS1973

A new approach to telemetry data processing

An approach for a preprocessing system for telemetry data processing was developed. The philosophy of the approach is the development of a preprocessing system to interface with the main processor and relieve it of the burden of stripping information from a telemetry data stream. To accomplish this task, a telemetry preprocessing language was developed. Also, a hardware device for implementing the operation of this language was designed using a cellular logic module concept. In the development of the hardware device and the cellular logic module, a distributed form of control was implemented. This is accomplished by a technique of one-to-one intermodule communications and a set of privileged communication operations. By transferring this control state from module to module, the control function is dispersed through the system. A compiler for translating the preprocessing language statements into an operations table for the hardware device was also developed. Finally, to complete the system design and verify it, a simulator for the collular logic module was written using the APL/360 system.

Broglio, C. J.↗
NASA NTRS1971

Layered recognition networks that pre-process, classify, and describe

A brief overview is presented of six types of pattern recognition programs that: (1) preprocess, then characterize; (2) preprocess and characterize together; (3) preprocess and characterize into a recognition cone; (4) describe as well as name; (5) compose interrelated descriptions; and (6) converse. A computer program (of types 3 through 6) is presented that transforms and characterizes the input scene through the successive layers of a recognition cone, and then engages in a stylized conversation to describe the scene.

Uhr, L.↗
NASA NTRS1978

On-board compensation for temporal changes in pushbroom scanner detector arrays

The design and operation of pushbroom and mechanical scanners are reviewed in order to determine differences in data preprocessing. Data preprocessing is categorized into spatial registration and radiometric corrections, as well as into systematic versus nonsystematic corrections. The category of nonsystematic radiometric errors due to temporal changes in detector array properties is emphasized as a subject of special interest and a challenging problem for onboard data preprocessing. Concepts for onboard compensation of temporal changes are presented. In particular one concept which uses dark current as an indicator of temperature change for determining gain and offset corrections is shown to have a number of advantages.

Jobson, D. J.↗
NASA NTRS1979

Compensation for atmospheric effects in LANDSAT data

Preprocessing algorithms were developed to remove or reduce the variations in multispectral data caused by variations in Sun angle and by changes in the atmospheric aerosol and water vapor levels. The two most significant algorithms developed by using mathematical models to define interrelations between the required multiplicative and additive correction factors so that just a few statistical characteristics of a LANDSAT distribution model would be sufficient to drive the mathematical model and to calculate the preprocessing corrections are examined. These are the atmospheric correction (ATCOR) computer program and the XSTAR haze correction algorithm. Neither the ATCOR nor the XSTAR algorithm provides an explicit compensation for the effects of changing LANDSAT view angle. Development efforts are underway to address this aspect of the preprocessing problem.

Lambeck, P. F.↗
NASA NTRS1981

Low-cost digital image processing at the University of Oklahoma

Computer assisted instruction in remote sensing at the University of Oklahoma involves two separate approaches and is dependent upon initial preprocessing of a LANDSAT computer compatible tape using software developed for an IBM 370/158 computer. In-house generated preprocessing algorithms permits students or researchers to select a subset of a LANDSAT scene for subsequent analysis using either general purpose statistical packages or color graphic image processing software developed for Apple II microcomputers. Procedures for preprocessing the data and image analysis using either of the two approaches for low-cost LANDSAT data processing are described.

Harrington, J. A., Jr.↗
NASA NTRS1988

Robot Gripper With Signal Processing

Single-chip computer and sensor-circuit chips preprocess sensor data. Self-contained circuitry combines sensor signals for serial digital transmission. Gripping surfaces crossed with grooves for grasping differently shaped objects. Gripper cavities house sensors and preprocessing circuitry. Sensors and preprocessing circuitry in robot gripper reduce amount of data being transmitted between robot controller and gripper. Placement in gripper reduces signal delays and vulnerability to electromagnetic interference.

Killion, Richard R.↗
NASA NTRS1991

Three dimensional unstructured multigrid for the Euler equations

The three dimensional Euler equations are solved on unstructured tetrahedral meshes using a multigrid strategy. The driving algorithm consists of an explicit vertex-based finite element scheme, which employs an edge-based data structure to assemble the residuals. The multigrid approach employs a sequence of independently generated coarse and fine meshes to accelerate the convergence to steady-state of the fine grid solution. Variables, residuals and corrections are passed back and forth between the various grids of the sequence using linear interpolation. The addresses and weights for interpolation are determined in a preprocessing stage using linear interpolation. The addresses and weights for interpolation are determined in a preprocessing stage using an efficient graph traversal algorithm. The preprocessing operation is shown to require a negligible fraction of the CPU time required by the overall solution procedure, while gains in overall solution efficiencies greater than an order of magnitude are demonstrated on meshes containing up to 350,000 vertices. Solutions using globally regenerated fine meshes as well as adaptively refined meshes are given.

Mavriplis, D. J.↗