Search NASA⌕ Search

SEARCH · Search NASA

Results for “processing algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Developing a Machine-Learning-Based Processing Framework for Twitter and Other Crowdsourced Data

Crowdsourced data streams such as Twitter and other social media are important sources of real-time and historical global information for Earth science applications. At the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), we have been exploring the Twitter data stream for its potential in augmenting the validation program of NASA's Global Precipitation Measurement (GPM) mission. To realize this potential, we need to increase the information density and enhance the quality of filtered precipitation tweets. We have implemented various components of a machine learning (ML)-based processing infrastructure for crowdsourced data that outputs, in this instance, useful and usable information derived from precipitation tweets. We have test enriched the Twitter stream with higher quality active tweets from those knowingly contributing to our effort and from existing crowdsourced programs (e.g., mPING, CoCoRaHS). We have experimented with various algorithms for processing tweets, including Naà ve Bayes, Convolutional Neural Network (CNN), Hierarchical Attention Network (HAN), and semi-supervised learning (with tri-training). Our current work focuses on (1) automated review of Earth science-related publications to determine relationships between discipline research needs and ML algorithms; (2) investigating Sequential Generative Adversarial Network (SeqGAN) for processing precipitation tweets for anomaly detection; and (3) managing crowdsourced data in a way that is compatible with existing NASA satellite data archives and using the data for ML applications. Key results include (1) network visualization of NLP-processed publications in various Earth science disciplines; (2) difference between GPM-linked, generated tweets and collected actual tweets that is small for GPM-determined light to moderate rain cases and high for GPM-determined heavy rain cases; and (3) identification of MongoDB for storing raw tweets and Zarr format for gridded tweets (compatible with GPM data). Our results have taken us a step closer to an operational ML-based tweet processing infrastructure and have already demonstrated that tweet-derived precipitation information is potentially useful for validation of Earth science satellite data.

Teng, William↗

Improvements In Processing And Aiming For Squint-Mode SAR

Improved technique for aiming antenna of synthetic-aperture radar (SAR) operating in squint imaging mode (SIM) complements improved algorithm for processing raw SIM SAR data. Developed to reduce deleterious effects of two unique characteristics of SIM SAR: large range walk and large variation of Doppler centroid as function of range.

Chang, Chi Y.↗

Prognostics of Power Mosfets Under Thermal Stress Accelerated Aging Using Data-Driven and Model-Based Methodologies

An approach for predicting remaining useful life of power MOSFETs (metal oxide field effect transistor) devices has been developed. Power MOSFETs are semiconductor switching devices that are instrumental in electronics equipment such as those used in operation and control of modern aircraft and spacecraft. The MOSFETs examined here were aged under thermal overstress in a controlled experiment and continuous performance degradation data were collected from the accelerated aging experiment. Dieattach degradation was determined to be the primary failure mode. The collected run-to-failure data were analyzed and it was revealed that ON-state resistance increased as die-attach degraded under high thermal stresses. Results from finite element simulation analysis support the observations from the experimental data. Data-driven and model based prognostics algorithms were investigated where ON-state resistance was used as the primary precursor of failure feature. A Gaussian process regression algorithm was explored as an example for a data-driven technique and an extended Kalman filter and a particle filter were used as examples for model-based techniques. Both methods were able to provide valid results. Prognostic performance metrics were employed to evaluate and compare the algorithms.

Electrolytic capacitors↗

Addressing and Presenting Quality of Satellite Data via Web-Based Services

With the recent attention to climate change and proliferation of remote-sensing data utilization, climate model and various environmental monitoring and protection applications have begun to increasingly rely on satellite measurements. Research application users seek good quality satellite data, with uncertainties and biases provided for each data point. However, different communities address remote sensing quality issues rather inconsistently and differently. We describe our attempt to systematically characterize, capture, and provision quality and uncertainty information as it applies to the NASA MODIS Aerosol Optical Depth data product. In particular, we note the semantic differences in quality/bias/uncertainty at the pixel, granule, product, and record levels. We outline various factors contributing to uncertainty or error budget; errors. Web-based science analysis and processing tools allow users to access, analyze, and generate visualizations of data while alleviating users from having directly managing complex data processing operations. These tools provide value by streamlining the data analysis process, but usually shield users from details of the data processing steps, algorithm assumptions, caveats, etc. Correct interpretation of the final analysis requires user understanding of how data has been generated and processed and what potential biases, anomalies, or errors may have been introduced. By providing services that leverage data lineage provenance and domain-expertise, expert systems can be built to aid the user in understanding data sources, processing, and the suitability for use of products generated by the tools. We describe our experiences developing a semantic, provenance-aware, expert-knowledge advisory system applied to NASA Giovanni web-based Earth science data analysis tool as part of the ESTO AIST-funded Multi-sensor Data Synergy Advisor project.

Leptoukh, Gregory↗

Digital CODEC for real-time processing of broadcast quality video signals at 1.8 bits/pixel

Advances in very large-scale integration and recent work in the field of bandwidth efficient digital modulation techniques have combined to make digital video processing technically feasible and potentially cost competitive for broadcast quality television transmission. A hardware implementation was developed for a DPCM-based digital television bandwidth compression algorithm which processes standard NTSC composite color television signals and produces broadcast quality video in real time at an average of 1.8 bits/pixel. The data compression algorithm and the hardware implementation of the CODEC are described, and performance results are provided.

Shalkhauser, Mary JO↗

Filtering flight data prior to aerodynamic system identification

An algorithm for processing flight-test data to provide state estimates and instrument calibrations for aerodynamic or hydrodynamic system identification by the equation error estimation method is developed and demonstrated on synthesized data. The extended-Kalman-filter algorithm employs a locally level, north-pointing frame of reference, accounts for rotating ellipsoidal earth effects, and estimates sensor bias, scale factors, wind components, and process noise levels by maximum-likelihood parameters. The method is found to be most effective with navigation quality inertial input data. The algorithm is applied to data from a six-degree-of-freedom F-4 aircraft simulation and shown to produce state estimates in good agreement with the simulation values.

Trankle, T. L.↗

Ozone determinations with the NOAA SBUV/2 system

The NOAA satellite ozone monitoring program was initiated by the National Environmental Satellite Data and Information Service (NESDIS) in December 1984, with the launch of the NOAA-9 spacecraft carrying the first operational Solar Backscatter Ultraviolet Spectrometer (SBUV/2). This instrument and its successor on NOAA-11, launched in 1988, are similar to the SBUV instrument launched by the NASA in 1978 on the Nimbus-7 research spacecraft. Measurements by the SBUV and SBUV/2 instruments overlap beginning in 1985. These instruments use measurements of the reflected ultraviolet solar radiation from the atmosphere to derive total ozone amounts and ozone vertical profiles. Since launch, the NOAA instruments and the derived products have been undergoing extensive evaluation by scientists of NOAA and NASA. Measurements obtained with these instruments are processed in real time by the NESDIS. These are reprocessed as the SBUV/2 instrument characterization is refined and as the retrieval algorithm for processing the data is improved. The NOAA-9 ozone data archive begins in March 1985 and continues through October 1990. The archive of NOAA-11 data begins in January 1989 and the data continues to be acquired in 1992.

Planet, Walter G.↗

EOS MLS Science Data Processing System: A Description of Architecture and Capabilities

This paper describes the architecture and capabilities of the Science Data Processing System (SDPS) for the EOS MLS. The SDPS consists of two major components--the Science Computing Facility and the Science Investigator-led Processing System. The Science Computing Facility provides the facilities for the EOS MLS Science Team to perform the functions of scientific algorithm development, processing software development, quality control of data products, and scientific analyses. The Science Investigator-led Processing System processes and reprocesses the science data for the entire mission and delivers the data products to the Science Computing Facility and to the Goddard Space Flight Center Earth Science Distributed Active Archive Center, which archives and distributes the standard science products.

Microwave Limb Sounder (MLS)↗

Control Software for a High-Performance Telerobot

A computer program for controlling a high-performance, force-reflecting telerobot has been developed. The goal in designing a telerobot-control system is to make the velocity of the slave match the master velocity, and the environmental force on the master match the force on the slave. Instability can arise from even small delays in propagation of signals between master and slave units. The present software, based on an impedance-shaping algorithm, ensures stability even in the presence of long delays. It implements a real-time algorithm that processes position and force measurements from the master and slave and represents the master/slave communication link as a transmission line. The algorithm also uses the history of the control force and the slave motion to estimate the impedance of the environment. The estimate of the impedance of the environment is used to shape the controlled slave impedance to match the transmission-line impedance. The estimate of the environmental impedance is used to match the master and transmission-line impedances and to estimate the slave/environment force in order to present that force immediately to the operator via the master unit.

Kline-Schoder, Robert J.↗

Algorithms and programming tools for image processing on the MPP

Topics addressed include: data mapping and rotational algorithms for the Massively Parallel Processor (MPP); Parallel Pascal language; documentation for the Parallel Pascal Development system; and a description of the Parallel Pascal language used on the MPP.

Reeves, A. P.↗

Digital CODEC for real-time processing of broadcast quality video signals at 1.8 bits/pixel

Advances in very large scale integration and recent work in the field of bandwidth efficient digital modulation techniques have combined to make digital video processing technically feasible an potentially cost competitive for broadcast quality television transmission. A hardware implementation was developed for DPCM (differential pulse code midulation)-based digital television bandwidth compression algorithm which processes standard NTSC composite color television signals and produces broadcast quality video in real time at an average of 1.8 bits/pixel. The data compression algorithm and the hardware implementation of the codec are described, and performance results are provided.

Shalkhauser, Mary JO↗

A comparison of discrete linear filtering algorithms.

Seven filter algorithms were presented in a recent survey paper (Kaminski, 1971), and were compared computationally (operations count) when relatively few observations were to be processed. These algorithms are now elaborated further. Details of the computations are presented, and it is shown that for problems with even moderately large amounts of data, the information matrix and square-root information matrix formulations are computationally more efficient than the other methods considered (conventional Kalman, stabilized Kalman, and square-root covariance mechanizations). It is pointed out that Schmidt's matrix factorization-Householder transformation technique leads to the same equations as those obtained via Potter's method. Several improvements in the equation mechanization are given.

Bierman, G. J.↗

Algorithms for software development version control and change detection

Simple computer algorithms for processing source program and text data files in order to extract change detection, version control, version history, and current status information are described. These algorithms presuppose that it is possible to attach to each record of the source files a 6-character code, placed within delimiters that will cause the compiler, or other using program, to ignore this code field. The code contains a 2-character code for a character-by-character position-sensitive checksum of the record, another for the record number in the file, and a third for the data on which the encoding took place. Once the source file has been thus encoded, it is possible to detect the following transactions on the file since the most recent version coding; (1) addition of new records (having no version code), (2) modification of existing records, (3) deletion of a number of records, (4) movement and/or duplication of existing records, and (5) modification and duplication of records. In addition, it is possible to extract a version history of the number of records created or modified by date. A special file listing program is described which prints the file records without showing the version codes, but places a "change bar" at the right margin whenever a change is detected. The program also provides a list of changed pages and a version history.

Tausworthe, R. C.↗

A solution-adaptive mesh algorithm for dynamic/static refinement of two and three dimensional grids

An adaptive grid algorithm has been developed in two and three dimensions that can be used dynamically with a solver or as part of a grid refinement process. The algorithm employs a transformation from the Cartesian coordinate system to a general coordinate space, which is defined as a parallelepiped in three dimensions. A weighting function, independent for each coordinate direction, is developed that will provide the desired refinement criteria in regions of high solution gradient. The adaptation is performed in the general coordinate space and the new grid locations are returned to the Cartesian space via a simple, one-step inverse mapping. The algorithm for relocation of the mesh points in the parametric space is based on the center of mass for distributed weights. Dynamic solution-adaptive results are presented for laminar flows in two and three dimensions.

Benson, Rusty A.↗

Developing Fast and Accurate Radiative Transfer Models to Meet the Needs of Modern Satellite Remote Sensing Applications

Modern hyperspectral satellite remote sensors provide highly accurate measurements the Earth’s Top-of-Atmosphere (TOA) radiance, reflectance, or polarized spectra with hundreds to thousands of spectral channels and with millions of observations per day. The large data volume and high spectral dimensionality of the data pose challenges for retrieval algorithms. To process the satellite Level-1 data (e.g. calibrated TOA spectra) into Level-2 products (e.g. atmospheric and surface properties) using physical-based retrieval algorithms, accurate and fast Radiative Transfer Models (RTMs) are needed. RTMs are usually the limiting factor in determining the speed of a level-2 algorithm. For example, more than one million Line-by-Line (LBL) radiative transfer (RT) calculations are needed in order to properly capture the spectral contributions of important atmospheric molecules for an IR hyperspectral sensor with a spectral coverage from 3.5 m to 15 m or a solar hyperspectral sensor with spectral coverage from 0.25 m to 2.5 m. In this presentation, we will discuss advantages and disadvantages of different ways (e.g. correlated k and effective transmittance) to accelerate the speed of a fast RTM. We finally describe a Principal Component-based Radiative Transfer Model (PCRTM), which can calculate TOA radiance or reflectance spectra from 50 cm-1 to 40,000 cm-1 (200 m to 0.25 m). It has demonstrated very good accuracy relative to reference LBL RTMs and saves orders of magnitude in computational time. The PCRTM has been used in many satellite remote sensing applications. Examples include forward modeling in Level-2 and Level-3 retrieval algorithms, high fidelity satellite instrument simulators and instrument performance trade studies, spectral and radiometric accuracy characterizations of satellite Level-1 data, tools for inter-satellite calibrations, tools for satellite RTM lookup table generations, and tools for generating physically based training datasets for Artificial Intelligence (AI) algorithms.

climate data record↗

Assistant for Analyzing Tropical-Rain-Mapping Radar Data

A document is defined that describes an approach for a Tropical Rain Mapping Radar Data System (TDS). TDS is composed of software and hardware elements incorporating a two-frequency spaceborne radar system for measuring tropical precipitation. The TDS would be used primarily in generating data products for scientific investigations. The most novel part of the TDS would be expert-system software to aid in the selection of algorithms for converting raw radar-return data into such primary observables as rain rate, path-integrated rain rate, and surface backscatter. The expert-system approach would address the issue that selection of algorithms for processing the data requires a significant amount of preprocessing, non-intuitive reasoning, and heuristic application, making it infeasible, in many cases, to select the proper algorithm in real time. In the TDS, tentative selections would be made to enable conversions in real time. The expert system would remove straightforwardly convertible data from further consideration, and would examine ambiguous data, performing analysis in depth to determine which algorithms to select. Conversions performed by these algorithms, presumed to be correct, would be compared with the corresponding real-time conversions. Incorrect real-time conversions would be updated using the correct conversions.

James, Mark↗