SEARCH · Search NASA

Results for “data reduction algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

All sources NASA NTRS DOE OSTI

NASA NTRS1986

Topographic mapping from interferometric synthetic aperture radar observations

The production of high-resolution topographic maps derived from interferometric synthetic aperture radar observations of the earth is reported. Topographic maps are typically determined from stereo-pair optical photographs. Vertical relief causes the same terrain to appear in a slightly different projection for differing look angles, and this shift in appearance is interpreted in terms of the height of the terrain. The radar interferometric approach is related to the stereo technique in that the terrain is viewed at two different angles; however, in this case, the angular separation of the antennas is extremely small, on the order of a milliradian or less, as compared to tens of degrees for the optical case. Thus, the geometrical distortion and subsequent rectification correction algorithms are much less severe in the reduction of interferometric data.

Zebker, H. A.↗

NASA NTRS1992

Astronomical data analysis software and systems I; Proceedings of the 1st Annual Conference, Tucson, AZ, Nov. 6-8, 1991

Consideration is given to a definition of a distribution format for X-ray data, the Einstein on-line system, the NASA/IPAC extragalactic database, COBE astronomical databases, Cosmic Background Explorer astronomical databases, the ADAM software environment, the Groningen Image Processing System, search for a common data model for astronomical data analysis systems, deconvolution for real and synthetic apertures, pitfalls in image reconstruction, a direct method for spectral and image restoration, and a discription of a Poisson imagery super resolution algorithm. Also discussed are multivariate statistics on HI and IRAS images, a faint object classification using neural networks, a matched filter for improving SNR of radio maps, automated aperture photometry of CCD images, interactive graphics interpreter, the ROSAT extreme ultra-violet sky survey, a quantitative study of optimal extraction, an automated analysis of spectra, applications of synthetic photometry, an algorithm for extra-solar planet system detection and data reduction facilities for the William Herschel telescope.

Worrall, Diana M.↗

DOE OSTI2025

Identifying Vehicle Signals in Continuous Seismic Data Using Unsupervised Machine-Learning Techniques

Seismic sensors deployed near roadways effectively capture ground vibrations generated by passing vehicles. Although both traditional and machine‐learning algorithms have been utilized for analyzing such signals, independent validation of detected vehicle events remains limited. We applied two unsupervised machine‐learning algorithms, uniform manifold approximation and projection for dimension reduction, and hierarchical density‐based spatial clustering of applications with noise, to continuous seismic data collected along a road on the main campus of Oak Ridge National Laboratory. The algorithms identified seven distinct cluster labels across the entire dataset. By comparing these cluster labels with precipitation records from a nearby weather station and image‐derived labels from a local camera system, we identified one cluster associated with rainfall and another with vehicle activity. Our algorithms identified a greater number of vehicle‐related labels compared to the camera‐derived labels because seismic data are unaffected by poor lighting conditions. The arrival times of the newly detected vehicle signals corresponded well with the road’s speed limit, supporting our findings. Our algorithm outperformed the short‐term average/long‐term average method and k‐means clustering. Our results suggest that seismic data, when analyzed with machine‐learning algorithms, can complement existing vehicle monitoring systems, particularly under challenging environmental conditions.

Chai, Chengping [Oak Ridge National Laboratory (OR↗

NASA NTRS1990

Wide-angle astrometry with the Mark III stellar interferometer

Astrometric measurements made with the Mark III stellar interferometer on five nights in August-September 1988 yielded average formal 1-sigma errors for 12 FK5 stars of 6 mas in declination and 10 mas in right ascension. This improvement in precision over previously reported measurements with this instrument made in 1986 is attributable to several factors: a second 12 m baseline; oriented E-S, was added to the instrument to improve the determination of right ascension; two-color analysis was included in the data-reduction process, along with a new central-fringe identification algorithm using three spectral channels, in order to reduce atmospheric errors; thermal control was greatly improved; and changes were made to observational procedures and hardware to monitor variations in the delay offset due to residual thermal drifts. Approximately half of the new positions are within 50 mas of their FK5 positions. However, an extended series of measurements are needed to ascertain the accuracy that can be achieved by interferometry.

Shao, M.↗

NASA NTRS1995

A phase-stepped point diffraction interferometer using liquid crystals

A new instrument, the liquid crystal point diffraction interferometer (LCPDI), has been developed for the measurement of phase objects. This instrument maintains the compact, robust design of Linnik's point diffraction interferometer (PDI) and adds to it phase stepping capability for quantitative interferogram analysis. The result is a compact, simple to align, environmentally insensitive interferometer capable of accurately measuring optical wavefronts with high data density and with automated data reduction. The design of the LCPDI is briefly discussed. An algorithm is presented for eliminating phase measurement error caused by object beam intensity variation from frame-to-frame. The LCPDI is demonstrated by measuring the temperature distribution across a heated chamber filled with silicone oil. The measured results are compared to independently measured results and show excellent agreement with them. It is expected that this instrument will have application in the fluid sciences as a diagnostic tool, particularly in space based applications where autonomy, robustness, and compactness are desirable qualities. It should also be useful for the testing of optical elements, provided a master is available for comparison.

Mercer, Carolyn R.↗

NASA NTRS1985

An eigensystem realization algorithm for modal parameter identification and model reduction

A method called the eigensystem realization algorithm is developed for modal parameter identification and model reduction of dynamic systems from test data. A new approach is introduced in conjunction with the singular-value decomposition technique to derive the basic formulation of minimum order realization which is an extended version of the Ho-Kalman algorithm. The basic formulation is then transformed into modal space for modal parameter identification. Two accuracy indicators are developed to quantitatively identify the system and noise modes. For illustration of the algorithm, an example is shown using experimental data from the Galileo spacecraft.

Juang, J.-N.↗

NASA NTRSDate not supplied

Applicability of Loads Estimation Techniques Using Sparse Acceleration Sensor Data to Spacecraft Structural Health Monitoring

The use of structural health monitoring systems on spacecraft structures can play a crucial role in ensuring the safety, reliability, and longevity of the structure by gathering and analyzing onboard sensor data. Of specific importance is monitoring for excessive loading at critical interfaces as any off-nominal structural excitations experienced by spacecraft structures can cause early unpredicted high structural life consumption or damage. The availability and cost of flight-certified sensors along with the size of spacecraft structures and allowable payload mass drives the need for a method to estimate loads using sparsely-located sensors. Numerous approaches such as physics-based, statistical learning, and physics-enhanced statistical learning algorithms have gained popularity among structural prognostics applications. However, developing noise-robust prediction models to assess loads and structural life predictions from a sparse multi-sensor data acquisition system can be a challenging task. This paper discusses the evaluation of physics-based versus machine-learning algorithms for predicting loads and structural life at mission critical locations on the spacecraft structure using a finite element loads analysis with the application of simulated noise and noise reduction techniques. To estimate the loads from accelerations, the physics-based algorithm leverages a loads transformation matrix from a Craig-Bampton reduced finite element model. A System Equivalent Reduction Expansion Process (SEREP) and a pseudo-inverse approach are considered to expand from the onboard sensor degrees of freedom to the Craig-Bampton model degrees of freedom. The machine learning algorithm provides a data driven solution/mapping of the sensor accelerations to the loads at the mission critical locations using a high dimensionality analysis. Although these strategies produce comparable loads prediction without noise, the limitations of these strategies with incorporating simulated noise and noise reduction techniques with low signal to noise ratio signals are evaluated. The study demonstrates the immense potential of statistical learning algorithms for sparse structural prognostic models and enhancing signal denoising techniques. These findings also highlight the need for noise-resilient prognostic models and low-noise data acquisition systems onboard spacecraft structures.

Spacecraft Structural Health Monitoring↗

DOE OSTI2024

Algorithms for Non-Negative Matrix Factorization on Noisy Data With Negative Values

Non-negative matrix factorization (NMF) is a dimensionality reduction technique that has shown promise for analyzing noisy data, especially astronomical data. For these datasets, the observed data may contain negative values due to noise even when the true underlying physical signal is strictly positive. Prior NMF work has not treated negative data in a statistically consistent manner, which becomes problematic for low signal-to-noise data with many negative values. In this paper we present two algorithms, Shift-NMF and Nearly-NMF, that can handle both the noisiness of the input data and also any introduced negativity. Both of these algorithms use the negative data space without clipping or masking and recover non-negative signals without any introduced positive offset that occurs when clipping or masking negative data. We demonstrate this numerically on both simple and more realistic examples, and prove that both algorithms have monotonically decreasing update rules.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NASA NTRS1985

An Eigensystem Realization Algorithm (ERA) for modal parameter identification and model reduction

A method, called the Eigensystem Realization Algorithm (ERA), is developed for modal parameter identification and model reduction of dynamic systems from test data. A new approach is introduced in conjunction with the singular value decomposition technique to derive the basic formulation of minimum order realization which is an extended version of the Ho-Kalman algorithm. The basic formulation is then transformed into modal space for modal parameter identification. Two accuracy indicators are developed to quantitatively identify the system modes and noise modes. For illustration of the algorithm, examples are shown using simulation data and experimental data for a rectangular grid structure.

Juang, J. N.↗

NASA NTRS1972

Application of Avco data analysis and prediction techniques (ADAPT) to prediction of sunspot activity

The results are presented of the application of Avco Data Analysis and Prediction Techniques (ADAPT) to derivation of new algorithms for the prediction of future sunspot activity. The ADAPT derived algorithms show a factor of 2 to 3 reduction in the expected 2-sigma errors in the estimates of the 81-day running average of the Zurich sunspot numbers. The report presents: (1) the best estimates for sunspot cycles 20 and 21, (2) a comparison of the ADAPT performance with conventional techniques, and (3) specific approaches to further reduction in the errors of estimated sunspot activity and to recovery of earlier sunspot historical data. The ADAPT programs are used both to derive regression algorithm for prediction of the entire 11-year sunspot cycle from the preceding two cycles and to derive extrapolation algorithms for extrapolating a given sunspot cycle based on any available portion of the cycle.

Hunter, H. E.↗

NASA NTRS2004

Microwave Observations of Precipitation and the Atmosphere

This research effort had three elements devoted to improving satellite-derived passive microwave retrievals of precipitation rate: morphological rain-rate retrievals, warm rain retrievals, and extension of a study of geostationary satellite options. The morphological precipitation-rate retrieval method uses for the first time the morphological character of the observed storm microwave spectra. The basic concept involves: 1) retrieval of point rainfall rates using current algorithms, 2) using spatial feature vectors of the observations over segmented multi-pixel storms to estimate the integrated rainfall rate for that storm (cu m/s), and 3) normalization of the point rain-rate retrievals to ensure consistency with the storm-wide retrieval. This work is ongoing, but two key steps have been completed: development of a segmentation algorithm for defining spatial regions corresponding to single storms for purposes of estimation, and reduction of some of the data from NAST-M that will be used to support this research going forward. The warm rain retrieval method involved extension of Aquai/AIRS/AMSU/HSB algorithmic work on cloud water retrievals. The central concept involves the fact that passive microwave cloud water retrievals over approx. 0.4 mm are very likely associated with precipitation. Since glaciated precipitation is generally detected quite successfully using scattering signatures evident in the surface-blind 54- and 183-GHz bands, this new method complements the first by permitting precipitation retrievals of non-glaciated events. The method is most successful over ocean, but has detected non-glaciated convective cells over land, perhaps in their early formative stages. This work will require additional exploration and validation prior to publication. Passive microwave instrument configurations for use in geostationary orbit were studied. They employ parabolic reflectors between 2 and 4 meters in diameter, and frequencies up to approx.430 GHz; this corresponds to nadir spot diameters as small as 10 km.

Staelin, David H.↗

NASA NTRS1972

An efficient algorithm using matrix methods to solve wind tunnel force-balance equations

An iterative procedure applying matrix methods to accomplish an efficient algorithm for automatic computer reduction of wind-tunnel force-balance data has been developed. Balance equations are expressed in a matrix form that is convenient for storing balance sensitivities and interaction coefficient values for online or offline batch data reduction. The convergence of the iterative values to a unique solution of this system of equations is investigated, and it is shown that for balances which satisfy the criteria discussed, this type of solution does occur. Methods for making sensitivity adjustments and initial load effect considerations in wind-tunnel applications are also discussed, and the logic for determining the convergence accuracy limits for the iterative solution is given. This more efficient data reduction program is compared with the technique presently in use at the NASA Langley Research Center, and computational times on the order of one-third or less are demonstrated by use of this new program.

Smith, D. L.↗

DOE OSTI2026

Maximizing efficiency of dataset compression for machine learning potentials with information theory

Machine learning interatomic potentials (MLIPs) balance high accuracy and lower costs compared to density functional theory calculations, but their performance often depends on the size and diversity of training datasets. Large datasets improve model accuracy and generalization but are computationally expensive to produce and train on, while smaller datasets risk discarding rare but important atomic environments and compromising MLIP accuracy/reliability. Here, we develop an information-theoretical framework to quantify the efficiency of dataset compression methods and propose an algorithm that maximizes this efficiency. By framing atomistic dataset compression as an instance of the minimum set cover (MSC) problem over atom-centered environments, our method identifies the smallest subset of structures that contains as much information as possible from the original dataset while pruning redundant information. The approach is extensively demonstrated on the GAP-20 and TM23 datasets and validated on 64 varied datasets from the ColabFit repository. Across all cases, MSC consistently retains outliers, preserves dataset diversity, and reproduces the long-tail distributions of forces even at high compression rates, outperforming other subsampling methods. Furthermore, MLIPs trained on MSC-compressed datasets exhibit reduced error for out-of-distribution data even in low-data regimes. We explain these results using an outlier analysis and show that such quantitative conclusions could not be achieved with conventional dimensionality reduction methods. The algorithm is implemented in the open-source QUESTS package and can be used for several tasks in atomistic modeling, from data subsampling, outlier detection, and training improved MLIPs at a lower cost.

36 MATERIALS SCIENCE↗

DOE OSTI2025

An investigation on machine learning predictive accuracy improvement and uncertainty reduction using VAE-based data augmentation

The confluence of ultrafast computers with large memory, rapid progress in Machine Learning (ML) algorithms, and the availability of large datasets place multiple engineering fields at the threshold of dramatic progress. However, a unique challenge in nuclear engineering is data scarcity because experimentation on nuclear systems is usually more expensive and time-consuming than most other disciplines. One potential way to resolve the data scarcity issue is deep generative learning, which uses certain ML models to learn the underlying distribution of existing data and generate synthetic samples that resemble the real data. In this way, one can significantly expand the dataset to train more accurate predictive ML models. In this study, our objective is to evaluate the effectiveness of data augmentation using variational autoencoder (VAE)-based deep generative models. We investigated whether the data augmentation leads to improved accuracy in the predictions of a deep neural network (DNN) model trained using the augmented data. Additionally, the DNN prediction uncertainties are quantified using Bayesian Neural Networks (BNN) and conformal prediction (CP) to assess the impact on predictive uncertainty reduction. To test the proposed methodology, we used TRACE simulations of steady-state void fraction data based on the NUPEC Boiling Water Reactor Full-size Fine-mesh Bundle Test (BFBT) benchmark. Here, we found that augmenting the training dataset using VAEs has improved the DNN model’s predictive accuracy, improved the prediction confidence intervals, and reduced the prediction uncertainties.

Bayesian neural network↗

NASA NTRS1975

A least mean squares CUBIC algorithm for on-line differential of sampled analog signals

A digital computer algorithm is developed for on-line time differentiation of sampled analog voltage signals. The derivative is obtained by employing a least mean squares technique. The recursive algorithm results in a considerable reduction in computer time compared to a complete new solution of the normal equations each time a new data point is accepted. Implementation of the algorithm on a digital computer is discussed. Examples are simulated on a DEC PDP-8 computer.

Allum, J. H. J.↗

NASA NTRSDate not supplied

Experimental Testing of Advanced Generalized Predictive Control for Stability Augmentation and Vibration Reduction of Tiltrotor Aircraft

Generalized Predictive Control (GPC) is an advanced form of an adaptive control algorithm that uses experimentally acquired data to determine the input-output relationship of complex systems through a process called system identification (system ID). GPC has historically been applied to wind tunnel tests of dynamically-scaled tiltrotor aircraft for stability augmentation and vibration reduction since the complex nature of these dynamic systems does not lend itself well to traditional control theory. Advanced GPC (AGPC) improves upon traditional GPC by enabling self-adaptation as conditions change from those used to acquire the system ID and controller performance would normally erode. The present research expands upon previous analytical development and demonstration of AGPC with experimental demonstration. To support AGPC, this present work also identifies and describes figures of merit that define a good working controller and quantifies the uniqueness of the control inputs and quality of the system ID parameters. The present research demonstrates that AGPC consistently performs better than traditional GPC and can successfully adapt to changing conditions.

Active Controls↗

NASA NTRSDate not supplied

Experimental Testing of Advanced Generalized Predictive Control for Stability Augmentation and Vibration Reduction of Tiltrotor Aircraft

Active Controls↗

NASA NTRS1974

A priori estimate of the quality of a data compression system based on statistical characteristics of the sensors used

Knowledge of the composition and certain statistical characteristics of the output signals of the scientific instruments on board a space vehicle allows determination of possible signal processing algorithms in the system and to evaluate the prospects for utilization of data reduction. A method is presented to estimate the compression factor of an on-board data collection and processing system with known mean activities of the sensors used and unknown mutual correlation of their output signals.

Khodarev, Y. K.↗