Search NASA⌕ Search

SEARCH · Search NASA

Results for “data reduction methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
NASA NTRS2023

The Impact of Dimensionality Reduction of Ion Counts Distributions on Preserving Moments, With Applications to Data Compression

The field of space physics has a long history of utilizing dimensionality reduction methods to distill data, including but not limited to spherical harmonics, the Fourier Transform, and the wavelet transform. Here, we present a technique for performing dimensionality reduction on ion counts distributions from the Multiscale Mission/Fast Plasma Investigation (MMS/FPI) instrument using a data-adaptive method powered by neural networks. This has applications to both feeding low-dimensional parameterizations of the counts distributions into other machine learning algorithms, and the problem of data compression to reduce transmission volume for space missions. The algorithm presented here is lossy, and in this work, we present the technique of validating the reconstruction performance with calculated plasma moments under the argument that preserving the moments also preserves fluid-level physics, and in turn a degree of scientific validity. The method presented here is an improvement over other lossy compressions in loss-tolerant scenarios like the Multiscale Mission/Fast Plasma Investigation Fast Survey or in non-research space weather applications.

D. da Silva↗
NASA NTRS1998

Versatile Software Package For Near Real-Time Analysis of Experimental Data

This paper provides an overview of a versatile software package developed for time- and frequency-domain analyses of experimental wind-tunnel data. This package, originally developed for analyzing data in the NASA Langley Transonic Dynamics Tunnel (TDT), is applicable for analyzing any time-domain data. A Matlab-based software package, TDT-analyzer, provides a compendium of commonly-required dynamic analysis functions in a user-friendly interactive and batch processing environment. TDT-analyzer has been used extensively to provide on-line near real-time and post-test examination and reduction of measured data acquired during wind tunnel tests of aeroelastically-scaled models of aircraft and rotorcraft as well as a flight test of the NASA High Alpha Research Vehicle (HARV) F-18. The package provides near real-time results in an informative and timely manner far exceeding prior methods of data reduction at the TDT.

Wieseman, Carol D.↗
NASA NTRS2000

Dimension Reduction of Hyperspectral Data on Beowulf Clusters

Traditional remote sensing instruments are multispectral, where observations are collected at a few different spectral bands. Recently, many hyperspectral instruments, that can collect observations at hundreds of bands, have been operation. Furthermore, there have been ongoing research efforts on ultraspectral instruments that can produce observations at thousands of spectral bands. While these remote sensing technology developments hold a great promise for new findings in the area of Earth and space science, they present many challenges. These include the need for faster processing of such increased data volumes, and methods for data reduction. Dimension Reduction is a spectral transformation, which is used widely in remote sensing, is the Principal Components Analysis (PCA). In light of the growing number of spectral channels of modern instruments, the paper reports on the development of a parallel PCA and its implementation on two Beowulf cluster configurations, on with fast Ethernet switch and the other is with a Myrinet interconnection.

El-Ghazawi, Tarek↗
DOE OSTI2024

Beyond PCA: Additional Dimension Reduction Techniques to Consider in the Development of Climate Fingerprints

Abstract Dimension reduction techniques are an essential part of the climate analyst’s toolkit. Due to the enormous scale of climate data, dimension reduction methods are used to identify major patterns of variability within climate dynamics, to create compelling and informative visualizations, and to quantify major named modes such as El Niño–Southern Oscillation. Principal components analysis (PCA), also known as the method of empirical orthogonal functions (EOFs), is the most commonly used form of dimension reduction, characterized by a remarkable confluence of attractive mathematical, statistical, and computational properties. Despite its ubiquity, PCA suffers from several difficulties relevant to climate science: high computational burden with large datasets, decreased statistical accuracy in high dimensions, and difficulties comparing across multiple datasets. In this paper, we introduce several variants of PCA that are likely to be of use in climate sciences and address these problems. Specifically, we introduce non-negative , sparse , and tensor PCA and demonstrate how each approach provides superior pattern recognition in climate data. We also discuss approaches to comparing PCA-family results within and across datasets in a domain-relevant manner. We demonstrate these approaches through an analysis of several runs of the E3SM climate model from 1991 to 1995, focusing on the simulated response to the Mt. Pinatubo eruption; our findings are consistent with a recently identified stratospheric warming fingerprint associated with this type of stratospheric aerosol injection.

Weylandt, Michael↗
DOE OSTI2021

Detailed in situ ATR-FTIR spectroscopy study of the early stages of C-S-H formation during hydration of monoclinic C3S

The early stages of tricalcium silicate hydration has been studied by in situ ATR-FTIR spectroscopy. A method for data reduction based on background correction and subtraction of spectra of pure components is presented, which makes it possible to describe the kinetic evolution of the calcium silicate hydrate phase upon hydration with great detail. The results obtained are in full agreement with recently reported, detailed solid-state NMR spectroscopy measurements. As ATR-FTIR spectroscopy does not require any isotope enrichment in order to increase the signal intensities and is a widely available technique, we suggest that our study opens up an avenue towards detailed in situ characterization of hydrating cementitious systems and hydrating systems in general.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Studies on the response of a water-Cherenkov detector of the Pierre Auger Observatory to atmospheric muons using an RPC hodoscope

Extensive air showers, originating from ultra-high energy cosmic rays, have been successfully measured through the use of arrays of water-Cherenkov detectors (WCDs). Sophisticated analyses exploiting WCD data have made it possible to demonstrate that shower simulations, based on different hadronic-interaction models, cannot reproduce the observed number of muons at the ground. The accurate knowledge of the WCD response to muons is paramount in establishing the exact level of this discrepancy. In this work, we report on a study of the response of a WCD of the Pierre Auger Observatory to atmospheric muons performed with a hodoscope made of resistive plate chambers (RPCs), enabling us to select and reconstruct nearly 600 thousand single muon trajectories with zenith angles ranging from 0$^\circ$ to 55$^\circ$. Comparison of distributions of key observables between the hodoscope data and the predictions of dedicated simulations allows us to demonstrate the accuracy of the latter at a level of 2%. As the WCD calibration is based on its response to atmospheric muons, the hodoscope data are also exploited to show the long-term stability of the procedure.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Operation of the ATLAS trigger system in Run 2

The ATLAS experiment at the Large Hadron Collider employs a two-level trigger system to record data at an average rate of 1 kHz from physics collisions, starting from an initial bunch crossing rate of 40 MHz. During the LHC Run 2 (2015–2018), the ATLAS trigger system operated successfully with excellent performance and flexibility by adapting to the various run conditions encountered and has been vital for the ATLAS Run-2 physics programme. For proton-proton running, approximately 1500 individual event selections were included in a trigger menu which specified the physics signatures and selection algorithms used for the data-taking, and the allocated event rate and bandwidth. The trigger menu must reflect the physics goals for a given data collection period, taking into account the instantaneous luminosity of the LHC and limitations from the ATLAS detector readout, online processing farm, and offline storage. This document discusses the operation of the ATLAS trigger system during the nominal proton-proton data collection in Run 2 with examples of special data-taking runs. Aspects of software validation, evolution of the trigger selection algorithms during Run 2, monitoring of the trigger system and data quality as well as trigger configuration are presented.

43 PARTICLE ACCELERATORS↗
DOE OSTI2021

The continuous readout stream of the MicroBooNE liquid argon time projection chamber for detection of supernova burst neutrinos

The MicroBooNE continuous readout stream is a parallel readout of the MicroBooNE liquid argon time projection chamber (LArTPC) which enables detection of non-beam events such as those from a supernova neutrino burst. The low energies of the supernova neutrinos and the intense cosmic-ray background flux due to the near-surface detector location makes triggering on these events very challenging. Instead, MicroBooNE relies on a delayed trigger generated by SNEWS (the Supernova Early Warning System) for detecting supernova neutrinos. The continuous readout of the LArTPC generates large data volumes, and requires the use of real-time compression algorithms (zero suppression and Huffman compression) implemented in an FPGA (field-programmable gate array) in the readout electronics. In this paper we present the results of the optimization of the data reduction algorithms, and their operational performance. To demonstrate the capability of the continuous stream to detect low-energy electrons, a sample of Michel electrons from stopping cosmic-ray muons is reconstructed and compared to a similar sample from the lossless triggered readout stream.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Machine learning on FPGA for event selection

Real-time data processing is a frontier field in experimental particle physics. The application of FPGAs at the trigger level is used by many current and planned experiments (CMS, LHCb, Belle2, PANDA). Usually they use conventional processing algorithms. LHCb has implemented Machine Learning (ML) elements for real-time data processing with a triggered readout system that runs most of the ML algorithms on a computer farm. The work described in this article aims to test the ML-FPGA algorithms for streaming data acquisition. Herein, there are many experiments working in this area and they have a lot in common, but there are many specific solutions for detector and accelerator parameters that are worth exploring further. This report describes the purpose of the work and progress in evaluating the ML-FPGA application.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Performance of the local reconstruction algorithms for the CMS hadron calorimeter with Run 2 data

A description is presented of the algorithms used to reconstruct energy deposited in the CMS hadron calorimeter during Run 2 (2015–2018) of the LHC. During Run 2, the characteristic bunch-crossing spacing for proton-proton collisions was 25 ns, which resulted in overlapping signals from adjacent crossings. The energy corresponding to a particular bunch crossing of interest is estimated using the known pulse shapes of energy depositions in the calorimeter, which are measured as functions of both energy and time. A variety of algorithms were developed to mitigate the effects of adjacent bunch crossings on local energy reconstruction in the hadron calorimeter in Run 2, and their performance is compared.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

DENNIS: a design and analysis tool for dynamic material x-ray diffraction experiments

We present DENNIS (Diffraction Experiment desigN and aNalysiS): a graphical software tool useful for the design and analysis of dynamic x-ray diffraction experiments, such as those performed on the Z Pulsed Power Facility, Thor Pulsed Power Generator, and Dynamic Compression Sector (DCS) of the Advanced Photon Source. DENNIS provides rapid powder and single-crystal diffraction pattern predictions and powder diffraction pattern image integration in three-dimensional geometries. Additional features include crystallographic information file reading, image processing, and synthetic diffraction pattern image generation. We overview the software's capabilities, detail the prediction and integration methodologies, and provide example implementations on Z and DCS experiments.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Embedded FPGA developments in 130 nm and 28 nm CMOS for machine learning in particle detector readout

Embedded field programmable gate array (eFPGA) technology allows the implementation of reconfigurable logic within the design of an application-specific integrated circuit (ASIC). This approach offers the low power and efficiency of an ASIC along with the ease of FPGA configuration, particularly beneficial for the use case of machine learning in the data pipeline of next-generation collider experiments. An open-source framework called "FABulous" was used to design eFPGAs using 130 nm and 28 nm CMOS technology nodes, which were subsequently fabricated and verified through testing. The capability of an eFPGA to act as a front-end readout chip was assessed using simulation of high energy particles passing through a silicon pixel sensor. A machine learning-based classifier, designed for reduction of sensor data at the source, was synthesized and configured onto the eFPGA. A successful proof-of-concept was demonstrated through reproduction of the expected algorithm result on the eFPGA with perfect accuracy. Finally, further development of the eFPGA technology and its application to collider detector readout is discussed.

47 OTHER INSTRUMENTATION↗
NASA NTRS1974

Assessment of a wake vortex flight test program

A proposed flight test program to measure the characteristics of wake vortices behind a T-33 aircraft was investigated. A number of facets of the flight tests were examined to define the parameters to be measured, the anticipated vortex characteristics, the mutual interference between the probe aircraft and the wake, the response of certain instruments to be used in obtaining measurements, the effect of condensation on the wake vortices, and methods of data reduction. Recommendations made as a result of the investigation are presented.

Spangler, S. B.↗
NASA NTRS1975

Design of a simple Gerdien condenser for ionospheric D-region charged particle density and mobility measurements

The theory of a Gerdien condenser operating in a collision controlled medium is reviewed. Design and electronics of a Gerdien condenser probe suitable for flying on the Arcas rocket is presented. Aerodynamics properties of the instrument in continuous flow are discussed. The method of data reduction and experimental results of one successful flight at White Sands Missile Range (WSMR), New Mexico, on 11 January 1974 are reported. This investigation shows positive ions in two relatively distinct mobility groups between 47 and 65 km and a more continuous distribution of mobilities between 38 and 47 km.

Farrokh, H.↗
NASA NTRS1975

Pressure contact sounding data for NASA's Atmospheric Variability Experiment (AVE 2)

The basic rawinsonde data are described at each pressure contact from the surface to sounding termination for the 54 stations participating in the AVE 2 pilot experiment. Soundings were taken at three-hour intervals from stations within the United States east of about 105 degrees west longitude. Methods of data reduction and estimates of data accuracy are discussed. Examples of the data records produced are shown. The AVE 2 pilot experiment was conducted as part of NASA's program to better understand and establish the extent of applications for meteorological satellite sensor data through correlative ground truth experiments and to provide basic experimental data for use in studies of atmospheric scales-of-motion interrelationships.

Fuelberg, H. E.↗
NASA NTRS1975

Flight flutter testing using pulse techniques

A case of flutter developed at a speed lower than had been flown previously. This incident precipitated the routine procedure of pulsing control surfaces as well as the firing of explosive charges during speed build-ups. In the interest of rapid evaluation of results, simple methods of data reduction were used. A case history is presented where in the pulse technique predicted flutter by extrapolating decay rates obtained at subcritical speeds; in addition, a case is presented where no valid extrapolation could be made.

Stringham, R. H., Jr.↗
NASA NTRS1977

The 1974 Ethiopian rift geodimeter survey

The field techniques and methods of data reduction for five successive geodimeter surveys in the Ethiopian rift valley are enlarged upon, with the considered conclusion that there is progressive accumulation of upper crustal strain, consonant with on-going rift extension. The extension is restricted to the Quaternary volcanotectonic axis of the rift, namely the Wonji fault belt, and is occurring at rates of 3 to 6 mm/yr in the northern sector of the rift valley. Although this concurs with the predictions of platetectonic analysis of the Afar triple junction, it is considered premature to endorse such a concurrence on the basis of only 5 years of observations. This is underlined by the detection of local tectonic contractions and expansions associated with geothermal and gravity anomalies in the central sector of the rift valley. There is a hint of a component of dextral slip along some of the rift-floor fault zones, both from geological evidence and from the strain patterns detected in the present geodetic surveys.

Mohr, P.↗