Search NASA⌕ Search

SEARCH · Search NASA

Results for “data reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Investigation of Boundary Layer Development in Multi-Stage Low Pressure

A review of recent literature has been made in the areas of unsteady measurement in turbomachinery and LP turbine design. This has included a detailed review of methods for extracting quantitative shear stress data from surface mounted hot-film arrays. Research goals were identified on the basis of the literature survey and following interaction with the GE and NASA contracts. Progress has also been made in the detailed planning of the research program. An array of hot-film sensors has been mounted at mid-span on a second stage nozzle blade ready for installation in the current turbine buildup. A new technique of applying the hot-film array using double sided adhesive is being tested. The temperature in the vicinity of the hot-films will be monitored using a thermocouple attached to the blade pressure surface. This will increase the accuracy of the data reduction process compared with the methods applied by Halstead et at. (1995) and others. Data obtained from this first set of sensors, along with data from the hot-wire investigation will help to determine the best locations for surface hot-film instrumentation for subsequent builds of the turbine. Other LSRT instrumentation issues which have been addressed include calibration of the torque measurement system and procurement of custom design hot-wire sensors required to compensate for the slope flow path. Preliminary attempts at modeling the boundary layer transition process have been completed. A steady, coupled viscous-inviscid flow solver (the MISES code of Drela and Youngren) was used to calculate the steady-flow boundary layer transition location.

Source record↗

High Performance Parallel Architectures

Traditional remote sensing instruments are multispectral, where observations are collected at a few different spectral bands. Recently, many hyperspectral instruments, that can collect observations at hundreds of bands, have been operational. Furthermore, there have been ongoing research efforts on ultraspectral instruments that can produce observations at thousands of spectral bands. While these remote sensing technology developments hold great promise for new findings in the area of Earth and space science, they present many challenges. These include the need for faster processing of such increased data volumes, and methods for data reduction. Dimension Reduction is a spectral transformation, aimed at concentrating the vital information and discarding redundant data. One such transformation, which is widely used in remote sensing, is the Principal Components Analysis (PCA). This report summarizes our progress on the development of a parallel PCA and its implementation on two Beowulf cluster configuration; one with fast Ethernet switch and the other with a Myrinet interconnection. Details of the implementation and performance results, for typical sets of multispectral and hyperspectral NASA remote sensing data, are presented and analyzed based on the algorithm requirements and the underlying machine configuration. It will be shown that the PCA application is quite challenging and hard to scale on Ethernet-based clusters. However, the measurements also show that a high- performance interconnection network, such as Myrinet, better matches the high communication demand of PCA and can lead to a more efficient PCA execution.

El-Ghazawi, Tarek↗

MicroMAPS CO Measurements over North America and Europe during Summer-Fall 2004

The MicroMAPS instrument is a nadir-viewing, gas filter-correlated radiometer which operating in the 4.67 micrometer fundamental band of carbon monoxide. Originally designed and built for a space mission, this CO remote sensor is being flown in support of satellite validation and science instrument demonstrations for potential UAV applications. The MicroMAPS instrument system, as flown on Proteus, was designed by a senior student design project in the Aerospace Engineering Department, Virginia Tech, in Blacksburg, VA. and then revised by Systems Engineers at NASA Langley. The final instrument system was integrated and tested at NASA LaRC, in partnership with Scaled Composites and Virginia Space Grant Consortium (VSGC). VSGC supervised the fabrication of the nacelle that houses the instrument system on the right rear tail boom of Proteus. Full system integration and flight testing was performed at Scaled Composites, in Mojave, in June 2004. Its successful performance enabled participation in four international science missions on Proteus: in 2004, INTEX -NA over eastern North America in July, ADRIEX over the Mediterranean region and EAQUATE over the United Kingdom region in September,and TWP-ICE over Darwin, Australia and the surrounding oceans in Jan-Feb 2006. These flights resulted in nearly 300 hours of data. In parallel with the engineering developments, theoretical radiative transfer models were developed specifically for the MicroMAPS instrument system at the University of Virginia, Mechanical Engineering Department by a combined undergraduate and graduate student team. With technical support from Resonance Ltd. in June 2005, the MicroMAPS instrument was calibrated for the conditions under which the Summer-Fall 2004 flights occurred. The analyses of the calibration data, combined with the theoretical radiative transfer models, provide the first data reduction for the science flights reported here. These early results and comparisons with profile data from the NASA DC-8, the coincident AIRS CO retrievals, and selected CO measurements from the MOZAIC program will be presented.

Connors, Vickie S.↗

Design and Testing of the Endcap Concentrator ASICs for the CMS High-Granularity Calorimeter Upgrade

A major upgrade of the High-Granularity Calorimeter (HGCAL) in the CMS detector is planned for Long-Shutdown 3 (LS3), currently expected to start in 2026. This upgrade will contain over 6 million channels and the electronics will be required to be low power and to withstand a radiation environment with a High-Energy Hadron flux of 3x10**6 particles per square centimeter per second. The solution to this significant challenge is the two Endcap Concentrator (ECON) ASICs, ECON-T and ECON-D, working in tandem with the HGCROC front-end ASIC. The two ECON ASICs provide critical on-detector data reduction for both the 40 MHz trigger path (ECON-T) and 750 kHz data acquisition path (ECON-D) of the HGCAL. The ASICs are fabricated in 65nm CMOS. They are rad-tolerant to 600 Mrad with low power consumption (<2.5 mW/channel). This presentation will be a comprehensive description of each ECON design, including the infrastructure that they share as well as the elements that make each unique. The presentation will also include functionality and radiation tests for both ASICs, and the first high statistics characterization results from the full production of 75k ECON-D and ECON-T ASICs.

Hoff, James R. [Fermilab] (ORCID:0000000163514592)↗

ISABELA for effective in situ compression of scientific data: ISABELA FOR EFFECTIVE IN-SITU REDUCTION OF SPATIO-TEMPORAL DATA

Exploding dataset sizes from extreme-scale scientific simulations necessitates efficient data management and reduction schemes to mitigate I/O costs. With the discrepancy between I/O bandwidth and computational power, scientists are forced to capture data infrequently, thereby making data collection an inherently lossy process. Although data compression can be an effective solution, the random nature of real-valued scientific datasets renders lossless compression routines ineffective. These techniques also impose significant overhead during decompression, making them unsuitable for data analysis and visualization, which require repeated data access. To address this problem, we propose an effective method for In situ Sort-And-B-spline Error-bounded Lossy Abatement (ISABELA) of scientific data that is widely regarded as effectively incompressible. With ISABELA, we apply a pre-conditioner to seemingly random and noisy data along spatial resolution to achieve an accurate fitting model that guarantees a ≥0.99 correlation with the original data. We further take advantage of temporal patterns in scientific data to compress data b ≈ 85%, while introducing only a negligible overhead on simulations in terms of runtime. ISABELA significantly outperforms existing lossy compression methods, such as wavelet compression, in terms of data reduction and accuracy. We extend upon our previous paper by additionally building a communication-free, scalable parallel storage framework on top of ISABELA-compressed data that is ideally suited for extreme-scale analytical processing. The basis for our storage framework is an inherently local decompression method (it need not decode the entire data), which allows for random access decompression and low-overhead task division that can be exploited over heterogeneous architectures. Furthermore, analytical operations such as correlation and query processing run quickly and accurately over data in the compressed space. Copyright © 2012 John Wiley & Sons, Ltd.

Computer Science↗

The LSST DESC data challenge 1: generation and analysis of synthetic images for next-generation surveys

Data Challenge 1 (DC1) is the first synthetic data set produced by the Rubin Observatory Legacy Survey of Space and Time (LSST) Dark Energy Science Collaboration (DESC). DC1 is designed to develop and validate data reduction and analysis and to study the impact of systematic effects that will affect the LSST data set. DC1 is comprised of r -band observations of 40 deg 2 to 10 yr LSST depth. In this paper, we present each stage of the simulation and analysis process: (a) generation, by synthesizing sources from cosmological N -body simulations in individual sensor-visit images with different observing conditions; (b) reduction using a development version of the LSST Science Pipelines; and (c) matching to the input cosmological catalogue for validation and testing. We verify that testable LSST requirements pass within the fidelity of DC1. We establish a selection procedure that produces a sufficiently clean extragalactic sample for clustering analyses and we discuss residual sample contamination, including contributions from inefficiency in star–galaxy separation and imperfect deblending. We compute the galaxy power spectrum on the simulated field and conclude that: (i) survey properties have an impact of 50 per cent of the statistical uncertainty for the scales and models used in DC1; (ii) a selection to eliminate artefacts in the catalogues is necessary to avoid biases in the measured clustering; and (iii) the presence of bright objects has a significant impact (2σ–6σ) in the estimated power spectra at small scales (ℓ > 1200), highlighting the impact of blending in studies at small angular scales in LSST.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A machine-learning-driven data labeling pipeline for scientific analysis in MLExchange

This study introduces a novel labeling pipeline to accelerate the labeling process of scientific data sets by using artificial intelligence (AI)-guided tagging techniques. This pipeline includes a set of interconnected web-based graphical user interfaces (GUIs), where Data Clinic and MLCoach enable the preparation of machine learning (ML) models for data reduction and classification, respectively, while Label Maker is used for label assignment. Throughout this pipeline, data can be accessed through a direct connection to a file system or through Tiled for access through Hypertext Transfer Protocol (HTTP). Our experimental results present three use cases where this labeling pipeline has been instrumental for the study of large X-ray scattering data sets in the area of pattern recognition, the remote analysis of resonant soft X-ray scattering data and the fine-tuning process of foundation models. These use cases highlight the labeling capabilities of this pipeline, including the ability to label large data sets in a short period of time, to perform remote data analysis while minimizing data movement and to enhance the fine-tuning process of complex ML models with human involvement.

Chavez, Tanny (ORCID:0000000193172896)↗

Fast Semi-automated Filtration Method for Non-targeted LC-QTOF Data of Aged Nitroplasticizer Samples

A full dataset of aged nitroplasticizer (NP) is composed of more than 2000 unique mass-to-charges (m/z) when combining the non-targeted data obtained from both positive and negative electrospray ionization modes in time-of-flight mass spectrometry. Therefore, manual processing of these data often takes days, weeks, or even months to scrutinize for mechanistic insights. To effectively extract meaningful signals that represent vital degradation intermediates in the early NP degradation mechanism, a semi-automated postprocessing workflow for data filtering, tailored to the aging experiment of NP, has been developed. The automated portion of this workflow is written in a Python code (using pandas, numpy, and matplotlib libraries), which removes more than 65% of potential false signals within seconds via four threshold-based adjustable filters: signal sensitivity, coefficient of variation, number of measurements, and retention time variability. As for the manual portion, a pattern-based inspection method is employed to reduce another 23% or more false positives, which greatly simplifies data visualization and results in less than 3% of potential candidate m/z needing in-depth data interpretation. As a positive control, known compounds are verified. Using this semi-automated data reduction method, the amount of time required is reduced to a matter of hours for data filtering in the non-targeted datasets of aged NP, which saves more time and effort for compound identification.

36 MATERIALS SCIENCE↗

POWERFUL ACTIVITY IN THE BRIGHT AGES. I. A VISIBLE/IR SURVEY OF HIGH REDSHIFT 3C RADIO GALAXIES AND QUASARS

We present new rest-frame UV and visible observations of 22 high- z (1 < z < 2.5) 3C radio galaxies and QSOs obtained with the Hubble Space Telescope ’s Wide Field Camera 3 instrument. Using a custom data reduction strategy in order to assure the removal of cosmic rays, persistence signal, and other data artifacts, we have produced high-quality science-ready images of the targets and their local environments. We observe targets with regions of UV emission suggestive of active star formation. In addition, several targets exhibit highly distorted host galaxy morphologies in the rest frame visible images. Photometric analyses reveal that brighter QSOs generally tend to be redder than their dimmer counterparts. Using emission line fluxes from the literature, we estimate that emission line contamination is relatively small in the rest frame UV images for the QSOs. Using archival VLA data, we have also created radio map overlays for each of our targets, allowing for analysis of the optical and radio axes alignment.

79 ASTRONOMY AND ASTROPHYSICS↗

A priori estimate of the quality of a data compression system based on statistical characteristics of the sensors used

Knowledge of the composition and certain statistical characteristics of the output signals of the scientific instruments on board a space vehicle allows determination of possible signal processing algorithms in the system and to evaluate the prospects for utilization of data reduction. A method is presented to estimate the compression factor of an on-board data collection and processing system with known mean activities of the sensors used and unknown mutual correlation of their output signals.

Khodarev, Y. K.↗

Analysis of Skylab fluid mechanics science demonstrations

The results of the data reduction and analysis of the Skylab fluid mechanics demonstrations are presented. All the fluid mechanics data available from the Skylab missions were identified and surveyed. The significant fluid mechanics phenomena were identified and reduced to measurable quantities wherever possible. Data correlations were performed using existing theories. Among the phenomena analyzed were: static low-g interface shapes, oscillation frequency and damping of a liquid drop, coalescence, rotating drop, liquid films and low-g ice melting. A survey of the possible applications of the results was made and future experiments are recommended.

Tegart, J. R.↗

Development of non-linear finite element computer code

Recent work has shown that the use of separable symmetric functions of the principal stretches can adequately describe the response of certain propellant materials and, further, that a data reduction scheme gives a convenient way of obtaining the values of the functions from experimental data. Based on representation of the energy, a computational scheme was developed that allows finite element analysis of boundary value problems of arbitrary shape and loading. The computational procedure was implemental in a three-dimensional finite element code, TEXLESP-S, which is documented herein.

Becker, E. B.↗

Polar Magnetic Field Experiment

This grant covers the initial data reduction and analysis of the magnetic field measurements of the Polar spacecraft. At this writing data for the first three years of the mission have been processed and deposited in the key parameter database. These data are also available in a variety of time resolutions and coordinate systems via a webserver at UCLA that provides both plots and digital data. The flight software has twice been reprogrammed: once to remove a glitch in the data where there were rare collisions between commands in the central processing unit and once to provide burst mode data at 100 samples per second on a regular basis. The instrument continues to function as described in the instrument paper (1.1 in the bibliography attached below). The early observations were compared with observations on the same field lines at lower altitude. The polar magnetic measurements also proved to be most useful for testing the accuracy of MHD models. WE also made important contributions to study of waves and turbulence.

Russell, C. T.↗

The Planet Mercury Surface Spectroscopy and Analysis from the Kuiper Airborne Observatory and Analysis and Modeling to Determine Surface Composition

We had two successful flights to observe Mercury from the Kuiper Airborne Observatory (KAO) using High-efficiency Infrared Faint-Object Grating Spectrograph (HIFOGS). Flights were May 8, 1995 (eastern elongation) and July 6, 1995 (western elongation) For the observations one half of the primary mirror was covered to prevent sunlight from entering the telescope. All equipment and the airplane and its crew performed well. These flights were historical firsts for the KAO and for spectroscopy of Mercury in that it was the first time any spectroscopic observations of Mercury from above the Earth's atmosphere had been made. It was the first time the KAO had been used to @bserve an object less than 30 degrees from the Sun. Upon completion of the basic data reduction it became obvious that extensive modeling and analysis would be required to understand the data. It took three years of a graduate student's time and part time the PI to do the thermal modeling and the spectroscopic analysis. This resulted in a lengthy publication. A copy of this publication is attached and has all the data obtained in both KAO flights and the results clearly presented. Notable results are: (1) The observations found an as yet unexplained 5 micron emission enhancement that we think may be a real characteristic of Mercury's surface but could have an instrumental cause; (2) Ground-based measurements or an emission maximum at 7.7 microns were corroborated. The chemical composition of Mercury's surface must be feldspathic in order to explain spectra features found in the data obtained during the KAO flights.

Sprague, Ann↗

Determining Aerodynamic Loads Based on Optical Deformation Measurements

This paper describes a videogram metric technique for determining aerodynamic loads based on optical elastic deformation measurements. The data reduction methods are developed to extract the normal force and pitching moment from beam deformation data. The axial force is obtained by measuring the axial translational motion of a movable shaft in a spring/bearing device. Proof-of-concept calibration experiments are conducted to assess the accuracy of this optical technique.

Liu, Tianshu↗

Determining Aerodynamic Loads Based on Optical Deformation Measurements

This paper describes a videogrammetric technique for determining aerodynamic loads based on optical elastic deformation measurements. The data reduction methods are developed to extract the normal force and pitching moment from beam deformation data. The axial force is obtained by measuring the axial translational motion of a movable shaft in a spring/bearing device. Proof-of-concept calibration experiments are conducted to assess the accuracy of this optical technique.

Liu, Tianshu↗

What's New in GSAS-II

The General Structure and Analysis Software II (GSAS-II) package is an all-new crystallographic analysis package written to replace and extend the capabilities of the universal and widely used GSAS and EXPGUI packages. GSAS-II was described in a 2013 article, but considerable work has been completed since then. This paper describes the advances, which include: rigid body fitting and structure solution modules; improved treatment for parametric refinements and equation of state fitting; and small-angle scattering data reduction and analysis. GSAS-II offers versatile and extensible modules for import and export of data and results. Capabilities are provided for users to select any version of the code. Code documentation has reached 150 pages and 17 web-tutorials are offered. © 2014 International Centre for Diffraction Data.

Toby, Brian H.↗