Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data reduction methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Radiometric corrections of topographically induced effects on Landsat TM data in an alpine environment

Four radiometric correction methods for the reduction of slope-aspect effects in a Landsat TM data set are tested in a mountainous test site with regard to their physical soundness and their influence on forest classification, as well as on the visual appearance of the scene. Excellent ground reference information and a fine-resolution DEM allowed precise assessment of the applicability of the methods under investigation. The results of the study presented here demonstrate the weakness of the classical cosine correction method for radiometric correction in rugged terrain. The statistical, Minnaert and C-correction approaches, however, yielded an improvement of the forest classification and an impressive reduction of the visual topography effect.

Meyer, Peter↗

DrSPINE - New approach to data reduction and analysis for neutron spin echo experiments from pulsed and reactor sources

Neutron spin echo (NSE) method at a pulsed neutron source presents new challenges to the data reduction and analysis as compared to the instruments installed at reactor sources. The main advantage of the pulsed source NSE is the ability to resolve the neutron wavelength and collect neutrons over a wider bandwidth. This allows us to more precisely determine the symmetry phase and measure the data for several Q-values at the same time. Based on the experience gained at the SNS NSE - the first, and to date the only one, NSE instrument installed at a pulsed spallation source, we propose a novel and unified approach to the NSE data processing.

Monkenbusch, Michael↗

Online learning of quadratic manifolds from streaming data for nonlinear dimensionality reduction and nonlinear model reduction

Here, this work introduces an online greedy method for constructing quadratic manifolds from streaming data, designed to enable in situ analysis of numerical simulation data on the Petabyte scale. Unlike traditional batch methods, which require all data to be available upfront and take multiple passes over the data, the proposed online greedy method incrementally updates quadratic manifolds in one pass as data points are received, eliminating the need for expensive disk input/output operations as well as storing and loading data points once they have been processed. A range of numerical examples demonstrate that the online greedy method learns accurate quadratic manifold embeddings while being capable of processing data that far exceed common disk input/output capabilities and volumes as well as main-memory sizes.

97 MATHEMATICS AND COMPUTING↗

User Guide for Sample Reduction at GP-SANS

This manual is intended as a quick guide for data reduction of GP-SANS data. It includes all necessary steps to do the data reduction based on absolute calibration using the open beam method and how to transfer the reduced data to the personal computer system. If any errors are coming up so that the reduction script is not functioning as intended, please contact the instrument scientist.

97 MATHEMATICS AND COMPUTING↗

MISR photogrammetric data reduction for geophysical retrievals

The theoretical concept, based on modern photogrammetric methods, underlying the design of the MISR science data processing system responsible for the autonomous and continuous georectification of multi-angle imagery is the subject of this paper.

photogrammetric↗

Real-time data reduction capabilities at the Langley 7 by 10 foot high speed tunnel

The 7 by 10 foot high speed tunnel performs a wide range of tests employing a variety of model installation methods. To support the reduction of static data from this facility, a generalized wind tunnel data reduction program had been developed for use on the Langley central computer complex. The capabilities of a version of this generalized program adapted for real time use on a dedicated on-site computer are discussed. The input specifications, instructions for the console operator, and full descriptions of the algorithms are included.

Fox, C. H., Jr.↗

THE VIRUS-P EXPLORATION OF NEARBY GALAXIES (VENGA): SURVEY DESIGN, DATA PROCESSING, AND SPECTRAL ANALYSIS METHODS

We present the survey design, data reduction, and spectral fitting pipeline for the VIRUS-P Exploration of Nearby Galaxies (VENGA). VENGA is an integral field spectroscopic survey, which maps the disks of 30 nearby spiral galaxies. Targets span a wide range in Hubble type, star formation activity, morphology, and inclination. The VENGA data cubes have 5.''6 FWHM spatial resolution, {approx}5 A FWHM spectral resolution, sample the 3600 A-6800 A range, and cover large areas typically sampling galaxies out to {approx}0.7R{sub 25}. These data cubes can be used to produce two-dimensional maps of the star formation rate, dust extinction, electron density, stellar population parameters, the kinematics and chemical abundances of both stars and ionized gas, and other physical quantities derived from the fitting of the stellar spectrum and the measurement of nebular emission lines. To exemplify our methods and the quality of the data, we present the VENGA data cube on the face-on Sc galaxy NGC 628 (a.k.a. M 74). The VENGA observations of NGC 628 are described, as well as the construction of the data cube, our spectral fitting method, and the fitting of the stellar and ionized gas velocity fields. We also propose a new method to measure the inclination of nearly face-on systems based on the matching of the stellar and gas rotation curves using asymmetric drift corrections. VENGA will measure relevant physical parameters across different environments within these galaxies, allowing a series of studies on star formation, structure assembly, stellar populations, chemical evolution, galactic feedback, nuclear activity, and the properties of the interstellar medium in massive disk galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗

Utility Sector Impacts of Reduced Electricity Demand

This report presents a new approach to estimating the marginal utility sector impacts associated with electricity demand reductions. The method uses publicly available data and provides results in the form of time series of impact factors. The input data are taken from the Energy Information Agency's Annual Energy Outlook (AEO) projections of how the electric system might evolve in the reference case, and in a number of side cases that incorporate different effciency and other policy assumptions. The data published with the AEO are used to define quantitative relationships between demand-side electricity reductions by end use and supply-side changes to capacity by plant type, generation by fuel type and emissions of CO2, Hg, NOx and SO2. The impact factors define the change in each of these quantities per unit reduction in site electricity demand. We find that the relative variation in these impacts by end use is small, but the time variation can be significant.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Physics-Informed Learning Machines for Multiscale and Multiphysics Problems (PHILMS) (Technical Report)

The research work at University of California Santa Barbara (UCSB) resulted in several new developments in the areas of scientific machine learning, numerical analysis, and practical methods for data-driven modeling, prediction, reductions, and simulation. Many of the projects were carried out in collaboration with members of the national laboratories at Sandia National Laboratories (SNL), Pacific Northwestern National Laboratories (PNNL), and other institutions. Results included developing new scientific machine learning methods, related theory and mathematical frameworks for analysis and training, data-driven numerical solvers, and related tools and software for scientific computation. During the support period, over 16+ papers were submitted for publication, and 4 open-source software packages were developed and released (available at http://atzberger.org/). In addition, 7+ students and 2 post-docs were mentored in collaboration with the laboratory staff for future careers in academia, government labs, and industry.

97 MATHEMATICS AND COMPUTING↗

The FAST Hipparcos data reduction consortium - Overview of the reduction software

The main features of the data analysis methods adopted by FAST in the calibration and processing of the Hipparcos data are discussed. The structure of the data reduction software is examined, and the actual processing and evaluation are presented. Attention is given to the first look task, the calibration task, data preparation, attitude determination, the great circle reduction, synthesis treatment, iterations, data management and command software, and follow-up and evaluation activities.

Kovalevsky, J.↗

The CapiSorb Visible System (CVS) Demonstrations on ISS

Falling liquid film amine sorbent reactors have been successfully employed to scrub CO 2 aboard submarines for decades. However, applying such proven methods aboard orbiting and coast spacecraft is significantly challenged by the nearly weightless environment, where liquid sprays and films do not fall, and vapor bubbles and gases do not rise. The Capillary Sorbent (CapiSorb) Visible System (CVS) is a technology demonstration experiment performed aboard the ISS April 18 – 21, 2023. The system establishes stable steady thin liquid film flows in Contactor (absorber) and Degasser (desorber/stripper) replacing the passive role of gravity with the combined passive roles of surface tension, wetting, and system geometry. A TOX-0 fructose ersatz liquid sorbent is employed enabling ‘transparent’ experiments performed and filmed by the crew safely in the open cabin of the ISS. Completed objectives include demonstrations of stable passive ‘massively’ parallel planar thin film capillary flows across atmospheric pressure Contactor and sealed heated Degasser. The impacts of varying flow rate, flow direction, heat input, viscosity, positive and negative Degasser pressures, condensate collection and return, fluid distribution, interfacial stability, and others are reported. At least 49 diagnostics are recorded for digitization and subsequent thermal-fluids model validation by a single HD video downlink during the nearly 22 hours of operations. An overview of the flight hardware including description of the components, diagnostics, crew procedures, flight operations, and summary of accomplishments is reported in Ref. 1. Further details of the diagnostics, tests performed, and data reduction is reported in Ref. 2. This report collects both1,2 into a single report adding methods of data digitization, reduction, and archive along with analyses and discussions of technology impacts.

microgravity↗

A new algorithm for five-hole probe calibration, data reduction, and uncertainty analysis

A new algorithm for five-hole probe calibration and data reduction using a non-nulling method is developed. The significant features of the algorithm are: (1) two components of the unit vector in the flow direction replace pitch and yaw angles as flow direction variables; and (2) symmetry rules are developed that greatly simplify Taylor's series representations of the calibration data. In data reduction, four pressure coefficients allow total pressure, static pressure, and flow direction to be calculated directly. The new algorithm's simplicity permits an analytical treatment of the propagation of uncertainty in five-hole probe measurement. The objectives of the uncertainty analysis are to quantify uncertainty of five-hole results (e.g., total pressure, static pressure, and flow direction) and determine the dependence of the result uncertainty on the uncertainty of all underlying experimental and calibration measurands. This study outlines a general procedure that other researchers may use to determine five-hole probe result uncertainty and provides guidance to improve measurement technique. The new algorithm is applied to calibrate and reduce data from a rake of five-hole probes. Here, ten individual probes are mounted on a single probe shaft and used simultaneously. Use of this probe is made practical by the simplicity afforded by this algorithm.

Reichert, Bruce A.↗

Advances in utilizing event based data structures for neutron scattering experiments

This article strives to expand on existing work to demonstrate advancements in data processing made available using event mode measurements. Most spallation neutron sources in the world have data acquisition systems that provide event recording. The new science that is enabled by utilizing event mode has only begun to be explored. In the past, these studies were difficult to perform because histograms forced dealing with either large chunks of time or a large number of files. With event based data collection, data can be explored and rebinned long after the measurement has completed. This article will review some of the principles of event data and how the method opens up new possibilities for in situ measurements, highlighting techniques that can be used to explore changes in the data. We also demonstrate the statistical basis for determining data quality and address the challenge of determining how long to measure mid-measurement. Lastly, we demonstrate a model independent method of grouping data via hierarchical clustering methods that can be used to improve calibration, reduction, and data exploration.

74 ATOMIC AND MOLECULAR PHYSICS↗

Acceleration of GPU-based Krylov solvers via data transfer reduction

Krylov subspace iterative solvers are often the method of choice when solving large sparse linear systems. At the same time, hardware accelerators such as graphics processing units continue to offer significant floating point performance gains for matrix and vector computations through easy-to-use libraries of computational kernels. However, as these libraries are usually composed of a well optimized but limited set of linear algebra operations, applications that use them often fail to reduce certain data communications, and hence fail to leverage the full potential of the accelerator. In this study, we target the acceleration of Krylov subspace iterative methods for graphics processing units, and in particular the Biconjugate Gradient Stabilized solver that significant improvement can be achieved by reformulating the method to reduce data-communications through application-specific kernels instead of using the generic BLAS kernels, e.g. as provided by NVIDIA’s cuBLAS library, and by designing a graphics processing unit specific sparse matrix-vector product kernel that is able to more efficiently use the graphics processing unit’s computing power. Furthermore, we derive a model estimating the performance improvement, and use experimental data to validate the expected runtime savings. Finally, considering that the derived implementation achieves significantly higher performance, we assert that similar optimizations addressing algorithm structure, as well as sparse matrix-vector, are crucial for the subsequent development of high-performance graphics processing units accelerated Krylov subspace iterative methods.

97 MATHEMATICS AND COMPUTING↗

Solving differential‐algebraic equations in power system dynamic analysis with quantum computing

Abstract Power system dynamics are generally modeled by high dimensional non‐linear differential‐algebraic equations (DAEs) given a large number of components forming the network. These DAEs' complexity can grow exponentially due to the increasing penetration of distributed energy resources, whereas their computation time becomes sensitive due to the increasing interconnection of the power grid with other energy systems. This paper demonstrates the use of quantum computing algorithms to solve DAEs for power system dynamic analysis. We leverage a symbolic programming framework to equivalently convert the power system's DAEs into ordinary differential equations (ODEs) using index reduction methods and then encode their data into qubits using amplitude encoding. The system non‐linearity is captured by Hamiltonian simulation with truncated Taylor expansion so that state variables can be updated by a quantum linear equation solver. Our results show that quantum computing can solve the power system's DAEs accurately with a computational complexity polynomial in the logarithm of the system dimension. We also illustrate the use of recent advanced tools in scientific machine learning for implementing complex computing concepts, that is, Taylor expansion, DAEs/ODEs transformation, and quantum computing solver with abstract representation for power engineering applications.

computational complexity↗