Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data reduction methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Solving differential‐algebraic equations in power system dynamic analysis with quantum computing

Abstract Power system dynamics are generally modeled by high dimensional non‐linear differential‐algebraic equations (DAEs) given a large number of components forming the network. These DAEs' complexity can grow exponentially due to the increasing penetration of distributed energy resources, whereas their computation time becomes sensitive due to the increasing interconnection of the power grid with other energy systems. This paper demonstrates the use of quantum computing algorithms to solve DAEs for power system dynamic analysis. We leverage a symbolic programming framework to equivalently convert the power system's DAEs into ordinary differential equations (ODEs) using index reduction methods and then encode their data into qubits using amplitude encoding. The system non‐linearity is captured by Hamiltonian simulation with truncated Taylor expansion so that state variables can be updated by a quantum linear equation solver. Our results show that quantum computing can solve the power system's DAEs accurately with a computational complexity polynomial in the logarithm of the system dimension. We also illustrate the use of recent advanced tools in scientific machine learning for implementing complex computing concepts, that is, Taylor expansion, DAEs/ODEs transformation, and quantum computing solver with abstract representation for power engineering applications.

computational complexity↗

aCORN: An experiment to measure the electron-antineutrino correlation coefficient in free neutron decay

Here, we describe an apparatus used to measure the electron-antineutrino angular correlation coefficient in free neutron decay. This apparatus employs a novel measurement technique in which the angular correlation is converted into a proton time-of-flight asymmetry that is counted directly, avoiding the need for proton spectroscopy. We present details of the method, apparatus, detectors, data acquisition, and data reduction scheme, along with a discussion of the important systematic effects.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Exploration of High-Dimensional Nuclei Data

Density Functional Theory (DFT) provides the theoretical foundation for a self-consistent mean-field description of the nucleus in terms of one-body densities and currents. The idea is to construct a functional whose input is the proton and neutron densities and currents, and whose output yields the ground-state energy and other properties of the nucleus. Extensive computations of ground-state energies and other observable properties of several thousand nuclei are required in order to find a universal functional that covers the entire chart of nuclei. The analysis looks for hidden relationships between observables to determine a functional that can reliably predict nuclear properties in regions where no experimental data exist. Using methods for dimension reduction and visualization tools, it is hypothesized that the deformation of the neutrons is related to other characteristics of the nuclei. The discovered relationships with the deformation of the neutrons take us a step closer toward the universal functional.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Exploration with Scalable Gaussian Process Reinforcement Learning

Exploration is a challenging problem in reinforcement learning (RL), especially in environments with sparse rewards. Quantifying and utilizing the parametric uncertainty has been shown to be paramount for successful exploration [Osband et al., 2018]. Bayesian, or approximately Bayesian, methods present a principled means of estimating the parametric uncertainty in RL problems. Gaussian processes, nonparametric Bayesian models, are often impractical due to poor scalability and computational bottlenecks. We introduce a scalable Gaussian process RL (GPRL) method which directly induces sparsity in the covariance matrix to facilitate faster computation. This is a departure from previous GPRL methods which instead rely on data reduction and subsampling. We compare various covariance-based exploration techniques (Thompson sampling, upper confidence bound, and probabilistic maximum variance) which leverage our scalable GP framework in sparse reward environments. Finally, we show favorable comparison against the bootstrapped deep Q-Network.

97 MATHEMATICS AND COMPUTING↗

Mass spectograph analysis

Computer program provides a means of rapid data reduction of mass spectrograph data. The methods used are suited to mechanization on a digital computer since they consist of the systematic search of a large amount of tabular data and the unknown.

Shores, J. P.↗

Boundary cooled rocket engines for space storable propellants

An evaluation of an existing analytical heat transfer model was made to develop the technology of boundary film/conduction cooled rocket thrust chambers to the space storable propellant combination oxygen difluoride/diborane. Critical design parameters were identified and their importance determined. Test reduction methods were developed to enable data obtained from short duration hot firings with a thin walled (calorimeter) chamber to be used quantitatively evaluate the heat absorbing capability of the vapor film. The modification of the existing like-doublet injector was based on the results obtained from the calorimeter firings.

Kesselring, R. C.↗

Pressure Contact Sounding Data for NASA's Atmospheric Variability Experiment (AVE 3)

The basic rawinsonde data are described at each pressure contact from the surface to sounding termination for the 41 stations participating in the AVE III measurement program that began at 0000 GMT on February 6 and ended at 1200 GMT on February 7, 1975. Soundings were taken at 3-hour intervals during a large period of the experiment from most stations within the United States east of about 105 degrees west longitude. Methods of data processing, change in reduction scheme since the AVE II pilot experiment, and data accuracy are briefly discussed. An example of contact data is presented, and microfiche cards of all the contact data are included in the appendix. The AVE III project was conducted to better understand and establish the extent of applications for meteorological satellite sensor data through correlative ground truth experiments and to provide basic experimental data for use in studies of atmospheric scales of-motion interrelationships.

Fuelberg, H. E.↗

An improved lunar moment of inertia determination - A proposed strategy

A strategy for determining an improved lunar moment of inertia is proposed. An improved uncertainty in the lunar inhomogeneity parameter could reduce the core density error from 4.20 gr/cu cm to 0.1 gm/cu cm for the case of a lunar density model having a 300 km core radius. The current error of 0.0025 for the lunar inhomogeneity parameter is mostly due to the uncertainties in the C20 and C22 gravity harmonics. An optimum reduction strategy for obtaining an order of magnitude improvement in the gravity estimates is based on covariance analyses of Doppler data. The long-arc reduction method is shown to provide better results than the short-arc technique, and the use of an orbit with a 7000 km semimajor axis along with certain terms of up to degree and order eight is recommended.

Ananda, M. P.↗

Comparison of ozone concentrations obtained from Skylab eclipse and ozonesonde measurements

The satellite eclipse technique of ozone measurement is evaluated to determine its accuracy and resolution. The method of obtaining ozone concentrations from ground-based observations of eclipsing satellites is described, the theory of this method is outlined, and the data reduction procedure is summarized. It is shown that the satellite eclipse technique successfully measures the vertical distribution of ozone from 15 to 40 km with precisions ranging from + or - 12% between 20 and 35 km and + or - 25% at both 15 and 40 km. The ozone profile is found to be in good agreement with in situ measurements obtained from an ozonesonde launched near the eclipse tangent point at local sunset, the percent differences being less than 14% from 20 to 40 km.

Mcdougal, D. S.↗

Compositional Diversity of the Vestan Regolith Derived from Howardite Compositions and Dawn VIR Spectra

Howardite, eucrite and diogenite meteorites likely come from asteroid 4 Vesta [1]. Howardites - physical mixtures of eucrites and diogenites - are of two subtypes: regolithic howardites were gardened in the true regolith; fragmental howardites are simple polymict breccias [2]. The Dawn spacecraft imaged the howarditic surface of Vesta with the visible and infrared mapping spectrometer (VIR) resulting in qualitative maps of the distributions of distinct diogenite-rich and eucrite-rich terranes [3, 4]. We are developing a robust basis for quantitative mapping of the distribution of lithologic types using spectra acquired on splits of well-characterized howardites [5, 6]. Spectra were measured on sample powders sieved to <75 μm in the laboratories of the Istituto di Astrofisica e Planetologia Spaziali and Brown University. Data reduction was done using the methods developed to process Dawn VIR spectra [4]. The band parameters for the ~1 and ~2 μm pyroxene absorption features (hereafter BI and BII) can be directly compared to Dawn VIR results. Regolithic howardites have shallower BI and BII absorptions compared to fragmental howardites with similar compositions. However, there are statistically significant correlations between Al or Ca contents and BI or BII center wavelengths regardless of howardite subtype. Diogenites are poor in Al and Ca while eucrites are rich in these elements. The laboratory spectra can thus be directly correlated with the percentage of eucrite material contained in the howardites. We are using these correlations to quantitatively map Al and Ca distributions, and thus the percentage of eucritic material, in the current regolith of Vesta.

Mittlefehldt, D. W.↗

Microwave Interrogation of Woven Straps under Light Loading for Inflatable Applications

NASA uses woven straps for restraint layers in inflatable structures. This work investigates the use of microwaves to measure low level loading in the woven straps. More specifically, microwaves from a linearly polarized antenna are used to investigate four straps composed of Vectran and Kevlar with ratings of 6,000 lbs and 12,000 lbs of force. The straps are all lightly loaded from 2kg to 10kg in 2kg increments. The spectral centroid (SC) technique has been used for the dimensionality reduction method to evaluate the microwave data. The SC method was used to reduce the data from 10001 points to a single point that corresponds to the amount of load on the strap.

Microwave↗

Manifold Learning: What, How, and Why

Manifold learning (ML), also known as nonlinear dimension reduction, is a set of methods to find the low-dimensional structure of data. Dimension reduction for large, high-dimensional data is not merely a way to reduce the data; the new representations and descriptors obtained by ML reveal the geometric shape of high-dimensional point clouds and allow one to visualize, denoise, and interpret them. This review presents the underlying principles of ML, its representative methods, and their statistical foundations, all from a practicing statistician's perspective. It describes the trade-offs and what theory tells us about the parameter and algorithmic choices we make in order to obtain reliable conclusions.

Mathematics↗

Photogrammetric aspects of remapping procedures

Photogrammetric control generation is discussed. Techniques in remote sensing data reduction are described. Emphasis is placed on methods of rectification of aerial photography and frame photography. Examples of multispectral band scanner data that were processed are presented.

Mikhail, E. M.↗

Understanding and Modeling Lossy Compression Schemes on HPC Scientific Data

Scientific simulations generate large amounts of floating-point data, which are often not very compressible using the traditional reduction schemes, such as deduplication or lossless compression. The emergence of lossy floating-point compression holds promise to satisfy the data reduction demand from HPC applications; however, lossy compression has not been widely adopted in science production. We believe a fundamental reason is that there is a lack of understanding of the benefits, pitfalls, and performance of lossy compression on scientific data. In this paper, we conduct a comprehensive study on state-of-the-art lossy compression, including ZFP, SZ, and ISABELA, using real and representative HPC datasets. Our evaluation reveals the complex interplay between compressor design, data features and compression performance. The impact of reduced accuracy on data analytics is also examined through a case study of fusion blob detection, offering domain scientists with the insights of what to expect from fidelity loss. Furthermore, the trial and error approach to understanding compression performance involves substantial compute and storage overhead. To this end, we propose a sampling based estimation method that extrapolates the reduction ratio from data samples, to guide domain scientists to make more informed data reduction decisions.

Lu, Tao↗

Archetype-based Redshift Estimation for the Dark Energy Spectroscopic Instrument Survey

We present a computationally efficient galaxy archetype-based redshift estimation and spectral classification method for the Dark Energy Survey Instrument (DESI) survey. The DESI survey currently relies on a redshift fitter and spectral classifier using a linear combination of principal component analysis–derived templates, which is very efficient in processing large volumes of DESI spectra within a short time frame. However, this method occasionally yields unphysical model fits for galaxies and fails to adequately absorb calibration errors that may still be occasionally visible in the reduced spectra. Our proposed approach improves upon this existing method by refitting the spectra with carefully generated physical galaxy archetypes combined with additional terms designed to absorb data reduction defects and provide more physical models to the DESI spectra. We test our method on an extensive data set derived from the survey validation (SV) and Year 1 (Y1) data of DESI. Our findings indicate that the new method delivers marginally better redshift success for SV tiles while reducing catastrophic redshift failure by 10%–30%. At the same time, results from millions of targets from the main survey show that our model has relatively higher redshift success and purity rates (0.5%–0.8% higher) for galaxy targets while having similar success for QSOs. These improvements also demonstrate that the main DESI redshift pipeline is generally robust. Additionally, it reduces the false-positive redshift estimation by 5%–40% for sky fibers. We also discuss the generic nature of our method and how it can be extended to other large spectroscopic surveys, along with possible future improvements.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A data reduction technique and associated computer program for obtaining vehicle attitudes with a single onboard camera

A detailed discussion of the application of a previously method to determine vehicle flight attitude using a single camera onboard the vehicle is presented with emphasis on the digital computer program format and data reduction techniques. Application requirements include film and earth-related coordinates of at least two landmarks (or features), location of the flight vehicle with respect to the earth, and camera characteristics. Included in this report are a detailed discussion of the program input and output format, a computer program listing, a discussion of modifications made to the initial method, a step-by-step basic data reduction procedure, and several example applications. The computer program is written in FORTRAN 4 language for the Control Data 6000 series digital computer.

Bendura, R. J.↗

Data-driven precision determination of the material budget in ALICE

The knowledge of the material budget with a high precision is fundamental for measurements of direct photon production using the photon conversion method due to its direct impact on the total systematic uncertainty. Moreover, it influences many aspects of the charged-particle reconstruction performance. In this article, two procedures to determine data-driven corrections to the material-budget description in ALICE simulation software are developed. One is based on the precise knowledge of the gas composition in the Time Projection Chamber. The other is based on the robustness of the ratio between the produced number of photons and charged particles, to a large extent due to the approximate isospin symmetry in the number of produced neutral and charged pions. Both methods are applied to ALICE data allowing for a reduction of the overall material budget systematic uncertainty from 4.5% down to 2.5%. Using these methods, a locally correct material budget is also achieved. The two proposed methods are generic and can be applied to any experiment in a similar fashion.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Constructing a Simulation Surrogate with Partially Observed Output

Gaussian process surrogates are a popular alternative to directly using computationally expensive simulation models. When the simulation output consists of many responses, dimension-reduction techniques are often employed to construct these surrogates. However, surrogate methods with dimension reduction generally rely on complete output training data. This article proposes a new Gaussian process surrogate method that permits the use of partially observed output while remaining computationally efficient. The new method involves the imputation of missing values and the adjustment of the covariance matrix used for Gaussian process inference. The resulting surrogate represents the available responses, disregards the missing responses, and provides meaningful uncertainty quantification. In conclusion, the proposed approach is shown to offer sharper inference than alternatives in a simulation study and a case study where an energy density functional model that frequently returns incomplete output is calibrated.

42 ENGINEERING↗