Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data reduction methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Developing ML/AI Methods for High-Throughput Characterization of Multiple-Sensor Streams of Tokamak Dynamics for High-Speed Control (Final Report)

This project evaluated and developed new mathematical and algorithmic techniques capable of handling (in real-time) the growing amounts of data generated by modern fusion research. While existing numerical linear algebra (NLA) methods provide the backbone to classical data analysis and algorithms, these methods fundamentally do not port to distributed architectures nor do they allow low-latency data reduction for control. Motivated by the needs for modern fusion reactors, this project explored and implemented new numerical methods to characterize plasma dynamics, respond in real-time to discharge evolution, and to process massive-scale data accurately and rapidly more fully. This project links expertise in multiple-sensor diagnostics of tokamak plasma dynamics from Columbia University’s Plasma Physics Laboratory with expertise in massive-scale data reduction and extreme data control algorithms at Columbia University’s Data Science Institute. This interdisciplinary project (i) applied machine learning methods, (ii) implemented a properly-trained neural-network for very fast processing of high-speed plasma videography, and (ii) developed the applied mathematical methods, based on randomized-NLA (rNLA) routines, for data analysis, reduction, and real-time control. The Columbia University High Beta Tokamak-Extended Pulse (HBT-EP) facility provided data to test new algorithms and partnership with Columbia University's Data Sciences Institute evaluated the broader use of new algorithms for many challenging control applications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Calibration of Reduced Dynamic Models of Power Systems using Phasor Measurement Unit (PMU) Data

Accuracy of a power system dynamic model is essential to the secure and efficient operation of the system. Lower confidence on model accuracy usually leads to conservative operation and lowers asset usage. To improve model accuracy, identification algorithms have been developed to calibrate parameters of individual components using measurement data from staged tests. To facilitate online dynamic studies for large power system interconnections, this paper proposes a model reduction and calibration approach using phasor measurement unit (PMU) data. First, a model reduction method is used to reduce the number of dynamic components. Then, a calibration algorithm is developed to estimate parameters of the reduced model. This approach will help to maintain an accurate dynamic model suitable for online dynamic studies. The performance of the proposed method is verified through simulation studies.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Preparing for In Situ Processing on Upcoming Leading-edge Supercomputers

High performance computing applications are producing increasingly large amounts of data and placing enormous stress on current capabilities for traditional post-hoc visualization techniques. Because of the growing compute and I/O imbalance, data reductions, including in situ visualization, are required. These reduced data are used for analysis and visualization in a variety of different ways. Many of he visualization and analysis requirements are known a priori, but when they are not, scientists are dependent on the reduced data to accurately represent the simulation in post hoc analysis. The contributions of this paper is a description of the directions we are pursuing to assist a large scale fusion simulation code succeed on the next generation of supercomputers. Finally, these directions include the role of in situ processing for performing data reductions, as well as the tradeoffs between data size and data integrity within the context of complex operations in a typical scientific workflow.

97 MATHEMATICS AND COMPUTING↗

Hot-wire anemometry for turbulence measurements in helium-air mixtures

The use of extended hot-wire anemometry involving an interfering probe is shown to permit measurements of variable density turbulence such as arises in the mixing of helium and air. The methods of calibration and data reduction leading to time series in one or more velocity components, in the mass fraction of helium, and in the mixture density are described. Typical results in various flows to which the technique has been applied are discussed.

Libby, P. A.↗

Some comments on particle image displacement velocimetry

Laser speckle velocimetry (LSV) or particle image displacement velocimetry, is introduced. This technique provides the simultaneous visualization of the two-dimensional streamline pattern in unsteady flows as well as the quantification of the velocity field over an entire plane. The advantage of this technique is that the velocity field can be measured over an entire plane of the flow field simultaneously, with accuracy and spatial resolution. From this the instantaneous vorticity field can be easily obtained. This constitutes a great asset for the study of a variety of flows that evolve stochastically in both space and time. The basic concept of LSV; methods of data acquisition and reduction, examples of its use, and parameters that affect its utilization are described.

Lourenco, L. M.↗

Measurement of surface microtopography using helicopter-mounted stereo film cameras and two stereo matching techniques

A common problem in acquiring ground-truth data for use in microwave interaction modeling is the capture of surface roughness data that are both sampled at distances comparable to a fraction of the wavelength and extensive enough to represent the surface statistics in at least one resolution cell of the microwave remote sensor used. A technique has been developed for acquiring the necessary photogrammetric data using twin 70-mm film cameras mounted on a helicopter boom. The apparatus is described, and the accuracy with which ground surface roughness can be characterized using this device is estimated. Both standard and cross-correlation methods were used for data reduction. Stereogrammetry is compared with a completely automated image-matching technique. Dense disparity images were generated from the helicopter stereo pairs. Using interior orientation parameters supplied by the camera manufacturers, and assuming that exterior orientation parameters remain constant between control target and test field photography, an extremely dense DEM (digital elevation model) for a test field has been derived. Results are compared, and accuracy estimates are presented.

Wall, S. D.↗

Rotational relaxation of molecular H2 at moderate temperatures

A coupled rotation-vibration-dissociation model is used to compute the rotational relaxation times for molecular hydrogen as a function of final temperatures (500-5000 K) in a hypothetical scenario of sudden compression. The theoretical model is based on a master equation solver. The bound-bound and bound-free transition rates have been computed using a quasi-classical trajectory method. A review of the available experimental data on the rotational relaxation of hydrogen is presented, with a critical overview of the method of measurements and data reduction, including the sources of errors. The experimental data are compared with the computed results.

Sharma, S. P.↗

Rotational relaxation of molecular hydrogen at moderate temperatures

Using a coupled rotation-vibration-dissociation model the rotational relaxation times for molecular hydrogen as a function of final temperature (500-5000 K), in a hypothetical scenario of sudden compression, are computed. The theoretical model is based on a master equation solver. The bound-bound and bound-free transition rates have been computed using a quasiclassical trajectory method. A review of the available experimental data on the rotational relaxation of hydrogen is presented, with a critical overview of the method of measurements and data reduction, including the sources of errors. These experimental data are then compared with the computed results.

COUPLED ROTATION VIBRATION DIS↗

Two Instruments for Measuring Distributions of Low-Energy Charged Particles in Space

Current estimates indicate that the bulk of interplanetary gas consists of protons with energies between 0 and 20 kev and concentrations of 1 to 105 particles/cu cm. Methods and instrumentation for measuring the energy and density distribution of such a gas are considered from the standpoint of suitability for space vehicle payloads. It is concluded that electrostatic analysis of the energy distribution can provide sufficient information in initial experiments. Both magnetic and electrostatic analyzers should eventually be used. Several instruments designed and constructed at the Ames Research Center for space plasma measurements, and the methods of calibration and data reduction are described. In particular, the instrument designed for operation on solar cell power has the following characteristics: weight, 1.1 pounds; size, 2 by 3 by 4 inches; and power consumption, 145 mw. The instrument is designed to yield information on the concentration, energy distribution, and the anisotropy of ion trajectories in the 0.2 to 20 kev range.

Bader, Michel↗

Data reduction using cubic rational B-splines

A geometric method is proposed for fitting rational cubic B-spline curves to data that represent smooth curves including intersection or silhouette lines. The algorithm is based on the convex hull and the variation diminishing properties of Bezier/B-spline curves. The algorithm has the following structure: it tries to fit one Bezier segment to the entire data set and if it is impossible it subdivides the data set and reconsiders the subset. After accepting the subset the algorithm tries to find the longest run of points within a tolerance and then approximates this set with a Bezier cubic segment. The algorithm uses this procedure repeatedly to the rest of the data points until all points are fitted. It is concluded that the algorithm delivers fitting curves which approximate the data with high accuracy even in cases with large tolerances.

Chou, Jin J.↗

Earth Science Data Analytics: Preparing for Extracting Knowledge from Information

Data analytics is the process of examining large amounts of data of a variety of types to uncover hidden patterns, unknown correlations and other useful information. Data analytics is a broad term that includes data analysis, as well as an understanding of the cognitive processes an analyst uses to understand problems and explore data in meaningful ways. Analytics also include data extraction, transformation, and reduction, utilizing specific tools, techniques, and methods. Turning to data science, definitions of data science sound very similar to those of data analytics (which leads to a lot of the confusion between the two). But the skills needed for both, co-analyzing large amounts of heterogeneous data, understanding and utilizing relevant tools and techniques, and subject matter expertise, although similar, serve different purposes. Data Analytics takes on a practitioners approach to applying expertise and skills to solve issues and gain subject knowledge. Data Science, is more theoretical (research in itself) in nature, providing strategic actionable insights and new innovative methodologies. Earth Science Data Analytics (ESDA) is the process of examining, preparing, reducing, and analyzing large amounts of spatial (multi-dimensional), temporal, or spectral data using a variety of data types to uncover patterns, correlations and other information, to better understand our Earth. The large variety of datasets (temporal spatial differences, data types, formats, etc.) invite the need for data analytics skills that understand the science domain, and data preparation, reduction, and analysis techniques, from a practitioners point of view. The application of these skills to ESDA is the focus of this presentation. The Earth Science Information Partners (ESIP) Federation Earth Science Data Analytics (ESDA) Cluster was created in recognition of the practical need to facilitate the co-analysis of large amounts of data and information for Earth science. Thus, from a to advance science point of view: On the continuum of ever evolving data management systems, we need to understand and develop ways that allow for the variety of data relationships to be examined, and information to be manipulated, such that knowledge can be enhanced, to facilitate science. Recognizing the importance and potential impacts of the unlimited ways to co-analyze heterogeneous datasets, now and especially in the future, one of the objectives of the ESDA cluster is to facilitate the preparation of individuals to understand and apply needed skills to Earth science data analytics. Pinpointing and communicating the needed skills and expertise is new, and not easy. Information technology is just beginning to provide the tools for advancing the analysis of heterogeneous datasets in a big way, thus, providing opportunity to discover unobvious scientific relationships, previously invisible to the science eye. And it is not easy It takes individuals, or teams of individuals, with just the right combination of skills to understand the data and develop the methods to glean knowledge out of data and information. In addition, whereas definitions of data science and big data are (more or less) available (summarized in Reference 5), Earth science data analytics is virtually ignored in the literature, (barring a few excellent sources).

data analytics↗

An Overview of the Patch Integral Method (PIM), a New Heat Transfer Analysis Tool for Hypersonic Wind Tunnel Facilities at NASA Langley

NASA Langley’s hypersonic wind tunnels are heavily leveraged for planetary missions. The data collection method in these tunnels is thermography, and surface temperature measurements of the model surface are collected and reduced to produce surface heating data, as seen in Fig 1. However, during model injection, no temperature data are collected, and thus conventional, integral heat transfer methods cannot be used to solve for surface heating. A method was developed in the 1990’s to reduce this data despite the data gap, known as the step approximation method. The method assumes that the film coefficient behaves as a step function, the model is semi-infinite, and thermal properties are constant. With these simplifying assumptions, a Laplace transform can be performed to result in an equation that takes the initial temperature of the model and a temperature at some point in time to back out the film coefficient at that time. This is the method that is used in the current thermographic data reduction software, IHEAT. While computationally light-weight, the step approximation has several issues associated with it. The time-history of temperature is not accounted for, which is vital as heat transfer is an integral process. Additionally, the required semi-infinite assumption is unnecessary and might be violated during runtime. Thermal variation of material properties can have a sizeable impact on heating results and are not modeled by the method. This method also takes multiple seconds to “collapse” to a steady state, which is undesirable from both a facility and data reduction standpoint. The method is also very sensitive to the “effective time” approximation, an approximation of when heating instantaneously starts (which is a nonphysical simplification), and a small variation in this value can result in an error in heating results.

J. S. Cheatwood↗

Online data analysis and reduction: An important co-design motif for extreme-scale computers

A growing disparity between supercomputer computation speeds and I/O rates means that it is rapidly becoming infeasible to analyze supercomputer application output only after that output has been written to a file system. Instead, data-generating applications must run concurrently with data reduction and/or analysis operations, with which they exchange information via high-speed methods such as interprocess communications. The resulting parallel computing motif, online data analysis and reduction (ODAR), has important implications for both application and HPC systems design. Here we introduce the ODAR motif and its co-design concerns, describe a co-design process for identifying and addressing those concerns, present tools that assist in the co-design process, and present case studies to illustrate the use of the process and tools in practical settings.

Data Analysis↗

On-the-Fly Mapping for Calibrating Directional Antennas

An improved method of calibrating a large directional radio antenna of the type used in deep-space communication and radio astronomy has been developed. This method involves a raster-scanning-and-measurement technique denoted on-the-fly (OTF) mapping, applied in consideration of the results of a systematic analysis of the entire measurement procedure. Phenomena to which particular attention was paid in the analysis include (1) the noise characteristics of a total-power radiometer (TPR) that is used in the measurements and (2) tropospherically induced radiometer fluctuations. The method also involves the use of recently developed techniques for acquisition and reduction of data. In comparison with prior methods used to calibrate such antennas, this method yields an order-of-magnitude improvement in the precision of determinations of antenna aperture efficiency, and improvement by a factor of five or more in the precision of determination of pointing error and beam width. Prerequisite to a meaningful description of the present method is some background information concerning three aspects of the problem of calibrating an antenna of the type in question: In OTF mapping measurements in which a TPR is used, the desired data are the peak temperature corresponding to a radio source, the pointing offset when the antenna is commanded to point toward the source, and the shape of the main lobe of the antenna beam, all as functions of the antenna beam elevation and azimuth angles. These data enable one to calculate the (1) antenna aperture efficiency by comparing the measured peak temperature with that expected for a 100-percent-efficient antenna, (2) the mechanical pointing error resulting from small misalignments of various parts of the antenna structure, and (3) misalignments of the antenna subreflector and other mirrors. For practical reasons having to do with obtaining adequate angular resolution and all-sky coverage, it is necessary to perform azimuth and elevation scans fairly rapidly. Many natural radio sources used in calibrating antennas are only approximately pointlike: some sources subtend angles greater than the beam width of a given antenna. In such a case, the antenna partially resolves the source structure and does not collect all of the radiation emitted by the source. This makes it necessary to estimate how much of the total known radiation from the source would actually be collected by the antenna if it were 100-percent efficient. The resulting estimate, leading to a source-size correction factor, introduces another degree of uncertainty to the measurements. OTF mapping can remove this uncertainty

Rochblatt, David↗

Developing Methodology to Determine Pu Isotopic Composition by Laser Ablation MC-ICP-MS

This project will develop methodology to analyze the Pu isotope ratio in mixed U-Pu particles by laser ablation MC-ICP-MS. This will involve: 1) testing and validation of the Pu analytical method using mixed U-Pu solutions and Pu doped glasses, 2) isotopic analysis of mixed U-Pu particles by laser ablation MC-ICP-MS, and 3) continued development of the R-based data reduction program. Details regarding the analytical method development and results of QC testing will be output as a deliverable to the IAEA, along with an updated version of the LARA data reduction software.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Uniform-in-phase-space data selection with iterative normalizing flows

Improvements in computational and experimental capabilities are rapidly increasing the amount of scientific data that are routinely generated. In applications that are constrained by memory and computational intensity, excessively large datasets may hinder scientific discovery, making data reduction a critical component of data-driven methods. Datasets are growing in two directions: the number of data points and their dimensionality. Whereas dimension reduction typically aims at describing each data sample on lower-dimensional space, the focus here is on reducing the number of data points. A strategy is proposed to select data points such that they uniformly span the phase-space of the data. The algorithm proposed relies on estimating the probability map of the data and using it to construct an acceptance probability. An iterative method is used to accurately estimate the probability of the rare data points when only a small subset of the dataset is used to construct the probability map. Instead of binning the phase-space to estimate the probability map, its functional form is approximated with a normalizing flow. Therefore, the method naturally extends to high-dimensional datasets. The proposed framework is demonstrated as a viable pathway to enable data-efficient machine learning when abundant data are available.

97 MATHEMATICS AND COMPUTING↗