Search NASA⌕ Search

SEARCH · Search NASA

Results for “data reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Data reduction in deterministic neutron transport calculations using machine learning

Neutron cross section matrices for fission and scattering data are required for each material, temperature, and enrichment level to calculate the neutron transport equation accurately. Here, this information can be a limiting factor when using the multigroup discrete ordinates (S N ) method when the number of energy groups is large. Machine Learning (ML) can be used to replace the need for the cross section matrices by reproducing the function that maps the scalar flux to the scattering and fission sources. Through the use of autoencoders and Deep Jointly-Informed Neural Networks (DJINN), the data storage requirements are reduced by 94% of the original data for a 618 group problem. This is accomplished while preserving the scalar flux, maintaining generality, and decreasing wall clock times.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Spectral Data Reduction via Wavelet Decomposition

The greatest advantage gained from hyperspectral imagery is that narrow spectral features can be used to give more information about materials than was previously possible with broad-band multispectral imagery. For many applications, the new larger data volumes from such hyperspectral sensors, however, present a challenge for traditional processing techniques. For example, the actual identification of each ground surface pixel by its corresponding reflecting spectral signature is still one of the most difficult challenges in the exploitation of this advanced technology, because of the immense volume of data collected. Therefore, conventional classification methods require a preprocessing step of dimension reduction to conquer the so-called "curse of dimensionality." Spectral data reduction using wavelet decomposition could be useful, as it does not only reduce the data volume, but also preserves the distinctions between spectral signatures. This characteristic is related to the intrinsic property of wavelet transforms that preserves high- and low-frequency features during the signal decomposition, therefore preserving peaks and valleys found in typical spectra. When comparing to the most widespread dimension reduction technique, the Principal Component Analysis (PCA), and looking at the same level of compression rate, we show that Wavelet Reduction yields better classification accuracy, for hyperspectral data processed with a conventional supervised classification such as a maximum likelihood method.

Kaewpijit, S.↗

Evaluation of Apex Alpha with LabWare-LIMS Data Reduction for Alpha Analyses

Savannah River Site's Environmental Bioassay Laboratory is migrating its laboratory information management system (LIMS) from SQL-LIMS to Oracle Labware-LIMS (LW-LIMS) systems to align with the Department of Energy's cyber security policies. Concurrently with the LIMS upgrade, the current VMS based Alpha Measurement System (AMS) software is being replaced with Apex Alpha software to reduce other cyber vulnerabilities, streamline procedural production aspects of data handling, and improve outdated reduction processes to align the program with requirements outlined in ANSI N13.30. The primary technical changes which are being implemented are: - Reagent contributions are added in data reduction, - Moving average background equivalent activity are used for gross signal corrections, - Measured uncertainty of both are included in the decision level and propagated uncertainty, - Tracer levels are increased for precision and accuracy improvements, and - Reports are modified for compliance.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Delta: Data Reduction for Integrated Application Workflows

Integrated Application Workflows (IAWs) run multiple simulation workflow components concurrently on an HPC resource connecting these components using compute area resources and compensating for any performance or data processing rate mismatches. These IAWs require high frequency and high volume data transfers between compute nodes and staging area nodes during the lifetime of a large parallel computation. The available network band-width between the two areas may not be enough to efficiently support the data movement. As the processing power available to compute resources increases, the requirements for this data transfer will become more difficult to satisfy and perhaps will not be satisfiable at all since network capabilities are not expanding at a comparable rate. Furthermore, energy consumption in HPC environments is expected to grow by an order of magnitude as exascale systems become a reality. The energy cost of moving large amounts of data frequently will contribute to this issue. It is necessary to reduce the volume of data without reducing the quality of data when it is being processed and analyzed. Delta resolves the issue by addressing the lifetime data transfer operations. Delta removes subsequent identical copies of already transmitted data during transfers and restores those copies once the data has reached the destination. Delta is able to identify duplicated information and determine the most space efficient way to represent it. Initial tests show about 50% reduction in data movement while maintaining the same data quality and transmission frequency.

97 MATHEMATICS AND COMPUTING↗

CMS Analysis and Data Reduction with Apache Spark

Experimental Particle Physics has been at the forefront of analyzing the world's largest datasets for decades. The HEP community was among the first to develop suitable software and computing tools for this task. In recent times, new toolkits and systems for distributed data processing, collectively called "Big Data" technologies have emerged from industry and open source projects to support the analysis of Petabyte and Exabyte datasets in industry. While the principles of data analysis in HEP have not changed (filtering and transforming experiment-specific data formats), these new technologies use different approaches and tools, promising a fresh look at analysis of very large datasets that could potentially reduce the time-to-physics with increased interactivity. Moreover these new tools are typically actively developed by large communities, often profiting of industry resources, and under open source licensing. These factors result in a boost for adoption and maturity of the tools and for the communities supporting them, at the same time helping in reducing the cost of ownership for the end-users. In this talk, we are presenting studies of using Apache Spark for end user data analysis. We are studying the HEP analysis workflow separated into two thrusts: the reduction of centrally produced experiment datasets and the end-analysis up to the publication plot. Studying the first thrust, CMS is working together with CERN openlab and Intel on the CMS Big Data Reduction Facility. The goal is to reduce 1 PB of official CMS data to 1 TB of ntuple output for analysis. We are presenting the progress of this 2-year project with first results of scaling up Spark-based HEP analysis. Studying the second thrust, we are presenting studies on using Apache Spark for a CMS Dark Matter physics search, comparing Spark's feasibility, usability and performance to the ROOT-based analysis.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Performance analysis and data reduction for exascale scientific workflows

Chimbuko is the first in situ, scalable, workflow-level performance analysis tool for trace-level analysis and visualization of application performance. This tool was developed by the Co-design Center for Online Data Analysis and Reduction and funded by the U.S. Department of Energy’s Exascale Computing Project. We provide a detailed description of Chimbuko’s architecture and illustrate our online and offline visualization with multiple use cases. We also present results for the deployment and scalability of the tool as applied to a high-energy physics workflow running at large scale on the Frontier supercomputer.

97 MATHEMATICS AND COMPUTING↗

GRACE KBR and Accelerometer Data Reduction and Calibration

The Gravity Recovery and Climate Experiment (GRACE), launched on March 17, 2002, represents the state-of-the-art in geodetic observations of the static and time varying components of the Earth's geopotential field. The fundamental measurement used to observe gravity is the inter-satellite range and range rate between two coplanar, low altitude satellites obtained from a K-band ranging (KBR) system. In addition to the K-band ranging system, each satellite possess a Super-STAR Accelerometer, a GPS receiver/antenna package, Star Cameras and a Laser Retro Reflector (LRR) to complete the compliment of science instruments. The GRACE project has now released two years of Level 1B data derived from the science instruments and sensors. An integral component of our time variable gravity research is the reduction, calibration and analyses of these Level 1B data. In particular we have analyzed several months of K-band ranging (KBR1B), accelerometry (ACC1B) and GPS navigation (GNAV1B) data. Accelerometer calibration and KBR data reduction methodology and results will be presented. We discuss the impact of these analyses on the recovery of time variable gravity.

Rowlands, David D.↗

Ongoing data reduction, theoretical studies and supporting research in magnetospheric physics

Data from ISEE-3, Pioneer Venus Orbiter, and Voyager 1 and 2 were analyzed. The predictability of local shock macrostructure at ISEE-1, at the Earth's bow shock, from solar wind measurements made up-stream by ISEE-3, was conducted using computer graphic format. Morphology of quasi-parallel shock was reviewed. The review attempted to interrelate various measurements and computations involving the q-parallel structure and foreshock elements connected to it. A new classification for q-parallel morphology was suggested.

Scarf, F. L.↗

(abstract) Venus Gravity Data Reduction

The Magellan spacecraft has provided high resolution gravity data to its very end, October 13, 1994, when it was consumed by the Venusian atmosphere. After aerobraking in August of 1993 to attain a near circular orbit, excellent high latitude data were acquired which previously were very weak during the elliptical orbit coverage. There are 1500 orbits during the near circular orbit, supplying redundant coverage at different geometries over many features. This allowed the relaxation of apriori constraints, so true amplitudes are being extracted from the data. In this paper we present the results of a 75(sup th) degree and order field that incorporates all the old Pioneer Venus Orbiter data as well as all the Magellan data to September 1994. The new results reflect even higher correlation with topography, higher amplitude values for the highs and lows, and global results that have essentially very little apriori constraint on the solution parameters. We also correlate our new model with the earlier ones based on 60(sup th) and 40(sup th) degree and order presentations.

Magellan Venus gravity orbits topography surface f↗

Vector-Ordering Filter Procedure for Data Reduction

The vector-ordering filter (VOF) technique involves a procedure for sampling a large population of data vectors to select a subset of data vectors that fully characterize the state space of the large population. The VOF technique enables a large reduction of the volume of data that must be handled in the automated monitoring system and method discussed in the two immediately preceding articles. In so doing, the VOF technique enables the development of data-driven mathematical models of a monitored asset from sets of data that would otherwise exceed the memory capacities of conventional engineering computers. Data-driven mathematical models have been shown to offer high fidelity for purposes of control and monitoring of assets. In practice, a collection of asset-operating observations is acquired with the intention that the collection contain observations characteristic of the full dynamic range of operation of the asset. Often, such a collection contains an extremely large number of observations, many of which are redundant. The VOF technique fills the need for a means to extract, from the original collection of observational data, a reduced data matrix that excludes redundant data while maintaining the full statistical character and dynamic range of the original data. The reduced data matrix can then be used as the input data for development of a mathematical model of the monitored asset, or as training data for a neural-network substitute for an explicit mathematical model of the asset. Alternatively, the reduced data matrix can, itself, be used directly as a mathematical model of the monitored asset, as is commonly done in multivariate state-estimation techniques. The original data are collected from the asset over a range of operating states and are put in matrix form. Each column vector in the original data matrix represents the signal values acquired at a particular operational state of the asset. Thus, the number of columns of the original data matrix equals the number of observed states and the number of rows in this matrix equals the number of signals acquired at each observation. In the VOF technique, one extracts the reduced data matrix from the original data matrix through the selection of a representative subset of the column (state) vectors.

Bickford, Randall L.↗

Planetary astronomy of Mars. Mars data reduction

Grant #NAGW-1408 was specifically awarded to obtain telescopic visible and near-IR spectral imaging of Mars during the 1988 apparition (9/28/88). The observing program was highly successful producing approximately 2 Gbytes of data, but was only funded for one year and virtually all of the funds were spent in data acquisition. The follow-up grant was funded the following year for reduction of these data into a scientifically productive form, which because of the size and nature of our observations, was a non-trivial task. A more detailed scientific analysis of these data (fully reduced) is in progress now and will take a number of years. Extended geologic analyses of the astronomical data are being funded by the NASA Planetary Geology and Geophysics program. The objective was to produce detailed reflectance spectra for contiguous, spatially resolved surface elements covering most of the planet (about +50 degrees to -90 degrees latitude, all longitudes). A total of 6 observing runs, of 3-4 days duration each, were conducted on the University of Arizona's 1.5m telescope on Mt. Bigelow. We present a sketch map showing the approximate total extent of our spectral image coverage. Nearly all of Mars south of 40 degrees N was observed at least once. About half of the area shown was observed multiple times. South of 65 degrees S, including the south polar cap, our coverage is heavily redundant. The first run was conducted June 29 - July 1, 1988 (all dates are UT) to serve as a baseline prior to possible dust storm activity on Mars. The other observing runs were closer to opposition: Sept. 3-6, 13-15, 24-26, and Oct. 5-7 and 16-18. The September and October observations were scheduled to provide maximum longitudinal coverage. This was also intended to provide a balance between surface observations and observations of predicted dust storm activity. No global dust storm developed in 1988, so we have a large volume of data for the surface of Mars.

Singer, Robert B.↗

Conversational high resolution mass spectrographic data reduction

A FORTRAN 4 program is described which reduces the data obtained from a high resolution mass spectrograph. The program (1) calculates an accurate mass for each line on the photoplate, and (2) assigns elemental compositions to each accurate mass. The program is intended for use in a time-shared computing environment and makes use of the conversational aspects of time-sharing operating systems.

Romiez, M. P.↗

Data reduction by computer processing

The automated analysis of remote sensing data, specifically digital processing of LANDSAT or other image data in numerical form was considered in a technical workshop which covered the teaching of digital image processing, including both theoretical and applied subjects and laboratory experience, and also reviewed NASA developed image processing software, and hardware/software systems employed at NASA-Ames Research Center in support of the Western Regional Applications Program (WRAP). A course titled Image Processing Lab, one of two courses required for a graduate minor in remote sensing at Arizona is examined as well as the rationale, content, and hardware/software support for this course.

Lumb, D. R.↗

Residual acceleration data on IML-1: Development of a data reduction and dissemination plan

The research performed consisted of three stages: (1) identification of sensitive IML-1 experiments and sensitivity ranges by order of magnitude estimates, numerical modeling, and investigator input; (2) research and development towards reduction, supplementation, and dissemination of residual acceleration data; and (3) implementation of the plan on existing acceleration databases.

Rogers, Melissa J. B.↗

User's manual for the one-dimensional hypersonic experimental aero-thermodynamic (1DHEAT) data reduction code

A FORTRAN computer code for the reduction and analysis of experimental heat transfer data has been developed. This code can be utilized to determine heat transfer rates from surface temperature measurements made using either thin-film resistance gages or coaxial surface thermocouples. Both an analytical and a numerical finite-volume heat transfer model are implemented in this code. The analytical solution is based on a one-dimensional, semi-infinite wall thickness model with the approximation of constant substrate thermal properties, which is empirically corrected for the effects of variable thermal properties. The finite-volume solution is based on a one-dimensional, implicit discretization. The finite-volume model directly incorporates the effects of variable substrate thermal properties and does not require the semi-finite wall thickness approximation used in the analytical model. This model also includes the option of a multiple-layer substrate. Fast, accurate results can be obtained using either method. This code has been used to reduce several sets of aerodynamic heating data, of which samples are included in this report.

Hollis, Brian R.↗