Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data reduction methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Codebase release 2.0 for sauce

Low energy nuclear physics experiments are transitioning towards fully digital data acquisition systems. Realizing the gains in flexibility afforded by these systems relies on equally flexible data reduction techniques. In this paper, methods utilizing data frames and in-memory techniques to work with data, including data from self-triggering, digital data acquisition systems, are discussed within the context of a Python package, sauce. It is shown that data frame operations can encompass common analysis needs and allow interactive data analysis. Two event building techniques, dubbed referenced and referenceless event building, are shown to provide a means to transform raw list mode data into correlated multi-detector events. These techniques are demonstrated in the analysis of two example data sets.

Marshall, Caleb (ORCID:0000000211942920)↗

S-Preconditioner for Multi-fold Data Reduction with Guaranteed User-Controlled Accuracy

The growing gap between the massive amounts of data generated by petascale scientific simulation codes and the capability of system hardware and software to effectively analyze this data necessitates data reduction. Yet, the increasing data complexity challenges most, if not all, of the existing data compression methods. In fact, lossless compression techniques offer no more than 10% reduction on scientific data that we have experience with, which is widely regarded as effectively incompressible. To bridge this gap, in this paper, we advocate a transformative strategy that enables fast, accurate, and multi-fold reduction of double-precision floating-point scientific data. The intuition behind our method is inspired by an effective use of preconditioners for linear algebra solvers optimized for a particular class of computational dwarfs (e.g., dense or sparse matrices). Focusing on a commonly used multi-resolution wavelet compression technique as the underlying solver for data reduction we propose the S-preconditioner, which transforms scientific data into a form with high global regularity to ensure a significant decrease in the number of wavelet coefficients stored for a segment of data. Combined with the subsequent EQ-calibrator, our resultant method (called S-Preconditioned EQ-Calibrated Wavelets (SPEQC-WAVELETS)), robustly achieved a 4- to 5- fold data reduction while guaranteeing user-defined accuracy of reconstructed data to be within 1% point-by-point relative error, lower than 0:01 Normalized RMSE, and higher than 0:99 Pearson Correlation. In this paper, we show the results we obtained by testing our method on six petascale simulation codes including fusion, combustion, climate, astrophysics, and subsurface groundwater in addition to 13 publicly available scientific datasets. We also demonstrate that application-driven data mining tasks performed on decompressed variables or their derived quantities produce results of comparable quality with the ones for the original data.

Jin, Ye↗

Transfer learning nonlinear plasma dynamic transitions in low dimensional embeddings via deep neural networks

Deep learning algorithms provide a new paradigm to study high-dimensional dynamical behaviors, such as those in fusion plasma systems. Development of novel, data-driven model reduction methods, coupled with detection of abnormal modes with plasma physics, opens a unique opportunity to identify plasma instabilities through automated construction of parsimonious models that can be tuned to balance accuracy and cost. Our fusion transfer learning (FTL) model demonstrates success in rapidly reconstructing nonlinear kink mode structures by learning from a limited amount of nonlinear simulation data. The knowledge transfer process leverages a pre-trained neural encoder–decoder network, initially trained on linear simulations, to effectively capture nonlinear dynamics. The low-dimensional embeddings extract the coherent structures of interest, while preserving the inherent dynamics of the complex system. Experimental results highlight FTL’s capacity to capture transitional behaviors and dynamical features in plasma dynamics—a task often challenging for conventional methods. The model developed in this study is generalizable and can be extended broadly through transfer learning to address various magnetohydrodynamics modes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Using Public Participation to Improve MELs Energy Data Collection

Miscellaneous Electric Loads (MELs) have proliferated in the last decade, and comprise an increasing share of building energy consumption. Because of the diversity of MELs and our lack of understanding about how people use them, large-scale data collection is needed to inform meaningful energy reduction strategies. Traditional methods of data collection, however, usually incur high labor and metering equipment expenses. As an alternative, this paper investigates the feasibility of crowdsourcing data collection to satisfy at least part of the data collection needs with acceptable accuracy. This study assessed the reliability and accuracy of crowdsourced data, by recruiting over 20 volunteers (from the 2012 Lawrence Berkeley Lab, Open House event) to test our crowdsourcing protocol. The protocol asked volunteers to perform the following tasks for three test products with increasing complexity - record power meter and product characteristics, identify all power settings available, and report the measured power. Based on our collected data and analysis, we concluded that volunteers performed reasonably well for devices with functionalities with which they are familiar, and might not produce highly accurate field measurements for complex devices. Accuracy will likely improve when participants are measuring the power used by devices in their home which they know how to operate, by providing more specific instructions including instructional videos. When integrated with existing programs such as the Home Energy Saver tool, crowdsourcing data collection from individual homeowners has the potential to generate a substantial amount of information about MELs energy use in homes.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

THE IMACS CLUSTER BUILDING SURVEY. I. DESCRIPTION OF THE SURVEY AND ANALYSIS METHODS

The IMACS Cluster Building Survey uses the wide field spectroscopic capabilities of the IMACS spectrograph on the 6.5 m Baade Telescope to survey the large-scale environment surrounding rich intermediate-redshift clusters of galaxies. The goal is to understand the processes which may be transforming star-forming field galaxies into quiescent cluster members as groups and individual galaxies fall into the cluster from the surrounding supercluster. This first paper describes the survey: the data taking and reduction methods. We provide new calibrations of star formation rates (SFRs) derived from optical and infrared spectroscopy and photometry. We demonstrate that there is a tight relation between the observed SFR per unit B luminosity, and the ratio of the extinctions of the stellar continuum and the optical emission lines. With this, we can obtain accurate extinction-corrected colors of galaxies. Using these colors as well as other spectral measures, we determine new criteria for the existence of ongoing and recent starbursts in galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗

THE GALACTIC PLANE INFRARED POLARIZATION SURVEY (GPIPS)

The scientific motivation, data collection strategy, data reduction, and analysis methods are presented for the Galactic Plane Infrared Polarization Survey (GPIPS). The chief goal for the Survey was to reveal the nature of the magnetic field threading the Galactic disk, in particular through regions of low to moderate extinction (1-20 mag of A{sub V} ) and star formation in the cool interstellar medium. The Survey region spans 76 deg{sup 2} of the northern Milky Way disk, from l = 18 Degree-Sign to 56 Degree-Sign and b =-1 Degree-Sign to +1 Degree-Sign . Linear polarimetric imaging observations began in 2006 in the near-infrared H band (1.6 {mu}m) using the Mimir instrument on the 1.8 m Perkins telescope, located outside Flagstaff, AZ. Mimir used a cold, fixed wire grid and a rotateable cold, compound half-wave plate to obtain 'step-and-integrate' polarimetry over its full 10 Multiplication-Sign 10 arcmin field of view. The GPIPS bright and faint polarimetric limits are approximately 7th and 15th mag, respectively, set by saturation and photon noise. Polarimetric uncertainties track with stellar magnitude, from about 0.1% to 25%, on average, from the brightest to faintest stars. Across the 3237 field GPIPS region, approximately 0.5 million stars are estimated to show detectable linear polarization (P/{sigma}{sub P} > 3); most of these have m{sub H} < 12. This represents many orders of magnitude improvement in the number of polarization measurements across this region. GPIPS observations are more than 90% complete and should finish in 2012.

79 ASTRONOMY AND ASTROPHYSICS↗

SU-E-I-10: Investigation On Detectability of a Small Target for Different Slice Direction of a Volumetric Cone Beam CT Image

Purpose: To investigate the detectability of a small target for different slice direction of a volumetric cone beam CT image and its impact on dose reduction. Methods: Analytic projection data of a sphere object (1 mm diameter, 0.2/cm attenuation coefficient) were generated and reconstructed by FDK algorithm. In this work, we compared the detectability of the small target from four different backprojection Methods: hanning weighted ramp filter with linear interpolation (RECON 1), hanning weighted ramp filter with Fourier interpolation (RECON2), ramp filter with linear interpolation (RECON 3), and ramp filter with Fourier interpolation (RECON4), respectively. For noise simulation, 200 photons per measurement were used, and the noise only data were reconstructed using FDK algorithm. For each reconstructed volume, axial and coronal slice were extracted and detection-SNR was calculated using channelized Hotelling observer (CHO) with dense difference-of-Gaussian (D-DOG) channels. Results: Detection-SNR of coronal images varies for different backprojection methods, while axial images have a similar detection-SNR. Detection-SNR{sup 2} ratios of coronal and axial images in RECON1 and RECON2 are 1.33 and 1.15, implying that the coronal image has a better detectability than axial image. In other words, using coronal slices for the small target detection can reduce the patient dose about 33% and 15% compared to using axial slices in RECON 1 and RECON 2. Conclusion: In this work, we investigated slice direction dependent detectability of a volumetric cone beam CT image. RECON 1 and RECON 2 produced the highest detection-SNR, with better detectability in coronal slices. These results indicate that it is more beneficial to use coronal slice to improve detectability of a small target in a volumetric cone beam CT image. This research was supported by the MSIP (Ministry of Science, ICT and Future Planning), Korea, under the IT Consilience Creative Program (NIPA-2014-H0201-14-1002) supervised by the NIPA (National IT Industry Promotion Agency). Authors declares that s/he has no conflict of Interest in relation to the work in this abstract.

60 APPLIED LIFE SCIENCES↗

A High-Quality Workflow for Multi-Resolution Scientific Data Reduction and Visualization

Multi-resolution methods such as Adaptive Mesh Refinement (AMR) can enhance storage efficiency for HPC applications generating vast volumes of data. However, their applicability is limited and cannot be universally deployed across all applications. Furthermore, integrating lossy compression with multi-resolution techniques to further boost storage efficiency encounters significant barriers. To this end, we introduce an innovative workflow that facilitates high-quality multi-resolution data compression for both uniform and AMR simulations. Initially, to extend the usability of multi-resolution techniques, our workflow employs a compression-oriented Region of Interest (ROI) extraction method, transforming uniform data into a multi-resolution format. Subsequently, to bridge the gap between multi-resolution techniques and lossy compressors, we optimize three distinct compressors, ensuring their optimal performance on multi-resolution data. These optimizations can improve the compression ratio of SOTA approaches by up to 3.3× under the same data quality loss. Lastly, we incorporate an advanced uncertainty visualization method into our workflow to understand the potential impacts of lossy compression. Experimental evaluation demonstrates that our workflow achieves significant compression quality improvements.

Wang, Daoce↗

HIGH-RESOLUTION XMM-NEWTON SPECTROSCOPY OF THE COOLING FLOW CLUSTER A3112

We examine high signal-to-noise XMM-Newton European Photon Imaging Camera (EPIC) and Reflection Grating Spectrometer (RGS) observations to determine the physical characteristics of the gas in the cool core and outskirts of the nearby rich cluster A3112. The XMM-Newton Extended Source Analysis Software data reduction and background modeling methods were used to analyze the XMM-Newton EPIC data. From the EPIC data, we find that the iron and silicon abundance gradients show significant increase toward the center of the cluster while the oxygen abundance profile is centrally peaked but has a shallower distribution than that of iron. The X-ray mass modeling is based on the temperature and deprojected density distributions of the intracluster medium determined from EPIC observations. The total mass of A3112 obeys the M-T scaling relations found using XMM-Newton and Chandra observations of massive clusters at r{sub 500}. The gas mass fraction f{sub gas} = 0.149{sup +0.036}{sub -0.032} at r{sub 500} is consistent with the seven-year Wilkinson Microwave Anisotropy Probe results. The comparisons of line fluxes and flux limits on the Fe XVII and Fe XVIII lines obtained from high-resolution RGS spectra indicate that there is no spectral evidence for cooler gas associated with the cluster with temperature below 1.0 keV in the central <38'' ({approx}52 kpc) region of A3112. High-resolution RGS spectra also yield an upper limit to the turbulent motions in the compact core of A3112 (206 km s{sup -1}). We find that the contribution of turbulence to total energy is less than 6%. This upper limit is consistent with the energy contribution measured in recent high-resolution simulations of relaxed galaxy clusters.

79 ASTRONOMY AND ASTROPHYSICS↗

Noise reduction methods for nucleic acid and macromolecule sequencing

Methods, systems, and devices are disclosed for processing macromolecule sequencing data with substantial noise reduction. In one aspect, a method for reducing noise in a sequential measurement of a macromolecule comprising serial subunits includes cross-correlating multiple measured signals of a physical property of subunits of interest of the macromolecule, the multiple measured signals including the time data associated with the measurement of the signal, to remove or at least reduce signal noise that is not in the same frequency and in phase with the systematic signal contribution of the measured signals.

59 BASIC BIOLOGICAL SCIENCES↗

The SAGES Legacy Unifying Globulars and Galaxies survey (SLUGGS): sample definition, methods, and initial results

We introduce and provide the scientific motivation for a wide-field photometric and spectroscopic chemodynamical survey of nearby early-type galaxies (ETGs) and their globular cluster (GC) systems. The SAGES Legacy Unifying Globulars and GalaxieS (SLUGGS) survey is being carried out primarily with Subaru/Suprime-Cam and Keck/DEIMOS. The former provides deep gri imaging over a 900 arcmin{sup 2} field-of-view to characterize GC and host galaxy colors and spatial distributions, and to identify spectroscopic targets. The NIR Ca II triplet provides GC line-of-sight velocities and metallicities out to typically ∼8 R {sub e}, and to ∼15 R {sub e} in some cases. New techniques to extract integrated stellar kinematics and metallicities to large radii (∼2-3 R {sub e}) are used in concert with GC data to create two-dimensional (2D) velocity and metallicity maps for comparison with simulations of galaxy formation. The advantages of SLUGGS compared with other, complementary, 2D-chemodynamical surveys are its superior velocity resolution, radial extent, and multiple halo tracers. We describe the sample of 25 nearby ETGs, the selection criteria for galaxies and GCs, the observing strategies, the data reduction techniques, and modeling methods. The survey observations are nearly complete and more than 30 papers have so far been published using SLUGGS data. Here we summarize some initial results, including signatures of two-phase galaxy assembly, evidence for GC metallicity bimodality, and a novel framework for the formation of extended star clusters and ultracompact dwarfs. An integrated overview of current chemodynamical constraints on GC systems points to separate, in situ formation modes at high redshifts for metal-poor and metal-rich GCs.

79 ASTRONOMY AND ASTROPHYSICS↗

Dimensionality reduction

This chapter presents an introduction to some of the key dimensionality reduction methods currently used in data science. The intended audience is pure mathematicians. The chapter puts special emphasis on connecting the fundamental ideas in dimensionality reduction to a diverse set of mathematical domains, including geometry, dynamical systems, representation theory, and category theory.

dimension reduction, geometry, dynamical systems, ↗

Heavy ion beam probe advances from the first installation of the diagnostic on an RFP (invited)

Heavy ion beam probes have been installed on a variety of toroidal devices, but the first and only application on a reversed field pinch is the diagnostic on the Madison Symmetric Torus. Simultaneous measurements of spatially localized equilibrium potential and fluctuations of density and potential, previously inaccessible in the core of the reversed field pinch (RFP), are now attainable. These measurements reflect the unique strength of the heavy ion beam probe (HIBP) diagnostic. They will help determine the characteristics and evolution of electrostatic fluctuations and their role in transport, and determine the relation of the interior electric field and flows. Many aspects of the RFP present original challenges to HIBP operation and inference of plasma quantities. The magnetic field contributes to a number of the issues: the comparable magnitudes of the toroidal and poloidal fields and edge reversal result in highly three-dimensional beam trajectories; partial generation of the magnetic field by plasma current cause it and hence the beam trajectories to vary with time; and temporal topology and amplitude changes are common. Associated complications include strong ultraviolet radiation and elevated particle losses that can alter functionality of the electrostatic systems and generate noise on the detectors. These complexities have necessitated the development of new operation and data analysis techniques: the implementation of primary and secondary beamlines, adoption of alternative beam steering methods, development of higher precision electrostatic system models, refinement of trajectory calculations and sample volume modeling, establishment of stray particle and noise reduction methods, and formulation of alternative data analysis techniques. These innovative methods and the knowledge gained with this system are likely to translate to future HIBP operation on large scale stellarators and tokamaks.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Data-Driven Event Detection of Power Systems Based on Unequal-Interval Reduction of PMU Data and Local Outlier Factor

With the deployment of phasor measurement units (PMU) and wide area measurement system (WAMS), it is feasible to have an insight into the events occurred in power systems based on measured data. Thus, a novel data-driven algorithm based on local outlier factor (LOF) is proposed in this work to detect and locate events in power systems using reduced PMU data. First, the unequal-interval reduction method is presented to reduce the scale of PMU data in sub-stations and reconstruct it in master station of WAMS, which can relieve the burden of communication systems. Then, principle component analysis (PCA)-based similarity search method is proposed to measure the differences of operation state between any two buses. Next, LOF is presented to detect the abnormal events in power systems, and employed to determine the region of the event source. Finally, six cases from the Western electricity coordinating council (WECC) 179-bus power system, a case from the South China power system (SCPS), and a case from the Guangdong power system (GDPS) are utilized to demonstrate the effectiveness of the proposed algorithm. Overall, the results show that proposed algorithm is effective and can be applied to event detection, event location, and online monitoring, which can enhance the situation awareness ability of power system operators.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A novel MC TRT method: vectorizable variance reduction for the energy spectra

Data produced up to now gives us confidence that we will continue to see variance reduction behavior at amenable runtimes as we move this test bed forward. This method has characteristics of event and history based Monte Carlo transport, without the bulky modifications required by event based Monte Carlo while avoiding some overhead.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Complexity Reduction Methods for Large-Scale Spatially Explicit Biofuels Network Design

The size and complexity of energy system optimization models have increased significantly in recent years, driven by the availability of high-resolution spatial data. We present complexity reduction and solution methods that enable us to efficiently represent high-resolution spatial data in the network design of large-scale energy systems. We aim to reduce the size and enhance the computational efficiency of network design models without sacrificing solution accuracy. Specifically, we first present how to aggregate highly granular data into larger resolutions without averaging out their specific properties through a composite-curve-based approach and then develop a method to linearly represent these curves. Second, we utilize a general clustering method to determine groups of geographically proximate biomass fields and establish a single transportation arc for all of them, reducing the number of transportation-related variables while maintaining an accurate representation of the system. Finally, we introduce a two-step algorithm that decomposes large-scale network design problems into two smaller, more manageable subproblems. We demonstrate the application of our methods using a case study of switchgrass-to-biofuels network design in the eight states of the U.S. Midwest, using realistic and highly explicit spatial data.

09 BIOMASS FUELS↗

Image feature extraction and galaxy classification: a novel and efficient approach with automated machine learning

ABSTRACT In this work, we explore the possibility of applying machine learning methods designed for 1D problems to the task of galaxy image classification. The algorithms used for image classification typically rely on multiple costly steps, such as the point spread function deconvolution and the training and application of complex Convolutional Neural Networks of thousands or even millions of parameters. In our approach, we extract features from the galaxy images by analysing the elliptical isophotes in their light distribution and collect the information in a sequence. The sequences obtained with this method present definite features allowing a direct distinction between galaxy types. Then, we train and classify the sequences with machine learning algorithms, designed through the platform Modulos AutoML. As a demonstration of this method, we use the second public release of the Dark Energy Survey (DES DR2). We show that we are able to successfully distinguish between early-type and late-type galaxies, for images with signal-to-noise ratio greater than 300. This yields an accuracy of $86{{\ \rm per\ cent}}$ for the early-type galaxies and $93{{\ \rm per\ cent}}$ for the late-type galaxies, which is on par with most contemporary automated image classification approaches. The data dimensionality reduction of our novel method implies a significant lowering in computational cost of classification. In the perspective of future data sets obtained with e.g. Euclid and the Vera Rubin Observatory, this work represents a path towards using a well-tested and widely used platform from industry in efficiently tackling galaxy classification problems at the peta-byte scale.

79 ASTRONOMY AND ASTROPHYSICS↗

RECONNAISSANCE OF THE HR 8799 EXOSOLAR SYSTEM. I. NEAR-INFRARED SPECTROSCOPY

We obtained spectra in the wavelength range {lambda} = 995-1769 nm of all four known planets orbiting the star HR 8799. Using the suite of instrumentation known as Project 1640 on the Palomar 5 m Hale Telescope, we acquired data at two epochs. This allowed for multiple imaging detections of the companions and multiple extractions of low-resolution (R {approx} 35) spectra. Data reduction employed two different methods of speckle suppression and spectrum extraction, both yielding results that agree. The spectra do not directly correspond to those of any known objects, although similarities with L and T dwarfs are present, as well as some characteristics similar to planets such as Saturn. We tentatively identify the presence of CH{sub 4} along with NH{sub 3} and/or C{sub 2}H{sub 2}, and possibly CO{sub 2} or HCN in varying amounts in each component of the system. Other studies suggested red colors for these faint companions, and our data confirm those observations. Cloudy models, based on previous photometric observations, may provide the best explanation for the new data presented here. Notable in our data is that these presumably co-eval objects of similar luminosity have significantly different spectra; the diversity of planets may be greater than previously thought. The techniques and methods employed in this paper represent a new capability to observe and rapidly characterize exoplanetary systems in a routine manner over a broad range of planet masses and separations. These are the first simultaneous spectroscopic observations of multiple planets in a planetary system other than our own.

79 ASTRONOMY AND ASTROPHYSICS↗