Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

THE OPTICAL AND NEAR-INFRARED TRANSMISSION SPECTRUM OF THE SUPER-EARTH GJ 1214b: FURTHER EVIDENCE FOR A METAL-RICH ATMOSPHERE

We present an investigation of the transmission spectrum of the 6.5 M{sub Circled-Plus} planet GJ 1214b based on new ground-based observations of transits of the planet in the optical and near-infrared, and on previously published data. Observations with the VLT + FORS and Magellan + MMIRS using the technique of multi-object spectroscopy with wide slits yielded new measurements of the planet's transmission spectrum from 0.61 to 0.85 {mu}m, and in the J, H, and K atmospheric windows. We also present a new measurement based on narrow-band photometry centered at 2.09 {mu}m with the VLT + HAWKI. We combined these data with results from a reanalysis of previously published FORS data from 0.78 to 1.00 {mu}m using an improved data reduction algorithm, and previously reported values based on Spitzer data at 3.6 and 4.5 {mu}m. All of the data are consistent with a featureless transmission spectrum for the planet. Our K-band data are inconsistent with the detection of spectral features at these wavelengths reported by Croll and collaborators at the level of 4.1{sigma}. The planet's atmosphere must either have at least 70% H{sub 2}O by mass or optically thick high-altitude clouds or haze to be consistent with the data.

79 ASTRONOMY AND ASTROPHYSICS↗

CALIBRATING 100 YEARS OF POLAR FACULAE MEASUREMENTS: IMPLICATIONS FOR THE EVOLUTION OF THE HELIOSPHERIC MAGNETIC FIELD

Although the Sun's polar magnetic fields are thought to provide important clues for understanding the 11 year sunspot cycle, including the observed variations of its amplitude and period, the current database of high-quality polar field measurements spans relatively few sunspot cycles. In this paper, we address this deficiency by consolidating Mount Wilson Observatory polar faculae data from four data reduction campaigns, validating it through a comparison with facular data counted automatically from Michelson Doppler Imager (MDI) intensitygrams, and calibrating it against polar field measurements taken by the Wilcox Solar Observatory and average polar field and total polar flux calculated using MDI line-of-sight magnetograms. Our results show that the consolidated polar facular measurements are in excellent agreement with both polar field and polar flux estimates, making them an ideal proxy to study the evolution of the polar magnetic field. Additionally, we combine this database with sunspot area measurements to study the role of the polar magnetic flux in the evolution of the heliospheric magnetic field (HMF). We find that there is a strong correlation between HMF and polar flux at solar minimum and that, taken together, polar flux and sunspot area are better at explaining the evolution of the HMF during the last century than sunspot area alone.

79 ASTRONOMY AND ASTROPHYSICS↗

Tightly integrated single- and multi-crystal data collection strategy calculation and parallelized data processing in JBluIce beamline control system

The calculation of single- and multi-crystal data collection strategies and a data processing pipeline have been tightly integrated into the macromolecular crystallographic data acquisition and beamline control software JBluIce . Both tasks employ wrapper scripts around existing crystallographic software. JBluIce executes scripts through a distributed resource management system to make efficient use of all available computing resources through parallel processing. The JBluIce single-crystal data collection strategy feature uses a choice of strategy programs to help users rank sample crystals and collect data. The strategy results can be conveniently exported to a data collection run. The JBluIce multi-crystal strategy feature calculates a collection strategy to optimize coverage of reciprocal space in cases where incomplete data are available from previous samples. The JBluIce data processing runs simultaneously with data collection using a choice of data reduction wrappers for integration and scaling of newly collected data, with an option for merging with pre-existing data. Data are processed separately if collected from multiple sites on a crystal or from multiple crystals, then scaled and merged. Results from all strategy and processing calculations are displayed in relevant tabs of JBluIce .

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Solving protein structure from sparse serial microcrystal diffraction data at a storage ring synchrotron source

This dataset consists of 79,992 diffraction patterns stored in cbf format. A step-by-step tutorial on the reconstruction of the Bragg intensities using the EMC algorithm (Loh & Elser 2009) is described [here](https://github.com/tl578/EMC-for-SMX/wiki). We thank the authors of Martin-Garcia et al. (2017) for their gracious access to the data. Reduced data files: For those who would like to try an EMC reconstruction immediately, the data reduction step can be skipped by downloading the reduced data files provided by us. See [here](https://github.com/tl578/EMC-for-SMX/wiki/Data-reduction#skipping-data-reduction) for more details.

23-ID-D↗

Data-Driven Event Detection of Power Systems Based on Unequal-Interval Reduction of PMU Data and Local Outlier Factor

With the deployment of phasor measurement units (PMU) and wide area measurement system (WAMS), it is feasible to have an insight into the events occurred in power systems based on measured data. Thus, a novel data-driven algorithm based on local outlier factor (LOF) is proposed in this work to detect and locate events in power systems using reduced PMU data. First, the unequal-interval reduction method is presented to reduce the scale of PMU data in sub-stations and reconstruct it in master station of WAMS, which can relieve the burden of communication systems. Then, principle component analysis (PCA)-based similarity search method is proposed to measure the differences of operation state between any two buses. Next, LOF is presented to detect the abnormal events in power systems, and employed to determine the region of the event source. Finally, six cases from the Western electricity coordinating council (WECC) 179-bus power system, a case from the South China power system (SCPS), and a case from the Guangdong power system (GDPS) are utilized to demonstrate the effectiveness of the proposed algorithm. Overall, the results show that proposed algorithm is effective and can be applied to event detection, event location, and online monitoring, which can enhance the situation awareness ability of power system operators.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A Co-design Framework for Online Data Analysis and Reduction

Science applications preparing for the exascale era are increasingly exploring in situ computations comprising of simulation-analysis-reduction pipelines coupled in-memory. Efficient composition and execution of such complex pipelines for a target platform is a codesign process that evaluates the impact and tradeoffs of various application- and system-specific parameters. In this article, we describe a toolset for automating performance studies of composed HPC applications that perform online data reduction and analysis. We describe Cheetah, a new framework for composing parametric studies on coupled applications, and Savanna, a runtime engine for orchestrating and executing campaigns of codesign experiments. Furthermore, this toolset facilitates understanding the impact of various factors such as process placement, synchronicity of algorithms, and storage versus compute requirements for online analysis of large data. Ultimately, we aim to create a catalog of performance results that can help scientists understand tradeoffs when designing next-generation simulations that make use of online processing techniques. We illustrate the design of Cheetah and Savanna, and present application examples that use this framework to conduct codesign studies on small clusters as well as leadership class supercomputers.

97 MATHEMATICS AND COMPUTING↗

Standard Galactic Field RR Lyrae. I. Optical to Mid-infrared Phased Photometry

We present a multi-wavelength compilation of new and previously published photometry for 55 Galactic field RR Lyrae variables. Individual studies, spanning a time baseline of up to 30 years, are self-consistently phased to produce light curves in 10 photometric bands covering the wavelength range from 0.4 to 4.5 microns. Data smoothing via the GLOESS technique is described and applied to generate high-fidelity light curves, from which mean magnitudes, amplitudes, rise times, and times of minimum and maximum light are derived. 60,000 observations were acquired using the new robotic Three-hundred MilliMeter Telescope (TMMT), which was first deployed at the Carnegie Observatories in Pasadena, CA, and is now permanently installed and operating at Las Campanas Observatory in Chile. We provide a full description of the TMMT hardware, software, and data reduction pipeline. Archival photometry contributed approximately 31,000 observations. Photometric data are given in the standard Johnson UBV, Kron–Cousins R{sub C}I{sub C}, 2MASS JHK, and Spitzer [3.6] and [4.5] bandpasses.

79 ASTRONOMY AND ASTROPHYSICS↗

Multiresolution classification of turbulence features in image data through machine learning

During large-scale simulations, intermediate data products such as image databases have become popular due to their low relative storage cost and fast in-situ analysis. Serving as a form of data reduction, these image databases have become more acceptable to perform data analysis on. In this work, we present an image-space detection and classification system for extracting vortices at multiple scales through wavelet-based filtering. A custom image-space descriptor is used to encode a large variety of vortex-types and a machine learning system is trained for fast classification of vortex regions. By combining a radial-based histogram descriptor, a bag of visual words feature descriptor, and a support vector machine, our results show that we are able to detect and classify vortex features at various sizes at multiple scales. Once trained, our framework enables the fast extraction of vortices on new, unknown image datasets for flow analysis.

97 MATHEMATICS AND COMPUTING↗

Workflows Community Summit 2022: A Roadmap Revolution

Scientific workflows have become integral tools in broad scientific computing use cases. Science discovery is increasingly dependent on workflows to orchestrate large and complex scientific experiments that range from the execution of a cloud-based data preprocessing pipeline to multi-facility instrument-to-edge-to-HPC computational workflows. Given the changing landscape of scientific computing (often referred to as a computing continuum) and the evolving needs of emerging scientific applications, it is paramount that the development of novel scientific workflows and system functionalities seek to increase the efficiency, resilience, and pervasiveness of existing systems and applications. Specifically, the proliferation of machine learning/artificial intelligence (ML/AI) workflows, need for processing large-scale datasets produced by instruments at the edge, intensification of near real-time data processing, support for long-term experiment campaigns, and emergence of quantum computing as an adjunct to HPC, have significantly changed the functional and operational requirements of workflow systems. Workflow systems now need to, for example, support data streams from the edge-to-cloud-to-HPC, enable the management of many small-sized files, allow data reduction while ensuring high accuracy, orchestrate distributed services (workflows, instruments, data movement, provenance, publication, etc.) across computing and user facilities, among others. Further, to accelerate science, it is also necessary that these systems implement specifications/standards and APIs for seamless (horizontal and vertical) integration between systems and applications, as well as enable the publication of workflows and their associated products according to the FAIR principles.

97 MATHEMATICS AND COMPUTING↗

First M87 Event Horizon Telescope Results. VII. Polarization of the Ring

In 2017 April, the Event Horizon Telescope (EHT) observed the near-horizon region around the supermassive black hole at the core of the M87 galaxy. These 1.3 mm wavelength observations revealed a compact asymmetric ring-like source morphology. This structure originates from synchrotron emission produced by relativistic plasma located in the immediate vicinity of the black hole. Here we present the corresponding linear-polarimetric EHT images of the center of M87. We find that only a part of the ring is significantly polarized. The resolved fractional linear polarization has a maximum located in the southwest part of the ring, where it rises to the level of ~15%. The polarization position angles are arranged in a nearly azimuthal pattern. We perform quantitative measurements of relevant polarimetric properties of the compact emission and find evidence for the temporal evolution of the polarized source structure over one week of EHT observations. The details of the polarimetric data reduction and calibration methodology are provided. We carry out the data analysis using multiple independent imaging and modeling techniques, each of which is validated against a suite of synthetic data sets. The gross polarimetric structure and its apparent evolution with time are insensitive to the method used to reconstruct the image. These polarimetric images carry information about the structure of the magnetic fields responsible for the synchrotron emission. Their physical interpretation is discussed in an accompanying publication.

79 ASTRONOMY AND ASTROPHYSICS↗

Contextual Compression of Large-Scale Wind Turbine Array Simulations: Preprint

Data sizes are becoming a critical issue particularly for HPC applications. We have developed a user-driven lossy wavelet-based storage model to facilitate the analysis and visualization of large-scale wind turbine array simulations. The model stores data as heterogeneous blocks of wavelet coefficients, providing high-fidelity access to user-defined data regions believed the most salient, while providing lower-fidelity access to less salient regions on a block-by-block basis. In practice, by retaining the wavelet coefficients as a function of feature saliency, we have seen data reductions in excess of 94 percent, while retaining lossless information in the turbine-wake regions most critical to analysis and providing enough (low-fidelity) contextual information in the upper atmosphere to track incoming coherent turbulent structures. Our contextual wavelet compression approach has allowed us to deliver interactive visual analysis while providing the user control over where data loss, and thus reduction in accuracy, in the analysis occurs. We argue this reduced but contexualized representation is a valid approach and encourages contextual data management.

17 WIND ENERGY↗

Revisiting galactic black hole binary GX 339-4 by using 2007 – 2014 Swift XRT observations

This work aims to study the X-ray properties of the galactic black hole binary GX 339-4. Focus of the study is on exploration of data from Swift-XRT in exclusively photon-counting mode. We use data from 2007 up to August 2014, which contain about 40 pointing observations with level 1 data. The flux of GX 339-4 varies in a factor of 100 during this period of observations. For the purpose of this work, we also try to develop a system to conduct standard SWIFT XRT data reduction automatically, in order to greatly reduce time when working with data bulk, which produces images, lightcurves as well as spectra. We also develop another system to conduct fitting of bulk spectral data with a two-component model, disk blackbody and power-law. The fitting results show that no data have a reduced chi-squared > 2. The fraction of the disk to total flux and the power-law to total flux range from 0.00389 – 0.994 and 0.00605 – 0.996, respectively. From the analysis of the disk component, we obtain the value of the innermost disk radius that does not show any large scale truncation which is in a good agreement with a previous study that used 2007 – 2011 Swift-XRT data, indicating that the systems we developed work properly.

79 ASTRONOMY AND ASTROPHYSICS↗

A Digital Twin Framework Utilizing Machine Learning for Robust Predictive Maintenance: Enhancing Tire Health Monitoring

We introduce a novel digital twin (DT) framework for the predictive maintenance of long-term physical systems. Using monitoring tire health as an application, we show how the DT framework can be used to enhance automotive safety and efficiency, and how the technical challenges can be overcome using a three-step approach. First, to manage the data complexity over a long operation span, we employ data reduction techniques to concisely represent physical tires using historical performance and usage data. Relying on these data, for fast real-time prediction, we train a transformer-based model offline on our concise dataset to predict future tire health over time, represented as remaining casing potential (RCP). Based on our architecture, our model quantifies both epistemic and aleatoric uncertainties, providing reliable confidence intervals around predicted RCP. Second, to incorporate real-time data, we update the predictive model in the DT framework, ensuring its accuracy throughout its lifespan with the aid of hybrid modeling and the use of the discrepancy function. Third, to assist decision-making in predictive maintenance, we implement a tire state decision algorithm, which strategically determines the optimal timing for tire replacement based on RCP forecasted by our transformer model. This approach ensures that our DT accurately predicts system health, continually refines its digital representation, and supports predictive maintenance decisions. Furthermore, our framework effectively embodies a physical system, leveraging big data and machine learning (ML) for predictive maintenance, model updates, and decision-making.

advanced computing infrastructure↗

Advanced Image Reconstruction for MCP Detector in Event Mode

A two-step data reduction framework is proposed in this study to reconstruct a radiograph from the data collected with a micro-channel plate (MCP) detector operating under event mode. One clustering algorithm and three neutron event back-tracing models are proposed and evaluated using both example data and a full scan data. The reconstructed radiographs are analyzed, the results of which are used to suggest future development.

Zhang, Chen↗

Bringing Different Views Together: A Hybrid Cooperative Perception Framework for Connected Autonomous Vehicles

Cooperative perception will be essential for connected autonomous vehicles to enhance object recognition and optimize path planning by sending data information about the surrounding environment. However, an inherent challenge in existing systems is the high bandwidth cost of transmitting information in real-time, which restricts cooperative perception’s practicality. Here, this work presents a hybrid cooperative perception fusion framework aimed at mitigating this issue by optimizing data transmission according to available bandwidth or through data reduction techniques. Our methods ensure that vehicles can rapidly transmit high-confidence data without overwhelming the network. Experimental results indicate that our methodology substantially diminishes data transmission sizes while maintaining object detection accuracy. For cooperative perception in autonomous vehicle systems, our approach provides a scalable and effective way to get past the bandwidth barrier.

Carrillo, Dominic [Univ. of North Texas, Denton, T↗

Progressive Tree-Based Compression of Large-Scale Particle Data

Scientific simulations and observations using particles have been creating large datasets that require effective and efficient data reduction to store, transfer, and analyze. However, current approaches either compress only small data well while being inefficient for large data, or handle large data but with insufficient compression. Toward effective and scalable compression/decompression of particle positions, we introduce new kinds of particle hierarchies and corresponding traversal orders that quickly reduce reconstruction error while being fast and low in memory footprint. Our solution to compression of large-scale particle data is a flexible block-based hierarchy that supports progressive, random-access, and error-driven decoding, where error estimation heuristics can be supplied by the user. For low-level node encoding, we introduce new schemes that effectively compress both uniform and densely structured particle distributions. Our proposed methods thus target all three phases of a tree-based particle compression pipeline, namely tree construction, tree traversal, and node encoding. In conclusion, the improved efficacy and flexibility of these methods over existing compressors are demonstrated through extensive experimentation, using a wide range of scientific particle datasets.

97 MATHEMATICS AND COMPUTING↗

Kvichak River RISEC Project Resource Reconnaissance and Physical Characterization, Igiugig, AK

During the summer and fall of 2011 TerraSond Ltd. (TerraSond) completed a bathymetric survey and hydrokinetic energy assessment of the Kvichak River at Igiugig, Alaska. The purpose of this work was to characterize the initial site conditions for the design and installation of a hydrokinetic turbine to provide electric power for the village. There were six distinct phases of work for this project. The first was a literature review and investigation of prior surveys and hydrologic studies done in the area. The second, third, fourth, and fifth phases consisted of four field expeditions conducted over the summer and fall of 2011. These expeditions consisted of an initial reconnaissance, multi beam bathymetric surveys, flow velocity and discharge measurements, a survey of water levels, and detailed flow velocity studies. The final phase of the project was complete data reduction, and preparation of the final report with its accompanying map sheets and data packages. This submission contains the final report for the Kvichak River RiISEC Project in addition to weather data for Igiugig, AK, Summer 2015.

16 TIDAL AND WAVE POWER↗

Top Ten Interaction Challenges in Extreme-Scale Visual Analytics

The chapter presents ten selected user interfaces and interaction challenges in extreme-scale visual analytics. The study of visual analytics is often referred to as 'the science of analytical reasoning facilitated by interactive visual interfaces' in the literature. The discussion focuses on the issues of applying visual analytics technologies to extreme-scale scientific and non-scientific data ranging from petabyte to exabyte in sizes. The ten challenges are: in situ interactive analysis, user-driven data reduction, scalability and multi-level hierarchy, representation of evidence and uncertainty, heterogeneous data fusion, data summarization and triage for interactive query, analytics of temporally evolving features, the human bottleneck, design and engineering development, and the Renaissance of conventional wisdom. The discussion addresses concerns that arise from different areas of hardware, software, computation, algorithms, and human factors. The chapter also evaluates the likelihood of success in meeting these challenges in the near future.

99 GENERAL AND MISCELLANEOUS↗