Buoy - California - Wind Sentinel (130), Morro Bay - Processed Data
Processed data for various datasets.
17 WIND ENERGY↗
SEARCH · Search NASA
Results for “DATA PROCESSING”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
MCPC Friction Stir Welding (FSW) Process Data
Processing parameters and machine log data for the MCPC LDRD Agile investment is collected material samples processed. This dataset captures the selected processing parameters, machine logs captured during material processing, and descriptions of how characterization samples were extracted from processed plates of material. The collect characterization data is captured in other datasets.
316 Stainless Steel↗
Lidar - California - Leosphere Windcube 866 (130), Morro Bay - Processed Data
Processed daily lidar dataset.
17 WIND ENERGY↗
Performance Analysis of Data Processing in Distributed File Systems with Near Data Processing
In the era of big data, the escalating volume and velocity of data generation pose significant challenges in data processing. Traditional systems like Spark and Hadoop manage the increasing amount and velocity of data by improving data placement and processing speeds. However, they face inherent limitations due to the essential data movement required for processing. In this paper, we explore the Skyhook framework, a novel extension of the Ceph distributed system, which significantly reduces the need for data movement. We present an extensive case study using the Skyhook framework, applying it with the TPC-H and K-means clustering algorithms. More specifically, we leverage the TPC-H benchmark to distinguish between CPU-intensive and I/O-intensive tasks. We explore the integration of K-means clustering into SQL, coupled with a near-data processing system to offload the computational burden of the K-means clustering algorithm to storage nodes. We conduct a comprehensive performance evaluation of distributed data processing applications across three processing approaches: traditional layout (baseline), optimized layout, and near-data processing. Additionally, we introduce the use of the FIO tool to simulate real-world system workloads, enabling the measurement of performance metrics such as average latency and CPU utilization. Our research is a significant advance in understanding how to optimize data processing systems to meet the demands of the modern data landscape.
Hou, Shiyue↗
FPGA-based computing system for processing data in size, weight, and power constrained environments
Technologies that are well-suited for use in size, weight, and power (SWAP)-constrained environments are described herein. A host controller dispatches data processing instructions to hardware acceleration engines (HAEs) of one or more field programmable gate arrays (FPGAs) and further dispatches data transfer instructions to a memory controller, such that the HAEs perform processing operations on data stored in local memory devices of the HAEs in parallel with other data being transferred from external memory devices coupled to the FPGA(s) to the local memory devices.
Napier, Matthew↗
Data processing methods and data acquisition for samples larger than the field of view in parallel-beam tomography
Parallel-beam tomography systems at synchrotron facilities have limited field of view (FOV) determined by the available beam size and detector system coverage. Scanning the full size of samples bigger than the FOV requires various data acquisition schemes such as grid scan, 360-degree scan with offset center-of-rotation (COR), helical scan, or combinations of these schemes. Though straightforward to implement, these scanning techniques have not often been used due to the lack of software and methods to process such types of data in an easy and automated fashion. The ease of use and automation is critical at synchrotron facilities where using visual inspection in data processing steps such as image stitching, COR determination, or helical data conversion is impractical due to the large size of datasets. Here, we provide methods and their implementations in a Python package, named Algotom, for not only processing such data types but also with the highest quality possible. The efficiency and ease of use of these tools can help to extend applications of parallel-beam tomography systems.
36 MATERIALS SCIENCE↗
Data Processing Package for Cyclic Integrated Reversible Bending Fatigue Testing
A data processing software package has been introduced. The package was developed using MATLAB with the aid of the Curve Fitting Toolbox. The package is made up of four modules: pre-processing, data processing for static testing, data processing for monitoring, and data processing for measurements. CIRFT data are structured with multiple levels of architecture involving group, specimen, session, and scan/block. The degree of complexity of the data structure depends on whether a test is static or cyclic.The test results are presented in figures, scatter plots, and tables. For static testing, the output in tables provides bending mechanical properties and characteristic points of moment–curvature relation: flexural rigidities in linear segments of loading and unloading stages, intersection points between characteristic segments of the curve, and equivalent stress and strain quantities. For cyclic testing, the table output lists control and fatigue life and responsive/dependent quantities including moment, curvature, flexural rigidity, flexural hysteresis, rigidity phase angle, and equivalent stresses and strains. In addition, derivatives such as half-gage length and sensor spacing correction are included. The output also provides standard deviations of the reported quantities when they are applicable or available. The data processing package can serve as a fundamental characterization tool in mechanical study of materials. The package is intended primarily for data processing for the CIRFT process and can also be used in applications for which similar testing requirements exist.
36 MATERIALS SCIENCE↗
PhytoOracle: Scalable, modular phenomics data processing pipelines
As phenomics data volume and dimensionality increase due to advancements in sensor technology, there is an urgent need to develop and implement scalable data processing pipelines. Current phenomics data processing pipelines lack modularity, extensibility, and processing distribution across sensor modalities and phenotyping platforms. To address these challenges, we developed PhytoOracle (PO), a suite of modular, scalable pipelines for processing large volumes of field phenomics RGB, thermal, PSII chlorophyll fluorescence 2D images, and 3D point clouds. PhytoOracle aims to ( i ) improve data processing efficiency; ( ii ) provide an extensible, reproducible computing framework; and ( iii ) enable data fusion of multi-modal phenomics data. PhytoOracle integrates open-source distributed computing frameworks for parallel processing on high-performance computing, cloud, and local computing environments. Each pipeline component is available as a standalone container, providing transferability, extensibility, and reproducibility. The PO pipeline extracts and associates individual plant traits across sensor modalities and collection time points, representing a unique multi-system approach to addressing the genotype-phenotype gap. To date, PO supports lettuce and sorghum phenotypic trait extraction, with a goal of widening the range of supported species in the future. At the maximum number of cores tested in this study (1,024 cores), PO processing times were: 235 minutes for 9,270 RGB images (140.7 GB), 235 minutes for 9,270 thermal images (5.4 GB), and 13 minutes for 39,678 PSII images (86.2 GB). These processing times represent end-to-end processing, from raw data to fully processed numerical phenotypic trait data. Repeatability values of 0.39-0.95 (bounding area), 0.81-0.95 (axis-aligned bounding volume), 0.79-0.94 (oriented bounding volume), 0.83-0.95 (plant height), and 0.81-0.95 (number of points) were observed in Field Scanalyzer data. We also show the ability of PO to process drone data with a repeatability of 0.55-0.95 (bounding area).
59 BASIC BIOLOGICAL SCIENCES↗
EGS Collab Experiment 1: Circulation Testing Processed data
This submission includes processed and reduced data for circulation testing that was conducted at the 164' fracture on the 4850 ft level of the Sanford Underground Research Facility. The circulation tests were done to test the flow through the 164' fracture in the EGS Collab Experiment 1 testbed on the 4850 ft level of the Sanford Underground Research Facility in order to validate computer models concerned with flow processes and heat exchange processes in EGS. This data was processed from raw data that is available in the GDR submission linked below: "EGS Collab Circulation Testing Raw Data and Documentation." Python scripts used to process and reduce the data are included. The scripts also serve as "documentation" as well as examples for data processing. More information about the test itself as well as the rationale and process of data processing is available at wiki page linked below.
15 GEOTHERMAL ENERGY↗
LiDAR-Based Point Cloud Data Processing
The presentation includes the procedures of utilizing LiDAR-based point cloud data in WebGL applications, such as capturing data, processing data, importing point cloud into Unity software, and improving application performance. It uses IRC BLD 603 Lab B-12 as an example. It'll be presented at Viz n Learn workshop which is a collaboration series between INL's Applied Visualization Laboratory (AVL) and University of Wyoming (UW)'s Shell 3D Visualization center. Each session will highlight 2 projects from each institution monthly, followed by discussion on areas of collaborative interest and action.
3D↗
Development of nuclear data processing code FRENDY version 2
Nuclear data processing is an important interface between an evaluated nuclear data library and neutronics calculation codes. JAEA has been developed the new nuclear data processing code FRENDY from 2013. FRENDY version 1 generates the ACE files used for the continuous-energy Monte Carlo codes including PHITS, Solomon, Serpent,and MCNP and it was released as the open-source software under the 2-clause BSD license in 2019.After we released FRENDY version 1, many functions, e.g., the multi-group neutron cross-section library generation, the statistical uncertainty quantification of the probability tables for unresolved resonance cross-section, the 'perturbation' of the ACE file for uncertainty quantification, and the modification of the ENDF-6 formatted nuclear data file, have been developed. We released FRENDY version 2 including these functions. The present paper gives an overview of FRENDY and presents features of new functions implemented in FRENDY version 2. (authors)
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
A Discrete Hankel Transform Approach to Nuclear Data Processing for Fusion Applications
This study introduces advancements to the numerical solutions employed in the processing of nuclear data for fusion applications. It leverages the convolution theorem and Fourier transform techniques to enhance computational efficiency and broaden applicability. Building upon a previously reported discrete Hankel transform approach for Doppler broadening, this work refines the solution of convolution integrals central to these applications. The methodology provides a general and unified framework for evaluating any convolution operation, regardless of whether the underlying problem involves temperature effects in nuclear reactions. The applicability to the nuclear data processing for fusion is demonstrated by deriving the convolution integrals for some of the fusion-related quantities. As before, the convolution operation utilizes a Gaussian-based kernel; however, the discrete Hankel transform of order $𝛼$ = $\frac{1}{2}$ is now applied to the forward Fourier transform of the nonkernel argument, rather than the inverse Fourier transform. This modification eliminates the need for the integration of the nonkernel, cross section–based function, which is a step that posed challenges for certain pointwise cross-section representations. It also removes the requirement for cross-section linearization. Optimized for graphics processing unit architectures, the approach significantly improves computational performance. These advancements are currently under evaluation as the foundation for the next-generation thermonuclear data file processing codes being developed at Lawrence Livermore National Laboratory.
Nuclear science and engineering↗
Isolated data processing modules
This disclosure relates to computer systems that isolate data processing modules and methods of operating the same. In one embodiment of a method, a computer system receives a first data processing request for a first data file. The computer system may determine that a first data type of the first data file is supported by an encapsulated data processing module and determine a first communication protocol from a set of communication protocols that can be used to receive the first data file. The computer system can then receive the first data file from the first storage location in accordance with the first communication protocol and the encapsulated data processing module may be executed to convert the first data file in the first data format into second data in a second data format.
Penton, Joshua Michael↗
Observational process data analytics using causal inference
Voluminous process data are available with the paradigm shift toward smart manufacturing. However, most historical data are observational, containing noncausal correlations due to confounders and mediators. Estimating causal effects from observational data remains a bottleneck in leveraging them for active applications such as optimization and control. Further, this work aims to introduce a causal modeling framework for analyzing observational process data and extracting quantitative causal information. We demonstrate a real-world application in steel manufacturing where causal inference is used to analyze observational production data and improve the steelmaking process. Additionally, we propose a novel formulation for identifying critical process parameters from observational data, where causal inference is combined with variance-based methods to estimate corresponding risks of interventions to the manufacturing system. The proposed methods are compared with statistical ones to illustrate that causally interpreting statistical correlation leads to problematic results, while the provided workflow generates satisfactory strategies for process improvement.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Geometric conditions for saturating the data processing inequality
Abstract The data processing inequality (DPI) is a scalar inequality satisfied by distinguishability measures on density matrices. For some distinguishability measures, saturation of the scalar DPI implies an operator equation relating the arguments of the measure. These results are typically derived using functional analytic techniques. In a complementary approach, we use geometric techniques to derive a formula that gives an operator equation from DPI saturation for any distinguishability measure; moreover, for a broad class of distinguishability measures, the derived operator equation is sufficient to imply saturation as well. Our operator equation coincides with known results for the sandwiched Rényi relative entropies, and gives new results for α - z Rényi relative entropies and a family of of quantum f -divergences, which we compute explicitly.
Physics↗
Site C1 UTD Sonic Anemometer / Processed Data
This dataset contains processed data from the Site C1 UTD Sonic Anemometer.
17 WIND ENERGY↗
ARM Site E36 - CLAMPS 2 Microwave Radiometer / Processed Data
This dataset contains processed data from the CLAMPS 2 Humidity And Temperature PROfiler (HATPRO) Microwave Radiometer and its associated meteorology tower. CLAMPS 2 deployed during fall-winter 2022 (10/3/22-12/27/23) and summer-fall 2023 (6/16/23-10/1/23).
17 WIND ENERGY↗
WFIP3 - RHOD site - NREL Scanning lidar (upgraded Galion SN:60) / Processed Data
This dataset contains processed data from the rear-facing Halo XR lidar on G06 in the King Plains wind farm.
17 WIND ENERGY↗