Results for “Data processing methods” — Page 2

NASA NTRS2016

Ultrasonic NDE Simulation for Composite Manufacturing Defects

The increased use of composites in aerospace components is expected to continue into the future. The large scale use of composites in aerospace necessitates the development of composite-appropriate nondestructive evaluation (NDE) methods to quantitatively characterize defects in as-manufactured parts and damage incurred during or post manufacturing. Ultrasonic techniques are one of the most common approaches for defect/damage detection in composite materials. One key technical challenge area included in NASA's Advanced Composite's Project is to develop optimized rapid inspection methods for composite materials. Common manufacturing defects in carbon fiber reinforced polymer (CFRP) composites include fiber waviness (in-plane and out-of-plane), porosity, and disbonds; among others. This paper is an overview of ongoing work to develop ultrasonic wavefield based methods for characterizing manufacturing waviness defects. The paper describes the development and implementation of a custom ultrasound simulation tool that is used to model ultrasonic wave interaction with in-plane fiber waviness (also known as marcelling). Wavefield data processing methods are applied to the simulation data to explore possible routes for quantitative defect characterization.

Leckey, Cara A. C.↗

DOE OSTI2025

Distinguishing isotropic and anisotropic signals for X-ray total scattering using machine learning

Understanding structure–property relationships is essential for advancing technologies based on thin films. X-ray pair distribution function (PDF) analysis can access relevant atomic structure details spanning local-, mid- and long-range structure. While X-ray PDF has been adapted for thin films on amorphous substrates, measurements on single-crystal substrates are necessary to accurately determine structure origins for some thin film materials, especially those for which the substrate changes the accessible structure and properties. However, when measuring films on single-crystal substrates, high-intensity anisotropic Bragg spots saturate 2D detector images, overshadowing the thin films' isotropic scattering signal. This renders previous data processing methods for films on amorphous substrates unsuitable for films on single-crystal substrates. To address this measurement need, we developed IsoDAT2D, an innovative data processing approach using unsupervised machine learning algorithms. The program combines dimensionality reduction and clustering algorithms to separate thin film and single-crystal substrate X-ray scattering signals. We use SimDAT2D , a program we developed to generate simulated thin film data, to validate IsoDAT2D . Here we also use IsoDAT2D to isolate X-ray total scattering signal from a thin film on a single-crystal substrate. The resulting PDF data are compared with similar data processed using previous methods, especially substrate subtraction for single-crystal and amorphous substrates. PDF data from IsoDAT2D -identified X-ray total scattering data are significantly better than from single-crystal substrate subtraction, but not as reliable as PDF data from amorphous substrate subtraction. With IsoDAT2D , there are new opportunities to expand PDF to a wider variety of thin films, including those on single-crystal substrates, with which new structure–property relationships can be elucidated to enable fundamental understanding and technological advances.

36 MATERIALS SCIENCE↗

NASA NTRS1995

Programmable Iterative Optical Image And Data Processing

Proposed method of iterative optical image and data processing overcomes limitations imposed by loss of optical power after repeated passes through many optical elements - especially, beam splitters. Involves selective, timed combination of optical wavefront phase conjugation and amplification to regenerate images in real time to compensate for losses in optical iteration loops; timing such that amplification turned on to regenerate desired image, then turned off so as not to regenerate other, undesired images or spurious light propagating through loops from unwanted reflections.

Jackson, Deborah J.↗

DOE OSTI2025

WHONDRS River Corridor Sediment and Water Geochemistry and In Situ Sensor Data from 7 Perennial and 7 Intermittent Streams across San Antonio, Texas (v3)

This dataset supports a broader study examining the effects of intermittency on sediment respiration. The dataset provides sediment and surface water geochemistry and in situ sensor data from 7 perennial and 7 intermittent streams in San Antonio, Texas. Each stream/site was visited both in summer during base flow (July-September 2023) and winter during peak flow (January-February 2024). Related data were collected and will be published separately in collaboration with A. Veach. The data package was originally published in April 2025. It was updated in June 2025 (v2; modified and new files) and September 2025 (v3; modified files). See the change history section in the readme for more details. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. This dataset is comprised of two folders of field photos and videos, one folder of raw Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) data and one main data folder containing (1) file-level metadata; (2) data dictionary; (3) field metadata; (4) readme; (5) international generic sample number (IGSN) mapping file; (6) field protocol; (7) a subfolder with sample data; and (8) a subfolder with sensor data. The sample data subfolder contains (1) surface water and sediment dissolved organic carbon (DOC, measured as non-purgeable organic carbon, NPOC) data and averages; (2) surface water and sediment total nitrogen data and averages; (3) sediment grain size data; (4) sediment iron (II) data and averages; (5) wet sediment mass, dry sediment mass, water mass, and wet sediment volume in incubation and sediment ICR vials; (7) sediment incubation respiration rate data and averages; (8) normalized respiration rate data and averages; (9) methods codes; (10) sediment percent carbon and nitrogen; (11) sediment X-ray diffraction (XRD) data; (12) gravimetric moisture and averages; (13) a subfolder with sediment incubation respiration data, scripts, and plots; (14) surface water and sediment FTICR methods; and (15) a subfolder of 9.4 Tesla (9.4T) FTICR-MS data. This folder contains five subfolders, one containing the sediment .xml data files, one containing the water .xml files, one containing the sediment CoreMS output files, one containing the water CoreMS output files, and the other containing instructions and scripts for processing the files in CoreMS (https://github.com/EMSL-Computing/CoreMS). The sensor data subfolder contains (1) a subfolder with miniDOT dissolved oxygen and temperature data and plots; (2) miniDOT dissolved oxygen and temperature summary data; and (3) miniDOT installation methods. All files are .csv, .pdf, .R, .xml, .d, .html, .Rmd, .py, .cal, .json, .jpg, .jpeg, .png, .mov, or .mp4. CORRECTION: The data processing methods for FTICR described in “v3_WHONDRS_AV1_Methods_Codes.csv” mistakenly indicate that users should process the data in Formultitude. The corrected description should read: “Both unprocessed and processed data are provided to allow users flexibility in data processing. Instructions and scripts for processing the data using CoreMS are included.” CORRECTION: Carbon and nitrogen content are reported as percentages. The current column headers "01395_C_percent_per_mg" and "01397_N_percent_per_mg" are incorrect. These should read "01395_C_percent" and "01397_N_percent" and will be corrected in the next version of this data package.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

WA-Omic_LA.1.0 - Quantitative Lipidomics, Metabolomics, and Sequencing (16S/ITS) Publication Data DOI Package

Corresponding Data Publication: "Rapid remodeling of the soil lipidome in response to a drying-rewetting event." This study reveals specific changes in lipids and metabolites that are indicative of stress adaptation, substrate use, and cellular recovery during soil drying and subsequent rewetting. Drought induced nutrient limitation was reflected in the lipidome and polar metabalome, both of which rapidly shifted (within hours) upon rewet. Reduced nutrient access in dry soil caused the replacement of glycerophospholipids with phosphorus-free lipids and impeded resource-expensive osmolyte accumulation. Elevated levels of ceramides and lipids with long chain polyunsaturated fatty acids, in dry soil suggests that lipids play an important role in fungal drought tolerance. Increasing abundance of bacterial glycerophospholipids and triacylglycerols with fatty acids typical of bacteria and polar metabolites suggest metabolic recovery in representative bacteria once the environmental conditions are conducive for growth. These results underscore the importance of the soil lipidome as a robust indicator of microbial community responses, especially at the short time scales of cell-environment reactions. Data package contents reported here are the first version and contain pre- and post-processed data acquisition and subsequent downstream analysis files using various data source instrument method techniques and Mass Spectroscopy (MS) EMSL capabilities. This publication data package DOI is a comprehensive high-throughput multi-omics data lifecycle collection containing processed data method metadata. Support files include additional data download “Read Me” file containing data descriptor information and data source application ontologies (see data dictionary). Reported data download contents are structured for compliance with project data sharing guidelines, community standards initiatives, and sponsor stakeholder policies supporting FAIR data principles. For increased data availability and interoperability, GC-MS/LC-MS mass spectrometry datasets (Thermo .raw ) were deposited at the MassIVE database repository under the related data accession MSV000086931 and can be accessed by using the API. Statistical data processing software, analysis tools, and data workflows are listed below corresponding to the host repository long-term location.

Amplicon sequencing 16S ITS LC-MS/MS lipidomics mu↗

DOE OSTI2021

WA-Omic_LA.1.0 - Quantitative Lipidomics, Metabolomics, and Sequencing (16S/ITS) Publication Data DOI Package

Corresponding Data Publication: "Rapid remodeling of the soil lipidome in response to a drying-rewetting event." This study reveals specific changes in lipids and metabolites that are indicative of stress adaptation, substrate use, and cellular recovery during soil drying and subsequent rewetting. Drought induced nutrient limitation was reflected in the lipidome and polar metabalome, both of which rapidly shifted (within hours) upon rewet. Reduced nutrient access in dry soil caused the replacement of glycerophospholipids with phosphorus-free lipids and impeded resource-expensive osmolyte accumulation. Elevated levels of ceramides and lipids with long chain polyunsaturated fatty acids, in dry soil suggests that lipids play an important role in fungal drought tolerance. Increasing abundance of bacterial glycerophospholipids and triacylglycerols with fatty acids typical of bacteria and polar metabolites suggest metabolic recovery in representative bacteria once the environmental conditions are conducive for growth. These results underscore the importance of the soil lipidome as a robust indicator of microbial community responses, especially at the short time scales of cell-environment reactions. Data package contents reported here are the first version and contain pre- and post-processed data acquisition and subsequent downstream analysis files using various data source instrument method techniques and Mass Spectroscopy (MS) EMSL capabilities. This publication data package DOI is a comprehensive high-throughput multi-omics data lifecycle collection containing processed data method metadata. Support files include additional data download “Read Me” file containing data descriptor information and data source application ontologies (see data dictionary). Reported data download contents are structured for compliance with project data sharing guidelines, community standards initiatives, and sponsor stakeholder policies supporting FAIR data principles. For increased data availability and interoperability, GC-MS/LC-MS mass spectrometry datasets (Thermo .raw ) were deposited at the MassIVE database repository under the related data accession MSV000086931 and can be accessed by using the API. Statistical data processing software, analysis tools, and data workflows are listed below corresponding to the host repository long-term location.

Amplicon sequencing 16S ITS LC-MS/MS lipidomics mu↗

DOE OSTI2021

WA-Omic_LA.1.0 - Quantitative Lipidomics, Metabolomics, and Sequencing (16S/ITS) Publication Data DOI Package

Corresponding Data Publication: "Rapid remodeling of the soil lipidome in response to a drying-rewetting event." This study reveals specific changes in lipids and metabolites that are indicative of stress adaptation, substrate use, and cellular recovery during soil drying and subsequent rewetting. Drought induced nutrient limitation was reflected in the lipidome and polar metabalome, both of which rapidly shifted (within hours) upon rewet. Reduced nutrient access in dry soil caused the replacement of glycerophospholipids with phosphorus-free lipids and impeded resource-expensive osmolyte accumulation. Elevated levels of ceramides and lipids with long chain polyunsaturated fatty acids, in dry soil suggests that lipids play an important role in fungal drought tolerance. Increasing abundance of bacterial glycerophospholipids and triacylglycerols with fatty acids typical of bacteria and polar metabolites suggest metabolic recovery in representative bacteria once the environmental conditions are conducive for growth. These results underscore the importance of the soil lipidome as a robust indicator of microbial community responses, especially at the short time scales of cell-environment reactions. Data package contents reported here are the first version and contain pre- and post-processed data acquisition and subsequent downstream analysis files using various data source instrument method techniques and Mass Spectroscopy (MS) EMSL capabilities. This publication data package DOI is a comprehensive high-throughput multi-omics data lifecycle collection containing processed data method metadata. Support files include additional data download “Read Me” file containing data descriptor information and data source application ontologies (see data dictionary). Reported data download contents are structured for compliance with project data sharing guidelines, community standards initiatives, and sponsor stakeholder policies supporting FAIR data principles. For increased data availability and interoperability, GC-MS/LC-MS mass spectrometry datasets (Thermo .raw ) were deposited at the MassIVE database repository under the related data accession MSV000086931 and can be accessed by using the API. Statistical data processing software, analysis tools, and data workflows are listed below corresponding to the host repository long-term location.

Amplicon sequencing 16S ITS LC-MS/MS lipidomics mu↗

NASA NTRS1995

Digital Array Scanned Interferometer: Sensors And Results

Digital Array Scanned Interferometers (DASI), blend characteristics of a grating spectrometer and a two-beam interferometer for acquisition of hyperspectra. DASIs possess field widened capabilities that permit very high throughput. Aspects of DASI design, hyperspectra and data processing methods are presented. In particular, we provide data showing the important result that photon noise limited hyperspectra are achievable for DASI data acquired with a variety of FPAs.

Smith, William Hyaden↗

DOE OSTI2024

High-Throughput Data Processing at FRIB Using ESnet

Real-time or nearly real-time (nearline) data processing methods are critical tools as detector technologies and data acquisition (DAQ) systems allow for higher data rates and volumes. The introduction of the energy sciences network (ESnet), a U.S. Department of Energy (DOE) supported high-speed network for scientific research, creates opportunities to leverage the computing power of DOE facilities like the National Energy Research Scientific Computing Center (NERSC). As a first step toward realizing a DOE Office of Science Integrated Research Infrastructure (IRI) pattern, an automated workflow was developed to remotely process data obtained from a nuclear physics experiment at the Facility for Rare Isotope Beams (FRIB) at NERSC with data transferred between FRIB and NERSC over ESnet. The workflow demonstrated the ability to process one week’s worth of experimental data in approximately 90 min and was used successfully for nearline analysis during a recently completed FRIB experiment. Here, a summary of the workflow development and results of recent demonstrations will be presented.

Data processing↗

DOE OSTI2022

In situ detection and characterization of alkali-silica reaction damage in concrete using contactless ultrasonic wavefield imaging

Here we present work to characterize cracking damage in concrete caused by alkali-silica reactivity distress. We apply contactless ultrasonic scan inspection, exploiting Rayleigh wave scattering from concrete inhomogeneities. The scanning system utilizes a multi-channel MEMS sensor array to collect ultrasonic wavefield data from concrete subjected to ASR-promoting environments. The location and extent of ASR damage are established by internal expansion measurements from embedded strain gauges, scanning electron microscope images of cored samples, and expansion measurements from companion samples. A wavefield data processing method extracts oscillatory fields from the ultrasonic wavefield data to detect distinct zones of ASR damage. A damage index is proposed to further characterize the extent of ASR damage. The results confirm the feasibility and accuracy of the approach to characterize ASR damage in concrete. The fully contactless ultrasonic scanning measurement system does not require separate material samples and enables in situ characterization of ASR damage within concrete structures.

36 MATERIALS SCIENCE↗

NASA NTRS1995

GPS as an orbit determination subsystems

This paper evaluates the use of Global Positioning System (GPS) receivers as a primary source of tracking data for low-Earth orbit satellites. GPS data is an alternative to using range, azimuth, elevation, and range-rate (RAER) data from the Air Force Satellite Control Network antennas, the Space Ground Link System (SGLS). This evaluation is applicable to missions such as Skipper, a joint U.S. and Russian atmosphere research mission, that will rely on a GPS receiver as a primary tracking data source. The Detachment 2, Space and Missile Systems Center's Test Support Complex (TSC) conducted the evaluation based on receiver data from the Space Test Experiment Platform Mission O (STEP-O) and Advanced Photovoltaic and Electronics Experiments (APEX) satellites. The TSC performed orbit reconstruction and prediction on the STEP-0 and APEX vehicles using GPS receiver navigation solution data, SGLS RAER data, and SGLS anglesonly (azimuth and elevation) data. For the STEP-O case, the navigation solution based orbits proved to be more accurate than SGLS RAER based orbits. For the APEX case, navigation solution based orbits proved to be less accurate than SGLS RAER based orbits for orbit prediction, and results for orbit reconstruction were inconclusive due to the lack of a precise truth orbit. After evaluating several different GPS data processing methods, the TSC concluded that using GPS navigation solution data is a viable alternative to using SGLS RAER data.

Fennessey, Richard↗

DOE OSTI2025

AI for nuclear physics: the EXCLAIM project

An overview of the recent activity of the newly funded EXCLusives with AI and Machine learning (EXCLAIM) collaboration is presented. The main goal of the collaboration is to develop a framework to implement AI and machine learning techniques in problems emerging from the phenomenology of high energy exclusive scattering processes from nucleons and nuclei, maximizing the information that can be extracted from various sets of experimental data, while implementing theoretical constraints from lattice QCD. A specific perspective embraced by EXCLAIM is to use the methods of theoretical physics to understand the working of ML, beyond its standardized applications to physics analyses which most often rely on industrially provided tools, in an automated way.

Analysis and statistical methods↗

NASA NTRS1979

Mean sea level determination from satellite altimetry

The primary experiment on the Geodynamics Experimental Ocean Satellite-3 (GEOS-3) is the radar altimeter. This experiment's major objective is to demonstrate the utility of measuring the geometry of the ocean surface; i.e., the geoid. Results obtained from this experiment so far indicate that the planned objectives of measuring the topography of the ocean surface with an absolute accuracy of + or - 5 m can be met and perhaps exceeded. The GEOS-3 satellite altimeter measurements have an instrument precision in the range of + or - 25 cm to + or - 50 cm when the altimeter is operating in the 'short pulse' mode. After one year's operations of the altimeter, data from over 5000 altimeter passes have been collected. With the mathematical models developed and the altimeter data presently available, mapping of local areas of ocean topography has been realized to the planned accuracy levels and better. This paper presents the basic data processing methods employed and some interesting results achieved with the early data. Plots of mean sea surface heights as inferred by the altimeter measurements are compared with a detailed 1 by 1 deg gravimetric geoid.

Kahn, W. D.↗

DOE OSTI2020

Quantitative probing of the fast particle motion during the solidification of battery electrodes

Synchrotron x-ray tomography represents one of the most powerful imaging techniques that can visualize the three-dimensional microstructural complexity with a high spatial resolution. To date, however, the temporal resolution of this technique has been handicapped by the intrinsic limitations in the data acquisition speed and the lack of a suitable data processing method. The present study aims to fundamentally resolve this challenge by implementing a data analysis method that is based on differentiating discrete tomography reconstruction from a continuous scan reconstruction. With this methodological development, we capture and quantify the particle motion during the solidification of battery electrodes and reveal the statistics of the dynamically evolving motion in the drying process, which has been challenging to resolve. We discover that the particle motion exhibits a strong dependence on its geometric location within a drying electrode. Our results also imply that the final electrode quality can be controlled by balancing the solvent evaporation rate and the particle mobility in the region close to the drying surface.

25 ENERGY STORAGE↗

NASA NTRS1985

Criteria for site selection and frequency allocation (keynote paper), part 5

Technical aspects of mesosphere-stratosphere-troposphere (MST) Radar on site and frequency selection were discussed. Recommendations on site selections are presented. Tests of interference will be conducted before selecting a site. A small directional antenna may be suitable to simulate sidelobe sensitivity of radars however, sophisticated data-processing methods make system sensitivity extremely good. The use of the complete data system to look for interference is recommended. There is the difficulty of allocation of frequencies -- almost continuous use by these radars will be made when the band 40 to 60 MHz is allocated to other services.

Rottger, J.↗

DOE OSTI2025

Object detection with deep learning for rare event search in the GADGET II TPC

In the pursuit of identifying rare two-particle events within the GADGET II Time Projection Chamber (TPC), this paper presents a comprehensive approach for leveraging Convolutional Neural Networks (CNNs) and various data processing methods. To address the inherent complexities of 3D TPC track reconstructions, the data is expressed in 2D projections and 1D quantities. This approach capitalizes on the diverse data modalities of the TPC, allowing for the efficient representation of the distinct features of the 3D events, with no loss in topology uniqueness. Additionally, it leverages the computational efficiency of 2D CNNs and benefits from the extensive availability of pre-trained models. Given the scarcity of real training data for the rare events of interest, simulated events are used to train the models to detect real events. To account for potential distribution shifts when predominantly depending on simulations, significant perturbations are embedded within the simulations. This produces a broad parameter space that works to account for potential physics parameter and detector response variations and uncertainties. These parameter-varied simulations are used to train sensitive 2D CNN object detectors. When combined with 1D histogram peak detection algorithms, this multi-modal detection framework is highly adept at identifying rare, two-particle events in data taken during experiment 21072 at the Facility for Rare Isotope Beams (FRIB), demonstrating a 100% recall for events of interest. Here, we present the methods and outcomes of our investigation and discuss the potential future applications of these techniques.

Convolutional neural network↗

NASA NTRS2018

UAS-Based P-Band Signals of Opportunity for Remote Sensing of Snow and Root Zone Soil Moisture

We have developed the P-band Signals of Opportunity (SoOp) sensor based on the Unmanned Aircraft System (UAS) to remotely sense Snow Water Equivalent (SWE) and Root Zone Soil Moisture (RZSM). The P-band UAS SoOp sensor for Hydrology (UASHydro) would operate on the S2 aircraft developed by Black Swift Technologies for sensing of SWE and RZSM with a spatial resolution of about 10m. Root-zone soil moisture and snow water storage in land are critical parameters of the water cycle. The long-term goal of our development would be to use small UAS to perform regional high resolution observation of two key hydrological measurements to improve the estimation of terrestrial water storage for water management, crop production and forecasts of natural hazard. The UASHydro concept utilizes passive receivers to detect the reflection of strong existing P-band radio signals at the 360-380 MHz band from geostationary Mobile Use Objective System (MUOS) communication satellites launched by the US Navy. The SWE remote sensing measurement principle using the P-band SoOp is based on the propagation delay (or phase change) of radio signals through the snowpack. The time delay of the reflected signal due to the snowpack with respect to snow-free conditions is directly proportional to the snowpack SWE, while the soil moisture can be retrieved from the reflectivity at the P-band frequencies for MUOS. We have been conducting ground-based campaigns to test the instrumentation and data processing methods at the Fraser Experimental Forest in Colorado since February 2016. The field campaign data has provided support to the measurement concept. To install the SoOp technologies on the UAS, a lightweight antenna has been built and interfaces with the S2 built by Black Swift Technologies have been completed. A set of flights have been planned starting April 2018 through the end of 2018 in Colorado.

Elston, Jack↗

DOE OSTI2026

The South Pole Telescope AGN Monitoring Campaign: First Release of SPTpol Bright AGN Light Curves

The South Pole Telescope (SPT) collaboration has recently embarked upon a campaign to monitor the brightness of a sample of active galactic nuclei (AGN), both in real time and in archival SPT data. The original design of the SPT was optimized for observations of the cosmic microwave background (CMB) at arc-minute and larger angular scales, and it has been used for this purpose for nearly twenty years, using three generations of CMB cameras. Recently it has been recognized that data from CMB experiments have the potential to be used for AGN monitoring. In this paper, we present the first public release of data from a full sample of SPT-monitored AGN, comprising 158 AGN light curves and associated data from the SPTpol camera, which was operational from 2012-2016. These light curves were created using observations from the SPTpol 500 deg$^{2}$ survey, in which the instrument was used to scan a 500 deg$^2$ patch of the sky several times per day with detectors sensitive to radiation in bands centered at 90 and 150 GHz. We provide a comprehensive description of the observations, the data processing methods, and the resulting light curve catalog. As an example of analyses that these data enable, we searched for a correlation between variability and spectral index, and we looked for ``bluer-when-brighter'' trends in the sample. Our analysis finds $> 10 σ$ correlation between fractional intrinsic variance and mean spectral index in the sample, but no significant evidence for bluer-when-brighter trends. The datasets from this study can be accessed through the SPT Treasury Record of AGN With Historical Activity and Time-Series or STRAWHAT catalog. This initial data release includes SPTpol light curves at 90 and 150 GHz, focusing on total intensity. In later updates, SPTpol polarization data and new observations from the SPT-3G instrument at 90, 150, and 220 GHz will be included.

Hood, J.C., II [Chicago U., KICP; Chicago U., Astr↗