Search NASA⌕ Search

SEARCH · Search NASA

Results for “process data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56

Architecture Of A Multi-channel Data Streaming Device With An Fpga As A Coprocessor

The design of a data acquisition system often involves the integration of a Field Programmable Gate Array (FPGA) with analog front-end components to achieve precise timing and control. Reuse of these hardware systems can be difficult since they need to be tightly coupled to the communications interface and timing requirements of the specific ADC used. A hybrid design exploring the use of FPGA as a coprocessor to a traditional CPU in a dataflow architecture is presented. Reduction in the volume of data and gradual transitioning of data processing away from a hard real-time environment are both discussed. Chief design concerns, including data throughput and precise synchronization with external stimuli, are addressed. The discussion is illustrated by the implementation of a multi-channel digital integrator, a device based entirely on commercial off-the-shelf (COTS) equipment.

Nogiec, Jerzy M.↗

Modeling of Vertical Motor-driven Pump for Simulation of a Fault Signature \\ for Condition Monitoring

As part of the ongoing effort to transition from preventive maintenance strategies to condition-based maintenance strategies in nuclear power plants, there is significant reliance on using machine learning techniques. To develop a robust machine learning model that can diagnose all the fault modes of a vertical motor-driven pump, data capturing the unique signature of each fault mode is required. In practice, it is difficult to collect or capture data that captures all the fault modes from a single plant site. So to address this situation, a computational model of a vertical motor-driven pump is developed using the multipurpose finite element software COMSOL Multiphysics. The developed model is used to generate simulated data under normal operation and is compared with the vibration data collected using vibration sensors. Once the simulation model is verified under normal operating condition, simulated data for the fault mode for which minimal or no evidence is available in historical plant process data is developed. This simulated data is used to develop fault signatures to achieve robust predictive models. This paper presents modeling details and verification of the model that can used to generate data for fault modes that are not available at a plant site for condition monitoring purpose.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Modeling of Vertical Motor-driven Pump for Simulation of a Fault Signature \\ for Condition Monitoring

As part of the ongoing effort to transition from preventive maintenance strategies to condition-based maintenance strategies in nuclear power plants, there is significant reliance on using machine learning techniques. To develop a robust machine learning model that can diagnose all the fault modes of a vertical motor-driven pump, data capturing the unique signature of each fault mode is required. In practice, it is difficult to collect or capture data that captures all the fault modes from a single plant site. So to address this situation, a computational model of a vertical motor-driven pump is developed using the multipurpose finite element software COMSOL Multiphysics. The developed model is used to generate simulated data under normal operation and is compared with the vibration data collected using vibration sensors. Once the simulation model is verified under normal operating condition, simulated data for the fault mode for which minimal or no evidence is available in historical plant process data is developed. This simulated data is used to develop fault signatures to achieve robust predictive models. This paper presents modeling details and verification of the model that can used to generate data for fault modes that are not available at a plant site for condition monitoring purpose.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Two-Column Aerosol Project (TCAP) Field Campaign Report

This study included the deployment of the Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Climate Research Facility’s Mobile Facility (AMF), ARM Mobile Aerosol Observing System (MAOS) and the ARM Aerial Facility (AAF). The study was a collaborative effort involving scientists from DOE national laboratories, NOAA, NASA, and universities. The AAF and MAOS were deployed for two approximately month-long Intensive Operational Periods (IOPs) conducted in June 2012 and February 2013. Seasonal differences in the aerosol chemical and optical properties observed using the AMF, AAF, and MAOS are presented in this report. The total mass loading of aerosol is found to be much greater in the summer than in the winter, with the difference associated with greater amounts of organic aerosol. The mass fraction of organic aerosol is much reduced in the winter, when sulfate is the dominant aerosol type. Surprisingly, very little sea-salt aerosol was observed in the summer. In contrast, much more sea salt aerosol was observed in the winter. The mass loading of black carbon is nearly the same in both seasons. These differences lead to a relative increase in the aerosol light absorption in the winter and an associated decrease in observed single-scattering albedo. Measurements of aerosol mixing state were made using a single-particle mass spectrometer, which showed that the majority of the summertime aerosol consisted of organic compounds mixed with various amounts of sulfate. A number of other findings are also summarized in the report, including: impact of aerosol layers aloft on the column aerosol optical depth; documentation of the aerosol properties at the AMF; differences in the aerosol properties associated with both columns, which are not systematic but reflect the complicated meteorological and chemical processes that impact aerosol as it is advected away from North America; and new instruments and data-processing techniques for measuring both aerosol and cloud properties that were deployed for the first time during the TCAP. Key lessons learned during TCAP include the need for closer coordination between the AMF, MAOS, and the AAF so that all AMF instruments can be online and functioning during the AAF IOPs. Based on experiences from TCAP, it is also important for instrument mentors, or other relevant individuals, to review data on a regular basis to ensure that data quality remains high during the entire deployment. TCAP was marked by two important meteorological events including the passage of Hurricane Sandy at the end of October 2012 and the occurrence of one of the largest New England blizzards in recorded history. During Sandy the AMF received some, generally minor, damage and was largely functional a short time after the storm. The blizzard led to extensive power outages on Cape Cod and a multi-day interruption of measurements by the AMF, MAOS, and AAF. In each case, however, the ARM Facilities were returned to service and functioning as soon as was reasonably possible.

54 ENVIRONMENTAL SCIENCES↗

Predicting High‐Resolution Spatial and Spectral Features in Mass Spectrometry Imaging with Machine Learning and Multimodal Data Fusion

Recent advancements in molecular Mass Spectrometry Imaging have sparked interest in integrating high spatial resolution methods with molecular mass-spectrometry-based chemical imaging. Fusion-based algorithms have proven effective in generating high spatial-resolution molecular mass spectra. However, a significant challenge stems from the differing physical mechanisms underlying image generation and data upsampling techniques, potentially leading to discrepancies in integrated information channels. Integrating physical constraints into data processing workflows is essential to tackle this issue. In this study, we propose an innovative approach that merges data from Fourier transform ion cyclotron resonance (FTICR), time-of-flight matrix-assisted laser desorption/ionization, and time-of-flight secondary ion mass spectrometry imaging techniques. By leveraging FT-ICR's unparalleled spectral resolution and ToF-SIMS's exceptional spatial resolution, we achieve submicron spatial resolution, enabling the observation of intact molecular species with remarkable spectral precision. Canonical correlation analysis is employed to incorporate physical constraints. Through sophisticated image processing and machine learning techniques, the results of this fusion hold significant promise for advancing our comprehension of complex systems and unveiling concealed molecular intricacies.

canonical correlation analysis↗

ESnet/JLab FPGA Accelerated Transport

To increase the science rate for high data rates/volumes, Thomas Jefferson National Accelerator Facility (JLab) has partnered with Energy Sciences Network (ESnet) to define an edge to data center traffic shaping / steering transport capability featuring data event aware network shaping and forwarding. The keystone of this ESnet+JLab FPGA Accelerated Transport (EJFAT) is the joint development of an AI/ML directed dynamic compute work Load Balancer (LB) of UDP streamed data. The LB is a suite consisting of a Field Programmable Gate Array (FPGA) executing the dynamically configurable, low fixed latency LB data plane featuring real-time packet redirection and high throughput, and a control plane running on the FPGA host computer that monitors network and compute farm telemetry in order to make dynamic AI/ML guided decisions for destination compute host redirection/load balancing and destination resource provisioning. The LB provides for three-tier horizontal scaling across LB suites, core compute hosts, and CPUs within a host. The LB effectively provides seamless integration of edge/core computing to support direct experimental data processing for immediate use by JLab science programs and others such as the EIC as well as data centers of the future requiring high throughput and low latency for both hot and cooled data for both running experiment data acquisition systems and data center use cases.

97 MATHEMATICS AND COMPUTING↗

Subsurface electrical conductivity across the BEO site inferred using a capacitively coupled resistivity survey in May 2013, Utqiagvik, Alaska

Multiple transects across and around the Barrow Environmental Observatory (BEO) site were surveyed using a capacitively coupled resistivity tool to infer the subsurface electrical conductivity in the top ~6 m in order to improve the understanding of heterogeneity in ice and salinity content. This work was led by the environmental geophysics team from Lawrence Berkeley National Laboratory as part of the Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic). The acquisition was performed in May 2013 using a capacitively coupled resistivity tool (OhmMapper from Geometrics, Inc) mounted behind a sled hooked to a snowmobile. Twenty-eight ~750 m long transects cover the NGEE intensive site (polygon areas A, B, C, D) in the BEO with a measurement (apparent resistivity for 5 different geometries) taken every 1.5 to 2 m. The survey also includes other transects that have been acquired along Electrical Resistivity Tomography (ERT) transects previously acquired at the site (Site 0, AB, and BD), and several long transects (up to 7 km each) around the BEO site crossing several Drained Thawed Lake Basins (DTLB). The various transects acquired during this survey cover a distance of about 100 km. All the datasets are provided with the acquisition geometry and the associated subsurface apparent electrical conductivity. In addition, the 28 transects at the BEO intensive site were inverted to infer the subsurface electrical conductivity. Unprocessed and processed data products are included in this package. This metadata document contains a description of the survey and processing steps and the inferred products.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic) was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy’s Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska, and 2) multiple areas in the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy’s Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Meteorological and Soil Data from Ecohydrology Sensor Towers at Pump House and Snodgrass Mountain in East River Watershed, Colorado, 2019-2025

This data package includes hourly meteorological and soil sensor data at eight ecohydrology monitoring sites in East River Watershed, Colorado as part of the Watershed Function Scientific Focus Area (WFSFA) research led by Lawrence Berkeley National Lab (LBNL). Four field sites were located on the hillslope of East River (ER) near Pump House (PH) at Mount Crested Butte (ER-PHS1 to 4), and the other four are in the Snodgrass Mountain (SG) area (SG-EHS5 to 8). In terms of vegetation cover, three sites are in montane grasslands (ER-PHS1, ER-PHS2, and SG-EHS5), three are below evergreen conifer canopy (ER-PHS3, SG-EHS6, and SG-EHS7), and two are below deciduous aspen canopy (ER-PHS4 and SG-EHS8). The monitoring period began in October 2019 at the East River sites, in October 2020 at SG-EHS5 and SG-EHS6, and in October 2021 at SG-EHS7 and SG-EHS8. In September 2024, all four East River sites were fully retired. The four Snodgrass Mountain sites remain active. Each site is equipped with a comprehensive suite of meteorological sensors on a tripod and soil sensors that measure weather, energy fluxes, and soil variables. This data package includes measurements from ten different types of sensors and up to thirteen individual sensors per site, including (1) a weather station (measurement height ranges from 2.8~3.8 meters (m) above ground), (2) a quantum sensor for photosynthetic active radiation (PAR) (2.4~3.3m), (3) a net radiometer (1.7~2.1m), (4) an infrared radiometer (1.6~2.2m), (5) a sonic distance sensor (1.5~1.9m), (6) a soil carbon dioxide (CO2) flux chamber (0m), (7) a soil heat flux plate (-0.05m below ground), (8) a soil oxygen sensor (-0.3m), (9) a soil water potential sensor (-0.3m), and (10) soil water content sensors at 3~4 depths (-1.15 ~ -0.1m). A total of twenty-three variables is reported in this data package, including (1) atmospheric variables: air temperature (TA), atmospheric pressure (PA), vapor pressure (VP), and vapor pressure deficit (VPD), (2) precipitation variables: rain precipitation (P) and snow depth (D_SNOW), (3) energy fluxes variables: four-component net radiation (NETRAD) (shortwave/longwave incoming/outgoing radiation, SW_IN, SW_OUT, LW_IN, LW_OUT), photosynthetic photon flux density (PPFD), and soil heat flux (G), (4) soil variables: soil water content (SWC), soil water potential (SWP), soil temperature (TS), soil bulk electrical conductivity (COND_SOIL), and soil gaseous oxygen concentration (O2_SOIL), (5) wind variables: two-dimensional wind speed (WS), gust speed (WS_MAX), and wind direction (WD), and (6) surface variables: surface infrared temperature (T_CANOPY) and soil CO2 flux (CO2_SOIL). Please see the Methods section for data processing and QA/QC steps taken to generate the hourly datasets. The following files are included in this data package (notes on version: v{x}-{y}, where x is the metadata version, and y is the data version, when applicable): (1) “metadata_site_v{x}-{y}.csv” - a site metadata file that summarizes location information of all sites, including site ID, description, coordinates, timeframe, elevation, and vegetation cover, (2) “metadata_instrument_v{x}-{y}.csv” - an instrument metadata file that summarizes sensor information of all sites, including sensor manufacturer and model, measurement height, and sampling and averaging interval of all variables, (3) "data_{SITE_ID}_v{x}-{y}.csv" - eight data files that contain hourly data of each site indicated by {SITE_ID} in the filename, (4) “/figure/data_{SITE_ID}_v{x}-{y}.png" - eight figures that help visualize data of each site indicated by {SITE_ID} in the filename, (5) “/photo/*” - photos of each site indicated by {SITE_ID} in the filename, and (6) four file level metadata (flmd.csv) and data dictionary (*_dd.csv) files that summarize file, header, column, and variable information of all files. Notes: (1) Measurement height: Each variable name is followed by conventional positional qualifiers “H_V_R”, where H indicates the relative horizontal positions of that specific variable, V the vertical positions, and R the replicates. In this data package, only the vertical qualifier V varies, and V increases from the highest vertical position (V=1) to the lowest. Variables with the same qualifier are not necessarily measured by the same sensor, and the same variable with the same qualifier across different sites are not necessarily measured at the same height. Please refer to “metadata_instrument.csv” for the sensor information and measurement heights, and whether a variable is measured below the canopy. (2) Variable availability: Snow depth is not available at ER-PHS3 and SG-EHS7. SWC, soil temperature, and soil bulk EC at the deepest depth (<-1m) are not available at SG-EHS6 and SG-EHS7. The missing value code for numeric variables is -9999, except for SWP. For SWP, the missing value code is +9999, because SWP values are negative. (3) Sampling frequency: Please refer to “metadata_instrument.csv” for the increase of sampling frequency of some variables from 30-min to 1-min at ER-PHS1 to 4 in July 2020. (4) Sensors: While the methods of each sensor are not detailed, all sensors are commercially available, and their methods can be found in their manuals. Please refer to “metadata_instrument.csv” for the sensor manufacturer and model information. This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

54 ENVIRONMENTAL SCIENCES↗

A Novel Approach to Map Permeability Using Passive Seismic Emission Tomography

Newly acquired magnetotelluric data and passive seismic data collected with tightly spaced geophone arrays are combined with historic drilling, active seismic, and potential fields data to generate 3-D permeability maps. A cooperative inversion methodology has been developed using active seismic, magnetotelluric, and gravity data in order to produce more robust velocity models for passive seismic data processing without requiring expensive 3-D active seismic surveys. The cooperative inversion estimates velocities from other geophysical data where no prior seismic velocity information is available at two geothermal sites in Nevada: San Emidio and Crescent Valley.

15 GEOTHERMAL ENERGY↗

ON PROCESS STABILITY IN WAAM-CMT OF ALUMINUM ALLOYS

Wire-arc additive manufacturing (WAAM) has become a cost-efficient metal additive manufacturing process. However, depositing aluminum with WAAM is challenging due to its sensitivity to heat input (linear energy density), which can cause undesirable surface topology waviness if not controlled. Thus, a process window is needed that can produce stable geometry and deposition conditions while minimizing production times. In this study, 5183 aluminum alloy wire is used to deposit 10-layer walls with varying wire feed speeds (WFS) and traverse speeds (TS) (at a constant WFS/TS ratio) and varying interpass temperature (IPT). In-situ process data consisting of optical contact-tip-workpiece-distance (CTWD) and current/voltage measurements are collected to determine process condition stability throughout the build. Part geometry is measured using a 3D scanner and build porosity is characterized via digital X-ray. A process window is identified that produces stable surface topology and process conditions at a minimal production time.

aluminum alloy↗

How Can Construction Process Simulation Modeling Aid the Integration of Lean Principles in the Factory-Built Housing Industry?

New and existing factories that produce and deliver factory-built housing can benefit from construction process simulation modeling to explore the integration of Lean principles in their operations. Construction process simulation modeling provides digital or virtual recreations of the real-world factory environments to visualize, quantify, analyze, and optimize their underlying behavior, including factory productivity, material flow, labor dynamics, bottlenecks, and work scope. One of the key benefits of process simulation modeling is the ability to create and compare "what-if" scenarios, including integrating Lean principles such as reducing waste (for example, transportation, waiting), line balancing, and just-in-time concepts. In general, three process simulation methods are widely used: discrete event simulation (DES), agentbased modeling (ABM), and system dynamics (SD). Myriad process simulation software also is available, but depending on the industry, complexity of the system, and purposes of the simulation, some software might be more appropriate. Similar to how computer-aided design (CAD) software such as AutoCAD and Rhinoceros enable building design of modular or factory-built housing, process simulation modeling software such as jStrobe, ProModel, and AnyLogic can enable factory design of new and existing factories to deliver modular affordable housing at scale, as opposed to traditional site-built construction. Software with DES capabilities can help generate a process model that is a logical representation of resources and activities in a factory. Software with CAD-DES integration can leverage product-process data integration to help spatially visualize a DES model of the factory in the CAD environment. Software with multimethod simulation capabilities, widely used in the manufacturing industry, brings together DES, ABM, and SD in a single platform that allows visualization, quantification, analyses, and optimization at varying data fidelities. Near-real-time data from an existing factory can be directly plugged into multimethod simulation software so that the construction process simulation model is a near-accurate representation of the real-world factory conditions. This report provides insights into the use of simulation as an aid to integrate Lean concepts in factories, including guidelines for selecting the appropriate process simulation modeling method and software. These insights have been developed as part of ongoing process simulation modeling research, development, and demonstration projects at the U.S. Department of Housing and Urban Development, the U.S. Department of Energy, and the National Renewable Energy Laboratory focused on how process simulation models can enable better integration of resilience, energy efficiency, and low-carbon design strategies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

R and DE Robotic Sensor Intern Team: Advanced Sensor Suite Prototype

The Department of Energy (DOE) nuclear complex includes many hazardous and challenging environments that must be inspected remotely and routinely for structural integrity evaluation and long-term planning purposes. The H-Canyon Air Exhaust (HCAEX) Tunnel is an example of such an environment where a biannual inspection is currently performed. Presently inspections are performed by teleoperated robotic crawlers which provide low-res video feedback to the structural engineers. Advanced sensors: including Lidar and panospheric hi-res cameras have the potential to provide additional valuable data in future inspections. The primary goal of the sensor suite is to provide an internal 3D map of the HCAEX tunnel. Possible sensors were a stereo camera, a 3D Lidar, or a 2D Lidar that would need to be spun around. The issues with the stereo camera were that it does not have a large field-of-view and that its depth information was not nearly as accurate as even the baseline Lidars. The Hokuyo UTM-30LX-EW shown below provides a 270 deg. FOV with high accuracy and resolution while the largest FOV on a 3D Lidar is 40 deg. This was the reason a 2D Lidar was chosen over the 3D Lidar. Even though the 2D Lidar requires additional components and software to generate a 3D map, its FOV advantage is too great given that the HCAEX tunnel is a relatively confined space. Along with the Lidar, a camera sensor, IMU sensor, pan-tit unit, and on board computer needed to be identified. The two panospheric cameras allow for full 360 deg. FOV. The IMU will give data on the state of the robot inside the tunnel. The computer is used to gather and process data on board and to control the pan-tilt system. Mounts were designed and 3D printed to build the prototype of the sensor suite. It was designed to have the Lidar on top With its full FOV free while having the camera below and as close to together as possible while still leaving much of their FOV visible. The design also managed the cables such that they were unlikely to be damaged if in tension and so that they did not intrude much on the cameras vision. The sensor tree developed for the H-Canyon tunnel inspection project produces a large quantity of camera and Lidar data. a postprocessing pipeline was created to facilitate the analysis of these data. The pipeline follows the following routine: 1) Registration - Salient local features in subsequent scans are identified and used to align the scans With one another. This allows production of a single cohesive map of the tunnel. 2) Sensor Fusion - RGB camera data is 'painted' onto the depth data created by the Lidar. 3) Segmentation - Individual surfaces from within the scene are segmented out separately for individual analysis. 4) Degradation Analysis - Automatic mapping of local deviation from the plane in position or surface normal is performed, as is detection of exposed rebar using Lidar return intensity. 2) Obstacle Detection - Lidar data is also used in real time to detect obstacles in the environment. This could give feedback to the operator to successfully drive in the tunnel. 6) Graphic User Interface - a custom GUI was created to facilitate customer use of the system. The system provides real-time feedback from both the cameras and Lidar. The Lidar point-cloud data is also used for obstacle detection. As the Lidar spins, various algorithms are run to analyze the current 'slice' and obstacles in the environment are determined and registered on a cost-map. A Graphical User Interface (GUI) was developed to allow the user to easily command the crawler to set the rotational speed of the Lidar, perform a scan, and register and save the 3D generated cloud after a scan is done. For the good of the crawler, a critical aspect of the GUI design is to allow the user to cancel a scan any time after it is commanded and before it is saved. The sensor trees depth accuracy was evaluated in comparison to a high end commercial FARO Terrestrial Laser Scanner (TLS) with specifications for millimeter accuracy at distances above 10 m. For the purposes of these tests, the depth measurements produced by the TLS were taken as ground truth. Example test wall panels were scanned with the TLS and postprocessed with its proprietary software, and subsequently scanned with the sensor tree system. The two scans were manually aligned and for each point in the output cloud from the sensor tree, the distance to the nearest ground truth point in the FARO cloud was determined. 98.7% of all produced points were within the specified target range of 6 mm, with an average deviation of 1.75 mm. The test walls used have an overall in-wall depth variation of around 40 mm.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Design and Challenges of Edge Computing ASICs on Front-End Electronics

In situ or hardware-embedded data processing of raw signals, close to their source, in radiation detectors is expected to provide dramatic improvements in data quality and volumes. However, the implementation of artificial neural networks (ANNs) in the front-end electronics, and the design of custom integrated circuits (ASICs), comes with challenges. In addition, detectors have to operate with limited power budget and implement complex functionalities in a very dense space. They often are exposed to extreme conditions as they work in high-radiation environments and/or cryogenic temperatures. This paper presents examples of applications and design methodologies for in-situ ANNs, along with the challenges of retaining the fidelity of the trained networks. For illustration, we use the problem of estimating the energy deposited by the radiation from digitized waveforms. The proposed implementation starts with an ML algorithm trained in Qkeras and eventually leads to an equivalent ASIC implementation. The associated design challenges in realizing energy and area efficient implementations in CMOS processes are reviewed. Novel approaches that employ hybrid technologies (combination of CMOS with memristors), in-memory computing models, and bio-inspired spiking neural networks are also highlighted

47 OTHER INSTRUMENTATION↗

Automatic identification and classification of Palomar Transient Factory astrophysical objects in GLADE

Palomar Transient Factory (PTF) is a comprehensive detection system for the identification and classification of transient astrophysical objects. In this paper, we make two significant contributions to the PTF pipeline. First, we present an experimental study that evaluates a novel implementation of the real-time classifier in GLADE - a parallel data processing system that combines the efficiency of a database with the extensibility of map-reduce. We show how each stage in the classifier maps optimally into GLADE tasks by taking advantage of the unique features of the system - range-based data partitioning, columnar storage, multi-query execution, and in-database support for complex aggregate computation. Second, we introduce a novel parallel similarity join algorithm for advanced transient classification. In conclusion, we implement this algorithm in GLADE and execute it on a massive supercomputer with more than 3,000 threads, achieving more than three orders of magnitude improvement over the PostgreSQL solution.

79 ASTRONOMY AND ASTROPHYSICS↗

Tracking materials science data lineage to manage millions of materials experiments and analyses

Abstract In an era of rapid advancement of algorithms that extract knowledge from data, data and metadata management are increasingly critical to research success. In materials science, there are few examples of experimental databases that contain many different types of information, and compared with other disciplines, the database sizes are relatively small. Underlying these issues are the challenges in managing and linking data across disparate synthesis and characterization experiments, which we address with the development of a lightweight data management framework that is generally applicable for experimental science and beyond. Five years of managing experiments with this system has yielded the Materials Experiment and Analysis Database (MEAD) that contains raw data and metadata from millions of materials synthesis and characterization experiments, as well as the analysis and distillation of that data into property and performance metrics via software in an accompanying open source repository. The unprecedented quantity and diversity of experimental data are searchable by experiment and analysis attributes generated by both researchers and data processing software. The search web interface allows users to visualize their search results and download zipped packages of data with full annotations of their lineage. The enormity of the data provides substantial challenges and opportunities for incorporating data science in the physical sciences, and MEAD’s data and algorithm management framework will foster increased incorporation of automation and autonomous discovery in materials and chemistry research.

Soedarmadji, Edwin↗

ATLAS data quality operations and performance for 2015–2018 data-taking

The ATLAS detector at the Large Hadron Collider reads out particle collision data from over 100 million electronic channels at a rate of approximately $100$ kHz, with a recording rate for physics events of approximately 1 kHz. Before being certified for physics analysis at computer centres worldwide, the data must be scrutinised to ensure they are clean from any hardware or software related issues that may compromise their integrity. Prompt identification of these issues permits fast action to investigate, correct and potentially prevent future such problems that could render the data unusable. This is achieved through the monitoring of detector-level quantities and reconstructed collision event characteristics at key stages of the data processing chain. This paper presents the monitoring and assessment procedures in place at ATLAS during 2015-2018 data-taking. Through the continuous improvement of operational procedures, ATLAS achieved a high data quality efficiency, with 95.6% of the recorded proton-proton collision data collected at $\sqrt{s}=13$ TeV certified for physics analysis.

43 PARTICLE ACCELERATORS↗

Aged and unaged pine wood pyrogenic organic matter: mineralization, elemental analysis and spectroscopy data (February 2020)

In this study, we used a pyrogenic organic matter (PyOM) degrading Streptomyces isolate – a globally common soil bacterium – to investigate the effects of physical (freeze-thaw and wet-dry), chemical (oxidation), and biological (microbial community incubation) ageing on the chemical properties and mineralizability of 350°C and 550°C pine wood PyOM. We used Fourier Transform Infrared spectroscopy (FTIR) and elemental analysis to characterize the aged and unaged PyOM, and cavity ring-down spectroscopy to trace CO2 emissions. The carbon (C) mineralization data from incubation of aged and unaged PyOM with the isolate are provided in co2cmg_picarro_022020.csv. This dataset contains raw carbon dioxide (CO2) data measured on the cavity ring-down spectroscopy over 1 month of incubation. The dataset also includes processed data such as cumulative CO2 emitted over multiple cycles of measurement and CO2 values normalized by the total carbon content in each PyOM treatment. The carbon, hydrogen and nitrogen elemental content of aged and unaged 350°C and 550°C pine wood PyOM are provided in CHN_pyom.csv. The relative peak heights measured during the FTIR analysis of aged and unaged PyOM are provided in ftir_peaks_rel.csv.

54 ENVIRONMENTAL SCIENCES↗