Search NASA⌕ Search

SEARCH · Search NASA

Results for “process data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Pyrogenic Organic Matter Laboratory Experiment: Aerobic Respiration and Geochemistry from Variably Inundated Stream Sediments (v3)

This dataset supports a broader study examining the effects of variable inundation and pyrogenic organic matter on ecosystem respiration. The dataset provides data generated from a laboratory batch experiment investigating the interaction between variable inundation conditions (wet and dry sediment) and pyrogenic organic matter (burned and unburned treatments). The contents include time series dissolved oxygen, sediment geochemistry data, and field metadata (including qualitative information on instream and river corridor characteristics). This data package was originally published in November 2025. It was updated in April 2026 (v2; new and modified files) and May 2026 (v3; modified files). See the change history section in the readme for more details For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. In addition to a readme, this data package also includes a file-level metadata (FLMD) file that describes each file and a data dictionary (DD) that describes all column/row headers and variable definitions. This dataset is comprised of (1) file-level metadata; (2) data dictionary; (3) field metadata; (4) international generic sample number (IGSN) mapping file; (5) readme; (6) field protocol; (7) sample name metadata; (8) an environmental context picture for the dry and inundated sampling locations; and (9) a subfolder with sample data from the sediment incubation experiment. The sample data subfolder contains (1) dissolved organic carbon (DOC, measured as non-purgeable organic carbon, NPOC); (2) total nitrogen (TN); (3) gravimetric moisture; (4) partial pressure and production rates of carbon dioxide, methane, and nitrous oxide; (5) field wet sediment mass, dry sediment mass, water mass, and field wet sediment volume in incubation and sediment NPOC/TN vials; (6) methods codes; (7) respiration rates, pH, and temperature from after the incubation, raw time series dissolved oxygen and temperature, and a subfolder containing associated plots and scripts; (8) ions; (9) FTICR-MS methods; and (10) a subfolder of 12 Tesla (12T) FTICR-MS data. This folder contains the CoreMS processed data and three subfolders, one containing the .xml files, one containing the CoreMS output files, and the other containing instructions and scripts for processing the files in CoreMS (https://github.com/EMSL-Computing/CoreMS). All files are .csv, .pdf, .R, .xml, .html, .Rmd, .py, .cal, .json, or .jpg.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Leveraging Pre-Built Catalogs and Object-Level Scheduling to Eliminate I/O Bottlenecks in HPC Environments

Modern High-Performance Computing (HPC) environments face mounting challenges due to the shift from large to small file datasets, along with an increasing number of users and parallelized applications. As HPC systems rely on Parallel File Systems (PFS), such as Lustre for data processing, performance bottlenecks stemming from Object Storage Target (OST) contention have become a significant concern. Existing solutions, such as LADS with its object-level scheduling approach, fall short in large-scale HPC environments due to their inability to effectively address metadata I/O bottlenecks and the growing number of I/O processes. This study highlights the pressing need for a comprehensive solution that tackles both OST contention and metadata I/O challenges in diverse HPC workloads. To address these challenges, we propose SwiftLoad, an object-level I/O scheduling framework that leverages a metadata catalog to enhance the performance and efficiency of parallel HPC utilities. The adoption of the metadata catalog mitigates the metadata I/O bottlenecks that commonly occur in HPC utilities, a challenge that is particularly pronounced in object-level I/O scheduling. SwiftLoad addresses OST contention and the uneven distribution of I/O processes across different OSTs through mathematical modeling and incorporates a Loader Configuration Module to regulate the number of I/O processes. Evaluated with two representative utilities—data deduplication profiling and data augmentation—SwiftLoad achieved performance improvements of up to 5.63x and 11.0x, respectively, on a production supercomputer.

HPC↗
DOE OSTI2018

Graphene milling dynamics during helium ion beam irradiation

We explore the potential of the Helium Ion Microscope (HIM) as a tool for direct-write patterning of graphene and describe the underlying processes of graphene milling with image data processing. Controlled helium ion irradiation of suspended graphene conducted while monitoring the mill in-situ revealed the localized formation of nanopores, their growth, and coalescence. We also explore the effects of defects on the milling dynamics, and show that pre-exposed membranes rupture by cracking and rapid crack propagation at the edges of the growing defects. The mechanism for the rupturing process is described by local defect formation by excessive irradiation of helium ions, dictated by the scanning direction of the beam. As a result, these findings enrich fundamental understanding of the graphene milling process with a helium ion beam that, is necessary for high-resolution and high throughput patterning of graphene with nanoscale precision.

36 MATERIALS SCIENCE↗
DOE OSTI2018

Modeling of time-lapse seismic monitoring using CO 2 leakage simulations for a model CO 2 storage site with realistic geology: Application in assessment of early leak-detection capabilities

Time-lapse surface seismic surveys have been widely used at carbon sequestration sites for site characterization, monitoring subsurface CO 2 plume migration, and detecting potential CO 2 leakage from a storage reservoir. Monitoring in the first permeable unit directly above the primary seal is important for early detection of CO 2 leakage. Forward modeling of time-lapse seismic data can be used to assess the utility of the seismic method for CO 2 leakage detection. We develop a workflow for forward modeling of time-lapse seismic data, including constructing seismic velocity models using flow simulation outputs, modeling of pre-stack and post-stack synthetic seismic data following seismic data processing sequence and analysis of processed synthetic time-lapse seismic data. We apply the forward modeling and analysis workflow to assessing the detectability and the earliest detection time of seismic monitoring using the hypothetical CO 2 leakage scenarios for a model geologic storage site with realistic geology. We then derive the detection thresholds using the simulated normalized root-mean-square (NRMS) differences for the no-leakage case at a range of signal-to-noise ratios, representing the background noise levels in seismic data. We then compare NRMS differences triggered by the CO 2 leakage to the detection thresholds at each time step to quantify the detectability and the earliest detection time of seismic monitoring. We analyze the effects of the acquisition parameters and elastic parameters on the produced synthetic seismic data and earliest detection time. Our modeling results indicate that high signal-to-noise ratio is needed to detect the CO 2 leakage at the model site. Minimizing the background noise in seismic data is crucial for improving the detectability of the seismic method. Increasing the shot density or increasing the dominant frequency of the source wavelet is likely to increase the possibility of the leakage detection and reduce the time needed for the detection. The elastic parameters used in the rock physics modeling have significant effects on the resultant seismic velocity models and synthetic seismic data, highlighting their critical roles in understanding and interpreting time-lapse seismic reflection data associated with CO 2 monitoring, verification and accounting activities.

58 GEOSCIENCES↗
DOE OSTI2024

Connected Traffic Signal Coordination Optimization Framework through Network-Wide Adaptive Linear Quadratic Regulator–Based Control Strategy

Traffic congestion in metropolitan areas causes several significant challenges, such as longer travel times, decreased productivity, increased fuel consumption and vehicle emissions, and even severe injuries during crashes. Traffic signal control is a management approach to reduce traffic congestion and allocate the appropriate right of way for safety and mobility efficiency, both in temporal and spatial domains. Here, this study proposes a network-wide adaptive signal control coordination optimization framework based on the linear quadratic regulator algorithm. The traffic flow conditions driven by signal control inputs are formulated based on their network-wide state-space representation. After modeling traffic control regulation constraints, an adaptive linear quadratic regulator algorithm is designed to maximize the network-wide total throughput under the current conditions. Optimal signal control split time durations for multiple intersections in the network are derived by solving the algebraic Riccati equation. Furthermore, the recursive least square parameter estimation method is employed to quantify dynamic traffic condition changes. To verify the effectiveness of this proposed signal control framework, both simulation and real-world experimental tests are conducted for multiple intersections in downtown Chattanooga, Tennessee, United States. In preparation for real-world experimental tests, pipelines for real-time data processing implementation and historical traffic flow data analysis are conducted. The test results demonstrate that the proposed control framework achieves a decrease in travel time by up to 19.4%, total time spent (TTS) by up to 11.9%, and relative queue balance (RQB) by up to 15.6%. The research findings indicate that the proposed signal control framework can be generalized to handle large scale signal control optimization network-wide.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Online learning of quadratic manifolds from streaming data for nonlinear dimensionality reduction and nonlinear model reduction

Here, this work introduces an online greedy method for constructing quadratic manifolds from streaming data, designed to enable in situ analysis of numerical simulation data on the Petabyte scale. Unlike traditional batch methods, which require all data to be available upfront and take multiple passes over the data, the proposed online greedy method incrementally updates quadratic manifolds in one pass as data points are received, eliminating the need for expensive disk input/output operations as well as storing and loading data points once they have been processed. A range of numerical examples demonstrate that the online greedy method learns accurate quadratic manifold embeddings while being capable of processing data that far exceed common disk input/output capabilities and volumes as well as main-memory sizes.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Overhead longwave infrared hyperspectral material identification using radiometric models

Material detection algorithms used in hyperspectral data processing are computationally efficient but can produce relatively high numbers of false positives. Material identification performed as a secondary processing step on detected pixels can help mitigate false positives. A material identification processing chain for longwave infrared hyperspectral data of solid materials collected from airborne platforms is presented. The algorithms utilize unwhitened radiance data and Nelder–Meade numerical optimization to estimate the temperature, humidity, and ozone levels of the atmospheric profile. Pixel unmixing is done using constrained linear regression and Bayesian information criteria for model selection. The resulting identification product includes an optimal atmospheric profile and a full radiance material model that includes material temperature, abundance values, and several fit statistics. A logistic regression method utilizing the model parameters to improve identification is also presented. Furthermore, several examples are provided using modeled data at several noise levels.

58 GEOSCIENCES↗
DOE OSTI2022

TOMOCUPY

ANL REFERENCE SF-22-102 DESCRIPTION: Tomocupy is a Python package and a command-line interface for GPU reconstruction of tomographic/laminographic data in 16-bit and 32-bit precision. It implements an efficient data processing conveyor allowing to overlap all data transfers with computations. First, independent Python threads are started for reading data chunks from the hard disk into a Python data queue and for writing reconstructed chunks from the Python queue to the hard disk. Second, CPU-GPU data transfers are overlapped with GPU computations by using CUDA streams.

NIKITIN, VIKTOR↗
DOE OSTI2020

NLR OpenPATH™ (National Laboratory of the Rockie's Open Platform for Agile Trip Heuristics [SWR-20-73]

National Laboratory of the Rockies' Open Platform for Agile Trip Heuristics (NLR OpenPATH™) enables people to track their travel modes—by car, bus, bike, walking, etc.—and measure their associated energy use. Formerly known as e-mission, the NLR OpenPATH tool features continuous data collection and analysis via a smart phone app backed by a server and automated data processing. Its open nature enables transparent data collection and analysis while allowing for continuous improvement coupled with accessibility and adaptability by others. NLR OpenPATH empowers communities to collect and understand their own travel data while achieving place-based, locally relevant mobility goals.

Shankari, K.↗
DOE OSTI2026

A network of soil moisture, soil temperature, air temperature, net radiation, ground heat flux and ground water for Chicago, Illinois

This dataset contains environmental monitoring data collected using solar-powered Multi-Function Research (MFR) Long Range Wide Area (LoRaWAN)-enabled nodes at 11 sites in Chicago, Illinois, as part of the DOE Urban Integrated Field Lab CROCUS project. The MFR node system consists of an Input/Output Digital Input Module (IB8) interface box (ICT International) providing wired connections for environmental sensors and an MFR-Node-L data logger that manages power, data processing, and LoRaWAN communication. The wireless data are ingested via Sage network (https://sagecontinuum.org/) nodes that contain LoRaWAN antennae. Measurements were collected from 11 MFR nodes deployed across Chicago State University (CSU), Northeastern Illinois University (NEIU), Northwestern University (NU), University of Illinois Chicago (UIC), West Woodlawn "Blacks in Green" (BIG), and Indian Boundary Prairies (IBP). Each MFR node supports a consistent suite of sensors measuring atmospheric, soil, and hydrological variables. Atmospheric measurements include 2m air temperature (°C), 2m vapor pressure deficit (kPa), and 2m shortwave/longwave radiation (incoming and outgoing, W/m²) measured using ATH-VPD and Apogee SN500 sensors. Soil measurements include volumetric water content (VWC, %) and temperature (°C) at four depths (15, 30, 45, and 60 cm below surface) using Meter Teros54 sensors, and heat flux (W/m²) at 10 cm depth using Huske HFP01-05 sensors. At selected locations, Meter Hydros21 sensors measure groundwater depth (mm), specific conductivity (dS/m), and temperature (°C). The dataset includes timestamps, site identifiers with location names, device IDs, Global Positioning System (GPS) coordinates, variable names with units, measurement depths, values, sensor names, and Sage node identifiers. All timestamps are in local Chicago time (CDT/CST). Quality control flags are provided using a 6-bit binary system indicating physical range violations, step spikes, 24-hour flat-line conditions, 6-hour jitter, 7-day ultra-low variance, and persistent high offset. Data is provided in CSV and CF-compliant NetCDF formats. This dataset is part of a larger collection of CROCUS environmental monitoring data, including linked datasets from Air Quality Transmitter (AQT) sensors, Weather Transmitter (WXT) sensors, and Sap Flow Meter (SFM1x) sensors.

Chicago↗
DOE OSTI2018

Navy Flight Testing Environmental Data Transfer Format Standard

This document outlines key elements of a data format standard for transferring Navy environmental flight test data between members of the Collaborative Environments Characterization Working Group (CECWG). The plan applies to measured data as well as analyzed or processed data. This plan is intended to foster a more productive collaboration between CECWG members by providing a common interface format such that each agency only has to receive and transmit data in one common format. Ideally, each agency is thus only responsible for translating formats between the native format of each agency’s respective database of flight measurements and this common data transfer format.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

An Efficient Storage-Driven Machine Learning Model for Performance in the Era of Multimodal Scientific Data

Scientific workflows are increasingly relying on machine learning (ML), simulation, and hybrid techniques to predict, understand, and optimize the behavior of complex experiments. High-performance computing has greatly improved researchers’ ability to acquire diverse data modalities in these workflows. Recent studies suggest that the performance of machine learning models can be improved by integrating data from various sources. Unfortunately, these workloads pose unprecedent pressure on the network storage to meet the demands associated with accessing these multimodal data. To mitigate the impact of intensive IO, we propose a solution that utilizes a multi-tier High-Performance Computing (HPC) distributed storage and data processing framework, placing computation where the data resides for better performance. By adopting this project, the scientific community will gain new opportunities to explore multimodal storage-driven possibilities, integrating multiple scientific data sources with advanced streaming frameworks. Additionally, our framework effectively utilizes computing resources and bridges the gaps identified by HPC experts. Our proposed approach tackles scalability and persistence challenges by leveraging native persistency, which has posed difficulties in traditional approaches. Furthermore, we seek to enhance fault-tolerance and load-balance of computations by leveraging real-time streaming in diverse scientific computing environments, thereby propelling advanced scientific computing research into the next generation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Beaver Creek Soil Incubation Experiment July 2018

The data accompanies the manuscript Antecedent conditions determine the biogeochemical response of coastal soils to seawater exposure" that evaluates impact of periodic seawater inundations of soils from in a first-order coastal watershed in the Olympic Peninsula of Washington state, USA. Samples were collected in July 2018 and subjected to laboratory incubations. The files contain a read me file, data files including soil chemical characteristics, FTICR-MS molecular and data file, FTICR-MS derived processed data from FREDA, reference file for transformation analysis, LC-MS derived molecular feature abundance data, gas flux data for multiple regression and R codes. The files are related to the publication and have been used in the results and analyses section.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Lignin molecular weights of Populus trichocarpa residues after CELF pretreatment

Here we present a dataset of molecular weights of lignin from a woody energy crop (Populus trichocarpa) residues after a series of co-solvent enhanced lignocellulosic fractionation (CELF) pretreatment. The natural poplar variant GW-9947 from the Center for Bioenergy Innovation (CBI) was used. The poplar was knife milled and passed through a 1 mm sieve and CELF pretreatment was performed in a Parr autoclave reactor with 7.5 wt % solids loading, 0.5 wt% H2SO4 as catalyst at 150°C with various time. Tetrahydrofuran was added in a 1:1 mass ratio with water as the pretreatment solvent. Lignin was isolated from the pretreated samples after ball-milling in a porcelain jar with ceramic balls via Retsch PM 200 at 580 rpm for 2.5 h followed by enzymatic hydrolysis in acetate buffer (pH 4.8, 50 °C) for 48 h. The solid residue was isolated by centrifugation and hydrolyzed again with freshly added buffer and enzymes for another 48 h. After filtration, the solid residue was extracted twice with 96% (v/v) 1,4-dioxane/water mixture at room temperature overnight. The extracts were combined, rotary evaporated, and freeze-dried to recover lignin. The lignin samples were then derivatized in an acetic anhydride/pyridine (1:1, v/v) mixture and stirred at room temperature for 24 h. Ethanol was added to the reaction mixture, left for 30 min and then removed with a rotary evaporator. The addition and removal of ethanol was repeated at least 3 times until all traces of acetic acid were removed. Acetylated lignin samples were then dissolved in tetrahydrofuran (THF) at a concentration of 1.0 mg/mL. The molecular weight of acetylated lignin was measured by a gel permeation chromatography (GPC) on a PSS-Polymer Standards Service (Warwick, RI, USA) GPC SECurity 1200 system featuring Agilent HPLC 1200 components equipped with four Waters Styragel columns (HR1, HR2, HR4 and HR6) and an UV detector (270 nm). Tetrahydrofuran was used as the mobile phase and flow rate was 0.3 mL/min. The Polymer Standards Service WinGPC Unity software (Build 6807) was used for data processing for all the samples. The data provides information about the effects of CELF pretreatment time at 150 ºC on lignin molecular weights.

09 BIOMASS FUELS↗
DOE OSTI2026

Comparison of CNN-Based Image Classification Approaches for Implementation of Low-Cost Multispectral Arcing Detection

Camera-based sensing has benefited in recent years from developments in machine learning data processing methods, as well as improved data collection options such as Unmanned Aerial Vehicles (UAV) mounted sensors. However, cost considerations, both for the initial purchase of sensors as well as updates, maintenance, or potential replacement if damaged, can limit adoption of more expensive sensing options for some applications. To evaluate more affordable options with less expensive, more available, and more easily replaceable hardware, we examine the use of machine learning-based image classification with custom datasets, utilizing deep learning based-image classification and the use of ensemble models for sensor fusion. Utilizing the same models for each camera to reduce technical overhead, we showed that for a very representative training dataset, camera-based detection can be successful for detection of electrical arcing. We also use multiple validation datasets, based on conditions expected to be of varying difficulty, to evaluate custom data. These results show that ensemble models of different data sources can mitigate risks from gaps in training data, though the system will be less redundant for those cases unless other precautions are taken. We found that with good quality custom datasets, data fusion models can be utilized without specialization in design to the specific cameras utilized, allowing for less specialized, more accessible equipment to be utilized as multispectral camera components. This approach can provide an alternative to expensive sensing equipment for applications in which lower-cost or more easily replaceable sensing equipment is desirable.

convolutional neural networks↗
DOE OSTI2023

Six More Ultra-faint Milky Way Companions Discovered in the DECam Local Volume Exploration Survey

We report the discovery of six ultra-faint Milky Way satellites identified through matched-filter searches conducted using Dark Energy Camera (DECam) data processed as part of the second data release of the DECam Local Volume Exploration (DELVE) survey. Leveraging deep Gemini/GMOS-N imaging (for four candidates) as well as follow-up DECam imaging (for two candidates), we characterize the morphologies and stellar populations of these systems. We find that these candidates all share faint absolute magnitudes (M$_{V}$ ≥ −3.2 mag) and old, metal-poor stellar populations (τ > 10 Gyr, [Fe/H] < −1.4 dex). Three of these systems are more extended (r$_{1/2}$ > 15 pc), while the other three are compact (r$_{1/2}$ < 10 pc). From these properties, we infer that the former three systems (Boötes V, Leo Minor I, and Virgo II) are consistent with ultra-faint dwarf galaxy classifications, whereas the latter three (DELVE 3, DELVE 4, and DELVE 5) are likely ultra-faint star clusters. Using data from the Gaia satellite, we confidently measure the proper motion of Boötes V, Leo Minor I, and DELVE 4, and tentatively detect a proper-motion signal from DELVE 3 and DELVE 5; no signal is detected for Virgo II. We use these measurements to explore possible associations between the newly discovered systems and the Sagittarius dwarf spheroidal, the Magellanic Clouds, and the Vast Polar Structure, finding several plausible associations. Our results offer a preview of the numerous ultra-faint stellar systems that will soon be discovered by the Vera C. Rubin Observatory and highlight the challenges of classifying the faintest stellar systems.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Leaf Area Index (LAI) of vegetation at the Teller site, Seward Peninsula, Alaska, 2017

Measurements of leaf area index (LAI) at 299 locations on the "tall shrub transect" at the NGEE Arctic Teller field site. Measurements were made on 2017-07-27 using a LiCor LAI-2200. The dataset includes 9 files as dGPS locations, raw measurements, processed data and R script used for processing. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

RadPro: Radiography Processing Tool

Presentation describes project to improve processing of Cygnus radiographs by simplifying data processing and modifying options/parameters, displaying and saving images in desired format and path, and improving performance of basic processing methods, to include de-star, subtract, normalize, rotate, tile boundaries, and de-warp.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗