Search NASA⌕ Search

SEARCH · Search NASA

Results for “data formats”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Rhizosphere Soil Biogeochemical Data and Photosynthetic Data of Vicia Faba in a Rhizobox

Here we share the data in column format via csv files for pH, redox, and dissolved oxygen collected at hourly resolution from microelectrodes. Dissolved organic carbon concentrations collected from TOC are also provided in a similar format but are composited samples from hourly microdialysis collection. This provided resolution of diel rhizosphere dynamics belowground. Plant physiological data was also collected at every 5 min for 24 hr cycles in order to capture diel dynamics aboveground. This data was used to parameterize the reaction transport model eSTOMP-ROOTS, which examines the rhizosphere biogeochemistry of a growing Vicia faba plant. The aim was to investigate plant activity and belowground biogeochemical processes, particularly their impact on mineral-organic associations in the rhizosphere. We combined in-situ rhizosphere microsensor and plant physiological measurements with a 3-D plant-soil reactive transport model to explore the behavior of dissolved organic carbon (DOC) in the rhizosphere. Over several days, microdialysis probes placed at the root-soil interface in live soil showed distinct daily patterns of DOC concentration in the pore water. Spikes in DOC concentrations during the day aligned with peaks in leaf-level photosynthesis, accompanied by decreasing redox potential and dissolved oxygen levels, and increasing pH in the rhizosphere. This new mechanistic modeling framework, which integrates aboveground plant physiological data with non-destructive, high-resolution monitoring of rhizosphere processes, offers significant potential for studying the factors that control carbon storage in soils.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

MINERvA s Open Data Product: A First for Neutrino Data Preservation

Access to information on neutrino nucleus interactions is critical to the success of all neutrino oscillation experiments. MINERvA's rich dataset covers a range of energies and nuclei unique amongst experiments, and as such is critical to the community in building the important shared knowledge needed to unravel the mysteries of the neutrino. In particular, its dataset provides the greatest statistical coverage in in the range of neutrino energies pertinent for DUNE until DUNE's near detector begins operation. Historically, such significant datasets in neutrino physics have been preserved primarily through their published results. While meaningful and useful, this limits the ability to explore the data to its fullest extent as new perspectives continue to form. MINERvA has undertaken a major effort to break this trend and preserve its data in a format to be as analyzable as possible from outside the collaboration. This has culminated in the officially-released MINERvA Open Data Product for the community to take advantage of and utilize. Maintaining direct access to the dataset in an analyzable form will allow new insights to continue to be extracted indefinitely. This talk will cover the contents of this product, the information included (and excluded), the tools provided to utilize the product effectively, the support MINERvA intends to provide in its use, and some lessons learned through the process.

Last, David [Rochester U.] (ORCID:0000000245147183↗
DOE OSTI2022

Data Curation for Machine Learning Applied to Geothermal Power Plant Operational Data for GOOML: Geothermal Operational Optimization with Machine Learning: Preprint

Geothermal Operational Optimization with Machine Learning (GOOML) is a transferable and extensible component-based geothermal asset modeling framework that considers complex steamfield relationships and identifies optimization prospects using a data-driven approach to physics-guided, data-centric machine learning. This framework has been used to develop digital twins that provide steamfield operators with operational environments to analyze and understand historical and forecasted power production, explore new steamfield configuration possibilities, and seek optimal asset management in real world applications. To create, test, and apply the GOOML framework, diverse time-series datasets spanning multiple years were sourced from various geothermal power plant components within several complex real-world geothermal operations. These operations are based in the United States and New Zealand and include a variety of technologies, end-uses and configurations, collectively covering nearly all relevant operating conditions for modern geothermal fields. Datasets were acquired from multiple sources to ensure that machine learning experiments generalized properly to various operating conditions. It was found that the data varied in quality, format, and completeness. To ensure consistency between the various datasets, a standardized data curation process was developed to reliably streamline data preparation. This paper will discuss best practices as learned from the GOOML data curation process which takes the following steps: 1) acquisition of large quantities of data from power plant operators, 2) digestion of data to gain an initial understanding of what is included, 3) data transformation, which includes converting the data into a standardized machine-readable format so that they can be visualized, quality checked, and cleaned, 4) quality assurance and quality control, involving identification of significant data gaps and apparent anomalies through mapping of data features to real world componentry via the GOOML historical model, followed by discussion with modelers and power plant operators to identify additional data needs and to resolve issues, 5) use in machine learning algorithms, and 6) repetition of steps one through five until all data needs are met and data are deemed suitable for producing trustworthy modeling results which may be disseminated, ideally along with the curated dataset. This iterative process is focused on improving the quality of the data rather than tuning machine learning model parameters and supports a shift towards data-centric AI as a means to improving real-world applicability of geothermal machine learning projects.

access↗
DOE OSTI2026

Leveraging large language models to address data scarcity in machine learning for graphene synthesis

Machine learning in experimental materials science faces significant challenges due to the scarcity of data, which are costly and time-consuming to generate, particularly when relying on in-house experiments. Literature data mining offers a potential solution but introduces issues like mixed data quality, inconsistent formats, and non-uniform reporting of synthesis parameters, resulting in partially missing and heterogeneous features across the dataset. Here, we propose data imputation and feature engineering methods that employ pre-trained large language models (LLMs) to enhance machine learning performance on scarce, heterogeneous datasets, demonstrated on graphene CVD synthesis data and the ML-HydPARK hydrogen storage dataset. GPT models perform data imputation via tailored prompting and semantic normalization of inconsistently reported features through embeddings, for example, to harmonize the complex nomenclature of CVD substrates. Beyond yielding more diverse and richer feature representations than traditional methods such as K-nearest neighbors (KNN) and Multivariate Imputation by Chained Equations (MICE), LLM-based data imputation is evaluated against dataset characteristics and prompting strategies. We vary the level of autonomy granted to the LLM, from generic prompting that leverages pre-trained knowledge for autonomous data generation to data-informed prompting that constrains outputs using target-specific information, and demonstrate which level of autonomy yields superior imputation performance across datasets and feature types. The proposed data engineering methods markedly improve downstream performance; for example, in graphene layer number classification using a support vector machine (SVM), binary accuracy increases from 39% to 65% and ternary accuracy from 52% to 72%. Fine-tuning experiments on both datasets show that combining our proposed LLM-based data imputation and feature encoding methods with numerical machine learning predictors outperforms standalone fine-tuned LLM predictors in data-scarce settings. The proposed strategies emphasize data enhancement techniques rather than refining learning architectures or regularizing loss functions, offering a broadly applicable framework for improving machine learning performance on scarce, inhomogeneous datasets.

Chemical vapor deposition↗
DOE OSTI2025

Data and Scripts associated with a manuscript on ecosystem responses to wildfires in the Columbia River Basin

This data package is associated with the publication “Ecosystem leaf area, gross primary production, and evapotranspiration responses to wildfire in the Columbia River Basin” submitted to Biogeosciences (Shi et al., 2024; doi: 10.22541/au.171053013.30286044/v1). In this research, data products, leaf area index (LAI), gross primary production (GPP), and evapotranspiration (ET), from the Moderate Resolution Imaging Spectroradiometer (MODIS) are used to quantify the resistance and resilience of different ecosystem types in the Columbia River Basin (CRB). A machine learning algorithm, random forest (RF), was used to examine the impacts of precipitation, vapor pressure deficit (VPD), and burn severity from Monitoring Trends in Burn Severity (MTBS) on ecosystem resilience. The data package includes the processed MODIS data products, precipitation, VPD, and burn severity in 138 fire regions in CRB and the input files for RF model training. This data package includes six folders. The MODIS products are included in three MODIS_* folders with shell scripts for data clipping and *ncl files for data processing: (1) “/MODIS_LAI_CRB”; (2) “/MODIS_GPP_CRB”; and (3) “/MODIS_ET_CRB”. All the processed data for each fire event are NetCDF formatted. The MTBS burn severity data and the shell and *ncl scripts used for data processing are in the folder named (4) “MTBS_fire”. The ERA meteorological fields and the data processing scritps are in (5) “ERA_Var_CR”. All the scripts for figure development are in the format of *ncl and in the folder (6) “paper_scripts”. See the file ending in “flmd.csv” for a list of all files contained in this data package and descriptions for each. Tabular column headers and units are described in the data dictionary file ending in “dd.csv”.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

malbacR: A Package for Standardized Implementation of Batch Correction Methods for Omics Data

Mass spectrometry is a powerful tool for identifying and analyzing small molecules, such as metabolites and lipids, in com-plex biological samples. Liquid chromatography and gas chromatography mass spectrometry studies quite commonly in-volve large numbers of samples, which can require significant time for sample preparation and analyses. To accommodate such studies, the samples are commonly split into batches. Inevitably, variations in sample handling, temperature fluctua-tion, imprecise timing, column degradation and other factors result in systematic errors or biases of the measured abundances between the batches. Numerous methods are available via R packages to assist with batch correction for small molecule om-ics data; however, since these methods were developed by different research teams, the algorithms are available in separate R packages, each with different data input and output formats. We introduce the malbacR package which consolidates eleven common batch effect correction methods for small molecule omics data into one place so users can easily implement and compare: pareto scaling, power scaling, range scaling, ComBat, EigenMS, NOMIS, RUV-random, QC-RLSC, WaveI-CA2.0, TIGER, and SERRF. The malbacR package standardizes data input and output formats across these batch correction methods. The package works in conjunction with the pmartR package, allowing users to seamlessly include batch effect cor-rection in a pmartR workflow without needing any additional data manipulation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Example on how to (intelligently) augment the nuclear-data pipeline with machine learning [Slides]

The presentation discusses how machine learning has helped the Los Alamos National Laboratory (LANL) nuclear-data pipeline. It also discusses the strengths of machine learning as it finds trends in large amounts of data where human brains are overwhelmed and that this information may be crucial to improve our nuclear data. It does stress, however, that machine learning is no "silver bullet" and that it is critical to feed it expert knowledge and use physics intuition to interpret the results. The presentation discusses the need to develop infrastructure and tools to provide data in an easily readable and unambiguously interpretable format (e.g., EXFOR format), to develop experimental data and theory to solve physics questions, and that statisticians and nuclear-data experts must be brought together to correctly interpret the results. The presentation concludes by stating that machine learning is a great tool and that LANL needs to use the algorithms along with developing physics data, tools and infrastructure.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

C-HER Metadata Overview: Approach, Standards, and Rigor for the Centralized Health and Exposomic Resource

The Centralized Health and Exposomic Resource (C-HER) unifies environmental, demographic, geographic, and health-related data for exposomic research. The source data differ in format, geographic coverage, time period, resolution, terminology, and documentation. We use a common metadata framework to describe those differences and to record how each data resource has been processed, documented, and ingested. This document relates only to the C-HER metadata framework. It explains the information that is recorded for each resource, the standards used to organize that information, the conditions for metadata completeness, and the relationship between metadata and quality review. It is intended for those who need to understand what C-HER metadata communicates and how it supports appropriate use of the data. It is not an implementation specification or procedure. It does not document the database schema, source code, deployment configuration, transformation algorithms, or dataset-specific QA/QC thresholds. Those materials are maintained separately.

MacFarland, Midgie [ORNL] (ORCID:0009000807354078)↗
DOE OSTI2024

Characterization of Soil and Rock Magnetic Properties along Multiple Hillslope Transects at Teller Road Site, Seward Peninsula, Alaska, 2018 and 2023

The magnetometer data was collected in multiple directions across the watershed hillslope at the NGEE Arctic Teller Road site at mile marker 27 (TL_MM27) on the Seward Peninsula, Alaska over multiple years in March 2018 and April 2023. The magnetic data were collected using a Geometrics Inc. G-858 gradiometer and G-857 base station in 2018 and the G-864 gradiometer and G857 base station in 2023. The data was collected (in all instances) by towing the gradiometer behind a snow machine around the watershed with the two sensors in a vertical profile with constant spacing during the continuous survey in that specific year. Magnetic total field measurements were collected by gradiometer and base station, and the data processing was performed in Geometrics MagMap2000 software. The processing steps were limited to removal of data spikes (despiking), reading dropouts, and correction/removal of bad GPS points. All offsets between sensors and GPS are stated within the data files and metadata, alongwith the processed and raw data. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).In this data submission there are two sets of raw magnetic data (.bin and .stn for 2018 and base for 2023; raw rover mag for 2023 is in .csv) inside two .zip files that identify the year the mag data was collected. The data are proprietary format to Geometrics and can be opened and processed with MagMap2000 which can be downloaded for free at Geometrics website. There are also two processed data files *.csv for each year and two metadata files *.csv.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Essential amino acids in the Plant-Conserved and Class-Specific Regions of cellulose synthases

The Plant-Conserved Region (P-CR) and the Class-Specific Region (CSR) are two plant-unique sequences in the catalytic core of cellulose synthases (CESAs) for which specific functions have not been established. Here, we used site-directed mutagenesis to replace amino acids and motifs within these sequences predicted to be essential for assembly and function of CESAs. We developed an in vivo method to determine the ability of mutated CesA1 transgenes to complement an Arabidopsis (Arabidopsis thaliana) temperature-sensitive root-swelling1 (rsw1) mutant. Replacement of a Cys residue in the CSR, which blocks dimerization in vitro, rendered the AtCesA1 transgene unable to complement the rsw1 mutation. Examination of the CSR sequences from 33 diverse angiosperm species showed domains of high-sequence conservation in a class-specific manner but with variation in the degrees of disorder, indicating a nonredundant role of the CSR structures in different CESA isoform classes. The Cys residue essential for dimerization was not always located in domains of intrinsic disorder. Expression of AtCesA1 transgene constructs, in which Pro417 and Arg453 were substituted for Ala or Lys in the coiled-coil of the P-CR, were also unable to complement the rsw1 mutation. Despite an expected role for Arg457 in trimerization of CESA proteins, AtCesA1 transgenes with Arg457Ala mutations were able to fully restore the wild-type phenotype in rsw1. Our data support that Cys662 within the CSR and Pro417 and Arg453 within the P-CR of Arabidopsis CESA1 are essential residues for functional synthase complex formation, but our data do not support a specific role for Arg457 in trimerization in native CESA complexes.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Soot Formation and Ignition Characteristics of Ethanol/Gasoline Blends in a Rapid Compression Machine

With the ever-increasing demand for sustainable energy, alcohol fuels have garnered interest for use in heavy duty engines. The significant infrastructure for ethanol production and blending of ethanol with gasoline make these fuels/fuel blends desirable candidates. However, development of heavy duty engine technology that is capable of burning alcohol fuels while retaining the advantages of traditional diesel combustion requires an improved understanding of the soot formation for these fuels under conditions relevant to mixing-controlled combustion. This work uses an extinction diagnostic to study the sooting tendency of ethanol and gasoline/ethanol blends ranging from E10 to E98 during ignition in a homogeneous environment. Experiments were conducted in a rapid compression machine (RCM) for compressed conditions of 20 ± 1 bar and an approximately constant temperature (± 10K) which was unique for each fuel. For a given soot volume fraction, a linear relationship was observed between ethanol content and the equivalence ratio in which that soot volume fraction was formed. Accounting for the oxygenated nature of ethanol, E85 and E98 fuels produced similar amounts of soot at a given Φ ox, , suggesting other factors outside of fuel oxygen content, such as fuel morphology, impact soot formation. Ignition delay data is reported for compressed pressures of 20 ± 1 bar and compressed temperatures ranging from 633 – 670 K for E10 and 771 – 789 K for E98. Varying pressures for E10 and E98 at conditions producing similar soot volume fractions demonstrated a linear dependence of soot formation on pressure, regardless of if the pressure considered was at top dead center or peak combustion pressure. Furthermore, the data gleaned from this work will be used to select soot models and chemical kinetic mechanisms for RCM simulations to ultimately model heavy duty engine technology with the studied fuels.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2021

Particle-Tracking Proton Computed Tomography—Data Acquisition, Preprocessing, and Preconditioning

Proton CT (pCT) is a promising new imaging technique that can reconstruct relative stopping power (RSP) more accurately than x-ray CT in each cubic millimeter voxel of the patient. This, in turn, will result in better proton range accuracy and, therefore, smaller planned tumor volumes (PTV). The hardware description and some reconstructed images have previously been reported. In a series of two contributions, we focus on presenting the software algorithms that convert pCT detector data to the final reconstructed pCT images for application in proton treatment planning. There were several options on how to accomplish this, and we will describe our solutions at each stage of the data processing chain. In the first paper of this series, we present the data acquisition with the pCT tracking and energy-range detectors and how the data are preprocessed, including the conversion to the well-formatted track information from tracking data and water-equivalent path length from the data of a calibrated multi-stage energy-range detector. These preprocessed data are then used for the initial image formation with an FDK cone-beam CT algorithm. The output of data acquisition, preprocessing, and FDK reconstruction is presented along with illustrative imaging results for two phantoms, including a pediatric head phantom. The second paper in this series will demonstrate the use of iterative solvers in conjunction with the superiorization methodology to further improve the images resulting from the upfront FDK image reconstruction and the implementation of these algorithms on a hybrid CPU/GPU computer cluster.

42 ENGINEERING↗
DOE OSTI2025

LLUDA (Low-cost Logging for Ubiquitous Decarbonization and Analysis) [SWR-24-131]

This repository features an Arduino-based GPS logger, called LLUDA, which uses the Adafruit Ultimate GPS FeatherWing with the Adafruit Feather M0 Adalogger, designed to capture and log GPS data in CSV format onto an SD card (embedded inside the Feather M0 Adalogger). The FeatherWing is powered through the vehicle's auxiliary power (from cigarette lighter) socket via a micro USB cable. The data it collects can be used to analyze vehicle operations and support vehicle modeling applications, helping to assess the potential for electrification.

Fakhimi, Setayesh [National Renewable Energy Labor↗
DOE OSTI2025

Metagenome-assembled genomes from topsoils collected during NEON campaign in East River, CO (06/14/2018-06/28/2018)

The Watershed Function Science Focus Area (WF SFA) at Lawrence Berkeley National Lab is working to build a mechanistic understanding of the distribution and dynamics of biogeochemical processes in mountainous watersheds and their response to perturbation. In June 2018, the NEON (National Ecological Observatory Network) Airborne Observatory Platform (AOP) performed a taskable airborne imaging campaign to collect visible to shortwave infrared (VSWIR) imaging spectroscopy and LiDAR data across 330 km2 in the Upper East River at Crested Butte, CO. We conducted a parallel ground sampling campaign to sample vegetation traits, as well as soil physical, chemical, and microbiological characteristics. We collected these samples from 438 sites across 12 locations spanning much of the elevation, topographic, and geologic variability across the study area. A subset of 250 samples were used for soil metagenomics which is presented here. In addition, at each site, vegetation samples were collected to measure species-specific leaf water content and leaf mass area, foliar elemental composition and foliar CN stable isotope ratios. Soil samples were collected to measure soil physical properties which include bulk density and soil texture analysis. A suite of soil chemical properties was measured from the samples collected at each site, including pH, organic matter, concentrations exchangeable cations, total elemental composition, and the concentrations of extractable N pools (e.g. total free amino acids, ammonium, nitrate, dissolved organic N, and total dissolved N). Additionally, we have measured soil microbial biomass CN stoichiometry. Here, we present 1982 metagenome-assembled genomes (MAGs) for the bacterial and archaeal community from topsoil collected from during NEON 2018 campaign. All metagenomes were sequenced at JGI (Joint Genome Institute) (GOLD Study ID: Gs0149986). Metagenomes were assembled using JGI Metagenome Workflow (10.1128/mSystems.00804-20). The dataset includes (1) zip files for 1982 MAG fasta files (neon_genomes1-5.tar.gz, split into 5 tarballs to keep tarballs under 0.5 GB), (2) neon_Gs0149986_samples_soilproperties_metagenomes.csv: the sample information together with the accession numbers for the underlying metagenomes and the associated soil physical and chemical measurements in NMDC (National Microbiome Data Collaborative) compliant format, (3) neon_Gs0149986.kml: location bounding box file for the sampled locations, (4) samples.csv: sample metadata file used to register Internationall Generic Sample Numbers (IGSNs), (5) flmd.csv: file level metadata file, and (6) dd.csv: data dictionary file. This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

2018 NEON and 2025 CHESS Campaigns↗
DOE OSTI2024

Divergent Bimetallic Mechanisms in Copper(II)-Mediated C–C, N–N, and O–O Oxidative Coupling Reactions

Copper-catalyzed aerobic oxidative coupling of diaryl imines provides a route for conversion of ammonia to hydrazine. Here the present study uses experimental and density functional theory computational methods to investigate the mechanism of N–N bond formation, and the data support a mechanism involving bimolecular coupling of Cu-coordinated iminyl radicals. Computational analysis is extended to Cu II -mediated C–C, N–N, and O–O coupling reactions involved in the formation of cyanogen (NC–CN) from HCN, 1,3-butadiyne from ethyne (i.e., Glaser coupling), hydrazine from ammonia, and hydrogen peroxide from water. The results reveal two different mechanistic pathways. Heteroatom ligands with an uncoordinated lone pair (iminyl, NH 2 , OH) undergo charge transfer to Cu II , generating ligand-centered radicals that undergo facile bimolecular radical–radical coupling. Ligands lacking a lone pair (CN and CCH) form bridged binuclear diamond-core structures that undergo C–C coupling. This mechanistic bifurcation is rationalized by analysis of spin densities in key intermediates and transition states, as well as multiconfigurational calculations. Radical–radical coupling is especially favorable for N–N coupling owing to energetically favorable charge transfer in the intermediate and thermodynamically favorable product formation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Identifying crystal structures and chemical reactions at the interface of stanene on Bi 2 Te 3

Synthesizing monolayers and heterostructures is an enabling approach to extract new physical phenomena from bulk materials. Among the structures amenable to this approach is stanene, which is a monolayer of tin, similar to graphene, and has been predicted to host one-dimensional topological states at its edges. Stanene can be tuned by decorating with different adatoms, which makes it a promising platform on which to engineer topological devices. Here, we deposit Sn on Bi 2 Te 3 and characterize the growth using anomalous synchrotron x-ray scattering and x-ray photoelectron spectroscopy (XPS). X-ray diffraction data reveal the formation of epitaxial Sn-based structures, along with penetration of Sn into the Bi 2 Te 3 , with Sn intercalating between the upper 10 Bi 2 Te 3 quintuple layers. Additionally, XPS data show deposited Sn reacting to form SnTe and Bi at the Bi 2 Te 3 surface. The calculated heat of reaction for Sn and Bi2Te3 is consistent with an exothermic reaction to SnTe and Bi. Using thermodynamic calculations as a guide, we identify several candidate substrates that can stabilize the stanene phase.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗