Search NASA⌕ Search

SEARCH · Search NASA

Results for “processing scripts”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

TalkPipe

SAND2025-11168O TalkPipe is a software tool to help users create and manage complex data analysis tasks involving Large Language Models. Its easy-to-use interface allows users to combine different analytical processes. TalkPipe includes a Python library, a scripting language, and can be run in a Docker container, making it simple to customize and extend. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Bauer, Travis [Sandia National Lab. (SNL-CA), Live↗
DOE OSTI2024

TEAMER: Crossflow Turbine Fairing Geometry Optimization - Report and CFD Modeling Files

The dataset includes computational fluid dynamics (CFD) models and simulation files for crossflow turbines as well as a detailed project report. The report documents the project undertaken by the Ocean Renewable Power Company (ORPC) to design and optimize a modular fairing for the Modular RivGen Marine Hydrokinetic (MHK) turbine, which enhances the efficient deployment and operation of turbine arrays. The project focused on optimizing the hydrodynamic performance of the fairing using CFD, with an emphasis on two key geometric parameters: the fairing's cross-sectional shape and the spacing between the rotor and the fairing. The analysis aimed to maximize net power output while also assessing discretized loading to evaluate ultimate and fatigue loads on the turbine components. The numerical modeling was conducted using both the commercial CFD software Star-CCM+ and the open-source code openFOAM, with the latter utilizing the actuator line library, turbinesFOAM. This dual-code approach was intended to increase confidence in the results and demonstrate the viability of using open-source tools for high-fidelity marine energy modeling. This dataset includes all necessary files for actuator line simulations in openFOAM, as well as 2D blade-resolved CFD results, along with Python and Java scripts for setting up and post-processing simulations.

16 TIDAL AND WAVE POWER↗
DOE OSTI2024

Seedling nitrogen uptake and rhizodeposition between mycorrhizal types

Tree mycorrhizal associations are associated with patterns in N cycling and soil organic matter (SOM) storage, however, we still lack a mechanistic understanding of what tree and fungal traits drive these patterns and how they will respond to global changes in soil N availability. To address this knowledge gap, we investigated how arbuscular mycorrhizal (AM)- and ectomycorrhizal (EcM)-associated seedlings alter rhizodeposition in response to increased inorganic N acquisition. Specifically, we conducted this greenhouse experiment in a sealed labeling chamber with an enriched 13Carbon atmosphere and 15Nitrogen enriched fertilizer over the course of five months from April 2021 - August 2021. To include the variability across tree species, we grew eight species of seedlings belonging to eight families that were either arbuscular (Acer rubrum, Nyssa sylvatica, Thuja occidentalis, and Prunus seritina) or ectomycorrhizal-associated (Quercus rubra, Tilia americana, Pinus strobus, and Betula lenta). We measured rhizodeposition (mg 13C), plant N uptake from fertilizer (mg N), net soil carbon, and the abundance of mycorrhizal fungi (ITS sequencing and qPCR). We also characterized fungal (ITS2) and bacterial (16S) soil communities.The data from this project are ".csv" files that can up downloaded into a folder, and then run in the associated R markdown scripts after changing the source folder location at the top of the script. These data include raw outputs and processed files (using the R markdown files) for seedling growth and biomass, 15N content, soil 13C content, raw reads and processed file versions for fungal and bacterial ASVS, and a final summary file used for modeling. R software is needed to run these data, and the packages needed are listed at the top of the R markdown file.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

A PSCAD Library Component Featuring a Reduced-Order IBR Model for EMT-Based Fault Studies

This paper presents a fully implemented inverter reduce-order-model (ROM) in an EMT simulation (PSCAD) library component for direct user utilization in protection studies. The developed inverter ROM has the following features: Equivalent to a full IBR inverter model with positive- and negative-sequence current formulation and representation A python script is developed to fully automate this process, including training data generation, ROM parameter training, updating parameters, and model verification and validation. With this PSCAD ROM library component, protection engineers can utilize a trustworthy, accurate ROM for protection studies in an easy-to-use and streamlined manner.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Evaluation of a Reduced-Order Model for IBR Fault Response Representation via OEM Blackbox Models

This paper presents a fully implemented inverter reduced-order-model (ROM) in an EMT simulation (PSCAD) library component for direct user utilization in protection studies. The developed inverter ROM has the following features: Equivalent to a full inverter-based resource (IBR) inverter model with positive- and negative-sequence current formulation and representation. A Python script is developed to fully automate this process, including training data generation, ROM parameter training, updating parameters, and model verification and validation. The ROM is validated using both IEEE 2800-compliant and non-compliant OEM modes in a real-world system, building confidence of its usability by protection engineers.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Dataset and scripts for manuscript "Using Neural Network Ensembles to Separate Ocean Biogeochemical and Physical Drivers of Phytoplankton Biogeography in Earth System Models"

Please note: The title of this version contains an updated title for the manuscript compared to the previous version of this dataset. This is only due to title updates during the peer review process for the manuscript. The zip file contains the scripts, functions, and source files for the manuscript titled "Using Neural Network Ensembles to Separate Ocean Biogeochemical and Physical Drivers of Phytoplankton Biogeography in Earth System Models." The manuscript has been submitted for peer review. Please consult the README file for information on the specifications of the files. These files may occasionally be updated to add annotations to the scripts to make them more user friendly and to correct any errors.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Soil Water Potentials (1990-2018) from a calibrated ELM-FATES, and rooting depth analyses scripts, PA-BCI, Panama

This dataset has ELM-FATES simulation outputs and scripts that accompany and reproduce the manuscript, Chitra-Tarak et al. (2021) Hydraulically-vulnerable trees survive on deep-water access during droughts in a tropical forest. New Phytologist. https: //doi.org/10.1111/nph.17464”. This dataset is organized into four parts: (1) source code for the model, Energy Exascale Earth System Land Model-Functionally Assembled Advanced Terrestrial simulator (ELM-FATES) (2) R scripts associated with ELM-FATES simulations: to prepare files for parameter ensemble simulation runs, calibrate the model with observed hydrological fluxes observed at BCI, re-run the model with tuned parameters and obtain long-term soil matric potentials by depth (3) ELM-FATES hydrological simulation outputs at PA-BCI, Panama (1990-2018, daily), and (4) R scripts for inverse rooting depth modeling and post-processing: prepare datasets and inversely model tree rooting depths at BCI, test hypotheses about the relationship of rooting depths with plant hydraulic traits and drought-induced mortality, and reproduce the manuscript itself. n.b. 1. Data needed to run R scripts in (2) and (4) and thus to reproduce the manuscript are sourced from various public datasets. Refer to the data availability section of the accompanying manuscript. 2. This dataset version (prepared on May 12, 2021) matches the revised and published version of the accompanying manuscript (published May 16, 2021) replacing a previous version. In the publication, this dataset is cited as follows: Chitra-Tarak R, Xu C, Aguilar S, Anderson-Teixeira K, Chambers J, Detto M, Faybishenko B, Fisher R, Knox R, Koven C et al. 2020. Soil water potentials (1990–2018) from a calibrated ELM-FATES, and rooting depth analyses scripts, PA-BCI, Panama. 2.0. NGEE Tropics Data Collection. doi: 10.15486/ngt/1696806

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Data and scripts associated with a manuscript investigating dissolved organic matter and microbial community linkages across seven globally distributed rivers

This data package is associated with the publication “Meta-metabolome ecology reveals that geochemistry and microbial functional potential are linked to organic matter development across seven rivers” submitted to Science of the Total Environment. This data package includes the data necessary to replicate the analyses presented within the manuscript to investigate dissolved organic matter (DOM) development across broad spatial distances and within divergent biomes. Specifically, we included the Fourier transform ion cyclotron mass spectrometry (FTICR-MS) data, geochemistry data, annotated metagenomic data, and results from ecological null modeling analyses in this data package. Additionally, we included the scripts necessary to generate the figures from the manuscript. Complete metagenomic data associated with this data package can be found at the National Center for Biotechnology (NCBI) under Bioproject PRJNA946291. This dataset consists of (1) four folders; (2) a file-level metadata (flmd) file; (3) a data dictionary (dd) file; (4) a factor sheet describing samples; and (5) a readme. The FTICR Data folder contains (1) the processed Fourier transform ion cyclotron mass spectrometry (FTICR-MS) data; (2) a transformation-weighted characteristics dendrogram generated from the FTICR-MS data; and (3) the script used to generate all FTICR-MS related figures. The Geochemical Data folder contains (1) the single geochemistry data file and (2) the R script responsible for generating associated figures. The Metagenomic Data folder contains (1) annotation information across different levels; (2) carbohydrate active enzyme (CAZyme) information from the dbCAN database (Yin et al., 2012); (3) phylogenetic tree data (FASTAs, alignments, and tree file); and (4) the scripts necessary to analyze all of these data and generate figures. The Null Modeling Data folder contains (1) data generated during null modeling for each river and all rivers combined and (2) the R scripts necessary to process the data. All files are .csv, .pdf, .tsv, .tre, .faa, .afa, .tree, or .R.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Model associated with: "Thermodynamic control on the decomposition of organic matter across different electron acceptors"

This model data package is associated with the publication “Thermodynamic control on the decomposition of organic matter across different electron acceptors” submitted to Soil Biology and Biochemistry (Zheng et al., 2023; https://doi.org/10.1016/j.soilbio.2024.109364).In this research, a thermodynamic modeling framework is built to flexibly incorporate both organic matter (OM) molecules and electron acceptors for estimating potential free energy release from various redox reactions and to further predict reaction rates based on Microbial Transition State Theory. The model package includes scripts for thermodynamic modeling and postprocessing. Input Fourier-transform ion cyclotron resonance (FTICR) data are from a previous experimental study (Boye et al., 2018), and model outputs are free energy predictions and stoichiometric coefficients associated with all possible redox reactions.This data package is associated with the project GitHub repository found at MM_bioenergetic_modeling.This data package contains four folders (Input_FTICR, Model, Output, and Output_processing), a file-level metadata (FLMD) csv, and a data dictionary (dd) csv. Please see Zheng_bioenergetic_modeling_flmd.csv for a list of all files contained in this data package and descriptions for each. The Zheng_bioenergetic_modeling_dd.csv file describes the csv column headers. The “Model” folder contains scripts to run energy balance calculations for each electron acceptor. The “Output” folder contains csv files with stoichiometric information from model simulations. And the "Output_processing" folder contains scripts for reaction rate calculations and to generate plots.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

MAUD Interface Tool Kit (MILK)

Materials Analysis Using Diffraction (MAUD) is an open source Rietveld refinement program which fits diffraction models to diffraction spectra allowing quantitative diffraction analysis. The scripting interface developed here using python facilitates the choice of parameters to refine during the Rietveld fitting process and provides a simple MPI framework for running MAUD instances in parallel. The scripting language facilitates batch, custom, and reproducible Rietveld refinements of large datasets.

Savage, Daniel↗
DOE OSTI2020

Planck intermediate results

We present the NPIPE processing pipeline, which produces calibrated frequency maps in temperature and polarization from data from the Planck Low Frequency Instrument (LFI) and High Frequency Instrument (HFI) using high-performance computers. NPIPE represents a natural evolution of previous Planck analysis efforts, and combines some of the most powerful features of the separate LFI and HFI analysis pipelines. For example, following the LFI 2018 processing procedure, NPIPE uses foreground polarization priors during the calibration stage in order to break scanning-induced degeneracies. Similarly, NPIPE employs the HFI 2018 time-domain processing methodology to correct for bandpass mismatch at all frequencies. In addition, NPIPE introduces several improvements, including, but not limited to: inclusion of the 8% of data collected during repointing manoeuvres; smoothing of the LFI reference load data streams; in-flight estimation of detector polarization parameters; and construction of maximally independent detector-set split maps. For component-separation purposes, important improvements include: maps that retain the CMB Solar dipole, allowing for high-precision relative calibration in higher-level analyses; well-defined single-detector maps, allowing for robust CO extraction; and HFI temperature maps between 217 and 857 GHz that are binned into 0'.9 pixels (Nside = 4096), ensuring that the full angular information in the data is represented in the maps even at the highest Planck resolutions. The net effect of these improvements is lower levels of noise and systematics in both frequency and component maps at essentially all angular scales, as well as notably improved internal consistency between the various frequency channels. Based on the NPIPE maps, we present the first estimate of the Solar dipole determined through component separation across all nine Planck frequencies. The amplitude is (3366.6 ± 2.7) μK, consistent with, albeit slightly higher than, earlier estimates. From the large-scale polarization data, we derive an updated estimate of the optical depth of reionization of τ = 0.051 ± 0.006, which appears robust with respect to data and sky cuts. There are 600 complete signal, noise and systematics simulations of the full-frequency and detector-set maps. As a Planck first, these simulations include full time-domain processing of the beam-convolved CMB anisotropies. The release of NPIPE maps and simulations is accompanied with a complete suite of raw and processed time-ordered data and the software, scripts, auxiliary data, and parameter files needed to improve further on the analysis and to run matching simulations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

X-ray Computed Tomography Data of Dense Metallic Components

The data shared in here are X-ray computed tomography (XCT) scans of a hexagonal fuel nozzle in 3 sections with the Metrotom 800 system at the Manufacturing Demonstration Facility (MDF) at Oak Ridge National Laboratory. The data are used in the paper "Tomographic Sparse View Selection using the View Covariance Loss, by Lin et al. (doi:10.1109/TPAMI.2025.36000720), accepted to the international conference on computational imaging (ICCP 2025). Figures 4-7 in the paper describe the part/XCT scan. File name Descriptions: Bottom section: TCR- Single Channeled SRC L 2019-3-18 12-26-41.hdf5 Medium section: TCR- Single Channeled SRC M 2019-3-18 13-8-9.hdf5 Top section: TCR- Single Channeled SRC T 2019-3-18 13-45-39.hdf5 Each hdf5 file contains projection data, and all the relevant X-ray CT scan setting. The full list of included attributes: distance_unit: Units of all distances specified angle_unit : Units of the angles angles: Array of all angles used voxel_size_xy: Baseline recon (if any) has this voxel size in the in-plane direction voxel_size_z: Baseline recon (if any) has this voxel size in the cross-plane direction det_pixel_size_col: Size of the detector pixels in the column dimension det_pixel_size_row: Size of the detector pixels in the row dimension src_iso_dist: Source to iso-center distance iso_det_dist: Iso-center to detector distance det_angle: If the detector is rotated/tilted, this angle corresponds to that value det_row_offset: Center of rotation offset in the vertical direction det_col_offset: Center of rotation offset in the horizontal direction reconstruction: A baseline reconstruction stored as 3D array BHC params: Beam-hardening parameters - Van De Casteel Model - if it has been used to pre-process the projections We also provided a python script (hdf_io.py) that allows the user to read the relevant data from each hdf5 file.

Ziabari, Amir [Oak Ridge National Laboratory]↗
DOE OSTI2025

Hyporheic-zone Processes and Stream Oxygen Dynamics: Insights from a Multiscale Reactive Transport Model: Modeling Archive

This archive contains the data and Python scripts required to reproduce the analyses and figures in the study: Gomez-Velez, J. D., Rathore, S. S., Cohen, M. J., & Painter, S. L. (2025). Hyporheic-zone Processes and Stream Oxygen Dynamics: Insights from a Multiscale Reactive Transport Model. Submitted to Water Resources Research. The analysis utilizes the subgrid model Advection Dispersion Equation with Lagrangian Subgrids (ADELS) implemented in the Advanced Terrestrial Simulator (ATS; https://amanzi.github.io/ats/stable/). In this case, the ATS and Amanzi versions are (1) ATS version 1.5.1_f5ba18f8 and (2) Amanzi version 1.6-dev_53444cca4. The repository includes a Jupyter Notebook and the necessary data (Pandas DataFrames stored as pickle files) to generate the figures for the manuscript. Additionally, it contains Python scripts to create ATS input files, run the ATS simulations, and post-process the results. Finally, it provides routines for parameter estimation using the Single-Station Metabolism (SSM) model with the Differential Evolution Adaptive Metropolis (DREAM) Markov Chain Monte Carlo (MCMC) algorithm with ZS enhancements (DREAM-ZS).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Adapting DESGW Single Epoch Image Differencing to the LSST Software Stack

Optical follow-up for gravitational wave events remains an important factor in potentially unlocking the secrets of dark matter in the universe. The Dark Energy Survey Gravitational Wave (DESGW) Group currently processes optical data from Dark Energy Camera (DECam) using a custom software pipeline derived from existing DES Supernovae Processing pipelines. While effective, is difficult to maintain and develop a custom workflow as new processing strategies are discovered, and researchers are diverted to newer projects in dark energy investigations. By building a modified image ingestion script and implementing the open-source Legacy Survey of Space and Time (LSST) Processing Pipeline for DESGW data, the lifetime and efficiency of the DESGW difference imaging program can be extended.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Data and scripts associated with “Riverine dissolved organic matter transformations increase with watershed area, water residence time, and Damköhler numbers in nested watersheds” (v2)

This data package is associated with the publication “Riverine dissolved organic matter transformations increase with watershed area, water residence time, and Damköhler numbers in nested watersheds” submitted to Biogeochemistry by Ryan et al., 2024 (DOI: https://doi.org/10.1007/s10533-024-01169-5). This study aims to investigate fundamental and transferable drivers of dissolved organic matter (DOM) diversity across five nested watersheds within the contiguous United States. DOM diversity was explored using ultrahigh-resolution Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS). The samples and the unprocessed FTICR-MS data used in this study are publicly available on the Environmental System Science Data Infrastructure for a Virtual Ecosystem (ESS-DIVE) data repository (see DOIs below). The data for the Willamette, Gunnison, Connecticut, and Deschutes basins were collected as part of a collaboration between the Watershed Rules of Life (WROL) project and Worldwide Hydrobiogeochemistry Observation Network for Dynamic River Systems (WHONDRS). The data for the Yakima River basin (YRB) was collected by the PNNL River Corridor SFA. The raw, unprocessed FTICR-MS data with additional (meta)data can be found at doi:10.15485/1895159 for WROL samples and doi:10.15485/1898912 for YRB samples. This data package contains the processed data used in the associated manuscript. This package also contains ancillary geospatial, hydrological, and geochemical information that supports the interpretation of the FTICR-MS data within Ryan et al., 2024. This data package is associated with the GitHub repository found at https://github.com/WHONDRS-Hub/rcsfa-RC4-WROL-YRB_DOM_Diversity. This data package was originally published August 2024. It was updated January 2025 (modified files). See the change history in the readme more details. At the directory level, the data package is comprised of three folders: (1) data, (2) output, and (3) src; and five additional files including the data dictionary (file ending in "_dd.csv”) and file-level metadata (file ending in “_flmd.csv”). The “src” folder contains the scripts used to process the FTICR data, conduct the analyses, and produce the manuscript figures. The inputs for these scripts are in the “data” folder and the returned outputs in the “output” folder. Inputs include temporal and spatial metadata associated with the sampling efforts, processed FTICR data, and total and normalized putative biochemical transformations per sample. Outputs include cleaned and combined data presented as tables, descriptive statistics, and plots. The file-level metadata file lists all files contained in this data package and descriptions for each. The data dictionary describes the units and definitions for each tabular data column or row header.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Maps of ice wedge thermokarst pool expansion from twenty-seven circumpolar survey areas

This repository includes data and code to accompany the manuscript 'Topography controls variability in circumpolar permafrost thaw pond expansion' by Abolt et al. The data include satellite imagery and derived maps of thermokarst pools from twenty-seven survey areas in North America and Siberia. The code, written in MATLAB (R2021a), contains demonstrations of the workflow for generating the maps. The demonstrations include training a generalized UNet for mapping thermokarst pools using data from three survey areas, 'fine tuning' the UNet for use at a specific survey area using transfer learning, applying a trained UNet to infer thermokarst pool extent within satellite imagery, and performing histogram matching as a pre-processing step to improve satellite imagery contrast. Contains MATLAB script files and M files, TIF files, shape files, XML, Excel, TXT, and CSV files.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic) was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

dbprocessing

dbprocessing is a python framework for automating data processing pipelines. The dbprocessing package uses a configuration file to define the input, intermediate, and output data products for a particular data type as well as the processes that connect those data products. In addition, dbprocessing uses python scripts called inspectors to determine if a particular file matches a configured data product. If a particular data product is found, it is ingested into the dbprocessing database (sqlite3 or postgres) which then triggers all of the chained processes to the final data product. While the framework is written in python, it can run software in any language but may require a “wrapper” to translate the dbprocessing command line arguments to the form expected by the software.

Walker, Andrew↗
DOE OSTI2024

Divide and conquer: using RhizoVision Explorer to aggregate data from multiple root scans using image concatenation and statistical methods

Roots are important in agricultural and natural systems for determining plant productivity and soil carbon inputs. Sometimes, the amount of roots in a sample is too much to fit into a single scanned image, so the sample is divided among several scans, and there is no standard method to aggregate the data. Here, we describe and validate two methods for standardizing measurements across multiple scans: image concatenation and statistical aggregation. We developed a Python script that identifies which images belong to the same sample and returns a single, larger concatenated image. These concatenated images and the original images were processed with RhizoVision Explorer, a free and open-source software. An R script was developed, which identifies rows of data belonging to the same sample and applies correct statistical methods to return a single data row for each sample. These two methods were compared using example images from switchgrass, poplar, and various tree and ericaceous shrub species from a northern peatland and the Arctic. Most root measurements were nearly identical between the two methods except median diameter, which cannot be accurately computed by statistical aggregation. We believe the availability of these methods will be useful to the root biology community.

59 BASIC BIOLOGICAL SCIENCES↗