Search NASA⌕ Search

SEARCH · Search NASA

Results for “processing scripts”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Data and Scripts Associated with "Modeling Ecohydrological Responses of Vegetation to Urban Microclimates Using the E3SM Land Model"

This dataset supports the study of vegetation ecohydrological responses to urban microclimates using the land component of the Energy Exascale Earth System Model (ELM) at four urban sites in Knoxville, Tennessee, USA. It includes the model inputs, simulation outputs, and associated scripts for running ELM simulations and analyzing the resulting data. The Model_Inputs folder includes static surface data, satellite-derived phenology (i.e., leaf area index), and atmospheric forcing data used to drive ELM simulations. Detailed descriptions of these datasets are provided in Section 2.3.2 of the associated manuscript. The Model_Outputs folder contains simulation results for the baseline, treatment, and ensemble experiments. Outputs from the baseline and treatment simulations are provided as raw ELM NetCDF files. Because the raw outputs from the 4,000-member ensemble are prohibitively large, the ensemble results are provided as summarized CSV files, which also serve as the source data for Figure 5 of the associated manuscript. The Scripts folder contains three components: E3SM, the core codebase of the Energy Exascale Earth System Model (E3SM); elm-olmt, the Offline Land Model Testbed (OLMT) used to perform the simulations; and knoxville_elm, which contains the analysis scripts used to process model outputs and generate the figures and results presented in the associated manuscript. Additional information is provided in Scripts_readme.txt within the Scripts directory.

Lu, Xiaoman [ORNL] (ORCID:0000000306698780)↗

Automation of Plot Generation for Strategic Petroleum Reserve Cavern Leaching Monitoring

Monitoring cavern leaching after each calendar year of oil sales is necessary to support cavern stability efforts and long-term availability for oil drawdowns in the U.S. Strategic Petroleum Reserve. Modeling results from the SANSMIC code and recent sonars are compared to show projected changes in the cavern’s geometry due to leaching from raw-water injections. This report aims to give background on the importance of monitoring cavern leaching and provide a detailed explanation of the process used to create the leaching plots used to monitor cavern leaching. In the past, generating leaching plots for each cavern in a given leaching year was done manually, and every cavern had to be processed individually. A Python script, compatible with Earth Volumetric Studio, was created to automate most of the process. The script makes a total of 26 plots per cavern to show leaching history, axisymmetric representation of leaching, and SANSMIC modeling of future leaching. The current run time for the script is one hour, replacing 40-50 hours of the monitoring cavern leaching process.

02 PETROLEUM↗

A practical guide to characterizing irradiated nuclear fuels using FIB tomography

We report focused ion beam (FIB) tomography with combined electron backscatter diffraction (EBSD) and energy dispersive x-ray spectroscopy (EDS) is a technique capable of statistically characterizing the microstructure and spatial compositional variation of nuclear fuel in three-dimensions (3D). The 3D visualization from FIB tomography provides a comprehensive picture of the interconnected microstructural and compositional features that can impact fuel performance. While these features are often characterized with surface examination, the complexity and relationship of fission products and grain boundary networks may not fully be captured by these 2D methods. This work presents a practical guide to FIB tomography that is tailored to nuclear fuel characterization. The steps used to collect and process the data are provided along with the scripts used to process the data. Additionally, suggestions for future characterization efforts utilizing this approach are given.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Model Scripts for "Old-Aged Groundwater Contributes to Mountain Hillslope Hydrologic Dynamics"

The partitioning of water inputs between deep and shallow groundwater flow paths is a fundamental processes, yet is challenging to observe. Numerical models provide a valuable tool to further develop insights on these groundwater mixing processes. This repository contains scripts to run the ParFlow-CLM and EcoSLIM integrated hydrologic models along the Pumphouse Hillslope in the East River Watershed and associated python scripts to process model outputs. Files includes input decks for the associated models, python scripts, and text and css files to support the model runs and processing. The 2-D hillslope model simulates from 2000 to 2021 using transient forcing conditions from the publicly available NLDAS-2 dataset. We develop an ensemble of models with variable hydrogeologic and soil parameters. Model outputs from the ensemble of runs are compared to to water level observations at the PLM1 and PLM6 wells published at (https://data.ess-dive.lbl.gov/view/doi:10.15485/1866836) and groundwater mean ages published at (https://data.ess-dive.lbl.gov/datasets/doi:10.15485/1960042. The model results are used to evaluate hillslope water mass-balance transience and mixing dynamics between groundwater flow paths with young (<10 year) and old (>10 year) ages.

54 ENVIRONMENTAL SCIENCES↗

HERO WEC 2024 - Electrical Configuration Deployment Data

The following submission includes raw and processed electrical configuration deployment data from the in water deployment of NREL's Hydraulic and Electric Reverse Osmosis Wave Energy Converter (HERO WEC), in the form of parquet files, TDMS files, CSV files, bag files, and MATLAB workspaces. This dataset was collected in April 2024 at the Jennette's pier test site in North Carolina. Raw data as TDMS, CSV, and bag files are provided here alongside processed data in the form of MATLAB workspaces and Parquet files. This dataset includes the Python code used to process the data and MATLAB scripts to visualize the processed data. All data types, calculations, and processing is described in the included "Data Descriptions" document. All files in this dataset are described in detail in the included README. This data set has been developed by the National Renewable Energy Laboratory, operated by Alliance for Sustainable Energy, LLC, for the U.S. Department of Energy (DOE) under Contract No. DE-AC36-08GO28308. Funding provided by the U.S. Department of Energy Office of Energy Efficiency and Renewable Energy Water Power Technologies Office.

16 TIDAL AND WAVE POWER↗

Spatially Resolved Raman Spectroscopic Investigation of Uranyl Fluoride: A Case Study in the Importance of Instrument Optimization

Raman spectroscopy is an emerging technique for rapid and nondestructive analysis of nuclear materials for forensic and nonproliferation applications as it is a powerful tool for distinguishing multiple chemical forms of materials with similar stoichiometries. Recent developments in spectroscopic software have enabled rapid data collection with high-speed Raman spectroscopic mapping capabilities. However, some uranium-rich materials are susceptible to degradation in humid air and/or laser-induced phase transformations. To mitigate environmental or measurement-related sample degradation of potential samples of interest, we have taken a systematic approach to define optimized data collection parameters for high-throughput measurements of uranyl fluoride (UO 2 F 2 ), which is an important intermediate material in the nuclear fuel cycle. First, we systematically describe the influence of optical magnification (5× to 100×), laser power, and exposure time on obtained signal for identical particles of UO 2 F 2 and find that at low laser power and exposure times, comparable signal is obtained regardless of optical magnification. Second, we ensure sample integrity during data collection, and third, collect spectroscopic maps that employ optimized parameters to reduce the time required to obtain spatially resolved spectroscopic information. Reductions of 90% and 99% in measurement times are discussed as they relate to differences in resolving spectroscopic features of particles in identical mapping areas. Finally, during this work, we found that additional data processing options were needed and thus developed a customized Python script for importing, processing, analyzing, and visualizing Raman spectroscopic map data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

EGS Collab Experiment 1: Circulation Testing Processed data

This submission includes processed and reduced data for circulation testing that was conducted at the 164' fracture on the 4850 ft level of the Sanford Underground Research Facility. The circulation tests were done to test the flow through the 164' fracture in the EGS Collab Experiment 1 testbed on the 4850 ft level of the Sanford Underground Research Facility in order to validate computer models concerned with flow processes and heat exchange processes in EGS. This data was processed from raw data that is available in the GDR submission linked below: "EGS Collab Circulation Testing Raw Data and Documentation." Python scripts used to process and reduce the data are included. The scripts also serve as "documentation" as well as examples for data processing. More information about the test itself as well as the rationale and process of data processing is available at wiki page linked below.

15 GEOTHERMAL ENERGY↗

Model data for a watershed-scale study in the Portage River Basin (OH) examining the effects of subsurface drainage on the hydrologic response of an agricultural watershed.

This study builds on Rathore et al. (2024, WRR) and investigates the role of artificial tile-drainage on various aspects of watershed hydrological response, with a particular focus on peakflow. The model-data for the original modeling-focused paper (Rathore et al., 2024, WRR) is archived at Rathore et al. (2024, ESS-DIVE). Hence, this model-data archive provides scripts that are specific to this study that includes model updates, processing and analysis scripts. For details and models files of original model, readers are referred to Rathore et al. (2024, ESS-DIVE). The key difference between the model configuration in this study and Rathore et al. (2024, WRR) is that the tile drains are applied to the entire domain, to study the impact of tile-drains on different aspects of hydrological response. Additional scenario considering intensified precipitation after a dry period was also simulated. The Watershed Workflow package is implemented in Python3. The Jupyter notebooks can be executed through multiple open-source tools, for example, Anaconda Jupyter Lab, VS Studio Code, etc. Other data files include CSV and HDF5 files, which can be read through Python scripts.

54 ENVIRONMENTAL SCIENCES↗

Derivation of Effective Properties Based on Porous Scale Simulations Using Filtering Techniques

This study presents a method for derivation of effective properties at the interface and in-depth of porous materials. The method defines a Representative Elementary Volume (REV) and applies filtering techniques to computer effective properties such as porosity and flow quantities, such as velocity and pressure. The script, developed to process the data was tested on the VTK type files that contain the mesh information and the flow solution. The method allows to choose between two types of filters, such as cellular and top-hat and define the size of the REV and number of samples along the domain. Extraction of the REV from the domain is performed to exact boundaries requested for the user. This is done using a triangulation technique and cutting through the cells to comply to the requested boundaries of the volume. The method can be applied to both structured and unstructured meshes. Filtering the material porosity and flow quantities involves integration of the numerical data. The algorithm provides three integration methods, such as Riemann sum, Monte Carlo and Quadrature rule to perform the integration. The Monte-Carlo technique permits the use of either uniform or linearly spaced distribution of points. The Quadrature rule is currently applicable to tetrahedral element types. The Monte Carlo and Quadrature rule methods require interpolation of the flow quantities at the sample points. For interpolation, two methods were tested and are readily available, Gaussian interpolation and re-sampling. It has been shown that re-sampling method has better consistency and acceptable accuracy in interpolation of the data. The algorithm was written in Python language and uses a number of modules. The major module besides numpy is PyVista. It is used to process the computational domain, clip the REV and interpolate the data. Quadrature rule integration was performed using a quadpy module. ParaView software was used externally to convert the flow solution to the VTK (or more specifically VTU) format. Integration of ParaView in the same environment with PyVista encountered problems and could not be implemented in this work. The developed algorithm is expected to be applicable to unstructured meshes and more complex porous structures as soon as the data can be passed in VTK type format. With the report is provided Python script for filtering the solution and a Matlab script for simple generation and processing of 2-D and 3-D porous channel geometries. The two scripts don't communicate.

Alexsander Zibitsker↗

Integration for navigation on the UMASS mobile perception lab

Integration of real-time visual procedures for use on the Mobile Perception Lab (MPL) was presented. The MPL is an autonomous vehicle designed for testing visually guided behavior. Two critical areas of focus in the system design were data storage/exchange and process control. The Intermediate Symbolic Representation (ISR3) supported data storage and exchange, and the MPL script monitor provided process control. Resource allocation, inter-process communication, and real-time control are difficult problems which must be solved in order to construct strong autonomous systems.

Draper, Bruce↗

ParFlow-CLM model simulation files for Maina et al., Journal of Hydrology, 2022

This dataset contains the files to run a ParFlow-CLM integrated hydrologic model simulation for Maina et al., HESS, 2022. It also contains the associated daily pressure output of those simulations. Simulations are for a hillslope-similarity approach based on seasonal groundwater changes in the East River, Colorado. Comparisons are made to different clustering, or functional zonation approaches. We assess the ability of these clustering approaches to identify and categorize hillslopes with similar static characteristics, hydroclimate, land surface processes, and subsurface dynamics in a mountainous watershed. ParFlow binary files (.pfb) are model specific, and can be modified/viewed with conversion to .sa, .silo, or .vtk file formats. ParFlow input scripts are in the .tcl file format. Associated post-processing scripts are included as .f90 files.

54 ENVIRONMENTAL SCIENCES↗

Data and scripts associated with the manuscript "Organic Molecules are Deterministically Assembled in River Sediments"

This data package is associated with the publication "Organic Molecules are Deterministically Assembled in River Sediments" submitted to Scientific Reports (Stegen et al., 2024). The study applies community ecology methods to dissolved organic matter (DOM) chemistry from variably inundated riverbed sediments to uncover principles governing DOM composition at a reach-scale. This data package documents the workflow used to process and generate the main findings in the manuscript. The R scripts reference the raw, unprocessed Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) data from another data package, available on ESS-DIVE at https://data.ess-dive.lbl.gov/view/doi:10.15485/1834208. The scripts then process the raw FTICR-MS data and generate the findings and figures presented in the associated manuscript. In brief, this study demonstrates that DOM assemblages in variably inundated sediments are primarily governed by deterministic variable selection, including sediment moisture effecting the degree of deterministic assembly. See the manuscript for more details pertaining to interpretation and implications of the findings. This data package is associated with the GitHub repository found at https://github.com/WHONDRS-Hub/ECA_2020_Sed.This data package is comprised of 6 scripts and 7 folders. The file-level metadata file (file ending in "flmd.csv") lists all files contained in this data package and descriptions for each. The data dictionary (file ending in "dd.csv) describes all tabular data columns and their respective definitions and units. The FTICR_Processing_Scripts produce the outputs found in the "Processed_Data" folder. The remaining scripts (located in the parent directory) produce the outputs found in the following four folders: (1) "MCD_Dendrograms", "MCD_Randomizations", "MCD_bNTI_Outcomes", and "OM_Null_Modeling". The fifth script additionally takes the three comma-separated values (CSV) files found in the parent directory as input ("VGC_texture.csv", "merged_weights.csv", and "ECA2_FTICR_BetaDisp.csv"). The outputs of each of the five scripts serve as the input to the following script, with the final outputs stored in the folder "OM_Null_Modeling".

54 ENVIRONMENTAL SCIENCES↗

Automation of the CFD Process on Distributed Computing Systems

A script system was developed to automate and streamline portions of the CFD process. The system was designed to facilitate the use of CFD flow solvers on supercomputer and workstation platforms within a parametric design event. Integrating solver pre- and postprocessing phases, the fully automated ADTT script system marshalled the required input data, submitted the jobs to available computational resources, and processed the resulting output data. A number of codes were incorporated into the script system, which itself was part of a larger integrated design environment software package. The IDE and scripts were used in a design event involving a wind tunnel test. This experience highlighted the need for efficient data and resource management in all parts of the CFD process. To facilitate the use of CFD methods to perform parametric design studies, the script system was developed using UNIX shell and Perl languages. The goal of the work was to minimize the user interaction required to generate the data necessary to fill a parametric design space. The scripts wrote out the required input files for the user-specified flow solver, transferred all necessary input files to the computational resource, submitted and tracked the jobs using the resource queuing structure, and retrieved and post-processed the resulting dataset. For computational resources that did not run queueing software, the script system established its own simple first-in-first-out queueing structure to manage the workload. A variety of flow solvers were incorporated in the script system, including INS2D, PMARC, TIGER and GASP. Adapting the script system to a new flow solver was made easier through the use of object-oriented programming methods. The script system was incorporated into an ADTT integrated design environment and evaluated as part of a wind tunnel experiment. The system successfully generated the data required to fill the desired parametric design space. This stressed the computational resources required to compute and store the information. The scripts were continually modified to improve the utilization of the computational resources and reduce the likelihood of data loss due to failures. An ad-hoc file server was created to manage the large amount of data being generated as part of the design event. Files were stored and retrieved as needed to create new jobs and analyze the results. Additional information is contained in the original.

Tejnil, Ed↗

Small-wedge synchrotron and serial XFEL datasets for Cysteinyl leukotriene GPCRs

Structural studies of challenging targets such as G protein-coupled receptors (GPCRs) have accelerated during the last several years due to the development of new approaches, including small-wedge and serial crystallography. Here, we describe the deposition of seven datasets consisting of X-ray diffraction images acquired from lipidic cubic phase (LCP) grown microcrystals of two human GPCRs, Cysteinyl leukotriene receptors 1 and 2 (CysLT 1 R and CysLT 2 R), in complex with various antagonists. Five datasets were collected using small-wedge synchrotron crystallography (SWSX) at the European Synchrotron Radiation Facility with multiple crystals under cryo-conditions. Two datasets were collected using X-ray free electron laser (XFEL) serial femtosecond crystallography (SFX) at the Linac Coherent Light Source, with microcrystals delivered at room temperature into the beam within LCP matrix by a viscous media microextrusion injector. All seven datasets have been deposited in the open-access databases Zenodo and CXIDB. Here, we describe sample preparation and annotate crystallization conditions for each partial and full datasets. We also document full processing pipelines and provide wrapper scripts for SWSX and SFX data processing. A Correction to this paper has been published: https://doi.org/10.1038/s41597-020-00759-w

97 MATHEMATICS AND COMPUTING↗

Water Sorption Study of Various Polymers and Polymeric Composites

In the formulations of many composite materials, polymeric materials are often used as binder materials to enhance processability, functionality, and safety during manufacturing. For instance, poly(ester urethane), such as Estane® 5703, is used in the formulation of PBX 9501, and vinyl copolymer elastomer (VCE) is used in the formulation of VCE/filler compos ites. The stability of these binders directly impacts the overall stability and performance of their composites. Estane and VCE are prone to hydrolytic degradation, with water sorption behavior playing a significant role in their long-term stability and aging behavior. Hence, it is critical to study their water sorption behavior under various humidity and tempera ture conditions. To improve the accuracy and reduce labor-intensive work involved in water sorption experiments, an automated Dynamic Vapor Sorption (DVS) system was employed, which can generate large datasets. To efficiently process and analyze these datasets, Python scripts were developed. These scripts not only streamlined data processing, but also accu rately derived the Arrhenius parameters related to water diffusion and sorption properties for the tested materials. This approach offers a robust framework for evaluating water trans port and sorption processes in polymeric materials and adds valuable capabilities to future water sorption testing efforts.

36 MATERIALS SCIENCE↗

Model Data Archive Associated with Manuscript "Fire-altered Carbon Pools Create Disturbance Memory in Stream Dissolved Organic Carbon"

This data package supports the publication “Fire-altered Carbon Pools Create Disturbance Memory in Stream Dissolved Organic Carbon” by Li et al. (2026). The package contains processed model inputs, configuration files, restart files, simulation outputs, scripts, and visualization products used to evaluate post-fire dissolved organic carbon (DOC) dynamics in the Naches River Watershed, Washington, USA, following the 2021 Schneider Springs Fire. The modeling workflow couples ELM-BGC, the biogeochemistry-enabled Energy Exascale Earth System Model Land Model; ATS, the Advanced Terrestrial Simulator for integrated surface-subsurface hydrology; and PFLOTRAN, a reactive transport model for multicomponent aqueous geochemistry. Together, these models simulate how wildfire-induced changes in vegetation, litter, coarse woody debris, and soil organic matter influence DOC production, transport, and reaction from burned hillslopes to stream networks. The archive includes preprocessed meteorological, geospatial, hydrologic, and biogeochemical forcing data; ELM-BGC-derived DOC source terms; ATS mesh files; PFLOTRAN reactive-transport inputs; model configuration files; spin-up and transient restart files; watershed-scale diagnostic outputs; stream concentration time series; and figures or visualization files used to inspect and reproduce key results. File types include Hierarchical Data Format 5 (HDF5) files for gridded forcing and model-coupling data, model input and configuration files for ELM-BGC, ATS, and PFLOTRAN, restart and simulation-output files generated by the modeling workflow, tabular or time-series diagnostic outputs, scripts for post-processing and figure generation, and image or visualization products associated with the manuscript. Use of the package depends on the intended task. Re-running the simulations requires the relevant modeling software, including ELM-BGC, ATS, and PFLOTRAN as ATS's geochemical engine. Inspecting outputs and reproducing figures requires Python with scientific plotting libraries such as Matplotlib, and three-dimensional model outputs may be viewed with ParaView. Geographic information system files or maps may be inspected with ArcGIS Pro or comparable GIS software. The data package is intended to enable traceability, reuse, and partial reproduction of the coupled land-to-watershed hydro-biogeochemical modeling workflow used to test how wildfire disturbance affects terrestrial carbon pools and downstream DOC dynamics.

ATS↗

HERO WEC 2024 Hydraulic Configuration Deployment Data

The following submission includes raw and processed data from the in water deployment of NREL's Hydraulic and Electric Reverse Osmosis Wave Energy Converter (HERO WEC), in the form of parquet files, TDMS files, CSV files, bag files and MATLAB workspaces. This dataset was collected in March 2024 at the Jennette's pier test site in North Carolina. This submission includes the following: - Data description document (HERO WEC FY24 Hydraulic Deployment Data Descriptions.doc) - This document includes detailed descriptions of the type of data and how it was processed and/or calculated. - Processed MATLAB workspace - The processed data is provided in the form of a single MATLAB workspace containing data from the full deployment. This workspace contains data from all sensors down sampled to 10 Hz along with all array Value Added Products (VAPs). - MATLAB visualization scripts - The MATLAB workspaces can be visualized using the file "HERO_WEC_2024_Hydraulic_Config_Data_Viewer.m/mlx". The user simply needs to download the processed MATLAB workspaces, specify the desired start and end times and run this file. Both the .m and .mlx file format has been provided depending on the user's preference. - Summary Data - The fully processed data was used to create a summary data set with averages and important calculations performed on 30-minute intervals to align with the intervals of wave resource data reported from nearby CDIP ocean observing buoys located 20km East of Jennette's pier and 40km Northeast of Jennette's pier. The wave resource data provided in this data set is to be used for reference only due the difference in water depth and proximity to shore between the Jennette's pier test site and the locations of the ocean observing buoys. This data is provided in the Summary Data zip folder, which includes this data set in the form of a MATLAB workspace, parquet file, and excel spreadsheet. - Processed Parquet File - The processed data is provided in the form of a single parquet file containing data from all HERO WEC sensors collected during the full deployment. Data in these files has been down sampled to 10 Hz and all array VAPs are included. - Interim Filtered Data - Raw data from each sensor group partitioned into 30-minute parquet files. These files are outputs from an intermediate stage of data processing and contain the raw data with no Quality Control (QC) or calculations performed in a format that is easier to use than the raw data. - Raw Data - Raw, unprocessed data from this deployment can be found in the Raw Data zip folder. This data is provided in the form of TDMS, CSV, and bag files in the original format output by the MODAQ system. - Python Data Processing Script - This links to an NREL public github repository containing the python script used to go from raw data to fully processed parquet files. Additional documentation on how to use this script is included in the github repository. This data set has been developed by the National Renewable Energy Laboratory, operated by Alliance for Sustainable Energy, LLC, for the U.S. Department of Energy (DOE) under Contract No. DE-AC36-08GO28308. Funding provided by the U.S. Department of Energy Office of Energy Efficiency and Renewable Energy Water Power Technologies Office.

16 TIDAL AND WAVE POWER↗