Search NASA⌕ Search

SEARCH · Search NASA

Results for “python workflow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Python UQ Workflows Progress [Poster]

Project Overview and Goal: Create a Python Toolkit for UQ (PyTUQ) to facilitate the interoperability of FASTMath UQ tools (Dakota, UQTk, KLPC), as well as other ASCR funded capabilities for UQ workflows.

97 MATHEMATICS AND COMPUTING↗

Towards a Standard Process Management Infrastructure for Workflows Using Python

Orchestrating the execution of ensembles of processes lies at the core of scientific workflow engines on large scale parallel platforms. This is usually handled using platform-specific command line tools, with limited process management control and potential strain on system resources. The PMIx standard provides a uniform interface to system resources. The low level C implementation of PMIx has hampered its use in workflow engines, leading to the development of Python binding that has yet to gain traction. In this paper, we present our work to harden the PMIx Python client, demonstrating its usability using a prototype Python driver to orchestrate the execution of an ensemble of processes. We present experimental results using the prototype on the Summit supercomputer at Oak Ridge National Laboratory. This work lays the foundation for wider adoption of PMIx for workflow engines, and encourages wider support of more PMIx functionality in vendor provided system software stacks.

Elwasif, Wael↗

Flexible Integration of Diverse HVAC Technologies in EnergyPlus via Python-Enabled Workflows

Analysis of advanced controls and novel system types is often not directly feasible in building energy simulation tools. Various techniques extend building energy simulation tool capabilities to allow the use of user-defined scripts and programs, but these approaches have limitations. The EnergyPlus Python plugin offers users new flexibility to use EnergyPlus to call an external Python module at specific points in the simulation, as well as to use Python to call EnergyPlus functionality through an application programming interface (API). This paper presents four case studies leveraging the EnergyPlus Python plugin to facilitate analysis of advanced controls and system types. The use of the Python plugin offers greater modularity and flexibility relative to previous approaches, is less error prone, and is simpler for users to adopt. The Python plugin allows EnergyPlus to be used in a more flexible manner and to accommodate the expanding realm of energy modeling applications.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Hydrologic Model Data for the East Fork Poplar Creek Watershed Simulated with the Advanced Terrestrial Simulator (ATS): Streamflow and Network Expansion–Contraction Dynamics

This dataset supports hydrologic modeling and stream network expansion–contraction analysis for the East Fork Poplar Creek (EFPC) Watershed in Tennessee. It includes a Jupyter notebook for model setup, model configuration files, simulation outputs, and derived products used to evaluate model performance and investigate stream dynamics under varying hydrologic conditions. The dataset was generated using the Watershed Workflow Python package and the Advanced Terrestrial Simulator (ATS), enabling integrated surface–subsurface hydrologic simulations using a stream-aligned mesh. Outputs include high-resolution time series of streamflow, active network length, water table depth, and related hydrologic variables. Also included are spatially explicit stream persistency indices and classifications of reaches as perennial or non-perennial. These data facilitate reproducibility and support further research on stream intermittency and variability in network extent.The model data archive is organized in following directories:1) model_setup_inputsContains the Watershed Workflow Jupyter notebooks (accessed through any open source code editor), selected input datasets, and resulting ATS input files, including XML files (access through any open source code editor), computational mesh (.exo files can be viewed using Paraview), and meteorological forcing files (.h5 files can be accessed through h5py python package and HDFView open source software). 2) model_outputsIncludes ATS simulation outputs relevant to this study. Time series of spatially integrated or averaged variables (e.g., streamflow, water table depth) are provided as CSV files. Select spatial fields (e.g., ponded depth and water table depth) are saved as pickled Python objects to reduce file size, and can be accessed through pickle package in Python. Key geometry objects from Watershed Workflow—such as the surface mesh and river tree—are also included to support analysis of streamflow persistency and expansion–contraction dynamics. These files can also be accessed through Watershed Workflow Python package.3) model_evaluationProvides observed streamflow time series and field survey-based flow regime classifications used to evaluate model performance. Jupyter notebooks for processing ATS outputs and comparing model predictions with observations to build confidence in the model prior to scientific analysis are also included.4) Q_L_relationshipsContains workflows for generating time series of discharge, active network length, and related hydrologic variables used in the stream network expansion–contraction analysis. Includes routines for delineating baseflow-dominated periods. For each catchment, notebooks and processed data (as pickled DataFrames accessed through Pandas Python package) are provided. 5) figure_scriptsProvides the Jupyter notebooks used to generate the figures presented in the paper.

54 ENVIRONMENTAL SCIENCES↗

LaRC SmartLab Apps For Instrument Control And Data Processing: Optical Micrometer Data Visualizer

The LaRC Smart Lab applications are a series of software tools to greatly enhance researcher efficiency by streamlining and automating workflows. Python scripts and applications are increasingly being used in scientific workflows, including for instrument control and data processing. Interactive Python scripting environments such as Jupyter Lab provide powerful tools for using Python. In some use cases, the development of standalone applications with dedicated graphical user interfaces (GUIs) can enhance the utility of the code and open it up to more users, including non-programmers. Here, we describe a GUI based optical micrometer data visualization application developed as part of the LaRC SmartLab project. We highlight its use in visualizing experimental data and briefly discuss its implementation to give pointers to programmers who wish develop work based on this application's or similar co de.

LaRC SmartLab↗

LaRC SmartLab Apps For Instrument Control and Data Processing: Laboratory Environment Monitor

The LaRC SmartLab applications are a series of software tools to greatly enhance researcher efficiency by streamlining and automating workflows. Python scripts and applications are increasingly being used in scientific workflows, including for instrument control and data processing. Interactive Python scripting environments such as JupyterLab provide powerful tools for using Python. In some use cases, the development of standalone applications with dedicated graphical user interfaces can enhance the utility of the code and open it up to more users, including non-programmers. Here, we describe a Python based application for communicating with, and displaying data from, iTHX Temperature, Humidity, and Dew Point probes. We discuss the set up and use of the application as well as its implementation. We also highlight the use of Simulated probes to enable users and developers to familiarize with or debug the application, even when they do not have access to the physical hardware in the laboratory.

LaRC SmartLab↗

pyGWBSE: a high throughput workflow package for GW-BSE calculations

Abstract We develop an open-source python workflow package, py GWBSE to perform automated first-principles calculations within the GW-BSE (Bethe-Salpeter) framework. GW-BSE is a many body perturbation theory based approach to explore the quasiparticle (QP) and excitonic properties of materials. GW approximation accurately predicts bandgaps of materials by overcoming the bandgap underestimation issue of the more widely used density functional theory (DFT). BSE formalism produces absorption spectra directly comparable with experimental observations. py GWBSE package achieves complete automation of the entire multi-step GW-BSE computation, including the convergence tests of several parameters that are crucial for the accuracy of these calculations. py GWBSE is integrated with Wannier90 , to generate QP bandstructures, interpolated using the maximally-localized wannier functions. py GWBSE also enables the automated creation of databases of metadata and data, including QP and excitonic properties, which can be extremely useful for future material discovery studies in the field of ultra-wide bandgap semiconductors, electronics, photovoltaics, and photocatalysis.

36 MATERIALS SCIENCE↗

NATURF

The Neighborhood Adaptive Tissues for Urban Resilience Futures tool (NATURF) is a Python workflow that generates les readable by the Weather Research and Forecasting (WRF) model. The NATURF Python modules use shapefiles containing building footprint and height data as input to calculate 132 building parameters at any resolution and converts the parameters into a binary file format.

Allen-Dumas, MelissaRee [Oak Ridge National Lab. (↗

ppdx : Automated modeling of protein–protein interaction descriptors for use with machine learning

This paper describes ppdx, a python workflow tool that combines protein sequence alignment, homology modeling, and structural refinement, to compute a broad array of descriptors for characterizing protein–protein interactions. The descriptors can be used to predict various properties of interest, such as protein–protein binding affinities, or inhibitory concentrations (IC 50 ), using approaches that range from simple regression to more complex machine learning models. The software is highly modular. It supports different protocols for generating structures, and 95 descriptors can be currently computed. More protocols and descriptors can be easily added. The implementation is highly parallel and can fully exploit the available cores in a single workstation, or multiple nodes on a supercomputer, allowing many systems to be analyzed simultaneously. As an illustrative application, ppdx is used to parametrize a model that predicts the IC 50 of a set of antigens and a class of antibodies directed to the influenza hemagglutinin stalk.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

ML-AMD/exa-amd

ML-AMD is a Python workflow framework designed to accelerate the discovery and design of functional materials.

Moraru, Maxim [Los Alamos National Laboratory]↗

Model data for infrastructure-aware simulation of compound flooding at Alligator Bayou Watershed, southeast Texas

This dataset supports infrastructure-aware hydrologic modeling and flood scenario analysis for the Alligator Bayou Watershed, a highly managed urban watershed in Southeast Texas. It includes Jupyter notebooks for figure reproduction, model configuration files, simulation outputs, and derived products used to quantify the influence of engineered stormwater infrastructure on flood behavior across multiple spatial scales. The dataset was generated using the Watershed Workflow Python package and the Advanced Terrestrial Simulator (ATS), enabling integrated surface–subsurface hydrologic simulations on a channel-aligned mesh with explicit representations of pump stations, gate structures, detention basins, and impervious surfaces. Outputs include time series of gate and pump flows, stage observations, and water balance components, as well as spatially explicit fields of peak ponded depth and flood duration across multiple infrastructure scenarios spanning a single-location detention basin expansion, distributed drainage limitations, and compound coastal flooding. These data facilitate full reproducibility of the manuscript figures and support further research on urban flood dynamics and the role of stormwater infrastructure in shaping watershed-scale flood response.

EARTH SCIENCE > OCEANS > COASTAL PROCESSES↗

naturf: a package for generating urban parameters for numerical weather modeling

The Neighborhood Adaptive Tissues for Urban Resilience Futures tool (NATURF) is a Python workflow that generates files readable by the Weather Research and Forecasting (WRF) model. NATURF uses geopandas and hamilton to calculate 132 building parameters from shapefiles with building footprint and height information. These parameters can be collected and used in many formats, and the primary output is a binary file configured for input to WRF. This workflow is a flexible adaptation of the National/World Urban Database and Access Portal Tool (NUDAPT/WUDAPT) that can be used with any study area at any spatial resolution. The climate modeling community and urban planners can identify the effects of building/neighborhood morphology on the microclimate using the urban parameters and WRF-readable files produced by NATURF. More information on the urban parameters calculated can be found in the documentation.

54 ENVIRONMENTAL SCIENCES↗

Calibration and Data Analysis of a Frequency Selectable Laser Source for CMB Detector Characterization

Cosmic Microwave Background (CMB) experiments study faint radiation left over from the early universe. The CMB was created when the universe became cool enough for light to travel freely through space, and today it gives scientists one of the earliest images of the universe. One important goal of modern CMB experiments is to measure this radiation with higher precision in order to search for evidence that supports the theory of cosmic inflation. To do this, scientists use extremely sensitive detectors that must be calibrated accurately. The Frequency Selectable Laser Source, or FLS, is a new calibration tool that can send selected frequencies to detectors and help measure their response. During my internship, I worked on the FLS after it returned to Fermilab from Chile, where it had been used to characterize detectors at the Simons Observatory. The system came back in parts, so the first part of my project was helping rebuild the optical and mechanical setup. After the system was rebuilt, we performed alignments to maximize the receiver photocurrent. We then collected calibration measurements over different frequency ranges, including 543 GHz to 568 GHz, 740 GHz to 766 GHz, and 60 GHz to 500 GHz. These measurements were used to check waterline calibration and reflectivity features and compare new data with previous data. Another major part of my project was learning Python so I could understand previous analysis code, modify it for new files, and write my own code to compare the mean response between datasets. The results showed that the new data was close to previous measurements and that waterline features near 556 GHz and 752 GHz were found within less than 1.5 GHz of the expected values. I also completed the reflectivity analysis for five prisms in two polarization orientations. In the original orientation, the results were consistent between the five prisms and close to values measured on a different system at the University of Chicago. I then collected a second set of measurements on my own with the polarization of the laser rotated by 90 degrees and compared them with the original data using the same Python workflow. The measured reflectivity increased for all five prisms in the new orientation, showing that the prism reflectivity depends on polarization. Future work will focus on using the FLS to characterize real CMB detectors.

Pumarino, Rafael [Unlisted]↗

Hydrology Copilot: A Cloud-Native Ai System for Hydrological Data Analysis

The emergence of AI-driven Earth observation systems promises to broaden access to petabyte-scale geospatial data beyond domain specialists. However, translating this vision into operational scientific infrastructure requires addressing fundamental challenges in data virtualization, code transparency, and domain-specific reasoning. We present Hydrology Copilot, a cloud-native AI framework for natural-language-driven analysis of Earth observation data. To demonstrate operational capabilities at scale, we implement the system using NASA's North American Land Data Assimilation System version 3 (NLDAS-3), which provides surface meteorological forcing and land-surface model output across North and Central America at 1-km resolution, from which drought diagnostics are derived. The system integrates five core contributions: (1) scalable data virtualization using Kerchunk-based cloud optimized access, achieving a 1.5 to 4.6 times improvement in I/O latency across benchmark queries spanning regional single-day extractions (4.6 times speedup) to continental monthly aggregations (1.5 times speedup); (2) transparent code generation through Microsoft Azure AI Foundry agents that expose executable Python workflows for scientific verification; (3) persistent conversational memory enabling multi-turn analytical discourse across sessions; (4) intelligent query validation that enforces dataset boundaries and resolves ambiguous requests before execution; and (5) a multi-agent architecture coordinating query parsing, code generation, and visualization. We evaluate the system through drought-monitoring workflows, demonstrating reliable code generation, accurate results validated against reference computations and the operational U.S. Drought Monitor, and efficient operation across increasingly complex tasks. By bridging natural-language interfaces with rigorous hydrological analysis, Hydrology Copilot advances beyond proof-of-concept demonstrations to provide a deployable framework for operational Earth science applications.

Data virtualization↗

Calibration and Data Analysis of a Frequency Selectable Laser Source for CMB Detector Characterization

Cosmic Microwave Background (CMB) experiments study faint radiation left over from the early universe. The CMB was created when the universe became cool enough for light to travel freely through space, and today it gives scientists one of the earliest images of the universe. One important goal of modern CMB experiments is to measure this radiation with higher precision in order to search for evidence that supports the theory of cosmic inflation. To do this, scientists use extremely sensitive detectors that must be calibrated accurately. The Frequency Selectable Laser Source, or FLS, is a new calibration tool that can send selected frequencies to detectors and help measure their response. During my internship, I worked on the FLS after it returned to Fermilab from Chile, where it had been used to characterize detectors at the Simons Observatory. The system came back in parts, so the first part of my project was helping rebuild the optical and mechanical setup. After the system was rebuilt, we performed alignments to maximize the receiver photocurrent. We then collected calibration measurements over different frequency ranges, including 543 GHz to 568 GHz, 740 GHz to 766 GHz, and 60 GHz to 500 GHz. These measurements were used to check waterline calibration and reflectivity features and compare new data with previous data. Another major part of my project was learning Python so I could understand previous analysis code, modify it for new files, and write my own code to compare the mean response between datasets. The results showed that the new data was close to previous measurements and that waterline features near 556 GHz and 752 GHz were found within less than 1.5 GHz of the expected values. I also completed the reflectivity analysis for five prisms in two polarization orientations. In the original orientation, the results were consistent between the five prisms and close to values measured on a different system at the University of Chicago. I then collected a second set of measurements on my own with the polarization of the laser rotated by 90 degrees and compared them with the original data using the same Python workflow. The measured reflectivity increased for all five prisms in the new orientation, showing that the prism reflectivity depends on polarization. Future work will focus on using the FLS to characterize real CMB detectors.

Pumarino Meza, Rafael [Unlisted, US; Fermilab]↗

Calibration and Data Analysis of a Frequency Selectable Laser Source for CMB Detector Characterization

Cosmic Microwave Background (CMB) experiments study faint radiation left over from the early universe. The CMB was created when the universe became cool enough for light to travel freely through space, and today it gives scientists one of the earliest images of the universe. One important goal of modern CMB experiments is to measure this radiation with higher precision in order to search for evidence that supports the theory of cosmic inflation. To do this, scientists use extremely sensitive detectors that must be calibrated accurately. The Frequency Selectable Laser Source, or FLS, is a new calibration tool that can send selected frequencies to detectors and help measure their response. During my internship, I worked on the FLS after it returned to Fermilab from Chile, where it had been used to characterize detectors at the Simons Observatory. The system came back in parts, so the first part of my project was helping rebuild the optical and mechanical setup. After the system was rebuilt, we performed alignments to maximize the receiver photocurrent. We then collected calibration measurements over different frequency ranges, including 543 GHz to 568 GHz, 740 GHz to 766 GHz, and 60 GHz to 500 GHz. These measurements were used to check waterline calibration and reflectivity features and compare new data with previous data. Another major part of my project was learning Python so I could understand previous analysis code, modify it for new files, and write my own code to compare the mean response between datasets. The results showed that the new data was close to previous measurements and that waterline features near 556 GHz and 752 GHz were found within less than 1.5 GHz of the expected values. I also completed the reflectivity analysis for five prisms in two polarization orientations. In the original orientation, the results were consistent between the five prisms and close to values measured on a different system at the University of Chicago. I then collected a second set of measurements on my own with the polarization of the laser rotated by 90 degrees and compared them with the original data using the same Python workflow. The measured reflectivity increased for all five prisms in the new orientation, showing that the prism reflectivity depends on polarization. Future work will focus on using the FLS to characterize real CMB detectors.

Pumarino Meza, Rafael [Unlisted, US; Fermilab]↗