Results for “workflow development” — Page 6

DOE OSTI2024

A Microservices Architecture Toolkit for Interconnected Science Ecosystems

Microservices architecture is a promising approach for developing reusable scientific workflow capabilities for inte- grating diverse resources, such as experimental and observational instruments and advanced computational and data management systems, across many distributed organizations and facilities. In this paper, we describe how the INTERSECT Open Architec- ture leverages federated systems of microservices to construct interconnected science ecosystems, review how the INTERSECT software development kit eases microservice capability develop- ment, and demonstrate the use of such capabilities for deploying an example multi-facility INTERSECT ecosystem.

Brim, Michael↗

DOE OSTI2024

A portable application framework for energy management and information systems (EMIS) solutions using Brick semantic schema

This paper introduces a portable framework for developing, scaling and maintaining energy management and information systems (EMIS) applications using an ontology-based approach. Key contributions include an interoperable layer based on Brick schema, the formalization of application constraints pertaining metadata and data requirements, and a field demonstration. The framework allows for querying metadata models, fetching data, preprocessing, and analyzing data, thereby offering a modular and flexible workflow for application development. Its effectiveness is demonstrated through a case study involving the development and implementation of a data-driven anomaly detection tool for the photovoltaic systems installed at the Politecnico di Torino, Italy. During eight months of testing, the framework was used to tackle practical challenges including: (i) developing a machine learning-based anomaly detection pipeline, (ii) replacing data-driven models during operation, (iii) optimizing model deployment and retraining, (iv) handling critical changes in variable naming conventions and sensor availability (v) extending the pipeline from one system to additional ones.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2024

Streaming Large-Scale Microscopy Data to a Supercomputing Facility

Data management is a critical component of modern experimental workflows. As data generation rates increase, transferring data from acquisition servers to processing servers via conventional file-based methods is becoming increasingly impractical. The 4D Camera at the National Center for Electron Microscopy generates data at a nominal rate of 480 Gbit s -1 (87,000 frames s -1 ⁠), producing a 700 GB dataset in 15 s. To address the challenges associated with storing and processing such quantities of data, we developed a streaming workflow that utilizes a high-speed network to connect the 4D Camera’s data acquisition system to supercomputing nodes at the National Energy Research Scientific Computing Center, bypassing intermediate file storage entirely. In this work, we demonstrate the effectiveness of our streaming pipeline in a production setting through an hour-long experiment that generated over 10 TB of raw data, yielding high-quality datasets suitable for advanced analyses. Additionally, we compare the efficacy of this streaming workflow against the conventional file-transfer workflow by conducting a postmortem analysis on historical data from experiments performed by real users. Our findings show that the streaming workflow significantly improves data turnaround time, enables real-time decision-making, and minimizes the potential for human error by eliminating manual user interactions.

4D-STEM↗

DOE OSTI2025

SuFEx-enabled high-throughput medicinal chemistry for developing potent tamoxifen analogs as Ebola virus entry inhibitors

Ebola virus (EBOV) causes severe hemorrhagic fever with a high mortality rate in humans. In acute infection, an abnormal immune response results in excessive inflammatory cytokines and uncontrolled systemic inflammation that can result in organ damage and multi-organ failure. While vaccines and monoclonal antibody therapies are available, there is an urgent need for effective small-molecule antivirals against EBOV. Here, we report on the optimization of tamoxifen, an EBOV-glycoprotein (GP) binder that inhibits viral entry, using our Sulfur-Fluoride Exchange (SuFEx) click chemistry-based high-throughput medicinal chemistry (HTMC) strategy. Using a “Direct-to-Biology” approach, we generated a focused library of 2,496 tamoxifen analogs overnight and screened them in a cell-based pseudo-EBOV infection assay. The HTMC workflow enabled the development of a potent EBOV entry inhibitor with submicromolar EC 50 cellular antiviral activity and more than 50-fold improvement in binding affinity against EBOV-GP compared to the parent compound. Our findings underscore the use of SuFEx-enabled HTMC for rapidly generating and assessing potential therapeutic candidates against viral and immune-mediated diseases in a cell-based assay.

Immunology↗

DOE OSTI2025

An Innovative High Throughput Genome Releaser for Rapid and Efficient PCR Screening

High-throughput PCR screening is vital in synthetic biology and metabolic engineering as it allows researchers to rapidly analyze and detect numerous targeted genetic mutation in the genome. Current challenges for high-throughput PCR screening in synthetic biology include efficiently preparing genomic DNA, optimizing protocols for diverse sample types, managing contamination risks, and effectively analyzing the large volumes of data generated while ensuring consistent and accurate results. In this study, we present the development of a High Throughput Genome Releaser (HTGR), an innovative device addressing common challenges in screening PCR. This genome DNA releaser is designed based on a squash method for rapid, cost-effective, and efficient DNA release, optimized for subsequent PCR reactions. After experimenting with various synthetic materials, we selected a plastic that closely replicates the smooth surface and compression properties of microscope slides, ensuring reliable performance. We engineered a device featuring a 96-Well Plate and a shear applicator, operable both manually and automatically, and compatible with standard liquid-handling robot platform. This compatibility enhances ease of use in high-throughput PCR workflows. Additionally, we developed software to support its automatic functions. Our results demonstrated that the specially engineered 96-Well Plate and HTGR can effectively squash fungal spores , which release enough genome DNA for PCR screening. The genome releaser facilitates the preparation of PCR-amplifiable genomic DNA substrate from 96 samples within minutes, eliminates the need for extraction buffers, and is adaptable to a wide range of microorganisms and cells, which could significantly advance biomanufacturing processes.

Yuan, Guoliang [BATTELLE (PACIFIC NW LAB)]↗

DOE OSTI2025

Predicting metal-binding proteins and structures through integration of evolutionary-scale and physics-based modeling

Metals are essential elements in all living organisms, binding to approximately 50% of proteins. They serve to stabilize proteins, catalyze reactions, regulate activities, and fulfill various physiological and pathological functions. While there have been many advancements in determining the structures of protein-metal complexes, numerous metal-binding proteins still need to be identified through computational methods and validated through experiments. Here, to address this need, we have developed the ESMBind workflow, which combines evolutionary scale modeling (ESM) for metal-binding prediction and physics-based protein-metal modeling. Our approach utilizes the ESM-2 and ESM-IF models to predict metal-binding probability at the residue level. In addition, we have designed a metal-placement method and energy minimization technique to generate detailed 3D structures of protein-metal complexes. Our workflow outperforms other models in terms of residue and 3D-level predictions. To demonstrate its effectiveness, we applied the workflow to 142 uncharacterized fungal pathogen proteins and predicted metal-binding proteins involved in fungal infection and virulence.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2026

Geothermal district energy systems coupled with seasonal underground thermal energy storage: a U.S. techno-economic screening by climate and geology

In the United States, cooling-dominated commercial building loads can cause geothermal heat pump-based district energy systems to accumulate a long-term subsurface thermal imbalance, motivating the incorporation of seasonal underground thermal energy storage. We developed a transferable workflow to evaluate geothermal district systems that pair ground heat exchangers with seasonal underground thermal energy storage. Using standardized hourly loads for seven commercial buildings and a uniform cost framework, we simulated ten U.S. cities with a physics-based ground heat exchanger model, subsurface storage simulations, and economic assessment to isolate the roles of climate and hydrogeology. In cooling-dominated cities, underground thermal energy storage supplied the majority of annual cooling, cutting electricity use and summer peaks substantially while achieving levelized costs comparable to or below conventional chiller-boiler plants. In cooler climates, the storage share shrunk, required borefield size and costs rose, and levelized cost of energy increased nearly linearly with declining underground thermal energy storage fraction, indicating storage fraction as the primary economic lever. Sensitivity analysis showed capital risk dominated by borefield drilling and surface heating, ventilation, and air-conditioning and piping, with underground thermal energy storage costs secondary. This workflow provides a transparent foundation for site-specific design and screening of next-generation geothermal district energy systems.

25 ENERGY STORAGE↗

DOE OSTI2026

Exploring the potential of using L-Band InSAR for the mapping of flooded vegetation in tropical wetlands

Wetlands play a critical role in global water and carbon cycles, yet monitoring their water extent remains difficult, particularly beneath dense vegetation. SAR-based techniques such as backscatter thresholding are limited by complex scattering mechanisms, while fully polarimetric SAR (PolSAR) data capable of detecting doublebounce scattering remain scarce. To address these challenges, this study evaluates the potential of Interferometric SAR (InSAR) for mapping water surfaces beneath vegetation, termed flooded vegetation, using the Atrato floodplain in Colombia as a case study. We develop an automated workflow combining InSAR fringe detection with local phase homogeneity analysis and random sampling of processing parameters to generate probabilistic flooded vegetation maps. Applied to ALOS PALSAR-1 L-band image pairs from 2007–2011, the workflow captures seasonal fluctuations in flooded extent ranging from 500 to 1,500 km2. Compared to other L-band SAR inundation products, the InSAR-based maps identify broader flooded areas, with ~70% agreement in pairwise comparisons. Around 84% of detections align with existing wetland inventories and seasonal changes correspond with regional hydrological indicators, including terrestrial water storage anomalies and water gauge measurements. PolSAR analysis shows that InSAR complements backscatter-based methods by detecting inundation in areas with weak double-bounce signals. These findings suggest that combining InSAR with backscatter-based methods can improve detection of flooded vegetation, which is especially relevant for the upcoming NISAR mission that will offer frequent global L-band observations.

Coastal inundation↗

DOE OSTI2025

Facilitating Screening of MOFs for Mixed Matrix Membranes Using Machine Learning and the Maxwell Model

Metal organic framework (MOF)-based mixedmatrix membranes (MMMs), which embed MOF particles in polymer matrices, combine the advantages of polymeric and inorganic membranes. Multiple previous studies have used the Maxwell model together with molecular simulations and machine learning (ML) to predict the performance of MOF/polymer MMMs. However, the assumption of rigid MOF frameworks in molecular simulations limited the accuracy of the data used in the predictions, particularly in predicting molecular diffusivities. We developed a novel workflow integrating ML models with consideration of MOF flexibility to predict the permeability and selectivity of 131,722 MMMs for CO 2 /CH 4 , O 2 /N 2 and He/H 2 separations. The full range of achievable MMM performance within the Maxwell model was analyzed, and several promising MOFs were identified using this workflow. This approach offers an efficient tool for screening any polymer and MOF combination in gas separation applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

Automated Nanocrystal Synthesis: Lessons from 25 Years of Robots, Microfluidics, and Machine Learning

Here, this perspective highlights the evolution of techniques for automating the synthesis of colloidal nanocrystals. Over the past 25 years, microfluidic reactors and robotic workflows have been developed to enhance the reproducibility of nanocrystal synthesis, facilitate rapid screening of reaction conditions, optimize material properties, and perform multistep syntheses of high-quality nanoparticles with complex heterostructures. Modern automated systems are now valued for their ability to generate robust data sets for validating physical models, supporting chemical mechanisms, training machine learning models, and for directing autonomous experimentation. We discuss the early challenges and limitations of these technologies and present key lessons for effectively utilizing automated and ML-guided tools to accelerate nanocrystal discovery for the next 25 years.

Nanocrystals↗

DOE OSTI2025

PAVC: The foundation for a Pan-Arctic Vegetation Cover database

Field-measured Arctic vegetation cover data is essential for creating accurate, high-quality vegetation structure and composition maps. Extrapolating field data into high-resolution cover maps provides detailed, function-specific information for use in Earth System Models, vegetation classifications, and monitoring vegetation change over time and space. However, field campaigns that collect plant cover vary substantially in scope, method, and purpose, which makes them difficult to unify across data stores, and they are often not designed to meet remote sensing needs. In this work, we synthesized and harmonized field-based fractional cover data from various data stores to create a high-quality, consistent repository schema for remote sensing-based vegetation cover mapping applications. We developed a reproducible workflow for synthesizing visual estimate and point-intercept fractional cover data. The resultant Pan-Arctic Vegetation Cover (PAVC) database contains synthesized fractional cover at both the species and plant functional type levels. The latter includes absolute foliar cover for deciduous shrubs and trees, evergreen shrubs and trees, forbs, graminoids, lichen, bryophytes, and “other” vegetation, as well as absolute cover for litter and top cover for water and bare ground.

Steckler, Morgan R. [Oak Ridge National Laboratory↗

DOE OSTI2026

Technoeconomic Design Optimization for Fast Reactors. Part II: Impact of Technoeconomic Constraints on Optimal Design

There is a current drive toward optimizing reactors, particularly small/micro reactors to minimize cost and maximize performance. Previous work has investigated the development of technoeconomic workflows for the design optimization of pool-type fast reactors that aim to deploy into district energy grids. Initial scoping studies verified that the workflow was capable of capturing design trends throughout a variety of design configurations and problem formulations while remaining sufficiently flexible. In this paper, this methodology is applied to understand how cost functions and technoeconomic constraints can drive optimal reactor design. Specifically, the UPu10Zr-fueled fast reactor model from Part I is adapted to include changes in the fissile content limits, control rod worth limits, control rod drive cost, and assumed fuel form. In the case of constraint relaxation at fixed power (fissile content and control rod worth limits), cost sensitivities of 5% to 10% were uncovered. Multi-objective optimization at varying reactor power levels with individualized control rod drives for each assembly (as opposed to one operational and one safety drive) increased cost by $\$10$ to $\$25$ million and substantially altered the optimal core geometry, favoring geometries with substantially fewer control rod placements relative to baseline optimization. Finally, a multi-objective optimization was performed at varying power levels with the fuel form overhauled to metallic, high-assay low-enriched uranium–based U10Zr with more refined fuel cost models. In the case of uranium fueling, the costs increased by at least $50 million relative to the baseline case. Furthermore, economic fuel zoning and lower reactivity swing cores were recovered. Each case serves to demonstrate the value of applying technoeconomic workflows to initial reactor design scoping studies to better understand the trade-off for a proposed concept between different design options.

Argonne Reactor Computation (ARC) codes↗

DOE OSTI2024

IDAES-PSE 2.5.0 Release

The Institute for the Design of Advanced Energy Systems (IDAES) Integrated Platform is a versatile computational environment offering extensive process systems engineering (PSE) capabilities for optimizing the design and operation of complex, interacting technologies and systems. IDAES enables users to efficiently search vast, complex design spaces to discover the lowest cost, most environmentally sustainable solutions while supporting the full process modeling lifecycle, from conceptual design to dynamic optimization and control. The extensible, open platform empowers users to create models of novel processes and rapidly develop custom analyses, workflows, and end-user applications. IDAES-PSE 2.5.0 Release Highlights Upcoming Changes IDAES will be switching to the new Pyomo solver interface in the next release. Whilst this will hopefully be a smooth transition for most users, there are a few important changes to be aware of. The new solver interface uses a different version of the IPOPT writer (“ipopt_v2”) and thus any custom configuration options you might have set for IPOPT will not carry over and will need to be reset. By default, the new Pyomo linear presolver will be activated with ipopt_v2. Whilst are working to identify any bugs in the presolver, it is possible that some edge cases will remain. IDAES will begin deploying a new set of scaling tools and APIs over the next few releases that make use of the new solver writers. The old scaling tools and APIs will remain for backward compatibility but will begin to be deprecated. New Models, Tools and Features New diagnostics check for near-parallel variables and constraints. New diagnostics tools for identifying causes of infeasibility in models. New example for creating a custom model of a liquid-liquid extractor unit operation. Bug Fixes Fixed bug in Gibbs reactor that caused it to appear to have additional spurious degrees of freedom. Fixed bug in the Modular Property Framework that would cause errors when trying to use phase-based material balances with phase equilibria. Fixed bug in Modular Properties Framework that caused errors when initializing models with non-vapor-liquid phase equilibria. Testing and Robustness Deployed the IDAES Diagnostics Toolbox to confirm that there are no structural or numerical issues in the core model libraries. Additional robustness tests for core model, and some associated improvements in the converge tester class. Fixed a number of issues that were causing unexpected warnings to be emitted during testing. Deprecations and Removals Removed examples for RIPE tool which has not been supported for a number of releases.

AS↗

DOE OSTI2024

IDAES-PSE 2.6.0 Release

The Institute for the Design of Advanced Energy Systems (IDAES) Integrated Platform is a versatile computational environment offering extensive process systems engineering (PSE) capabilities for optimizing the design and operation of complex, interacting technologies and systems. IDAES enables users to efficiently search vast, complex design spaces to discover the lowest cost solutions while supporting the full process modeling lifecycle, from conceptual design to dynamic optimization and control. The extensible, open platform empowers users to create models of novel processes and rapidly develop custom analyses, workflows, and end-user applications. IDAES-PSE 2.6.0 Release Highlights Upcoming Changes IDAES will be switching to the new Pyomo solver interface in the next release. Whilst this will hopefully be a smooth transition for most users, there are a few important changes to be aware of. The new solver interface uses a different version of the IPOPT writer (“ipopt_v2”) and thus any custom configuration options you might have set for IPOPT will not carry over and will need to be reset. By default, the new Pyomo linear presolver will be activated with ipopt_v2. Whilst are working to identify any bugs in the presolver, it is possible that some edge cases will remain. IDAES will begin deploying a new set of scaling tools and APIs over the next few releases that make use of the new solver writers. The old scaling tools and APIs will remain for backward compatibility but will begin to be deprecated. New Models, Tools and Features New Intersphinx extension automatically linking Jupyter notebook examples to project documentation New end-to-end diagnostics example demonstrated on a real problem New complementarity formulation for VLE with cubic equations of state, backward compatibility for old formulation New solver interface with presolve (ipopt_v2) in support of upcoming changes to the initialization and APIs methods, with default set to ipopt to maintain backwards compatibility; this will deprecate once all examples have been updated New forecaster and parameterized bidder methods within grid integration library Updated surrogates API and examples to support Keras 3, with backwards compatibility for older formats such as TensorFlow SavedModel (TFSM) Updated costing base dictionary to include the 2023 cost year index value Updated ProcessBlock to include information on the constructing block class Updated Flowsheet Visualizer to allow visualize() method to return value and functions Bug Fixes Fixed bug in the Modular Property Framework that would cause errors when trying to use phase-based material balances with phase equilibria. Fixed bug in Modular Properties Framework that caused errors when initializing models with non-vapor-liquid phase equilibria. Fixed typos flagged by June update to crate-ci/typos and removed DMF-related exceptions Minor corrections of units of measurement handling in power plant waste/transport costing expressions, control volume material holdup expressions, and BTX property package parameters Fixed throwing >7500 numpy deprecation warnings by replacing scalar value assignment with element extraction and item iteration calls Testing and Robustness Migrated slow tests (>10s) to integration, impacting test coverage but also yielding a nearly 30% decrease in local test runtime Pinned pint to avoid issues with older supported Python versions Pinned codecov versions to avoid tokenless upload behavior with latest version Bumped extensions to version 3.4.2 to allow pointing to non-standard install location Deprecations and Removals Python 3.8 is no longer supported. The supported Python versions are 3.9 through 3.12 The Data Management Framework (DMF) is no longer supported. Importing idaes.core.dmf will cause a deprecation warning to be displayed until the next release The SOFC Keras surrogates have been removed. The current version of the SOFC surrogate model in the examples repository is a PySMO Kriging model.

AS↗

DOE OSTI2024

IDAES-PSE 2.7.0 Release

The Institute for the Design of Advanced Energy Systems (IDAES) Integrated Platform is a versatile computational environment offering extensive process systems engineering (PSE) capabilities for optimizing the design and operation of complex, interacting technologies and systems. IDAES enables users to efficiently search vast, complex design spaces to discover the lowest cost solutions while supporting the full process modeling lifecycle, from conceptual design to dynamic optimization and control. The extensible, open platform empowers users to create models of novel processes and rapidly develop custom analyses, workflows, and end-user applications. IDAES-PSE 2.7.0 Release Highlights New features: AutoScaler and CustomScalerBase classes: Such tools are the core of the new scaling framework being implemented in IDAES. Wider adoption of scaling tools among users will result in quicker and more robust model solutions. Scaler for equilibrium reactor and saponification properties: These scaler models are examples to follow for how to use the new scaling tools. ONNX Surrogate support from Optimization & Machine Learning Toolkit (OMLT): ONNX is an open standard format to save and load ML/AI models that is widely supported by all major frameworks. This capability makes it easier for IDAES users to create surrogate models and use them without having to support each framework individually. 1D Membrane Model for CO2 Capture and Utilization: Supports ongoing efforts for modeling and optimizing polymer membrane processes for CO2 capture and conversion into formic acid. StreamScaler unit model: Unrelated to the CustomScalerBase, this unit model allows a stream’s extensive variables to be scaled by a fixed factor. This allows streams being processed by multiple units in parallel to be scaled down to unit scale and scaled back up to process scale. Bug fixes or improvements: Scaling, EoS, Diagnostics tool, Modular Properties, tests & documentation Deprecations: Old Cubic EoS

AS↗

DOE OSTI2025

IDAES-PSE 2.8.0 Release

The Institute for the Design of Advanced Energy Systems (IDAES) Integrated Platform is a versatile computational environment offering extensive process systems engineering (PSE) capabilities for optimizing the design and operation of complex, interacting technologies and systems. IDAES enables users to efficiently search vast, complex design spaces to discover the lowest cost solutions while supporting the full process modeling lifecycle, from conceptual design to dynamic optimization and control. The extensible, open platform empowers users to create models of novel processes and rapidly develop custom analyses, workflows, and end-user applications.

AS↗

DOE OSTI2024

Flexible Technoeconomic Analysis Tools for Evaluating Emerging Power Generation Technologies in Hourly Electricity Markets using IDAES and Pyomo

Conference presentation leveraging the recently developed “price-taker class”. We use the tool to develop and showcase workflows that enable rapid technology evaluation for power generation technologies. This work shows a reimplementation of previous results that were conducted outside the price-taker class framework, indicating this workflow is indeed streamlining emerging technology analysis.

Laky, Daniel↗

DOE OSTI2025

Automated Systems for Solvent Extraction

An automated solvent extraction system for the eventual handling of radioactive materials has been designed and procured for rapid, efficient and safe liquid-liquid extraction processes. This system will be configured to carry out liquid-liquid separations from beginning to end, automating tedious and time-consuming tasks such as organic/aqueous phase prep, pH checks, phase separation, and metal ion analysis. The system features advanced liquid handling capabilities, a robotic arm for precise sample transfer, and sophisticated analytical tools including UV-VIS spectrophotometry for real-time monitoring. Additionally, it incorporates automated capping of vials, vortex mixing, and centrifugation to ensure thorough mixing and phase separation. This report provides an overview of the system and general capabilities as well as initial efforts to develop an automated workflow for liquid-liquid separations.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗