Search NASA⌕ Search

SEARCH · Search NASA

Results for “distributed workflows”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

A Mobility-Driven Approach to Modeling Building Energy

Buildings are one of the primary energy consumers in any city's energy use [12]. Presence and absence of humans is a major contributing factor to the energy use in a building. In this paper, we present an approach to generating a realistic model of human building occupancy throughout a typical work week. We use the Toolbox for Urban Mobility Systems (TUMS) to generate a synthetic population based on population distribution estimates, we schedule the population's daily commute based on National Household Travel Survey (NHTS) survey data, and we simulate their daily travel patterns using an agent-based transportation simulation (TRANSIMS). We process and fuse the simulation output to produce a list of the first and last seen location of each agent in the simulation. Based on the arrival at the last destination, we map each agent to one of the nearby buildings. Using these agent arrivals, as well as NHTS data, we create an hourly occupancy schedule for each building. We successfully demonstrate this workflow at the example of the Chicago Loop, a major business district in Chicago, Illinois.

Berres, Andy↗
NASA NTRS2007

Design and Data Management System

The Design and Data Management System (DDMS) was developed to automate the NASA Engineering Order (EO) and Engineering Change Request (ECR) processes at the Propulsion Test Facilities at Stennis Space Center for efficient and effective Configuration Management (CM). Prior to the development of DDMS, the CM system was a manual, paper-based system that required an EO or ECR submitter to walk the changes through the acceptance process to obtain necessary approval signatures. This approval process could take up to two weeks, and was subject to a variety of human errors. The process also requires that the CM office make copies and distribute them to the Configuration Control Board members for review prior to meetings. At any point, there was a potential for an error or loss of the change records, meaning the configuration of record was not accurate. The new Web-based DDMS eliminates unnecessary copies, reduces the time needed to distribute the paperwork, reduces time to gain the necessary signatures, and prevents the variety of errors inherent in the previous manual system. After implementation of the DDMS, all EOs and ECRs can be automatically checked prior to submittal to ensure that the documentation is complete and accurate. Much of the configuration information can be documented in the DDMS through pull-down forms to ensure consistent entries by the engineers and technicians in the field. The software also can electronically route the documents through the signature process to obtain the necessary approvals needed for work authorization. The workflow of the system allows for backups and timestamps that determine the correct routing and completion of all required authorizations in a more timely manner, as well as assuring the quality and accuracy of the configuration documents.

Messer, Elizabeth↗
DOE OSTI2022

Legacy surface change analyses of the 1993 Rock Valley earthquake sequence for direct comparison to planned NA-22 underground conventional high-explosive experiments (Source Physics Experiment 3 (SPE3) - RV/DC Task 1.3 FY22 Final Report)

Recent work under two previous phases of the NNSA NA-22 Source Physics Experiment (SPE) have shown that underground chemical high-explosive experiments can produce detectable surface changes that differ in spatial extent and vertical magnitude depending on the geologic media at the site (Schultz-Fellenz et al., 2018; 2020; Crawford et al., 2021). Neither of these two prior phases of SPE identified natural earthquake-related surface effects in the same region that occurred at a similar depth as the explosive experiments for direct comparison. While earthquakes can also produce surface changes that are detectable using remote sensing data analyses, it is expected that the pattern and spatial extent of surface changes would vary between earthquakes and explosions. However, no direct-observed surface-change signature comparison between earthquakes and explosions has ever been performed. The SPE Phase 3 Rock Valley/Direct Comparison (RV/DC) program presents a unique opportunity to investigate and characterize co-occurrence of both earthquakes and explosions. In this project, we worked to address five tasks in a workflow, as follows: 1. Identify and obtain existing high-resolution legacy satellite and aerial imagery as close in time before and after the 1993 Rock Valley earthquake sequence to temporally constrain the analyses. 2. Transform these pre-earthquake and post-earthquake datasets into digital elevation models (DEMs) using geospatial analysis software packages (e.g., ArcGIS, Agisoft Metashape, and Google Earth Engine). 3. Perform DEM differencing analyses to assess and quantify earthquake-related changes from the 1993 sequence, and develop map products that visualize these analyses. 4. Use the analyses from (3) to: (a) assess spatial distribution and magnitude of surface changes due to the 1993 Rock Valley earthquake sequence, and (b) determine parameters of forthcoming, planned explosion-related surface change data collection from sensors mounted on unmanned aerial vehicles (UAVs) (e.g., spatial extent of collection, design and density of survey control, sensors to deploy, forward speed and line spacing of UAV flight lines, flight altitude). 5. Develop a summary report on the analyses, including how the analyses define parameters and identify focus areas for any future surface change analytical field campaigns related to the explosive experiment. Analyzing these legacy data and identifying whether they can detect any surface changes related to the earthquake sequence facilitates opportunities for direct signature comparison of surface change from explosions at one location, which has never previously been performed. Comparing the surface change signatures from a co-located and depth-equivalent earthquake and an explosion could help to advance remote sensing event discrimination techniques. This report summarizes the work completed toward this ambitious goal.

42 ENGINEERING↗
DOE OSTI2024

New U.S. Data Tools are Playing a Crucial Role in Decarbonizing Buildings at Speed, Scale, and Low Cost

Preparing buildings for retrofits traditionally requires expensive on-site audits or timeintensive simulation models. As a result, the majority of buildings fail to pursue cost-saving retrofits. To address these barriers, the U.S. Department of Energy (DOE) has introduced the Building Efficiency Targeting Tool for Energy Retrofits (BETTER)-a new, free, on-line tool that utilizes a data-driven analytical engine and user-friendly web interface to automatically analyze a building's monthly energy usage in response to weather conditions. The tool benchmarks a building's electric and fossil energy usage against peers; estimates energy, cost, and emissions reductions at the building and portfolio levels; recommends energy efficiency measures; and prioritizes buildings for net-zero energy retrofits. Thanks to interoperability with the DOE's Standard Energy Efficiency Data (SEED) platform, BETTER is supporting U.S. jurisdictions to prepare buildings for retrofit at speed, scale, and low cost to comply with energy policies. This paper discusses the use of BETTER and SEED by one of the branches of the California state government to streamline a retrofit program across 455 public non-residential buildings to align with state goals to reduce greenhouse gas emissions. It describes the organization's challenge to reduce energy consumption across a geographically diverse, aging portfolio; explores how BETTER and SEED improved workflow efficiency; presents preliminary results, including avoiding audit costs of $3.28 million and developing the groundwork for retrofit projects estimated to prevent emission of 2,271 t CO2e annually; and provides guidance for other jurisdictions seeking similar results.

BETTER↗
DOE OSTI2019

Implementation of ATLAS Distributed Computing monitoring dashboards using InfluxDB and Grafana

For the last 10 years, the ATLAS Distributed Computing project has based its monitoring infrastructure on a set of custom designed dashboards provided by CERN. This system functioned very well for LHC Runs 1 and 2, but its maintenance has progressively become more difficult and the conditions for Run 3, starting in 2021, will be even more demanding; hence a more standard code base and more automatic operations are needed. A new infrastructure has been provided by CERN, based on InfluxDB as the data store and Grafana as the display environment. ATLAS has adapted and further developed its monitoring tools to use this infrastructure for data and workflow management monitoring and accounting dashboards, expanding the range of previous possibilities with the aim to achieve a single, simpler, environment for all monitoring applications. This document describes these tools and the data flows for monitoring and accounting.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Integrated edge-to-exascale workflow for real-time steering in neutron scattering experiments

We introduce a computational framework that integrates artificial intelligence (AI), machine learning, and high-performance computing to enable real-time steering of neutron scattering experiments using an edge-to-exascale workflow. Focusing on time-of-flight neutron event data at the Spallation Neutron Source, our approach combines temporal processing of four-dimensional neutron event data with predictive modeling for multidimensional crystallography. At the core of this workflow is the Temporal Fusion Transformer model, which provides voxel-level precision in predicting 3D neutron scattering patterns. The system incorporates edge computing for rapid data preprocessing and exascale computing via the Frontier supercomputer for large-scale AI model training, enabling adaptive, data-driven decisions during experiments. This framework optimizes neutron beam time, improves experimental accuracy, and lays the foundation for automation in neutron scattering. Although real-time experiment steering is still in the proof-of-concept stage, the demonstrated potential of this system offers a substantial reduction in data processing time from hours to minutes via distributed training, and significant improvements in model accuracy, setting the stage for widespread adoption across neutron scattering facilities and more efficient exploration of complex material systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

AI ATAC 1: An Evaluation of Prominent Commercial Malware Detectors

This work presents an evaluation of six prominent commercial endpoint malware detectors, a network malware detector, and a file-conviction algorithm from a cyber technology vendor. The evaluation was administered as the first of the Artificial I ntelligence Applications t o Autonomous Cybersecurity (AI ATAC) prize challenges, funded by / completed in service of the US Navy. The experiment employed 100K files (50/50% benign/malicious) with a stratified distribution of file types, including ~1K zero-day program executables (increasing experiment size two orders of magnitude over previous work). We present an evaluation process of delivering a file to a fresh virtual machine donning the detection technology, waiting 90s to allow static detection, then executing the file and waiting another period for dynamic detection; this allows greater fidelity in the observational data than previous experiments, in particular, resource and time-to-detection statistics. To execute all 800K trials (100K files × 8 tools), a software framework is designed to choreograph the experiment into an automated, time-synced, and reproducible workflow with substantial parallelization. Software with base classes for this framework are provided. A cost-benefit model was configured to integrate the tools’ detection statistics into a comparable quantity by simulating costs of use. This provides a ranking methodology for cyber competitions and a lens for reasoning about the varied statistical results. The results provide insights on state of commercial malware detection.

Bridges, Robert↗
DOE OSTI2023

Robust In-Situ Strain Measurements to Monitor CO 2 Storage

The goal of this project was to develop and demonstrate robust instrumentation to monitor the in-situ strain tensor in order to improve the reliability and security of CO 2 storage in geologic formations. We met the original goals of the project and the major overarching accomplishment is the advancement of strain tensor monitoring from an intriguing concept to a commercially available technology with a solid foundation of novel instruments supported by theoretical analyses and validation experiments. The main accomplishments of the project are summarized below. We designed, built and evaluated nine new optical fiber strainmeters and tiltmeters using Michelson interferometers to measure deformation with ultra-high resolution at both shallow and deep point locations in the subsurface. These are the robust strainmeters that motivated the title of the project. We designed, built and evaluated a novel method of measuring distributed strain in optical fibers with nanostrain resolution, and cm-scale location, and sampling into the seismic band. The new method is called Coherence-length-gated Microwave Photonics Interfereometry (CMPI). CMPI technology has advantages over existing commercial DAS and DSS methods. We developed and demonstrated capabilities to deploy instruments in the field and used them to measure strain caused by ambient signals like barometric pressure and tides, as well as induced signals like surface loading and pore pressure changes from pumping tests. We deployed a working strainmeter at 1,700 ft depth, slightly above an active reservoir. This is to our knowledge the greatest depth a strainmeter has been deployed and the techniques we used can readily be extended to greater depths. Optical fiber borehole tensor strainmeter techology was advanced from a TRL 4 at the start, to a TRL of 7 at the conclusion of the project. The project included advances in simulations and theoretical analyses. We developed and demonstrated a computational workflow that uses machine learning to reduce the computational requirements and make it practical to use Bayesian inversion to solve large numerical poroelastic analyses needed to interpret strain tensor field data. We evaluated the strain tensor fields and time series that would be caused by leaks of CO 2 or other fluids from reservoirs. These simulations demonstrated that signals from leaks could be measured with instruments developed for the project, opening a potentially new method for ensuring storage security. We showed that strains in caprock can be used to estimate pressure in a reservoir. This avoids the need to drill monitoring wells into the reservoir, and it expands the capabilities of monitoring in the caprock. The project includes a derivation and application of a novel analytical solution to the strains in the vicinity of a pressurized poroelastic inclusion. This solution explains field data measured during injeciton tests at the North Avant Field, and it will simplify future interpretation of strain tensor data. The project included a broad range of experiments, and of the most significant is the characterization of the strain tensor at an array three strainmeters during six injection tests at the North Avant Field, Oklahoma. This demonstrated repeatability of the strain signal measured by the new instruments developed for the project, and it showed similarities between the strain signal at shallow depths and pressure in the underlying reservoir. We also demonstrated that useful strain data can be measured at reservoir depths. This confirms that strain tensor data can be measured throughout the caprock over a reservoir. The project demonstrated the feasibility of using the strain tensor and distributed strain measured in caprock during a variety of different well tests where the pumping rate was constant, sinusoidal and positive, or a periodic square wave with zero net rate. This further strengthens the validity of using strain data to characterize reservoirs and aquifers. We also demonstrated that strain caused be fluctuations of air pressure and water pressure in the vadose zone can be measured and interpreted, suggesting that high resolution distributed strain measurements hold promise for monitoring the vadose zone. The project partially supported nine graduate students in the Environmental Engineering, Hydrogeology, Electrical Engineering programs at Clemson University. The research was described in nine journal papers, 23 talks and conference abstracts. Additional journal papers are in preparation. A new company called Tensora was started to provide strainmeter technology for commercial applications.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2023

A phased workflow to define permit‐ready locations for large volume CO 2 injection and storage

Abstract To‐date, only two UIC Class VI permits have been issued by the US Environmental Protection Agency. We illustrate a four‐phase workflow to first identify regional storage resources and then down‐select sites to yield permit‐ready locations that can accept and store large volumes of CO 2 . Specific permit requirements should guide objectives and define deliverables of respective workflow phases. In the first phase we used available regional data and screened structure and injection zones to locate resources that match CO 2 volumes planned to be captured. Available data were also used to assess presence and depth of usable groundwater, the key resource being protected via permitting. We then used advanced, closed‐form, analytical solutions (EASiTool) to estimate CO 2 injectivity into each hydrologically connected injection compartment. In the second phase we acquired and conditioned additional wireline logs and leased available seismic datasets. We interpreted the depositional systems from wireline well‐log character and mapped sandbody geometry to interpolate injection and confining‐zone distribution. Using available data, we mapped faults and locations of freshwater and overpressure (or other capacity‐limiting geologic parameters) in more detail. In the third phase, we used the augmented geologic data to develop a static model for the selected area, extracted the areas of highest interest, and generated and ran dynamic (flow) models. In a fourth phase, we reduced major uncertainties identified in earlier phases. Our case study indicates that to complete preparation of a permit application requires (1) improved lithologic characterization information (thicknesses and horizontal and vertical connectivity) and (2) better definition of poorly defined local faults. © 2023 The Authors. Greenhouse Gases: Science and Technology published by Society of Chemical Industry and John Wiley & Sons Ltd.

58 GEOSCIENCES↗
DOE OSTI2017

HEPCloud, a New Paradigm for HEP Facilities: CMS Amazon Web Services Investigation

Historically, high energy physics computing has been performed on large purpose-built computing systems. These began as single-site compute facilities, but have evolved into the distributed computing grids used today. Recently, there has been an exponential increase in the capacity and capability of commercial clouds. Cloud resources are highly virtualized and intended to be able to be flexibly deployed for a variety of computing tasks. There is a growing interest among the cloud providers to demonstrate the capability to perform large-scale scientific computing. In this paper, we discuss results from the CMS experiment using the Fermilab HEPCloud facility, which utilized both local Fermilab resources and virtual machines in the Amazon Web Services Elastic Compute Cloud. We discuss the planning, technical challenges, and lessons learned involved in performing physics workflows on a large-scale set of virtualized resources. Additionally, we will discuss the economics and operational efficiencies when executing workflows both in the cloud and on dedicated resources.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Combined Data and Deep Learning Model Uncertainties: An Application to the Measurement of Solid Fuel Regression Rate

In complex physical process characterization, such as the measurement of the regression rate for solid hybrid rocket fuels, where both the observation data and the model used have uncertainties originating from multiple sources, combining these in a systematic way for quantities of interest (QoI) remains a challenge. In this paper, we present a forward propagation uncertainty quantification (UQ) process to produce a probabilistic distribution for the observed regression rate r. We characterized two input data uncertainty sources from the experiment (the distortion from the camera U c and the non-zero-angle fuel placement U Y ), the prediction and model form uncertainty from the deep neural network (U m ), as well as the variability from the manually segmented images used for training it (U s ). Here, we conducted seven case studies on combinations of these uncertainty sources with the model form uncertainty. The main contribution of this paper is the investigation and inclusion of the experimental image data uncertainties involved, and how to include them in a workflow when the QoI is the result of multiple sequential processes.

42 ENGINEERING↗
DOE OSTI2022

A low-cost centralized HVAC control system solution for energy savings, load shedding, and improved maintenance

University campuses rely on centralized controls for managing and optimizing complex HVAC systems in larger buildings. However, most campuses also have many smaller buildings with packaged HVAC systems controlled by a stand-alone thermostat. Even when these distributed and often overlooked systems have modern programmable thermostats, they cannot be centrally monitored or controlled, and they are typically not programmed adequately. This paper describes the implementation of a low-cost centralized control solution for these systems serving smaller campus buildings, mostly under 5,000 sf and representative of light commercial spaces. Thanks to advances in technology spurred by residential and commercial IoT developments, simple networked thermostat solutions exist that can easily replace original thermostats, and, connect these systems to a web-based portal for monitoring and control. We show that, with small customizations, these platforms can be integrated into facility management workflows. Beyond the energy savings potential from improved scheduling and closer management of these systems, there are significant advantages for maintenance crews since these systems can now be monitored on smart phones or tablets. A grid-responsive load-shedding program has also been implemented for additional cost savings. The networked thermostats can also be connected to additional systems such as economizer controls for improved ventilation management and energy savings. With data from these systems integrated centrally, it can also be used for improved analytics and fault detection. A toolkit has been developed to share the program with other campuses, whether for energy savings, improved management of ventilation, or a more proactive maintenance approach.

Fauchier-Magnan, Nicolas↗
DOE OSTI2022

Resilient, Rural, and Revolutionary: Salisbury Square's Direct-Current Affordable Microgrid Community: Preprint

The technology to interconnect buildings with a dedicated direct-current (DC) power distribution network is in place today; what is missing is a turnkey approach to designing a DC microgrid - and the business models allowing such systems to be deployed, owned, and operated at scale. To close this gap, the Salisbury Square Development Team, comprising clean-energy experts, has engineered a resilient community DC microgrid for an affordable housing community in Randolph, Vermont. Ten single-family, occupant-owned residences and 12 multifamily rental units will share locally generated and stored solar energy via a DC power distribution bus capable of operating during extended grid outages. With a DC power distribution network in place, each home will be equipped with high-efficiency DC lighting and appliances, operating alongside alternating current (AC) appliances, even during an islanded mode of operation. To obtain a comprehensive understanding of what is possible and achievable, the Team collaborated with the local utility, regulatory agencies, a national laboratory, energy-as-service providers, and vendors. The collaborators evaluated microgrid typologies, business models, and energy modeling, and analyzed electrification and resilience. Further, the Team applied the URBANoptTM (Urban Renewable Building and Neighborhood optimization, NREL 2022) software development kit (SDK) to Salisbury Square's single-family and multifamily buildings to validate workflows and identify needs for advanced capability. This paper addresses the barriers to entry, scalability, and impact on residents and system ownership. It also examines the analysis that informed the design and engineering of the DC microgrid and the opportunities to streamline the process.

DER↗
DOE OSTI2023

Pedestal particle balance studies in JET-ILW H-mode plasmas

JET-ILW type I ELMy H-modes at 2.5 MA/2.8 T with constant NBI heating (23 MW) and gas fuelling rate were performed, utilising edge localised mode (ELM) pacing by vertical kicks and plasma shaping (triangularity, δ) as tools to disentangle the effects of ELMs, inter-ELM transport and edge stability on the pedestal particle balance. In agreement with previous studies, the pedestal confinement improves with increasing δ, mostly due to a significant increase in pedestal density while the ELM frequency ($f_{\mathrm{ELM}}$) is decreased. Improved pedestal confinement with increasing δ was observed even when the pedestal MHD stability was degraded artificially by vertical kicks, implying that increased triangularity may favourably affect the inter-ELM pedestal recovery. The workflow developed to quantify the pedestal particle balance uses high time-resolution profile reflectometry to characterise the inter-ELM evolution of the plasma particle content ($\mathrm{d} N/\mathrm{d}t$), the NEO drift-kinetic solver to evaluate the neoclassical fluxes and interpretative EDGE2D-EIRENE simulations to estimate the edge particle source. The edge particle source is then constrained by deuterium Balmer-α line intensity measurements in the main chamber, which are, however, strongly affected by reflections from the metal walls. The reflections are accounted for by the CHERAB code taking the divertor emission (the brightest light source in the torus) distribution from imaging spectroscopy measurements as input. Our analysis shows that in the second half of the ELM cycle, the volume-integrated particle source is larger than $\mathrm{d} N/\mathrm{d}t$, indicating that transport plays a key role in the inter-ELM pedestal recovery.

fuelling↗
DOE OSTI2018

SPARC: Demonstrate burst-buffer-based checkpoint/restart on ATS-1.

Recent high-performance computing (HPC) platforms such as the Trinity Advanced Technology System (ATS-1) feature burst buffer resources that can have a dramatic impact on an application’s I/O performance. While these non-volatile memory (NVM) resources provide a new tier in the storage hierarchy, developers must find the right way to incorporate the technology into their applications in order to reap the benefits. Similar to other laboratories, Sandia is actively investigating ways in which these resources can be incorporated into our existing libraries and workflows without burdening our application developers with excessive, platform-specific details. This FY18Q1 milestone summaries our progress in adapting the Sandia Parallel Aerodynamics and Reentry Code (SPARC) in Sandia’s ATDM program to leverage Trinity’s burst buffers for checkpoint/restart operations. We investigated four different approaches with varying tradeoffs in this work: (1) simply updating job script to use stage-in/stage out burst buffer directives, (2) modifying SPARC to use LANL’s hierarchical I/O (HIO) library to store/retrieve checkpoints, (3) updating Sandia’s IOSS library to incorporate the burst buffer in all meshing I/O operations, and (4) modifying SPARC to use our Kelpie distributed memory library to store/retrieve checkpoints. Team members were successful in generating initial implementation for all four approaches, but were unable to obtain performance numbers in time for this report (reasons: initial problem sizes were not large enough to stress I/O, and SPARC refactor will require changes to our code). When we presented our work to the SPARC team, they expressed the most interest in the second and third approaches. The HIO work was favored because it is lightweight, unobtrusive, and should be portable to ATS-2. The IOSS work is seen as a long-term solution, and is favored because all I/O work (including checkpoints) can be deferred to a single library.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Open-Source and FAIR Research Software for Proteomics

Scientific discovery relies on innovative software as much as experimental methods, especially in proteomics, where computational tools are essential for mass spectrometer setup, data analysis, and interpretation. Since the introduction of SEQUEST, proteomics software has grown into a complex ecosystem of algorithms, predictive models, and workflows, but the field faces challenges, including the increasing complexity of mass spectrometry data, limited reproducibility due to proprietary software, and difficulties integrating with other omics disciplines. Closed-source, platform-specific tools exacerbate these issues by restricting innovation, creating inefficiencies, and imposing hidden costs on the community. Open-source software (OSS), aligned with the FAIR Principles (Findable, Accessible, Interoperable, Reusable), offers a solution by promoting transparency, reproducibility, and community-driven development, which fosters collaboration and continuous improvement. In this manuscript, we explore the role of OSS in computational proteomics, its alignment with FAIR principles, and its potential to address challenges related to licensing, distribution, and standardization. Drawing on lessons from other omics fields, we present a vision for a future where OSS and FAIR principles underpin a transparent, accessible, and innovative proteomics community.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Parallelizing autotuning for HPC applications: Unveiling the potential of the speculation strategy in Bayesian optimization

In the exascale computing era, tuning High-Performance Computing (HPC) applications has become a significant computational challenge. Although Bayesian optimization (BO) has emerged as a promising tool for HPC performance tuning, the BO workflow is inherently sequential (i.e., one function evaluation at a time) and cannot leverage the huge amount of parallel resources present in modern supercomputers, resulting in a considerable underutilization of their computational capabilities. This paper explores the trade-off between search quality and parallelism in BO, investigating a diverse set of methods. Building upon both previous approaches from the literature and novel methodologies introduced in this work, our study provides a deep analysis to accelerate BO performance tuning. By examining a set of synthetic functions and practical HPC applications, our exploration analyzes the interaction among various BO methods for parallelization, the quantity of parallel resources, the runtime distribution of target HPC applications, and the costs associated with different search orchestration mechanisms that have been overlooked in previous studies. Compared to sequential BO, our novel methodology achieves comparable quality while demonstrating robust scalability in search time as the amount of parallel resources increases; it also outperforms a state-of-the-art tuner, which supports parallelization, achieving up to 3.67x faster search time. We provide high-value insights for practitioners seeking to leverage the power of parallel computing for efficient HPC application tuning. Additionally, to further assist researchers in accelerating the performance tuning of their HPC applications, we provide an extension of an existing open-source tuning framework that incorporates our methods.

Bayesian optimization↗
DOE OSTI2019

Parallel beamlet dose calculation via beamlet contexts in a distributed multi‐GPU framework

Purpose Dose calculation is one of the most computationally intensive, yet essential tasks in the treatment planning process. With the recent interest in automatic beam orientation and arc trajectory optimization techniques, there is a great need for more efficient model‐based dose calculation algorithms that can accommodate hundreds to thousands of beam candidates at once. Foundational work has shown the translation of dose calculation algorithms to graphical processing units ( GPU s), lending to remarkable gains in processing efficiency. But these methods provide parallelization of dose for only a single beamlet, serializing the calculation of multiple beamlets and under‐utilizing the potential of modern GPU s. In this paper, the authors propose a framework enabling parallel computation of many beamlet doses using a novel beamlet context transformation and further embed this approach in a scalable network of multi‐ GPU computational nodes. Methods The proposed context‐based transformation separates beamlet‐local density and TERMA into distinct beamlet contexts that independently provide sufficient data for beamlet dose calculation. Beamlet contexts are arranged in a composite context array with dosimetric isolation, and the context array is subjected to a GPU collapsed‐cone convolution superposition procedure, producing the set of beamlet‐specific dose distributions in a single pass. Dose from each context is converted to a sparse representation for efficient storage and retrieval during treatment plan optimization. The context radius is a new parameter permitting flexibility between the speed and fidelity of the dose calculation process. A distributed manager‐worker architecture is constructed around the context‐based GPU dose calculation approach supporting an arbitrary number of worker nodes and resident GPU s. Phantom experiments were executed to verify the accuracy of the context‐based approach compared to Monte Carlo and a reference CPU ‐ CCCS implementation for single beamlets and broad beams composed by addition of beamlets. Dose for representative 4 π beam sets was calculated in lung and prostate cases to compare its efficiency with that of an existing beamlet‐sequential GPU ‐ CCCS implementation. Code profiling was also performed to evaluate the scalability of the framework across many networked GPU s. Results The dosimetric accuracy of the context‐based method displays <1.35% and 2.35% average error from the existing serialized CPU ‐ CCCS algorithm and Monte Carlo simulation for beamlet‐specific PDD s in water and slab phantoms, respectively. The context‐based method demonstrates substantial speedup of up to two orders of magnitude over the beamlet‐sequential GPU ‐ CCCS method in the tested configurations. The context‐based framework demonstrates near linear scaling in the number of distributed compute nodes and GPU s employed, indicating that it is flexible enough to meet the performance requirements of most users by simply increasing the hardware utilization. Conclusions The context‐based approach demonstrates a new expectation of performance for beamlet‐based dose calculation methods. This approach has been successful in accelerating the dose calculation process for very large‐scale treatment planning problems ‐ such as automatic 4 π IMRT beam orientation and VMAT arc trajectory selection, with hundreds of thousands of beamlets ‐ in clinically feasible timeframes. The flexibility of this framework makes it as a strong candidate for use in a variety of other very large‐scale treatment planning tasks and clinical workflows.

Neph, Ryan↗