Search NASA⌕ Search

SEARCH · Search NASA

Results for “scheduling software”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Stochastic Look-Ahead Commitment: A Case Study in MISO

This paper introduces the Stochastic Look Ahead Commitment (SLAC) software prototyped and tested for the Midcontinent Independent System Operator (MISO) look ahead commitment process. SLAC can incorporate hundreds of wind, load, and net scheduled interchange (NSI) uncertainty scenarios. It uses a progressive hedging method to solve a novel two-stage stochastic unit commitment. The first stage commitment decisions, made only for those generators whose decision to commit or not in each time period cannot be deferred, can cover the uncertainties within the next three hours. The second stage includes both the dispatch for each of the scenarios and the commitment decisions that can be deferred. Study results on 15 MISO production days show that SLAC may bring economic and reliability benefits under uncertainty.

MATHEMATICS AND COMPUTING↗

HL-LHC Analysis With ROOT: ROOT Project Input to the HL-LHC Computing Review (Stage 2)

ROOT is high energy physics' software for storing and mining data in a statistically sound way, to publish results with scientific graphics. It is evolving since 25 years, now providing the storage format for more than one exabyte of data; virtually all high energy physics experiments use ROOT. With another significant increase in the amount of data to be handled scheduled to arrive in 2027, ROOT is preparing for a massive upgrade of its core ingredients. As part of a review of crucial software for high energy physics, the ROOT team has documented its R&D plans for the coming years.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Management of metadata and automation for mail-in measurements with the APS 11-BM high throughput, high-resolution synchrotron powder diffractometer.

A high-resolution and high-throughput synchrotron powder diffractometer has been automated for use with samples that are mailed in by Advanced Photon Source users. Implementation of a relational database with web interfaces for both outside users and beamline staff, which is integrated into the facility-wide proposal and safety system, allows all aspects of beamline management to be integrated. This system permits users to request kits for mounting samples, to provide sample safety information, to obtain their collected data and to provide usage information upon project completion in a quick and simple manner. Beamline staff use a separate interface to note receipt of samples, schedule and collect diffraction data, post-process and quality-check data, and dispose of samples. The design of the software and database are discussed in detail.

43 PARTICLE ACCELERATORS↗

SU-E-T-776: Use of Quality Metrics for a New Hypo-Fractionated Pre-Surgical Mesothelioma Protocol

Purpose: The “SMART” (Surgery for Mesothelioma After Radiation Therapy) approach involves hypo-fractionated radiotherapy of the lung pleura to 25Gy over 5 days followed by surgical resection within 7. Early clinical results suggest that this approach is very promising, but also logistically challenging due to the multidisciplinary involvement. Due to the compressed schedule, high dose, and shortened planning time, the delivery of the planned doses were monitored for safety with quality metric software. Methods: Hypo-fractionated IMRT treatment plans were developed for all patients and exported to Quality Reports™ software. Plan quality metrics or PQMs™ were created to calculate an objective scoring function for each plan. This allows for an objective assessment of the quality of the plan and a benchmark for plan improvement for subsequent patients. The priorities of various components were incorporated based on similar hypo-fractionated protocols such as lung SBRT treatments. Results: Five patients have been treated at our institution using this approach. The plans were developed, QA performed, and ready within 5 days of simulation. Plan Quality metrics utilized in scoring included doses to OAR and target coverage. All patients tolerated treatment well and proceeded to surgery as scheduled. Reported toxicity included grade 1 nausea (n=1), grade 1 esophagitis (n=1), grade 2 fatigue (n=3). One patient had recurrent fluid accumulation following surgery. No patients experienced any pulmonary toxicity prior to surgery. Conclusion: An accelerated course of pre-operative high dose radiation for mesothelioma is an innovative and promising new protocol. Without historical data, one must proceed cautiously and monitor the data carefully. The development of quality metrics and scoring functions for these treatments allows us to benchmark our plans and monitor improvement. If subsequent toxicities occur, these will be easy to investigate and incorporate into the metrics. This will improve the safe delivery of large doses for these patients.

60 APPLIED LIFE SCIENCES↗

`SkyPy`: A package for modelling the Universe

SkyPy is an open-source Python package for simulating the astrophysical sky. It comprises a library of physical and empirical models across a range of observables and a command-line script to run end-to-end simulations. The library provides functions that sample realisations of sources and their associated properties from probability distributions. Simulation pipelines are constructed from these models using a YAML-based configuration syntax, while task scheduling and data dependencies are handled internally and the modular design allows users to interface with external software. SkyPy is developed and maintained by a diverse community of domain experts with a focus on software sustainability and interoperability. By fostering development, it provides a framework for correlated simulations of a range of cosmological probes including galaxy populations, large scale structure, the cosmic microwave background, supernovae and gravitational waves. Version 0.4 implements functions that model various properties of galaxies including luminosity functions, redshift distributions and optical photometry from spectral energy distribution templates. Future releases will provide additional modules, for example, to simulate populations of dark matter halos and model the galaxy-halo connection, making use of existing software packages from the astrophysics community where appropriate.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Recovery Act: A Measurement -- Management Technology for Improving Energy Efficiency in Data Centers and Telecommunication Facilities (Final Technical Report)

Data center (DC) electricity use is increasing at an annual rate of over 20% and presents a concern for the Information Technology (IT) industry, governments, and the society. A large fraction of the energy use is consumed by the compressor cooling to maintain the recommended operating conditions for IT equipment. The most common way to improve the DC efficiency is achieved by optimally provisioning the cooling power to match the global heat dissipation in the DC. However, at a more granular level, the large range of heat densities of today's IT equipment makes the task of provisioning cooling power optimized to the level of individual computer room air conditioning (CRAC) units much more challenging. Distributed sensing within a DC enables the development of new strategies to improve energy efficiency, such as hot spot elimination through targeted cooling, matching power consumption at rack level with workload schedule, and minimizing power losses. The scope of Measurement and Management Technologies (MMT) is to develop a software tool and the underlying sensing technology to provide critical decision support and control for DC and telecommunication facilities (TF) operations. A key aspect of MMT technology is integration of modeling tools to understand how changes in one operational parameter affect the overall DC response. It is demonstrated that reduced ordered models for DC can generate, in less than 2 seconds computational time, a three dimensional thermal model in a 50 kft 2 DC. This rapid modeling enables real time visualization of the DC conditions and enables "0what if" scenarios simulations to characterize response to "disturbances". One such example is thermal zone modeling that matches the cooling power to the heat generated at a local level by identifying DC zones cooled by a specific CRAC. Turning off a CRAC unit can be simulated to understand how the other CRAC utilization changes and how server temperature responds. Several new sensing technologies were added to the existing MMT platform: (1) air contamination (corrosion) sensors, (2) power monitoring, and (3) a wireless environmental sensing network. All three technologies are built on cost effective sensing solutions that increase the density of sensing points and enable high resolution mapping of DCs. The wireless sensing solution enables Air Conditioning Unit (ACU) control while the corrosion sensor enables air side economization and can quantify the risk of IT equipment failure due to air contamination. Validation data for six test sites demonstrate that leveraging MMT energy efficiency solutions combined with industry best practices results in an average of 20% reduction in cooling energy, without major infrastructure upgrades. As an illustration of the unique MMT capabilities, a data center infrastructure efficiency (DCIE) of 87% (industry best operation) was achieved. The technology is commercialized through IBM System and Technology Lab Services that offers MMT as a solution to improve DC energy efficiency. Estimation indicates that deploying MMT in existing DCs can results in an 8 billion kWh savings and projection indicates that constant adoption of MMT can results in obtainable savings of 44 billion kWh in 2035. Negotiations are under way with business partners to commercialize/license the ACU control technology and the new sensor solutions (corrosion and power sensing) to enable third party vendors and developers to leverage the energy efficiency solutions.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Connectivity-Enhanced Route Selection and Adaptive Control for the Chevrolet Volt: Preprint

The National Renewable Energy Laboratory and General Motors evaluated connectivity-enabled efficiency enhancements for the Chevrolet Volt. A high-level model was developed to predict vehicle fuel and electricity consumption based on driving characteristics and vehicle state inputs. These techniques were leveraged to optimize energy efficiency via green routing and intelligent control mode scheduling, which were evaluated using prospective driving routes between tens of thousands of real-world origin/destination pairs. The overall energy savings potential of green routing and intelligent mode scheduling was estimated at 5% and 3% respectively. These represent substantial opportunities considering that they only require software adjustments to implement.

33 ADVANCED PROPULSION SYSTEMS↗

Risk Reduction and Training using Simulation Based Tools - 12180

Process Modeling and Simulation (M and S) has been used for many years in manufacturing and similar domains, as part of an industrial engineer's tool box. Traditionally, however, this technique has been employed in small, isolated projects where models were created from scratch, often making it time and cost prohibitive. Newport News Shipbuilding (NNS) has recognized the value of this predictive technique and what it offers in terms of risk reduction, cost avoidance and on-schedule performance of highly complex work. To facilitate implementation, NNS has been maturing a process and the software to rapidly deploy and reuse M and S based decision support tools in a variety of environments. Some examples of successful applications by NNS of this technique in the nuclear domain are a reactor refueling simulation based tool, a fuel handling facility simulation based tool and a tool for dynamic radiation exposure tracking. The next generation of M and S applications include expanding simulation based tools into immersive and interactive training. The applications discussed here take a tool box approach to creating simulation based decision support tools for maximum utility and return on investment. This approach involves creating a collection of simulation tools that can be used individually or integrated together for a larger application. The refueling simulation integrates with the fuel handling facility simulation to understand every aspect and dependency of the fuel handling evolutions. This approach translates nicely to other complex domains where real system experimentation is not feasible, such as nuclear fuel lifecycle and waste management. Similar concepts can also be applied to different types of simulation techniques. For example, a process simulation of liquid waste operations may be useful to streamline and plan operations, while a chemical model of the liquid waste composition is an important tool for making decisions with respect to waste disposition. Integrating these tools into a larger virtual system provides a tool for making larger strategic decisions. The key to integrating and creating these virtual environments is the software and the process used to build them. Although important steps in the direction of using simulation based tools for nuclear domain, the applications described here represent only a small cross section of possible benefits. The next generation of applications will, likely, focus on situational awareness and adaptive planning. Situational awareness refers to the ability to visualize in real time the state of operations. Some useful tools in this area are Geographic Information Systems (GIS), which help monitor and analyze geographically referenced information. Combined with such situational awareness capability, simulation tools can serve as the platform for adaptive planning tools. These are the tools that allow the decision maker to react to the changing environment in real time by synthesizing massive amounts of data into easily understood information. For the nuclear domains, this may mean creation of Virtual Nuclear Systems, from Virtual Waste Processing Plants to Virtual Nuclear Reactors. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Multi-Agent Control Planes for Quantum Networks: A Scalable Architecture for Autonomous Quantum Internet Management

Quantum networks are expected to enable distributed quantum computing, secure communication, and global entanglement distribution. However, operating such networks presents significant challenges, including stochastic quantum processes, fragile entanglement resources, dynamic topology, and cross-layer control requirements. Current quantum network control architectures largely rely on centralized or hierarchical controllers inspired by classical software-defined networking (SDN). While effective for small testbeds, these approaches face scalability, latency, and reliability limitations as quantum networks grow. This paper proposes a multi-agent control plane architecture for quantum networks. In this design, intelligent software agents operate at quantum nodes, repeaters, and orchestration layers, collectively managing entanglement generation, routing, purification, and scheduling. The distributed intelligence of the agent system allows the network to adapt dynamically to quantum hardware variability and environmental noise. We argue that multi-agent systems provide significant advantages over centralized control approaches, including scalability, resilience, local autonomy, and real-time adaptation. The paper discusses architectural design principles, agent coordination mechanisms, and research challenges in deploying multi-agent control planes for the emerging quantum Internet.

Alnajjar, Anees [ORNL] (ORCID:0000000237101601)↗

Connectivity-enhanced route selection and adaptive control for the Chevrolet Volt

The National Renewable Energy Laboratory and General Motors evaluated connectivity-enabled efficiency enhancements for the Chevrolet Volt. A high-level model was developed to predict vehicle fuel and electricity consumption based on driving characteristics and vehicle state inputs. These techniques were leveraged to optimize energy efficiency via green routing and intelligent control mode scheduling, which were evaluated using prospective driving routes between tens of thousands of real-world origin/destination pairs. The overall energy savings potential of green routing and intelligent mode scheduling was estimated at 5% and 3%, respectively. Furthermore, these represent substantial opportunities considering that they only require software adjustments to implement.

30 DIRECT ENERGY CONVERSION↗

Final Report for ARPA-E LOCOMOTIVES Advanced Locomotive Technology and Rail Infrastructure Optimization System (ALTRIOS) Project

The Advanced Locomotive Technology and Rail Infrastructure Optimization System (ALTRIOS) is a unique, fully integrated, open-source software tool used to evaluate strategies for cost-effectively deploying advanced locomotive technologies and associated infrastructure. ALTRIOS simulates freight-demand-driven train scheduling, mainline meet-pass planning, locomotive dynamics, train dynamics, energy conversion efficiencies, and energy storage dynamics of line-haul train operations. Because new locomotives represent a significant long-term capital investment and new technologies must be thoroughly demonstrated before deployment, this tool provides guidance on the risk/reward trade-offs and operation integration of different technology rollout strategies. An open, integrated simulation tool is valuable for identifying future research needs and making decisions on technology development, routes, and train selection. This final report details the ALTRIOS software architecture, major modules and components, and data validation process. It demonstrates the software's utility through a 30-year rollout case study targeting high penetration of advanced powertrain technologies by 2050 for two BNSF Railway routes: loaded taconite ore trains from Hibbing, Minnesota, to Superior, Wisconsin, and mixed-freight trains from Superior to Minneapolis, Minnesota.

33 ADVANCED PROPULSION SYSTEMS↗

Numerical simulations of vertical growth of hydraulic fractures and brine migration in geological formations above the Marcellus shale

One of the critical environmental questions about hydraulic fracturing in shales is the potential for contamination of ground and surface water. There are two specific concerns arising from hydraulic treatments: 1) whether hydraulic fractures extend upward through overlying strata to reach overlying aquifers containing drinking water, and 2) whether injected fluids push native fluids upward into these overlying aquifers. In this work, the extent of likely fracture growth through overlying layers during hydraulic treatment of the Marcellus shale was estimated using a hydraulic fracture model. A wide range of material and fluid flow properties in a multi-layered geologic model was considered. The model was based on conditions and characteristics applicable to the Marcellus shale in that part of the Appalachian basin within southwestern Pennsylvania. Predictions of vertical termination frequencies for hydraulic fractures were used in a multi-layer model of the strata and natural fractures for studying brine migration through the natural and induced fracture network. NFFLOW, the software for explicitly modeling flow within networks of fractures, was utilized to compute transient flow rates according to the schedule of injected fluid during hydraulic fracturing. To aid our analysis, the modeled sequence of geologic strata was capped with a fictitious unfractured, but moderately-permeable layer, which serves as a monitoring zone. The analysis assumes one well lateral was placed in the middle of the Marcellus shale with hydraulic fractures penetrating layers in the model. The newly-developed geomechanical module within NFFLOW was used to represent stress-sensitivity of the fractures. This allows the opening and closing of fracture apertures with changes in fluid pressures within fracture segments. Pressure increases in the formations overlying the Tully limestone, indicating fluid flow, was observed due to the hydraulic stimulation; and the impact of these increased pressures on brine migration towards the surface was considered.

03 NATURAL GAS↗

Integration of RNTuple in ATLAS Athena

After using ROOT’s TTree I/O subsystem for over two decades and storing more than an exabyte of compressed High Energy Physics (HEP) data, advances in technology have motivated a complete redesign, RNTuple, which breaks backward-compatibility to take better advantage of these storage options. The RNTuple I/O subsystem has been designed to address performance bottlenecks and other shortcomings of TTree. Specifically, RNTuple comes with an updated, more compact binary data format that can be stored both in ROOT files and natively in object stores. It is designed for modern storage hardware (e.g. high-throughput low-latency NVMe SSDs), and provides robust and easy to use interfaces. The binary format of RNTuple is scheduled to become production grade in 2024, and recently has become mature enough to start exploring the integration into software used by HEP experiments. In this contribution, we discuss the developments to support the features as required by the ATLAS analysis Event Data Model (EDM) in RNTuple, which will enable its integration into the Athena software framework. With these developments in place, we evaluate the performance of the current most recent versions of RNTuple-based ATLAS data sets and compare this to that of TTree.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

High Performance Computing - Power Application Programming Interface Specification

Achieving practical exascale supercomputing will require massive increases in energy efficiency. The bulk of this improvement will likely be derived from hardware advances such as improved semiconductor device technologies and tighter integration, hopefully resulting in more energy efficient computer architectures. Still, software will have an important role to play. With every generation of new hardware, more power measurement and control capabilities are exposed. Many of these features require software involvement to maximize feature benefits. This trend will allow algorithm designers to add power and energy efficiency to their optimization criteria. Similarly, at the system level, opportunities now exist for energy-aware scheduling to meet external utility constraints such as time of day cost charging and power ramp rate limitations. Finally, future architectures might not be able to operate all components at full capability for a range of reasons including temperature considerations or power delivery limitations. Software will need to make appropriate choices about how to allocate the available power budget given many, sometimes conflicting considerations.

97 MATHEMATICS AND COMPUTING↗

Austin Sustainable and Holistic Integration of Energy Storage and Solar PV [Austin SHINES]. Final Report, Version 2

The Austin SHINES project and solution is a software management platform, for an electric grid with a high penetration of dispersed photovoltaic (PV) solar generation sites, which maintains the traditional power quality and reliability associated with grid service. This project developed and deployed the platform as a Distributed Energy Resource Management System (DERMS), engaging multiple advanced controls, to evaluate operation and optimization of a fleet of diverse DER assets, installed at several locations among Austin Energy’s customers and distribution system. The project also produced a methodology to create a replicable DERMS template, adaptable to other regions and market structures. Last, Austin SHINES aimed to demonstrate the solution’s methodology would enable the DER grid ecosystem to serve load at a technical cost (System Levelized Cost of Electricity, or System LCOE) of less than the U.S. Department of Energy SHINES program metric of $0.14/kWh, in a defined boundary, while enabling a high penetration of distributed PV. Research was categorized in 6 reports (Final Deliverables = FD) listed below, with titles and descriptions indicating which area of understanding was investigated: FD-1: System Levelized Cost of Electricity (System LCOE) Methodology The creation and use of the System LCOE to Serve Load metric that encompasses the holistic, system-level costs and benefits of all resources, and enables them to be evaluated based on their ability to support an efficient and low-cost integrated grid ecosystem. FD-2: Software Platform Product Description The creation of new DER control methodologies deployable within a utility-grade software platform that enable DER's to maximize their benefit within a grid, that is capable of serving load enabling a high penetration of distributed PV generation. FD-3: Optimal Design Methodology Optimal design methodologies for individual DER installations that enable utilities to determine the optimal combinations and sizing for individual DER sites. FD-4: Austin SHINES Ownership and Operation Models for DER System Performance A comparison of multiple DER aggregation and ownership methodologies including direct utility control, third-party aggregator, and autonomous. FD-5: Economic Modeling & Optimization A comparison of multiple DER technology mixes and configurations within the distribution system, providing insight into an optimal blend of technologies that best enable the distribution system to serve load at the lowest cost at high penetrations of solar. FD-6: Fielded Assets Deployed DER assets within the Austin Energy SHINES circuits. Austin SHINES provided an opening for state-of-the-art technology products to be deployed, providing a rich opportunity for improving how each of the products perform as stand-alone products, and in concert with other complementary products. The Austin SHINES project comprised of two key metrics for System LCOE: SystemLCOE_SHINES<$0.14/kWh Modeled ΔSystemLCOE_SHINES/ΔSystemLCOE_Base≥20% at same solar penetration The System LCOE calculation uses the costs of the utility-owned infrastructure as it exists today, the cost of the DERs that exist in the system today, and the cost of the purchase of energy from ERCOT wholesale markets over the course of the calendar year. All costs are on an annualized basis. The capital and operating costs are derived from the rate case, which produces a yearly cost. The net cost of energy and services imported to the system is integrated over the test year, as is the load served and solar penetration. The first metric was easily achieved by every scenario considered. The goal was set when the Department of Energy’s SHINES Funding Opportunity Announcement was written in 2015 and was a more difficult target at the time. Due mostly to rapidly declining costs for DERs and the significant decrease in the Electric Reliability Council of Texas (ERCOT) energy market prices, which results in lower net cost of energy purchases, the System LCOE is well below this target for all scenarios considered. A fleet of DERs can assume different mixtures, each of which serves the load at a different LCOE. The optimal mixture of DERs serves load at the smallest System LCOE. The second metric (hereinafter %delta metric) asks that the holistic DERMS controls reduce the incremental cost above the baseline of going to a high solar penetration future by at least 20% as compared to the case of a DER deployment with no sophisticated controls (autonomous). Many comparison sets were created throughout this project. Physical technology was installed for informing utility engineering and testing several types of operational control schemes, through the DERMS. The types of operational control which were compared for valuation of the System LCOE Metric were: Holistic control = using the full suite of the DERMS platform to decide and optimize how/why the systems operate depending on weather, market, and reliability signal input. Autonomous control = a local mode at the asset site, wherein a schedule operates the asset, with visibility into performance only No control = the baseline for comparing value against the other two types of control The types of ownership control included: Direct Utility control = the utility dispatches a signal to each asset Third-Party Aggregator = a third party aggregates a fleet of assets and the utility dispatches one signal for all Autonomous = a local mode is set for operation at the asset site, wherein a schedule operates the asset, with visibility into performance only The types of control methodologies deployable within a utility-grade software platform included: Utility Peak Load Reduction = Lower transmission cost obligation Day-Ahead Energy Arbitrage = Realize economic value through price differential Real-Time Price Dispatch = Realize economic value from real-time price spikes Voltage support = Reduce losses and increase solar generation Distribution Congestion Management = Increase local grid reliability Demand Charge Reduction = Lower customer bills and realize system benefit The fielded assets deployed for the project were: Utility Scale Kingsbery Energy Storage System: 1.5 MW / 3 MWh Li-Ion battery storage Mueller Energy Storage System: 1.75 MW / 3.2 MWh Li-Ion battery storage, 7 Energy Storage Units (250 kW each) La Loma Community Solar: 2.6 MW Commercial Scale Aggregated storage installations at 3 sites, with existing solar (300+ kW): One 18 kW / 36 kWh Li-Ion battery storage Two 72 kW / 144 kWh Li-Ion battery storage Residential Scale Aggregated storage installations: -Six stationary battery storage systems (10 kWh each) at homes with existing solar -One Electric Vehicle installed as Vehicle-to-Grid (V2G) Utility-Controlled Solar via Smart Inverters at 12 homes Autonomously-Controlled Smart Inverters at 6 homes Over the course of the project, Austin SHINES undertook installing more than 3 MW of distributed battery energy storage, smart PV inverters, a DER control platform, and other enabling technologies utilizing customer and utility locations and aggregation models. All of these resources were to be integrated and optimized at the utility level. DER assets and control methodologies were designed to achieve a credible pathway to a System LCOE for energy delivered to load of $0.14//kWh or less by 2020, while maximizing distributed solar generation and maintaining acceptable standards of power quality. The project also established a template for other regions to follow, to maximize the adoption of distributed solar PV in support of an economic and efficient grid. In total, the Austin SHINES project added value to the DER subject area in each layer of integration. From utility, to commercial to residential scales, the sheer hierarchy of communication and coordination was a significant accomplishment in addition to learnings from what these communications revealed was unique to each. Economically, the most effective method demonstrated was the criticality of planning phases. Contingencies and multiple projection scenarios helped guide the project to deploy optimal design as close as feasible, in real world conditions. The project and reports will serve public benefit by outlining specific areas of DER strategy and installation where many stakeholders and needs can be addressed with improved efficiency. Overall, communities and utilities should use the results to guide the increasing options available for powering the grid with DER, renewables, and carbon considerate energy.

14 SOLAR ENERGY↗

Preparation of the Multi-Site Data Processing at the Vera C. Rubin Observatory

The Vera C. Rubin Observatory’s Legacy Survey of Space and Time (LSST) Camera is scheduled to start taking data in the summer of 2025. The Data Release Production will run the LSST Science Pipe software at data facilities in the US, France and the UK. The LSST Science Pipeline consists of complex directed acyclic graphs (DAGs) of tasks. Rubin will use the Production and Distributed Analysis (PanDA) workflow and workload management system to orchestrate this complex workflow and the distribution of workloads to the data facilities. When run end-to-end by a team of data production staff, this processing (the Science Pipelines, distributed by the workflow and workload management system) is referred to as a 'campaign'. This paper describes the central services and data facility specific services that support this multi-site data process model, including the service deployment infrastructure, the workload and workflow system, the Campaign Management tools, and connection to Rubin Data Management. This paper will also mention the experience of processing the Rubin Commissioning Camera data. All these are part of the effort to scale up the processing capabilities for the expected very large data volume from the LSST Camera.

Yang, Wei [SLAC]↗

Exploring the Use of Novel Spatial Accelerators in Scientific Applications

Driven by the need to find alternative accelerators which can viably replace GPUs in next-generation Supercomputing systems, this paper proposes a methodology to enable agile application/hardware co-design. The application-first methodology provides the ability to come up with design of accelerators while working with real-world workloads, available accelerators, and system software. The iterative design process targets a set of kernels in a workload for performance estimates that can prune the design space for later phases of detailed architectural evaluations. To this effect, in this paper, a novel data-parallel device model is introduced that simulates the latency of performance-sensitive operations in an accelerator including data transfers and kernel computation using multi-core CPUs. The use of off-the-shelf simulators, such as pre-RTL simulator Aladdin or multiple tools available for exploring the design of deep neural network accelerators (e.g., Timeloop) is demonstrated for evaluation of various accelerator designs using applications with realistic inputs. Examples of multiple device configurations that are instantiable in a system are explored to evaluate the performance benefit of deploying novel accelerators. The proposed device is integrated with a programming model and system software to potentially explore the impacts of high-level programming languages/compilers and low-level effects such as task scheduling on multiple accelerators. We analyze our methodology for a set of applications that represent high-performance computing (HPC) and graph analytics. The applications include a computational chemistry kernel realized using tensor contractions, triangle counting, GraphSAGE and Breadth-first Search. These applications include kernels such as dense matrix-dense matrix multiplication, sparse matrix-spare matrix multiplication, and sparse matrix-dense vector multiplication. Our results indicate potential performance benefits and insights for system design by including accelerators that realize these kernels along-side general purpose accelerators.

AI, codesign, Accelerated Computing, Modeling and ↗