Search NASA⌕ Search

SEARCH · Search NASA

Results for “usage model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Transportation Hub Infrastructure Expansion: Decision Support Under Uncertainty

The Athena project (www.athena-mobility.org) has worked to investigate the relationship between the Dallas-Fort Worth Airport (DFW) and the greater Dallas area in order to better understand and therefore better inform future decision-making regarding the critical infrastructure that influence mobility between the airport and the city. Through this work, infrastructure related to curbside pickup and drop-off, parking, public transit, and the road network congestion were identified as critical to the operation of the DFW transportation hub. The infrastructure analysis and expansion aspect of the Athena project is focused on the restructuring of the CTA curb as a hierarchical curb and the building or repurposing of parking infrastructure as the interplay between these two areas. Many sources of uncertainty exist that may impact future airport and transportation hub operations, such as passenger volume growth, population demographic changes over time, electric vehicle (EV) adoption rates, and autonomous vehicle (AV) adoption rates. Due to these sources of uncertainty, we have selected for our research a modeling framework that can capture various types of uncertainty and hedge against those uncertainties in the optimization process. We analyze road network and curb congestion, the rise of transportation networking companies, trends in parking usage, existing policies around this infrastructure, airport revenue streams, and other contributing factors to enable infrastructure decision making with less uncertainty. To accomplish this wholistic analysis, we have developed a novel multi-stage, multi-period stochastic optimization model which considers the airport's decisions from 2025-2045 under different possible future macro trajectories and day-to-day variations in operational conditions captured as "annual representation of operations" scenarios with respective probabilities. This model has also been designed to leverage the outputs of various efforts under the Athena project to create a combined decision framework for infrastructure decisions. These various efforts include the route optimization model, the ASPIRES simulation, the mode choice model, and the SUMO traffic simulation. Our computational experiments of this system at scale have resulted in a working version of our infrastructure model which enables the explicit representation and consideration of various sources of uncertainty in the decision process to enable robust, flexible decision-making. This model has been effectively run on NREL's HPC system, Eagle, with large numbers of stochastic scenarios and shows promise as a scalable tool for robust consideration of uncertainties in airport planning. We have tested our model using 30,240 operational circumstances in total, resulting in a problem with more 200 million variables. This model was solved in several different configurations, and a workflow to simulate the performance of the infrastructure model results was developed and deployed. In general, our results indicate that a combination of remote parking, remote curb infrastructure, and dynamic pricing can generate revenue, reduce emissions, accommodate emerging technologies such as AVs and EVs, and manage airport passenger growth over time. We note the success of the proposed strategy depends on the data collection and forecasting abilities of DFW. We have also seen that the AV adoption by TNCs might necessitate larger amounts of remote curb. The results of this work inform strategies for airport infrastructure decision making, as well as demonstrate the value of an adaptable model, but also indicate that there are avenues remaining where further research would be of value.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Dynamic metrics of natural ventilation cooling effectiveness for interactive modeling

The evaluation of natural ventilation potential for cooling indoor spaces during the early design phases is of great interest to researchers and practitioners. Among various definitions and usages for natural ventilation potential (NVP) in early design evaluation, this paper reviews and identifies the key performance indicators, and proposes two new dynamic metrics—natural ventilation cooling effectiveness (NVCE) and climate potential utilization ratio (CPUR). The metrics are dynamically responsive to various design options, in both steady and transient states, allowing consideration of thermal mass. Assisting in design development processes, the metrics quantify how well indoor spaces make use of natural ventilation’s cooling capacity. Case studies are presented to demonstrate how NVCE and CPUR enable designers to evaluate the predicted performance and how to apply the information to improve building design. Finally, the results of the design iterations showed that the relationship among various design parameters should be dynamically understood in order to evaluate the performance of natural ventilation, confirming that “the more the airflow, the greater the potential,” and “the heavier the thermal mass, the greater the energy saving” were not always true.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

2022 LANL Radionuclide Air Emissions Report (Rev. 2)

This report describes the emissions of airborne radionuclides from operations at Los Alamos National Laboratory (LANL) for calendar year 2022 and the resulting off-site dose from these emissions. This document fulfills the requirements established by the National Emissions Standards for Hazardous Air Pollutants in 40 CFR 61, Subpart H – Emissions of Radionuclides other than Radon from Department of Energy Facilities, commonly referred to as the Radionuclide NESHAP or Rad-NESHAP. Compliance with this regulation and preparation of this document is the responsibility of LANL’s Rad NESHAP compliance program, which is part of the Environmental Protection and Compliance (EPC) Division. The information in this report is required under the Clean Air Act and is being submitted to the U.S. Environmental Protection Agency (EPA) Headquarters and EPA Region 6. The highest effective dose equivalent (EDE) to an off-site member of the public was calculated using procedures specified by the EPA and described in this report. LANL’s EDE was 0.45 for 2022. The annual limit is 10 millirem per year, established by the EPA in 40 CFR 61 Subpart H. All measured air emissions are modeled to a single location, known as the Maximally Exposed Individual (MEI). During calendar year 2022, LANL continuously monitored radionuclide emissions at 27 “major” release points, or stacks. The Laboratory estimates emissions from an additional 34 “minor” release points using radionuclide usage source terms in lieu of stack monitoring. Also, LANL uses an EPA approved network of air samplers around the Laboratory perimeter to monitor ambient airborne levels of radionuclides. To provide data for dispersion modeling and dose assessment, LANL maintains and operates several meteorological monitoring towers. From these various systems, a comprehensive evaluation is conducted to calculate the MEI dose for the Laboratory. The MEI can be any member of the public at any off-site location where there is a residence, school, business, or office. In 2022, this MEI location was a business at 95 Entrada Drive, located in the eastern end of Los Alamos town site. The primary contributors to the off-site dose at this location are the ambient air data at that location combined with radioactive gas emissions from the LANSCE facility and the collected potential emissions from unmonitored (minor) sources. Overall, the MEI dose in 2022 is similar to that which has been observed in recent years, and it remains well below the EPA’s 10 millirem per year limit. Doses reported to the EPA for the past 10 years are shown in Table E1.

54 ENVIRONMENTAL SCIENCES↗

Notice of Submittal – 2023 Radionuclide Air Emissions Report for Los Alamos National Laboratory

This report describes the emissions of airborne radionuclides from operations at Los Alamos National Laboratory (LANL) for calendar year 2023 and the resulting off-site dose from these emissions. This document fulfills the requirements established by the National Emissions Standards for Hazardous Air Pollutants in 40 CFR 61, Subpart H – Emissions of Radionuclides other than Radon from Department of Energy Facilities, commonly referred to as the Radionuclide NESHAP or Rad-NESHAP. Compliance with this regulation and preparation of this document is the responsibility of LANL’s Rad NESHAP compliance program, which is part of the Environmental Protection and Compliance (EPC) Division. The information in this report is required under the Clean Air Act and is being submitted to the U.S. Environmental Protection Agency (EPA) Headquarters and EPA Region 6. The highest effective dose equivalent (EDE) to an off-site member of the public was calculated using procedures specified by the EPA and described in this report. LANL’s EDE was 0.43 for 2023. The annual limit is 10 millirem per year, established by the EPA in 40 CFR 61 Subpart H. All measured air emissions are modeled to a single location, known as the Maximally Exposed Individual (MEI). During calendar year 2023, LANL continuously monitored radionuclide emissions at 28 “major” release points, or stacks. The Laboratory estimates emissions from an additional 59 “minor” release points using radionuclide usage source terms in lieu of stack monitoring. Also, LANL uses an EPA approved network of air samplers around the Laboratory perimeter to monitor ambient airborne levels of radionuclides. To provide data for dispersion modeling and dose assessment, LANL maintains and operates several meteorological monitoring towers. From these various systems, a comprehensive evaluation is conducted to calculate the MEI dose for the Laboratory. The MEI can be any member of the public at any off-site location where there is a residence, school, business, or office. In 2023, this MEI location was a business at 129 New Mexico State Road 4 (NM-4), located in the northern end of White Rock. The primary contributors to the off-site dose at this location are the ambient air data at that location combined with the collected potential emissions from unmonitored (minor) sources. Overall, the MEI dose in 2023 is similar to that which has been observed in recent years, and it remains well below the EPA’s 10 millirem per year limit. Doses reported to the EPA for the past 10 years are shown in Table E1.

54 ENVIRONMENTAL SCIENCES↗

Insights from high-fidelity modeling of industrial rotary bell atomization

The global automotive industry sprayed over 2.6 billion liters of paint in 2018, much of which through electrostatic rotary bell atomization, a highly complex process involving the fluid mechanics of rapidly rotating thin films tearing apart into micrometer-thin filaments and droplets. Coating operations account for 65% of the energy usage in a typical automotive assembly plant, representing 10,000s of gigawatt-hours each year in the United States alone. Optimization of these processes would allow for improved robustness, reduced material waste, increased throughput, and significantly reduced energy usage. Here, we introduce a high-fidelity mathematical and algorithmic framework to analyze rotary bell atomization dynamics at industrially relevant conditions. Our approach couples laboratory experiment with the development of robust non-Newtonian fluid models; devises high-order accurate numerical methods to compute the coupled bell, paint, and gas dynamics; and efficiently exploits high-performance supercomputing architectures. These advances have yielded insight into key dynamics, including i) parametric trends in film, sheeting, and filament characteristics as a function of fluid rheology, delivery rates, and bell speed; ii) the impact of nonuniform film thicknesses on atomization performance; and iii) an understanding of spray composition via primary and secondary atomization. These findings result in coating design principles that are poised to improve energy- and cost-efficiency in a wide array of industrial and manufacturing settings.

97 MATHEMATICS AND COMPUTING↗

Computational modeling of coupled mechanical damage and electrochemistry in ternary oxide composite electrodes

Performance degradation of ternary layered oxide cathodes largely originates from their loss of structural integrity in cyclic usage. Mechanical damage, such as intergranular fracture of the active particles, is not only a mechanical cleavage process but also interferes with electrochemical kinetics such as infiltration of liquid electrolyte, surface corrosion of the constituent primary particles, and may eventually isolate the primary grains from the electron conducting network. Here, in this work, we develop a computational framework that integrates electrochemistry of a LiNi x Mn y Co 1−x−y O 2 (NMC) composite cathode with mechanical damage of the active particles. To fully examine the intricate chemomechanical behavior of the electrode, we evaluate the effects of the anisotropic material properties, the influence of mechanical potential on Li transport, and the concurrent intergranular fracture and electrolyte penetration along the grain boundaries upon multiple cycles. Electrolyte infiltration benefits capacity retention but aggravates further mechanical damage by corrosion. Structural failure mostly occurs in the first charging due to the anisotropic mechanical strain between the primary grains, while the resulting damage remains stable in the later few cycles. The results are consistent with experimental observations and the integration of electrochemistry and mechanical failure enables a step further understanding of the complex mechanism of battery degradation.

Battery degradation↗

IDAES-PSE 2.2.0 Release

The Institute for the Design of Advanced Energy Systems (IDAES) Integrated Platform is a versatile computational environment offering extensive process systems engineering (PSE) capabilities for optimizing the design and operation of complex, interacting technologies and systems. IDAES enables users to efficiently search vast, complex design spaces to discover the lowest cost, most environmentally sustainable solutions while supporting the full process modeling lifecycle, from conceptual design to dynamic optimization and control. The extensible, open platform empowers users to create models of novel processes and rapidly develop custom analyses, workflows, and end-user applications. New features in the 2.2 release include: DiagnosticsToolbox DiagnosticsToolbox (idaes.core.util.model_diagnostics. DiagnosticsToolbox is a new self-guiding toolbox for assisting with diagnosing modeling issues. The toolbox contains a wide range of tools for identifying common modeling issues and conveying these to the user, and more features will be added in the coming months. To try the new toolbox, use the following steps: from idaes.core.util import DiagnosticsToolbox Build an instance of your model Ensure your models has zero degrees of freedom (as best you can) dt = DiagnosticsToolbox(model) dt.report_structural_issues() Follow the prompts Deprecations DegeneracyHunter is being deprecated in favor of the new DiagnosticsToolbox. The features and capabilities of DegeneracyHunter will be moved over to the DiagnositcsToolbox in the coming months. Removal of usage of Pyomo's expr.current due to deprecation upstream. Removed support for radial basis functions in ALAMOpy as these did not work in the current implementation. Those wishing to use radial basis functions should use Pysmo instead. New Capabilities MSContactor model for unit operations involving mass transfer between 2 or more streams, such as membrane, solvent extraction and solids leaching operations. Other Improvements Improved formulation for solubility products with additional parameters for better scaling of terms Better backward compatibility, verification and robustness testing of core models and APIs Added support for Separator models without energy balances

DiagnosticsToolbox↗

Electrifying High-Efficiency Future Communities: Impact on Energy, Emissions, and Grid

To combat climate change and meet decarbonization goals, the building sector is improving energy efficiency and electrifying end uses to reduce carbon emissions from fossil fuels. All-electric buildings are becoming a trend among new constructions, introducing opportunities for decarbonization but also technical challenges and research gaps. For instance, further investigation is needed to understand how the adoption of energy efficiency measures (EEMs) and distributed energy resources (DERs) in all-electric communities would affect energy consumption, carbon emissions, and grid planning. This paper presents a case study of a mixed-use, all-electric community located in Denver, Colorado. We use URBANopt TM , a physics-based urban energy modeling platform to model the community and then evaluate the impact of EEMs and DERs (i.e., photovoltaics [PV], electric vehicles [EVs], and batteries) on the community's energy usage, carbon emissions, and peak demand. The results show that adding EEMs and PV led to both energy consumption and carbon emissions reductions across all building types. However, we saw fairly limited impact of EEMs and PV on buildings' peak demand in our case. Additionally, due to overnight EV charging activities and higher grid carbon intensity at night, the carbon emissions in multifamily buildings have a noticeable increase compared to scenarios without vehicles. Finally, the addition of batteries helped reduce peak demand by 11%-29%. The modeling workflow and evaluation methods can be applied to similar communities to evaluate their performance and the effect of integrating EEMs and DERs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Internal Model-Based Active Damping Strategy for a Back-to-Back Modular Multilevel Converter System for Advanced Grid Support: Preprint

The proposed work focuses on the possibility of achieving the reduction in the size of the interfacing filter for the grid connection for a back-to-back modular multilevel converter system with the use of third order LCL filters. To achieve the same attenuation, it is possible to reduce the size of the interfacing filters by the usage of third order filters. However, this kind of filtering comes with the limitation of having sustained oscillations due to lack of damping especially during transient changes. Therefore, in this work, a methodology has been proposed based on the principle of internal model to cater for this unwanted oscillations. The third order system is modeled inside the microcontroller with the damping enabled. The error between the output from the model and the actual are compared and the error is utilized to accomplish the active damping strategy. The proposed architecture is verified via computer simulations based on MATLAB/Simulink domain and various case study results along with their discussion is presented in this paper.

dq control↗

Protein cost minimization promotes the emergence of coenzyme redundancy

Metabolism relies on a small class of molecules (coenzymes) that serve as universal donors and acceptors of key chemical groups and electrons. Although metabolic networks crucially depend on structurally redundant coenzymes [e.g., NAD(H) and NADP(H)] associated with different enzymes, the criteria that led to the emergence of this redundancy remain poorly understood. Our combination of modeling and structural and sequence analysis indicates that coenzyme redundancy may not be essential for metabolism but could rather constitute an evolved strategy promoting efficient usage of enzymes when biochemical reactions are near equilibrium. Our work suggests that early metabolism may have operated with fewer coenzymes and that adaptation for metabolic efficiency may have driven the rise of coenzyme diversity in living systems.

59 BASIC BIOLOGICAL SCIENCES↗

Power Profile Monitoring and Tracking Evolution of System-Wide HPC Workloads

The power & energy demands of HPC machines have grown significantly. Modern exascale HPC systems require tens of megawatts of combined power for computing resources and cooling facilities at full capacity. The current energy trend is not sustainable for future HPC systems, and there is a need to work toward the energy efficiency aspect of HPC performance. Energy awareness of the HPC applications at the job level is essential for running an efficient HPC system. This work aims to develop a pipeline to provide a production-level system-wide overview of the HPC workloads' power profile while handling evolving workloads exhibiting new power trends. We developed an open-set classification model for HPC jobs based on the properties of power profiles to continuously provide a system-wide holistic view of recently completed jobs. The pipeline helps continuously monitor the job-level power usage pattern of HPC and enables us to capture the new trends in applications' power behavior. We employed a comprehensive set of techniques to generate job-level data, custom-designed feature extraction methods to extract critical features from jobs' power profiles, clustering techniques powered by generative modeling, and open-set classification for identifying job profiles into known classes or an unknown set. With extensive evaluations, we demonstrate the effectiveness of each component in our pipeline. We provide an analysis of the resulting clusters that characterize the power profile landscape of the Summit supercomputer from more than 60K jobs executed in a year. The open-set classification classifies the known data sets into known classes with high accuracy and identifies unknown data noints with over 85% accuracy.

Karimi, Ahmad Maroof↗

Design of experiments to spectroscopically characterize radiation flow in stochastic media

Precise characterization of experimental radiation flow is required to validate the high energy density physics models, numerical methods, and codes that are used to simulate radiation-hydrodynamics phenomena such as thermal radiation transport in stochastic media. The Cassio code is used to simulate thermal radiation flow through inhomogeneous, stochastic-media-foam configurations containing optically thick clumps dispersed within an optically thin background aerogel. Cassio can model small inhomogeneous problems directly, but most problems require approximations to meet computer limitations on run-times and memory usage. Various examples of these approximations are methods that produce, in one calculation, an ensemble-averaged solution and associated standard deviation; reduced spatial dimensionality with approximate geometries; and full material homogenization with no geometric detail. Cassio simulations are used to design experiments at the OMEGA-60 Laser Facility that can measure the radiation flow using the spatially resolved COAX absorption spectroscopy diagnostic. The experimental platforms flow radiation through foam targets ranging from a background-only aerogel, to a single configuration of a specified stochastic medium, to a fully homogenized foam of the background and clump materials. Under constant total clump mass, larger clumps (here, larger than 10 μm diameter) will mix more slowly with the background such that the bulk radiation flow is faster than it would be in a fully homogenized material. The COAX platform can be used to infer temperature and density profiles in both the background material and clumps, simultaneously, and therefore to differentiate radiation flow in a range of stochastic and homogeneous media.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

ARDP Natrium Neutronic Methodology: Argonne Neutronic Assessment of ABR-1000

The Natrium Sodium-cooled Fast Reactor (SFR) concept developed by TerraPower, LLC was selected as one of the advanced reactor designs for demonstration under the Advanced Reactor Demonstration Program Natrium Demo project. In collaboration with TerraPower, the Argonne National Laboratory (ANL) team provide independent reviews of the neutronic methodology being used for the Natrium design. As part of this activity, both the TerraPower and ANL teams agreed to perform independent neutronics analyses of the ABR-1000 reactor problem as a demonstration on the usage of the neutronics methodologies. Comparison of the results from TerraPower and ANL would expose any methodological differences in the modeling approaches. This report describes and presents the Argonne analysis work on the ABR-1000, and will be provided to TerraPower, along with data files, to complete the comparison study. The comparison will cover the methodology to evaluate the reactivity coefficients for a safety analysis, the shutdown margin, and the reconstructed pin power distribution. The methods and models used to calculate the kinetic parameters and the reactivity coefficients (density, Doppler, axial/radial expansion, etc.) are described in detail with recommendations of specific method options and modelling techniques. The control system reactivity worth and the excess reactivity due to temperature defect are calculated for the shutdown margin analysis. The method to evaluate the excess reactivity is discussed in detail. The pin power reconstruction methodology used in SE2ANL, SE2RCT, and DASSH are discussed in this report. The pin power distribution evaluated by different methods are compared and discussed in the report.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Technoeconomic Analysis of Infrastructure Buildout Scenarios

The success of CCUS deployment in the southeast will depend on the optimized pipeline network from CO 2 point sources to geologic sinks for CO 2 storage. An optimal pipeline framework will reduce both environmental impacts and pipeline building cost. However, finding an optimal pipeline/transport infrastructure design is a non-trivial task and requires simultaneous usage of large volumes of data, computational resources, and a state-of-the-art simulator. Such a transport infrastructure model must consider point sources for CO 2 capture and associated volumes, sinks for CO 2 storage, and transportation from source to sink via pipeline networks. These considerations must be addressed simultaneously and systemically in an optimization process, in which a defined objective function (i.e., capital, variable CO 2 capture, transport, and storage cost function) is required to be minimized with the consideration of practical constraints (e.g., CO 2 flow through pipelines is less than the maximum capacity). Although optimization has been widely used in subsurface resources production and CO 2 storage, its application in large scale CCUS infrastructure design is rarely reported in the literature. SimCCS, developed by Los Alamos National Laboratory, is an open-source CCUS pipeline infrastructure design toolset that facilitates the optimization of pipeline infrastructure networks.

99 GENERAL AND MISCELLANEOUS↗

Overview of Upcoming Process Improvement Efforts at the Saltstone Facilities at the Savannah River Site - 20474

The Saltstone Facilities at the Savannah River Site (SRS) process and dispose of low activity salt solution waste generated by other liquid waste facilities. Today in the Liquid Waste System (LWS), approximately 125 million liters of salt waste remain to be processed. The Saltstone Production Facility (SPF) receives the decontaminated salt waste, which is mixed with dry feeds consisting of cement, fly ash and slag to produce the saltstone. The mixed slurry is pumped to the Saltstone Disposal Units (SDUs) for safe disposal in the Saltstone Disposal Facility (SDF). To support continuous Salt Waste Processing Facility (SWPF) operations at annual processing volumes many times higher than present, significant modifications are required to ensure that the SPF has the capacity to support the throughput of salt waste. These changes include several infrastructure upgrades that are being worked through the Enhanced Low Activity Waste Disposal (ELAWD) project. In addition to infrastructure upgrades, Savannah River Remediation (SRR), the Savannah River Site's Liquid Waste Contractor for the U.S. Department of Energy, has identified a flowsheet improvement opportunity of implementing a cement-free saltstone formulation to eliminate cement from the current three component formulation. This two-component formulation would simplify the procurement, transport, off-loading, and storage of the premix materials, and increase the storage capacity for the individual components. This flowsheet, when implemented, will reduce operational risk and improve throughput necessary to achieve disposal rates necessary for SWPF operations. Research has been completed to confirm the feasibility of this formulation, with the new cement-free flowsheet expected to be implemented in the next few years. Improvements have also been identified downstream of the SPF to increase SDU utilization. Specifically, a concentrated effort has taken place to raise the fill height in SDU 6 to the full disposal height, 13 meters, to maximize the usage of each SDU in support of the liquid waste disposal mission. This improvement has been made through additional thermal modeling and improved process understanding to create a SDU flammability model and control strategy more representative of facility operations. This work will allow for the completion of construction and operational readiness for SDU 7 while filling SDU 6 to ensure there is no lapse in available space once SWPF starts up. A summary of these improvements as they relate to increased throughput will be provided along with associated status. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

An Assessment of the Usability of Machine Learning Based Tools for the Security Operations Center

Gartner, a large research and advisory company, anticipates that by 2024 80% of security operation centers (SOCs) will use machine learning (ML) based solutions to enhance their operations. 1 1 https://www.ciodive.com/news/how-data-science-tools-can-lighten-the-load-for-cybersecurity-teams/572209/ In light of such widespread adoption, it is vital for the research community to identify and address usability concerns. This work presents the results of the first in situ usability assessment of ML-based tools. With the support of the US Navy, we leveraged the national cyber range-a large, air-gapped cyber testbed equipped with state-of-the-art network and user emulation capabilities-to study six US Naval SOC analysts' usage of two tools. Our analysis identified several serious usability issues, including multiple violations of established usability heuristics for user interface design. We also discovered that analysts lacked a clear mental model of how these tools generate scores, resulting in mistrust a and/or misuse of the tools themselves. Surprisingly, we found no correlation between analysts' level of education or years of experience and their performance with either tool, suggesting that other factors such as prior background knowledge or personality play a significant role in ML-based tool usage. Our findings demonstrate that ML-based security tool vendors must put a renewed focus on working with analysts, both experienced and inexperienced, to ensure that their systems are usable and useful in real-world security operations settings.

Oesch, T↗

The Case for Strong Scaling in Deep Learning: Training Large 3D CNNs with Hybrid Parallelism

Here, we present scalable hybrid-parallel algorithms for training large-scale 3D convolutional neural networks. Deep learning-based emerging scientific workflows often require model training with large, high-dimensional samples, which can make training much more costly and even infeasible due to excessive memory usage. We solve these challenges by extensively applying hybrid parallelism throughout the end-to-end training pipeline, including both computations and I/O. Our hybrid-parallel algorithm extends the standard data parallelism with spatial parallelism, which partitions a single sample in the spatial domain, realizing strong scaling beyond the mini-batch dimension with a larger aggregated memory capacity. We evaluate our proposed training algorithms with two challenging 3D CNNs, CosmoFlow and 3D U-Net. Our comprehensive performance studies show that good weak and strong scaling can be achieved for both networks using up to 2K GPUs. More importantly, we enable training of CosmoFlow with much larger samples than previously possible, realizing an order-of-magnitude improvement in prediction accuracy.

97 MATHEMATICS AND COMPUTING↗