Robust Quantum Sensing and Distributed Analytics for Critical Energy Infrastructure
Quantum Technologies for Critical Infrastructure Security Summit, January 14-15, 2021
Jr, Paul Ohodnicki↗
SEARCH · Search NASA
Results for “summit”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
PREEMPT: Scalable Epidemic Interventions Using Submodular Optimization on Multi-GPU Systems
Preventing and slowing the spread of epidemics is achieved through techniques such as vaccination and social distancing. Given practical limitations on the number of vaccines and cost of administration, optimization becomes a necessity. Previous approaches using mathematical programming methods have shown to be effective but are limited by computational costs. In this work, we make several contributions: First, we present a new approach for intervention via maximizing the influence of vaccinated nodes on the network. We call this method \preempt. Next, we prove submodular properties associated with the objective function of our method so that it aids in construction of an efficient greedy approximation strategy. Consequently, we present a new parallel algorithm based on greedy hill climbing for \preempt, and present an efficient parallel implementation for distributed CPU-GPU heterogeneous platforms. Our results demonstrate that \preempt{} is able to achieve a significant reduction (up to 6.75$\times$) in the percentage of people infected on a city-scale network. We also show strong scaling results of \preempt{} on 128 nodes of the Summit supercomputer. Our parallel implementation is able to significantly reduce time to solution, from hours to minutes on large networks. This work represents a first-of-its-kind effort in parallelizing greedy hill climbing and applying it toward devising effective interventions for epidemics.
Minutoli, Marco↗
Scalable All-pairs Shortest Paths for Huge Graphs on Multi-GPU Clusters
We present an optimized Floyd-Warshall (Floyd-Warshall) algorithm that computes the All-pairs shortest path (APSP) for GPU accelerated clusters. The Floyd-Warshall algorithm due to its structural similarities to matrix-multiplication is well suited for highly parallel GPU architectures. To achieve high parallel efficiency, we address two key algorithmic challenges: reducing high communication overhead and addressing limited GPU memory. To reduce high communication costs, we redesign the parallel (a) to expose more parallelism, (b) aggressively overlap communication and computation with pipelined and asynchronous scheduling of operations, and (c) tailored MPI-collective. To cope with limited GPU memory, we employ an offload model, where the data resides on the host and is transferred to GPU on-demand. The proposed optimizations are supported with detailed performance models for tuning. Our optimized parallel Floyd-Warshall implementation is up to 5x faster than a strong baseline and achieves 8.1 PetaFLOPS/sec on 256~nodes of the Summit supercomputer at Oak Ridge National Laboratory. This performance represents 70% of the theoretical peak and 80% parallel efficiency. The offload algorithm can handle 2.5x larger graphs with a 20% increase in overall running time.
Sao, Piyush↗
Accelerating Multigrid-based Hierarchical Scientific Data Refactoring on GPUs
Rapid growth in scientific data and a widening gap between computational speed and I/O bandwidth make it increasingly infeasible to store and share all data produced by scientific simulations. Instead, we need methods for reducing data volumes: ideally, methods that can scale data volumes adaptively so as to enable negotiation of performance and fidelity tradeoffs in different situations. Multigrid-based hierarchical data representations hold promise as a solution to this problem, allowing for flexible conversion between different fidelities so that, for example, data can be created at high fidelity and then transferred or stored at lower fidelity via logically simple and mathematically sound operations. However, the effective use of such representations has been hindered until now by the relatively high costs of creating, accessing, reducing, and otherwise operating on such representations. We describe here highly optimized data refactoring kernels for GPU accelerators that enable efficient creation and manipulation of data in multigrid-based hierarchical forms. We demonstrate that our optimized design can achieve up to 250 TB/s aggregated data refactoring throughput—83% of theoretical peak—on 1024 nodes of the Summit supercomputer. We showcase our optimized design by applying it to a large-scale scientific visualization workflow and the MGARD lossy compression software.
Chen, Jieyang↗
ExaWind: Predictive Wind Energy Simulations
This presentation describes the ExaWind project and the team's progress in creating a suite of performance-portable codes designed for predictive simulations of wind farms on next-generation exascale-class supercomputers. Such simulations will require the resolution of scales spanning many orders of magnitude, from blade boundary layers to wind farm flow structures. In the U.S., the first exascale systems will be GPU accelerated, and different GPU manufacturers have been chosen for the different systems. At the heart of the ExaWind software is a hybrid-solver approach based on the codes Nalu-Wind and AMR-Wind, which are computational fluid dynamics solvers for the incompressible Navier-Stokes equations. Nalu-Wind is an unstructured-grid code used to resolve wind turbine geometry and blade boundary layers, whereas AMR-Wind is a structured-grid background solver for atmospheric turbulent flow and turbine wake propagation. The models are coupled with overset meshes and global linear systems are approximated through a loose-coupling algorithm. Results will include validation-quality high-fidelity simulations and strong/weak scaling results from the Summit supercomputer.
49 EE - Wind and Water Power Program - Wind (EE-4W↗
Preparing an Incompressible-Flow Fluid Dynamics Code for Exascale-Class Wind Energy Simulations: Preprint
The US Department of Energy has identified Exascale-Class wind farm simulation tools as critical to wind energy scientific discovery. A primary objective of the Exawind project is to build high-performance, predictive Computational Fluid Dynamics tools that satisfy these modeling needs. GPU accelerators will serve as the computational thoroughbreds of next generation, Exascale-Class, platforms. Here, we report on our efforts for preparing the Exawind unstructured mesh solver, Nalu-Wind, for Exascale-Class machines. For computing at this scale, a simple port of the incompressible-flow algorithms to GPUs is not sufficient. One needs novel algorithms that are application aware, memory efficient, and optimized for latest generation GPU devices to get high-performance. The result of our efforts are unstructured mesh simulations of wind turbines that use 1/6 the compute resources of Summit supercomputer at Oak Ridge National Lab. In particular, we demonstrate a first-of-its-kind, simulation using Algebraic Multigrid solvers on over 4000 GPUs.
algebraic multigrid↗
Enabling Combustion Science Simulations for Future Exascale Machines
Reacting flow simulations for combustion applications require extensive computing capabilities. Leveraging the AMReX library, the Pele suite of combustion simulation tools targets the largest supercomputers available and future exascale machines. We introduce PeleC, the compressible solver in the Pele suite, and detail its capabilities, including complex geometry representation, chemistry integration, and discretization. We present a comparison of development efforts using both OpenACC and AMReX's C++ performance portability framework for execution on multiple GPU architectures. We discuss relevant details that have allowed PeleC to achieve high performance and scalability. PeleC's performance characteristics are measured through relevant simulations on multiple supercomputers. The success of PeleC's design for exascale is exhibited through demonstration of a 160 billion cell simulation and weak scaling onto 100\% of Summit, an NVIDIA-based GPU supercomputer at Oak Ridge National Laboratory. Our results provide confidence that PeleC will enable future combustion science simulations with unprecedented fidelity.
combustion↗
A Community Roadmap for Scientific Workflows Research and Development
The landscape of workflow systems for scientific applications is notoriously convoluted with hundreds of seemingly equivalent workflow systems, many isolated research claims, and a steep learning curve. To address some of these challenges and lay the groundwork for transforming workflows research and development, the WorkflowsRI and ExaWorks projects partnered to bring the international workflows community together. This paper reports on discussions and findings from two virtual “Workflows Community Summits” (January and April, 2021). The overarching goals of these workshops were to develop a view of the state of the art, identify crucial research challenges in the workflows community, articulate a vision for potential community efforts, and discuss technical approaches for realizing this vision. To this end, participants identified six broad themes: FAIR computational workflows; AI workflows; exascale challenges; APIs, interoperability, reuse, and standards; training and education; and building a workflows community. We summarize discussions and recommendations for each of these themes.
Ferreira Da Silva, Rafael↗
Combined Structural Analysis of Core and Image Log of TGH 76-31 South East of Mt Baker, Washington State
Despite active volcanism, few geothermal energy resources have been developed in the Cascades Range. Temperature Gradient Hole 76-31 was drilled to ~440 m measured depth to probe for zones where fractures provide fluid conduits that transport deep volcanic heat to shallow depths that could support baseload, carbon neutral electrical generation. These zones were predicted by a Play Fairway assessment (PFA) of resource potential along a zone 11 km west-southwest of the summit of Mount Baker Volcano. Rock core, temperature logs, and an acoustic image log were obtained. By comparison to outcrops, the core has been initially interpreted as the Chilliwack group comprised of partially metamorphosed basaltic to andesitic volcanics. Core mapping reveals complex, steeply dipping networks of fractures and brecciation along slickensided strike slip faults; clay alteration is common in many of these structures. The majority of fractures are thoroughly healed by layers of chlorite and calcite; preservation of pyrite indicates anoxic conditions. The majority of fracture porosity resides in very dense fractures a few centimeters or less in length. The image log provides good insights into attitude of fractures that fully transect the core, but generally underestimates fracture density. The combination of complex, non-planar fracture zones containing many short fractures and healing promote misinterpretation of natural fracture attitude and density in the image log. The healing and anoxic minerals are consistent with the conductive temperature gradient measured in the well below a shallow isothermal zone, although, several fractures are open or only partially healed and resulted in fluid entries into the well. Here, the equilibrated measured temperature gradient of 64ºC/km and calculated heat flow of 145 mW/m2 is more than twice the regional average, indicating local influence of the Mt Baker magmatic system at the Little Park Creek TGH site.
Cascades↗
Improving the Performance of DGEMM with MoA and Cache-Blocking: Preprint
The goal of this paper is to demonstrate performance enhancements of the high performance dense linear algebra matrix-matrix multiply DGEMM kernel, widely implemented by vendors in the basic linear algebra subroutine BLAS library. The mathematics of arrays (MoA) paradigm due to Mullin (1988) results in contiguous memory accesses in combination with Church-Rosser complete language constructs optimized for target processor architectures [3]. Our performance studies demonstrate that the MoA implementation of DGEMM combined with optimal cache-blocking strategies results in at least a 25% performance gain on both Intel Xeon Skylake and IBM Power-9 processors over the vendor supplied Intel MKL and IBM ESSL basic linear algebra libraries. Results are presented for the NREL Eagle and ORNL Summit supercomputers.
cache-blocking↗
Anderson Acceleration for Distributed Training of Deep Learning Models
Anderson acceleration (AA) is an extrapolation technique that has recently gained interest in the deep learning (DL) community to speed-up the sequential training of DL models. However, when performed at large scale, the DL training is exposed to a higher risk of getting trapped into steep local minima of the training loss function, and standard AA does not provide sufficient acceleration to escape from these steep local minima. This results in poor generalizability and makes AA ineffective. To restore AA’s advantage to speed-up the training of DL models on large scale computing platforms, we combine AA with an adaptive moving average procedure that boosts the training to escape from steep local minima. By monitoring the relative standard deviation between consecutive iterations, we also introduce a criterion to automatically assess whether the moving average is needed. We applied the method to the following DL instantiations for image classification: (i) ResNet50 trained on the open-source CIFAR100 dataset and (ii) ResNet50 trained on the open-source ImageNet1k dataset. Numerical results obtained using up to 1,536 NVIDIA V100 GPUs on the OLCF supercomputer Summit showed the stabilizing effect of the moving average on AA for all the problems above.
Lupo Pasini, Massimiliano↗
Overview of Integrated Pathway Analyses to Meet the Hydrogen Energy Earthshot Goal
This slide deck was presented at the 2021 DOE Hydrogen Shot Summit on Aug. 31, 2021. The presentation describes two ongoing NETL system analysis efforts: "Comparison of Commercial, State-of-the-Art, Fossil-Based Hydrogen Production Technologies" (nearing completion), and "Hydrogen Energy Earthshot Initiative Screening Analysis" (which has recently started). The former study will detail costs and greenhouse gas emissions profiles of current commercial technologies (e.g., reforming and gasification routes). The latter will focus on our efforts to identify pathways that may meet the goal of the DOE Hydrogen Energy Earthshot Initiative (i.e., $1/kg H2 by 2030) as well as low carbon emissions.
Lewis, Eric↗
Stable Parallel Training of Wasserstein Conditional Generative Adversarial Neural Networks : *Full/Regular Research Paper submission for the symposium CSCI-ISAI: Artificial Intelligence
We use a stable parallel approach to train Wasserstein Conditional Generative Adversarial Neural Networks (W-CGANs). The parallel training reduces the risk of mode collapse and enhances scalability by using multiple generators that are concurrently trained, each one of them focusing on a single data label. The use of the Wasserstein metric reduces the risk of cycling by stabilizing the training of each generator. We apply the approach on the CIFAR10 and the CIFAR100 datasets, two standard benchmark datasets with images of the same resolution, but different number of classes. Performance is assessed using the inception score, the Fréchet inception distance, and image quality. An improvement in inception score and Fréchet inception distance is shown in comparison to previous results obtained by performing the parallel approach on deep convolutional conditional generative adversarial neural networks (DC-CGANs). Weak scaling is attained on both datasets using up to 100 NVIDIA V100 GPUs on the OLCF supercomputer Summit.
Lupo Pasini, Massimiliano↗
Global Energy Policy to Achieve the United States’ Nationally Determined Contributions: Potential Pathway
In 2021, the United States declared its Nationally Determined Contribution (NDC) in preparation for the COP26 climate summit, setting goals to achieve zero emission electricity by 2035, and reducing net emissions by 50–52% compared to 2005 levels. The current U.S. energy policies were found to not be adequate to meet these goals, thus it is necessary to draft a pathway to achieving these goals through policy changes. This study focused on foreign energy policies to analyze the most effective policies in a host of sectors. By identifying the most ambitious and effective policies from around the world in each sector, this study was able to suggest a policy pathway that can potentially achieve both of goals set in the NDC. In guiding the development of the proposed policy pathway, this study analyzed policies from Australia, Canada, California, China, Denmark, France, Germany, Japan, Russia, South Korea, Sweden, the United Kingdom, and the United States. This study found that the most drastic CO2 reductions came from low-carbon electricity policy, but contributions were also made from carbon capture, reforestation, hydrogen, energy efficiency, and climate smart agriculture.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
Two-link Staggered Quark Smearing in QUDA
Gauge covariant smearing based on the 3D lattice Laplacian can be used to create extended operators that have better overlap with hadronic ground states. For staggered quarks, we make use of two-link parallel transport to preserve taste properties. We have implemented the procedure in QUDA. We present the performance of this code on the NVIDIA A100 GPUs in Indiana University's Big Red 200 supercomputer and on the AMD MI250X GPUs in Oak Ridge Leadership Computer Facility's (OLCF's) Crusher and discuss its scalability. We also study the performance improvement from using NVSHMEM on OLCF's Summit. Reusing precomputed two-link products for all sources and sinks, it reduces the total smearing time for a baryon correlator measurement by a factor of 100-120 as compared with the original MILC code and reduces the overall time by 60-70%.
Gottlieb, Steven↗
Toward designing effective exascale scientific computing workflows: experiences and best practices
Many fields within scientific computing have embraced advances in big-data analysis and machine learning, which often requires the deployment of large, distributed and complicated workflows that may combine training neural networks, performing simulations, running inference, and performing database queries and data analysis in asynchronous, parallel and pipelined execution frameworks. Such a shift has brought into focus the need for scalable, efficient workflow management solutions with reproducibility, error and provenance handling, traceability, and checkpoint-restart capabilities, among other needs. Here, we discuss challenges and best-practices for deploying exascale-generation computational science workflows on resources at the Oak Ridge Leadership Computing Facility (OLCF). We present our experiences with large-scale deployment of distributed workflows on the Summit supercomputer, including for bioinformatics and computational biophysics, materials science, and deep learning model optimization. We also present problems and solutions created by working within a Python-centric software base on traditional HPC systems, and discuss steps that will be required before the convergence of HPC, AI, and data science can be fully realized. Our results point to a wealth of exciting new possibilities for harnessing this convergence to tackle new scientific challenges.
Coletti, Mark↗
Idaho National Laboratory Energy Cybersecurity Programs Update
This brief presentation provides a status update on three Idaho National Laboratory energy cybersecurity programs of particular interest to NERC Reliability and Security Technical Committee annual in-person Security Groups summit. Public information on the following three programs is included: Cybersecurity for Operational Technology Environments (CyOTE™) program Cyber-Informed Engineering (CIE) Cyber Testing for Resilient Industrial Control Systems (CyTRICS) program, and associated high-level information on the Energy Software Bill of Materials POC, Executive Order 14017, and the Energy Cyber Sense Act
24 POWER TRANSMISSION AND DISTRIBUTION↗
Wind Energy Accomplishments and Year-End Performance Report: Fiscal Year 2023
As the United States' largest source of renewable energy, wind is already playing a vital role in the nation's shift to electricity generated from sustainable resources. Scientists, engineers, and analysts at the U.S. Department of Energy's (DOE's) National Renewable Energy Laboratory (NREL) are propelling our country closer to this clean energy future with new efficient, reliable, and cost-competitive wind technologies and deployment strategies. In Fiscal Year 2023 (FY 2023), NREL received national acclaim for recent wind technology breakthroughs, applauded sustained decades of progress in wind energy research, and heralded new initiatives to support the next generation of wind development. This report and NREL's achievements of the last year set the stage for innovative research to come. Two NREL software innovations used to assess wind technology options were recognized with R&D 100 Awards. The Renewable Energy Potential (reV) model helps planners, developers, and researchers calculate wind energy capacity, generation, and cost for specific facilities, fleets and scenarios. NREL's Simulation and Emulation for Advanced Systems validates transmission and distribution solutions to minimize implementation risks. Both of these tools can be applied to a range of renewable solutions to cut costs and improve the reliability of systems in even the most remote locations. The laboratory commemorated landmark anniversaries for wind energy research facilities and programs managed by NREL. The National Wind Technology Center (NWTC) celebrated 30 years as a world-class hub for renewable energy research. An important component of the NWTC on NREL's Flatirons Campus, the one-of-a-kind 7-megawatt (MW) Controllable Grid Interface wind energy research apparatus, turned 10 this year. The Collegiate Wind Competition completed its tenth annual competition in May 2023. Six years after the grand challenges in wind energy science were first compiled, NREL brought together more than 100 wind energy experts from 15 countries to revisit the field's most pressing research needs. Other key new research initiatives examined ways to simultaneously address the needs for skilled wind energy workers and equitable job opportunities. NREL released the first national-level report evaluating offshore wind industry workforce gaps and ways to build a large, diverse pool of job candidates. The lab also co-hosted the International Partnering Forum's Offshore Wind Workforce Summit as part of its ongoing efforts to address the special challenges of that industry sector. NREL research and development (R&D) for the DOE Wind Energy Technologies Office (WETO) continues to build momentum in its efforts to combat climate change, create clean energy jobs, and promote energy justice. This report provides more detail on these top achievements and other accomplishments made by NREL and its partners during FY 2023 (between Oct. 1, 2022, and Sept. 30, 2023).
accomplishments↗