Search NASA⌕ Search

SEARCH · Search NASA

Results for “deterministic”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

Multi-Hazard Advanced Seismic Probabilistic Risk Assessment Tools and Applications

Design of nuclear power plant (NPP) facilities to resist natural hazards has been a part of the regulatory process from the beginning of the NPP industry in the United States (US), but has evolved substantially over time. The original set of approaches and methods was entirely deterministic in nature and focused on a traditional engineering margins-based approach. However, over time probabilistic and risk-informed approaches were also developed and implemented in US Nuclear Regulatory Commission (NRC) guidance and regulation. A defense-in-depth framework has also been incorporated into US regulatory guidance over time. As a result, today, the US regulatory framework incorporates deterministic and probabilistic approaches for a range of different applications and for a range of natural hazard considerations. This framework will continue to evolve as a result of improved knowledge and newly identified regulatory needs and objectives, most notably in response to the NRC activities developed in response to the 2011 Fukushima accident in Japan. Although the US regulatory framework has continued to evolve over time, the tools, methods and data available to the US nuclear industry to meet the changing requirements have not kept pace. Notably, there is significant room for improvement in the tools and methods available for external event probabilistic risk assessment (PRA), which is the principal assessment approach used in risk-informed regulations and risk-informed decision-making applied to natural hazard assessment and design. This is particularly true if PRA is applied to natural hazards other than seismic loading. Development of a new set of tools and methods that incorporate current knowledge, modern best practice, and state-of-the-art computational resources would lead to more reliable assessment of facility risk and risk insights (e.g., the SSCs and accident sequences that are most risk-significant), with less uncertainty and reduced conservatisms.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Intelligent Manufacturing of Commercial Optics Final Report CRADA No. TC-0313-92

The project combined the research and development efforts of LLNL and the University of Rochester Center for Manufacturing Optics (COM), to develop a new generation of flexible computer controlled optics· grinding machines. COM's principal near term development effort is to commercialize the OPTICAM-SM, a new prototype spherical grinding machine. A crucial requirement for commercializing the OPTICAM-SM is the development of a predictable and repeatable material removal process ( deterministic micro-grinding) that yields high quality surfaces that minimize non-deterministic polishing. OPTICAM machine tools and the fabrication process development studies are part of COM' s response to the DOD (ARPA) request to implement a modernization strategy for revitalizing the U.S. optics manufacturing base. This project was entered into in order to develop a new generation of :flexible, computer-controlled optics grinding machines.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Improved Hybrid Modeling of Spent Fuel Storage Facilities

This work developed a new computational method for improving the ability to calculate the neutron flux in deep-penetration radiation shielding problems that contain areas with strong streaming. The “gold standard” method for radiation transport is Monte Carlo (MC) as it samples the physics exactly and requires few approximations. Historically, however, MC was not useful for shielding problems because of the computational challenge of following particles through dense shields. Instead, deterministic methods, which are superior in term of computational effort for these problems types but are not as accurate, were used. Hybrid methods, which use deterministic solutions to improve MC calculations through a process called variance reduction, can make it tractable from a computational time and resource use perspective to use MC for deep-penetration shielding. Perhaps the most widespread and accessible of these methods are the Consistent Adjoint Driven Importance Sampling (CADIS) and Forward-Weighted CADIS (FW-CADIS) methods. For problems containing strong anisotropies, such as power plants with pipes through walls, spent fuel cask arrays, active interrogation, and locations with small air gaps or plates embedded in water or concrete, hybrid methods are still insufficiently accurate. In this work, a new method for generating variance reduction parameters for strongly anisotropic, deep penetration radiation shielding studies was developed. This method generates an alternate form of the adjoint scalar flux quantity, Φ Ω , which is used by both CADIS and FW-CADIS to generate variance reduction parameters for local and global response functions, respectively. The new method, called CADIS-Ω, was implemented in the Denovo/ADVANTG software. Results indicate that the flux generated by CADIS-Ω incorporates localized angular anisotropies in the flux more effectively than standard methods. CADIS-Ω outperformed CADIS in several test problems. This initial work indicates that CADIS- may be highly useful for shielding problems with strong angular anisotropies. This is a benefit to the public by increasing accuracy for lower computational effort for many problems that have energy, security, and economic importance.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Advanced Seismic Probabilistic Risk Assessment Methodology: Development of Beta 1.0 MASTODON Toolset

Design of nuclear power plant (NPP) facilities to resist natural hazards has been a part of the regulatory process from the beginning of the NPP industry in the United States, but has evolved substantially over time. The original set of approaches and methods was entirely deterministic in nature and focused on a traditional engineering margins-based approach. However, over time probabilistic and risk-informed approaches were also developed and implemented in US Nuclear Regulatory Commission guidance and regulation. A defense-in-depth framework has also been incorporated into US regulatory guidance over time. As a result, today, the US regulatory framework incorporates deterministic and probabilistic approaches for a range of different applications and for a range of natural hazard considerations. Although the US regulatory framework has continued to evolve over time, the tools, methods and data available to the US nuclear industry to meet the changing requirements have not kept pace. Notably, there is room for improvement in the tools and methods available for external event probabilistic risk assessment (PRA), which is the principal assessment approach used in risk-informed regulations and risk-informed decision-making applied to natural hazard assessment and design. Development of a new set of tools and methods that incorporate current knowledge, modern best practice, and state-of-the-art computational resources would lead to more reliable assessment of facility risk and risk insights (e.g., the plant elements and accident sequences that are most risk-significant), with less uncertainty and reduced conservatisms. Development of the next generation tools and methods for external events PRA is ongoing under the Risk Informed Safety Margins Characterization (RISMC) technical pathway. The RISMC toolkit development centers on integration of the tools and methods under a common framework, MOOSE. These tools and methods make use of existing and newly developed tools and methods, coupled with the experience and data gained in the past decades, to define and analyze more realistic risk assessment models. Specific focus in this report is on the capability to model seismic risk using advanced SPRA methods. Over the last year, significant capability has been added to Mastodon to simulate 3-D wave passage effects through nonlinear soil. Verification has demonstrated the capability of Mastodon to model wave passage effects in 1-D, 2-D, and 3-D. Methods have been developed to incorporate probabilistic floor response capabilities. Additional capability will be added to Mastodon over the next year to implement a robust gapping and sliding element for cyclic shaking, web-based verification and user manuals, stochastic finite elements, and frequency independent damping. Verification of added capabilities has occured in parallel with code writing activities.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Calibration of MAMBA and CRUD Sources Using Full-Core CTF+MAMBA

This report outlines a process for the deterministic calibration of MAMBA using the computational toolkit Dakota. The tools and processes for deterministic calibration have been built and are laid out in this report. While completing this milestone, issues emerged with MAMBA that resulted in delays. The consequences for these difficulties to the calibration process are briefly discussed. The report concludes with an outline of a path forward for Bayesian calibration. The Bayesian calibration will be performed next year. This process was laid out by Benjamin Collins, Robert Salko, and Adam Hetzler.

42 ENGINEERING↗

Carbon Dioxide Enhanced Oil Recovery Life Cycle (CELiC) Model

The Carbon Dioxide (CO 2 ) Enhanced Oil Recovery (EOR) Life Cycle (CELiC) Model calculates life cycle greenhouse gas (GHG) emissions for a CO 2 -EOR system, where the user can select one of three sources of the injected CO 2 : (1) extracted from a natural dome, (2) captured from a coal-fired power plant, or (3) captured from a natural gas power plant. The model has several parameters and options to allow the assessment of the system for a wide-array of products—electricity, pipeline CO 2 , crude oil, and refined fuels. The model is also capable of deterministic (i.e., point estimate) and stochastic (i.e., probabilistic) analyses and finally a deterministic time-series analysis that shows the changing GHG emissions for the CO 2 -EOR system over time.

03 NATURAL GAS↗

Generation of Multigroup Multiband Nuclear Data

Historically, deterministic pre-processing methods have been used for generating multigroup (MG) and multigroup multiband (MGMB) cross sections. These deterministic methods require an assumption of the shape for the scalar ux. There has been increasing interest in utilizing Monte Carlo transport as a method to generate these cross sections since the energy self-shielding and resonance overlap are fully accounted for. The purpose of this project is to implement and test the capability of generating these cross sections in Mercury.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Dynamic Multi-Sensor Multi-Mission Optimal Planning Tool

Remote sensing systems have firmly established a role in providing immense value to commercial industry, scientific exploration, and national security. Continued maturation of sensing technology has reduced the cost of deploying highly-capable sensors while at the same time increased reliance on the information these sensors can provide. The demand for time on these sensors is unlikely to diminish. Coordination of next-generation sensor systems, larger constellations of satellites, unmanned aerial vehicles, ground telescopes, etc. is prohibitively complex for existing heuristics-based scheduling techniques. The project was a two-year collaboration spanning multiple Sandia centers and included a partnership with Texas A&M University. We have developed algorithms and software for collection scheduling, remote sensor field-of-view pointing models, and bandwidth-constrained prioritization of sensor data. Our approach followed best practices from the operations research and computational geometry communities. These models provide several advantages over state of the art techniques. In particular, our approach is more flexible compared to heuristics that tightly couple models and solution techniques. First, our mixed-integer linear models afford a rigorous analysis so that sensor planners can quantitatively describe a schedule relative to the best possible. Optimal or near-optimal schedules can be produced with commercial solvers in operational run-times. These models can be modified and extended to incorporate different scheduling and resource constraints and objective function definitions. Further, we have extended these models to proactively schedule sensors under weather and ad hoc collection uncertainty. This approach stands in contrast to existing deterministic schedulers which assume a single future weather or ad hoc collection scenario. The field-of-view pointing algorithm produces a mosaic with the fewest number of images required to fully cover a region of interest. The bandwidth-constrained algorithms find the highest priority information that can be transmitted. All of these are based on mixed-integer linear programs so that, in the future, collection scheduling, field-of-view, and bandwidth prioritization can be combined into a single problem. Experiments conducted using the developed models, commercial solvers, and benchmark datasets have demonstrated that proactively scheduling against uncertainty regularly and significantly outperforms deterministic schedulers.

47 OTHER INSTRUMENTATION↗

High Brightness Room Temperature III-Nitride Based Single Photon Source

Single photon sources (SPS) are quantum light sources where photons are emitted one at a time instead of randomly (e.g. lasers) or in a bunch (e.g. thermal) that can significantly impact quantum information science (computing and secure communications) and quantum metrology. Some highly desirable features of SPS are low second order correlation (g 2 ),controllable emission, electrically injected room temperature operation with high photon rate, high extraction efficiency and controllable directionality. Approaches taken thus far using different material systems have only addressed a subset of these features. III-nitride based approach offers a clear pathway to deterministic, room temperature (R.T.), electrically injected practical SPS as one can potentially also leverage the knowledge and technology from the light emitting diode (LED) world. Here we will describe a hybrid approach wherein a TiO2 based photonic crystal (PC) cavity is fabricated around an InGaN quantum dot (QD) embedded nanoscale post deterministically placed inside a photonic crystal cavity. This project takes the initial steps necessary to achieve a practical, compact SPS. We have used finite difference time domain simulations to optimize the cavity design to achieve high quality factor, mode overlap with QD and high extraction. We have fabricated InGaN quantum dots using a top-down approach involving dry etch and photoelectrochemical etch followed by electron beam lithography based nanofabrication of photonic crystal cavities.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Supervisory Control System for Multi-Modular Advanced Reactors

The proposed supervisory control system (SCS) may provide considerable benefits to advanced small modular reactors, including reduced plant staffing, optimized maintenance activities, greater plant availability, and higher operating efficiency. The SCS makes risk-informed decisions based on (1) a probabilistic assessment of the likelihood of success given the status of the plant/systems and component health, and (2) a deterministic assessment between plant operating parameters and reactor protection parameters to prevent unnecessary trips and challenges to plant safety system—one measure of SCS success. The probabilistic portion of the decision-making engine of the SCS is based on the control actions associated with an advanced liquid-metal reactor (ALMR) Power Reactor, Innovative, Small Module (PRISM). Within the SCS, the probabilistic assessment provides a ranking of viable control actions; however, certain instructions generated by the probabilistic model only include an abstract notion of action without specifications. For instance, one instruction may be to reduce power without specifying how much reduction is needed. The prognostic/diagnostic models incorporate the health of components into the decision-making process. Once the control options are identified and ranked based on the likelihood of success, the SCS transmits the options to the deterministic portion of the platform. The performance-based system models assess and rank each of the probabilistically identified control actions by taking into account the physical behavior (current and projected) of the system. The performance-based decision making module receives inputs from the probabilistic decision-making module and the ERM module to generate a single solution. Interfaces to these modules are defined later in the section. A utility theory algorithm factors into the decision making by estimating the distance from and approach to a trip setpoint for each control option. If the magnitude of a negative utility value increases rapidly as the system approaches the trip setpoint, that option is not likely to be the preferred option. This can lead to a re-ranking of the control options. The SCS then transmits a control signal(s) to a component or system and informs the operator of actions taken based on the action chosen. The SCS successfully coupled probabilistic and performance-based system models to arrive at optimal control decisions based on the actual status of the plant and components. The automatic, autonomous, and real-time performance requirements for a control system were met by the SCS. The value of coupling probabilistic and performance-based system models was demonstrated by the re-ranking of control options based on the use of a utility algorithm. The use of ERM monitors provides added value to the SCS as demonstrated by the re-ranking of control options based on a components degraded state.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Hydraulic Properties Data Package for the E-Area Soils, Cementitious Materials, and Waste Zones–Update

Hydraulic property estimates for the soils, cementitious materials, and waste zones associated with the E-Area low-level radioactive waste disposal units have been provided to support the Performance Assessments (PA) for the E-Area Low-Level Waste Facility (LLWF). Nominal or “best estimate” hydraulic property values for use in the deterministic modeling are provided along with representations of the hydraulic property value uncertainty for use in sensitivity and uncertainty modeling. The hydraulic properties provided for each of the E-Area materials include: porosity ( η ), dry bulk density ( ρ b ), particle density (ρ p ), saturated hydraulic conductivity ( K sat ), characteristic curves (suction head, saturation, and relative permeability), and effective diffusion coefficient ( D e ). A representation of the uncertainty associated with each property, except for the characteristic curves, is provided for each material, except for the E-Area waste zones. These nominal parameter values for each of the E-Area soils, cementitious materials, and waste zones, and, where indicated, parameter uncertainty representations, are based upon the following in order of priority: Site-specific field data, Site-specific laboratory data, Similarity to material with site-specific field or laboratory data, and Literature data. Additionally, a methodology to represent long-term concrete degradation is provided. Finally, because much of the nominal hydraulic property values and uncertainty representations for the E-Area soils, cementitious materials, and waste zones are based on similarity to other materials or literature data, a methodology to prioritize additional work to better define these values and representations is outlined. Prioritization should be based on the importance of the material and/or property to the results of deterministic, sensitivity, and uncertainty modeling. This prioritization should be established through a process of sensitivity modeling. This report supersedes the previous hydraulic properties data package. Revision 1 contains clarifications, updates and corrections to text, figures and tables in a number of places in the report along with some minor editing.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Benchmark Solutions for Radiation Transport in Stochastic Media with Inhomogeneous Material Statistics

Accurately solving implicit Monte Carlo (IMC) thermal photon transport problems with mixed material cells is important in realistic applications. The production IMC package at LLNL treats mixed material cells arising from ALE remap and hydrodynamics using the same approximate model. The new Imp IMC thermal photon transport package currently under development has both a material interface reconstruction (MIR) algorithm and a Levermore-Pomraning (LP) stochastic medium algorithm for treating mixed material cells. Existing stochastic medium algorithms for treating mixed material cells in IMC lack a complete theoretical basis. The IMC LP algorithm implementation has been demonstrated to reproduce published deterministic LP solutions for the particular case of spatially homogeneous material statistics. Realistic simulations will include spatially inhomogeneous material statistics (material mean chord lengths). In a previous investigation, the LP-model for transport in binary stochastic media in rod geometry was generalized to accommodate spatially varying material chord lengths, i.e., the mixing statistics were allowed to be nonhomogeneous. Analytical solutions were obtained and used to produce a verifi cation suite for the Imp IMC Levermore-Pomraning implementation for different spatial variations of the chord lengths. However, the accuracy of the LP model when the mixing statistics are nonhomogeneous has not been assessed and leaves open the question of whether local accuracy is improved or further degraded when chord lengths are not uniform. This shortcoming is rectifi ed here by developing benchmark analytic solutions for transport in binary Markovian stochastic mixtures in rod geometry with nonhomogeneous mixing statistics, using spatially varying chord lengths considered in the previous investigation based on the LP model. Methods for sampling a nonhomogeneous Poisson process (NHPP) are first described and used to construct individual realizations of the binary mixtures in rod geometry. Analytic solutions are then obtained for the forward and backward directed fluxes on a given realization, now viewed as a deterministic medium with alternating layers of the two materials with known interface locations. Finally, material averaged scalar fluxes are obtained using these sampling schemes with spatially linear and quadratic chord lengths and used to assess the accuracy of the previously obtained LP-model results.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Functional Photoresists for Energy Applications. Final Report

Monolithic ultralow-density porous bulk materials have recently attracted much interest due to many emerging applications in the areas of catalysis, energy storage and conversion, and thermal insulation. They are also important components of high energy density (HED) and inertial confinement fusion (ICF) targets. However, despite tremendous progress that has been made in the synthesis of porous materials, deterministic and independent control over microscopic architecture, density and composition remain key issues, and their integration in high precision devices requires cost and time-intensive mechanical machining that not only reduces reproducibility by generating debris but also limits the complexity of the 3D shapes that can be realized. In this project, we overcame these limitations by developing a universal templating capability that provides deterministic and independent control over density, composition, architecture, and macroscopic sample shape. This was achieved by developing the technology to 1) 3D print ultrahigh resolution, ultra-high precision polymeric micro-lattice templates, 2) coat these templates with the desired materials, and 3) removing the template (Fig. 1a). Atomic layer deposition (ALD) provides the atomic scale coating thickness accuracy required for precisely controlling density. While this templating approach had been demonstrated in prior work, limitations in suitable photoresists, 3D print technologies, print design, and template removal techniques did not allow the fabrication of millimeter-sized high-precision parts with sub-micron resolution. To enable this technology, we developed 1) two-photon polymerization (TPP) print designs that enable the fabrication of millimeter-sized, mechanically robust polymeric templates with sub-micron resolution and 2) a continuum level TPP printing simulation capability for additional print design guidance; 3) atomistic models to study photoresist polymerization kinetics and network topography, 4) refractive index matched polymeric and preceramic TPP photoresists, and 5) functional TPP photoresists including porous voxel structures and self-immolative polymer photoresist chemistries; and 6) damage free template removal techniques that enable the fabrication of defect-free high-precision low-density foam components. We also developed a templating approach for pure carbon microlattices with a unique tube-in-tube ligament morphology. As a test platform, we pursued the fabrication of foam liners that promise to further increase the neutron yield in indirect drive ICF experiments by improving implosion symmetry control and coupling between the laser and the deuterium-tritium fuel. This application requires fabrication and integration of a ultra-high precision, millimeter-sized, thin-walled (200-400 micrometer thick), low-density (10-30 mg/cc), high atomic number (high Z) cylindrical foam tube into the gold hohlraum of an indirect drive ICF target (Fig. 1b). While our hohlraum liner test case will mainly find application in HED and ICF experiments, the underlying science will also directly apply to previously developed nanoparticle and additive manufacturing technologies and will advance those techniques as well.

36 MATERIALS SCIENCE↗

Adaptive Recovery Model: Designing Systems for Testing Tracing and Vaccination to Support COVID-19 Recovery Planning.

This report documents a new approach to designing disease control policies that allocate scarce testing, contact tracing, and vaccination resources to better control community transmission of COVID19 or similar diseases. The Adaptive Recovery Model (ARM) combines a deterministic compartmental disease model with a stochastic network disease propagation model to enable us to simulate COVID-19 community spread through the lens of two complementary modeling motifs. ARM contact networks are derived from cell-phone location data that have been anonymized and interpreted as individual arrivals to specic public locations. Modeling disease spread over these networks allows us to identify locations within communities conducive to rapid disease spread. ARM applies this model- and data-derived abstractions of community transmission to evaluate the effectiveness of disease control measures including targeted social distancing, contact tracing, testing and vaccination. The architecture of ARM provides a unique capacity to help decision makers understand how best to deploy scarce testing, tracing and vaccination resources to minimize disease-spread potential in a community. This document details the novel mathematical formulations underlying ARM, presents a dynamical stability analysis of the deterministic model components, a sensitivity analysis of control parameters and network structure, and summarizes a process for deriving contact networks from cell-phone location data. An example use case steps through applying ARM to evaluate three targeted social distancing policies using Bernalillo County, New Mexico as an exemplar test locale. This step-by-step analysis demonstrates how ARM can be used to measure the relative performance of competing public health policies. Initial scenario tests of ARM shows that ARMs design focus on resource utilization rather than simple incidence prediction can provide decision makers with additional quantitative guidance for managing ongoing public health emergencies and planning future responses.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Endogenous Assessment of the Capacity Value of Solar PV in Generation Investment Planning Studies. Draft

There exist several different reliability- and approximation-based methods to determine the capacity contribution of solar resources towards resource adequacy. However, most of these approaches require knowing in advance the installed capacities of both conventional and solar generators. This is a complication since generator capacities are actually decision variables in capacity planning studies. In this article we study the effect of time resolution and solar PV penetration using a capacity planning model that accounts for the full distribution of generator outages and solar resource variability. We also describe a modification of a standard deterministic planning model that enforces a resource adequacy target through a reserve margin constraint. Our numerical experiments show that at least 50 days worth of data are necessary to approximate the results of the full-resolution model with a maximum error of 2.5% on costs and capacity. We also show that the amount of displaced capacity of conventional generation decreases rapidly as the penetration of solar PV increases. We find that using an exogenously defined and constant capacity factor based on time-series data can yield relatively accurate results for small penetration levels (less than 5%). For higher penetration levels (up to 20%), the modified deterministic planning model better captures avoided costs and the decreasing value of solar PV. Although our results are not general, they highlight the importance of accounting for the variation in both energy and capacity value of solar resources endogenously in capacity planning models. A11 numerical experiments are performed using the IEEE Reliability Test System and 7 years worth of demand and solar data from a utility in Arizona.

14 SOLAR ENERGY↗

Gamma Dose Measurements in ZPPR-15

Gamma doses were measured in the Zero Power Plutonium Reactor (ZPPR) to provide data for validation of calculations of gamma heating in important reactor components. Stainless steel-encapsulated LiF thermoluminescent dosimeters (TLDs) were irradiated in two configurations in ZPPR-15B and one configuration in ZPPR-15D to provide gamma heating data for the Integral Fast Reactor design in the mid-1980s. The ZPPR-15 experimental records were used to develop detailed as-built Monte Carlo models for the gamma dose measurements in ZPPR-15B and ZPPR-15D. These Monte Carlo models can be converted to deterministic models for calculations with deterministic codes. The reported uncertainty in the published gamma dose measurements is just the statistical uncertainty in the TLD readout. In addition to this statistical uncertainty in the TLD readout, several corrections and other factors contribute to the total uncertainty for the gamma dose measurements. The total uncertainty for the gamma dose measurements can be significantly larger than the published statistical uncertainty for the TLD readout. All known contributions to the total uncertainty were analyzed, and a total uncertainty was derived for the ZPPR-15 gamma dose measurements.

36 MATERIALS SCIENCE↗

Randomized Algorithms for Scientific Computing (RASC)

Randomized algorithms have propelled advances in artificial intelligence (AI) and represent a foundational research area in advancing AI for Science. Future advancements in DOE Office of Science priority areas such as climate science, astrophysics, fusion, advanced materials, combustion, and quantum computing all require randomized algorithms for surmounting challenges of complexity, robustness, and scalability. Advances in data collection and numerical simulation have changed the dynamics of scientific research and motivate the need for randomized algorithms. For instance, advances in imaging technologies such as X-ray ptychography, electron microscopy, electron energy loss spectroscopy, or adaptive optics lattice light-sheet microscopy collect hyperspectral imaging and scattering data in terabytes, at breakneck speed enabled by state-of-the-art detectors. The data collection is exceptionally fast compared with its analysis. Likewise, advances in high-performance architectures have made exascale computing a reality and changed the economies of scientific computing in the process. Floating-point operations that create data are essentially free in comparison with data movement. Thus far, most approaches have focused on creating faster hardware. Ironically, this faster hardware has exacerbated the problem by making data still easier to create. Under such an onslaught, scientists often resort to heuristic deterministic sampling schemes (e.g., low-precision arithmetic, sampling every nth element) and sacrifice potentially valuable accuracy. Dramatically better results can be achieved via randomized algorithms, reducing the data size as much as or more than naive deterministic subsampling can achieve, while retaining the high accuracy of computing on the full data set. By randomized algorithms we mean those algorithms that employ some form of randomness in internal algorithmic decisions to accelerate time to solution, increase scalability, or improve reliability. Examples include matrix sketching for solving large-scale least-squares problems (see Figure 1) and stochastic gradient descent for training machine learning models. We are not recommending heuristic methods but rather randomized algorithms that have certificates of correctness and probabilistic guarantees of optimality and near-optimality. Such approaches can be useful beyond acceleration, for example, in understanding how to avoid measure zero worst-case scenarios that plague methods such as QR matrix factorization.

97 MATHEMATICS AND COMPUTING↗

Optimizing and Extending the Functionality of EXARL for Scalable Reinforcement Learning [Slides]

The main goal of the Co-Design Summer School 2021 is to provide algorithmic improvements to EXARL framework by improving performance and by adding functionalities. This presentation includes an introduction to reinforcement learning and to EXARL. The researchers expanded the capability of EXARL by including additional agents like (Asynchronized) Advantage Actor Critic (A2C/A3C) and Twin Delayed Deep Deterministic Policy Gradient (TD3). They also explored algorithmic improvements such as v-trace and Prioritized Experience Replay. They found that A2C/A3C performed best with v-trace and outperformed Deep Q-Network (DQN) on both the CartPole game and the ExaBooster scientific environment. Additionally, they found that TD3 performed as good as the existing Deep Deterministic Policy Gradient (DDPG) agent and that adding Prioritized Experience Replay to DDPG accelerated convergence.

97 MATHEMATICS AND COMPUTING↗