Search NASA⌕ Search

SEARCH · Search NASA

Results for “reasoning about programs”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Updated Primers Generated for SCALE 6.2 for KENO V.a and KENO-VI

Primers were developed and published for the use of the KENO V.a and KENO-VI codes in 2005 and 2008, respectively. These primers were both developed for SCALE 5 using the GeeWiz graphical user interface (GUI). Many new capabilities have been added to the transport codes since the release of these primers. The GUI was also changed to Fulcrum with the release of SCALE 6.2. For these reasons, updated versions of both primers were developed for a planned released in September 2020. The KENO V.a and KENO-VI codes are almost always run within the associated CSAS5 and CSAS6 sequences within SCALE, so the primers use the sequences and do not address running the codes in stand-alone mode.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

l3d2vtk: An MCNPTools Utility to Enable LNK3DNT File Visualization & Post-processing [Slides]

This presentation discusses the objective of the project which is to provide a utility (among other utilities) that improves MCNP analysis post-processing and visualization capabilities. Much recent work has been done to improve MCNP post-processing and visualization. It also discusses the goals of the project, which are to create a product that is portable, open, easily interrogated by a user, no dependencies, including a mesh tally-to-VTK conversion, an EEOUT-to-VTK conversion, and an interactive, 3-D, visualization environments (e.g., ParaView). The presentation also discusses the reasons regarding why this is being done, which are to provide physical insight into behaviors and trends, to facilitate error mitigation (easier to “see” errors than “read” them), and to improve communication with collaborators. It also discusses why this is being done now as analyses are getting ever-more complicated and are more flexible in terms of build, test, and deployment capabilities.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Updated Primers Generated for SCALE 6.2 for KENO V.a and KENO-VI [Slides]

Primers were developed and published for the use of the KENO V.a and KENO-VI codes in 2005 and 2008, respectively. These primers were both developed for SCALE 5 using the GeeWiz graphical user interface (GUI). Many new capabilities have been added to the transport codes since the release of these primers. The GUI was also changed to Fulcrum with the release of SCALE 6.2. For these reasons, updated versions of both primers were developed for a planned released in September 2020. The KENO V.a and KENO-VI codes are almost always run within the associated CSAS5 and CSAS6 sequences within SCALE, so the primers use the sequences and do not address running the codes in stand-alone mode.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Evaluation of Visual Analytics Environments: The Road to the Visual Analytics Science and Technology Challenge Evaluation Methodology

The evaluation of visual analytics environments was a topic in Illuminating the Path [Thomas 2005] as a critical aspect of moving research into practice. For a thorough understanding of the utility of the systems available, evaluation not only involves assessing the visualizations, interactions or data processing algorithms themselves, but also the complex processes that a tool is meant to support (such as exploratory data analysis and reasoning, communication through visualization, or collaborative data analysis [Lam 2012; Carpendale 2007]). Researchers and practitioners in the field have long identified many of the challenges faced when planning, conducting, and executing an evaluation of a visualization tool or system [Plaisant 2004]. Evaluation is needed to verify that algorithms and software systems work correctly and that they represent improvements over the current infrastructure. Additionally to effectively transfer new software into a working environment, it is necessary to ensure that the software has utility for the end-users and that the software can be incorporated into the end-user’s infrastructure and work practices. Evaluation test beds require datasets, tasks, metrics and evaluation methodologies. As noted in [Thomas 2005] it is difficult and expensive for any one researcher to setup an evaluation test bed so in many cases evaluation is setup for communities of researchers or for various research projects or programs. Examples of successful community evaluations can be found [Chinchor 1993; Voorhees 2007; FRGC 2012]. As visual analytics environments are intended to facilitate the work of human analysts, one aspect of evaluation needs to focus on the utility of the software to the end-user. This requires representative users, representative tasks, and metrics that measure the utility to the end-user. This is even more difficult as now one aspect of the test methodology is access to representative end-users to participate in the evaluation. In many cases the sensitive nature of data and tasks and difficult access to busy analysts puts even more of a burden on researchers to complete this type of evaluation. User-centered design goes beyond evaluation and starts with the user [Beyer 1997, Shneiderman 2009]. Having some knowledge of the type of data, tasks, and work practices helps researchers and developers know the correct paths to pursue in their work. When access to the end-users is problematic at best and impossible at worst, user-centered design becomes difficult. Researchers are unlikely to go to work on the type of problems faced by inaccessible users. Commercial vendors have difficulties evaluating and improving their products when they cannot observe real users working with their products. In well-established fields such as web site design or office software design, user-interface guidelines have been developed based on the results of empirical studies or the experience of experts. Guidelines can speed up the design process and replace some of the need for observation of actual users [heuristics review references]. In 2006 when the visual analytics community was initially getting organized, no such guidelines existed. Therefore, we were faced with the problem of developing an evaluation framework for the field of visual analytics that would provide representative situations and datasets, representative tasks and utility metrics, and finally a test methodology which would include a surrogate for representative users, increase interest in conducting research in the field, and provide sufficient feedback to the researchers so that they could improve their systems.

evaluation↗

NNSA ASC Exascale Environment Planning, Applications Working Group, Report February 2011

The scope of the Apps WG covers three areas of interest: Physics and Engineering Models (PEM), multi-physics Integrated Codes (IC), and Verification and Validation (V&V). Each places different demands on the exascale environment. The exascale challenge will be to provide environments that optimize all three. PEM serve as a test bed for both model development and 'best practices' for IC code development, as well as their use as standalone codes to improve scientific understanding. Rapidly achieving reasonable performance for a small team is the key to maintaining PEM innovation. Thus, the environment must provide the ability to develop portable code at a higher level of abstraction, which can then be tuned, as needed. PEM concentrate their computational footprint in one or a few kernels that must perform efficiently. Their comparative simplicity permits extreme optimization, so the environment must provide the ability to exercise significant control over the lower software and hardware levels. IC serve as the underlying software tools employed for most ASC problems of interest. Often coupling dozens of physics models into very large, very complex applications, ICs are usually the product of hundreds of staff-years of development, with lifetimes measured in decades. Thus, emphasis is placed on portability, maintainability and overall performance, with optimization done on the whole rather than on individual parts. The exascale environment must provide a high-level standardized programming model with effective tools and mechanisms for fault detection and remediation. Finally, V&V addresses the infrastructure and methods to facilitate the assessment of code and model suitability for applications, and uncertainty quantification (UQ) methods for assessment and quantification of margins of uncertainty (QMU). V&V employs both PEM and IC, with somewhat differing goals, i.e., parameter studies and error assessments to determine both the quality of the calculation and to estimate expected deviations of simulations from experiments. The exascale environment must provide a performance envelope suitable both for capacity calculations (high through-put) and full system capability runs (high performance). Analysis of the results place shared demand on both the I/O as well as the visualization subsystems.

97 MATHEMATICS AND COMPUTING↗

The MUSIC Critical Benchmark and Nuclear Data

The Measurement of Uranium Subcritical and Critical (MUSIC) experiment was a series of measurements of critical and subcritical configurations of bare highly enriched uranium. The goal was to compare measurement methods, analysis techniques, and simulation methods across regimes of criticality and to provide high-quality validation of 235 U nuclear data. A benchmark evaluation of the two critical configurations of the MUSIC experiments will soon be published in the release of the International Criticality Safety Benchmark Evaluation Project Handbook. The recent execution of the experiment aids in proper quantification of model simplifications and all uncertainties associated with the experiment. Historical benchmark evaluations are heavily relied on for uranium nuclear data validation despite the fact that the same level of documentation and comparable uncertainty analysis may not be present. The MUSIC evaluation is less likely to include “unknown unknowns” that could impede accurately modeling the system. Presented are both highly detailed and very simplified models, which represent the experimental configurations accurately, aiding the users of the benchmark for nuclear data or transport code validation. The sensitivities of k eff to nuclear data and nuclear data–related uncertainties are very similar between this experiment and previous bare uranium sphere experiments. In addition, the nuclear data uncertainties to any nuclides other than 235 U are small. For all these reasons, the recently evaluated MUSIC benchmark critical configurations could prove very useful for 235 U nuclear data validation. Currently, major libraries have good agreement with the experimental results, within 200 pcm for all nuclear data libraries, and within one standard deviation of the experimental result for most. Suggested nuclear data adjustments based on MUSIC and Lady Godiva are also presented, with posterior improvements to both the agreement in k eff and the uncertainty associated with the nuclear data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Uncertainty Analyses for Localized Tallies in Monte Carlo Eigenvalue Calculations

It is well known that statistical estimates obtained from Monte Carlo criticality simulations can be adversely affected by cycle-to-cycle correlations in the fission source. In addition, there are several other more fundamental issues that may lead to errors in Monte Carlo results. These factors can have a significant impact on the calculated eigenvalue, localized tally means and their associated standard deviations. In fact, modern Monte Carlo computational tools may generate standard deviation estimates that are a factor of five or more lower than the true standard deviation for a particular tally due to the inter-cycle correlations in the fission source. The magnitude of this under-prediction can climb as high as one hundred when combined with an ill-converged fission source or poor sampling techniques. Since Monte Carlo methods are widely used in reactor analysis (as a benchmarking tool) and criticality safety applications, an in-depth understanding of the effects of these issues must be developed in order to support the practical use of Monte Carlo software packages. A rigorous statistical analysis of localized tally results in eigenvalue calculations is presented using the SCALE/KENO-VI and MCNP Monte Carlo codes. The purpose of this analysis is to investigate the under-prediction in the uncertainty and its sensitivity to problem characteristics and calculational parameters, and to provide a comparative study between the two codes with respect to this under-prediction. It is shown herein that adequate source convergence along with proper specification of Monte Carlo parameters can reduce the magnitude of under-prediction in the uncertainty to reasonable levels; below a factor of 2 when inter-cycle correlations in the fission source are not a significant factor. In addition, through the use of a modified sampling procedure, the effects of inter-cycle correlations on both the mean value and standard deviation estimates can be isolated.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Resonance Region Covariance Analysis Method and New Covariance Data for {sup 232}Th, {sup 233}U, {sup 235}U, {sup 238}U, and {sup 239}Pu

Resonance-parameter covariance matrix (RPCM) evaluations in the resolved resonance region were done for {sup 232}Th, {sup 233}U, {sup 235}U, {sup 238}U, and {sup 239}Pu using the computer code SAMMY. The retroactive approach of the code SAMMY was used to generate the RPCMs for {sup 233}U and {sup 235}U. RPCMs for {sup 232}Th, {sup 238}U and {sup 239}Pu were generated together with the resonance parameter evaluations. The RPCMs were then converted in the ENDF format using the File32 representation. Alternatively, for computer storage reasons, the File32 was converted in the File33 cross section covariance matrix (CSCM). Both representations were processed using the computer code PUFF-IV. This paper describes the procedures used to generate the RPCM with SAMMY.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

OECD MCCI Project: Small-Scale Water Ingression and Crust Strength Tests (SSWICS) (SSWICS 11 Design Report)

During the course of the first MCCI program (MCCI-1), seven small-scale water ingression tests were performed with 75 kg corium melts made up of UO 2 and varying amounts of either siliceous or limestone common sand concrete. The concrete contents varied from a low of 4 wt% to a high of 23 wt%. These tests demonstrated that melt cooling can be enhanced by water ingression made possible by thermal stress-induced cracking, and that the role of water ingression increases with decreasing concrete content. The dependence of the water ingression cooling rate on concrete content is strongest for melts containing less than 14% concrete. For melts with 14% or more concrete, little evidence of water ingression cooling was discernible. It was also found that melts with siliceous concrete cooled at about the same rate as melts with a similar amount of limestone common sand concrete. One aim of the current MCCI program (MCCI-2) is to investigate the role of gas sparging on the corium cooling rate. The gases are a byproduct of the decomposition of concrete, which occurs when the material overheats. Gases generated near the corium/concrete interaction zone at the bottom of the melt are propelled up through the corium by buoyancy forces and the resultant gas flow has the potential to create melt porosity. This porosity is expected to supplement the fissures induced by thermal stress cracking. It is thought that these extra pathways could enhance the amount of water ingression cooling and quench the melt more rapidly than the case without sparging gases. This report describes the gas injection system to be used for SSWICS-11 along with test conditions and a summary of the test procedure. The report first revisits much of the design rationale for the gas sparging system that was detailed in the SSWICS-8 report. The reason for including the material again here is that, assuming this test is successful, there will be little inclination to refer to the earlier report for design background since that test was effectively one without gas sparging. Therefore all potentially pertinent material will be included in this single report. The next section describes the gas sparging system for SSWICS-11 by beginning with the design rationale for the system used in SSWICS-8.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Shortwave Array Spectroradiometer-Hemispheric (SAS-He): design and evaluation

A novel ground-based radiometer, referred to as the Shortwave Array Spectroradiometer-Hemispheric (SAS-He), is introduced. This radiometer uses the shadow-band technique to report total irradiance and its direct and diffuse components frequently (every 30 s) with continuous spectral coverage (350–1700 nm) and moderate spectral (~2.5 nm ultraviolet–visible and ~6 nm shortwave-infrared) resolution. The SAS-He's performance is evaluated using integrated datasets collected over coastal regions during three field campaigns supported by the US Department of Energy's Atmospheric Radiation Measurement (ARM) program, namely the (1) Two-Column Aerosol Project (TCAP; Cape Cod, Massachusetts), (2) Tracking Aerosol Convection Interactions Experiment (TRACER; in and around Houston, Texas), and (3) Eastern Pacific Cloud Aerosol Precipitation Experiment (EPCAPE; La Jolla, California). We compare (i) aerosol optical depth (AOD) and total optical depth (TOD) derived from the direct irradiance, as well as (ii) the diffuse irradiance and direct-to-diffuse ratio (DDR) calculated from two components of the total irradiance. As part of the evaluation, both AOD and TOD derived from the SAS-He direct irradiance are compared to those provided by a collocated Cimel sunphotometer (CSPHOT) at five (380, 440, 500, 675, 870 nm) and two (1020, 1640 nm) wavelengths, respectively. Additionally, the SAS-He diffuse irradiance and DDR are contrasted with their counterparts offered by a collocated multifilter rotating shadowband radiometer (MFRSR) at six (415, 500, 615, 675, 870, 1625 nm) wavelengths. Overall, reasonable agreement is demonstrated between the compared products despite the challenging observational conditions associated with varying aerosol loadings and diverse types of aerosols and clouds. For example, the AOD- and TOD-related values of root mean square error remain within 0.021 at 380, 440, 500, 675, 870, 1020, and 1640 nm wavelengths during the three field campaigns.

47 OTHER INSTRUMENTATION↗

Evaluation of Control Strategies to Effectively Meet 70-90% Mercury Reduction on an Eastern Bituminous Coal Cyclone Boiler with SCR

This is the final site report for testing conducted at Public Service of New Hampshire's (PSNH) Merrimack Unit 2 (MK2). This project was funded through the DOE/NETL Innovations for Existing Plants program. It was a Phase III project with the goal to develop mercury control technologies that can achieve 50-70% mercury capture at costs 25-50% less than baseline estimates of $50,000-$70,000/lb of mercury removed. While results from testing at Merrimack indicate that the DOE goal was partially achieved, further improvements in the process are recommended. Merrimack burned a test blend of eastern bituminous and Venezuelan coals, for a target coal sulfur content of 1.2%, in its 335-MW Unit 2. The blend ratio is approximately a 50/50 split between the two coals. Various sorbent injection tests were conducted on the flue gas stream either in front of the air preheater (APH) or in between the two in-series ESPs. Initial mercury control evaluations indicated that, without SO3 control, the sorbent concentration required to achieve 50% control would not be feasible, either economically or within constraints specific to the maximum reasonable particle loading to the ESP. Subsequently, with SO{sub 3} control via trona injection upstream of the APH, economically feasible mercury removal rates could be achieved with PAC injection, excepting balance-of-plant concerns. The results are summarized along with the impacts of the dual injection process on the air heater, ESP operation, and particulate emissions.

01 COAL, LIGNITE, AND PEAT↗

Fingerprints of a riming event on cloud radar Doppler spectra: observations and modeling

In this paper, Radar Doppler spectra measurements are exploited to study a riming event when precipitating ice from a seeder cloud sediment through a supercooled liquid water (SLW) layer. The focus is on the "golden sample" case study for this type of analysis based on observations collected during the deployment of the Atmospheric Radiation Measurement Program's (ARM) mobile facility AMF2 at Hyytiälä, Finland, during the Biogenic Aerosols – Effects on Clouds and Climate (BAECC) field campaign. The presented analysis of the height evolution of the radar Doppler spectra is a state-of-the-art retrieval with profiling cloud radars in SLW layers beyond the traditional use of spectral moments. Dynamical effects are considered by following the particle population evolution along slanted tracks that are caused by horizontal advection of the cloud under wind shear conditions. In the SLW layer, the identified liquid peak is used as an air motion tracer to correct the Doppler spectra for vertical air motion and the ice peak is used to study the radar profiles of rimed particles. A 1-D steady-state bin microphysical model is constrained using the SLW and air motion profiles and cloud top radar observations. The observed radar moment profiles of the rimed snow can be simulated reasonably well by the model, but not without making several assumptions about the ice particle concentration and the relative role of deposition and aggregation. In conclusion, this suggests that in situ observations of key ice properties are needed to complement the profiling radar observations before process-oriented studies can effectively evaluate ice microphysical parameterizations.

54 ENVIRONMENTAL SCIENCES↗

SUPPORT OF NEW COMPUTER HARDWARE AT LUCH'S MC&A SYSTEM: PROBLEMS AND A SOLUTION

Abstract Microsoft Windows NT 4.0 operating system is the only software product certified in Russia for using in MC&A systems. In the paper a solution for allowing the installation of this outdated operating system on new computers is discussed. The solution has been successfully tested and has been in use at Luch's network since March 2008. Furthermore, it is being recommended for other Russian enterprises for the same purpose. Introduction Typically, the software part of a nuclear material control and accounting (MC&A) system consists of an operating system (OS), database management systems (DBMS), accounting program itself and database of nuclear materials. Russian regulations require the operating system and database for MC&A be certified for information security, and the whole system must pass an accreditation. Historically, the only certified operating system for MC&A still continues to be Microsoft Windows NT 4.0 Server/Workstation. Attempts to certify newer versions of Windows failed. Luch, like most other Russian sites, uses Microsoft Windows NT 4.0 and SQL Server 6.5. Luch's specialists have developed an application (LuchMAS) for accounting purposes. Starting from about 2004, some problems appeared in Luch's accounting system. They were related to the complexity of installing Windows NT 4.0 on new computers. At first, it was possible to solve the problem choosing computer equipment that is compatible with Windows NT 4.0 or selecting certain operating system settings. Over time, the problem worsened and now it is almost impossible to install Windows NT 4.0 on new computers. The reason is the lack of hardware drivers in the outdated operating system. The problem was serious enough that it could have affected the long-term sustainability of Luch's MC&A system if adequate alternate measures were not developed.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

The Potentialities of the Atomic Bomb

In January 1949, Norris Bradbury gave a lecture at the National War College which summarized the progress Los Alamos had made since the end of the war. The transcript of the talk was filed and forgotten until it surfaced fifty years later. It is, perhaps, one of the best summaries of the state of the United States nuclear weapons program in 1949. It is also evidence of how Bradbury saw the future of atomic weapons. It is presented in full, with minor editing, and begins as follows: Since the first use of an atomic bomb on August 5 [sic], 1945, over the city of Hiroshima, Japan, there has been a continual flood of speculation and discussion concerning the effect of this new weapon on military technology. Much of this speculation and discussion has been intelligent and fruitful; much, I regret to say, has had neither of these characteristics. The enormity of the device, in terms of potential destruction and loss of life, and the practical necessity to surround the technical facts with full security restrictions have only combined to make the problem more difficult. At the same time, it is imperative that policymaking personnel in charge of long range national planning know the basic facts concerning atomic weapons and have these facts in a reasonable perspective. This document describes these potentialities in detail.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Excavation Volume Growth Factors at Environmental Remediation Sites - 20318

The U.S. Army Corps of Engineers (USACE) manages numerous environmental remediation projects in accordance with the Comprehensive Environmental Response, Compensation, and Liability Act, otherwise known as CERCLA. These include projects for the Formerly Utilized Sites Remedial Action Program (FUSRAP). Utilizing the CERCLA framework to address these projects requires detailed cost estimates and a significant portion of costs are associated with the volume of material to be excavated and that material's final disposition. Accordingly, understanding the expected volumes and uncertainty associated with those volumes is vital to project cost estimating. These estimates are completed at various stages of the CERCLA process, thus the project team has varying degrees of information available from which to develop these estimates depending on how far along the project is. Understanding the factors contributing to volume growth (increase in volume of material from that originally estimated) is a crucial element to determining volume and cost uncertainty. This paper presents a case study of a FUSRAP site which involves excavation and offsite disposal of contaminated soils from complex commercial, industrial, and residential properties. Original volume estimates were compared to post excavation volumes on a property by property basis. Reasons for differences are determined along with magnitude of impacts to cost estimating. For both residential and commercial property types, volume estimating factors, uncertainty considerations, and methods to account for each are discussed with emphasis on volume growth considerations. Cost estimating model input considerations are discussed with specific emphasis on accounting for volume uncertainty at the Feasibility Study (FS) phase of CERCLA. Underestimating or overestimating costs at the FS phase has repercussions under CERCLA that may impact project close out or completion schedule. Discussions presented will be helpful to both reviewers and preparers of cost estimates involving excavations. Additionally, project planners may be able to use the information to plan for volume growth contingencies. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

FEW questions, many answers: using machine learning to assess how students connect food–energy–water (FEW) concepts

There is growing support and interest in postsecondary interdisciplinary environmental education which integrate concepts and disciplines in addition to providing varied perspectives. There is a need to assess student learning in these programs as well as rigorous evaluation of educational practices, especially of complex synthesis concepts. This work tests a text classification machine learning model as a tool to assess student systems thinking capabilities using two questions anchored by the Food-Energy-Water (FEW) Nexus phenomena by answering two questions (1) Can machine learning models be used to identify instructor-determined important concepts in student responses? (2) What do college students know about the interconnections between food, energy and water, and how have students assimilated systems thinking into their constructed responses about FEW? Reported here are a broad range of model performances across 26 text classification models associated with two different assessment items, with model accuracy ranging from 0.755 to 0.992. Expert-like responses were infrequent in our dataset compared to responses providing simpler, incomplete explanations of the systems presented in the question. For those students moving from describing individual effects to multiple effects, their reasoning about the mechanism behind the system indicates advanced systems thinking ability. Specifically, students exhibit higher expertise for explaining changing water usage than discussing tradeoffs for such changing usage. This research represents one of the first attempts to assess the links between foundational, discipline-specific concepts and systems thinking ability. These text classification approaches to scoring student FEW Nexus Constructed Responses (CR) indicate how these approaches can be used, in addition to several future research priorities for interdisciplinary, practice-based education research. Development of further complex question items using machine learning would allow evaluation of the relationship between foundational concept understanding and integration of those concepts as well as more nuanced understanding of student comprehension of complex interdisciplinary concepts.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Initial Efforts Organizing WPNCS SG-8: Preservation of Expert Knowledge and Judgement Applied to Criticality Benchmarks

The Working Party on Nuclear Criticality Safety (WPNCS) under the guidance of the Organization for Economic Co-operation and Development (OECD) Nuclear Energy Agency (NEA) has over 20 years of experience addressing concerns related to static and transient configurations encountered within the nuclear fuel cycle: fuel fabrication, transportation, reprocessing, storage, and geological disposal. One of the cornerstone activities of the WPNCS is the International Criticality Safety Benchmark Evaluation Project (ICSBEP), which was established to identify a comprehensive set of criticality benchmark data, evaluate the data, including quantification of overall uncertainties; compile the data into a standardized format, perform sample calculations utilizing modern nuclear data sets and codes utilized in nuclear criticality safety, and formally document the work into a single source of verified benchmark data. Annually, members of the ICSBEP Technical Review Group (TRG) contribute evaluated benchmark data that undergoes comprehensive technical review prior to publication in the ICSBEP Handbook. In the years since the ICSBEP was established, there has been much work to prepare benchmark data to support validation activities in nuclear criticality safety. The 2020 edition of the ICSBEP Handbook contains acceptable benchmark specifications for 5,053 critical, subcritical, or near-critical configurations in 582 benchmark evaluations. Modern benchmark development benefits from decades of experienced international participants, a well-established handbook format, supplementary guides to deal with uncertainty quantification, and a comprehensive review process based upon independent reviews from international experts. The ICSBEP Handbook also contains 838 configurations deemed unacceptable to support criticality safety efforts. They are recorded, with the reasoning for their rejection, to preserve the experimental data, prevent reevaluation of data that are incomplete or contain known errors, and/or to potentially allow future reevaluation of the experiment pending the identification of sufficient data to resolve identified inconsistencies and errors. Users of the ICSBEP Handbook today might notice that the rigor and quality of modern criticality safety benchmarks is much greater than those prepared within the initial decade of the project. Benchmarks with 1s uncertainties in k eff greater than 1% were traditionally rejected unless they were identified as unique experiment types that encompassed materials, fuels, or designs not available from other benchmark experiments. However, benchmarks developed using modern experimental techniques and practices typically have uncertainties on the order of a few tenths of a percent. There have been ongoing efforts to improve the overall quality of previously published benchmark evaluations. Seventy-eight evaluations, containing approximately 600 configurations, have been revised just within the past decade. An additional eleven benchmarks are under revision for updated release in the 2020 edition of the ICSBEP Handbook. If some of the historic benchmarks were resubmitted in their current form to the TRG today, they would be rejected due to lack of data, missing components in the uncertainty analysis, or incomplete benchmark model development. The use of historic criticality safety benchmarks that underestimate the total uncertainty, lack properly quantified biases, or provide inadequate benchmark specifications do not sufficiently support modern criticality safety and nuclear data efforts. Although the ICSBEP Handbook is recognized by regulating bodies to support criticality safety, users are required to justify their reasons to ignore historic benchmark data and include additional safety margins within their designs. Discussions were held at the WPNCS 23rd Annual Meeting in September 2019 regarding the aforementioned issues. The resultant decision was to establish Subgroup 8 (SG-8): Preservation of Expert Knowledge and Judgement Applied to Criticality Benchmarks. The current activities of SG-8 are discussed herein.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

ARM Aerosol Measurement Science Group 2019 Strategic Planning Workshop Report

This report summarizes the results of a U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility workshop held in November 2019 to advance a science-based strategy for ARM’s aerosol measurement program. This was the second such workshop since the Aerosol Measurement Science Group (AMSG) was chartered in 2015 to enhance coordination of ARM observations of aerosols and atmospheric trace gases with the needs of ARM users. The results presented here reflect the AMSG’s focus in recent years on science-based strategies that will contribute to the increased use of ARM data to fulfill its mission of improving process representations and predictability in climate models. Sessions held during the workshop range from interfacing with models through aerosol sampling strategies to calibration protocols and data products. The strategies set forth here were also developed to be directly relevant to ARM’s updated Decadal Vision. The AMSG workshops have been designed to recommend actions that will enable ARM to evolve and continue to meet its mission. To that end, the AMSG will develop an actionable plan from the recommendations outlined here. Some are well defined and can reasonably be accomplished in the short term. Others are less definite or of a larger scope that calls for a longer-term implementation. Further discussion will be required to develop and prioritize actionable items related to such areas. Task teams comprising the appropriate expertise and perspective from the AMSG and other members of the community will be formed to achieve this outcome. Some particular topics are recognized as high priority, so plans are underway to develop task teams and to hold follow-on discussions to address them. Four areas currently being considered for short, focused discussion are 1) aerosol measurements on the North Slope of Alaska, 2) improving data usability for modeling, 3) strategies for advancing remote sensing, vertical profiling, and distributed measurements of aerosols, and 4) aerosol sampling strategies at existing ARM sites to provide intensive modes of operation to promote data usage for process and modeling studies.

54 ENVIRONMENTAL SCIENCES↗