Search NASA⌕ Search

SEARCH · Search NASA

Results for “EVALUATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Advancing Electric Propulsion Aircraft Evaluation for Urban Air Mobility: Insights from NASA-Ames

This presentation delves into a recent evaluation conducted at NASA-Ames on the Vertical Motion Simulator, focusing on the handling qualities of Distributed Electric Propulsion VTOL (eVTOL) aircraft, specifically tailored for Urban Air Mobility (UAM) applications. The presentation will focus on the recent effort to adapt and refine use of the Aeronautical Design Standard -33 (ADS-33) rotorcraft handling qualities developed by the U.S. Army and NASA to meet the diverse needs of civilian (eVTOL) concept evaluation. A brief discussion of the author’s personal test pilot insights in the early development of military Fly-By-Wire evaluation methods will also be provided. The emergence of innovative eVTOL designs with unique lift capabilities and flight control systems, present both opportunities and challenges, particularly in ensuring safety amidst technological complexity. To navigate these challenges, our investigation examined evaluation criteria designed to accommodate the varied configurations and advanced automation systems inherent in modern eVTOL aircraft. By establishing a standardized approach to evaluation, our research not only fosters innovation but also upholds safety standards in the dynamic landscape of urban air mobility. Through this endeavor, we help to facilitate the seamless integration of novel aircraft capabilities into new operations, contributing to a new era of safe and efficient aerial transportation.

Loran Allen Haworth↗

Advancing Electric Propulsion Aircraft Evaluation for Urban Air Mobility: Insights from NASA Ames

This presentation delves into a recent evaluation conducted at NASA-Ames on the Vertical Motion Simulator, focusing on the handling qualities of Distributed Electric Propulsion VTOL (eVTOL) aircraft, specifically tailored for Urban Air Mobility (UAM) applications. The presentation will focus on the recent effort to adapt and refine use of the Aeronautical Design Standard -33 (ADS-33) rotorcraft handling qualities developed by the U.S. Army and NASA to meet the diverse needs of civilian (eVTOL) concept evaluation. A brief discussion of the author’s personal test pilot insights in the early development of military Fly-By-Wire evaluation methods will also be provided. The emergence of innovative eVTOL designs with unique lift capabilities and flight control systems, present both opportunities and challenges, particularly in ensuring safety amidst technological complexity. To navigate these challenges, our investigation examined evaluation criteria designed to accommodate the varied configurations and advanced automation systems inherent in modern eVTOL aircraft. By establishing a standardized approach to evaluation, our research not only fosters innovation but also upholds safety standards in the dynamic landscape of urban air mobility. Through this endeavor, we help to facilitate the seamless integration of novel aircraft capabilities into new operations, contributing to a new era of safe and efficient aerial transportation.

eVTOL↗

Evaluating the Trustworthiness of Deep Neural Networks in Deployment – A Comparative Study (Replicability Study)

As deep neural networks (DNNs) are increasingly used in safety critical applications, there is a growing concern for their trustworthiness. Even highly trained, high-performant networks are not 100% accurate. However, it is very difficult to predict their behaviour during deployment without ground truth. In this paper, we provide a comparative and replicability study on recent approaches that have been proposed to evaluate the trustworthiness of DNNs. We find that it is very difficult to run and reproduce the results for these approaches on their replication packages, and it is even more difficult to run the tools on artifacts other than their own. Further, it is difficult to compare the effectiveness of the tools, due to lack of clearly defined evaluation metrics. Our results indicate that more effort is needed in our research community to obtain sound techniques for evaluating the trustworthiness of neural networks in safety-critical domains. To this end, we contribute an evaluation framework that incorporates the considered approaches and enables evaluation on common benchmarks, using common metrics. Using this framework, we run a comparative study of the three approaches.

Trustworthy AI↗

An Initial Evaluation Of Characterization And Closure Options For Underground Pipelines Within A Hanford Site Single-Shell Tank Farm

The Hanford Site includes 149 single-shell tanks, organized in 12 'tank farms,' with contents managed as high-level mixed waste. The Hanford Federal Facility Agreement and Consent Order requires that one tank farm, the Waste Management Area C, be closed by June 30, 2019. A challenge to this project is the disposition and closure of Waste Management Area C underground pipelines. Waste Management Area C contains nearly seven miles of pipelines and 200 separate pipe segments. The pipelines were taken out of service decades ago and contain unknown volumes and concentrations of tank waste residuals from past operations. To understand the scope of activities that may be required for these pipelines, an evaluation was performed. The purpose of the evaluation was to identify what, if any, characterization methods and/or closure actions may be implemented at Waste Management Area C for closure of Waste Management Area C by 2019. Physical and analytical data do not exist for Waste Management Area C pipeline waste residuals. To develop estimates of residual volumes and inventories of contamination, an extensive search of available information on pipelines was conducted. The search included evaluating historical operation and occurrence records, physical attributes, schematics and drawings, and contaminant inventories associated with the process history of plutonium separations facilities and waste separations and stabilization operations. Scoping analyses of impacts to human health and the environment using three separate methodologies were then developed based on the waste residual estimates. All analyses resulted in preliminary assessments, indicating that pipeline waste residuals presented a comparably low long-term impact to groundwater with respect to soil, tank and other ancillary equipment residuals, but exceeded Washington State cleanup requirement values. In addition to performing the impact analyses, the assessment evaluated available sampling technologies and pipeline removal or treatment technologies. The evaluation accounted for the potential high worker risk, high cost, and schedule impacts associated with characterization, removal, or treatment of pipelines within Waste Management Area C for closure. This assessment was compared to the unknown, but estimated low, long-term impacts to groundwater associated with remaining waste residuals should the pipelines be left "as is" and an engineered surface barrier or landfill cap be placed. This study also recommended that no characterization or closure actions be assumed or started for the pipelines within Waste Management Area C, likewise with the premise that a surface barrier or landfill cap be placed over the pipelines.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Continued Evaluation of the Pulse-Echo Ultrasonic Instrument for Critical Velocity Determination during Hanford Tank Waste Transfer Operations

Laboratory (PNNL) conducted an extensive evaluation of the ability of three ultrasonic instruments to detect critical velocity for a broad range of simulated Hanford nuclear waste streams containing particles with mean particle sizes of >50 microns. Evaluations were perform using the pipe loop at the Process Development Laboratory – East (PDL-E) at PNNL that was designed and built to evaluate the pipeline plugging issue during slurry transfer operations at the Hanford Waste Treatment Plant. In 2011 the ability of the ultrasonic PulseEcho system to detect critical velocity continued to be evaluated using the PDL-E flow loop and new simulants containing high-density particles with a mean particle size of < 15 microns. The PDL-E flow loop was modified for the 2011 testing to include a new test section that contained 5-MHz and 10-MHz ultrasonic transducers non-invasively mounted to schedule 40 pipe. The test section also contained reference instrumentation to facilitate direct comparison of the real-time PulseEcho transducer responses with experimentally observed critical velocities. This paper presents the results from the 2011 PulseEcho evaluation using a variety of simulated Hanford nuclear waste streams that were selected to encompass the expected high-level waste feed properties.

Critical Velocity↗

Evaluation methodology for comparing memory and communication of analytic processes in visual analytics

Provenance tools can help capture and represent the history of analytic processes. In addition to supporting analytic performance, provenance tools can be used to support memory of the process and communication of the steps to others. Objective evaluation methods are needed to evaluate how well provenance tools support analyst s memory and communication of analytic processes. In this paper, we present several methods for the evaluation of process memory, and we discuss the advantages and limitations of each. We discuss methods for determining a baseline process for comparison, and we describe various methods that can be used to elicit process recall, step ordering, and time estimations. Additionally, we discuss methods for conducting quantitative and qualitative analyses of process memory. By organizing possible memory evaluation methods and providing a meta-analysis of the potential benefits and drawbacks of different approaches, this paper can inform study design and encourage objective evaluation of process memory and communication.

Ragan, Eric D↗

Lessons Learned from Comprehensive Energy and Water Evaluations at U.S. Army Campus Installations

The U.S. Department of Energy’s Pacific Northwest National Laboratory has engaged in a multi-year collaboration with the U.S. Army to support comprehensive energy and water evaluations at large Army campus installations. Initiated to help the Army achieve compliance with facility evaluation requirements dictated by the Energy Independence and Security Act of 2007, this effort has resulted in the evaluation of 530 buildings at 14 installations across the U.S., and the identification of annual savings potential of over 212 billion Btu of energy and 29 million gallons of water. This paper highlights the nature of the evaluation process applied at these Army installations and discusses a number of key findings that can be considered for ongoing and future evaluations at Army and other federal agency facilities, particularly those buildings within campus settings.

Woodward, James C.↗

Evaluation and Validation Approaches for Simulation of Social Behavior: Challenges and Opportunities

While models of social systems have grown in scope to represent increasingly complex phenomena, efforts to validate these models against observations suffer from a number of challenges that include the lack of shared approaches, the use of single-dimensional evaluation criteria, and the difficulty in evaluating causal mechanisms. Moreover, current evaluation approaches suffer from sensitivity of the existing measurements to initial conditions and model assumptions, and failure to account for uncertainty. These effects lead to the lack of generalizability to new contexts, inability to replicate the validation approach for new models, and difficulties in interpretation of validation results. These challenges can be addressed by building a set of diverse and robust evaluation metrics and by developing best practices for comparative, reproducible validation of varied social simulation approaches against real-world data. Herein, we outline several best practices for data-drive model validation, such as defining evaluation strategies consistent with the intended use case and defining broad comparison criteria to highlight both model strengths and weaknesses. Leveraging common validation practices will enable robust analysis of simulation performance across diverse social scenarios and modeling approaches.

Saldanha, Emily G.↗

Assembling a Cyber Range to Evaluate Artificial Intelligence / Machine Learning (AI/ML) Security Tools

In this case study, we will describe the design and assembly of a cyber security test range we have built at Oak Ridge National Laboratory in Oak Ridge, TN, USA. The range is designed to provide a flexible environment to evaluate cyber security tools—particularly those involving AI/ML—in a way that provides realistic environments and where we can control the experiments to determine the strengths and weaknesses of the tools. We have designed in the ability to repeat the evaluations, so additional tools can be evaluated and compared at a later time. The system is one that can be scaled up or down for experiment sizes. At the time of the conference we will have completed two full-scale, national, government challenges on this range. These challenges are evaluating the performance and operating costs for AI/ML-based cyber security tools for application into large, government-sized environments. These evaluations will be described, in order to provide motivation and context for various design decisions and adaptations we have made. The first challenge measured end-point security tools against 100K malware samples chosen across a range of types. The second is network detection of attempted penetration and exploitations with varying levels of covertness in a high-volume, business network. The scale of each of these challenges is requiring us to create automation systems to repeat the experiments identically for each tool. Preventing there being easy signs of malicious activity for the AI/ML tools to focus on has been a particularly interesting and challenging aspect of designing and executing these challenge events. After the events, the range continues to be used for other research such as adversarial machine learning where the repeatability, scale, and automation required for the national challenge events become essential elements for research.

Nichols, Jeff↗

Use of Groundwater Flow, Solute Transport, and Geochemical Modeling To Evaluate Long-Term Nitrate Plume Concentrations Following Phreatophyte Source Control - 17262

The Monument Valley, Arizona, Processing Site is a former uranium mill site within the Navajo Nation in northeastern Arizona. Milling activities between 1955 and 1968 resulted in contamination of groundwater in the shallow alluvium at the site. Remedial action was completed under Title I of the Uranium Mill Tailings Radiation Control Act of 1978. Site remediation activities between 1992 and 1994 removed surficial source material and other site-related contamination, but contamination of deeper soil, primarily by nitrate, remained between the excavation depth and the water table. Residual nitrate in these soils, from uranium ore processing at the mill, has continued to be a source of groundwater contamination. To evaluate the potential for native phreatophytes to control remaining source material, four-wing salt-bush and black grease-wood were planted in 2000 and 2005 within the footprints of the former tailings piles. The objectives of the plantings were to increase nitrate removal from soil water through root uptake and, because phreatophyte water usage is expected to equal or exceed annual precipitation, to halt nitrate loading to groundwater. Recent evaluation showed more than an 80% decrease in soil nitrate concentrations and no effective groundwater recharge in the planting area. Numerical groundwater flow, solute transport, and geochemical modeling were performed to evaluate the long-term response of the existing nitrate plume to the phreatophyte source control measures. This modeling will help determine if 100-year natural flushing is a viable compliance strategy for the nitrate plume. Results showed that nitrate concentrations in the alluvial aquifer are expected to drop below the standard of 10 mg/L as N in approximately 70 years as a result of the phreatophyte planting. Companion sensitivity analysis was also performed to better understand how uncertainty in groundwater flow model and solute transport model inputs would impact cleanup times. Even considering input uncertainty, nitrate concentrations are expected to reach the standard in the alluvial aquifer within 100 years. Recognizing that model predictions are not absolute, but represent the general potential for an event to occur, the model was used to identify key sampling locations to verify that the nitrate plume will attenuate as predicted. This evaluation identified locations that can be used to assess the viability of the modeling predictions within the next 50 years. If the source diminishes or no longer exists, modeling predicts that concentrations of nitrate and ammonium in these wells should show significant declines over the next 10-55 years. If downward concentration trends do not occur as predicted, other remedial strategies may need to be evaluated to meet groundwater standards within the specified 100-year duration. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

The transportation factor in site evaluations for spent nuclear fuel storage and disposal facilities - 15460

New facility siting studies will be necessary to fulfill the Blue Ribbon Commission (BRC) on America's Nuclear Future 2012 recommendation to develop consolidated interim storage (CIS) for spent nuclear fuel in the next decade. Future site evaluations for used nuclear fuel (UNF) storage and disposal facilities must address transportation requirements, especially access to mainline railroads, early in the site selection process. The U.S. Department of Energy (DOE) in 2013 proposed a strategy for managing spent nuclear fuel in accordance with the BRC recommendations by establishing a pilot interim storage facility by 2021 and a consolidated interim storage facility by 2025. The authors demonstrate that currently available geographic information systems and already adopted siting criteria (defining favorable and unfavorable conditions) allow the identification of the transportation portion of a storage facility siting process to begin without delay. Ready access to the mainline rail system is absolutely critical since existing rail access, or easily constructed access, is a highly favorable condition for successful siting. Despite widespread rail abandonments over the past three decades, vast areas of the United States retain mainline rail service or could connect to existing mainlines by building new rail spurs of less than 25-50 miles. This precondition for transportation planning is critical. Planners need to start with the beginning - availability of rail transportation to and from the interim storage facility/facilities. A second step in transportation screening would be to evaluate those potential site locations within 50 miles of existing mainline railroads using other appropriate variables. This effort could begin with the application of the 1984 repository siting guidelines for transportation (10 CFR 960.5-2-7)[1]. Repository surface facilities have essentially the same transportation requirements as storage facilities. The guidelines in 10 CFR 960 provide a readily available template for evaluating sites based on transportation risks, impacts and costs. Initial site screening, after considering proximity to mainline railroads as the precursory step, should evaluate: 1) proximity to highly populated areas; 2) proximity to interstate highways; 3) proximity to environmentally sensitive areas and lands protected by federal, state, or tribal governments; and 4) proximity to military installations, hazardous materials facilities, or other facilities that might impact transportation safety and security.Several challenges exist which prevent effective transportation planning. The diversity of canister and cask types and SNF characteristics and conditions, the increasingly limited rail access at the shipping sites and the ease with which public attention can be marshalled against a waste management program, all suggest that future efforts need to identify potential storage sites that reduce transportation impacts and costs by reducing near-site transportation construction and reduce total system transportation impacts. This can most easily be accomplished by reducing shipping distances in a process that is easily defined and implemented. The paper concludes that the DOE should develop a site screening and evaluation program with transportation as a central consideration. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Evaluation of Current Knowledge for Building the Dutch Salt Safety Case - 16024

This paper provides an overview of an evaluation for building the Safety Case of geological disposal of radioactive waste in rock salt in the Netherlands. The evaluation comprises the present knowledge about the safety and feasibility of geological disposal designs considered in the past, thereby classifying the information taking into account the methodology and structure of a Safety Case. The evaluation is performed as part of the Dutch research programme OPERA (OnderzoeksProgramma Eindberging Radioactief Afval - Dutch acronym for Research Programme into Geological Disposal of Radioactive Waste) by a consortium consisting of GRS from Germany, and TNO and NRG from the Netherlands. Basis of the evaluation is the available Dutch and international scientific-technical information about geological disposal in rock salt, especially from the German and US programmes. The evaluations have shown that although much knowledge on the topic exists, the available information need to be integrated in order to develop a Dutch Safety Case on rock salt. For example, the characteristics of the Dutch radioactive waste investigated for disposal have changed considerably since the last Dutch research programme ended in 2000. This implies that the previously considered Dutch facility concepts for geological disposal in rock salt need to be adapted to the newly regarded waste types such as spent fuel from research reactors and large amounts of LLW, including depleted uranium. Introducing these aspects into the iteration towards a salt Safety Case would also require an update of the post-closure safety assessment. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Evaluation and Impacts of Mercury in the SRS Liquid Waste System - 16121

The Savannah River Site (SRS) Liquid Waste System (LWS) stores radioactive waste in 43 underground tanks. The radionuclides in the waste are removed through a series of separation processes and the low-level fraction is immobilized in a grout waste form while the high level fraction is disposed in a glass waste form. Mercury originated from decades of canyon processing (used as a catalyst for dissolving the aluminum cladding of reactor fuel) and is present throughout the LWS (∼60 metric tons). Mercury has long been a consideration in the LWS, from both hazard and processing perspectives. Mercury is removed from the LWS in many ways including: 1) the Tank Farm evaporator condensates; 2) at the Defense Waste Processing Facility (DWPF) where it is steam-stripped and removed during the feed preparation processes; 3) it is removed at the Effluent Treatment Plant (ETP); and it is immobilized in the low-level, grout waste form. An integrated, system-wide evaluation and assessment of mercury behavior in the LWS is being performed. The recently completed Phase I evaluation focused on mercury inventory and speciation in the LWS; mercury holdup and chemical processing behavior; mercury impact Identification, including worker safety and equipment degradation; and mercury removal and disposal options. The mercury removal system at the DWPF has been unable to remove mercury successfully due to equipment and chemistry challenges since the 2008 timeframe. Phase I evaluations indicate that approximately 43 percent of the mercury in waste sent to the DWPF is now returning to the Tank Farm in the recycle stream and is concentrating to higher than expected levels (∼500 mg/l) around the 2H evaporator system. The chemical behavior of mercury is further complicated by the formation of higher than expected quantities of organomercury species, specifically methyl mercury, now present in the DWPF recycle evaporator system (2H Tank farm evaporator), which is used to volume-reduce the recycle stream. Phase II activities are building on the Phase I mercury activities, including additional sampling and characterization activities, a re-assessment of overall system knowledge, ranking and prioritizing critical gaps/information in mercury behavior across the flowsheet, assessing impacts of mercury removal and disposal options, and documenting an action plan for overall mercury management in the LWS. Phase II activities include two System Engineering Evaluations to 1) 'Reestablish Mercury removal Capability within DWPF', and 2) 'Determine the Best Alternative Mercury Removal Location with the LWS'. This paper provides the results of the Phase I and II mercury evaluations for the SRS LWS. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Evaluation of Computed Tomography Techniques for Material Identification in Low Level and Intermediate Level Waste - 16648

Measures required to assure long term safe storage of Low-level and intermediate-level short-lived (LIL/SL) waste generated by the nuclear-power industry in France include the characterization of the waste and identification of materials within the waste. Digital Radiography (DR) techniques using x-ray at energies in the 6 MeV range have been shown to be effective for validation of the integrity of the concrete containers, and it was considered that the use of this technique together with the addition of Computed Tomography (CT) techniques could effectively identify materials within the waste. This paper describes the initial evaluation of two DR imaging techniques and two CT techniques using x-ray energy spectra up to 9 MeV to inspect a surrogate waste package, which comprised an outer concrete cylindrical container of 1400 mm diameter with 148 mm wall thickness, and an overall volume of 2 meters cubed, within which a 200 liter drum containing representative heterogeneous inactive waste, was placed in the center and the annulus between the 200 liter drum and the outer cylindrical package was filled with cement grout. The surrogate waste within the 200 liter drum comprised three separate layers of high density, medium density and low density mixed materials. The equipment used was a linear accelerator producing high energy spectra at either 6 MeV or 9 MeV and a high-precision CT manipulator with X, Y, Z and rotation motions, which were common to all techniques investigated. Two different digital detectors were used in the DR and CT performance evaluations, a Digital Detector Array (DDA) comprising a columnar Thallium-doped Cesium-Iodide scintillator screen in intimate contact with a 2 k by 2 k array of amorphous silicon detectors, 200 μm x 200 μm in area, and a Linear Diode Array (LDA) comprising a line of Cadmium-Tungstate columns, 1 cm thick and 400 μm x 400 μm in area. The work comprised evaluations of linear accelerator spectra and the attenuation effects of the waste container and contents, image acquisition performance of each detector, and CT techniques using area detector and linear detector. The results presented in this paper include mathematical evaluation of the two CT techniques, and analysis of measurement data, digital images, CT reconstruction images, and estimated material densities. The data was compared with recorded details and photographs of the actual configuration of materials within the surrogate waste. The Digital Detector Array can generate CT inspection volumes with considerable resolution and detail for the low-density and medium-density sections of the surrogate waste, however, the high-density sections were not imaged with sufficient detail and the images contained a large number of artifacts mainly due to the detectors lack of high energy photon stopping power. Materials identification with the Digital Detector Array, while possible for certain materials, for materials in the steel to plastic density range the attenuation values of the voxels in the reconstruction are too similar and difficult to resolve from the artifacts present. The Linear Diode Array can generate CT inspection volumes of regions of interest of the low-density and medium-density sections with considerable resolution and contrast, and potentially acceptable levels of resolution and contrast of the high-density section of the waste. While a few artifacts were present in the reconstructions, the majority are not due to the fundamental properties of the detector and are considered to be correctable. Materials identification with the LDA inspection data appear to be viable, with steel, copper, and higher-density metals being readily be distinguished from other materials on the basis of voxel value. Future work is needed to obtain a better definition of optimum spatial resolution and inspection speed, and to develop a system of 'calibration rods' which would consist of a series of 50 mm diameter cylinders of 7 materials; Plastic, Teflon, Concrete, Aluminum, Copper, Tungsten and Lead. The cylinders will be distributed at a certain radius in the surrogate waste and will be used as reference points in the evaluation and demonstration of the contrastive performance for the low, medium and high-density cases. The ability to identify the materials within a sealed waste container, by nondestructive examination, enables the verification of waste acceptance criteria without the need to open the waste containers. This eliminates the need for complex and expensive equipment to open and remotely handle the intermediate level waste, avoids potential hazards and risk of personnel dose uptake, and does not increase the volume of waste caused by repackaging of materials after examination and the decontamination or disposal of equipment used.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Enhanced Evaluation Criteria to Meet the WIPP Waste Acceptance Criteria - 18655

The Waste Isolation Pilot Plant (WIPP) is a deep geologic repository for the disposal of Transuranic (TRU) waste and the only such disposal facility of its kind. TRU waste is radioactive mixed waste generated by the U. S. Department of Energy in support of National Defense. In 2014, the WIPP facility was shut down when two separate accidents occurred in the repository. The two accidents were a fire on a large underground haul truck that prompted evacuation and filled the mine with smoke and soot, and a radiation release that contaminated the exhaust ventilation and disposal areas of the mine. DOE performed two accident investigations in 2014 that resulted in many corrective actions. Some of the corrective actions resulted in significant changes in the WIPP Waste Acceptance Criteria (WAC) and are required to be applied to all TRU waste upon the resumption of shipments to WIPP. WIPP re-opened and began taking shipments again in 2017 and a large backlog of over 25,000 TRU waste containers that were certified prior to the new WAC have been undergoing re-evaluation since the re-opening. This paper will focus on the new WAC criteria that TRU waste must meet above-and-beyond previous WAC criteria and the implementation of new processes for approval. The primary area for these changes is in the area of waste characterization using Acceptable Knowledge (AK) and new detailed analyses required for chemical compatibility. The accident investigation revealed that the radiation release was due to a thermal runaway and bursting of the waste container due to inadvertent mixtures of nitrates and combustibles resulting in ignitable waste forms. In other words, the TRU waste container had incompatible contents that went undiscovered and created a hazard characteristic that was prohibited at WIPP. Through detailed chemical compatibility evaluations and new oversight, the DOE should be able to prevent a similar accident (see Figure 1). The new chemical compatibility evaluations and evaluations of oxidizing chemicals combined with combustibles are complex and detailed. Chemical compatibility is not a new requirement, but a much more detailed evaluation is a new requirement. And, obtaining historical information about the generation of the final waste form for legacy packaged waste can be very challenging. Specifically, determining possible amounts of chemicals in the waste can be extremely challenging. This paper does not explore in depth, the details of oxidizing chemicals. Other papers presented will discuss oxidizing chemicals. (author)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Factors Influencing the Evaluation of Spent Fuel Rail Routes - 19010

The U.S. Department of Energy (DOE) is considering use of rail transport for future shipments of commercial spent nuclear fuel (SNF) from where it currently resides to storage or disposal facilities. Rail carriers transporting in commerce certain quantities of 'rail security sensitive materials,' including SNF, face a regulatory requirement from the U.S. Department of Transportation to perform route risk assessments on an annual basis. In performing these assessments, each affected rail carrier must take into consideration twenty-seven different route factors, and document its rationale for selecting preferred and alternative routes on the basis of the safety and security risk analysis results. The major freight rail carriers operating in the U.S. have invested in the development of a proprietary tool, for rail carrier use only, to assist them in making route selections. This tool utilizes operations data input by each affected rail carrier in conjunction with geographic information systems (GIS) data to represent proximate risk factors, to be integrated and assigned to individual points and segments on the railroad network. Separate safety and security risk values are generated for each rail route under consideration. These values are then placed on an equivalent scoring basis and summed together to allow direct comparison between different route options and to rank order each route in terms of its relative attractiveness. Each affected rail carrier files an annual report for evaluation by the Federal Railroad Administration (FRA) that documents its route risk assessment approach and analysis results. DOE has developed its own decision-support tool, Stakeholder Tool for Assessing Radioactive Transportation (START), which is capable of generating and analyzing routing options for transporting SNF by rail in addition to other freight modes. To better understand how affected rail carriers are likely to route SNF shipments in accordance with regulatory requirements and those route factors likely to be most influential in impacting DoE's evaluation of alternative SNF rail routes, a study was undertaken by DOE with the following objectives: - Review the shipment routes that have been historically used by rail carriers to move high hazard materials, including SNF; - Identify the physical, operational and proximate characteristics (attributes) associated with the rail segments that comprise these routes; - Evaluate the relationships between these attributes; - Make suggestions for how to streamline the factors used in DoE's rail route evaluations; - Contrast these relationships with how the factors are used by the rail carriers in applying their tool This paper describes the study approach, analysis results, and implications for rail route selection methodology. Differences between this evaluation and railroad industry information about rail route assessments are also discussed. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

External Engagement During Evaluations of Shutdown Nuclear Power Plant Sites - 19221

This is a technical paper that does not take into account the contractual limitations under the Standard Contract for Disposal of Spent Nuclear Fuel and/or High-Level Radioactive Waste (Standard Contract) (10 CFR Part 961). Under the provisions of the Standard Contract, DOE does not consider spent nuclear fuel in multi-assembly canisters to be an acceptable waste form, absent a mutually agreed to contract amendment. To the extent discussions or recommendations in this paper conflict with the provisions of the Standard Contract, the Standard Contract provisions prevail. The U.S. Department of Energy Office of Integrated Waste Management (DOE-IWM) continues to conduct evaluations of removing spent nuclear fuel (SNF) from shutdown nuclear power plant sites. The 14 shutdown sites included in the evaluation to date have nuclear power reactors that have been permanently shut down and the sites have been decommissioned or are undergoing decommissioning. The 14 shutdown sites are Maine Yankee, Yankee Rowe, Connecticut Yankee, Humboldt Bay, Big Rock Point, Rancho Seco, Trojan, La Crosse, Zion, Crystal River, Kewaunee, San Onofre, Vermont Yankee, and Fort Calhoun. The Oyster Creek Nuclear Generating Station ceased operations in September 2018 and will be included in future evaluations. A key part of the shutdown site evaluations are visits to the sites. These site visits typically take place over 3 days. The first day is spent at the nuclear power plant site. The second day is spent evaluating the near-site transportation infrastructure, including rail infrastructure, potential heavy-haul routes, and potential rail and barge transload locations. The third day is often spent meeting with community engagement or advisory panels. External engagement activities during site visits are conducted in two areas. The first area involves inviting tribal and state representatives, State Regional Group (SRG) representatives, and Federal Railroad Administration (FRA) representatives to participate in the entire site visit. The SRG representatives are from the Southern States Energy Board, the Western Interstate Energy Board, the Council of State Governments - Midwest, or the Council of State Governments - Eastern Regional Conference, according to the location of the nuclear power plant. State representatives typically represent their state department of energy, state department of environmental or natural resources, State Rail Safety Participation Program, state police, state department of transportation, radiation protection organization, or emergency management organization. Tribal representatives explore issues associated with cultural affiliation and tribal involvement with past and present site activities. As the regulator of the U.S. railroads, the FRA representatives bring unique experience to the site visits. They also coordinate meetings with the railroads that serve the shutdown sites. The second area of external engagement activities during site visits involves meeting with local community engagement or advisory panels. Meeting with local community engagement or advisory panels provides an opportunity to inform these panels on DOE activities and the roles and responsibilities of federal agencies during site decommissioning. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Evaluation of Material Balance Approaches for Hanford Direct-Feed Low Activity Waste Processing - 20022

The Hanford Site has accumulated millions of gallons of tank waste from reprocessing spent fuel to recover plutonium, uranium, cesium, and strontium. The supernatant from the accumulated tank waste will be treated using a Direct Feed Low-Activity Waste approach. The supernatant will be treated to remove solids and cesium in the Tank-Side Cesium Removal process in the Hanford tank farm, then vitrified in a semi-batch process in the Hanford Waste Treatment and Immobilization Plant (WTP). Currently, each batch of feed is sampled at three locations prior to being fed to the melter: the feed qualification tank in the Hanford tank farm as well as the concentrate receipt vessel (CRV) and melter feed preparation vessel (MFPV) in the WTP. The feed qualification sample is taken from a large batch of accumulated feed, only two to three samples are expected each year. Approximately 275 samples from the CRVs and 1100 samples from the MFPV are expected each year. An evaluation was performed to determine if a material balance based on the feed qualification sample could replace most of the sampling in the CRVs and MFPVs. The evaluation consisted of three elements: (1) determination of the practicality of using a material balance to estimate the stream composition of the CRV and MFPV contents, (2) evaluation of whether the material balance could be automated using the existing process control system, and (3) determination of the uncertainty in glass composition using the material balance approach. It is assumed that periodic sampling at the CRV and MFPV would be performed periodically to re-baseline the material balance, evaluations are in progress to determine the frequency of this periodic sampling. Process sample locations downstream of the melter were reviewed as well, but the partitioning of semi-volatile species in the melter was determined to preclude extending the material balance approach past the melter. It was determined that replacement of the CRV sample location was feasible and did not increase process uncertainty or significantly impact waste loading. Replacement of the MFPV sample was also determined to be feasible, but that measurement of the glass former chemical addition may be needed prior to addition of these chemicals to the MFPV. This measurement could be performed by an in situ laser-induced breakdown spectroscopy (LIBS) system. Limited tests were performed to evaluate LIBS for direct measurements of the low-activity waste melter feed. The use of a material balance would eliminate over 1200 samples each year if only 10% of the CRV and MFPV batches are sampled and could likely allow the WTP laboratory to operate on days only versus 24/7 operation. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗