Search NASA⌕ Search

SEARCH · Search NASA

Results for “EVALUATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Evaluation of proposed Section III Division 5 Class B rules: Piping example problem

Evaluation of proposed Section III Division 5 Class B rules: Piping example problem to be presented include Z pipe geometry and model problem statement, Z pipe loads and design inputs problem statement, Primary Stress Limit overview, Primary stress limit pseudo yield stress calculation, Primary stress limited factored load procedure, Strain limit evaluation composite load cycle, Strain limit evaluation pseudo yield stress, Strain limit evaluation strain limit criteria and ratcheting check, Creep fatigue damage evaluation overview, Creep fatigue damage evaluation alternating stress calculations, Creep fatigue damage evaluation lower bound stress, Creep fatigue damage evaluation stress relaxation history, Creep fatigue damage evaluation damage fractions, and Recommendations to consider for Z-pipe problem.

42 ENGINEERING↗

Weapons of Mass Destruction Technology Evaluation and Training Range

The Idaho National Laboratory (INL) has a long history for providing technology evaluation and training for military and other federal level Weapons of Mass Destruction (WMD) response agencies. Currently there are many federal organizations and commercial companies developing technologies related to detecting, assessing, mitigating and protecting against hazards associated with a WMD event. Unfortunately, very few locations exist within the United States where WMD response technologies are realistically field tested and evaluated using real chemical, biological, radiological, nuclear and explosive materials. This is particularly true with biological and radiological hazards. Related to this lack of adequate WMD, multi-hazard technology testing capability is the shortage of locations where WMD response teams can train using actual chemical, biological, and radiological material or highly realistic simulates. In response to these technology evaluation and training needs, the INL has assembled a consortium of subject matter experts from existing programs and identified dedicated resources for the purpose of establishing an all-hazards, WMD technology evaluation and training range. The author describes the challenges associated with creating the all-hazards WMD technology evaluation and training range and lists the technical, logistical and financial benefits of an all-hazards technology evaluation and training range. Current resources and capabilities for conducting all-hazard technology evaluation and training at the INL are identified. Existing technology evaluation and training programs at the INL related to radiological, biological and chemical hazards are highlighted, including successes and lessons learned. Finally, remaining gaps in WMD technology evaluation and training capabilities are identified along with recommendations for closing those gaps.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Early response evaluation of neoadjuvant therapy with PET/MRI to predict resectability in patients with adenocarcinoma of the esophagogastric junction

Study design and purpose: Positron emission tomography (PET)/magnetic resonance imaging (MRI) is a new modality that has showed promising results for various clinical indications. Currently, evaluation of neoadjuvant therapy (NT) among patients with adenocarcinoma of the esophagogastric junction has primarily been reserved for PET/computed tomography. Our aim was to evaluate if early response evaluation by PET/MRI is a feasible method to predict resectability. Methods and materials: Patients with untreated adenocarcinoma of the esophagogastric junction (Siewert types I/II) and fit for NT with no contraindications for PET/MRI were considered eligible. A baseline scan was performed prior to NT induction and an evaluation scan 3 weeks later. For histopathological response evaluation, the Mandard tumor regression grade score was applied. Response on PET/MRI was evaluated with Response Evaluation Criteria in Solid Tumors (RECIST 1.1), and change in ADC and SUV{sub max} values. Results: Twenty-eight patients were enrolled, and 22 completed both scans and proceeded to final analyses. Seventeen patients were found resectable versus five who were found unresectable. PET/MRI response evaluation had a sensitivity 94%, specificity 80%, and AUC = 0.95 when predicting resectability in patients with adenocarcinoma of the esophagogastric junction. No association with histopathological response (tumor regression grade) was found nor was RECIST correlated with resectability. Conclusion: Response evaluation using PET/MRI was a feasible method to predict resectability in patients with adenocarcinoma of the esophagogastric junction in this pilot study. However, larger studies are warranted to justify the use of the modality for this indication.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Release of Evaluated 235 U(n,f) Average Prompt Fission Neutron Multiplicities Including the CGMF Model

This report documents an evaluation of the average prompt fission neutron multiplicity, $\overline{v}_p$, of 235 U from 200 keV to 15 MeV that is a potential release candidate for the upcoming U.S. nuclear data library, ENDF/B-VIII.1. This evaluation had to be re-done from "scratch", as the input to the $\overline{v}_p$ evaluation of the previous library, ENDF/B-VIII.0, was lost. That means that all available experimental data were re-analyzed and uncertainties were re-estimated. Another major difference to ENDF/B-VIII.0 is that this evaluation includes model information from the Hauser-Feshbach fission fragment decay code CGMF, while ENDF/B-VIII.0 is based purely on experimental data. CGMF links several fission quantities with each other; $\overline{v}_p$ is predicted by assumptions made on, e.g., pre-neutron emission yields as a function of mass, the total kinetic energy, or spin and parity of fission fragments. This allows to perform two types of validation for the new 235 U $\overline{v}_p$: On the one hand, one can employ evaluated CGMF parameters obtained from fitting to experimental 235 U $\overline{v}_p$ to predict yields as a function of mass, the average total kinetic energy, or the mean energy of the prompt fission neutron spectrum. These model-predicted values can then be compared to experimental and evaluated data. The model-predicted fission-observable values using evaluated parameters obtained here are reasonably close to experimental data indicating the evaluated 235 U(n,f) $\overline{v}_p$ are physical. On the other hand, one can validate 235 U $\overline{v}_p$ with respect to integral responses such as fast ICSBEP critical assemblies or LLNL pulsed spheres. LLNL pulsed-sphere neutron-leakage spectra are minimally impacted by the new 235 U $\overline{v}_p$ as these experimental data are shape data and the $\overline{v}_p$ would mostly lead to a change in normalization of the data as the spheres are relatively thin (0.7 and 1.5 mean-free path) and, thus, mostly depend on 235 U $\overline{v}_p$ from 12-15 MeV. The change in the predicted effective neutron multiplication factor, k eff , of selected ICSBEP critical assemblies, however, is large compared to values using ENDF/B-VIII.0 and experimental k eff : The average bias is 108 pcm across all studied k eff values versus 12 pcm for ENDF/B-VIII.0. A reasonable performance in simulating keff (mean bias of 14 pcm) can be retained by tweaking 235 U $\overline{v}_p$ from 3-5 MeV, and combining it with a recent 235 U PFNS evaluation that is also a ENDF/B-VIII.1 release candidate.

235U↗

Engineering flight and guest pilot evaluation report, phase 2

Prior to the flight evaluation, the two-segment profile capabilities of the DC-8-61 were evaluated and flight procedures were developed in a flight simulator at the UA Flight Training Center in Denver, Colorado. The flight evaluation reported was conducted to determine the validity of the simulation results, further develop the procedures and use of the area navigation system in the terminal area, certify the system for line operation, and obtain evaluations of the system and procedures by a number of pilots from the industry. The full area navigation capabilities of the special equipment installed were developed to provide terminal area guidance for two-segment approaches. The objectives of this evaluation were: (1) perform an engineering flight evaluation sufficient to certify the two-segment system for the six-month in-service evaluation; (2) evaluate the suitability of a modified RNAV system for flying two-segment approaches; and (3) provide evaluation of the two-segment approach by management and line pilots.

Morrison, J. A.↗

NASA PC software evaluation project

The USL NASA PC software evaluation project is intended to provide a structured framework for facilitating the development of quality NASA PC software products. The project will assist NASA PC development staff to understand the characteristics and functions of NASA PC software products. Based on the results of the project teams' evaluations and recommendations, users can judge the reliability, usability, acceptability, maintainability and customizability of all the PC software products. The objective here is to provide initial, high-level specifications and guidelines for NASA PC software evaluation. The primary tasks to be addressed in this project are as follows: to gain a strong understanding of what software evaluation entails and how to organize a structured software evaluation process; to define a structured methodology for conducting the software evaluation process; to develop a set of PC software evaluation criteria and evaluation rating scales; and to conduct PC software evaluations in accordance with the identified methodology. Communication Packages, Network System Software, Graphics Support Software, Environment Management Software, General Utilities. This report represents one of the 72 attachment reports to the University of Southwestern Louisiana's Final Report on NASA Grant NGT-19-010-900. Accordingly, appropriate care should be taken in using this report out of context of the full Final Report.

Dominick, Wayne D.↗

Towards Reliable Evaluation of Anomaly-Based Intrusion Detection Performance

This report describes the results of research into the effects of environment-induced noise on the evaluation process for anomaly detectors in the cyber security domain. This research was conducted during a 10-week summer internship program from the 19th of August, 2012 to the 23rd of August, 2012 at the Jet Propulsion Laboratory in Pasadena, California. The research performed lies within the larger context of the Los Angeles Department of Water and Power (LADWP) Smart Grid cyber security project, a Department of Energy (DoE) funded effort involving the Jet Propulsion Laboratory, California Institute of Technology and the University of Southern California/ Information Sciences Institute. The results of the present effort constitute an important contribution towards building more rigorous evaluation paradigms for anomaly-based intrusion detectors in complex cyber physical systems such as the Smart Grid. Anomaly detection is a key strategy for cyber intrusion detection and operates by identifying deviations from profiles of nominal behavior and are thus conceptually appealing for detecting "novel" attacks. Evaluating the performance of such a detector requires assessing: (a) how well it captures the model of nominal behavior, and (b) how well it detects attacks (deviations from normality). Current evaluation methods produce results that give insufficient insight into the operation of a detector, inevitably resulting in a significantly poor characterization of a detectors performance. In this work, we first describe a preliminary taxonomy of key evaluation constructs that are necessary for establishing rigor in the evaluation regime of an anomaly detector. We then focus on clarifying the impact of the operational environment on the manifestation of attacks in monitored data. We show how dynamic and evolving environments can introduce high variability into the data stream perturbing detector performance. Prior research has focused on understanding the impact of this variability in training data for anomaly detectors, but has ignored variability in the attack signal that will necessarily affect the evaluation results for such detectors. We posit that current evaluation strategies implicitly assume that attacks always manifest in a stable manner; we show that this assumption is wrong. We describe a simple experiment to demonstrate the effects of environmental noise on the manifestation of attacks in data and introduce the notion of attack manifestation stability. Finally, we argue that conclusions about detector performance will be unreliable and incomplete if the stability of attack manifestation is not accounted for in the evaluation strategy.

cyber defense↗

An approach to evaluating and monitoring ecological resources for sustainability on DOE remediation sites: Hanford as a case study - 15524

Protecting ecological and environmental resources is a worthy aspect of the Department of Energy's site missions, for each of its sites, during and after remediation. Ecological resources are important to a range of stakeholders, including regulatory agencies, resource agencies, natural resource trustees, Tribal governments, and the public, and may be an essential component of Native American cultural resources. Because the nature and value of ecological resources can change over time as a result of remediation, succession, and global climate change, it is imperative for DOE to have instituted an acceptable method of evaluating resources before initiation of active remediation, over the ensuing century when institutional and engineering controls are considered to be in effect. Having such a methodology in place also would be key to resource sustainability. Department of Energy sites generally have environmental programs, so instituting specific unified practices for evaluating resources should not be difficult to implement. Instituting these practices would assure the public that ecological resources, as well as human and cultural resources, are being protected now, and can be protected into the future. Key ecological species and/or unique habitats have been preserved at Department of Energy sites since the mid-20. century because of federal government stewardship. Such preservation is particularly true for the sites with larger land areas, including the Hanford Reservation, the Idaho National Laboratory and the Savannah River Site. Individual sites typically have extensive studies of site biodiversity, but site resources are not routinely examined within a regional or national context (Eco-region). The evaluation of the on-site resources with those resources in the appropriate Eco-region provides a context for 'valuing' on- site resources. On-site resources should also be evaluated in terms of federal and state legislation where species may have legal protection and require legal consideration during remediation if present or adjacent to the remediation site. A method is needed in this study for evaluating ecological resources prior to remediation and during remediation, and a paradigm is proposed that will ensure sustainability. Finally, in a period of climate change and instability, developing methods of evaluating ecological resources is essential to successful protection, enhancement, and sustainability. The ecological methodology is part of a Hanford site-wide Risk Review Project, conducted by the Consortium for Risk Evaluation with Stakeholder Participation (CRESP). Our method adapts an existing methodology that includes using established levels for evaluating ecological resources by expanding the existing methodology to include field work for validating previous resource level designations, to assess the occurrence of invasive/exotic species, and to identify landscape scale features (patch size, connectivity). Evaluations should be conducted in the remediation unit itself, and in a buffer zone surrounding the remediation site. The methodology described has been applied to several remediation areas at Hanford, and issues that emerged during its application are discussed. The methodology can be applied at the major sites. Application of the Eco-region analysis will provide regulators and the public with an understanding of the value of the ecological resources in relation to the region, as well as an appreciation for the stewardship role the Department of Energy has played in protecting these resources since the beginning of the Cold War Era and can continue to do so sustainably. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Best-Estimate-Plus-Uncertainty-Informed Deterministic Safety Evaluation

Nuclear power plant (NPP) utilities operate contingent on receiving a favorable safety assessment from their national regulatory and safety authority. Among the many facets of NPP safety addressed is verification of integral design-basis performance - a demonstration of a plant's response to a suite of challenging transient and accident scenarios. Thermal-hydraulic system computer codes like RELAP5, TRAC, CATHARE, and ATHLET are used as the simulation engine as part of a broader evaluation model that accounts for a variety of uncertainties. It is common for these evaluation models to apply either a super-bounding/ deterministic or best-estimate plus uncertainty (BEPU) approach. The trend over the past two decades has been away from the classical deterministic methods towards methods explicitly incorporating parametric uncertainty models. These methods center upon the evaluation of parametric and system response uncertainties, where these uncertainties are derived from the convolution of one or more parametric uncertainty models. Acceptance of BEPU methods has provided the nuclear industry benefits regarding operational flexibility and, in some cases, power output. The advantage of BEPU for new NPPs is less obvious. Generally, these new designs include engineered safety features that practically eliminate fuel damage resulting from design-basis events. To substantiate such claims, applying super-bounding assumptions on uncertainties may be a more expedient demonstration of a plant's safety case than those based on BEPU. In addition, the requirements on design inputs for a deterministic evaluation model are substantially less than that for a BEPU evaluation model. As such, applying a deterministic evaluation model is expected to have the advantage of reducing the duration of the licensing review process. For the current operating fleet of light-water reactors (LWRs), the nuclear safety authorities in most countries have followed the U.S. Nuclear Regulatory Commission's rules for the preparation of safety analysis. These rules are specified in the U.S. Code of Federal Regulations, most notably in, Part 10, Section 50.46, entitled 'acceptance criteria for emergency core cooling systems for light-water nuclear power reactors' and its Appendix K. Notably, Appendix K specifies deterministic requirements for analysis of the loss-of-coolant accident (LOCA), which is generally regarded as the maximum credible accident for LWRs. Projecting 10 CFR 50, Appendix K, to new plants is not obviously applicable as it addresses light water fluid flow and heat transfer phenomena associated with core uncovery. Preventing core uncovery is a requirement for several designs in the class of small modular reactors (SMR). In doing so, the majority of phenomenological uncertainties prescribed in Appendix K are eliminated. Similarly, the impact of other phenomena to effect a change in various safety measures, i.e., figures-of-merit, is expected to be different. The implication is that development of a deterministic evaluation model must be derived with an original technical basis rather than solely rely on Appendix K. While a logical conclusion, the expectation of original bases, regardless of the treatment of uncertainties, is embodied in the U.S. NRC's Regulatory Guide (RG) 1.203, Transient and Accident Analysis. Within the evaluation model development and application process framework of RG 1.203, this paper describes a BEPU-informed deterministic evaluation model for NPPs with large inherent safety margins. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Status of a New Resonance Evaluation for Cerium to Support Nuclear Criticality Safety Applications

A new resonance evaluation is currently being carried out at Oak Ridge National Laboratory (ORNL) for isotopes of cerium. This new evaluation will provide a much-needed update of the resolved and unresolved resonance parameters for {sup 140}Ce and {sup 142}Ce based on new and existing experimental cross section data. The physics of the resolved resonance region will be greatly improved, and new resonance parameter covariance data will be generated. Cerium exists predominately as {sup 140}Ce and {sup 142}Ce and can be found in chemical processing streams because it is used commercially as a catalyst or additive in chemical applications (e.g., glass polishing powder). Cerium has neutron-absorbing properties that can influence the reactivity of systems with fissionable material. The need for improved cerium cross section data has been identified specifically for the Hanford Plutonium Finishing Plant as part of the Nuclear Criticality Safety Program (NCSP) nuclear data request. Furthermore, cerium is a high-yield fission product, making it relevant for reactor calculations. Currently, ENDF/B-VII.1 evaluations for cerium isotopes (described in Section II) do not include the covariance data needed to support sensitivity/uncertainty analyses of systems involving cerium. In addition, the available cerium resonance parameters in ENDF/B-VII.1 are based on parameters provided in the Atlas of Neutron Resonances: Resonance Parameters and Thermal Cross- Sections. Z = 1-100 by S. Mughabghab; hence, the 'evaluated' resonance parameters are not based on a detailed R-matrix analysis. Furthermore, differential measurements are needed in the resonance region to accurately predict the neutron resonances. ORNL has completed new differential measurements on natural samples of cerium, and measurements of an enriched {sup 142}Ce sample are planned. A corresponding resonance evaluation for {sup 140}Ce and {sup 142}Ce being conducted by ORNL will provide detailed cross section resonance parameters and corresponding evaluated covariance data in the resonance region in support of the NCSP. The target uncertainty requested by the NCSP is on the order of 1-2% for the total cross section and less than 6% for the capture cross section in the resolved resonance region. New cerium resonance evaluations will significantly improve radiation transport calculations for systems involving cerium in processes in the DOE Complex. Also, the new evaluations will provide much-needed evaluated covariance data to support sensitivity/ uncertainty analyses.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Evaluation of a potassium filled UO{sub 2} core in a beryllium-reflected space reactor - 14371

The critical configuration of the small, compact critical assembly (SCCA) experiments performed at the Oak Ridge Critical Experiments Facility (ORCEF) in 1962-1965[1,2] have been evaluated for the International Criticality Safety Benchmark Evaluation Project (ICSBEP) and were determined to be acceptable benchmark experiments and are included in the International Handbook of Evaluated Criticality Safety Benchmark Experiments (ICSBEP Handbook)[3]. The initial intent of these experiments was to support the design of the Medium Power Reactor Experiment (MPRE) program, whose purpose was to study 'power plants for the production of electrical power in space vehicles'.[4] The third configuration in this series of experiments was a beryllium-reflected mockup of a stainless-steel-clad, highly enriched uranium (HEU)-O{sub 2} fuel, potassium-cooled, space power reactor. Reactivity measurements, cadmium ratio spectral measurements, and fission rate measurements were measured through the core and top reflector. Fuel effect worth measurements and neutron moderating and absorbing material worths were also measured in the assembly fuel region. The cadmium ratios, fission rate, and worth measurements were evaluated for the International Reactor Physics Experiment Evaluation Project (IRPhEP) and are published in the International Handbook of Evaluated Reactor Physics Benchmark Experiments (IRPhEP Handbook)[5]. More recently, two additional critical configurations have been evaluated and added to the existing evaluation report in the ICSBEP Handbook. The new critical configurations measure the effect of filling the core with potassium. The critical configuration consisted of 30.48 cm tall fuel tubes of 93.15 wt.% enriched uranium dioxide (UO{sub 2}) pellets. Each fuel tube had 26 pellets with a total mass of 295.8 g UO{sub 2} per tube. There were 253 tubes were arranged with 1.506-cm center-to-center, triangular spacing and surrounded on all side by a beryllium reflected. The reactivity of the system was measured with the core tank empty and filled with potassium. The system reactivity was increased from 13.4 c to 32 c. This change in system reactivity represents the worth of the potassium. Simple benchmark models for the empty and potassium filled cores have been derived and evaluated and found to be acceptable as benchmark experiments. The benchmark experiment eigenvalues are 1.0001 ± 0.0008 and 1.0011 ± 0.0009 for the empty and filled cores, respectively. When calculated with MCNP5 and ENDF/B-VII.0 the calculated eigenvalues are 0.98906 ± 0.00002 and 0.98883 ± 0.00002, respectively. These results are concerning due to the drop of the calculated system reactivity when potassium is added to the system rather than the expected increase in system reactivity. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Evaluation of Pre- and Post- Redevelopment Groundwater Chemical Analyses from LM Monitoring Wells

This report documents the efforts and analyses conducted for the Applied Studies and Technology (AS&T) Ancillary Work Plan (AWP) project titled Evaluation of Pre- and Post- Redevelopment Groundwater Sample Laboratory Analyses from Selected LM Groundwater Monitoring Wells. This effort entailed compiling an inventory of nearly 500 previous well redevelopment events at 16 U.S. Department of Energy Office of Legacy Management (LM) sites, searching the literature for impacts of well redevelopment on groundwater sample quality, and—the focus of this report—evaluating the impacts of well redevelopment on field measurements and sample analytical results. Study Catalyst Monitoring well redevelopment, the surging or high-volume pumping of a well to loosen and remove accumulated sediment and biological build-up from a well, is considered an element of monitoring well maintenance that is implemented periodically during the lifetime of the well to mitigate its gradual deterioration. Well redevelopment has been conducted fairly routinely at a few LM sites in the western United States (e.g., the Grand Junction office site and the Gunnison processing site in Colorado), but at most other sites in this region it is not a routine practice. Also, until recently (2014–2015), there had been no specific criteria for implementing well redevelopment, and documentation of redevelopment events has been inconsistent. A catalyst for this evaluation was the self-identification of these inconsistencies by the Legacy Management Support contractor. As a result, in early 2015 Environmental Monitoring Operations (EMO) staff began collecting and documenting additional field measurements during well redevelopment events. In late 2015, AS&T staff undertook an independent internal evaluation of EMO's well redevelopment records and corresponding pre- and post-well-redevelopment groundwater analytical results. Study Findings Although literature discussions parallel the prevailing industry-wide assumption that well redevelopment is necessary to increase production or to extend the life of a well, no data in the literature indicate that redevelopment affects chemical signatures in monitoring wells. The comprehensive evaluation undertaken for this study also yielded no evidence that redevelopment has any quantifiable or predictable effect on groundwater sample quality. Both short-term and long-term changes in groundwater chemistry were assessed relative to preceding and subsequent well redevelopment events. Although short-term changes in specific conductance or contaminant concentrations likely attributable to well redevelopment were found at some sites, these cases were limited to a small subset of wells in which chemical stratification had been observed. Redevelopment causes mixing of the well water, resulting in short-term impacts, but not in a consistent direction. Long-term groundwater concentration trends of uranium, the primary contaminant of concern at most LM Uranium Mill Tailings Radiation Control Act (UMTRCA) sites, were evaluated for all 16 sites addressed in this study. Based on the data evaluated, there are no apparent impacts of well redevelopment on uranium trends. In most cases where deviations in trends were found, these could be attributed to water level fluctuations or other factors. A few exceptions were found where spikes or marked decreases in uranium concentrations could potentially be related to the preceding well redevelopment, but apparent impacts were neither predictable nor quantifiable. Summary and Recommendations A catalyst for this project was a concern that there was a need for strict criteria for a program-wide approach to well redevelopment at LM sites. There was also an implicit question as to whether well redevelopment was a necessary practice that was being overlooked at some sites. The primary objective of this study was to determine if there are significant differences in laboratory analytical results between pre- and post-redevelopment groundwater samples. Results of this evaluation indicate that this is not the case—groundwater concentrations of uranium, the primary contaminant of concern at most LM UMTRCA sites, generally remained unchanged pre- and post-well-redevelopment. The literature supports redevelopment of monitoring and municipal wells if signs of reduced productivity, biofouling, sediment buildup, or other conditions potentially affecting long-term well integrity are observed. In these cases, use of a downhole camera to examine the condition of the well screen and casing may be useful. However, based on the data sets examined for this study, there is no evidence that well redevelopment is needed in order to obtain samples that have the same chemical concentrations as those in the groundwater. To conclusively demonstrate that point—that is, to define chemical effects—the underlying mechanisms have to be understood. For example, if biofouling is observed in a well and is considered a potential cause of spurious or invalid chemical data, appropriate hypothesis-testing ethodology should be used to test the validity of this claim. Until late 2014, the onset of this project, there was no standard procedure for documenting well redevelopment events; some (perhaps many) had not been captured in the historical record. EMO has made notable progress in this regard since 2015, having established a format for documenting well redevelopment events and associated field measurements, as well as a data repository for capturing those records. This policy should be continued to ensure that all well redevelopment events and associated field observations are recorded and easily tracked.

54 ENVIRONMENTAL SCIENCES↗

Preliminary Content Evaluation of the North Anna High Burn-Up Sister Fuel Rod Segments for Transportation in the 10-160B and NAC-LWT

The U.S. Department of Energy’s (DOE’s) Used Fuel Disposition Campaign (UFDC) Program has transported high-burnup nuclear sister fuel rods from a commercial nuclear power plant for purposes of evaluation and testing. The evaluation and testing of high-burnup used nuclear fuel is integral to DOE initiatives to collect information useful in determining the integrity of fuel cladding for future safe transportation of the fuel, and for determining the effects of aging, on the integrity of UNF subjected to extended storage and subsequent transportation. The UFDC Program, in collaboration with the U.S. Nuclear Regulatory Commission and the commercial nuclear industry, has obtained individual used nuclear fuel rods for testing. The rods have been received at Oak Ridge National Laboratory (ORNL) for both separate effects testing (SET) and small-scale testing (SST). To meet the research objectives, testing on multiple 6 inch fuel rod pins cut from the rods at ORNL will be performed at Pacific Northwest National Laboratory (PNNL). Up to 10 rod equivalents will be shipped. Options were evaluated for multiple shipments using the 10-160B (based on 4.5 rod equivalents) and a single shipment using the NAC-LWT. Based on the original INL/Virginia Power transfer agreement, the rods are assumed to 152 inches in length with a 0.374-inch diameter. This report provides a preliminary content evaluation for use of the 10-160B and NAC-LWT for transporting those fuel rod pins from ORNL to PNNL. This report documents the acceptability of using these packagings to transport the fuel segments from ORNL to PNNL based on the following evaluations: enrichment, A2 evaluation, Pu-239 FGE evaluation, heat load, shielding (both gamma and neutron), and content weight/structural evaluation.

10-160B↗

Evaluation of Trenchless Installation Technology for Radioactive Wastewater Piping Applications

The U.S. Department of Energy (DOE) Office of Environmental Management (EM) cleanup mission at Oak Ridge National Laboratory (ORNL) includes dispositioning facilities, contaminated legacy materials/waste, and contamination sources and remediation of soil under facilities, groundwater, and surface water to support final Records of Decision (RODs). The Integrated Facilities Disposition Project (IFDP) is a roughly $15B project for completion of the EM mission at Oak Ridge, with a project duration of up to 35 years. The IFDP Mission Need Statement - Critical Decision-0 (CD-0) - was approved by DOE in July 2007, and the IFDP Alternative Selection and Cost Range - Critical Decision-1 (CD-1) - was approved in November 2008. The IFDP scope includes reconfiguration of waste collection and treatment systems as needed to complete the IFDP remediation and decontamination and decommissioning (D&D) missions in a safe and cost-effective manner while maintaining compliance with all governing regulations and bodies and preserving the support of continuing operations at ORNL. A step in the CD-1 approval process included an external technical review (ETR) of technical approaches proposed in the CD-1 document related to the facility reconfiguration for the ORNL radioactive waste and liquid low-level waste management systems. The ETR team recommended that the IFDP team consider the use of trenchless technologies for installing pipelines underground in and around contaminated sites as part of the alternatives evaluations required in support of the CD-2 process. The team specifically recommended evaluating trenchless technologies for installing new pipes in existing underground pipelines as an alternative to conventional open trench installation methods. Potential benefits could include reduction in project costs, less costly underground piping, fewer disruptions of ongoing and surface activities, and lower risk for workers. While trenchless technologies have been used extensively in the sanitary sewer and natural gas pipeline industries, they have been used far less in contaminated environments. Although trenchless technologies have been used at ORNL in limited applications to install new potable water and gas lines, the technologies have not been used in radioactive applications. This study evaluates the technical risks, benefits, and economics for installing gravity drained and pressurized piping using trenchless technologies compared to conventional installation methods for radioactive applications under ORNL geological conditions. A range of trenchless installation technologies was reviewed for this report for general applicability for replacing existing contaminated piping and/or installing new pipelines in potentially contaminated areas. Installation methods that were determined to have potential for use in typical ORNL contaminated environments were then evaluated in more detail for three specific ORNL applications. Each feasible alternative was evaluated against the baseline conventional open trench installation method using weighted criteria in the areas of environment, safety, and health (ES&H); project cost and schedule; and technical operability. The formulation of alternatives for evaluation, the development of selection criteria, and the scoring of alternatives were performed by ORNL staff with input from vendors and consultants. A description of the evaluation methodology and the evaluation results are documented in the following sections of this report.

03 NATURAL GAS↗

Overview of the OECD-NEA Working Party on International Nuclear Data Evaluation Cooperation (WPEC)

The OECD Nuclear Energy Agency (NEA) Working Party on International Nuclear Data Evaluation Cooperation (WPEC) was established in 1989 to facilitate collaboration in nuclear data activities. Over its thirty year history, different Subgroups have been created to address topics in nearly every aspect of nuclear data, including: experimental measurements, evaluation, validation, model development, quality assurance of databases and the development of software tools. WPEC has recently completed activities on fission yield evaluation, the general nuclear database structure (GNDS) to replace the ENDF-6 format, methods to provide feedback to evaluation, studies of specific capture cross sections, new methods in thermal scattering kernel evaluation and the Collaborative International Evaluated Library Organisation (CIELO) Pilot Project. Ongoing activities in GNDS application programming interface (API) development, methods for covariance evaluation and quality assurance in nuclear data validation using the International Criticality Safety Benchmark Evaluation Project (ICSBEP) database are complemented by the work of two Expert Groups that oversee the High-Priority Request List (HPRL) for Nuclear Data and the continuous development of the GNDS. New activities on the use of integral experiments for nuclear data validation and adjustment, as well as the use of the Shielding Integral Benchmark Archive and Database (SINBAD) for validation have begun and will be coordinated alongside future Subgroups. After three decades we will review the status of WPEC, how it integrates other collections and activities organised by the NEA and how it dovetails with the initiatives of the IAEA and other bodies to effectively coordinate international activities in nuclear data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Re-evaluating the prompt fission neutron spectrum of spontaneously fissioning 252 Cf

The prompt fission neutron spectrum (PFNS) of spontaneously fissioning 252 Cf is a Neutron Data Standards observable. Nearly all fission spectra of actinides were measured relative to it, using efficiencies derived from it, or analyzed with simulations validated by it. The current Standards evaluation was published by W. Mannhart in 1987. It could not be updated because the evaluation input, experimental mean values and covariances, were lost. First, we attempt to reproduce it. However, Mannhart’s evaluation can only be reproduced within its one-σ uncertainties as some of its aspects (e.g., experimental covariances, rejected data points) remain unknown. Therefore, a new evaluation is presented: We revisit all existing experimental 252 Cf(sf) PFNS data, including those published after the release of the current Standards evaluation, and re-estimate associated covariances. The newly evaluated 252 Cf(sf) PFNS differs distinctly from Mannhart’s below 300 keV and extends it to lower and higher outgoing neutron energies (500 eV–25 MeV). The new evaluated uncertainties are larger from 3–9 MeV and smaller otherwise. Spectrum averaged cross sections of importance to the International Reactor Dosimetry and Fusion File community calculated with the new spectrum are close to those calculated with Mannhart’s evaluation and agree with experimental values well within their uncertainties.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Quantitative Evaluation of Autonomous Driving in CARLA

There has been a great deal of recent advancements in end-to-end imitation and reinforcement learning for self-driving vehicles. Despite this, there is a severe lack of standardized metrics for evaluating the performance of autonomous self-driving agents. Existing metrics are generally lacking in their ability to capture a wide range of driving behaviors and compare the severity of different failure cases. In this work, we introduce the Quantitative Evaluation for Driving metric, or QED, which assigns a quantitative score from 0-100 that captures the quality of driving for any driving agent. Our QED metric assesses different aspects of driving behavior including the ability to stay in the center of the lane, avoid weaving and erratic behavior, follow the speed limit, and avoid collisions, and it can be used under a wide range of driving scenarios. To show the effectiveness of our QED metric, we compare the scores generated by QED against scores assigned by human evaluators on a total of 30 different drivers and 6 different towns in the CARLA driving simulator. In ``easy'' evaluation scenarios, where it is relatively straightforward to distinguish better drivers from worse drivers, QED attains an average Pearson correlation of 0.96 and average Spearman correlation of 0.97 when compared against human evaluators. In ``hard'' evaluation scenarios, where it is far more ambiguous how to rank/score different types of bad driving behavior, QED attains an average Pearson correlation of 0.82 and average Spearman correlation of 0.75 when compared against human evaluators, which are both slighter higher than when we compare human evaluators against each other. While QED may not capture every characteristic that defines good driving, we consider it an important foundation for reproducibility and standardization in the community.

Gao, Shang↗

TU-AB-303-07: Evaluation of Automatic Segmentation of Critical Structures for Head-And-Neck and Thoracic Radiotherapy Planning

Purpose: To evaluate the performance of commercially available automatic segmentation tools built into treatment planning systems (TPS) in terms of their segmentation accuracy and flexibility in customization. Methods: Twelve head-and-neck cancer patients and twelve thoracic cancer patients were retrospectively selected to benchmark the model-based segmentation (MBS) and atlas-based segmentation (ABS) in RayStation TPS and the Smart Probabilistic Image Contouring Engine (SPICE) in Pinnacle TPS. Multi-atlas contouring service (MACS) that was developed in-house as a plug-in of Pinnacle TPS was evaluated as well. Manual contours used in clinic were reviewed and modified for consistency and served as ground truth for the evaluation. Head-and-neck evaluation included six regions of interest (ROIs): left and right parotid glands, brainstem, spinal cord, mandible, and submandibular glands. Thoracic evaluation includes seven ROIs: left and right lungs, spinal cord, heart, esophagus, and left and right brachial plexus. Auto-segmented contours were compared with the manual contours using the Dice similarity coefficient (DSC) and the mean surface distance (MSD). Results: In head- and-neck evaluation, only mandible has a high accuracy in all segmentations (DSC>85%); SPICE achieved DSC>70% for parotid glands; MACS achieved this for both parotid glands and submandibular glands; and RayStation ABS achieved this for spinal cord. In thoracic evaluation, SPICE achieved the best in lung and heart segmentation, while MACS achieved the best for all other structures. The less distinguishable structures on CT images, such as brainstem, spinal cord, parotid glands, submandibular glands, esophagus, and brachial plexus, showed great variability in different segmentation tools (mostly DSC<70% and MSD>3mm). The template for RayStation ABS can be easily customized by users, while RayStation MBS and SPICE rely on the vendors to provide the templates/models. Conclusion: Great variability was observed in different segmentation tools applied to different structures. These commercially-available segmentation tools should be carefully evaluated before clinical use.

60 APPLIED LIFE SCIENCES↗