Search NASA⌕ Search

SEARCH · Search NASA

Results for “EVALUATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Post-Flight Back Pain Following International Space Station Missions: Evaluation of Spaceflight Risk Factors

INTRODUCTION Back pain during spaceflight has often been attributed to the lengthening of the spinal column due to the absence of gravity during both short and long-duration missions. Upon landing and re-adaptation to gravity, the spinal column reverts back to its original length thereby causing some individuals to experience pain and muscular spasms, while others experience no ill effects. With International Space Station (ISS) missions, cases of back pain and injury are more common post-flight, but little is known about the potential risk factors. Thus, the purpose of this project was to perform an initial evaluation of reported post-flight back pain and injury cases to relevant spaceflight risk factors in United States astronauts that have completed an ISS mission. METHODS All US astronauts who completed an ISS mission between Expeditions (EXP) 1 and 41 (2000-2015) were included in this evaluation. Forty-five astronauts (36 males and 9 females) completed 50 ISS missions during the study time period, as 5 astronauts completed 2 ISS missions. Researchers queried medical records of the 45 astronauts for occurrences of back pain and injury. A case was defined as any reported event of back pain or injury to the cervical, thoracic, lumbar, sacral, or coccyx spine regions. Data sources for the cases included the Flight Medicine Clinic's electronic medical record; Astronaut Strength, Conditioning and Rehabilitation electronic documentation; the Private Medical Conference tool; and the Space Medicine Operations Team records. Post-flight cases were classified as an early case if reported within 45 days of landing (R + 45) or a late case if reported from R + 46 to R + 365 days after landing (R + 1y). Risk factors in the astronaut population for back pain include age, sex, prior military service, and prior history of back pain. Additionally, spaceflight specific risk factors such as type of landing vehicle and onboard exercise countermeasures were included to evaluate their contribution to post-flight cases. Prior history of back pain included back pain recorded in the medical record within 3 years prior to launch. Landing vehicle was included in the model to discern if more astronauts experienced back pain or injury following a Shuttle or Soyuz landing. Onboard exercise countermeasures were noted for those astronauts who had a mission following 2009 deployment of the Advanced Resistive Exercise Device (aRED) (EXP 19 to 41). T-test and chi-squared tests were performed to evaluate the association between each individual risk factor and post-flight case. Logistic regression was used to evaluate the combined contribution of all the risk factors on post-flight cases. Separate models were calculated for cases reported by R + 45 and R + 1y. RESULTS During the study time period, there were 13 post-flight cases reported by R + 45 and an additional 5 reported by R + 1y. Most of these cases have been reported since EXP 19 with 10 cases by R + 45 and 4 by R + 1y. Individual risk factors of age, sex, landing vehicle, and prior military service were not significantly associated with post-flight cases identified at R + 45 or R + 1y (p greater than 0.05). Having back pain or injury within 3 years prior to launch significantly increased the likelihood of becoming a case by R + 1y (p = 0.041), but not at R+45 (p=0.204). Additionally, astronauts who experienced onboard exercise countermeasures that included aRED had a significantly increased risk of becoming a case at R + 45 (p = 0.024) and R + 1y (p=0.003). Multiple logistic regression evaluating all the risk factors for cases identified no significant risk factors at either the R + 45 or R + 1y time period (p greater than 0.05). Overall model fit was poor for both the R + 45 (R(exp 2) = 0.132) and R + 1y (R(exp 2) = 0.186) cases showing that there are risk factors not represented in our model. CONCLUSIONS Regardless of cause, post-flight cases are reported more often since aRED was deployed in 2009. This may reflect improved documentation or unidentified risk factors. No spaceflight risk factor explains the data fully. Post-flight cases are probably due to multi-faceted factors that are not easily elucidated in the medical data.

Laughlin, M. S.↗

2.5/3D Daisy Chain Reliability Evaluation

The objective of this task is to evaluate thermal cycle behavior of advanced 2.5/3D electronics — commercial-off the-shelf (COTS) —packages of different configurations assembled onto printed circuit boards (PCBs). Three key approaches were considered for evaluation. The first approach focused on the through-mold via (TMV™) technology at assembly level. The second approach focused on evaluation of 2.5D (also known as, System in Package (SiP)) in fine pitch ball grid array (FPGA). The third approach focused on evaluation of through-silicone-via (TSV) technologies. This report presents the test results for TMV™ and SiP packaging technologies and reliability, and it also provides lessons learned on quality assurance methods. Specifically, the report presents the test matrix for various 3D TMV™ packaging assembly configurations and reliability characterizations performed under two accelerated thermal cycling (ATC) and accelerated thermal shock cycling (ATSC) conditions. The ATC and ATSC were performed in the range of –55°C to 125°C and –100°C to 100°C, respectively. The report also includes assembly of a SiP— a 60-mm fine-pitch ball-grid array (FPGA) interposer with an IC at the center and six chip-scale package (CSP) daisy chains at the periphery—with package assembly characterizations. After assembly, the daisy chains were subjected to ATCs in the range of –40°C to 125°C for reliability evaluation. Finally, for both TMV™ and SiP packaging configurations, characterizations results by X-ray, optical imaging, and daisy-chain resistance evaluations were also presented.

Ghaffarian, Reza↗

Scheduling Improvements Following the Phase 1 Field Evaluation of the ATD-2 Integrated Arrival, Departure, and Surface Concept

NASA is conducting the Airspace Technology Demonstration-2 to evaluate an Integrated Arrival, Departure, and Surface (IADS) traffic management system that extends traffic sequencing for the entire life-cycle of a flight from departure gate to arrival gate within multi-airport, metroplex environments. After development and testing in human-in-the-loop simulations, the IADS system was deployed to Charlotte Douglas International Airport for a three-year field evaluation. From the initial IADS concept development through the end of the Phase 1 field evaluation many lessons were learned with regards to the IADS scheduler. In this paper we describe how data from the Phase 1 field evaluation helped identify scheduler improvements and guided the implementation of refinements. The improvements in the IADS scheduler described in this paper are incorporated into the IADS Phase 2 scheduler enabling strategic Surface Metering Programs and will be evaluated during the field evaluation.

Coupe, William J.↗

In-Flight Evaluation of the Traffic Aware Planner on the NASA HU-25A Guardian Aircraft

NASA’s Traffic Aware Planner (TAP) software is a research-prototype decision support tool that provides pilots with time- and fuel-saving route recommendations that optimize their current trajectory. The software runs on a first-of-a-kind system architecture onboard three aircraft in revenue service conducting operational evaluations with a major domestic airline. Therefore, significant NASA-internal testing is required prior to releasing the software to the partner airline. This paper describes a flight test plan that exercises the functionality of the TAP software in a representative operational environment, describes the system architecture developed and implemented for the NASA Langley HU-25A Guardian aircraft to support the test objectives, presents outcomes of the flight test campaign, and discusses use cases that demonstrate the value of flight testing for this activity.Research into flight path optimization of transport aircraft conducted by the National Aeronautics and SpaceAdministration (NASA) has produced an operational concept known as Traffic Aware Strategic Aircrew Requests(TASAR) [1, 2]. This near-term concept [3] provides the aircrew with a flight deck decision support tool known asthe Traffic Aware Planner (TAP). The TAP software leverages a growing number of information sources on the flightdeck to make time- and fuel-saving route optimization recommendations to the aircrew while en route. The aircrewcan then use the suggestions provided by the tool to make route change requests with a greater likelihood of acceptanceby air traffic control (ATC). Since TASAR is a concept intended for the current operational environment, it isintentionally designed to have no safety-critical impact or require any changes to current Federal AviationAdministration (FAA) rules and procedures [4, 5].The research prototype TAP system [6–8], explained further in Section III.C, continually incorporates up-to-dateaircraft state data from onboard avionics, as well as the latest position of surrounding traffic, the most recent windforecast, and the most recent convective weather forecast, in order to calculate candidate trajectory modifications thatimprove upon the current active route. These trajectories account for user-selectable objective functions [3] of reducedfuel burn, reduced flight time, or an airline-derived combination of factors known as trip cost. Previous analyses andsimulations have estimated substantial savings for airlines employing this technique within the U.S. National AirspaceSystem (NAS) [9–11]. Operational evaluations with Alaska Airlines seek to validate these projected benefits usingmeasured data while simultaneously providing benefits to the airline [12, 13].The TAP software has undergone a number of human-in-the-loop simulations [14] and flight test activities[15–17] in order to validate the operational concept, evaluate human factors considerations (e.g., workload, usability,distraction, etc.), and to assess the ability of the software to function in a representative operational environment (e.g.,connected to live avionics data, using in-flight internet connectivity, etc.). However, these simulations and flight testcampaigns did not account for the hardware architecture implemented on the three aircraft for Alaska Airlines’operational evaluations of the TAP software. Therefore, a need was identified to thoroughly test the functionality ofthe software in a similar hardware architecture to that of the partner airline’s aircraft. Information regarding testapparatus and environments used to evaluate TAP prior to testing on the HU-25A can be found in reference [18].A campaign of flight trials on a NASA aircraft, the HU-25A Guardian, was conducted to ensure that the researchprototype TAP system functions well in a configuration similar to the Alaska Airlines aircraft prior to deployment.This airborne, networked environment enables an assessment of the operational factors unique to the flight environment. Additionally, this activity evaluated the effectiveness and benefit of new TAP functionality andoperation in a relevant flight environment while allowing the rapid prototyping of new concepts and features.This paper is organized as follows: Section II discusses the details of the flight test plan, flight profiles, and theduties of personnel involved with conducting flight operations. Section III describes the test platform, avionicsequipage, and system architecture. Section IV presents a discussion of results, and Section V contains concludingremarks.

Underwood, Matthew C.↗

Evaluation methodology guidance for stack packages

This report provides evaluation methodology guidance based on previous National Aeronautics and Space Administration (NASA) reports and literature surveys for 3D stack packages and assemblies. Two aspects of technology are covered: the package itself (guidance for functional packages) and package assembly manufacturing and reliability. This work was funded by the NASA Electronic Parts and Packaging (NEPP) Program. The objectives of this NEPP project are to: Perform a literature survey of 3D stack technology; perform a literature survey on the evaluation methodology for 3D package and assembly; combine the two aspects to provide evaluation methodology for both aspects with consideration of interactions between package and assembly; generate guidance on the evaluation methodology for 3D stack package integrity prior to and after assembly; provide recommendations on future experimental activities. The qualification and evaluation methodology guidelines will facilitate NASA projects in effectively evaluating the reliability of very dense and newly available high-density 3D stack packages, allowing more processing power in a smaller board footprint and lower system weight.

Gerke, David↗

Towards an Aviation Large Language Model by Fine-tuning and Evaluating Transformers

In the aviation domain, there are many applications for machine learning and artificial intelligence tools that utilize natural language. For example, there is a desire to know the commonalities in written safety reports such as voluntary post incidents reports or aerial wildfire operations reports to better understand the risks present. Another use-case is the possibility of extracting airspace procedures and constraints currently written in documents such as Letters of Agreement. These applications can benefit from the use of state-of-the-art natural language processing techniques when adapted to the language/phraseology specific to the aviation domain. This paper evaluates the viability of adaptation of NLP tools to the aviation domain by fine-tuning transformer based models using aviation data sets. In 2018, a novel language model based on neural units (also called transformers) was created and became known as “Bidirectional Encoder Representations from Transformers” or BERT. This architecture combined with large amounts of English training data and innovative semi-supervised training tasks set the standard for what would later emerge as Large Language Models. The performance of these models was further improved by hyperparameter tuning and refinement of the semi-supervised training task and resulted in “Robustly Optimized BERT Pre-training Approach through hyperparameter tuning” or RoBERTa models. These pre-trained Large Language Models proved to be useful for a wide variety of natural language processing tasks such as text classification and question answering through a process called fine-tuning. The transformer architecture with pre-trained weights served as the basis with the last few layers replaced with layers fine-tuned to perform a new task e.g., a layer that provides a label for the entire input text. This process of fine-tuning can also be used to adapt the models to new domains; e.g., BioBERT started with the pre-trained BERT model and was completed by additional fine-tuning and training on biomedical documents. Transformer-based architectures can also be used to create rich representations of text called embeddings which can serve as the input to other machine learning models. This allows simpler algorithms such as logistic regression to use context-rich representations of the text while still remaining quick to train and evaluate. In the world of aviation, there is a growing demand for natural language processing and understanding but the domain presents unique challenges. Due to the technical content (and specialized language) of most aviation documents, fine-tuning pre-trained Large Language Models to specific tasks has not met the benchmark on natural language processing tasks set by simpler models trained from scratch on the data. To address this deficiency, this paper evaluates the improvements from fine-tuning a Large Language Model on a large set of aviation documents using the original semi-supervised training tasks before performing specific natural language tasks. In fine-tuning, a domain-specific dataset is used on the original training task but with the pre-trained Large Language Model instead of starting from a random initialization. This approach allows the model to be adapted to the specific domain language without discarding the information gained from training on general English data. This paper utilized two major dataset types to train and assess the RoBERTa fine-tuning performance. The first are 7,057 Letters of Agreement which are Federal Aviation Administration (FAA) documents that formalize airspace operations across the national airspace system. They contain many examples of ‘aviation English’ using domain specific terminology and phrasing which serves as a representative basis to perform the semi-supervised fine-tuning. The second type is the 494 document classification labels to be used for evaluation. This down-stream evaluation aims to show the performance of the fine-tuned model, better understand how much data is needed for an effective fine-tuning, and how fine-tuning can be adapted for different applications in-the domain. After semi-supervised training, evaluation begins by encoding the documents for classification using the fine-tuned RoBERTa model. Then a logistic regression classifier is trained to label the document type and compared against our ground truth labels. This currently leads to a 82.8% accuracy on 10-fold cross validation showing improvement over baseline RoBERTa which achieved 81.0%. We plan to measure the improvements on additional tasks and it is expected that these improvements will lead to more robust models that can tackle the natural language processing challenges present in aviation datasets.

ATM↗

Improving landscape-level environmental impact evaluations.

New spatial data and advancements in GIS tools allow much more comprehensive and quantitative analyses of the large datasets required when making programmatic evaluations of the ecological effects of proposed activities that cover a large area or region. Understanding the environmental impacts of proposed human developments is critical to making appropriate siting decisions and designing mitigation strategies to reduce impacts on important resources. Impact analyses conducted under the National Environmental Policy Act (NEPA) in Environmental Impact Statements (EISs) or Environmental Assessments (EAs) are intended to determine the resource-specific impacts of proposed activities of federal agencies and their alternatives using the best available information. Impacts to ecological resources are often a primary focus of these analyses. Information used in NEPA analyses include some measure of the known or probable presence of plants and wildlife in the project area, with special emphasis placed on threatened, endangered, and other special-status species. Site-specific information pertaining to ecological resources is usually easier to obtain for small-scale activities such as a local facility, road, or transmission upgrade project, where the ability to conduct fieldwork is more often feasible. However, site-specific data is more difficult-and sometimes impossible-to obtain for proposed activities that could affect a large area or region. These types of analyses often are considered in programmatic NEPA documents, in which a federal agency evaluates the implementation of a broad program or plan. Under these programmatic evaluations, the exact location and size of developments are often not known. Because obtaining quantitative information for ecological resources at such large spatial scales is difficult, programmatic impact evaluations typically rely on sketchy or partial information such as recorded species occurrences, species ranges, and general habitat descriptions. However, new spatial data and improved GIS tools allow much more comprehensive and quantitative analyses using large, readily available datasets. The availability of large-scale regional data such as GAP land-cover models or species habitat suitability models, combined with more robust spatial analysis procedures available through ArcGIS for Desktop software, allowed the analysis of multiple datasets at large spatial scales. This enabled researchers to surpass previous qualitative evaluations by developing a more accurate and quantitative approach for determining the environmental impacts of human activities at larger spatial scales. These approaches, combined with the utility of ModelBuilder and operability of Python scripts in ArcGIS, allow a more timely and cost-effective synthesis of available spatial data for programmatic evaluations and add a quantitative basis to environmental decision making.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Refinement of Modeling Techniques for the Structural Evaluation of Hanford Single-Shell Nuclear Waste Storage Tanks

Abstract: A total of 149 tanks out of 177 at the Hanford Site (in Washington State, USA) belong to the first generation of underground nuclear waste storage tanks known as single shell tanks (SSTs). These tanks were constructed between 1943 and 1964 and are well beyond their design life. All the SSTs had been removed from active service by November 1980 and have been later interim stabilized by removing the pumpable liquids. The remaining waste in the tanks is in the form of salt cake and sludge awaiting r permanent disposal.. The evaluation of the structural integrity of these tanks is of utmost importance not only for the continued safe storage of the waste until waste retrieval and closure, but also to assure safe retrieval and closure operations. This article discusses the structural analysis approach, modeling challenges and issues encountered during the ongoing analysis of record (AOR) for evaluating the structural integrity of the SSTs. There are several geometrical and material nonlinearities and uncertainties to be dealt with while performing the modern finite element analysis of these tanks. Several studies were conducted to refine the models in order to minimize modeling artifacts introduced by soil arching, boundary effects, concrete cracking, and concrete-soil interface behavior. The analysis takes into account the temperature history of the tanks and allowable mechanical operating loads of these tanks for proper estimation of creep strains and thermal degradation of material properties. The loads imposed in the AOR models also include anticipated loads that these tanks may see during waste retrieval and closure. Due to uncertainty in a number of inputs to the models, sensitivity studies were conducted to address questions related to the boundary conditions to realistically or conservatively represent the influence of surrounding tanks in a tank farm, the influence of backfill excavation slope, the extent of backfill and the total extent of undisturbed soil surrounding the backfill. The article also discusses the criteria and design standards used for evaluating the structural integrity of these underground concrete tanks. Because of the non-availability of complete data on the thermal and operating history for many of the individual tanks, some of the data was assumed or interpolated. However, the models developed for the analysis of record represent the bounding scenarios and include the worst and extreme loading cases that the tanks were subjected to or anticipated. The modeling refinement techniques followed in the AOR resulted in conservative estimates for force and moment demands at various sections in the concrete tanks. The SSTs are classified into 4 types as per their configuration and capacity. This article discusses the modeling aspects related to two types of SSTs that have been analyzed until now. The TOLA results combined with seismic demands from seismic analysis for the analysis of record indicate that the tanks analyzed are structurally stable as per the evaluation criteria established. These results are presented in a separate article. The modeling techniques, methodology and evaluation criteria developed for evaluating the structural integrity of SSTs at Hanford are in general applicable to any similar tanks or underground concrete storage structures.

Single Shell Tank, Structural analysis, Structural↗

An Approach for Assessing Development and Deployment Risks in the DOE Fuel Cycle Options Evaluation and Screening Study

Abstract One of the key objectives of the U.S. Department of Energy (DOE) Nuclear Energy R&D Roadmap is the development of sustainable nuclear fuel cycles that can improve natural resource utilization and provide solutions to the management of nuclear wastes. Recently, an evaluation and screening (E&S) of fuel cycle systems has been conducted to identify those options that provide the best opportunities for obtaining such improvements and also to identify the required research and development activities that can support the development of advanced fuel cycle options. In order to evaluate and screen the E&S study included nine criteria including Development and Deployment Risk (D&DR). More specifically, this criterion was represented by the following metrics: Development time, development cost, deployment cost from prototypic validation to first-of-a-kind commercial, compatibility with the existing infrastructure, existence of regulations for the fuel cycle and familiarity with licensing, and existence of market incentives and/or barriers to commercial implementation of fuel cycle processes. Given the comprehensive nature of the study, a systematic approach was needed to determine metric data for the D&DR criterion, and is presented here. As would be expected, the Evaluation Group representing the once-through use of uranium in thermal reactors is always the highest ranked fuel cycle Evaluation Group for this D&DR criterion. Evaluation Groups that consist of once-through fuel cycles that use existing reactor types are consistently ranked very high. The highest ranked limited and continuous recycle fuel cycle Evaluation Groups are those that recycle Pu in thermal reactors. The lowest ranked fuel cycles are predominately continuous recycle single stage and multi-stage fuel cycles that involve TRU and/or U-233 recycle.

Gehin, Jess C↗

GROWTH OF THE INTERNATIONAL CRITICALITY SAFETY AND REACTOR PHYSICS BENCHMARK EXPERIMENT EVALUATION PROJECTS SINCE ICNC 2011

Since the International Conference on Nuclear Criticality Safety (ICNC) 2011, the International Criticality Safety Benchmark Evaluation Project (ICSBEP) and the International Reactor Physics Experiment Evaluation Project (IRPhEP) have continued to expand their efforts. Twenty countries have continued to participate in the ICSBEP since 2011; participating countries in the IRPhEP have grown from 16 in 2011 to 20 in 2015. Since ICNC 2011, the contents of the International Handbook of Evaluated Criticality Safety Benchmark Experiments have increased from 533 evaluations (approximately 58,000 pages), containing benchmark specifications for 4,552 critical or subcritical configurations to 561 evaluations (approximately 67,000 pages), containing benchmark specifications for 4,839 critical or subcritical configurations in the 2014 Edition of the ICSBEP Handbook. While the current number of criticality-alarm-placement/shielding benchmark configurations has remained at 24, the number of fundamental physics measurements relevant to criticality safety applications has increased from 200 to 207. Since ICNC 2011, the contents of the International Handbook of Evaluated Reactor Physics Benchmark Experiments have increased from 53 experimental series that were performed at 31 different reactor facilities to 143 experimental series that were performed at 50 different reactor facilities in the 2015 Edition of the IRPhEP Handbook. The status of the ICSBEP and the IRPhEP is discussed and benchmarks that have been more recently added to the handbooks are highlighted.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Evaluating Indicators and Life Cycle Inventories for Processes in Early Stages of Technical Readiness

This presentation examines different methods for analyzing manufacturing processes in the early stages of technical readiness. Before developers know much detail about their processes, it is valuable to apply various assessments to evaluate their performance. One type of assessment evaluates performance indicators to describe how closely processes approach desirable objectives. Another type of assessment determines the life cycle inventories (LCI) of inputs and outputs for processes, where for a functional unit of product, the user evaluates the resources used and the releases to the environment. These results can be compared to similar processes or combined with the LCI of other processes to examine up-and down-stream chemicals. The inventory also provides a listing of the up-stream chemicals, which permits study of the whole life cycle. Performance indicators are evaluated in this presentation with the U.S. Environmental Protection Agency's GREENSCOPE (Gauging Reaction Effectiveness for ENvironmental Sustainability with a multi-Objective Process Evaluator) methodology, which evaluates processes in four areas: Environment, Energy, Economics, and Efficiency. The method develops relative scores for indicators that allow comparisons across various technologies. In this contribution, two conversion pathways for producing cellulosic ethanol from biomass, via thermochemical and biochemical routes, are studied. The information developed from the indicators and LCI can be used to inform the process design and the potential life cycle effects of up- and down-stream chemicals.

09 BIOMASS FUELS↗

Testing and Evaluation of Passive Radiation Detection Equipment for Homeland Security

This article is concerned with test and evaluation methods for passive radiation detection equipment used in homeland security applications. The different types of equipment used in these applications are briefly reviewed and then test and evaluation methods discussed. The primary emphasis is on the test and evaluation standards developed by the American National Standards Institute’s N42 committees. Commonalities among the standards are then reviewed as well as examples of unique aspects for specific equipment types. Throughout, sample test configurations and results from testing and evaluation at Oak Ridge National Laboratory are given. The article concludes with a brief discussion of typical tests and evaluations not covered by the N42 standards and some examples of test and evaluation that involve the end users of the equipment.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

An Integrated Sustainability Evaluation of Indirect Liquefaction of Biomass to Liquid Fuels

Developing a more sustainable biofuel production process holds the key for displacing fossil fuels with biofuels for sustainable greenhouse gas emissions and natural resource consumption mitigation. A holistic sustainability analysis for the production of biofuel plays a critical role on the improvement of the overall life cycle sustainability. Once a conceptual conversion process is developed, the next step is to evaluate its overall sustainability, preferably based on a process sustainability evaluation methodology using various indicators. The EPA's GREENSCOPE methodology evaluates processes in four areas: environment, energy, economics, and efficiency. The method develops relative scores for indicators that allow comparisons across various technologies. In this study, we have implemented GREENSCOPE methodology for a sustainability performance assessment of NREL's indirect liquefaction of biomass to high-octane gasoline blendstock by evaluating a range of metrics beyond the typical minimum fuel selling price and greenhouse gas considerations. We applied this methodology to evaluate the sustainability performance of this gate-to-gate conceptual design. One outcome of the sustainability evaluation is to allow researchers to identify process areas in need of sustainability improvement, as well as the challenges and opportunities for achieving the best possible sustainability target.

09 BIOMASS FUELS↗

EVALUATION OF ENHANCED ACCIDENT TOLERANT FUELS

The U.S. Department of Energy Advanced Fuels Campaign (AFC) is currently funding research and development on a number of fuel technologies for light water reactors (LWRs) that could provide enhanced performance under accident scenarios relative to the current zirconium alloy-uranium dioxide (UO2) fuel system. The overall mission of the accident tolerant fuel (ATF) research is to develop advanced fuels/cladding with improved performance, reliability and safety characteristics during normal operations and accident conditions, while minimizing waste generation. Evaluating the performance of candidate accident tolerant fuel concepts is a topic of significant discussion among researchers, fuel vendors and utilities to ensure that the developed concepts can meet minimum performance and economic requirements, can be developed within a reasonable time, and can be approved for insertion as a lead fuel rod in a commercial reactor by the 2022 goal. Characterizing the performance enhancements of candidate ATF first requires understanding the performance of the current Zr-UO2 system under equivalent operations and accident scenarios. Proper evaluation of each concept is dependent on development of data through focused out-of-pile and in-core experiments to support modeling of the fuel and cladding behavior in fuel performance and systems analysis codes; complimentary irradiation of ATF concepts will be discussed in a separate paper. This paper will provide an overview of the key evaluation tools and evaluation scenarios currently being considered within the LWR community for ATF. The evaluation toolset includes standard neutronic and thermal-hydraulic analysis for normal operating conditions and transient/accident conditions and analysis of severe accident behavior using a modified version of the MELCOR code. Development of advanced fuel performance analysis using the BISON application based on the Multi-physics Object-Oriented Simulation Environment (MOOSE) environment at Idaho National Laboratory (INL) has also been initiated. Evaluation scenarios (e.g. accident scenarios) currently being discussed for use across the international ATF development teams are also presented.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Bayesian Monte Carlo Evaluation Framework for Imperfect Data and Models [Abstract]

Nuclear data evaluation methods conventionally make the following assumptions: prior and posterior probability distribution functions (PDFs) of all model parameters and data are normal (Gaussian); the linear approximation is sufficiently accurate for minimization of a cost function (even for non-linear models); and that both the model (of, e.g., neutron cross section) and experimental data (including their covariance data) are perfect. These assumptions are inherent to the well-known generalized linear least squares (GLLS) minimization method commonly used for evaluations of resolved resonance region (RRR) neutron cross sections. However, these assumptions are often not justified due to the presence of non-normal PDFs, non-linear models (e.g. R -matrix formalism), and inherent imperfections in data and models (e.g. discrepant data sets, discrepancies between the previous evaluation and newly measured data, or imperfect covariance data). We remove the said assumptions in a mathematical framework of Bayes’ theorem, and implement it using the Metropolis-Hastings Monte Carlo method. Parameters of a new kind are introduced to parameterize inherent imperfections, e.g. , any discrepancies between the theoretical model and measured data. These new parameters enable evaluators to quantify their expert judgement about any discrepancies or imperfections in a reproducible manner. We demonstrate the framework with an ongoing evaluation of 233 U in the eV region using the ENDF-B/VIII library and transmission data measured by Guber, et al. , and compare the posterior parameters to those obtained by conventional evaluation methods.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Using High-Resolution NSRDB Data to Evaluate Cloud Mask Forecast from WRF-Solar EPS

Validating spatiotemporal distributions of cloud forecasts using numerical weather prediction (NWP) models is difficult as this requires high-quality cloud-property at significantly high spatial and temporal resolution over extended periods of time. Observations of cloud properties, such as cloud mask, cloud optical thickness, and cloud type, are vital for assessing the capability of NWP models to forecast various types of clouds. Using the National Solar Radiation Database (NSRDB), this research evaluates ensemble cloud-mask predictions from the WRF-Solar ensemble prediction system (WRF-Solar EPS). From the WRF-Solar EPS, day-ahead solar forecasts for the contiguous United States (CONUS) for 2018 are simulated. Given the NSRDB data is accessible at a resolution of 2 km, we can calculate the cloud fraction across the 9-km grid of WRF-Solar EPS. This allows us to spatially assess the cloud-mask forecasts using two methods against the high-resolution NSRDB: (a) considering all 2-km NSRDB clouds in the forecast domain (EMAll), and (b) using a minimum cloud fraction threshold of 50% to designate a pixel as cloudy (EMP50). The low-resolution cloud masks from WRF-Solar EPS are evaluated directly against the cloud-resolving scale gridded observations from NSRDB using EMAll. With EMP50, we presume that scenes with less than 50% cloud cover from the 2-km NSRDB are clear. Thus, this assessment approach allows for a fair comparison with WRF-Solar EPS resolved to a 9-km grid. A method of point-by-point verification is used to evaluate dichotomous (yes/no) cloud mask predictions against the NSRDB. For each pixel of model extent, cloud frequency and traditional metrics (e.g., probability of detection, false alarm rate, and hit rate, etc.) are computed and compared with satellite-derived data sets. Mismatched cloud frequency (MCF) is computed to measure the present capability of WRF-Solar EPS in representing various types of clouds, which are categorized using three levels of cloud top height (CTH) and cloud optical depth (COD) across entire CONUS. Preliminary results show that the WRF-Solar EPS provides MCF values ranging from 9% to 46%, 16% to 33%, and 8% to 27% for low-level, middle-level, and high-level clouds, respectively, for three CTHs. The model produces MCFs ranging from 27% to 46%, 13% to 34%, and 8% to 19% for thin, medium-thickness, and thick clouds, respectively, for three CODs. The presentation will include a detailed description of the current outcomes as well as potential future extensions. The evaluation approach established in this study is readily extensible to the evaluation of cloud predictions from different ensemble NWP models. In addition, the findings of the suggested evaluation technique aid in identifying model weaknesses and will ultimately lead to advances in WRF-Solar EPS's skill in predicting clouds and solar irradiance.

cloud mask forecast↗

Preliminary evaluation of removing used nuclear fuel from shutdown sites - 15568

A preliminary evaluation of removing spent nuclear fuel (SNF) from 12 shutdown nuclear power reactor sites was conducted. At these shutdown sites the nuclear power reactors have been permanently shut down and the sites have been decommissioned or are undergoing decommissioning. The shutdown sites were Maine Yankee, Yankee Rowe, Connecticut Yankee, Humboldt Bay, Big Rock Point, Rancho Seco, Trojan, La Crosse, Zion, Crystal River, Kewaunee, and San Onofre. The evaluation was divided into four components: (1) characterization of the SNF and greater-than-Class C low-level radioactive waste (GTCC waste) inventory, (2) a description of the on-site infrastructure and conditions relevant to transportation of SNF and GTCC waste, (3) an evaluation of the near-site transportation infrastructure and experience relevant to shipping transportation casks containing SNF and GTCC waste, including identification of gaps in information, and (4) an evaluation of the actions necessary to prepare for and remove SNF and GTCC waste. Every site was found to have at least one off-site transportation mode option for removing its SNF and GTCC waste; some have multiple options. Experience removing large components during reactor decommissioning provided an important source of information used to identify the transportation mode options for the sites. Especially important in conducting the evaluation were site visits, through which information was obtained that would not have been available otherwise. Extensive photographs taken during the site visits proved to be particularly useful in documenting the current conditions at or near the sites. It is expected that additional site visits will be conducted to add to the information presented in the evaluation. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Nevada National Security Site (NNSS) Environmental Remediation Using EPA's Model Evaluation Guidance to Move to Closure - 15588

The National Nuclear Security Administration Nevada Field Office (NNSA/NFO) has adapted the Environmental Protection Agency's guidance on environmental model evaluation as a framework for evaluating corrective action investigation models. Model evaluation is an important confidence building activity, which is needed to support closure of the Nevada National Security Site (NNSS) Corrective Action Units (CAUs) associated with underground nuclear testing. Through this process, site-investigation models of groundwater flow and contaminant transport are reviewed and compared to new site-specific data to determine if the results can be used to support regulatory decisions required for closure and to achieve NNSA/NFO site management objectives. The regulatory decisions include identifying and establishing CAU regulatory boundaries; identifying institutional controls, including use-restriction boundaries; and developing a long-term closure monitoring program. A successful case study from Frenchman Flat, Nevada is used to illustrate the model evaluation process. Groundwater flow and transport from two of the 10 underground nuclear tests in Frenchman Flat had the largest potential for contaminating groundwater, and were selected for evaluation. Wells were drilled, logged, hydraulically tested, sampled, and analyzed for radionuclides and the data was evaluated with respect to previous site conceptualization and numerical model results. The approach and results of this process as applied to the PIN STRIPE test and how it helped build confidence to close the Frenchman Flat CAU is described in this case study. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗