Search NASA⌕ Search

SEARCH · Search NASA

Results for “EVALUATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

Commercial Smallsat Data Acquisition Program On-ramp #2 Airbus U.S. Synthetic Aperture Radar (SAR) Evaluation Report

In 2017, NASA’s Earth Science Division (ESD) launched the Private-Sector Small Constellation Satellite Data Product Pilot, now referred to as the Commercial Smallsat Data Acquisition (CSDA) program. The objective of CSDA is to identify, evaluate, and acquire commercial remote sensing data that support NASA’s Earth science research and application activities. The Pilot successfully concluded in early 2020, when CSDA transitioned into a sustained program with on-ramping opportunities for new vendors as the industry emerges with new candidates and capabilities. In October 2019, a Request for Information (RFI) seeking capability statements from parties interested in providing data from spaceborne platforms was released for the CSDA on-ramp #2 evaluations. To be responsive to the RFI, the commercial satellite constellations had to consist of three or more operating spacecraft actively collecting data in a non-geostationary orbit with full latitudinal coverage and be U.S. companies. Two vendors responded to the RFI and were evaluated by a committee composed of NASA ESD leadership, program managers, and scientists. Both vendors satisfied the RFI requirements and were asked to respond to a Request for Proposal (RFP). After review of the proposals, NASA entered into a Blanket Purchase Agreement (BPA) with Airbus Defense and Space GEO, Inc. (Airbus) U.S. in September 2021 and with BlackSky Geospatial Solutions, Inc. (BlackSky) in November 2021. In this report, CSDA provides an evaluation of the usefulness of data provided by the Airbus U.S. Synthetic Aperture Radar (SAR) satellite constellation, consisting of TerraSAR-X (launched in 2007), TanDEM-X (launched in 2010), and PAZ (launched in 2018), for advancing NASA’s Earth system science research and applications. The evaluation of the BlackSky commercial data will be provided in a separate report. To conduct the Airbus evaluation, NASA’s ESD augmented 13 existing research projects that could potentially benefit from, and had the expertise to evaluate, the commercial data being considered for longer-term purchase. Investigators from NASA’s Research and Analysis Program science focus areas and from NASA’s Applied Sciences Program elements participated in the evaluation. A summary of the research areas evaluated by the Principal Investigator (PI) teams is presented in Figure 3. CSDA also funded a dedicated activity to evaluate the satellite data quality (calibration and geolocation) independently by assessing the accuracy of data from Airbus. Evaluation activities were carried out by the selected PIs from December 7, 2022, to December 7, 2023. Delivery of datasets requested by the researchers began in January 2023. The vendors were evaluated on the accessibility of data, accuracy and completeness of metadata, and promptness and quality of user support services. Datasets purchased during the evaluation have been archived by NASA and will be made available to current and future government-funded researchers in accordance with the End User License Agreement (EULA). This synthesis report distills and integrates the findings of research reports commissioned by NASA for the Airbus evaluation. This report also includes recommendations that inform the way ahead for the program. The scientific results from the evaluations demonstrated that the commercial data from Airbus were able to advance NASA research and applications. However, the PIs encountered limitations that diminished the usefulness of the data due to the amount of effort that was required to access, preprocess, and analyze these data. One significant issue encountered was the limited spatial and temporal coverage of the data in the Airbus archive that could be used to conduct time series analyses or assessments over large spatial scales. Overall, however, the utility and the quality of the evaluated data outweighed the difficulties encountered, and NASA has concluded that the Airbus SAR data would complement NASA’s existing Earth observation capabilities and Airbus U.S. would qualify to participate in the sustained phase of the program.

Batuhan Osmanoglu↗

EVALUATION OF SOLID SORBENTS AS A RETROFIT TECHNOLOGY FOR CO2 CAPTURE FROM COAL-FIRED POWER PLANTS

Through a U.S. Department of Energy (DOE) National Energy Technology Laboratory (NETL) funded cooperative agreement DE-NT0005649, ADA Environmental Solutions (ADA) has begun evaluating the use of solid sorbents for CO{sub 2} capture. The project objective was to address the viability and accelerate development of a solid-based CO{sub 2} capture technology. To meet this objective, initial evaluations of sorbents and the process/equipment were completed. First the sorbents were evaluated using a temperature swing adsorption process at the laboratory scale in a fixed-bed apparatus. A slipstream reactor designed to treat flue gas produced by coal-fired generation of nominally 1 kWe was designed and constructed, which was used to evaluate the most promising materials on a more meaningful scale using actual flue gas. In a concurrent effort, commercial-scale processes and equipment options were also evaluated for their applicability to sorbent-based CO{sub 2} capture. A cost analysis was completed that can be used to direct future technology development efforts. ADA completed an extensive sorbent screening program funded primarily through this project, DOE NETL cooperative agreement DE-NT0005649, with support from the Electric Power Research Institute (EPRI) and other industry participants. Laboratory screening tests were completed on simulated and actual flue gas using simulated flue gas and an automated fixed bed system. The following types and quantities of sorbents were evaluated: 87 supported amines; 31 carbon based materials; 6 zeolites; 7 supported carbonates (evaluated under separate funding); and 10 hydrotalcites. Sorbent evaluations were conducted to characterize materials and down-select promising candidates for further testing at the slipstream scale. More than half of the materials evaluated during this program were supported amines. Based on the laboratory screening four supported amine sorbents were selected for evaluation at the 1 kW scale at two different field sites. ADA designed and fabricated a slipstream pilot to allow an evaluation of the kinetic behavior of sorbents and provide some flexibility for the physical characteristics of the materials. The design incorporated a transport reactor for the adsorber (co-current reactor) and a fluidized-bed in the regenerator. This combination achieved the sorbent characterization goals and provided an opportunity to evaluate whether the potential cost savings associated with a relatively simple process design could overcome the sacrifices inherent in a co-current separation process. The system was installed at two field sites during the project, Luminant's Martin Lake Steam Electric Station and Xcel Energy's Sherburne County Generating Station (Sherco). Although the system could not maintain continuous 90% CO{sub 2} removal with the sorbents evaluated under this program, it was useful to compare the CO{sub 2} removal properties of several different sorbents on actual flue gas. One of the supported amine materials, sorbent R, was evaluated at both Martin Lake and Sherco. The 1 kWe pilot was operated in continuous mode as well as batch mode. In continuous mode, the sorbent performance could not overcome the limitations of the cocurrent adsorbent design. In batch mode, sorbent R was able to remove up to 90% CO{sub 2} for several cycles. Approximately 50% of the total removal occurred in the first three feet of the adsorption reactor, which was a transport reactor. During continuous testing at Sherco, CO{sub 2} removal decreased to approximately 20% at steady state. The lack of continuous removal was due primarily to the combination of a co-current adsorption system with a fluidized bed for regeneration, a combination which did not provide an adequate driving force to maintain an acceptable working CO{sub 2} capacity. In addition, because sorbent R consisted of a polymeric amine coated on a silica substrate, it was believed that the 50% amine loaded resulted in mass diffusion limitations related to the CO{sub 2} uptake rate. Three additional supported amine materials, sorbents AX, F, and BN, were selected for evaluation using the 1 kW pilot at Sherco. Sorbent AX was operated in batch mode and performed similarly to sorbent R (i.e. could achieve up to 90% removal when given adequate regeneration time). Sorbent BN was not expected to be subject to the same mass diffusion limitations as experienced with sorbent R. When sorbent BN was used in continuous mode the steady state CO{sub 2} removal was approximately double that of sorbent R, which highlighted the importance of sorbents without kinetic limitations.

01 COAL, LIGNITE, AND PEAT↗

Objective Structured Clinical Evaluation (OSCE) of an Artificial Intelligence (AI) Clinical Decision Support System (CDSS) Tool

BACKGROUND Objective Structured Clinical Evaluations (OSCEs) have long been established as a robust methodology for summative assessment of clinical skills and decision-making during medical education. The recent integration of Artificial Intelligence (AI) into clinical decision-making processes has prompted the need for novel evaluation frameworks to assess the efficacy and reliability of AI clinical decision support system (CDSS) tools. This abstract outlines the process of quantitatively evaluating a novel CDSS (“Doc in a Box” Google 2024) trained on curated medical spaceflight data in the psychomotor domain as it interfaces with a human volunteer acting as the crew medical officer (CMO). PURPOSE The AI CDSS under review was developed as part of the Lunar Command and Control Interoperability (LuCCI) project, which is intended to address a gap in how Lunar Surface Systems (LSS) would interoperate across multiple programs, commercial partners, and international partners. The project objective is to define, prototype, integrate, and evaluate an interoperable lunar command, control, data, and software reference architecture to enable autonomy and informatics capability through common standards across LSS. A multi-modal AI-based CDSS compatible with Federated LSS will assist clinicians in diagnosing and managing complex medical conditions by providing evidence-based recommendations through predictive analytics. Given the critical role of decision-support as NASA continues to evolve its Earth-independent medical operations (EIMO), it is imperative to ensure that such AI tools perform reliably and align with clinical standards during progressive lunar and Martian exploration class missions. METHODS The OSCE framework, traditionally used for evaluating human clinicians, was adapted to assess the AI tool's decision-making capabilities in simulated clinical scenarios. In this adapted OSCE, the AI CDSS was tested across a series of structured clinical scenarios designed to mimic real-life spaceflight patient cases. These scenarios included a range of conditions and complexities, allowing for comprehensive assessment of the tool's performance. Key evaluation metrics included accuracy of diagnosis, timeliness of decision-making, and appropriate recommendations for therapies. The OSCE was scored by human physician evaluators who assessed the AI's recommendations in comparison with expert clinicians' medical decision making to ensure alignment with best practices and the standard of care. RESULTS Preliminary results indicate that the AI CDSS demonstrated high accuracy in diagnostic recommendations and decision support across various scenarios. However, certain limitations were noted, such as occasional discrepancies in handling complex or nuanced cases that required a more contextual understanding. Additionally, the tool scored higher on the diagnostic portion of the rubric, with lower scores in the therapeutic recommendations. These findings highlight the importance of continuous refinement and validation of AI tools through rigorous evaluation frameworks like the OSCE. The adaptation of OSCEs for AI tools presents several advantages, including a structured and reproducible approach to evaluation, the ability to test AI systems in diverse clinical scenarios, and the opportunity to benchmark AI performance against established clinical standards to permit charting of future progress as aerospace medicine evolves as a discipline. Remaining challenges include ensuring that these evaluations capture the full spectrum of clinical decision-making scenarios that will be confronted by CMOs during missions and adequately reflecting real-world variability of the austere spaceflight environment. CONCLUSION Employing OSCEs to evaluate AI clinical decision support tools offers a promising approach to validating their clinical utility and efficacy. This methodology not only provides insights into the tool's performance but also fosters ongoing improvement and alignment with standard of care practices. Future research should focus on refining these evaluation processes and addressing limitations to enhance the integration of AI tools in clinical spaceflight settings. REFERENCES Scott S, Hearns V, Barker MA. Testing Clinical Skills: A Look at the OSCE and USMLE Clinical Skills Exams. S D Med. 2019 Oct;72(10):451-453. Majumder MAA, Kumar A, Krishnamurthy K, Ojeh N, Adams OP, Sa B. An evaluative study of objective structured clinical examination (OSCE): students and examiners perspectives. Adv Med Educ Pract. 2019 Jun 5;10:387-397. Karam VY, Park YS, Tekian A, Youssef N. Evaluating the validity evidence of an OSCE: results from a new medical school. BMC Med Educ. 2018 Dec 20;18(1):313.

Ariana M Nelson↗

A framework for evaluating the accessibility of raw materials from end-of-life products and the Earth’s crust

Highlights: • Defined and conceptualised raw material accessibility. • Applied concept extraction in raw material management. • Developed a framework for evaluating raw material accessibility. •Carried out an evaluation with End-of-Life products and natural deposits. • Developed an early project stage evaluation for accessing raw materials. - Abstract: An increasing number of geochemically scarce metallic raw materials are entering into our lives via new technologies. A reversal of this trend is not foreseeable, leading to concerns regarding the security of their supply. However, the evaluation of raw material supply is currently hampered by inconsistent use of fundamental terminologies and incomplete assessment criteria. In this paper, we aim to establish a consistent framework for evaluating raw material supply from both anthropogenic and geological sources. A method for concept extraction was applied to evaluate systematically the use of fundamental terms in the evaluation of raw material supply. The results have shown that ‘availability’ is commonly used in raw material supply evaluations, whilst other researchers suggest that raw material supply should be evaluated based on ‘accessibility’. It was revealed that ‘accessibility’ actually comprises two aspects: ‘availability’ and ‘approachability’. Raw material ‘approachability’ has not previously been explicitly addressed at a system level. A novel, consistent framework for evaluating raw material supply was therefore developed. To demonstrate the application of the established framework, we evaluated the raw material supply of four rare earth element case studies. Three case studies are End-of-Life products (the anthroposphere) from Switzerland: (i) phosphors in fluorescent lamps, (i) permanent magnets in the drive motors of electric cars and (iii) fibre optic cable. The fourth case study source is the Earth’s crust (the geosphere): Mount Weld deposit in Australia. The framework comprises a comprehensive evaluation of six components relating to raw material mining and processing: their geological knowledge, eligibility, technology, economic, societal and environmental impacts. Our results show that metals are not considered to be fully accessible in any of the case studies due to a lack of necessary technologies and potential societal and environmental impacts. The framework presented here can serve as a starting point for the development of an evaluation framework for raw material accessibility at an early project development stage.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Evaluation of Visualization Heuristics

Heuristics have been used since the early 1990's in the Human Computer Interaction (HCI) domain, for evaluating user interfaces. Most notably, heuristics developed by Nielsen and Molich (1990) have been used by the HCI community. Forsell and Johansson (2010) used the same methodology as Nielsen and Molich and developed a set of 10 heuristics for information visualization. Currently, neither the information visualization or the visual analytics community has adopted these heuristics. However, several studies have been conducted using heuristics. Hearst et al. (2015) found that using the heuristics for visualizations along with asking questions about the data resulted in complementary results as the questions about the data could compensate for heuristics that were difficult to understand and apply. Heli Väätäjä et al. (2016) found that heuristics related to interaction, veracity, and aesthetics needed to be added to the Forsell and Johansson (2010) set. They also noted that a lack of domain knowledge caused the evaluators issues in conducting a heuristic evaluation. We conducted a controlled experiment to determine what factors might impact the expert evaluators' capability to conduct a heuristic evaluation of a static information visualization. In particular, we wanted to understand how their familiarity with the visualizations and their experience in conducting heuristic evaluations impacted their evaluations of visualizations. We recruited 10 participants who were domain experts in the visualization field each having experience with one of more of the following: user experience design or research, user interface development, and human computer interaction research. We used a heuristic set proposed by Forsell and Johansson. Participants were also asked to complete a demographic survey in which they rated their experience with each visualization type generally, their experience conducting heuristic evaluations, their experience using each visualization type to extract information, and their experience developing and creating each visualization type. The participants were shown a series of 5 common visualizations (Scatterplots, Sunbursts, Tree Maps, Parallel Sets, and Area Graphs) all displaying the VAST 2008 Mini Challenge Two- Migrant Boats data . Participants were given a suggested analytical question related to each visualization to keep in mind as they applied the 10 heuristics to each visualization. They were asked if they could find any usability problems in the visualizations and which heuristic(s) helped them to identify these problems. The participants were asked to rate how relevant each heuristic was for evaluating each visualization along with rating how confident they felt in their ability to apply the heuristic to evaluate each visualization. At the conclusion of the study, participants provided qualitative feedback on the usability issues of each visualization. Additionally, we collected eye tracking data on 6 of the 10 participants. We will be using this data to determine how long participants looked at the various visualizations and what parts of the visualizations they focused on. We had two hypotheses for this empirical evaluation: 1.The Forsell and Johansson heuristics of Orientation and help, Data set reduction, and Prompting are less useful for static visualizations because they require some interaction in order to test completely. 2.Participants that do not have experience with heuristic evaluation will provide lower evaluation scores for the heuristics compared to those that have experience. Related to hypothesis 1, as our study used only static visualizations, interaction-related usability challenges should be harder to identify. This should result in lower usefulness ratings for those heuristics. Preliminary results indicate that participants found it more difficult to apply heuristics to unfamiliar visualizations.

Williams, Ryan G.↗

Review of Evaluation, Measurement and Verification Approaches Used to Estimate the Load Impacts and Effectiveness of Energy Efficiency Programs

Public and private funding for end-use energy efficiency actions is expected to increase significantly in the United States over the next decade. For example, Barbose et al (2009) estimate that spending on ratepayer-funded energy efficiency programs in the U.S. could increase from $3.1 billion in 2008 to $7.5 and 12.4 billion by 2020 under their medium and high scenarios. This increase in spending could yield annual electric energy savings ranging from 0.58% - 0.93% of total U.S. retail sales in 2020, up from 0.34% of retail sales in 2008. Interest in and support for energy efficiency has broadened among national and state policymakers. Prominent examples include {approx}$18 billion in new funding for energy efficiency programs (e.g., State Energy Program, Weatherization, and Energy Efficiency and Conservation Block Grants) in the 2009 American Recovery and Reinvestment Act (ARRA). Increased funding for energy efficiency should result in more benefits as well as more scrutiny of these results. As energy efficiency becomes a more prominent component of the U.S. national energy strategy and policies, assessing the effectiveness and energy saving impacts of energy efficiency programs is likely to become increasingly important for policymakers and private and public funders of efficiency actions. Thus, it is critical that evaluation, measurement, and verification (EM&V) is carried out effectively and efficiently, which implies that: (1) Effective program evaluation, measurement, and verification (EM&V) methodologies and tools are available to key stakeholders (e.g., regulatory agencies, program administrators, consumers, and evaluation consultants); and (2) Capacity (people and infrastructure resources) is available to conduct EM&V activities and report results in ways that support program improvement and provide data that reliably compares achieved results against goals and similar programs in other jurisdictions (benchmarking). The National Action Plan for Energy Efficiency (2007) presented commonly used definitions for EM&V in the context of energy efficiency programs: (1) Evaluation (E) - The performance of studies and activities aimed at determining the effects and effectiveness of EE programs; (2) Measurement and Verification (M&V) - Data collection, monitoring, and analysis associated with the calculation of gross energy and demand savings from individual measures, sites or projects. M&V can be a subset of program evaluation; and (3) Evaluation, Measurement, and Verification (EM&V) - This term is frequently seen in evaluation literature. EM&V is a catchall acronym for determining both the effectiveness of program designs and estimates of load impacts at the portfolio, program and project level. This report is a scoping study that assesses current practices and methods in the evaluation, measurement and verification (EM&V) of ratepayer-funded energy efficiency programs, with a focus on methods and practices currently used for determining whether projected (ex-ante) energy and demand savings have been achieved (ex-post). M&V practices for privately-funded energy efficiency projects (e.g., ESCO projects) or programs where the primary focus is greenhouse gas reductions were not part of the scope of this study. We identify and discuss key purposes and uses of current evaluations of end-use energy efficiency programs, methods used to evaluate these programs, processes used to determine those methods; and key issues that need to be addressed now and in the future, based on discussions with regulatory agencies, policymakers, program administrators, and evaluation practitioners in 14 states and national experts in the evaluation field. We also explore how EM&V may evolve in a future in which efficiency funding increases significantly, innovative mechanisms for rewarding program performance are adopted, the role of efficiency in greenhouse gas mitigation is more closely linked, and programs are increasingly funded from multiple sources often with multiple program administrators and intended to meet multiple purposes.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Study on Evaluation of Project Management Data for Decommissioning of Uranium Refining and Conversion Plant - 12234

Some of nuclear facilities that would no longer be required have been decommissioned in JAEA (Japan Atomic Energy Agency). A lot of nuclear facilities have to be decommissioned in JAEA in near future. To implement decommissioning of nuclear facilities, it was important to make a rational decommissioning plan. Therefore, project management data evaluation system for dismantling activities (PRODIA code) has been developed, and will be useful for making a detailed decommissioning plan for an object facility. Dismantling of dry conversion facility in the uranium refining and conversion plant (URCP) at Ningyo-toge began in 2008. During dismantling activities, project management data such as manpower and amount of waste generation have been collected. Such collected project management data has been evaluated and used to establish a calculation formula to calculate manpower for dismantling equipment of chemical process and calculate manpower for using a green house (GH) which was a temporary structure for preventing the spread of contaminants during dismantling. In the calculation formula to calculate project management data related to dismantling of equipment, the relation of dismantling manpower to each piece of equipment was evaluated. Furthermore, the relation of dismantling manpower to each chemical process was evaluated. The results showed promise for evaluating dismantling manpower with respect to each chemical process. In the calculation formula to calculate project management data related to use of the GH, relations of GH installation manpower and removal manpower to GH footprint were evaluated. Furthermore, the calculation formula for secondary waste generation was established. In this study, project management data related to dismantling of equipment and use of the GH were evaluated and analyzed. The project management data, manpower for dismantling of equipment, manpower for installation and removal of GH, and secondary waste generation from GH were considered. Establishment of the calculation formula for dismantling of each kind of equipment makes it possible to evaluate manpower for dismantling the whole facility. However, it is not easy to prepare calculation formula for all kinds of equipment that exist in the facility. Therefore, a simpler evaluation method was considered to calculate manpower based on facility characteristics. The results showed promise for evaluating dismantling manpower with respect to each chemical process. For dismantling of contaminated equipment, a GH has been used for protection of the spread of contamination. The use of a GH increases manpower for installation and removal of GH etc. Moreover, structural materials of the GH such as plastic sheets, adhesive tape become a burnable secondary waste. To create an effective dismantling plan, it is necessary to carefully consider use of a GH preliminarily. Thus, an evaluation method of project management data such as manpower and secondary waste generation was considered. The results showed promise for evaluating project management data of GH by using established calculation formula. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

IAEA CIELO Evaluation of Neutron-induced Reactions on 235 U and 238 U Targets

Evaluations of nuclear reaction data for the major uranium isotopes 238 U and 235 U were performed within the scope of the CIELO Project on the initiative of the OECD/NEA Data Bank under Working Party on Evaluation Co-operation (WPEC) Subgroup 40 coordinated by the IAEA Nuclear Data Section. Both the mean values and covariances are evaluated from 10 -5 eV up to 30 MeV. The resonance parameters of 238 U and 235 U were re-evaluated with the addition of newly available data to the existing experimental database. The evaluations in the fast neutron range are based on nuclear model calculations with the code EMPIRE–3.2 Malta above the resonance range up to 30 MeV. 235 U(n,f), 238 U(n,f), and 238 U(n,γ) cross sections and 235 U(n th ,f) prompt fission neutron spectrum (PFNS) were evaluated within the Neutron Standards project and are representative of the experimental state-of-the-art measurements. The Standards cross sections were matched in model calculations as closely as possible to guarantee a good predictive power for cross sections of competing neutron scattering channels. 235 U(n,γ) cross section includes fluctuations observed in recent experiments. 235 U(n,f) PFNS for incident neutron energies from 500 keV to 20 MeV were measured at Los Alamos Chi-Nu facility and re-evaluated using all available experimental data. While respecting the measured differential data, several compensating errors in previous evaluations were identified and removed so that the performance in integral benchmarks was restored or improved. Covariance matrices for 235 U and 238 U cross sections, angular distributions, spectra and neutron multiplicities were evaluated using the GANDR system that combines experimental data with model uncertainties. Unrecognized systematic uncertainties were considered in the uncertainty quantification for fission and capture cross sections above the thermal range, and for neutron multiplicities. Evaluated files were extensively benchmarked to ensure good performance in reactor calculations and fusion-related systems. New comprehensive evaluations show excellent agreement with available differential data and integral performance better than current evaluated data libraries, and represent a step forward in a quest for better nuclear data for applications.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Field evaluation of remote wind sensing technologies: Shore-based and buoy mounted LIDAR systems

In developing a national energy strategy, the United States has a number of objectives, including increasing economic growth, improving environmental quality, and enhancing national energy security. Wind power contributes to these objectives through the deployment of clean, affordable and reliable domestic energy. To achieve U.S. wind generation objectives, the Wind and Water Power Program within the Department of Energy’s (DOE) Office of Energy Efficiency and Renewable Energy (EERE) instituted the U.S. Offshore Wind: Removing Market Barriers Program in FY 2011. Accurate and comprehensive information on offshore wind resource characteristics across a range of spatial and temporal scales is one market barrier that needs to be addressed through advanced research in remote sensing technologies. There is a pressing need for reliable offshore wind-speed measurements to assess the availability of the potential wind energy resource in terms of power production and to identify any frequently occurring spatial variability in the offshore wind resource that may impact the operational reliability and lifetime of wind turbines and their components and to provide a verification program to validate the “bankability” of the output of these alternative technologies for use by finance institutions for the financing of offshore wind farm construction. The application of emerging remote sensing technologies is viewed as a means to cost-effectively meet the data needs of the offshore wind industry. In particular, scanning and buoy mounted LIDAR have been proposed as a means to obtain accurate offshore wind data at multiple locations without the high cost and regulatory hurdles associated with the construction of offshore meteorological towers. However; before these remote sensing technologies can be accepted the validity of the measured data must be evaluated to ensure their accuracy. The proposed research will establish a unique coastal ocean test-bed in the Mid-Atlantic for the evaluation of LIDAR-based wind measurement systems to validate the accuracy of remotely measured wind data in marine applications. Specifically, the test-bed will be utilized to systematically evaluate the capability of emerging scanning LIDAR and buoy mounted vertically profiling LIDAR by: (1) Evaluating a fixed scanning LIDAR against land-based 50 and 60 meter high meteorological masts fitted with research quality cup-vane and/or sonic anemometers; (2) Evaluating a buoy mounted vertically profiling LIDAR fixed on land and floating in a sheltered bay against a co-located 60 meter high meteorological mast fitted with a research quality cup-vane and/or sonic anemometers and the fixed scanning LIDAR; and (3) Offshore field evaluation of both LIDAR platforms through a comparison of the fixed scanning LIDAR data and data obtained by the buoy mounted LIDAR located 10 miles offshore. The proposed research will systematically validate Light Detection and Ranging (LIDAR) based wind measurement systems and assess the temporal and spatial variability of the offshore wind resource in the Mid-Atlantic east of New Jersey. The goal of the proposed project is to address the technical and commercial challenges of the offshore wind energy industry by validating and assessing cost-effective, over ocean wind resource characterization technologies. The objective is to systematically evaluate the capability of both scanning and vertically profiling LIDARs to accurately measure 3D wind fields through comparison with fixed met masts and intercomparison among LIDAR platforms. Once validated, data collected by both buoy mounted vertically profiling LIDARs and shore-based, pulsed horizontally scanning LIDARs can be used to accurately assess offshore wind resources and to quantify the spatial and temporal variability in the offshore wind fields. One of the fundamental research questions to be addressed in phase 1 is the assessment of various measurement and data processing schemes to retrieve accurate wind vectors in the marine environment over large sampling ranges (10 to 12 km) and varying atmospheric aerosol levels. Atmospheric conditions and aerosol content within the coastal ocean region of the Mid-Atlantic seaboard of the US can vary significantly over short time periods in response to frontal passages and extratropical and tropical low pressure system passage offshore of the coast. Since aerosols provide the scattering medium for the determination of LIDAR Doppler shifts in the atmosphere the accuracy and range of LIDAR derived velocity measurements as a function of variation in aerosol content in the marine environment is a key research question to be addressed. In phase 1, it is desired to capture as much variation in atmospheric conditions and aerosol content as possible. To this end, collocated measurements of LIDAR and standard anemometer wind fields will be captured by the project PIs over all four seasons and during specific events (e.g., coastal low pressure system passage) in year 1. Additionally, since the meteorological masts are permanent structures, additional events can be captured over the three year duration of the field research project. All research instruments are owned by Fishermen’s Energy and made available to the PIs though a lease agreement as part of the DOE grant. Energy Fishermen’s Energy will be responsible for the operation and maintenance of the scanning LIDAR and met mast anemometers. On a daily basis, environmental data and systems performance indicators will be transmitted from each measurement station to the Fishermen’s project team consisting of both in-house personnel and equipment manufacturer engineers. Data sets include compiled LIDAR files as well as data sets from ancillary sensors. Diagnostic parameters to be monitored include standard deviations of measured values, battery levels and charging systems output, and the operational status. Once data have been confirmed as complete and reliable, files will be transferred to the Garrad Hassan (a subcontractor to Fishermen’s Energy) for incorporation in to the validation database, which is accessible to other scientific team members. Data collection times and durations will be determined by the PI and Co-PIs in consultation with instrument engineers to ensure the capture of data representative of the expected range of mid-Atlantic atmospheric conditions (e.g., temperature, moisture, coastal low pressure systems, tropical systems, rain, snow, fog). The collection and processing of the data is a function of site specific measurement requirements (Kelley et.al. 2007; Hannon et.al. 2008). To determine the optimal profiles of wind speed and direction from the LIDAR radial velocities as a function of azimuth angle, rigorous estimates of the bias and random error of each radial velocity estimate are required. Lockheed Martin Coherent Technologies, Inc., under contract with Fishermen’s Energy, will provide analyses of raw and processed data using various scan patterns to determine optimal performance settings for the pulsed scanning LIDAR. Once optimized, appropriate processing and analyses techniques will be evaluated by Garrad Hassan for use in validating the accuracy of the LIDAR wind field measurements against the standard anemometer measurements from the meteorological masts. The most attractive capability of the scanning LIDAR is the ability to provide high spatial resolution observations in a three-dimensional volume which provides superior statistical accuracy due to the large number of samples obtained. Each radial scan provides measurements in 100 range gates over a distance of 10 to 12 km at an update rate of 5 to 10 Hz and rotation of 2.5° per second. Each rotation at a fixed azimuth requires 2.4 minutes. Depending on the number of azimuths desired a complete scan can take up to 10 minutes or longer to complete. Once collected the radial velocities are processed to produce vector wind velocity estimates based on a set of data distributed in angle and range around points of interest, typically a standard grid within the radial wind map. To calculate wind vectors over a limited spatial area of interest for the comparison of data with other measurement platforms a localized least-squares approach has been applied by Hannon et.al. (2008) and a Variation Assimilation (VAR) processing technique has been applied by Chan and al Assimilation (VAR) processing technique has been applied by Chan and Shao (2006). Additionally, Kelley et.al. (2007) applied a “stare” technique that fixed a scanning LIDAR in both azimuth and elevation angles to measure over collocated sampling volumes of the LIDAR and a 3D sonic anemometer mounted to a fixed mast. Although the stare technique is limited to wind directions aligned with the sampling radial of the LIDAR, it does provide a direct comparison of sampling volumes. Each of the processing techniques described above (and possibly others) will be evaluated to determine the validity of the LIDAR derived wind fields in the marine environment. Numerical methods such as linear regression and comparison of probability density functions of wind fields measured by each instrument platform will be used to assess the processing techniques. Linear regression has the advantage of directly evaluating corresponding pairs of wind data measured by each instrument and can lend insight into deviations and bias between instruments as a function of wind speed. Assessment of the coherency between the probability density function of the wind measured by each instrument provides insight into processes that may not be accurately resolved by each instrument at specific frequencies. Once processed and assessed the most appropriate technique will be utilized to provide valid wind measurements from the pulsed scanning LIDAR. A detailed analysis of the measurement data from the LIDAR and the three meteorological towers and comparison of the coastal wind characteristics from the different systems will be performed by the CO_PI at NREL. This analysis will evaluate how the WT LIDAR performance and measurement of the wind characteristics vary with distance from the LIDAR and by atmospheric conditions; using the tower measurements at different distances (4.8, 9.6, and 19 km) from the LIDAR as a reference. The comparative analysis will include, to the extent possible, evaluation of parameters such as wind speed and direction distributions, wind shear, turbulence intensity and their variations by atmospheric conditions, month or season, and time of day.

17 WIND ENERGY↗

Evaluation of Neutron Reactions for ENDF/B-VII: {sup 232-241}U and {sup 239}Pu

We have completed new evaluations for several actinides in the ENDF/B-VII database and have extensively modified existing evaluations for several other actinides. We compare calculations using the new evaluations with critical assembly reaction rate measurements made at Los Alamos over the past 50 years, covering a range of reactions and differing neutron spectrum and fluence environments. The evaluations are for all neutron-induced reactions with uranium isotopes in the mass range A=232-241 as well as {sup 239}Pu, and mostly cover the incident neutron energy range from keV energies to 30 MeV. We combined the results of these analyses with new evaluations of the resolved and/or unresolved resonance regions from Oak Ridge for {sup 233,235,238}U and with modified ENDF/B-VI resonance evaluations for the other actinides to produce new neutron-induced evaluations spanning the incident neutron energy range from 10{sup -5} eV to 20 or 30 MeV. Major aspects of this analysis are: systematic accumulation of all relevant experimental data; re-normalization of the neutron data to modern standards; assessment of the applicability of several recent optical model potentials for actinide calculations; interpretation of the experimental results in terms of nuclear theory to allow interpolation and extrapolation of the data into unmeasured regions; and finally, assembly of the experimental and theoretical results into formal evaluated nuclear data files that can be processed for use in applied nuclear programs. In this report we discuss the theoretical analysis and evaluation of all the evaluations, with emphasis on incident neutron energies in the range 10 keV to 20 MeV. We present detailed comparisons of critical assembly simulations with the measurements and include tables of the experimental results. The critical assembly measurements include reaction rates for (n,f), (n,{gamma}), and (n,2n) reactions obtained in the Godiva, Jezebel, Topsy, Bigten, and Flattop assemblies. The evaluations described here are on file at the National Nuclear Data Center at Brookhaven National Laboratory in the ENDF/B-VII database.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

The Uniform Methods Project: Smart Thermostat Evaluation Protocol

A smart thermostat is an internet-connected device that controls home heating, ventilation, and air-conditioning (HVAC) equipment and can automatically adjust temperature set points to optimize performance and achieve energy savings. Smart thermostat features often include two way communication, occupancy detection (such as geofencing and occupancy sensors), schedule learning, and seasonal optimization algorithms. Smart thermostats can control most conventional HVAC systems, including central air conditioners, heat pumps, and forced air furnaces. Several types of residential utility programs offer smart thermostats as replacements measures. Working with smart thermostat vendors, utilities can offer separate optimization programs to produce energy savings beyond those achieved by installing a smart thermostat. From an evaluation perspective, smart thermostat programs have several noteworthy features. First, the energy savings from a smart thermostat may change over the life of the device. As a smart thermostat is connected to the internet, original equipment manufacturers can update the thermostat software to improve the thermostat's energy efficiency. Likewise, users can adjust the thermostat settings and schedules over time in response to changes in weather, thermal comfort, energy prices, or preferences for energy efficiency. Additionally, many thermostat manufacturers offer seasonal optimization programs that recommend changes or make minor, automated adjustments to the thermostat settings to improve energy efficiency. These opt-in programs are now standard offerings for many smart thermostat manufacturers and provided at no additional cost to users. The potential for software updates and continuous optimization and the evolving nature of user interactions mean future energy savings may differ from first-year savings and the energy savings of smart thermostats may need to be evaluated more than once. Second, smart thermostats often have small unit energy savings relative to a home's total energy consumption, especially in comparison to whole- home retrofit programs. This can make it difficult to detect the smart thermostat savings in billing or advanced metering infrastructure (AMI) meter consumption data. For example, as cooling loads in many regions average about 20% of annual electricity consumption, smart thermostat savings of 10% of cooling energy use would equate to a 2% reduction in home electricity consumption. Evaluators should use regression analysis of whole-home billing consumption or advanced metering infrastructure (AMI) meter consumption data to evaluate smart thermostat savings because, as explained at greater length below , these data are usually available to evaluators and regression can control for the impacts of weather and other potentially confounding factors on a home's energy consumption. Finally, as with other energy efficiency programs, participation in smart thermostat programs is self-selective. As discussed at greater length below , smart thermostat participants tend to be, among other things, younger, higher-income, and more likely to adopt electric vehicles (EVs) and internet connected devices than nonparticipants. These differences are often unobservable to the evaluator and correlated with a home's energy consumption, creating the potential for bias in estimating savings. Due to the small unit savings of thermostats, errors and biases from self-selection that may not be very consequential when evaluating a whole- home retrofits (e.g., ±2% of home electricity consumption) can have a major impact when evaluating the savings and cost-effectiveness of smart thermostat programs. A percentage point change in the estimated savings could affect the cost-effectiveness of a program. This means it is important for evaluators to assess and to minimize the potential for error from selection bias in estimating smart thermostat program savings. The Uniform Methods Project provides model protocols for determining energy savings and demand reductions that result from specific energy efficiency measures implemented through state and utility programs. In most cases, the measure protocols are based on a particular option identified by the International Performance Verification and Measurement Protocol ; however, this work provides a more detailed approach to implementing that option. Each chapter is written by technical experts in collaboration with their peers, reviewed by industry experts, and subject to public review and comment. The UMP protocols can be used by utilities, program administrators, public utility commissions, evaluators, and other stakeholders for both program planning and evaluation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Evaluations of Energy Spectra of Neutrons Emitted Promptly in Neutron-induced Fission of 235 U and 239 Pu

The energy spectra of neutrons emitted promptly in the neutron-induced fission reactions of 235 U and 239 Pu were re-evaluated for ENDF/B-VIII.0. The evaluations presented here are based on a careful modeling of all relevant physics processes, an extensive analysis of experimental data and a detailed quantification of pertinent uncertainties. Energy spectra of neutrons emitted in up to fourth chance fission are considered and both compound and pre-equilibrium processes are included. Also, important nuclear model parameters, such as the average total kinetic energy of the fission fragments and the multiple chance fission probabilities, and their uncertainties are estimated based on experimental knowledge, model information and evaluated data. In addition to experimental information already available for ENDF/B-VII.1, these new evaluations make use of recently published experimental data either of high precision or spanning a broad incident energy range, information on legacy measurements explaining discrepancies and recently measured data of the average total kinetic energy as a function of incident neutron energy. The resulting evaluated data and covariances agree well with the experimental database used for the evaluation. However, the evaluated spectra are softer than the 235 U and 239 Pu ENDF/B-VII.1, JENDL-4.0 and JEFF-3.2 evaluations for incident neutron energies E inc ≤ 1.5 MeV and E inc ≤ 5 MeV, respectively. For E inc > 5 MeV, the evaluated spectra show structures due to the improved modeling which are not present in ENDF/B-VII.1 and JEFF-3.2 but can be observed in JENDL-4.0 evaluations. Part of these new evaluations were adopted for ENDF/B-VIII.0, while the ENDF/B-VII.1 239 Pu PFNS was retained for E inc ≤ 5 MeV awaiting more conclusive experimental evidence.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Development of a Technical, Economic, and Risk Assessment Tool for the Evaluation of Work Reduction Opportunities

Efficient and cost-effective operation of a nuclear power plant (NPP) is essential to ensuring long-term economical and safe operation. Multiple cost saving opportunities exist, referred to here as work reduction opportunities (WRO). These WROs reduce plant operating costs by employing various cost-effective strategies (e.g., implementation of modern technologies). Identifying and objectively screening WROs is an essential task to help reduce overall costs. However, there is no comprehensive framework for assessing WROs in the nuclear industry and evaluating their impact on plant operations. This report presents a novel framework for systematically evaluating WROs from a technical, economic, and risk perspective. As NPPs continue to add new technology and implement modernization strategies into their current processes, potential WROs are commonly identified. Although most WROs have the potential to reduce costs, not all opportunities will result in significant cost savings due to unforeseen risks, large implementation costs, or benefits that fall short of expectations. Examples of this can be the result of a technology that is not fully developed, uncertainty in the amount of cost reduction, or difficulties introducing a new process into an organization. These uncertainties can manifest several ways and can result in a WRO with limited cost savings or even a loss of investment. The framework developed emphasizes the importance of effectively screening the WROs from a holistic perspective to objectively identify inefficiencies and ensure a positive impact to the organization. This report presents the Technical, Economic, and Risk Assessment (TERA) as a key methodology for the screening and evaluation of potential WROs. The TERA framework begins with a screening phase where the process is examined through a hybrid combination of Lean Six Sigma and Integrated Operations for Nuclear (ION) guiding principles. This framework examines the current processes using the Lean Six Sigma SIPOC (Suppliers, Inputs, Process, Outputs, Consumers) methodology but retains the ION key elements of People, Technology, Process, and Governance as important factors to the nuclear decision-making process. By combining the principles of Lean Six Sigma and ION, the developed screening process is specific to the nuclear industry in that it systematically evaluates WROs in order to implement new technology that is comprehensively evaluated. The TERA begins by mapping current processes as they relate to WROs and examining the inefficiencies. Furthermore, the created process map can be used to identify and evaluate potential solutions. Using key performance indicators (KPIs), the TERA evaluates each area—technology, economics, and risk—for uncertainties and to perform cost-benefit analysis. The results of the TERA are important KPIs that allow for an evaluation of different processes and technology implementations. This assessment enables decision-makers to compare various WROs based on metrics and then make informed decisions for which opportunity to implement first. This research includes not only the creation of the TERA framework, but also the evaluation of its performance. A case study for screening potential WROs at Southern Nuclear Company is presented that utilizes the TERA methodology. Through the use of TERA, various WROs were screened, and the solutions evaluated for cost-benefit expectations. The report concludes by summarizing the overall effort and implications for utility modernization. The performance of the screening and TERA are discussed as well as the impact on the nuclear industry. The TERA process enables utilities to evaluate and inform investment decisions for WROs and mitigate any potential risks. Through this research, we provide utilities with a valuable framework to optimize operations, reduce costs, and drive continuous process improvement.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Evaluation of integrated assessment model hindcast experiments: a case study of the GCAM 3.0 land use module

Abstract. Hindcasting experiments (conducting a model forecast for a time period in which observational data are available) are being undertaken increasingly often by the integrated assessment model (IAM) community, across many scales of models. When they are undertaken, the results are often evaluated using global aggregates or otherwise highly aggregated skill scores that mask deficiencies. We select a set of deviation-based measures that can be applied on different spatial scales (regional versus global) to make evaluating the large number of variable–region combinations in IAMs more tractable. We also identify performance benchmarks for these measures, based on the statistics of the observational dataset, that allow a model to be evaluated in absolute terms rather than relative to the performance of other models at similar tasks. An ideal evaluation method for hindcast experiments in IAMs would feature both absolute measures for evaluation of a single experiment for a single model and relative measures to compare the results of multiple experiments for a single model or the same experiment repeated across multiple models, such as in community intercomparison studies. The performance benchmarks highlight the use of this scheme for model evaluation in absolute terms, providing information about the reasons a model may perform poorly on a given measure and therefore identifying opportunities for improvement. To demonstrate the use of and types of results possible with the evaluation method, the measures are applied to the results of a past hindcast experiment focusing on land allocation in the Global Change Assessment Model (GCAM) version 3.0. The question of how to more holistically evaluate models as complex as IAMs is an area for future research. We find quantitative evidence that global aggregates alone are not sufficient for evaluating IAMs that require global supply to equal global demand at each time period, such as GCAM. The results of this work indicate it is unlikely that a single evaluation measure for all variables in an IAM exists, and therefore sector-by-sector evaluation may be necessary.

58 GEOSCIENCES↗

Evaluated Iridium, Yttrium, and Thulium Cross Sections and Integral Validation Against Critical Assembly and Bethe Sphere Measurements

We describe new dosimetry (radiochemical) ENDF evaluations for yttrium, iridium, and thulium. These LANL2006 evaluations were based upon measured data and on nuclear model cross section calculations. In the case of iridium and yttrium, new measurements using the GEANIE gamma-ray detector at LANSCE were used to infer (n,xn) cross sections, the measurements being augmented by nuclear model calculations using the GNASH code. The thulium isotope evaluations were based on GNASH calculations and older measurements. The evaluated cross section data are tested through comparisons of simulations with measurements of reaction rates in critical assemblies and in Bethe sphere (sometimes called Wyman sphere) integral experiments. Two types of Bethe sphere experiments were studied - a LiD experiment that had a significant component of 14 MeV neutrons, and a LiD-U experiment that additionally had varying amounts of fission neutrons depending upon the location. These simulations were performed with the MCNP code using continuous energy Monte Carlo, and because the neutron fluences can be modeled fairly accurately by MCNP at different locations in these assemblies, the comparisons provide a valuable validation test of the accuracy of the evaluated cross sections and their energy dependencies. The MCNP integral reaction rate validation testing for the three detectors yttrium, iridium, and thulium, in the LANL2006 database is summarized as follows: (1) (n,2n)near 14 MeV: In 14 MeV-dominated locations (the LiD Bethe spheres and the outer regions of the LiD-U Bethe spheres), the (n,2n) products are modeled very well for all three detectors, suggesting that the evaluated {sup 89}Y(n,2n), {sup 191}Ir(n,2n), and {sup 169}Tm(n,2n) cross sections are accurate to better than about 5% near 14 MeV; (2) (n,2n)near threshold: In locations that have a significant number of fission spectrum neutrons or downscattered neutrons from 14 MeV inelastic scattering (the central regions of the LiD-U spheres and the fast critical assemblies), the (n,2n) products are overpredicted by 5-30 % for the three detectors, suggesting either the threshold region (n,2n) cross sections are too high, or that the MCNP-simulated neutron flux is too large for neutron energies above about 8 MeV; (3) Capture: The capture products for yttrium are modeled accurately for the LiD Bethe spheres, but are underpredicted by about 20% for the LiD-U Bethe spheres and the critical assemblies; for iridium-191 they are predicted accurately in the critical assemblies; and for thulium they are generally overpredicted by 10-30 %; (4) Inelastic scattering in iridium: The evaluated {sup 193}Ir(n,n{sup '}){sup 193m}Ir cross section performs well over a very wide range of neutron spectra (where the 193m/190 spectrum hardness index varies by over three orders of magnitude), the differences between simulation and experiment typically being better than 10-15%; (5) Iridium 193m/190 spectrum hardness index: Our simulations reproduce the measured 193m/190 data typically to better than 10-20% over three orders of magnitude in the 193m/190 ratio. The aforementioned indications from data testing involving assemblies containing actinides - that the (n,2n) products are overpredicted by 5-30% - could be used to motivate a decrease in the evaluated (n,2n) cross sections in the approximately 8-12 MeV range. However, at this stage we have not modified these cross sections since: (a) They are consistent with the cross section laboratory measurements; and (b) It is possible that the cross sections are correct and instead the simulated integral assembly neutron spectrum is too high for neutron energies above 8 MeV. The latter possibility is particularly intriguing given all three detector materials showed a bias in the same direction, and that the evaluated actinide prompt fission spectra and inelastic scattering data are probably uncertain to at least 20% above 8 MeV. We also discuss refinements needed in the transport methods to faithfully represent the evaluated data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Evaluation of the Neutron Data Standards

With the need for improving existing nuclear data evaluations, (e.g., ENDF/B-VIII.0 and JEFF-3.3 releases) the first step was to evaluate the standards for use in such a library. This new standards evaluation made use of improved experimental data and some developments in the methodology of analysis and evaluation. In addition to the work on the traditional standards, this work produced the extension of some energy ranges and includes new reactions that are called reference cross sections. Since the effort extends beyond the traditional standards, it is called the neutron data standards evaluation. This international effort has produced new evaluations of the following cross section standards: the H(n,n), 6 Li(n,t), 10 B(n,α), 10 B(n,α 1 γ), nat C(n,n), Au(n,γ), 235 U(n,f) and 238 U(n,f). Also in the evaluation process the 238 U(n,γ) and 239 Pu(n,f) cross sections that are not standards were evaluated. Evaluations were also obtained for data that are not traditional standards: the Maxwellian spectrum averaged cross section for the Au(n,γ) cross section at 30 keV; reference cross sections for prompt γ-ray production in fast neutron-induced reactions; reference cross sections for very high energy fission cross sections; the 252 Cf spontaneous fission neutron spectrum and the 235 U prompt fission neutron spectrum induced by thermal incident neutrons; and the thermal neutron constants. The data and covariance matrices of the uncertainties were obtained directly from the evaluation procedure.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

TECHNICAL BASIS FOR EVALUATING SURFACE BARRIERS TO PROTECT GROUNDWATER FROM DEEP VADOSE ZONE CONTAMINATION

The U.S. DOE and its predecessors released nearly 2 trillion liters (450 billion gallons) of contaminated liquid into the vadose zone at the Hanford Site. Some of the contaminants currently reside in the deeper parts of the vadose zone where they are much less accessible to characterization, monitoring, and typical remediation activities. The DOE Richland Operations Office (DOE-RL) prepared a treatability test plan in 2008 to examine remediation options for addressing contaminants in the deep vadose zone; one of the technologies identified was surface barriers (also known as engineered barriers, covers, and caps). In the typical configuration, the contaminants are located relatively close to the surface, generally within 15 m, and thus they are close to the base of the surface barrier. The proximity of the surface barrier under these conditions yielded few concerns about the effectiveness of the barrier at depth, particularly for cases in which the contaminants were in a lined facility. At Hanford, however, some unlined sites have contaminants located well below depths of 15 m. The issue raised about these sites is the degree of effectiveness of a surface barrier in isolating contaminants in the deep vadose zone. Previous studies by Hanford Site and PNNL researchers suggest that surface barriers have the potential to provide a significant degree of isolation of deep vadose zone contaminants. The studies show that the actual degree of isolation is site-specific and depends on many factors, including recharge rates, barrier size, depth of contaminants, geohydrologic properties ofthe sediments, and the geochemical interactions between the contaminants and the sediments. After the DOE-RL treatability test plan was published, Pacific Northwest National Laboratory was contracted to review the information available to support surface barrier evaluation for the deep vadose zone, identify gaps in the information and outcomes necessary to fill the data gaps, and outline tasks to achieve those outcomes. Full understanding of contaminant behavior in the deep vadose zone is constrained by four key data gaps: limited access; limited data; limited time; and the lack of an accepted predictive capability for determining whether surface barriers can effectively isolate deep vadose zone contaminants. Activities designed to fill these data gaps need to have these outcomes: (1) common evaluation methodology that provides a clear, consistent, and defensible basis for evaluating groundwater impacts caused by placement of a surface barrier above deep vadose zone contamination; (2) deep vadose zone data that characterize the lithology, the spatial distribution of moisture and contaminants, the physical, chemical, and biological process that affect the mobility of each contaminant, and the impacts to the contaminants following placement of a surface barrier; (3) subsurface monitoring to provide subsurface characterization of initial conditions and changes that occur during and following remediation activities; and (4) field observations that span years to decades to validate the evaluation methodology. A set of six proposed tasks was identified to provide information needed to address the above outcomes. The proposed tasks are: (1) Evaluation Methodology - Develop common evaluation methodology that will provide a clear, consistent, and defensible basis for evaluating groundwater impacts caused by placement of a surface barrier above deep vadose zone contamination. (2) Case Studies - Conduct case studies to demonstrate the applicability ofthe common evaluation methodology and provide templates for subsequent use elsewhere. Three sites expected to have conditions that would yield valuable information and experience pertinent to deep vadose zone contamination were chosen to cover a range of conditions. The sites are BC Cribs and Trenches, U Plant Cribs, and the T Farm Interim Cover. (3) Subsurface Monitoring Technologies - Evaluate minimally invasive geophysical approaches for delineating subsurface plumes and monitoring their migration in the deep vadose zone. (4) Controlled Field Test at Sisson and Lu Site - Evaluate the ability ofthe model to predict long-term liquid, vapor, and chemical transport processes at a well-characterized site containing a plume of subsurface water and tracer remaining from injections in the early 1980s and 2000s. (5) Deep Vadose Zone Monitoring at T Farm - Demonstrate the ability of the geophysical sensors and the model to detect and predict long-term migration of liquid and vapor between the vadose zone beneath the infiltration area and the vadose zone protected by the interim cover. (6) Deep Vadose Zone Monitoring at the Prototype Hanford Barrier - Demonstrate the ability of geophysical sensors and the model to detect and predict the hydrologic conditions in the vadose zone beneath the Prototype Hanford Barrier 15 years after construction.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A Review of the Evaluation of Building Energy Code Compliance in the United States

Building energy codes are essential tools for achieving energy efficiency in buildings. However, the full energy savings potential of these codes can only be realized if buildings are constructed in compliance with them. Therefore, evaluating building energy code compliance is crucial in bridging the gap between the energy efficiency requirements set by energy codes and the actualized energy savings achieved. An energy code compliance evaluation serves as a mechanism to assess construction practices, evaluate the effectiveness of code enforcement, identify gaps in compliance, and guide strategies for improvement through training and education. Conducting code compliance evaluation activities involves field studies that require careful design and significant resources. Historically, more emphasis has been placed on developing and adopting building energy codes, while efforts to evaluate compliance have been relatively limited and lacking consistent approaches. The passage of the 2009 American Recovery and Reinvestment Act (ARRA), which mandated that states create plans for achieving 90% compliance within eight years, stimulated the need for an energy code compliance evaluation. As a result, federal, state, and local governments, and utilities have invested in the development of methodologies and tools for code compliance evaluation studies. This paper reviews the code compliance evaluation studies conducted in the United States over the past three decades. It describes and compares the methodologies and metrics used to assess building energy code compliance, summarizes the general elements and steps involved in the evaluation process, and discusses common issues in these studies. Over time, code compliance evaluation methodologies have evolved from isolated development within individual states, regions, and utilities, to widely accepted protocols applicable across different states and local jurisdictions. There has been a transition in compliance metrics, shifting from historical compliance rates to energy-consumption-oriented approaches.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗