Search NASA⌕ Search

SEARCH · Search NASA

Results for “program evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Chapter 21: Estimating Net Savings - Common Practices. The Uniform Methods Project: Methods for Determining Energy Efficiency Savings for Specific Measures

This chapter focuses on the methods used to estimate net energy savings in evaluation, measurement, and verification (EM and V) studies for energy efficiency (EE) programs. The chapter provides a definition of net savings, which remains an unsettled topic both within the EE evaluation community and across the broader public policy evaluation community, particularly in the context of attribution of savings to a program. The chapter differs from the measure-specific Uniform Methods Project (UMP) chapters in both its approach and work product. Unlike other UMP resources that provide recommended protocols for determining gross energy savings, this chapter describes and compares the current industry practices for determining net energy savings but does not prescribe methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Developing State and National Evaluation Infrastructures- Guidance for the Challenges and Opportunities of EM&V

Evaluating the impacts and effectiveness of energy efficiency programs is likely to become increasingly important for state policymakers and program administrators given legislative mandates and regulatory goals and increasing reliance on energy efficiency as a resource. In this paper, we summarize three activities that the authors have conducted that highlight the expanded role of evaluation, measurement and verification (EM&V): a study that identified and analyzed challenges in improving and scaling up EM&V activities; a scoping study that identified issues involved in developing a national efficiency EM&V standard; and lessons learned from providing technical assistance on EM&V issues to states that are ramping up energy efficiency programs. The lessons learned are summarized in 13 EM&V issues that policy makers should address in each jurisdiction and which are listed and briefly described. The paper also discusses how improving the effectiveness and reliability of EM&V will require additional capacity building, better access to existing EM&V resources, new methods to address emerging issues and technologies, and perhaps foundational documents and approaches to improving the credibility and cross jurisdictional comparability of efficiency investments. Two of the potential foundational documents discussed are a national EM&V standard or resource guide and regional deemed savings and algorithm databases.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Advanced Hydrogen Turbine Development

Under the sponsorship of the U.S. Department of Energy (DOE) National Energy Technology Laboratories, Siemens has completed the Advanced Hydrogen Turbine Development Program to develop an advanced gas turbine for incorporation into future coal-based Integrated Gasification Combined Cycle (IGCC) plants. All the scheduled DOE Milestones were completed and significant technical progress was made in the development of new technologies and concepts. Advanced computer simulations and modeling, as well as subscale, full scale laboratory, rig and engine testing were utilized to evaluate and select concepts for further development. Program Requirements of: A 3 to 5 percentage point improvement in overall plant combined cycle efficiency when compared to the reference baseline plant; 20 to 30 percent reduction in overall plant capital cost when compared to the reference baseline plant; and NOx emissions of 2 PPM out of the stack. were all met. The program was completed on schedule and within the allotted budget

42 ENGINEERING↗

Industrial Energy Assessment Training Effectiveness Evaluation: An Eye-Tracking Study

It is essential to understand the effectiveness of any training program so it can be improved accordingly. Various studies have applied standard metrics for the evaluation of visual behavior to recognize the areas of interest that attract individuals’ attention as there is a high correlation between attentional behavior and where one is focusing on. However, through reviewing the literature, we believe that studies that applied eye-tracking technologies for training purposes are still limited, especially in the industrial energy assessment training field. In this paper, the effectiveness of industrial energy assessment training was quantitatively evaluated by measuring the attentional allocation of trainees using eye-tracking technology. Moreover, this study identifies the areas that require more focus based on evaluating the performance of subjects after receiving the training. Additionally, this research was conducted in a controlled environment to remove the distractions that may be caused by environmental factors to only concentrate on variables that influence the learning behavior of subjects. The experiment results showed that after receiving the training, the subjects’ performance in energy assessment was significantly improved in two areas: production, and recycling and waste management, and the designed training program enhanced the knowledge of participants in identifying energy-saving opportunities to the knowledge level of experienced participants.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Analysis of Space-Conditioning Loads in Commercial Buildings

Space conditioning end-uses, which include heating, cooling, and ventilation, represent a significant fraction of commercial building energy use, with a wide variety of heating and cooling technology options available in the market. In the interest of improving the overall efficiency of heating, ventilation and air-conditioning (HVAC) technologies, governments, utilities and private sector entities have implemented a variety of market transformation policies that aim to influence consumer purchase decisions. To evaluate the costs and benefits of such programs, analysts typically postulate a hypothetical default equipment choice, and compare it to one that provides comparable service with lower energy and/or power use. The corresponding reduced operating cost provides a benefit that offsets the potential higher cost of improved efficiency. Typically, life-cycle cost or cash-flow analyses are used to quantify the net economic benefit. These analyses require the capability to assess how a given equipment design would perform across a broad range of characteristics, both of the building and of the local weather. While these assessments can be performed using customized building simulations, it is generally not practical to develop and validate detailed building simulation code to cover all the potential variations of equipment design and installation. An alternative, and somewhat simpler, approach is to solely use detailed building simulations to generate time series of heating and cooling loads in commercial buildings. These loads can then be used as input to more detailed, stand-alone engineering models that simulate HVAC system performance under different equipment designs. This approach was used to evaluate a range of high-efficiency commercial packaged air conditioner design options for the Department of Energy’s Appliance and Equipment Standards Program (DOE-EERE 2015). While there may be some loss of precision relative to full simulation, the accuracy of this approach is sufficient for practical applications of cost-benefit analysis. This report describes the development of a database of commercial building heating and cooling loads, generated using the EnergyPlus software package, a whole building energy use model supported by the Department of Energy (DOE-EERE 2020a). EnergyPlus takes as input a set of configuration files that describe the building itself (size, zoning, envelope characteristics, etc.) and the various systems within it (HVAC, lighting, water heating, etc.). This analysis uses a publicly available collection of commercial reference buildings (CRB), comprised of sixteen building types and three vintages (DOE-EERE 2020b; Deru et al 2011). Each building is simulated in eighteen different locations, covering a wide range of climatic conditions. The prototype building description files assign the type of HVAC equipment used, and capacities across climate zones.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Parallel-scanning tomosynthesis using a slot scanning technique: Fixed-focus reconstruction and the resulting image quality

Purpose: Parallel-scanning tomosynthesis (PS-TS) is a novel technique that fuses the slot scanning technique and the conventional tomosynthesis (TS) technique. This approach allows one to obtain long-view tomosynthesis images in addition to normally sized tomosynthesis images, even when using a system that has no linear tomographic scanning function. The reconstruction technique and an evaluation of the resulting image quality for PS-TS are described in this paper. Methods: The PS-TS image-reconstruction technique consists of several steps (1) the projection images are divided into strips, (2) the strips are stitched together to construct images corresponding to the reconstruction plane, (3) the stitched images are filtered, and (4) the filtered stitched images are back-projected. In the case of PS-TS using the fixed-focus reconstruction method (PS-TS-F), one set of stitched images is used for the reconstruction planes at all heights, thus avoiding the necessity of repeating steps (1)–(3). A physical evaluation of the image quality of PS-TS-F compared with that of the conventional linear TS was performed using a R/F table (Sonialvision safire, Shimadzu Corp., Kyoto, Japan). The tomographic plane with the best theoretical spatial resolution (the in-focus plane, IFP) was set at a height of 100 mm from the table top by adjusting the reconstruction program. First, the spatial frequency response was evaluated at heights of −100, −50, 0, 50, 100, and 150 mm from the IFP using the edge of a 0.3-mm-thick copper plate. Second, the spatial resolution at each height was visually evaluated using an x-ray test pattern (Model No. 38, PTW Freiburg, Germany). Third, the slice sensitivity at each height was evaluated via the wire method using a 0.1-mm-diameter tungsten wire. Phantom studies using a knee phantom and a whole-body phantom were also performed. Results: The spatial frequency response of PS-TS-F yielded the best results at the IFP and degraded slightly as the distance from the IFP increased. A visual evaluation of the spatial resolution using the x-ray test pattern indicated that the resolution was 1.8 lp/mm at the IFP and 1.2 lp/mm at heights of −100 and 100 mm from the IFP. The authors demonstrated that a spatial resolution of 1.2–1.8 lp/mm could be obtained within heights of 200 mm of the IFP. The slice sensitivity varied between 11.1 and 13.8 mm for heights between −50 and 100 mm, and there was no critical change in the slice sensitivity within a height range of 150 mm around the IFP. The phantom results demonstrated that tomosynthesis and long-view images could be reconstructed. Conclusions: PS-TS-F provides tomosynthesis images while using low-cost systems that have no tomographic scanning function, such as tableside-controlled universal R/F systems or universal radiographic systems.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

RAVEN User Manual

RAVEN is a generic software framework to perform parametric and probabilistic analysis based on the response of complex system codes. The initial development was aimed to provide dynamic risk analysis capabilities to the Thermo-Hydraulic code RELAP-7, currently under development at the Idaho National Laboratory (INL). Although the initial goal has been fully accomplished, RAVEN is now a multi-purpose probabilistic and uncertainty quantification platform, capable to agnostically communicate with any system code. This agnosticism includes providing Application Programming Interfaces (APIs). These APIs are used to allow RAVEN to interact with any code as long as all the parameters that need to be perturbed are accessible by inputs files or via python interfaces. RAVEN is capable of investigating the system response, and investigating the input space using Monte Carlo, Grid, or Latin Hyper Cube sampling schemes, but its strength is focused toward system feature discovery, such as limit surfaces, separating regions of the input space leading to system failure, using dynamic supervised learning techniques. The development of RAVEN has started in 2012, when, within the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, the need to provide a modern risk evaluation framework became stronger. RAVEN principal assignment is to provide the necessary software and algorithms in order to employ the concept developed by the Risk Informed Safety Margin Characterization (RISMC) program. RISMC is one of the pathways defined within the Light Water Reactor Sustainability (LWRS) program. In the RISMC approach, the goal is not just the individuation of the frequency of an event potentially leading to a system failure, but the closeness (or not) to key safety-related events. Hence, the approach is interested in identifying and increasing the safety margins related to those events. A safety margin is a numerical value quantifying the probability that a safety metric (e.g. for an important process such as peak pressure in a pipe) is exceeded under certain conditions. The initial development of RAVEN has been focused on providing dynamic risk assessment capability to RELAP-7, currently under development at the INL and, likely, future replacement of the RELAP5-3D code. Most the capabilities that have been implemented having RELAP-7 as principal focus are easily deployable for other system codes. For this reason, several side activaties are currently ongoing for coupling RAVEN with software such as RELAP5-3D, etc. The aim of this document is the explanation of the input requirements, focalizing on the input structure.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Power System Wildfire Risks and Potential Solutions: A Literature Review & Proposed Metric

Several fire risk evaluation, fire tracking, and fire response resources are available. The risk metrics and fire response programs are sometimes modified to include a power system context. The risk metrics often evaluate the risk of fires causing power system faults or outages, especially on transmission systems. The response programs are modified to ensure the safety of power system equipment and first responders as well as to coordinate power system outages to both ensure safety during an active fire and prevent fire ignition during high risk periods. Although some aspects of wildfire responses have been adapted to include power system concerns, adaptations to power system operations and maintenance to include wildfire risks and responses are still nascent. In particular, a risk metric that evaluates the potential for power system components to ignite wildfires is needed to help guide power system upgrade efforts and power system fire safety measures. This document serves as a brief literature review of wildfire risk metrics and response programs and how they relate to power systems. It also includes a proposed risk metric and structure for describing the risk of a power system component igniting a fire.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Needed improvements in the development of systemic corrective actions.

There are indications that corrective actions, as implemented at Sandia National Laboratories are not fully adequate. Review of independent audits spanning multiple years provides evidence of recurring issues within the same or similar operations and programs. Several external audits have directly called into question the ability Sandia's assessment and evaluation processes to prevent recurrence. Examples of repeated findings include lockout/tagout programs, local exhaust ventilation controls and radiological controls. Recurrence clearly shows that there are underlying systemic factors that are not being adequately addressed by corrective actions stemming from causal analyses. Information suggests that improvements in the conduct of causal analyses and, more importantly, in the development of subsequent corrective actions are warranted. Current methodolgies include Management Oversight Risk Tree, developed in the early 1970s and Systemic Factors Analysis. Recommendations for improvements include review of other causal analysis systems, training, improved formality of operations, improved documentation, and a corporate method that uses truly systemic solutions. This report was written some years ago and is being published now to form the foundation for current, follow-on reports being developed. Some outdated material is recognized but is retained for report completeness.

99 GENERAL AND MISCELLANEOUS↗

Innovation Incubator: Whisker Labs Technical Evaluation

The Wells Fargo Innovation Incubator (IN2) is a program to foster and accelerate startup companies with commercial building energy-efficiency and demand management technologies. The program is funded by the Wells Fargo Foundation and co-administered by the National Renewable Energy Laboratory (NREL). Whisker Labs, an Oakland, California-based company, was one of four awardees in the first IN2 cohort and was invited to participate in the program because of its novel electrical power sensing technology for circuit breakers. The stick-on Whisker meters install directly on the front face of the circuit breakers in an electrical panel using adhesive, eliminating the need to open the panel and install current transducers (CTs) on the circuit wiring.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Using remote sensing to quantify the additional climate benefits of California forest carbon offset projects

Abstract Nature‐based climate solutions are a vital component of many climate mitigation strategies, including California's, which aims to achieve carbon neutrality by 2045. Most carbon offsets in California's cap‐and‐trade program come from improved forest management (IFM) projects. Since 2012, various landowners have set up IFM projects following the California Air Resources Board's IFM protocol. As many of these projects approach their 10th year, we now have the opportunity to assess their effectiveness, identify best practices, and suggest improvements toward future protocol revisions. In this study, we used remote sensing‐based datasets to evaluate the carbon trends and harvest histories of 37 IFM projects in California. Despite some current limitations and biases, these datasets can be used to quantify carbon accumulation and harvest rates in offset project lands relative to nearby similar “control” lands before and after the projects began. Five lines of evidence suggest that the carbon accumulated in offset projects to date has generally not been additional to what might have otherwise occurred: (1) most forests in northwestern California have been accumulating carbon since at least the mid‐1980s and continue to accumulate carbon, whether enrolled in offset projects or not; (2) harvest rates were high in large timber company project lands before IFM initiation, suggesting they are earning carbon credits for forests in recovery; (3) projects are often located on lands with higher densities of low‐timber‐value species; (4) carbon accumulation rates have not yet increased on lands that enroll as offset projects, relative to their pre‐enrollment levels; and (5) harvest rates have not decreased on most project lands since offset project initiation. These patterns suggest that the current protocol should be improved to robustly measure and reward additionality. In general, our framework of geospatial analyses offers an important and independent means to evaluate the effectiveness of the carbon offsets program, especially as these data products continue improving and as offsets receive attention as a climate mitigation strategy.

59 BASIC BIOLOGICAL SCIENCES↗

Evaluation of Efficiency Activities in the Industrial Sector Undertaken in Response to Greenhouse Gas Emission Reduction Targets

The 2006 California Global Warming Solutions Act calls for reducing greenhouse gas (GHG) emissions to 1990 levels by 2020. Meeting this target will require action from all sectors of the California economy, including industry. The industrial sector consumes 25% of the energy used and emits 28% of the carbon dioxide (CO{sub 2}) produced in the state. Many countries around the world have national-level GHG reduction or energy-efficiency targets, and comprehensive programs focused on implementation of energy efficiency and GHG emissions mitigation measures in the industrial sector are essential for achieving their goals. A combination of targets and industry-focused supporting programs has led to significant investments in energy efficiency as well as reductions in GHG emissions within the industrial sectors in these countries. This project has identified program and policies that have effectively targeted the industrial sector in other countries to achieve real energy and CO{sub 2} savings. Programs in Ireland, France, The Netherlands, Denmark, and the UK were chosen for detailed review. Based on the international experience documented in this report, it is recommended that companies in California's industrial sector be engaged in a program to provide them with support to meet the requirements of AB32, The Global Warming Solution Act. As shown in this review, structured programs that engage industry, require members to evaluate their potential efficiency measures, plan how to meet efficiency or emissions reduction goals, and provide support in achieving the goals, can be quite effective at assisting companies to achieve energy efficiency levels beyond those that can be expected to be achieved autonomously.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

RAVEN User Manual

RAVEN is a generic software framework to perform parametric and probabilistic analy- sis based on the response of complex system codes. The initial development was aimed to provide dynamic risk analysis capabilities to the Thermo-Hydraulic code RELAP-7, currently under development at the Idaho National Laboratory (INL). Although the initial goal has been fully accomplished, RAVEN is now a multi-purpose probabilistic and uncer- tainty quantification platform, capable to agnostically communicate with any system code. This agnosticism includes providing Application Programming Interfaces (APIs). These APIs are used to allow RAVEN to interact with any code as long as all the parameters that need to be perturbed are accessible by inputs files or via python interfaces. RAVEN is capable of investigating the system response, and investigating the input space using Monte Carlo, Grid, or Latin Hyper Cube sampling schemes, but its strength is focused to- ward system feature discovery, such as limit surfaces, separating regions of the input space leading to system failure, using dynamic supervised learning techniques. The development of RAVEN has started in 2012, when, within the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, the need to provide a modern risk evaluation framework became stronger. RAVEN principal assignment is to provide the necessary software and algorithms in order to employ the concept developed by the Risk Informed Safety Margin Characterization (RISMC) program. RISMC is one of the pathways defined within the Light Water Reactor Sustainability (LWRS) program. In the RISMC approach, the goal is not just the individuation of the frequency of an event potentially leading to a system failure, but the closeness (or not) to key safety-related events. Hence, the approach is in- terested in identifying and increasing the safety margins related to those events. A safety margin is a numerical value quantifying the probability that a safety metric (e.g. for an important process such as peak pressure in a pipe) is exceeded under certain conditions. The initial development of RAVEN has been focused on providing dynamic risk assess- ment capability to RELAP-7, currently under develop-ment at the INL and, likely, future replacement of the RELAP5-3D code. Most the capabilities that have been implemented having RELAP-7 as principal focus are easily deployable for other system codes. For this reason, several side activates are currently ongoing for coupling RAVEN with soft- ware such as RELAP5-3D, etc. The aim of this document is the explaination of the input requirements, focalizing on the input structure.

97 MATHEMATICS AND COMPUTING↗

RAVEN User Manual

RAVEN is a generic software framework to perform parametric and probabilistic analy- sis based on the response of complex system codes. The initial development was aimed to provide dynamic risk analysis capabilities to the Thermo-Hydraulic code RELAP-7, currently under development at the Idaho National Laboratory (INL). Although the initial goal has been fully accomplished, RAVEN is now a multi-purpose probabilistic and uncer- tainty quantification platform, capable to agnostically communicate with any system code. This agnosticism includes providing Application Programming Interfaces (APIs). These APIs are used to allow RAVEN to interact with any code as long as all the parameters that need to be perturbed are accessible by inputs files or via python interfaces. RAVEN is capable of investigating the system response, and investigating the input space using Monte Carlo, Grid, or Latin Hyper Cube sampling schemes, but its strength is focused to- ward system feature discovery, such as limit surfaces, separating regions of the input space leading to system failure, using dynamic supervised learning techniques. The development of RAVEN has started in 2012, when, within the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, the need to provide a modern risk evaluation framework became stronger. RAVEN principal assignment is to provide the necessary software and algorithms in order to employ the concept developed by the Risk Informed Safety Margin Characterization (RISMC) program. RISMC is one of the pathways defined within the Light Water Reactor Sustainability (LWRS) program. In the RISMC approach, the goal is not just the individuation of the frequency of an event potentially leading to a system failure, but the closeness (or not) to key safety-related events. Hence, the approach is in- terested in identifying and increasing the safety margins related to those events. A safety margin is a numerical value quantifying the probability that a safety metric (e.g. for an important process such as peak pressure in a pipe) is exceeded under certain conditions. The initial development of RAVEN has been focused on providing dynamic risk assess- ment capability to RELAP-7, currently under develop-ment at the INL and, likely, future replacement of the RELAP5-3D code. Most the capabilities that have been implemented having RELAP-7 as principal focus are easily deployable for other system codes. For this reason, several side activates are currently ongoing for coupling RAVEN with soft- ware such as RELAP5-3D, etc. The aim of this document is the explaination of the input requirements, focalizing on the input structure.

97 MATHEMATICS AND COMPUTING↗

RAVEN User Manual, Revision 4

RAVEN is a generic software framework to perform parametric and probabilistic analysis based on the response of complex system codes. The initial development was aimed to provide dynamic risk analysis capabilities to the Thermo-Hydraulic code RELAP-7, currently under development at the Idaho National Laboratory (INL). Although the initial goal has been fully accomplished, RAVEN is now a multi-purpose probabilistic and uncertainty quantification platform, capable to agnostically communicate with any system code. This agnosticism includes providing Application Programming Interfaces (APIs). These APIs are used to allow RAVEN to interact with any code as long as all the parameters that need to be perturbed are accessible by inputs files or via python interfaces. RAVEN is capable of investigating the system response, and investigating the input space using Monte Carlo, Grid, or Latin Hyper Cube sampling schemes, but its strength is focused to- ward system feature discovery, such as limit surfaces, separating regions of the input space leading to system failure, using dynamic supervised learning techniques. The development of RAVEN has started in 2012, when, within the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, the need to provide a modern risk evaluation framework became stronger. RAVEN principal assignment is to provide the necessary software and algorithms in order to employ the concept developed by the Risk Informed Safety Margin Characterization (RISMC) program. RISMC is one of the pathways defined within the Light Water Reactor Sustainability (LWRS) program. In the RISMC approach, the goal is not just the individuation of the frequency of an event potentially leading to a system failure, but the closeness (or not) to key safety-related events. Hence, the approach is interested in identifying and increasing the safety margins related to those events. A safety margin is a numerical value quantifying the probability that a safety metric (e.g. for an important process such as peak pressure in a pipe) is exceeded under certain conditions. The initial development of RAVEN has been focused on providing dynamic risk assess- ment capability to RELAP-7, currently under development at the INL and, likely, future replacement of the RELAP5-3D code. Most the capabilities that have been implemented having RELAP-7 as principal focus are easily deployable for other system codes. For this reason, several side activates are currently ongoing for coupling RAVEN with soft- ware such as RELAP5-3D, etc. The aim of this document is the explanation of the input requirements, focalizing on the input structure.

97 MATHEMATICS AND COMPUTING↗