Search NASA⌕ Search

SEARCH · Search NASA

Results for “Testing metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Introduction to Special Section: Machine Learning for Image-based Geologic Interpretation

Image-based geological interpretation has been a labor-intensive and time-consuming process because it requires well-trained geoscientists to identify geological structures, features, and textures from various types of images. These images include scanning electron microscopic images, optical microscopic images, optical photos, resistivity images, seismic volumes, remote-sensing images, etc. With fast-evolving machine learning (ML) technology and computing power in recent decades, computers can achieve nearhuman-level to super-human-level performance with scalable high efficiency in the computer vision field. These technological revolutions facilitated image-based geological interpretation in petroleum exploration and production. For example, a fault picking method applied to 3-D seismic volume data using deep learning can achieve superior performance in comparison to conventional auto-picking methods. In addition, under the new normal of low oil prices, the petroleum industry seeks cost-effective strategies such as automating traditionally labor-intensive processes. Nevertheless, the potential of applying ML to geological image interpretation is still facing a few key challenges including data scarcity, data distribution, poor data and/or label quality, data leakage, learning algorithms, model architecture, training methodologies, testing and evaluation metrics, hyper-parameters optimization, model drift, production deployment, and the like.

58 GEOSCIENCES↗

Implementation Plan for Combined Heat and Power Systems VOLTTRON Controller: Performance Monitoring and Real-Time Commissioning Algorithm Verification

Building-integrated cooling, heating, and power (CHP) systems are more efficient than conventional systems at providing local power and thermal energy, and favorable fuel prices are bound to spur their increased adoption. However, to realize the full benefit of the CHP systems, we must ensure persistence of energy efficient operations. Much of the inefficiency in the current building operations can be eliminated by use of automated performance monitoring (PM), real-time commissioning verification (CxV) and automated fault detection and diagnostic (AFDD) tools. Automation can help system operators make intelligent decisions. Remote and continuous monitoring of system conditions and performance will enable better management and integration of CHP with existing building systems. Continuous PM, real-time CxV, and AFDD could alleviate burdens for operations staff, enhance operations and maintenance (O&M), and improve reliability of building and CHP systems. To address the O&M challenges and to provide a means to maximize the rate-of-return of building-integrated CHP systems, the Building Technologies Office (BTO) within the U.S. Department of Energy’s (DOE’s) Office of Energy Efficiency and Renewable Energy (EERE) initiated a project to design, develop, and field test a VOLTTRON™-based supervisory controller and associated open-source algorithms. These algorithms will ensure real-time optimal operation of a building-integrated CHP system, support electric grid reliability, and lead to achieving the goal of clean, efficient, reliable, and affordable next-generation integrated energy system. Previous report listed the components for which PM, real-time CxV, and AFDD algorithms will be developed, how the algorithms will be tested, and the metrics that will be used to validate the algorithms and their ease of deployment. Deployment of these algorithms in the field will result in a reduction in energy consumption of between 10% and 20% (for both CHP and conventional building systems). This report builds upon the previous report by detailing the process by which PNNL will implement performance monitoring and real-time commissioning algorithms for CHP systems in conjunction with the use of the VOLTTRON CHP economic dispatch agent in host facilities.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Developing Flexible, Networked Lighting Control Systems That Reliably Save Energy in California Buildings

An important strategy to meet California's ambitious energy efficiency goals is to use innovative wireless communications, embedded sensors, data analytics and controls to significantly reduce lighting energy use in commercial buildings. This project developed a suite of networked lighting solutions to further this goal. The technologies include a platform for low-cost sensing, distributed intelligence and communications, the “PermaMote,” which is a self-powered sensor and controller for lighting applications. The project team also developed a task ambient daylighting system that integrates sensors with data-driven daylighting control using an open communication interface, called the “Readings-At-Desk” (RAD) system. To address the problem of building occupants being confused about how to operate traditional lighting control systems, the research team created content that could be the basis for a user interface standard for lighting controls. Finally, to address the difficulty of ensuring that advanced lighting control systems actually deliver their promised energy savings, the project team developed a new method for evaluating and specifying lighting systems’ performance. The research team validated these technologies in the laboratory, showing significant lighting energy savings, up to 73% for the PermaMote sensor system from occupancy control and daylight dimming features, compared to the same light source (LED replacement lamps) operated via simple on/off scheduling. The project team also developed a proposed standard lighting data model and user interface elements, which were contributed to the ANSI Lighting Systems Committee (C137) for standardization. Existing data models are incomplete and inconsistent, whereas the lighting-specific data model developed here is clear and comprehensive, to serve as a starting point for creating common, universally agreed upon semantic definitions of key lighting parameters, to promote interoperability. For the task on verifiable performance of lighting systems, the project team developed a more effective metric for capturing the actual energy impact of a lighting system over time — the energy usage intensity (kWh/ft2/year). Three commercial lighting systems were tested in FLEXLAB® using this new metric, and the tests show a wide range in the accuracy of the self-reported energy-use metric, from 0.5% to 28% error compared to direct measurement of lighting energy using dedicated submeters. Overall, the project team estimates that these advanced technologies can reduce California office lighting energy use by 20% (above and beyond normal advanced lighting controls mandated by Title 24), resulting in about 1,600 GWh/year in savings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Performance Metric for Cementitious Waste Form Inventory Release in the Integrated Disposal Facility

This report describes work supporting Phase 1 of the 2018 Department of Energy (DOE) Office of River Protection’s (ORP) Grand Challenge recipient proposal “Cementitious Immobilization of Treated LAW and Ancillary Benefits to Risk Reduction in Cross Site Transfer”. Phase 1 was to establish a performance metric for grout leachability against which laboratory leach data (as observed diffusivities) can be assed, followed by a comparison of historical test data against this metric. Historically, advancements in the cementitious (grout) waste form performance have been made over the last 40 years, with the majority of progress achieved within the past 8 years as part of the Washington River Protection Solutions, LLC testing program. This report presents a summary of that effort relevant to the Hanford Site.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Selecting and Implementing Resilience Metrics in Existing Energy Sector Models [Slides]

Resilience is a topic receiving much attention in relation to energy systems, with particular attention being paid to the supply of electricity. As a result of the growing interest in energy sector resilience, research communities have proposed a plethora of candidate resilience indicators and metrics, most of which remain immature at different scales and segments within the energy system. A necessary focus of the research community lies in implementing, testing, and validating resilience metrics and analysis approaches in energy sector models, which will be invaluable for informing resilience planning and investment decisions. Recognizing these challenges that need to be addressed, we explore how to effectively integrate resilience considerations into energy sector models and tools. The overarching goal of the effort was to evaluate the data needs, methodologies, and outcomes - including consequences and/or changes in investment or operational decisions due to avoided consequences - based on resilience analysis in a range of existing tools. In particular, we selected five models originally built at NREL to explore non-resilience energy research questions to implement and exercise resilience metrics and analysis approaches. To demonstrate the importance of perspective, we selected models that represent different segments of the energy sector, geographic scales, and modeling approaches. A second important aspect of our effort was the development of generalized power interruption scenarios. These scenarios were intended to help establish a framework for simulating the effects of real-world threats in terms of their impacts on system components and, in turn, power interruption.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Adapting Existing Energy Models for Resilience Analysis

Resilience is a topic receiving much attention in relation to energy systems, with particular attention being paid to the supply of electricity. As a result of the growing interest in energy sector resilience, research communities have proposed a plethora of candidate resilience indicators and metrics, most of which remain immature at different scales and segments within the energy system. A necessary focus of the research community lies in implementing, testing, and validating resilience metrics and analysis approaches in energy sector models, which will be invaluable for informing resilience planning and investment decisions. Recognizing these challenges that need to be addressed, we explore how to effectively integrate resilience considerations into energy sector models and tools. The overarching goal of the effort was to evaluate the data needs, methodologies, and outcomes—including consequences and/or changes in investment or operational decisions due to avoided consequences—based on resilience analysis in a range of existing tools. In particular, we selected five models originally built at NREL to explore non-resilience energy research questions to implement and exercise resilience metrics and analysis approaches. To demonstrate the importance of perspective, we selected models that represent different segments of the energy sector, geographic scales, and modeling approaches. A second important aspect of our effort was the development of generalized power interruption scenarios. These scenarios were intended to help establish a framework for simulating the effects of real-world threats in terms of their impacts on system components and, in turn, power interruption.

ENERGY PLANNING, POLICY, AND ECONOMY↗

HFIR High Power HEU Neutronics Analyses

Department of Energy National Nuclear Security Administration Office of Material Management and Minimization’s mission includes the conversion of civilian research reactors from highly enriched uranium (HEU) to low-enriched uranium (LEU) fuel. Analyses have shown that the Oak Ridge National Laboratory High Flux Isotope Reactor (HFIR) will need to operate at 95 MW for the LEU silicide dispersion fuel designs to match key performance metrics obtained with HEU fuel at 85 MW. To prove safe operation of HFIR after installation of plant modifications to increase power, a high power HEU test cycle was proposed. Neutronics model updates and reactor physics analyses are performed to support the development of safety design reports for the high power (HP) HEU test cycle. Reactor physics metrics evaluated herein include fuel depletion, actinide production, cycle length, fission rate density distributions, axial power peaking factors, and reactor kinetic parameters. These reactor physics analyses support the development of future LEU safety design reports by providing key input for future HP HEU HFIR thermal hydraulics and reactor transient safety analyses.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Image Distinguishability Analysis Testing Through Principal Components and Its Application to Hot Spot Scale Invariance

Hot spots are spatial regions of intense energy localization that govern initiation of secondary high explosives. Studies that characterize or compare simulated hot spots are frequently either qualitatively descriptive or resort to quantitative distribution functions that neglect stochastic variations and spatial correlations—effects that are also neglected in common comparison tests like the Kolmogorov–Smirnov test. To this end, we develop an image distinguishability analysis (IDA) test based on principal component (PC) analysis that makes pixel-by-pixel comparisons between small, for example, O(<10), image data sets. The IDA test makes comparisons through a generalized distance metric in the PC space and a test statistic that is derived to calculate mathematical equation-values. Here, we derive a statistical distribution and criticality criterion to determine whether images are distinguishable from established baselines. We apply the IDA test on images generated from molecular dynamics simulations of hot spots from pore collapse in TATB to assess scale invariance in the complex patterns of hot spots that form in a representative high explosive crystal. The IDA test shows that TATB hot spot spatial temperature fields and their derived temperature histograms exhibit scale-invariant features over specific intervals of shock orientation, strength, and initial pore diameter. However, the IDA test also shows that qualitatively different conclusions regarding invariance can be reached depending on whether the hot spot is treated as a spatially correlated field as opposed to a distribution function that lacks spatial information.

organic↗

The Triple Catalytic Action of Tertiary Nitrogen Catalysts in Recyclable Epoxy-Anhydride Thermosets

The thermosetting polymer matrix in fiber reinforced composites is an important component for energy related applications, such as the lightweighting of vehicles or their use in wind and waterpower turbine blades, due to their ability to provide superior adhesion, stiffness, and applicability to a wide range of manufacturing processes. Despite these benefits, today's thermosets are widely considered to be unrecyclable; thus, there is a large interest in redesigning these materials to be inherently recyclable so that energy intensive production of fibers and monomers can be circumvented, bolstering composite manufacture supply chains. Polyester covalent adaptable networks (PECANs) are one such promising alternative to the incumbent, nonrecyclable epoxy-amine thermosets. PECANs can be formed from the ring-opening co-polymerization (ROCOP) of epoxy-anhydride monomer mixtures and subsequent curing at mild temperatures to exhibit similar performance to conventional epoxies while also possessing unique dynamic chemistries along the ester-hydroxyl backbone that are capable of transesterification and thus reprocessability. While significant advancements have been made in formulating these materials for improved mechanical properties or optimizing solvolysis and reprocessing strategies, less attention has been placed on the impact of the residing amine catalyst used to generate the polyester network. In this work, we evaluated the triple-catalytic efficacy of 12 tertiary amines that act as a curing (bulk ROCOP), a transesterification (internal bond exchange), and a deconstruction (methanolysis) catalyst for PECAN thermosets. Specifically, we first distinguish between chain-growth and step-growth polymerization mechanisms for epoxy-amine and epoxy-anhydride mechanisms. We also utilized density functional theory (DFT) to estimate the basicity (pKb) of each catalyst. Of the tested catalysts, the ROCOP of the studied PECAN network can be completed between 95 and 247 min (at 80 degrees C), with variable gelation phenomena. Additionally, the stress relaxation (transesterification metric) efficiency of the tested PECAN networks with alternative embedded catalysts ranged from 95% to 15% reduction in stress after 5 h at 200 degrees C, and the depolymerization efficacy ranged from 2.5% to 9.8% deconstruction after 36 h at 130 degrees C. Overall, the nitrogen-based moieties were demonstrated to influence polymerization kinetics, catalyze the dynamic transesterification exchange mechanism, and aid in the solvolysis of the thermosets at end-of-life.

36 MATERIALS SCIENCE↗

Power Prediction of Airborne Wind Energy Systems Using Multivariate Machine Learning

Kites can be used to harvest wind energy at higher altitudes while using only a fraction of the material required for conventional wind turbines. In this work, we present the kite system of Kyushu University and demonstrate how experimental data can be used to train machine learning regression models. The system is designed for 7 kW traction power and comprises an inflatable wing with suspended kite control unit that is either tethered to a fixed ground anchor or to a towing vehicle to produce a controlled relative flow environment. A measurement unit was attached to the kite for data acquisition. To predict the generated tether force, we collected input–output samples from a set of well-designed experimental runs to act as our labeled training data in a supervised machine learning setting. We then identified a set of key input parameters which were found to be consistent with our sensitivity analysis using Pearson input–output correlation metrics. Finally, we designed and tested the accuracy of a neural network, among other multivariate regression models. The quality metrics of our models show great promise in accurately predicting the tether force for new input/feature combinations and potentially guide new designs for optimal power generation.

17 WIND ENERGY↗

Comprehensive Evaluation for Protective Coatings: Optical, Electrical, Photoelectrochemical, and Spectroscopic Characterizations

Numerous efficient semiconductors suffer from instability in aqueous electrolytes. Strategies utilizing protective coatings have thus been developed to protect these photoabsorbers against corrosion while synergistically improving charge separation and reaction kinetics. Recently, various photoelectrochemical (PEC) protective coatings have been reported with suitable electronic properties to ensure low charge transport loss and reveal the fundamental photoabsorber efficiency. However, protocols for studying the critical figures of merit for protective coatings have yet to be established. For this reason, we propose four criteria for evaluating the performance of a protective coating for PEC water-splitting: stability, conductivity, optical transparency, and energetic matching. We then propose a flow chart that summarizes the recommended testing protocols for quantifying these four performance metrics. In particular, we lay out the stepwise testing protocols to evaluate the energetics matching at a semiconductor/coating/(catalyst)/liquid interface. Finally, we provide an outlook for the future benchmarking needs for coatings.

36 MATERIALS SCIENCE↗

Prioritizing Off-gas Metrics

Off-gas research within the Material Recovery and Waste Form Development (MRWFD) team is dispersed among four national laboratories and multiple universities and small businesses. Ensuring research is conducted consistently and in a manner conducive to direct comparison is a nontrivial task. The team assembled to realign goals and expectations by identifying distinct R&D phases, prioritizing crucial metrics, and outlining standardized tests specifically associated with Kr, Xe, and I capture.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Evaluating Synthetic Smart Meter Locations For Communication System Modeling

An important part of good communication models for smart grid applications, particularly when wireless protocols are used, is the location information of the nodes. We’ve developed metrics to assist in evaluating whether a given model with such information is representative of feeders found in the world. These metrics are applied to a set of feeder models with known good location information for the smart meter locations and compared to a set of feeder models with similar location information that is not expected to be representative of real-world feeders. The comparison reveals that the suspect models do not pass statistical tests utilizing the developed metrics, providing initial validation of the analysis technique.

smart meter, feeder model, GridLAB-D↗

A building performance-based approach to determining energy resilience for grocery stores in the event of a power outage

Evaluating progress toward a built environment that is best equipped to serve communities during a regional power outage will require metrics that capture the energy resilience of the unique buildings and businesses most crucial to the well-being of those nearby. We focused on grocery stores as key buildings for which access, and thus energy resilience, is critical during a disaster when power is unavailable. We evaluated the energy resilience of these buildings by offering and testing building-scale metrics that assess business continuity potential during a power outage. Metrics proposed in this study are calculated based on the unique power loads characteristic to grocery stores, primarily refrigeration and maintaining safe indoor environmental conditions. Building simulations based on varying levels of backup power were carried out against occupant safety and comfort parameters to apply these metrics, with additional criteria imposed on grocery stores to capture the inventory and sales loss from food spoilage resulting from a lack of refrigeration power. Findings from this study demonstrate the feasibility of our proposed metrics and methodology to serve as a low-data burden means for stakeholders to evaluate the energy resilience of grocery stores, with greater implications in helping to understand the impact on community-scale energy resilience.

Siegel, Lino Sanchez↗

Development of an All-Aqueous Thermally Regenerative Redox Flow Battery to Support Fossil Fuel Assets

Low-temperature thermal energy, a largely untapped resource, holds significant promise for large-scale electrical power generation globally. Various stationary sources, including industrial entities and thermal power plants, emit considerable low-temperature heat that currently remains unutilized. This energy is often overlooked because its low temperature renders it unsuitable for efficient power generation using conventional methods. However, current research is exploring diverse technologies capable of converting low-temperature heat into grid-scale power, aiming to enhance grid efficiency, further decarbonization initiatives, and facilitate a shift toward more decentralized power systems. One such innovative technology is the thermally regenerative battery (TRB), noted for its high power and energy densities compared to similar technologies, positioning it as a potential game-changer in power generation. TRBs integrate two scalable and well-established unit operations: a redox flow battery and a distillation column. This integration suggests that once an effective TRB chemistry is established, the pathway to commercialization could be expedited. The copper-based thermally regenerative ammonia battery (Cu aq -TRAB) stands out as the first TRB that circumvents electrodeposition/dissolution reactions, stabilizing Cu(I) and Cu(II) within the electrolyte and maintaining stability of all electroactive species in an aqueous phase. This stabilization has led to improvements in coulombic efficiency, open circuit potential, and copper solubility, thereby enhancing power density, energy density, and overall energy efficiency. Preliminary tests were conducted to determine the effects of various electrolyte species on the performance metrics of the battery, both theoretically and experimentally. These tests revealed that the solubility of copper in the Cu aq -TRAB electrolyte was constrained by the Cu(I)-NH 3 complex. Adjusting the background electrolyte to 5 M NH4Br and the ligand concentration to 4 M NH 3 enabled the copper concentration to reach a maximum of 0.6 M. This modification led to an estimated theoretical maximum energy density of 9.5 Wh L -1 for the Cu aq -TRAB. Additionally, full cell testing indicated a tradeoff between peak power and energy density with varying copper and ammonia concentrations. Increasing the applied current density during discharge linearly raised the average power output, with a minimal reduction in energy density due to a balance between higher ohmic overpotential and reduced time for undesirable ammonia crossover. Furthermore, a comprehensive numerical sensitivity analysis of the complete Cu aq -TRAB system was performed. This analysis aimed to assess how the battery and the distillation column responded to changes in system input parameters, providing insights into optimal research directions for enhancing system performance. The analysis revealed that at room temperature, battery power was significantly more sensitive to ohmic losses than to mass transfer, with reaction rates having minimal impact. This trend continued even at higher temperatures. Also, the thermal energy required for ammonia separation was studied, showing that increased temperatures generally reduced energy requirements, except in low-pressure scenarios above 65 °C. An investigation into membrane performance in the Cu aq -TRAB was undertaken, given the significant impact of ammonia transport control and ohmic losses on system performance. Various membranes were evaluated to identify key performance metrics. Among the tested membranes, Selemion CMVN exhibited the highest performance, with a peak power density of 84 mW cm -2 and average values of 26 ± 6.8 mW cm -2 for power density and 2.9 Wh L -1 for energy density at an applied current density of 50 mA cm -2 . An economic assessment indicated a levelized cost of storage at $410 per MWh under optimal conditions, highlighting the commercial potential of the Cu aq -TRAB when utilizing cost-effective, readily available materials.

25 ENERGY STORAGE↗

Optimal Transport for e/$\pi^0$ Particle Classification in LArTPC Neutrino Experiments

Separation of electron signals from $\pi^0$ backgrounds is crucial for neutrino oscillation measurements and searches for Beyond Standard Model (BSM) physics in current and future Liquid Argon Time Projection Chamber (LArTPC) experiments. e/$\pi^0$ separation has been a reconstruction challenge since both e and $\pi^0$ present as electromagnetic showers, and often only one out of the two showers produced by $\pi^0$ is reconstructed correctly. This research aims to improve the performance of e/$\pi^0$ separation using optimal transport (OT), by leveraging on the topological differences in the showers produced by the two particles. OT is a method which compares two distributions by finding the most efficient way to transform, or “move” from one to the other. This work uses the MicroBooNE open samples public dataset to test the e/$\pi^0$ separation performance of the method on events which incorporate realistic modeling of LArTPC detector response. Reconstructed 3D energy deposits are projected onto a plane perpendicular to the primary shower, allowing OT to better detect the topological differences between the two types of particles without the need to separately reconstruct all the showers in the events. Different distance metrics for OT are tested and preliminary results on e/$\pi^0$ separation are presented.

43 PARTICLE ACCELERATORS↗

Automated, high-accuracy classification of textured microstructures using a convolutional neural network

Crystallographic texture is an important descriptor of material properties but requires time-intensive electron backscatter diffraction (EBSD) for identifying grain orientations. While some metrics such as grain size or grain aspect ratio can distinguish textured microstructures from untextured microstructures after significant grain growth, such morphological differences are not always visually observable. This paper explores the use of deep learning to classify experimentally measured textured microstructures without knowledge of crystallographic orientation. A deep convolutional neural network is used to extract high-order morphological features from binary images to distinguish textured microstructures from untextured microstructures. The convolutional neural network results are compared with a statistical Kolmogorov–Smirnov tests with traditional morphological metrics for describing microstructures. Results show that the convolutional neural network achieves a significantly improved classification accuracy, particularly at early stages of grain growth, highlighting the capability of deep learning to identify the subtle morphological patterns resulting from texture. The results demonstrate the potential of a convolutional neural network as a tool for reliable and automated microstructure classification with minimal preprocessing.

36 MATERIALS SCIENCE↗

Efficient and Reliable Power Takeoff for Ocean Wave Energy Harvesting

The project goal is to significantly improve the current ocean wave energy harvesting through innovative Power Take-off (PTO) design, advanced power electronics, and novel wave capture structures. The objective of the project is to design and demonstrate system-agnostic components for application across multiple MHK systems, and complete component designs, build scaled prototypes, and perform testing and analysis for metric validation of 25% increase in component rating/per unit cost and 50% reduction in failure rate. The major innovation of the PTO is the Mechanical Motion Rectifier (MMR) mechanism that rectifies the bi-directional oscillatory motion of the input from waves into a steady unidirectional rotation output to directly drive the electrical generator. Through this mechanism, the efficiency and the fatigue life of the PTO can be significantly improved to benefit the energy absorption and lifespan of the wave energy converters (WEC). During the period of performance, the component and system design are completed, the scaled prototypes are developed and performed testing. It is validated that the 25% increase in a component rating/per unit cost. The 50% reduction in failure rate is not directly validated by experiments, however, it can be explained qualitatively with analysis. Besides, 8 journal articles, 13 conference proceedings, 1 patent, 3 Master thesis and two Ph.D. dissertations are published based on the work related to this project. The list of all the publications can be found at the end of the project as an appendix. Over 30 students and postdocs were trained through this project. Three prototypes of 100W and 500W WECs and 10KW PTO were designed, built, and tested in ocean wave tank and using the NREL dynamometer. This project demonstrated 50-80% PTO efficiency, 90-98% power electronics efficiency, up to 66% capture width ratio in irregular waves, and 34% overall efficiency in regular waves.

16 TIDAL AND WAVE POWER↗