Search NASA⌕ Search

SEARCH · Search NASA

Results for “Effectiveness evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Industrial Energy Assessment Training Effectiveness Evaluation: An Eye-Tracking Study

It is essential to understand the effectiveness of any training program so it can be improved accordingly. Various studies have applied standard metrics for the evaluation of visual behavior to recognize the areas of interest that attract individuals’ attention as there is a high correlation between attentional behavior and where one is focusing on. However, through reviewing the literature, we believe that studies that applied eye-tracking technologies for training purposes are still limited, especially in the industrial energy assessment training field. In this paper, the effectiveness of industrial energy assessment training was quantitatively evaluated by measuring the attentional allocation of trainees using eye-tracking technology. Moreover, this study identifies the areas that require more focus based on evaluating the performance of subjects after receiving the training. Additionally, this research was conducted in a controlled environment to remove the distractions that may be caused by environmental factors to only concentrate on variables that influence the learning behavior of subjects. The experiment results showed that after receiving the training, the subjects’ performance in energy assessment was significantly improved in two areas: production, and recycling and waste management, and the designed training program enhanced the knowledge of participants in identifying energy-saving opportunities to the knowledge level of experienced participants.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Intermediate-Term Thermal Aging Effect Evaluation for Grade 92 and 316L at The LWR Relevant Temperature

Life extension of the existing nuclear reactors imposes accumulated damages, such as higher fluences and longer period of corrosion, to structural materials, which would result in significant challenges to the traditional reactor materials such as type 304 and 316 stainless steels. Advanced alloys with superior radiation resistance will increase safety margins, design flexibility, and economics for not only the life extension of the existing fleet but also new builds with advanced reactor designs. The Electric Power Research Institute (EPRI) teamed up with Department of Energy (DOE) on the Advanced Radiation Resistant Materials (ARRM) program, aiming to develop and test degradation resistant alloys from current commercial alloy specifications by 2021 to a new advanced alloy with superior degradation resistance in light water reactor (LWR)-relevant environments by 2024. Based on a comprehensive microstructure and property screening performed in Phase-1 of the ARRM program, a total of five alloys, together with 316L and X-750 as references, were down-selected for Phase-2 neutron irradiation studies. Because thermal aging could exert a synergistic effect on neutron irradiation due to the low neutron damage rate on the order of 10 –7 displacements per atom per second (dpa/s), Grade 92 (one of the five down-selected alloys) and two heats of 316L were selected in this task to study the effect of aging at 350°C for 12.5–12.7 kh on microstructure and mechanical properties. The aging time is approximately corresponding to 5 dpa neutron irradiation, which can be served as a reference for the 5-dpa-irradiated samples of the alloys to help understand the independent neutron damage influence on microstructure and mechanical properties. Optical microscopy and scanning electron microscopy were used for microstructural characterization. Hardness, tensile, Charpy impact toughness, and fracture toughness in the ductile regime of the aged samples were examined. The aging of Grade 92 led to the formation of many Laves phase in sizes of ~100–200 nm and resulted in some reduction in hardness and yield/ultimate tensile strength with some increases in uniform and total plastic elongations, which may have helped the enhancement of Charpy impact toughness, e.g., ~4 J increase in upper-shelf energy and 20.5°C reduction in ductile-brittle transition temperature compared with the unaged condition. The fracture toughness of the aged Grade 92 showed decent toughness of ~303 MPa√m (K Jq ) with ~87 tearing modulus at 22°C, which reduced to ~241 MPa√m (~20% reduction) with ~75 tearing modulus at 300°C. The two heats of 316L are differentiated by their amounts of δ-ferrite, i.e., ~1 vol% in heat T1103 and ~4 vol% in heat N5B8. The two heats of 316L were subjected to 15% cold work (CW) as this condition is often used in nuclear reactors to help trapping radiation-induced defects and thus postpone the steady state swelling stage. The aging did not result in any noticeable microstructure changes, except for possible segregations at grain boundaries that need to be further investigated. The aging resulted in slight reduction in hardness of 316L-T1103 and slight increase in hardness of 316L-N5B8, which is consistent with their tensile testing results. The 15%CW might have introduced some inhomogeneity, resulting in large standard deviations in hardness, which were reduced after the aging. The aged 316L followed the same trend as the unaged condition for the strength and elongation results from the tensile testing. Minimum elongations appeared within ~300–600°C, above which the elongations seem to increase. Unlike the negligible or minor changes in microstructure, hardness and tensile results of the two heats of 316L, their fracture toughness showed noticeable difference. The aged 316L-T1103 showed good toughness of ~350 MPa√m with ~80 tearing modulus at 22°C, which reduced to ~271 MPa√m (~23% reduction) with ~83 tearing modulus at 300°C. In contrast, the aged 316L-N5B8 showed lower toughness of ~244 MPa√m with ~53 tearing modulus at 22°C, which reduced to ~180 MPa√m (~26% reduction) with ~31 tearing modulus at 300°C. The preliminary results indicate that the presence of high volume of δ-ferrite would noticeable impair fracture toughness although it may not influence hardness and tensile properties.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Long-Term Thermal Aging Effect Evaluation for Grade 92 and 316L at The LWR Relevant Temperature

Life extension of the existing nuclear reactors imposes accumulated damages, such as higher fluences and longer periods of corrosion, to structural materials, which would result in significant challenges to the traditional reactor materials such as type 304 and 316 stainless steels. Advanced alloys with superior radiation resistance will increase safety margins, design flexibility, and economics for not only the life extension of the existing fleet but also new builds with advanced reactor designs. The Electric Power Research Institute (EPRI) initiated a collaboration with the Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program on the Advanced Radiation Resistant Materials (ARRM) program, focused on developing and test degradation resistant alloys for light water reactor (LWR)- relevant environments. Based on a comprehensive microstructure and property screening, the ARRM program selected a total of five alloys (i.e., Grade 92, 310, 690, 718A, and 725), together with 316L and X-750 as references, for further investigations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Evaluating Effects of Shear Processing on 2D Crystalline Materials in 3D Metal Matrices: Atomistic Understanding of High Shear Deformation of Copper Graphene Composites

Composites made of copper and graphene demonstrate high strength, lubricity and enhanced electrical and thermal conductivity compared pure copper. However, manufacturing these composites at bulk volumes for industrial applications has been a big challenge. Shear deformation assisted processing is an effective method for manufacturing materials such as copper-graphene composites demonstrating ultra-fine grain structures and compositional homogeneity. Nevertheless, microstructural evolution of the composites and their property development under such conditions is not clearly understood currently. To rectify this gap in literature, high strain shear deformation of copper coated graphene foils was performed using a tribometer pin in this study. Changes in microstructure of the composite as well as the constituent components under shear deformation was correlated to process conditions. A sharp increase in the coefficient of friction attributed to rupture and smearing of graphene layer into copper substrate was observed during the shear processing. The coefficient of friction of the sheared copper/graphene composite was lower than that of pure copper, suggesting that partially worn graphene is effectively lubricious at the macroscale. A multimodal characterization of the processed region further revealed a shear deformation-induced ultrafine two-phase grain-structure consisting of copper and graphitic domains. Shear deformation reduced the copper grain size from around 50 – 100 µm to ~200 nm on an average and ~2 – 5 nm in some locations. The semicrystalline graphene films were observed to fracture into 10 – 50 µm size flakes. Oxygen enrichment was observed in the processed region. Finally, graphitic domain were identified for the first time in the copper matrix and not just at the grain boundaries providing evidence for a metastable composite microstructure as a result of solid phase processing at room temperature.

36 MATERIALS SCIENCE↗

Evaluating the effects of structural disorder on the magnetic properties of Nd 2 Zr 2 O 7

Motivated by the variation in reported lattice parameters of floating-zone-grown Nd 2 Zr 2 O 7 crystals, we have performed a detailed study of the relationship between synthesis environment, structural disorder, and magnetic properties. Using a combination of polycrystalline standards, electron-probe microanalysis, and scattering techniques, we show that crystals grown under atmospheric conditions have a reduced lattice parameter relative to pristine polycrystalline powders due to occupation of the Nd site by excess Zr (i.e., negative stuffing). In contrast, crystals grown under high-pressure Ar are nearly stoichiometric with an average lattice parameter approaching the polycrystalline value. While minimal disorder of the oxygen sublattices is observed on the scale of the average structure, neutron pair-distribution function analysis indicates a highly local disorder of the oxygen coordination, which is only weakly dependent on growth environment. Most importantly, our magnetization, heat capacity, and single-crystal neutron scattering data show that the magnetic properties of crystals grown under high-pressure Ar match closely with those of stoichiometric powders. Neutron scattering measurements reveal that the signature of magnetic moment fragmentation—the coexistence of all-in-all-out (AIAO) magnetic Bragg peaks and diffuse pinch-point scattering due to spin-ice correlations–persists in these nearly stoichiometric crystals. However, in addition to an increased AIAO transition temperature, the diffuse signal is seemingly stabilized and remains nearly unchanged upon warming to 800 mK. This behavior indicates that both the AIAO magnetic order and spin-ice correlations are sensitive to deviations of the Nd stoichiometry.

36 MATERIALS SCIENCE↗

Evaluating the Effectiveness of a Detection and Deterrent System in Reducing Golden Eagle Fatalities at Operational Wind Facilities

The Renewable Energy Wildlife Institute (REWI) was appointed as the prime awardee of DOE award number DE-EE0007883 to lead a team of scientists, wind developers, and technology manufacturers toward the overarching goal of evaluating the effectiveness of the current DTBird system in minimizing the risk of golden eagles (Aquila chrysaetos) and other large soaring raptors from approaching the rotor-swept zone (RSZ) of operating wind turbines. As part of this goal, the team set out to 1) quantify the expected reduction in collision risk for golden eagles from operation of the detection and deterrence modules in a manner that supports the approach used by the U.S. Fish and Wildlife Service (USFWS) to assess and credit facility operators for their efforts to minimize predicted collision fatalities and 2) provide information to help improve the technology to maximize its effectiveness. DTBird is an automated detection and audio deterrent system created by the Spanish company Liquen, designed to discourage birds from entering the RSZ of spinning wind turbines. The system uses cameras to automatically detect airborne targets of interest, records each such event in an online database, and triggers a warning signal (loud sound) if the tracked object has moved close to the turbine. If the object moves even closer to the RSZ, a more aggressive dissuasion signal is broadcast. To meet our objectives, the team conducted a two-year experiment at the Goodnoe Hills wind facility in Washington state, in which 14 turbines were outfitted with DTBird units. Daily, each DTBird-equipped turbine was randomly assigned to a control or treatment group. Treatment turbines operated with DTBird running as intended—broadcasting warning or deterrent signals when DTBird detected a target within range. On control turbines, no sound signals were broadcast if a moving target triggered the DTBird system. The team also flew unmanned aerial vehicles (UAVs) designed to coarsely mimic the general size, weight, and coloration of golden eagles in programmed flight transects across DTBird detection ranges to quantify DTBird’s ability to detect intended targets and to evaluate factors that influence the probability of detection and DTBird’s response distances. Additionally, the team evaluated the behavioral responses of in situ eagles exposed to spinning turbines alone (visual and sound influences) versus spinning turbines plus broadcasted DTBird audio deterrents, to estimate the effectiveness of deterrence by the DTBird system. The data and results from these investigations were combined with those from a pilot study conducted at the Manzana Wind Power Project in California to better evaluate DTBird’s effectiveness across different landscapes.

17 WIND ENERGY↗

ECAR-5067 Computational Evaluation on Effect of Edge-rounding in Circular to Annular Flow Transitions within a Hexagonal Duct

In this ECAR, the computational fluid dynamics (CFD) simulation of the duct with a cross-section varying from circle to annulus was performed to evaluate the effect of edge-rounding of the internal edges. The edge of circular channel and the edge of inner annular channel were rounded with the radius of curvature ranged from 0 mm to 20 mm. The CFD results show that the pressure loss of the duct can be reduced by increasing the radius of the rounded edge. Case-A results showed that the pressure drop can be significantly reduced by the edge-rounding, e.g., the pressure drop was reduced approximately 56% by the radius of curvature of 5.0mm, and reduced 70% by the radius of curvature of 20.0 mm although its effectiveness would be attenuated as the radius of curvature of edge increases. Results from Case-B showed the impact of rounding the inlet edge was practically negligible compared to the outlet edge. This ECAR could provide a guideline to determine the optimum inlet module design of the VTR fuel rod bundle.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Evaluating the Effectiveness of Soil Profile Rehabilitation for Pluvial Flood Mitigation Through Two-Dimensional Hydrodynamic Modeling

Pluvial flooding, driven by increasingly impervious surfaces and intense storm events, presents a growing challenge for urban areas worldwide. In Baltimore City, MD, USA, climate change, rapid urbanization, and aging stormwater infrastructure are exacerbating flooding impacts, resulting in significant socio-economic consequences. This study evaluated the effectiveness of a soil profile rehabilitation scenario using a 2D hydrodynamic modeling approach for the Tiffany Run watershed, Baltimore City. This study utilized different extreme storm events, a high-resolution (1 m) LiDAR Digital Terrain Model (DTM), building footprints, and hydrological soil data. These datasets were integrated into a fully coupled 2D hydrodynamic model, the City Catchment Analysis Tool (CityCAT), to simulate urban flood dynamics. The pre-soil rehabilitation simulation revealed a maximum water depth of 3.00 m in most areas, with hydrologic soil groups C and D, especially downstream of the study area. The post-soil rehabilitation simulation was targeted at vacant lots and public parcels, accounting for 33.20% of the total area of the watershed. This resulted in a reduced water depth of 2.50 m. Additionally, the baseline runoff coefficient of 0.49 decreased to 0.47 following the rehabilitation, and the model consistently recorded a peak runoff reduction rate of 4.10 across varying rainfall intensities. The validation using a contingency matrix demonstrated true-positive rates of 0.75, 0.50, 0.64, and 0 for the selected events, confirming the model’s capability at capturing real-world flood occurrences.

Baltimore City↗

Evaluating the effectiveness of a camera-based detection system to support informed curtailment and minimize eagle fatalities at wind energy facilities

The American Wind Wildlife Institute (AWWI – now Renewable Energy Wildlife Institute, REWI) – was appointed prime awardee of DOE award number DE-EE0007880 to lead a team of scientists, wind developers, and technology manufacturers in a collaborative evaluation of the effectiveness of a technology intended to help reduce eagle collisions with wind turbines. IdentiFlight, developed by Renewable Energy Systems (RES) in collaboration with Boulder Imaging, is an autonomous aerial monitoring and detection system. REWI partnered with ecological consultants, Western Ecosystems Technology, Inc. (WEST), to independently evaluate the performance of IdentiFlight reducing eagle collision risk under a suite of environmental conditions relative to the performance of a Biomonitor (human observer-based) Program. The project objectives were to 1) evaluate how IdentiFlight compared to biomonitors in detecting and identifying eagles under a suite of environmental conditions and 2) use the observation data to model how IdentiFlight and biomonitors reduced the eagle fatality prediction through informed curtailment. Field testing was to take place at two geographically distinct wind farms over two field seasons at each wind farm with a study design appropriate for meta-analyses across sites and years.

17 WIND ENERGY↗

Evaluating the Effects of Precipitation and Evapotranspiration on Soil Moisture Variability Within CMIP5 Using SMAP and ERA5 Data

=The effects of precipitation (Pr) and evapotranspiration (ET) on surface soil moisture (SSM) play an essential role in the land-atmosphere system. Here we evaluate multimodel differences of these effects within the Coupled Model Intercomparison Project Phase 5 (CMIP5) compared to Soil Moisture Active Passive (SMAP) products and ECMWF Reanalysis v5 (ERA5) as references in a frequency domain. The variability of SSM, Pr, and ET within three frequency bands (1/7 ~ 1/30 days -1 , 1/30 ~ 1/90 days -1 , and 1/90 ~ 1/365 days -1 ) after normalization is quantified using Fourier transform. We analyze the impact of ET and Pr on SSM variability based on a transfer function assuming that these variables form a linear time-invariant (LTI) system. For the total effects of ET and Pr on SSM variability, the CMIP5 estimations are smaller than the reference data in the two higher frequency bands and are larger than the reference data in the lowest frequency band. Besides, the effects on SSM by Pr and ET are found to be different across the three frequency bands. In each frequency band, the variability of the factor that dominates SSM (i.e., Pr or ET) from CMIP5 is smaller than that from the references. This study identifies the spatiotemporal distribution of differences between CMIP5 models and references (SMAP and ERA5) in simulating ET and Pr effects on SSM within three frequency bands. This study provides insightful information on how soil moisture variability is affected by varying precipitation and evapotranspiration at different time scales within Earth System Models.

54 ENVIRONMENTAL SCIENCES↗

Evaluating the effectiveness of M-AMBI with other biotic indexes in a temperate estuary

Need for a scalable and widely applicable index has been increasingly important. This study evaluates the applicability of the M-AMBI, a potential comprehensive index, at small spatial scales. M-AMBI was compared to regional indices (EMAP-E and GOM B-IBI), assessing response to natural environmental gradients and low oxygen stress. Results indicate poor agreement between indices with M-AMBI and GOM B-IBI showing positive correlation but significant disagreement in habitat condition. EMAP-E had no agreement. Indices showed similar patterns of better habitat scores in higher salinities. M-AMBI also showed a negative relationship with sediment organic matter and total nitrogen. DO influenced all indices with M-AMBI the most sensitive. However, mismatches between DO and index score were observed further calibration may be needed before adoption into programs. Altogether, the M-AMBI demonstrates potential at smaller, local scales, but additional studies are needed to validate its performance in different coastal environments and under different conditions.

54 ENVIRONMENTAL SCIENCES↗

Canada-US Blended Cyber-Physical Security Exercise (Final Report)

The Canada-US Blended Cyber-Physical Exercise was a successful, first of its kind, multiorganization and multi-laboratory exercise that culminated years of complex system development and planning. The project aimed to answer three driving research questions, (1) How do cyberattacks support malicious acts leading to theft or sabotage [at a nuclear site]? (2) What are aspects of an effective combined cyber-physical response? (3) How to evaluate effectiveness of that response? Which derived the following primary objectives, 1. The May 2023 Cyber-Physical Exercise shall present a cyber-attack scenario that supports malicious acts leading to theft or sabotage. 2. The May 2023 Cyber-Physical Exercise shall define aspects of an effective combined cyber-physical response. 3. Analysis of the May 2023 Cyber-Physical Exercise shall evaluate the effectiveness of the incident response against pre-established exercise evaluation criteria. 4. Analysis of the May 2023 Cyber-Physical Exercise shall assess the effectiveness of the evaluation criteria itself. 5. Exercises shall be performed in a real-life environment. The team believes these objectives were met, and the evidence will be presented in this report. Due to the novelty of the exercise, there were several lessons learned that will be presented in this report.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Evaluating Corrosion Effects on the Stainless Steel Components of the SAVY-4000/Hagan Nuclear Material Storage Containers: FY2022 Update

This report summarizes the work completed and underway for the Corrosion Working Group (CWG) for FY2022 in support of evaluating a greater than a 15 year design life for the SAVY4000. The CWG meets on an as needed basis to review new work, results or information regarding the corrosion of SAVY-4000 and Hagan nuclear material storage containers. The goal when analyzing corrosion is to develop a design life appropriate for the containers and to identify when a container should be removed from service. There are many parallel efforts associated with identifying and extending the service life of nuclear material storage containers. This report includes information from research and development efforts to address the lifetime. The CWG is closely related to surveillance activities and continues to play a role in identification of issues and paths forward for analysis of surveillance containers. This work summarizes the completed tasks for FY22 of the CWG while keeping in mind that some efforts continue into future years. Brief summaries of identified new avenues of work have been identified for FY23.

36 MATERIALS SCIENCE↗

Self-calibrating the look-elsewhere effect: fast evaluation of the statistical significance using peak heights

In experiments where one searches a large parameter space for an anomaly, one often finds many spurious noise-induced peaks in the likelihood. This is known as the look-elsewhere effect, and must be corrected for when performing statistical analysis. Here, this paper introduces a method to calibrate the false alarm probability (FAP), or p-value, for a given dataset by considering the heights of the highest peaks in the likelihood. Specifically, we derive an equation relating the global p-value to the rank and height of local maxima. In the simplest form of self-calibration, the look-elsewhere-corrected $\chi^2$ of a physical peak is approximated by the $\chi^2$ of the peak minus the $\chi^2$ of the highest noise-induced peak, with accuracy improved by considering lower peaks. In contrast to alternative methods, this approach has negligible computational cost as peaks in the likelihood are a byproduct of every peak-search analysis. We apply to examples from astronomy, including planet detection, periodograms, and cosmology.

79 ASTRONOMY AND ASTROPHYSICS↗

Evaluating the Effect of Electrolyte Additive Functionalities on NMC622/Si Cell Performance

Unstable electrode/electrolyte interface is the major cause of degradation for silicon (Si)-based anodes for lithium (Li)-ion batteries. Development of functional electrolyte additives can provide a viable path toward stabilizing the dynamic Si/electrolyte interface, which will benefit the development of high energy density Li-ion batteries. Here, we evaluate polymerizable electrolyte additives with varying functional groups (fluorocarbon, thiophosphate, and fluorophosphazene). The additives are examined using LiNi 0.6 Mn 0.2 Co 0.2 O 2 /Si full cells where the cycle performance and impedance are measured. Electrochemical tests show that the fluorine-containing additives provide better passivation at the Si electrode, leading to enhanced full cell performance. Here, among the three additives examined, best electrochemical performance is observed from the fluorocarbon-containing compound, followed by fluorophosphazene- and thiophosphate-containing compounds. Characterization of the solid electrolyte interphase (SEI) on cycled electrodes using Auger electron spectroscopy (AES), X-ray photoelectron spectroscopy (XPS), and attenuated total reflectance Fourier transform infrared spectroscopy (ATR-FTIR) reveal that higher concentration of fluorine and lithium oxide, and lower concentration of carbonate and organic species correlate with enhanced electrochemical performance.

25 ENERGY STORAGE↗

Evaluating the Effectiveness of Retrieval-Augmented Large Language Models in Scientific Document Reasoning

Despite the dramatic progress in Large Language Model (LLM) development, LLMs often provide seemingly plausible but not factual information, often referred as hallucinations. Retrieval-augmented LLMs provide a non-parametric approach to solve these issues by retrieving relevant information from external data sources and augment the training process. These models helps to trace evidence from an externally provided knowledge base allowing the model predictions to be better interpreted and verified. In this work, we critically evaluate these models in their ability to perform in scientific document reasoning tasks. To this end, we tuned multiple such model variants with science-focused instructions and evaluated them on a scientific document reasoning benchmark for the usefulness of the retrieved document passages. Our findings suggest that models justify predictions in science tasks with fabricated evidence and leveraging scientific corpus as pretraining data does not alleviate the risk of evidence fabrication.

• Artificial intelligence (AI) / machine learning ↗